[2025-09-25T17:00:01.978629] [INFO ] [MAIN ] Using last completed trading day: 2025-09-25 [2025-09-25T17:00:01.980848] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-25T17:00:01.980961] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-25T17:00:01.981002] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-25T17:00:02.966025] [DEBUG] [SYMBOL ] Found 2424 valid NYSE symbols. [2025-09-25T17:00:02.966192] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-25T17:00:02.966394] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-25T17:00:02.967275] [INFO ] [LOCAL ] Symbols cache updated with 2372 symbols. [2025-09-25T17:00:02.967336] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-25T17:00:02.967368] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-25T17:00:02.967426] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-25T17:00:02.967521] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-25T17:00:02.967951] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-25T17:00:02.968003] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-25T17:00:02.968178] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-25T17:00:02.968233] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2372 valid symbols. [2025-09-25T17:00:02.968266] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-25T17:00:02.968295] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-25T17:00:02.997389] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-25T17:00:03.023091] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-25T17:00:03.023277] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-25T17:00:03.023315] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-25T17:00:03.023344] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-25T17:00:03.023774] [WARN ] [STATE ] State set to: RUNNING [2025-09-25T17:00:03.023929] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-25T17:00:03.024334] [DEBUG] [LOCAL ] Found 2372 symbols in cached list. [2025-09-25T17:00:03.024386] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-25T17:00:03.024418] [INFO ] [MAIN ] Starting incremental update for 2372 symbols. [2025-09-25T17:00:03.024447] [INFO ] [MAIN ] Running in parallel mode [2025-09-25T17:00:03.024636] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2372 symbols [2025-09-25T17:00:03.752522] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:03.766696] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:03.766813] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-25T17:00:03.766856] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-25T17:00:03.766986] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-25T17:00:03.767027] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-25T17:00:03.767071] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-25T17:00:03.767105] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-25T17:00:03.814445] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:03.824230] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:03.824344] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-25T17:00:03.824383] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-25T17:00:03.824503] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-25T17:00:03.824595] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-25T17:00:03.824690] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-25T17:00:03.824741] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-25T17:00:04.133834] [DEBUG] [LOCAL ] AA: Loaded 53614 existing records from primary storage. [2025-09-25T17:00:04.134010] [INFO ] [MAIN ] AA: Loaded 53614 existing records. [2025-09-25T17:00:04.243037] [DEBUG] [LOCAL ] A: Loaded 50780 existing records from primary storage. [2025-09-25T17:00:04.249072] [INFO ] [MAIN ] A: Loaded 50780 existing records. [2025-09-25T17:00:04.908132] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:04.917125] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-25T17:00:04.917194] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-25T17:00:04.922770] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-25T17:00:04.922858] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-25T17:00:04.952341] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:04.952579] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-25T17:00:04.952624] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-25T17:00:04.952978] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-25T17:00:04.953036] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-25T17:00:05.412861] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:05.488574] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-25T17:00:05.523979] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:05.528104] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-25T17:00:05.909769] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:05.910265] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-25T17:00:05.929682] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-25T17:00:06.113059] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:06.119511] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:06.120628] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-25T17:00:06.120286] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-25T17:00:06.203385] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T17:00:06.204521] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-25T17:00:06.550192] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T17:00:06.551363] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-25T17:00:06.915478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T17:00:06.916602] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-25T17:00:06.986279] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T17:00:06.992339] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-25T17:00:07.199554] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-25T17:00:07.200630] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-25T17:00:07.551368] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-25T17:00:07.552627] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-25T17:00:07.816522] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-25T17:00:07.817503] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-25T17:00:07.917517] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T17:00:07.927899] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-25T17:00:07.989511] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T17:00:08.000983] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-25T17:00:08.088601] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-25T17:00:08.091572] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-25T17:00:08.106134] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T17:00:08.116444] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-25T17:00:08.378489] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-25T17:00:08.380027] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-25T17:00:08.728872] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T17:00:08.729996] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-25T17:00:08.834380] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T17:00:08.839500] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-25T17:00:09.411135] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T17:00:09.411967] [INFO ] [REMOTE ] AAM: Full fetch complete (965 records). [2025-09-25T17:00:09.412054] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-25T17:00:09.412578] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:00:09.412709] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:00:09.412770] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:00:09.412869] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-25T17:00:09.412990] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-25T17:00:09.413053] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-25T17:00:09.413098] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-25T17:00:09.413178] [INFO ] [MAIN ] Update Progress: 1/2372 symbols completed. AAM took 6.4s. Estimated remaining: 4h 12m 28s. Rate: 9.4 symbols/min [2025-09-25T17:00:09.603375] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:09.700275] [DEBUG] [LOCAL ] AAP: Loaded 52097 existing records from primary storage. [2025-09-25T17:00:09.700467] [INFO ] [MAIN ] AAP: Loaded 52097 existing records. [2025-09-25T17:00:09.807234] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T17:00:09.844414] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-25T17:00:09.974000] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:09.974261] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-25T17:00:09.974338] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-25T17:00:09.974908] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-25T17:00:09.974992] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-25T17:00:10.016452] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-25T17:00:10.085184] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-25T17:00:10.297293] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T17:00:10.307248] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-25T17:00:10.469209] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:10.469557] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-25T17:00:11.447441] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T17:00:11.453835] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-25T17:00:11.783047] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T17:00:11.796690] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-25T17:00:12.105062] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-25T17:00:12.116722] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-25T17:00:12.360138] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T17:00:12.374199] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-25T17:00:12.409071] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T17:00:12.414374] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-25T17:00:13.304584] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T17:00:13.318292] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-25T17:00:13.529580] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T17:00:13.535580] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-25T17:00:13.846888] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T17:00:13.858895] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-25T17:00:13.981727] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T17:00:13.992493] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-25T17:00:14.494824] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T17:00:14.500061] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-25T17:00:15.122663] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T17:00:15.134543] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-25T17:00:16.565771] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-25T17:00:16.573067] [INFO ] [REMOTE ] AAMI: Full fetch complete (30615 records). [2025-09-25T17:00:16.573206] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-25T17:00:16.816479] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T17:00:16.823040] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:00:16.823158] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:00:16.823205] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-25T17:00:16.823293] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-25T17:00:16.823350] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-25T17:00:16.823395] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-25T17:00:16.826266] [INFO ] [MAIN ] Update Progress: 2/2372 symbols completed. AAMI took 13.8s. Estimated remaining: 4h 32m 35s. Rate: 8.7 symbols/min [2025-09-25T17:00:16.888204] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (2.90 seconds). [2025-09-25T17:00:16.921529] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-25T17:00:17.088839] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:17.138595] [DEBUG] [LOCAL ] AAT: Loaded 30649 existing records from primary storage. [2025-09-25T17:00:17.138813] [INFO ] [MAIN ] AAT: Loaded 30649 existing records. [2025-09-25T17:00:17.179189] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-25T17:00:17.206358] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-25T17:00:17.363039] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:17.363386] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-25T17:00:17.363435] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-25T17:00:17.366952] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-25T17:00:17.367020] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-25T17:00:17.755802] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:17.756158] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-25T17:00:18.012965] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (2.88 seconds). [2025-09-25T17:00:18.027410] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-25T17:00:19.095008] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-25T17:00:19.106490] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-25T17:00:19.283900] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T17:00:19.292079] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-25T17:00:19.677420] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-25T17:00:19.695122] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-25T17:00:19.887373] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:00:19.904857] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-25T17:00:20.603790] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T17:00:20.611540] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-25T17:00:20.648238] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T17:00:20.659982] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-25T17:00:21.364026] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T17:00:21.375804] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-25T17:00:21.565984] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T17:00:21.580892] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-25T17:00:22.300320] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T17:00:22.312840] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-25T17:00:22.817490] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:00:22.829090] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-25T17:00:23.526609] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T17:00:23.542386] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-25T17:00:23.663314] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (3.05 seconds). [2025-09-25T17:00:23.671042] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-25T17:00:24.311394] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T17:00:24.329296] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-25T17:00:24.873710] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T17:00:24.885329] [INFO ] [REMOTE ] A: Full fetch complete (73064 records). [2025-09-25T17:00:24.885614] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-25T17:00:25.162116] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:00:25.178477] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T17:00:25.191520] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-25T17:00:25.263172] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-25T17:00:25.488140] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-25T17:00:25.488292] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-25T17:00:25.489464] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-25T17:00:25.489586] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-25T17:00:25.492282] [DEBUG] [LOCAL ] A: Trimmed 73064 records to 51143 (keeping 200 days of data) [2025-09-25T17:00:25.942632] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T17:00:25.965313] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-25T17:00:25.972156] [DEBUG] [LOCAL ] A: Primary data saved (51143 records). [2025-09-25T17:00:25.972359] [INFO ] [MAIN ] A: Full history saved. [2025-09-25T17:00:25.973561] [INFO ] [MAIN ] Update Progress: 3/2372 symbols completed. A took 22.9s. Estimated remaining: 5h 2m 2s. Rate: 7.8 symbols/min [2025-09-25T17:00:26.167127] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:26.167314] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-25T17:00:26.167355] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-25T17:00:26.168182] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-25T17:00:26.168239] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-25T17:00:26.168285] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-25T17:00:26.168320] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-25T17:00:26.518270] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T17:00:26.536006] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-25T17:00:26.621729] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:26.622064] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-25T17:00:26.859250] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:26.859568] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-25T17:00:26.860108] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-25T17:00:27.061289] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:27.063833] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-25T17:00:27.064832] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-25T17:00:27.173168] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T17:00:27.184349] [INFO ] [REMOTE ] AA: Full fetch complete (77536 records). [2025-09-25T17:00:27.184577] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-25T17:00:27.341431] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:27.341796] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-25T17:00:27.342289] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-25T17:00:27.650495] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-25T17:00:27.650583] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-25T17:00:27.651358] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-25T17:00:27.651430] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-25T17:00:27.658887] [DEBUG] [LOCAL ] AA: Trimmed 77536 records to 54004 (keeping 200 days of data) [2025-09-25T17:00:27.804454] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:27.804837] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-25T17:00:27.805342] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-25T17:00:28.070719] [DEBUG] [LOCAL ] AA: Primary data saved (54004 records). [2025-09-25T17:00:28.070870] [INFO ] [MAIN ] AA: Full history saved. [2025-09-25T17:00:28.072085] [INFO ] [MAIN ] Update Progress: 4/2372 symbols completed. AA took 25.0s. Estimated remaining: 4h 7m 8s. Rate: 9.6 symbols/min [2025-09-25T17:00:28.107248] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:28.107499] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-25T17:00:28.111366] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-25T17:00:28.278179] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:28.310679] [DEBUG] [LOCAL ] AB: Loaded 28323 existing records from primary storage. [2025-09-25T17:00:28.310836] [INFO ] [MAIN ] AB: Loaded 28323 existing records. [2025-09-25T17:00:28.333029] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:00:28.333380] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-25T17:00:28.367339] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-25T17:00:28.383378] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T17:00:28.390520] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-25T17:00:28.527489] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-25T17:00:28.556591] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-25T17:00:28.633127] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:28.633391] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-25T17:00:28.633459] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-25T17:00:28.634048] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-25T17:00:28.634112] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-25T17:00:29.023300] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:29.023726] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-25T17:00:29.137013] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T17:00:29.139229] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-25T17:00:29.814329] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:00:29.822341] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-25T17:00:29.850446] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T17:00:29.853247] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-25T17:00:30.240670] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T17:00:30.276176] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T17:00:30.284444] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-25T17:00:30.285789] [INFO ] [REMOTE ] AAP: Full fetch complete (75148 records). [2025-09-25T17:00:30.285990] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-25T17:00:30.678996] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T17:00:30.682960] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-25T17:00:30.783226] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-25T17:00:30.783322] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-25T17:00:30.784209] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-25T17:00:30.784276] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-25T17:00:30.786076] [DEBUG] [LOCAL ] AAP: Trimmed 75148 records to 52464 (keeping 200 days of data) [2025-09-25T17:00:31.130965] [DEBUG] [LOCAL ] AAP: Primary data saved (52464 records). [2025-09-25T17:00:31.131104] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-25T17:00:31.132069] [INFO ] [MAIN ] Update Progress: 5/2372 symbols completed. AAP took 21.7s. Estimated remaining: 3h 41m 46s. Rate: 10.7 symbols/min [2025-09-25T17:00:31.222198] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T17:00:31.230234] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-25T17:00:31.333254] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T17:00:31.359440] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-25T17:00:31.384045] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:31.384174] [DEBUG] [LOCAL ] ABBV: No existing data file found in primary storage. [2025-09-25T17:00:31.384232] [WARN ] [MAIN ] ABBV: No existing data found, performing full refresh instead. [2025-09-25T17:00:31.384355] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-25T17:00:31.384394] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-25T17:00:31.384435] [DEBUG] [LOCAL ] ABBV: No primary data file found to delete. [2025-09-25T17:00:31.384468] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-25T17:00:31.509558] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T17:00:31.514552] [INFO ] [REMOTE ] AAUC: Full fetch complete (7613 records). [2025-09-25T17:00:31.514767] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-25T17:00:31.836426] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-25T17:00:31.841463] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:00:31.841517] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:00:31.841557] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-25T17:00:31.841613] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-25T17:00:31.841674] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-25T17:00:31.841743] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-25T17:00:31.841825] [INFO ] [MAIN ] Update Progress: 6/2372 symbols completed. AAUC took 5.9s. Estimated remaining: 3h 9m 24s. Rate: 12.5 symbols/min [2025-09-25T17:00:32.187045] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:32.187234] [DEBUG] [LOCAL ] ABCB: No existing data file found in primary storage. [2025-09-25T17:00:32.187272] [WARN ] [MAIN ] ABCB: No existing data found, performing full refresh instead. [2025-09-25T17:00:32.187516] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-25T17:00:32.187560] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-25T17:00:32.187602] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-09-25T17:00:32.187634] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-25T17:00:32.290876] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:32.291205] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-25T17:00:32.575266] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T17:00:32.598728] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-25T17:00:32.685963] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:32.686317] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-25T17:00:32.948793] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T17:00:32.957485] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-25T17:00:33.987518] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T17:00:33.993772] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-25T17:00:34.100514] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T17:00:34.106221] [INFO ] [REMOTE ] AAT: Full fetch complete (42693 records). [2025-09-25T17:00:34.106325] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-25T17:00:34.362186] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T17:00:34.401756] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-25T17:00:34.454243] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-25T17:00:34.465486] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-25T17:00:34.659802] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-25T17:00:34.659894] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-25T17:00:34.660333] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-25T17:00:34.660378] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-25T17:00:34.662235] [DEBUG] [LOCAL ] AAT: Trimmed 42693 records to 30881 (keeping 200 days of data) [2025-09-25T17:00:34.878784] [DEBUG] [LOCAL ] AAT: Primary data saved (30881 records). [2025-09-25T17:00:34.879074] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-25T17:00:34.879179] [INFO ] [MAIN ] Update Progress: 7/2372 symbols completed. AAT took 18.0s. Estimated remaining: 2h 59m 22s. Rate: 13.2 symbols/min [2025-09-25T17:00:35.034316] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:00:35.044962] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-25T17:00:35.107791] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:35.157032] [DEBUG] [LOCAL ] ABEV: Loaded 53276 existing records from primary storage. [2025-09-25T17:00:35.157205] [INFO ] [MAIN ] ABEV: Loaded 53276 existing records. [2025-09-25T17:00:35.337854] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:35.339882] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-25T17:00:35.339937] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-25T17:00:35.340296] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-25T17:00:35.340356] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-25T17:00:35.729372] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:35.729834] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-25T17:00:35.886872] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:00:35.895522] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-25T17:00:35.930636] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T17:00:35.936860] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-25T17:00:36.580919] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T17:00:36.599110] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-25T17:00:36.792389] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T17:00:36.800550] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-25T17:00:37.309069] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T17:00:37.317482] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-25T17:00:37.377693] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:00:37.388492] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-25T17:00:37.670477] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T17:00:37.676842] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-25T17:00:38.626227] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-25T17:00:38.644803] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-25T17:00:38.737169] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T17:00:38.747905] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-25T17:00:38.881548] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:00:38.891152] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-25T17:00:38.950705] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:00:38.970227] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-25T17:00:39.884216] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T17:00:39.889537] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-25T17:00:40.278796] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T17:00:40.285185] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-25T17:00:40.676165] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T17:00:40.686853] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-25T17:00:40.748140] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T17:00:40.759695] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-25T17:00:40.826009] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T17:00:40.830813] [INFO ] [REMOTE ] AB: Full fetch complete (45805 records). [2025-09-25T17:00:40.830970] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-25T17:00:40.832054] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:00:40.832303] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:00:40.832392] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:00:40.832490] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-25T17:00:40.832565] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-09-25T17:00:40.832601] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-09-25T17:00:40.835202] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-09-25T17:00:40.837908] [INFO ] [MAIN ] Update Progress: 8/2372 symbols completed. AB took 12.8s. Estimated remaining: 3h 6m 14s. Rate: 12.7 symbols/min [2025-09-25T17:00:41.059295] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:41.059493] [DEBUG] [LOCAL ] ABG: No existing data file found in primary storage. [2025-09-25T17:00:41.059530] [WARN ] [MAIN ] ABG: No existing data found, performing full refresh instead. [2025-09-25T17:00:41.059770] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-25T17:00:41.059823] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-25T17:00:41.059892] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-09-25T17:00:41.059957] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-25T17:00:41.466523] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T17:00:41.496167] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-25T17:00:41.502625] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:41.502906] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-25T17:00:42.301487] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T17:00:42.306012] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-25T17:00:42.513484] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:00:42.527045] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-25T17:00:42.561878] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T17:00:42.571585] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-25T17:00:42.657057] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T17:00:42.674399] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-25T17:00:43.406040] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T17:00:43.411727] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-25T17:00:43.819621] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T17:00:43.827067] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-25T17:00:44.243752] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:00:44.258276] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-25T17:00:44.284776] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T17:00:44.291684] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-25T17:00:44.669742] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-25T17:00:44.684423] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-25T17:00:45.085918] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T17:00:45.094143] [INFO ] [REMOTE ] ABCB: Full fetch complete (44199 records). [2025-09-25T17:00:45.094432] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-25T17:00:45.097452] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:00:45.098962] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:00:45.099076] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:00:45.099158] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-25T17:00:45.099243] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-09-25T17:00:45.099312] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-09-25T17:00:45.099388] [DEBUG] [LOCAL ] ABCB: No derivative data file found to delete. [2025-09-25T17:00:45.099487] [INFO ] [MAIN ] Update Progress: 9/2372 symbols completed. ABCB took 13.3s. Estimated remaining: 3h 4m 7s. Rate: 12.8 symbols/min [2025-09-25T17:00:45.307433] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:45.307676] [DEBUG] [LOCAL ] ABM: No existing data file found in primary storage. [2025-09-25T17:00:45.307733] [WARN ] [MAIN ] ABM: No existing data found, performing full refresh instead. [2025-09-25T17:00:45.308166] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-25T17:00:45.308213] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-25T17:00:45.308258] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-09-25T17:00:45.308292] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-25T17:00:45.392749] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T17:00:45.410758] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-25T17:00:45.705042] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:45.705403] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-25T17:00:46.099830] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T17:00:46.114689] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-25T17:00:46.793981] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-25T17:00:46.808841] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-25T17:00:46.909262] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T17:00:46.919429] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-25T17:00:46.979920] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T17:00:46.986009] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-25T17:00:47.763077] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T17:00:47.779439] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-25T17:00:47.805375] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T17:00:47.810834] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-25T17:00:47.968791] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T17:00:47.977473] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-25T17:00:48.722901] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T17:00:48.736041] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-25T17:00:48.750281] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:00:48.755627] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-25T17:00:49.106928] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T17:00:49.113478] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-25T17:00:49.700619] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T17:00:49.705882] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-25T17:00:49.805432] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T17:00:49.820334] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-25T17:00:50.437535] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:00:50.444981] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-25T17:00:50.565939] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T17:00:50.584133] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-25T17:00:50.807474] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T17:00:50.813338] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-25T17:00:51.303465] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:00:51.315534] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-25T17:00:51.944917] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T17:00:51.957598] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-25T17:00:51.973395] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T17:00:51.977502] [INFO ] [REMOTE ] ABG: Full fetch complete (26410 records). [2025-09-25T17:00:51.977637] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-25T17:00:52.493440] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-25T17:00:52.493576] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-25T17:00:52.494072] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-25T17:00:52.494162] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-25T17:00:52.495342] [DEBUG] [LOCAL ] ABG: Trimmed 26410 records to 18922 (keeping 200 days of data) [2025-09-25T17:00:52.633677] [DEBUG] [LOCAL ] ABG: Primary data saved (18922 records). [2025-09-25T17:00:52.633869] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-25T17:00:52.634010] [INFO ] [MAIN ] Update Progress: 10/2372 symbols completed. ABG took 11.8s. Estimated remaining: 3h 15m 18s. Rate: 12.1 symbols/min [2025-09-25T17:00:52.802511] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T17:00:52.827220] [INFO ] [REMOTE ] ABBV: Full fetch complete (77720 records). [2025-09-25T17:00:52.827442] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-25T17:00:52.901204] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:53.142053] [DEBUG] [LOCAL ] ABR: Loaded 52104 existing records from primary storage. [2025-09-25T17:00:53.142374] [INFO ] [MAIN ] ABR: Loaded 52104 existing records. [2025-09-25T17:00:53.151903] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T17:00:53.218523] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-25T17:00:53.299366] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T17:00:53.343037] [INFO ] [REMOTE ] ABEV: Full fetch complete (77198 records). [2025-09-25T17:00:53.343339] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-25T17:00:53.862989] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:00:53.863396] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-25T17:00:53.863483] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-25T17:00:53.863890] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-25T17:00:53.863976] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-25T17:00:53.872731] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-25T17:00:53.872788] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-25T17:00:53.873630] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-25T17:00:53.873726] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-25T17:00:53.882240] [DEBUG] [LOCAL ] ABBV: Trimmed 77720 records to 54076 (keeping 200 days of data) [2025-09-25T17:00:54.545599] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T17:00:54.616127] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-25T17:00:54.865190] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-25T17:00:54.865319] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-25T17:00:54.866791] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-25T17:00:54.866893] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-25T17:00:54.876466] [DEBUG] [LOCAL ] ABEV: Trimmed 77198 records to 53665 (keeping 200 days of data) [2025-09-25T17:00:54.960743] [DEBUG] [LOCAL ] ABBV: Primary data saved (54076 records). [2025-09-25T17:00:54.960911] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-25T17:00:54.961030] [INFO ] [MAIN ] Update Progress: 11/2372 symbols completed. ABBV took 23.8s. Estimated remaining: 3h 5m 47s. Rate: 12.7 symbols/min [2025-09-25T17:00:55.327423] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:55.344920] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-25T17:00:55.489192] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:55.489996] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-09-25T17:00:55.490306] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-09-25T17:00:55.493335] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-25T17:00:55.493742] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-25T17:00:55.494374] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-25T17:00:55.494983] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-25T17:00:55.792845] [DEBUG] [LOCAL ] ABEV: Primary data saved (53665 records). [2025-09-25T17:00:55.792989] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-25T17:00:55.794481] [INFO ] [MAIN ] Update Progress: 12/2372 symbols completed. ABEV took 20.9s. Estimated remaining: 2h 52m 58s. Rate: 13.6 symbols/min [2025-09-25T17:00:56.048002] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:00:56.104783] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-25T17:00:56.210934] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:56.211128] [DEBUG] [LOCAL ] ACA: No existing data file found in primary storage. [2025-09-25T17:00:56.211166] [WARN ] [MAIN ] ACA: No existing data found, performing full refresh instead. [2025-09-25T17:00:56.211293] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-25T17:00:56.211335] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-25T17:00:56.211380] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-09-25T17:00:56.211414] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-25T17:00:56.262801] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:56.266847] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-25T17:00:56.676969] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:00:56.677360] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-25T17:00:57.366856] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T17:00:57.377529] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-25T17:00:57.437958] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T17:00:57.443792] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-25T17:00:57.492864] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T17:00:57.500615] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-25T17:00:58.091813] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T17:00:58.103219] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-25T17:00:58.603684] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T17:00:58.609683] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-25T17:00:58.750399] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:00:58.760122] [INFO ] [REMOTE ] ABM: Full fetch complete (44626 records). [2025-09-25T17:00:58.760424] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-25T17:00:58.937323] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:00:58.948097] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-25T17:00:59.323337] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-25T17:00:59.323473] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-25T17:00:59.324143] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-25T17:00:59.324240] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-25T17:00:59.326288] [DEBUG] [LOCAL ] ABM: Trimmed 44626 records to 32713 (keeping 200 days of data) [2025-09-25T17:00:59.519272] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T17:00:59.524859] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-25T17:00:59.638257] [DEBUG] [LOCAL ] ABM: Primary data saved (32713 records). [2025-09-25T17:00:59.638505] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-25T17:00:59.638858] [INFO ] [MAIN ] Update Progress: 13/2372 symbols completed. ABM took 14.5s. Estimated remaining: 2h 51m 13s. Rate: 13.8 symbols/min [2025-09-25T17:00:59.824472] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T17:00:59.843062] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-25T17:00:59.902671] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:00:59.902938] [DEBUG] [LOCAL ] ACCO: No existing data file found in primary storage. [2025-09-25T17:00:59.902980] [WARN ] [MAIN ] ACCO: No existing data found, performing full refresh instead. [2025-09-25T17:00:59.903157] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-25T17:00:59.903215] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-25T17:00:59.903286] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-25T17:00:59.903333] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-25T17:01:00.329824] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:00.330234] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-25T17:01:00.859840] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T17:01:00.870284] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-25T17:01:01.051358] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:01:01.058371] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-25T17:01:01.416525] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:01:01.426997] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-25T17:01:01.970731] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:01:01.978619] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-25T17:01:02.334423] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T17:01:02.344207] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-25T17:01:02.532297] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:01:03.088732] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-25T17:01:03.212782] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T17:01:03.275846] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T17:01:03.400553] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T17:01:03.888699] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-25T17:01:04.688718] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-25T17:01:05.085967] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T17:01:05.488697] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-25T17:01:05.896595] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T17:01:06.188539] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T17:01:06.288689] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-25T17:01:07.088680] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-25T17:01:07.349308] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T17:01:07.441341] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T17:01:07.888731] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-25T17:01:08.649331] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T17:01:08.688678] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-25T17:01:08.974402] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T17:01:09.488731] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-25T17:01:10.237258] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:01:10.288679] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-25T17:01:10.663037] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:01:11.088764] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-25T17:01:11.888740] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-25T17:01:12.117243] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T17:01:12.688736] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-25T17:01:12.923869] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:01:12.950973] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T17:01:12.962864] [INFO ] [REMOTE ] ACA: Full fetch complete (34131 records). [2025-09-25T17:01:12.963891] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-25T17:01:12.965261] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:01:12.968764] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:01:12.968911] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:01:12.969018] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-25T17:01:12.969154] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-09-25T17:01:12.969229] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-09-25T17:01:12.969313] [DEBUG] [LOCAL ] ACA: No derivative data file found to delete. [2025-09-25T17:01:12.969462] [INFO ] [MAIN ] Update Progress: 14/2372 symbols completed. ACA took 17.2s. Estimated remaining: 3h 16m 21s. Rate: 12.0 symbols/min [2025-09-25T17:01:13.177621] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:13.217771] [DEBUG] [LOCAL ] ACEL: Loaded 27124 existing records from primary storage. [2025-09-25T17:01:13.217923] [INFO ] [MAIN ] ACEL: Loaded 27124 existing records. [2025-09-25T17:01:13.399495] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:13.399860] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-25T17:01:13.399909] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-25T17:01:13.402746] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-25T17:01:13.402810] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-25T17:01:13.493826] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-25T17:01:13.843819] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:14.288725] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-25T17:01:14.420113] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T17:01:15.088710] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-25T17:01:15.191707] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:01:15.400471] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T17:01:15.888731] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-25T17:01:16.688717] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-25T17:01:16.833137] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T17:01:17.027355] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T17:01:17.488727] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-25T17:01:17.788236] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T17:01:18.288732] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-25T17:01:19.088727] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-25T17:01:19.428157] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:01:19.448528] [INFO ] [REMOTE ] ABR: Full fetch complete (75193 records). [2025-09-25T17:01:19.448841] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-25T17:01:19.577069] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T17:01:19.893886] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-25T17:01:19.975133] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-25T17:01:19.975303] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-25T17:01:19.976245] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-25T17:01:19.976326] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-25T17:01:19.982568] [DEBUG] [LOCAL ] ABR: Trimmed 75193 records to 52464 (keeping 200 days of data) [2025-09-25T17:01:20.350259] [DEBUG] [LOCAL ] ABR: Primary data saved (52464 records). [2025-09-25T17:01:20.350737] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-25T17:01:20.350895] [INFO ] [MAIN ] Update Progress: 15/2372 symbols completed. ABR took 27.7s. Estimated remaining: 3h 22m 31s. Rate: 11.6 symbols/min [2025-09-25T17:01:20.542459] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:20.646211] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-25T17:01:20.646421] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-09-25T17:01:20.654258] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:01:20.688923] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-25T17:01:20.881609] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:20.882625] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-25T17:01:20.882736] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-25T17:01:20.883581] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-25T17:01:20.883702] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-25T17:01:21.324317] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:21.488768] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-25T17:01:22.085456] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-25T17:01:22.122344] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:01:22.288727] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-25T17:01:22.559597] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T17:01:23.088730] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-25T17:01:23.888774] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-25T17:01:24.688844] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-25T17:01:25.149391] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-25T17:01:25.213559] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T17:01:25.306962] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T17:01:25.488733] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-25T17:01:25.803865] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T17:01:25.815559] [INFO ] [REMOTE ] ACCO: Full fetch complete (53873 records). [2025-09-25T17:01:25.815799] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-25T17:01:25.817149] [FATAL] [VALIDATOR ] ACCO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:01:25.817255] [FATAL] [MAIN ] ACCO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:01:25.817297] [WARN ] [MAIN ] ACCO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:01:25.817355] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-25T17:01:25.817479] [DEBUG] [LOCAL ] ACCO: No primary data file found to delete. [2025-09-25T17:01:25.817553] [INFO ] [LOCAL ] ACCO: Starting deletion of derivative data. [2025-09-25T17:01:25.817634] [DEBUG] [LOCAL ] ACCO: No derivative data file found to delete. [2025-09-25T17:01:25.817816] [INFO ] [MAIN ] Update Progress: 16/2372 symbols completed. ACCO took 26.2s. Estimated remaining: 3h 23m 11s. Rate: 11.6 symbols/min [2025-09-25T17:01:26.028409] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:26.112746] [DEBUG] [LOCAL ] ACI: Loaded 53269 existing records from primary storage. [2025-09-25T17:01:26.112919] [INFO ] [MAIN ] ACI: Loaded 53269 existing records. [2025-09-25T17:01:26.291604] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-25T17:01:26.321896] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:26.322138] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-25T17:01:26.322187] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-25T17:01:26.322468] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-25T17:01:26.322528] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-25T17:01:26.794147] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:27.088759] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-25T17:01:27.605547] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T17:01:27.888731] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-25T17:01:28.019858] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-25T17:01:28.694435] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-25T17:01:28.704242] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T17:01:28.736300] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:01:29.488753] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-25T17:01:30.288780] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-25T17:01:30.700384] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T17:01:31.088724] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-25T17:01:31.152980] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-25T17:01:31.888735] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-25T17:01:32.224531] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:01:32.236341] [INFO ] [REMOTE ] ABT: Full fetch complete (77197 records). [2025-09-25T17:01:32.236585] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-25T17:01:32.238231] [FATAL] [VALIDATOR ] ABT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:01:32.238349] [FATAL] [MAIN ] ABT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:01:32.238445] [WARN ] [MAIN ] ABT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:01:32.238531] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-25T17:01:32.238672] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-09-25T17:01:32.238735] [INFO ] [LOCAL ] ABT: Starting deletion of derivative data. [2025-09-25T17:01:32.238782] [DEBUG] [LOCAL ] ABT: No derivative data file found to delete. [2025-09-25T17:01:32.238879] [INFO ] [MAIN ] Update Progress: 17/2372 symbols completed. ABT took 37.3s. Estimated remaining: 3h 25m 59s. Rate: 11.4 symbols/min [2025-09-25T17:01:32.472640] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:32.569109] [DEBUG] [LOCAL ] ACM: Loaded 43152 existing records from primary storage. [2025-09-25T17:01:32.569427] [INFO ] [MAIN ] ACM: Loaded 43152 existing records. [2025-09-25T17:01:32.695796] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-25T17:01:32.798107] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:32.798508] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-25T17:01:32.798566] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-25T17:01:32.799075] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-25T17:01:32.799145] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-25T17:01:33.180123] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-25T17:01:33.274881] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:33.488781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-25T17:01:33.636511] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T17:01:34.288793] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-25T17:01:35.088743] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-25T17:01:35.364761] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-25T17:01:35.721747] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-25T17:01:35.888719] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-25T17:01:36.159545] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:01:36.485341] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:01:36.499319] [INFO ] [REMOTE ] ACEL: Full fetch complete (38920 records). [2025-09-25T17:01:36.499551] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-25T17:01:36.717766] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-25T17:01:36.962103] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-25T17:01:36.962216] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-25T17:01:36.962673] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-25T17:01:36.962762] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-25T17:01:36.964225] [DEBUG] [LOCAL ] ACEL: Trimmed 38920 records to 27254 (keeping 200 days of data) [2025-09-25T17:01:37.154924] [DEBUG] [LOCAL ] ACEL: Primary data saved (27254 records). [2025-09-25T17:01:37.155090] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-25T17:01:37.155214] [INFO ] [MAIN ] Update Progress: 18/2372 symbols completed. ACEL took 24.2s. Estimated remaining: 3h 25m 10s. Rate: 11.5 symbols/min [2025-09-25T17:01:37.353767] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:37.429438] [DEBUG] [LOCAL ] ACN: Loaded 53424 existing records from primary storage. [2025-09-25T17:01:37.429592] [INFO ] [MAIN ] ACN: Loaded 53424 existing records. [2025-09-25T17:01:37.499557] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-25T17:01:37.630203] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:37.631308] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-25T17:01:37.631379] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-25T17:01:37.631731] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-25T17:01:37.631803] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-25T17:01:38.019286] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:38.288733] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-25T17:01:38.365894] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T17:01:38.767559] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T17:01:39.092759] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-25T17:01:39.099272] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (3.21 seconds). [2025-09-25T17:01:39.888749] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-25T17:01:40.521999] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-25T17:01:40.688788] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-25T17:01:41.048035] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T17:01:41.488731] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-25T17:01:41.800317] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T17:01:42.288825] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-25T17:01:42.652317] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-25T17:01:42.750859] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T17:01:43.088727] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-25T17:01:43.888762] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-25T17:01:44.252904] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T17:01:44.554898] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T17:01:44.688744] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-25T17:01:45.318365] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T17:01:45.488720] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-25T17:01:46.145582] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T17:01:46.288744] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-25T17:01:47.088797] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-25T17:01:47.888745] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-25T17:01:48.329402] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-25T17:01:48.354202] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-25T17:01:48.688815] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-25T17:01:48.751770] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T17:01:49.417711] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:01:49.488733] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-25T17:01:50.288766] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-25T17:01:50.365428] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:01:51.093972] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-25T17:01:51.097283] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T17:01:51.888738] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-25T17:01:52.688737] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-25T17:01:52.811818] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-25T17:01:52.929371] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:01:53.483132] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:01:53.491759] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-25T17:01:54.288707] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-25T17:01:55.088708] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-25T17:01:55.213612] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-25T17:01:55.298329] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T17:01:55.888719] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-25T17:01:56.227777] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:01:56.241329] [INFO ] [REMOTE ] ACI: Full fetch complete (77053 records). [2025-09-25T17:01:56.241572] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-25T17:01:56.689746] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-25T17:01:56.713606] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T17:01:56.848089] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-25T17:01:56.848183] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-25T17:01:56.848906] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-25T17:01:56.848971] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-25T17:01:56.851207] [DEBUG] [LOCAL ] ACI: Trimmed 77053 records to 53659 (keeping 200 days of data) [2025-09-25T17:01:57.203719] [DEBUG] [LOCAL ] ACI: Primary data saved (53659 records). [2025-09-25T17:01:57.203880] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-25T17:01:57.209083] [INFO ] [MAIN ] Update Progress: 19/2372 symbols completed. ACI took 31.4s. Estimated remaining: 3h 55m 41s. Rate: 10.0 symbols/min [2025-09-25T17:01:57.391507] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:57.440192] [DEBUG] [LOCAL ] ACP: Loaded 31136 existing records from primary storage. [2025-09-25T17:01:57.440357] [INFO ] [MAIN ] ACP: Loaded 31136 existing records. [2025-09-25T17:01:57.488866] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-25T17:01:57.643052] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:57.643379] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-25T17:01:57.643441] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-25T17:01:57.644026] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-25T17:01:57.644086] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-25T17:01:58.003343] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:01:58.288692] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-25T17:01:58.672337] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-25T17:01:58.867486] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-25T17:01:59.088740] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-25T17:01:59.309981] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T17:01:59.319742] [INFO ] [REMOTE ] ACM: Full fetch complete (62361 records). [2025-09-25T17:01:59.319890] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-25T17:01:59.320930] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:01:59.321037] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:01:59.321081] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:01:59.321122] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-25T17:01:59.321205] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-09-25T17:01:59.321263] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-09-25T17:01:59.321884] [DEBUG] [LOCAL ] ACM: Deleted derivative data file. [2025-09-25T17:01:59.327892] [INFO ] [MAIN ] Update Progress: 20/2372 symbols completed. ACM took 27.1s. Estimated remaining: 3h 47m 57s. Rate: 10.3 symbols/min [2025-09-25T17:01:59.527776] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:01:59.546440] [DEBUG] [LOCAL ] ACR: Loaded 6297 existing records from primary storage. [2025-09-25T17:01:59.546566] [INFO ] [MAIN ] ACR: Loaded 6297 existing records. [2025-09-25T17:01:59.743836] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:01:59.744085] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-25T17:01:59.744131] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-25T17:01:59.744350] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-25T17:01:59.744409] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-25T17:01:59.904910] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-25T17:02:00.079886] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T17:02:00.200048] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:00.688730] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-25T17:02:01.206487] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T17:02:01.493994] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-25T17:02:01.495331] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T17:02:02.288748] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-25T17:02:02.607852] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-25T17:02:02.919174] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T17:02:03.088711] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-25T17:02:03.700148] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T17:02:03.888719] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-25T17:02:04.160521] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T17:02:04.688725] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-25T17:02:05.488763] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-25T17:02:06.013387] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:02:06.035426] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T17:02:06.288710] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-25T17:02:06.738940] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-25T17:02:06.753299] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-25T17:02:06.753453] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-25T17:02:07.096820] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-25T17:02:07.202927] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-25T17:02:07.203016] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-25T17:02:07.203860] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-25T17:02:07.203942] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-25T17:02:07.215364] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T17:02:07.219833] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 54208 (keeping 200 days of data) [2025-09-25T17:02:07.579989] [DEBUG] [LOCAL ] ACHR: Primary data saved (54208 records). [2025-09-25T17:02:07.580142] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-25T17:02:07.583852] [INFO ] [MAIN ] Update Progress: 21/2372 symbols completed. ACHR took 47.2s. Estimated remaining: 3h 52m 25s. Rate: 10.1 symbols/min [2025-09-25T17:02:07.773514] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:07.824271] [DEBUG] [LOCAL ] ACRE: Loaded 33608 existing records from primary storage. [2025-09-25T17:02:07.824412] [INFO ] [MAIN ] ACRE: Loaded 33608 existing records. [2025-09-25T17:02:07.889889] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-25T17:02:08.022410] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:02:08.024623] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-25T17:02:08.024714] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-25T17:02:08.025083] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-25T17:02:08.025142] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-25T17:02:08.286319] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T17:02:08.454728] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:08.688787] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-25T17:02:09.264222] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T17:02:09.488721] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-25T17:02:09.879681] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T17:02:09.896773] [INFO ] [REMOTE ] ACN: Full fetch complete (76713 records). [2025-09-25T17:02:09.896949] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-25T17:02:09.899112] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:02:09.899826] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:02:09.900001] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:02:09.900339] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-25T17:02:09.900425] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-09-25T17:02:09.900483] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-09-25T17:02:09.901046] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-09-25T17:02:09.901155] [INFO ] [MAIN ] Update Progress: 22/2372 symbols completed. ACN took 32.7s. Estimated remaining: 3h 45m 53s. Rate: 10.4 symbols/min [2025-09-25T17:02:10.112877] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:10.123796] [DEBUG] [LOCAL ] ACV: Loaded 6946 existing records from primary storage. [2025-09-25T17:02:10.123907] [INFO ] [MAIN ] ACV: Loaded 6946 existing records. [2025-09-25T17:02:10.281723] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T17:02:10.290011] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-25T17:02:10.327601] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:02:10.327999] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-25T17:02:10.328071] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-25T17:02:10.328296] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-25T17:02:10.328354] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-25T17:02:10.743706] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:11.088834] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-25T17:02:11.807871] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T17:02:11.888707] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-25T17:02:12.638087] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:02:12.688770] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-25T17:02:13.433961] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:02:13.488733] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-25T17:02:14.044172] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:02:14.288777] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-25T17:02:15.023547] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T17:02:15.088730] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-25T17:02:15.491102] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T17:02:15.888787] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-25T17:02:16.685667] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T17:02:16.688856] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-25T17:02:16.704782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T17:02:17.488815] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-25T17:02:18.029069] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T17:02:18.288742] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-25T17:02:18.897476] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T17:02:18.965969] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T17:02:19.088698] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-25T17:02:19.888823] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-25T17:02:20.364432] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T17:02:20.572142] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T17:02:20.688805] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-25T17:02:21.372924] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T17:02:21.488778] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-25T17:02:22.001011] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T17:02:22.288720] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-25T17:02:22.849568] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T17:02:23.088720] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-25T17:02:23.888727] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-25T17:02:24.198939] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T17:02:24.659441] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T17:02:24.688766] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-25T17:02:25.470817] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T17:02:25.488753] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-25T17:02:26.059507] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T17:02:26.061127] [INFO ] [REMOTE ] ACR: Full fetch complete (8560 records). [2025-09-25T17:02:26.061355] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-25T17:02:26.297736] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-25T17:02:26.496293] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-25T17:02:26.496400] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-25T17:02:26.496661] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-25T17:02:26.496764] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-25T17:02:26.497974] [DEBUG] [LOCAL ] ACR: Trimmed 8560 records to 6320 (keeping 200 days of data) [2025-09-25T17:02:26.550248] [DEBUG] [LOCAL ] ACR: Primary data saved (6320 records). [2025-09-25T17:02:26.550611] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-25T17:02:26.550849] [INFO ] [MAIN ] Update Progress: 23/2372 symbols completed. ACR took 27.2s. Estimated remaining: 4h 4m 18s. Rate: 9.6 symbols/min [2025-09-25T17:02:26.746911] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:26.837806] [DEBUG] [LOCAL ] ACVA: Loaded 49322 existing records from primary storage. [2025-09-25T17:02:26.837966] [INFO ] [MAIN ] ACVA: Loaded 49322 existing records. [2025-09-25T17:02:27.049070] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:02:27.049783] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-25T17:02:27.049862] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-25T17:02:27.050435] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-25T17:02:27.050525] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-25T17:02:27.092277] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-25T17:02:27.459312] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:27.720744] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T17:02:27.888680] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-25T17:02:28.338389] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T17:02:28.688698] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-25T17:02:29.113462] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T17:02:29.488734] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-25T17:02:30.085814] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:02:30.093748] [INFO ] [REMOTE ] ACP: Full fetch complete (47613 records). [2025-09-25T17:02:30.093906] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-25T17:02:30.295831] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-25T17:02:30.578618] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-25T17:02:30.578750] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-25T17:02:30.579311] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-25T17:02:30.579360] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-25T17:02:30.580965] [DEBUG] [LOCAL ] ACP: Trimmed 47613 records to 31281 (keeping 200 days of data) [2025-09-25T17:02:30.752361] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T17:02:30.764036] [INFO ] [REMOTE ] ACRE: Full fetch complete (50327 records). [2025-09-25T17:02:30.764207] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-25T17:02:30.764936] [FATAL] [VALIDATOR ] ACRE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:02:30.765020] [FATAL] [MAIN ] ACRE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:02:30.765099] [WARN ] [MAIN ] ACRE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:02:30.765165] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-25T17:02:30.765315] [DEBUG] [LOCAL ] ACRE: No primary data file found to delete. [2025-09-25T17:02:30.765408] [INFO ] [LOCAL ] ACRE: Starting deletion of derivative data. [2025-09-25T17:02:30.770875] [DEBUG] [LOCAL ] ACRE: Deleted derivative data file. [2025-09-25T17:02:30.771072] [INFO ] [MAIN ] Update Progress: 24/2372 symbols completed. ACRE took 23.2s. Estimated remaining: 4h 0m 55s. Rate: 9.7 symbols/min [2025-09-25T17:02:31.042808] [DEBUG] [LOCAL ] ACP: Primary data saved (31281 records). [2025-09-25T17:02:31.043004] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-25T17:02:31.071120] [INFO ] [MAIN ] Update Progress: 25/2372 symbols completed. ACP took 33.8s. Estimated remaining: 3h 51m 39s. Rate: 10.1 symbols/min [2025-09-25T17:02:31.133497] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T17:02:31.117922] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-25T17:02:31.166764] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:31.166971] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-25T17:02:31.167018] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-25T17:02:31.167534] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-25T17:02:31.176661] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-25T17:02:31.176759] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-25T17:02:31.176799] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-25T17:02:31.610510] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:31.615949] [DEBUG] [LOCAL ] ADC: No existing data file found in primary storage. [2025-09-25T17:02:31.616034] [WARN ] [MAIN ] ADC: No existing data found, performing full refresh instead. [2025-09-25T17:02:31.616173] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-25T17:02:31.616212] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-25T17:02:31.616254] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-25T17:02:31.616288] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-25T17:02:31.917726] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-25T17:02:32.053783] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:32.195459] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:32.492478] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T17:02:32.688685] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-25T17:02:32.731172] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T17:02:32.902816] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:32.903157] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-25T17:02:33.488696] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-25T17:02:33.983348] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T17:02:34.288720] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-25T17:02:34.790126] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T17:02:35.088725] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-25T17:02:35.326549] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:35.328922] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-25T17:02:35.888718] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-25T17:02:36.082122] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:36.082502] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-25T17:02:36.688761] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-25T17:02:36.945917] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:36.946232] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-25T17:02:37.489057] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-25T17:02:38.288748] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-25T17:02:38.352684] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T17:02:38.355286] [INFO ] [REMOTE ] ACV: Full fetch complete (9748 records). [2025-09-25T17:02:38.355375] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-25T17:02:38.761318] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-25T17:02:38.761458] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-25T17:02:38.761745] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-25T17:02:38.761812] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-25T17:02:38.762570] [DEBUG] [LOCAL ] ACV: Trimmed 9748 records to 7016 (keeping 200 days of data) [2025-09-25T17:02:38.817859] [DEBUG] [LOCAL ] ACV: Primary data saved (7016 records). [2025-09-25T17:02:38.818020] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-25T17:02:38.818165] [INFO ] [MAIN ] Update Progress: 26/2372 symbols completed. ACV took 28.9s. Estimated remaining: 3h 54m 17s. Rate: 10.0 symbols/min [2025-09-25T17:02:39.001996] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:39.061189] [DEBUG] [LOCAL ] ADCT: Loaded 34069 existing records from primary storage. [2025-09-25T17:02:39.061355] [INFO ] [MAIN ] ADCT: Loaded 34069 existing records. [2025-09-25T17:02:39.096913] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-25T17:02:39.282361] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:02:39.285208] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-25T17:02:39.285293] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-25T17:02:39.287182] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-25T17:02:39.287250] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-25T17:02:39.352378] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:39.352738] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-25T17:02:39.703968] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:39.752324] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T17:02:39.888698] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-25T17:02:40.688692] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-25T17:02:40.890403] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:40.891725] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-25T17:02:41.350340] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T17:02:41.488705] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-25T17:02:41.720717] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:41.721087] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-25T17:02:42.288779] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-25T17:02:43.088809] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-25T17:02:43.875775] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T17:02:43.888690] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-25T17:02:44.090414] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:02:44.090816] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-25T17:02:44.594982] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T17:02:44.688677] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-25T17:02:45.488786] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-25T17:02:46.106758] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T17:02:46.288728] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-25T17:02:47.088785] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-25T17:02:47.157692] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T17:02:47.827002] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T17:02:47.894375] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-25T17:02:47.899003] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T17:02:47.904191] [INFO ] [REMOTE ] AD: Full fetch complete (6105 records). [2025-09-25T17:02:47.904288] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-25T17:02:47.905203] [FATAL] [VALIDATOR ] AD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:02:47.905314] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:02:47.905380] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:02:47.905442] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-25T17:02:47.905547] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-25T17:02:47.905605] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-25T17:02:47.905681] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-25T17:02:47.905802] [INFO ] [MAIN ] Update Progress: 27/2372 symbols completed. AD took 17.1s. Estimated remaining: 3h 58m 40s. Rate: 9.8 symbols/min [2025-09-25T17:02:48.087471] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:02:48.190013] [DEBUG] [LOCAL ] ADM: Loaded 53395 existing records from primary storage. [2025-09-25T17:02:48.190230] [INFO ] [MAIN ] ADM: Loaded 53395 existing records. [2025-09-25T17:02:48.382114] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:02:48.382434] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-25T17:02:48.382488] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-25T17:02:48.382809] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-25T17:02:48.382877] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-25T17:02:48.694728] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-25T17:02:48.762948] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:02:49.488705] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-25T17:02:49.728186] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:02:50.253677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T17:02:50.288673] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-25T17:02:50.899780] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T17:02:51.088714] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-25T17:02:51.888809] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-25T17:02:52.048343] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T17:02:52.312670] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T17:02:52.688822] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-25T17:02:53.488753] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-25T17:02:53.884490] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T17:02:54.258349] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:02:54.288715] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-25T17:02:55.088733] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-25T17:02:55.425381] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T17:02:55.888741] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-25T17:02:55.905506] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T17:02:56.467635] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T17:02:56.688749] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-25T17:02:57.488804] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-25T17:02:57.586032] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:02:57.634759] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T17:02:58.288759] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-25T17:02:59.088757] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-25T17:02:59.287321] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T17:02:59.326868] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T17:02:59.888701] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-25T17:03:00.688766] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-25T17:03:00.750707] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T17:03:01.488708] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-25T17:03:01.809927] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T17:03:02.288718] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-25T17:03:03.100681] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-25T17:03:03.104206] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-25T17:03:03.888698] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-25T17:03:05.662909] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (4.17 seconds). [2025-09-25T17:03:05.671811] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-25T17:03:06.620634] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-25T17:03:06.671711] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-25T17:03:06.696127] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (4.41 seconds). [2025-09-25T17:03:06.708801] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-25T17:03:06.713760] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (3.61 seconds). [2025-09-25T17:03:06.897417] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T17:03:07.088729] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-25T17:03:07.888716] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-25T17:03:08.484191] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T17:03:08.609565] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T17:03:08.651803] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T17:03:08.688733] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-25T17:03:09.379951] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T17:03:09.391978] [INFO ] [REMOTE ] ACVA: Full fetch complete (69851 records). [2025-09-25T17:03:09.392139] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-25T17:03:09.397800] [FATAL] [VALIDATOR ] ACVA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:03:09.400436] [FATAL] [MAIN ] ACVA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:03:09.400529] [WARN ] [MAIN ] ACVA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:03:09.400601] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-25T17:03:09.401118] [DEBUG] [LOCAL ] ACVA: No primary data file found to delete. [2025-09-25T17:03:09.401178] [INFO ] [LOCAL ] ACVA: Starting deletion of derivative data. [2025-09-25T17:03:09.406092] [DEBUG] [LOCAL ] ACVA: Deleted derivative data file. [2025-09-25T17:03:09.411743] [INFO ] [MAIN ] Update Progress: 28/2372 symbols completed. ACVA took 42.9s. Estimated remaining: 4h 20m 3s. Rate: 9.0 symbols/min [2025-09-25T17:03:09.493788] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-25T17:03:09.612997] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:09.704773] [DEBUG] [LOCAL ] ADNT: Loaded 47461 existing records from primary storage. [2025-09-25T17:03:09.704962] [INFO ] [MAIN ] ADNT: Loaded 47461 existing records. [2025-09-25T17:03:09.904445] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:09.905202] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-25T17:03:09.905289] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-25T17:03:09.908750] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-25T17:03:09.908835] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-25T17:03:10.289931] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-25T17:03:10.320325] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:10.428766] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T17:03:10.443971] [INFO ] [REMOTE ] ADC: Full fetch complete (65687 records). [2025-09-25T17:03:10.444141] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-25T17:03:10.445021] [FATAL] [VALIDATOR ] ADC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:03:10.445110] [FATAL] [MAIN ] ADC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:03:10.445154] [WARN ] [MAIN ] ADC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:03:10.445194] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-25T17:03:10.445407] [DEBUG] [LOCAL ] ADC: No primary data file found to delete. [2025-09-25T17:03:10.445469] [INFO ] [LOCAL ] ADC: Starting deletion of derivative data. [2025-09-25T17:03:10.445514] [DEBUG] [LOCAL ] ADC: No derivative data file found to delete. [2025-09-25T17:03:10.445578] [INFO ] [MAIN ] Update Progress: 29/2372 symbols completed. ADC took 39.4s. Estimated remaining: 4h 12m 22s. Rate: 9.3 symbols/min [2025-09-25T17:03:10.630336] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:10.722143] [DEBUG] [LOCAL ] ADT: Loaded 53477 existing records from primary storage. [2025-09-25T17:03:10.722313] [INFO ] [MAIN ] ADT: Loaded 53477 existing records. [2025-09-25T17:03:10.987848] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:10.988138] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-25T17:03:10.988191] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-25T17:03:10.988547] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-25T17:03:10.988609] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-25T17:03:11.100193] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-25T17:03:11.198393] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:03:11.484400] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:11.587232] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T17:03:11.595850] [INFO ] [REMOTE ] ADCT: Full fetch complete (51718 records). [2025-09-25T17:03:11.596055] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-25T17:03:11.888814] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-25T17:03:12.009522] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-25T17:03:12.009630] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-25T17:03:12.010252] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-25T17:03:12.010307] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-25T17:03:12.012085] [DEBUG] [LOCAL ] ADCT: Trimmed 51718 records to 34394 (keeping 200 days of data) [2025-09-25T17:03:12.243509] [DEBUG] [LOCAL ] ADCT: Primary data saved (34394 records). [2025-09-25T17:03:12.243698] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-25T17:03:12.243810] [INFO ] [MAIN ] Update Progress: 30/2372 symbols completed. ADCT took 33.4s. Estimated remaining: 4h 6m 12s. Rate: 9.5 symbols/min [2025-09-25T17:03:12.428637] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:12.465771] [DEBUG] [LOCAL ] ADX: Loaded 27783 existing records from primary storage. [2025-09-25T17:03:12.465926] [INFO ] [MAIN ] ADX: Loaded 27783 existing records. [2025-09-25T17:03:12.649537] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T17:03:12.691719] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-25T17:03:12.716167] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:12.718209] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-25T17:03:12.718272] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-25T17:03:12.718760] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-25T17:03:12.718822] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-25T17:03:13.152694] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:13.488724] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-25T17:03:14.288722] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-25T17:03:14.657771] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-25T17:03:14.723306] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-25T17:03:15.088725] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-25T17:03:15.651022] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-25T17:03:15.753300] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T17:03:15.888779] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-25T17:03:16.688697] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-25T17:03:16.766548] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:03:17.060000] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T17:03:17.488736] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-25T17:03:18.208953] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T17:03:18.288765] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-25T17:03:19.088750] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-25T17:03:19.158317] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T17:03:19.586135] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T17:03:19.888761] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-25T17:03:20.175061] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T17:03:20.688767] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-25T17:03:21.488761] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-25T17:03:21.634063] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T17:03:22.288746] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-25T17:03:22.449316] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T17:03:23.088798] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-25T17:03:23.536288] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-25T17:03:23.558786] [INFO ] [REMOTE ] ADM: Full fetch complete (76830 records). [2025-09-25T17:03:23.559083] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-25T17:03:23.561279] [FATAL] [VALIDATOR ] ADM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:03:23.561478] [FATAL] [MAIN ] ADM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:03:23.561551] [WARN ] [MAIN ] ADM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:03:23.561808] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-25T17:03:23.561979] [DEBUG] [LOCAL ] ADM: No primary data file found to delete. [2025-09-25T17:03:23.562070] [INFO ] [LOCAL ] ADM: Starting deletion of derivative data. [2025-09-25T17:03:23.562892] [DEBUG] [LOCAL ] ADM: Deleted derivative data file. [2025-09-25T17:03:23.563097] [INFO ] [MAIN ] Update Progress: 31/2372 symbols completed. ADM took 35.7s. Estimated remaining: 4h 12m 24s. Rate: 9.3 symbols/min [2025-09-25T17:03:23.808031] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:23.873501] [DEBUG] [LOCAL ] AEE: Loaded 50147 existing records from primary storage. [2025-09-25T17:03:23.873694] [INFO ] [MAIN ] AEE: Loaded 50147 existing records. [2025-09-25T17:03:23.906839] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-25T17:03:24.104320] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:24.107061] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T17:03:24.118885] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-25T17:03:24.119030] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-25T17:03:24.119386] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-25T17:03:24.119450] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-25T17:03:24.270580] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:03:24.563283] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:24.688717] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-25T17:03:25.488721] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-25T17:03:26.094415] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-25T17:03:26.288700] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-25T17:03:26.466940] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T17:03:26.522911] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:03:27.088741] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-25T17:03:27.748160] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T17:03:27.888677] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-25T17:03:28.235707] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T17:03:28.688727] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-25T17:03:29.448326] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:03:29.488673] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-25T17:03:30.059386] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T17:03:30.288773] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-25T17:03:31.015024] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T17:03:31.088726] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-25T17:03:31.882110] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:03:31.892397] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-25T17:03:32.688770] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-25T17:03:32.847348] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T17:03:33.277382] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T17:03:33.488725] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-25T17:03:34.172934] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:03:34.288767] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-25T17:03:34.602665] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T17:03:35.088815] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-25T17:03:35.888767] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-25T17:03:36.208691] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T17:03:36.247964] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T17:03:36.688772] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-25T17:03:37.324021] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T17:03:37.488769] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-25T17:03:38.288768] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-25T17:03:38.545488] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T17:03:39.088692] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-25T17:03:39.192277] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T17:03:39.237139] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T17:03:39.888754] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-25T17:03:40.688714] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-25T17:03:40.741458] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:03:40.753097] [INFO ] [REMOTE ] ADT: Full fetch complete (77204 records). [2025-09-25T17:03:40.753695] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-25T17:03:41.147438] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T17:03:41.153685] [INFO ] [REMOTE ] ADX: Full fetch complete (42130 records). [2025-09-25T17:03:41.153864] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-25T17:03:41.502683] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-25T17:03:41.504053] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-25T17:03:41.504111] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-25T17:03:41.504905] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-25T17:03:41.504993] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-25T17:03:41.541078] [DEBUG] [LOCAL ] ADT: Trimmed 77204 records to 53866 (keeping 200 days of data) [2025-09-25T17:03:41.984211] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-25T17:03:41.984311] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-25T17:03:41.984804] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-25T17:03:41.984879] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-25T17:03:41.986169] [DEBUG] [LOCAL ] ADX: Trimmed 42130 records to 28005 (keeping 200 days of data) [2025-09-25T17:03:42.318183] [DEBUG] [LOCAL ] ADT: Primary data saved (53866 records). [2025-09-25T17:03:42.318417] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-25T17:03:42.320558] [INFO ] [MAIN ] Update Progress: 32/2372 symbols completed. ADT took 31.9s. Estimated remaining: 4h 27m 16s. Rate: 8.8 symbols/min [2025-09-25T17:03:42.450698] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T17:03:42.497069] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-25T17:03:42.541414] [DEBUG] [LOCAL ] ADX: Primary data saved (28005 records). [2025-09-25T17:03:42.541542] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-25T17:03:42.541683] [INFO ] [MAIN ] Update Progress: 33/2372 symbols completed. ADX took 30.3s. Estimated remaining: 4h 19m 19s. Rate: 9.0 symbols/min [2025-09-25T17:03:42.689593] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:42.796415] [DEBUG] [LOCAL ] AEFC: Loaded 8584 existing records from primary storage. [2025-09-25T17:03:42.796569] [INFO ] [MAIN ] AEFC: Loaded 8584 existing records. [2025-09-25T17:03:42.881021] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:43.089591] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:43.090004] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-25T17:03:43.090086] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-25T17:03:43.090395] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-25T17:03:43.090476] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-25T17:03:43.126905] [DEBUG] [LOCAL ] AEG: Loaded 49615 existing records from primary storage. [2025-09-25T17:03:43.127084] [INFO ] [MAIN ] AEG: Loaded 49615 existing records. [2025-09-25T17:03:43.245695] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T17:03:43.285393] [INFO ] [REMOTE ] ADNT: Full fetch complete (68092 records). [2025-09-25T17:03:43.285549] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-25T17:03:43.704869] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:03:43.708145] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-25T17:03:43.708207] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-25T17:03:43.714079] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-25T17:03:43.714182] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-25T17:03:44.146073] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T17:03:44.170912] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-25T17:03:44.406068] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:44.422055] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-25T17:03:44.575916] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-25T17:03:44.576009] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-25T17:03:44.576700] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-25T17:03:44.576763] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-25T17:03:44.578062] [DEBUG] [LOCAL ] ADNT: Trimmed 68092 records to 47786 (keeping 200 days of data) [2025-09-25T17:03:44.758116] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:44.758422] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-25T17:03:44.962058] [DEBUG] [LOCAL ] ADNT: Primary data saved (47786 records). [2025-09-25T17:03:44.962259] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-25T17:03:44.964940] [INFO ] [MAIN ] Update Progress: 34/2372 symbols completed. ADNT took 35.6s. Estimated remaining: 4h 14m 22s. Rate: 9.2 symbols/min [2025-09-25T17:03:45.156132] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:45.156288] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-25T17:03:45.156326] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-25T17:03:45.156514] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-25T17:03:45.156553] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-25T17:03:45.156612] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-25T17:03:45.156674] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-25T17:03:45.259785] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T17:03:45.494726] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-25T17:03:45.538002] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:45.951406] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T17:03:45.967486] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T17:03:46.288753] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-25T17:03:46.335461] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:03:47.018114] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T17:03:47.088723] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-25T17:03:47.888726] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-25T17:03:48.688704] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-25T17:03:48.957211] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T17:03:49.488770] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-25T17:03:49.824506] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T17:03:50.255182] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T17:03:50.293821] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-25T17:03:50.308609] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T17:03:51.088721] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-25T17:03:51.888695] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-25T17:03:52.132201] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T17:03:52.658922] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:03:52.688719] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-25T17:03:52.708745] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T17:03:53.488751] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-25T17:03:54.113516] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:03:54.288765] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-25T17:03:54.798539] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T17:03:55.088796] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-25T17:03:55.888724] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-25T17:03:56.200216] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T17:03:56.461885] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T17:03:56.474730] [INFO ] [REMOTE ] AEE: Full fetch complete (72536 records). [2025-09-25T17:03:56.474959] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-25T17:03:56.743728] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-25T17:03:56.967760] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-25T17:03:56.967843] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-25T17:03:56.968523] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-25T17:03:56.968567] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-25T17:03:56.969992] [DEBUG] [LOCAL ] AEE: Trimmed 72536 records to 50500 (keeping 200 days of data) [2025-09-25T17:03:57.293814] [DEBUG] [LOCAL ] AEE: Primary data saved (50500 records). [2025-09-25T17:03:57.293957] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-25T17:03:57.294046] [INFO ] [MAIN ] Update Progress: 35/2372 symbols completed. AEE took 33.7s. Estimated remaining: 4h 20m 43s. Rate: 9.0 symbols/min [2025-09-25T17:03:57.468631] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:03:57.468835] [DEBUG] [LOCAL ] AEO: No existing data file found in primary storage. [2025-09-25T17:03:57.468878] [WARN ] [MAIN ] AEO: No existing data found, performing full refresh instead. [2025-09-25T17:03:57.469007] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-25T17:03:57.469048] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-25T17:03:57.469090] [DEBUG] [LOCAL ] AEO: No primary data file found to delete. [2025-09-25T17:03:57.469123] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-25T17:03:57.494034] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-25T17:03:57.872910] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:03:58.163868] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-25T17:03:58.246412] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:03:58.288778] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-25T17:03:59.088810] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-25T17:03:59.130824] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-25T17:03:59.582296] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-25T17:03:59.888727] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-25T17:04:00.017802] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:04:00.688727] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-25T17:04:00.818313] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T17:04:01.488938] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-25T17:04:02.288711] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-25T17:04:03.088751] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-25T17:04:03.732983] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T17:04:03.888791] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-25T17:04:04.245056] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T17:04:04.676144] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T17:04:04.678016] [INFO ] [REMOTE ] AEFC: Full fetch complete (12333 records). [2025-09-25T17:04:04.678103] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-25T17:04:04.678886] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:04:04.681408] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:04:04.681551] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:04:04.681666] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-25T17:04:04.681770] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-09-25T17:04:04.681813] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-09-25T17:04:04.682510] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-09-25T17:04:04.683147] [INFO ] [MAIN ] Update Progress: 36/2372 symbols completed. AEFC took 22.4s. Estimated remaining: 4h 21m 21s. Rate: 8.9 symbols/min [2025-09-25T17:04:04.720729] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-25T17:04:04.891009] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:04.952176] [DEBUG] [LOCAL ] AER: Loaded 48631 existing records from primary storage. [2025-09-25T17:04:04.952340] [INFO ] [MAIN ] AER: Loaded 48631 existing records. [2025-09-25T17:04:05.151669] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:05.152400] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-25T17:04:05.152478] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-25T17:04:05.152828] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-25T17:04:05.152887] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-25T17:04:05.567710] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:05.568331] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-25T17:04:05.601564] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (4.91 seconds). [2025-09-25T17:04:06.154071] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T17:04:06.288861] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-25T17:04:07.088746] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-25T17:04:07.331455] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T17:04:07.452438] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (5.96 seconds). [2025-09-25T17:04:07.888759] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-25T17:04:08.694827] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-25T17:04:08.719492] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-25T17:04:08.861923] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T17:04:09.312339] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T17:04:09.488818] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-25T17:04:10.288888] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-25T17:04:10.896192] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-25T17:04:11.088742] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-25T17:04:11.202108] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T17:04:11.895101] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-25T17:04:11.902383] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:04:12.688762] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-25T17:04:13.040880] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T17:04:13.488838] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-25T17:04:13.986228] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T17:04:14.000524] [INFO ] [REMOTE ] AEG: Full fetch complete (69944 records). [2025-09-25T17:04:14.002885] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-25T17:04:14.005295] [FATAL] [VALIDATOR ] AEG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:04:14.005488] [FATAL] [MAIN ] AEG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:04:14.005549] [WARN ] [MAIN ] AEG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:04:14.006106] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-25T17:04:14.006235] [DEBUG] [LOCAL ] AEG: No primary data file found to delete. [2025-09-25T17:04:14.006312] [INFO ] [LOCAL ] AEG: Starting deletion of derivative data. [2025-09-25T17:04:14.007062] [DEBUG] [LOCAL ] AEG: Deleted derivative data file. [2025-09-25T17:04:14.007239] [INFO ] [MAIN ] Update Progress: 37/2372 symbols completed. AEG took 31.5s. Estimated remaining: 4h 23m 59s. Rate: 8.8 symbols/min [2025-09-25T17:04:14.262700] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T17:04:14.288714] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-25T17:04:15.088720] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-25T17:04:15.172857] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:04:15.888730] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-25T17:04:16.392898] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T17:04:16.688690] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-25T17:04:17.056002] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T17:04:17.488728] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-25T17:04:18.181368] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-25T17:04:18.288716] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-25T17:04:18.333361] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T17:04:19.088760] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-25T17:04:19.227063] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:04:19.888770] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-25T17:04:20.039107] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T17:04:20.053862] [INFO ] [REMOTE ] AEM: Full fetch complete (76752 records). [2025-09-25T17:04:20.054216] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-25T17:04:20.056234] [FATAL] [VALIDATOR ] AEM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:04:20.056422] [FATAL] [MAIN ] AEM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:04:20.056467] [WARN ] [MAIN ] AEM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:04:20.056521] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-25T17:04:20.056682] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-25T17:04:20.056756] [INFO ] [LOCAL ] AEM: Starting deletion of derivative data. [2025-09-25T17:04:20.056828] [DEBUG] [LOCAL ] AEM: No derivative data file found to delete. [2025-09-25T17:04:20.056923] [INFO ] [MAIN ] Update Progress: 38/2372 symbols completed. AEM took 35.1s. Estimated remaining: 4h 23m 7s. Rate: 8.9 symbols/min [2025-09-25T17:04:20.976609] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T17:04:20.990060] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-25T17:04:21.411965] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T17:04:21.488785] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-25T17:04:22.860953] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T17:04:22.872669] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-25T17:04:23.304449] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T17:04:23.315189] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-25T17:04:24.822454] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T17:04:24.839542] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-25T17:04:25.248257] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T17:04:25.266440] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-25T17:04:26.945965] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T17:04:26.959638] [INFO ] [REMOTE ] AER: Full fetch complete (69210 records). [2025-09-25T17:04:26.959856] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-25T17:04:26.973006] [FATAL] [VALIDATOR ] AER: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:04:26.973142] [FATAL] [MAIN ] AER: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:04:26.973200] [WARN ] [MAIN ] AER: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:04:26.973252] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-25T17:04:26.973406] [DEBUG] [LOCAL ] AER: No primary data file found to delete. [2025-09-25T17:04:26.973465] [INFO ] [LOCAL ] AER: Starting deletion of derivative data. [2025-09-25T17:04:26.979523] [DEBUG] [LOCAL ] AER: Deleted derivative data file. [2025-09-25T17:04:26.984349] [INFO ] [MAIN ] Update Progress: 39/2372 symbols completed. AER took 22.3s. Estimated remaining: 4h 23m 10s. Rate: 8.9 symbols/min [2025-09-25T17:04:26.999530] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T17:04:27.011161] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-25T17:04:29.275273] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T17:04:29.285334] [INFO ] [REMOTE ] AEO: Full fetch complete (77444 records). [2025-09-25T17:04:29.285502] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-25T17:04:29.697002] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-25T17:04:29.697117] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-25T17:04:29.697871] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-25T17:04:29.697948] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-25T17:04:29.701963] [DEBUG] [LOCAL ] AEO: Trimmed 77444 records to 53946 (keeping 200 days of data) [2025-09-25T17:04:30.053311] [DEBUG] [LOCAL ] AEO: Primary data saved (53946 records). [2025-09-25T17:04:30.053490] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-25T17:04:30.053630] [INFO ] [MAIN ] Update Progress: 40/2372 symbols completed. AEO took 32.8s. Estimated remaining: 4h 19m 28s. Rate: 9.0 symbols/min [2025-09-25T17:04:30.717698] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:30.770049] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:30.885993] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:30.882606] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:30.959132] [DEBUG] [LOCAL ] AFB: Loaded 11277 existing records from primary storage. [2025-09-25T17:04:30.960783] [INFO ] [MAIN ] AFB: Loaded 11277 existing records. [2025-09-25T17:04:31.000841] [DEBUG] [LOCAL ] AES: Loaded 53671 existing records from primary storage. [2025-09-25T17:04:31.001008] [INFO ] [MAIN ] AES: Loaded 53671 existing records. [2025-09-25T17:04:31.023008] [DEBUG] [LOCAL ] AFG: Loaded 32578 existing records from primary storage. [2025-09-25T17:04:31.023157] [INFO ] [MAIN ] AFG: Loaded 32578 existing records. [2025-09-25T17:04:31.131122] [DEBUG] [LOCAL ] AESI: Loaded 49499 existing records from primary storage. [2025-09-25T17:04:31.131277] [INFO ] [MAIN ] AESI: Loaded 49499 existing records. [2025-09-25T17:04:31.679073] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:31.679301] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-25T17:04:31.679346] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-25T17:04:31.679601] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-25T17:04:31.679723] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-25T17:04:31.874836] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:31.875135] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-25T17:04:31.875187] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-25T17:04:31.880311] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-25T17:04:31.880399] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-25T17:04:31.950748] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:32.001675] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-25T17:04:32.001744] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-25T17:04:32.001414] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:32.013848] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-25T17:04:32.013895] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-25T17:04:32.014175] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-25T17:04:32.014234] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-25T17:04:32.013672] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-25T17:04:32.048842] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-25T17:04:33.064040] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:33.089128] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-25T17:04:33.366823] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:33.375055] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-25T17:04:33.383661] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:33.383884] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-25T17:04:33.387877] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:33.388520] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-25T17:04:33.973574] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T17:04:33.977391] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-25T17:04:34.534830] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T17:04:34.537974] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-25T17:04:34.771999] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T17:04:34.777936] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-25T17:04:35.026186] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:04:35.044306] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-25T17:04:35.046241] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T17:04:35.049694] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-25T17:04:35.272794] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T17:04:35.283852] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-25T17:04:35.636599] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T17:04:35.642582] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-25T17:04:35.682780] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T17:04:35.688475] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-25T17:04:36.549271] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T17:04:36.552950] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-25T17:04:36.786155] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T17:04:36.795803] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-25T17:04:36.876211] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T17:04:37.102041] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T17:04:37.323927] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T17:04:37.488716] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-25T17:04:38.224359] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T17:04:38.259291] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:04:38.288676] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-25T17:04:39.088731] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-25T17:04:39.788633] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T17:04:39.804344] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T17:04:39.888762] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-25T17:04:40.688721] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-25T17:04:41.488741] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-25T17:04:41.812693] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T17:04:41.985290] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T17:04:42.288720] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-25T17:04:43.088716] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-25T17:04:43.194376] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T17:04:43.563773] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T17:04:43.888796] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-25T17:04:44.331665] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T17:04:44.688725] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-25T17:04:45.488740] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-25T17:04:45.555967] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T17:04:46.241593] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:04:46.288674] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-25T17:04:47.088731] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-25T17:04:47.462409] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:04:47.602030] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-25T17:04:47.888750] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-25T17:04:47.938605] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T17:04:47.942556] [INFO ] [REMOTE ] AFB: Full fetch complete (16525 records). [2025-09-25T17:04:47.942632] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-25T17:04:48.344011] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-25T17:04:48.344090] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-25T17:04:48.344324] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-25T17:04:48.344363] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-25T17:04:48.344909] [DEBUG] [LOCAL ] AFB: Trimmed 16525 records to 11386 (keeping 200 days of data) [2025-09-25T17:04:48.414010] [DEBUG] [LOCAL ] AFB: Primary data saved (11386 records). [2025-09-25T17:04:48.414151] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-25T17:04:48.414238] [INFO ] [MAIN ] Update Progress: 41/2372 symbols completed. AFB took 18.3s. Estimated remaining: 4h 30m 25s. Rate: 8.6 symbols/min [2025-09-25T17:04:48.603475] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:48.612234] [DEBUG] [LOCAL ] AFGB: Loaded 2386 existing records from primary storage. [2025-09-25T17:04:48.612391] [INFO ] [MAIN ] AFGB: Loaded 2386 existing records. [2025-09-25T17:04:48.691429] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-25T17:04:48.815854] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:04:48.818083] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-25T17:04:48.818137] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-25T17:04:48.818517] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-25T17:04:48.818577] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-25T17:04:49.225742] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:49.240345] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T17:04:49.488727] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-25T17:04:50.288697] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-25T17:04:50.458767] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:04:50.961547] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T17:04:51.088704] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-25T17:04:51.888722] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-25T17:04:52.196801] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T17:04:52.688691] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-25T17:04:52.752333] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T17:04:53.229545] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T17:04:53.488795] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-25T17:04:54.076175] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T17:04:54.288748] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-25T17:04:54.332165] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T17:04:55.090434] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-25T17:04:55.888725] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-25T17:04:56.249244] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T17:04:56.688749] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-25T17:04:56.886842] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T17:04:57.488696] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-25T17:04:57.660386] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T17:04:57.668367] [INFO ] [REMOTE ] AFG: Full fetch complete (45723 records). [2025-09-25T17:04:57.668506] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-25T17:04:58.054845] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-25T17:04:58.054951] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-25T17:04:58.055463] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-25T17:04:58.055577] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-25T17:04:58.057913] [DEBUG] [LOCAL ] AFG: Trimmed 45723 records to 32808 (keeping 200 days of data) [2025-09-25T17:04:58.281176] [DEBUG] [LOCAL ] AFG: Primary data saved (32808 records). [2025-09-25T17:04:58.281326] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-25T17:04:58.281467] [INFO ] [MAIN ] Update Progress: 42/2372 symbols completed. AFG took 28.2s. Estimated remaining: 4h 32m 60s. Rate: 8.5 symbols/min [2025-09-25T17:04:58.314689] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-25T17:04:58.473228] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:04:58.473421] [DEBUG] [LOCAL ] AFGC: No existing data file found in primary storage. [2025-09-25T17:04:58.473468] [WARN ] [MAIN ] AFGC: No existing data found, performing full refresh instead. [2025-09-25T17:04:58.473901] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-25T17:04:58.473953] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-25T17:04:58.473996] [DEBUG] [LOCAL ] AFGC: No primary data file found to delete. [2025-09-25T17:04:58.474040] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-25T17:04:58.692114] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T17:04:58.716384] [INFO ] [REMOTE ] AESI: Full fetch complete (70316 records). [2025-09-25T17:04:58.716523] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-25T17:04:58.904709] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T17:04:59.093764] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-25T17:04:59.256120] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:04:59.488427] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-25T17:04:59.488521] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-25T17:04:59.489197] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-25T17:04:59.489265] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-25T17:04:59.491761] [DEBUG] [LOCAL ] AESI: Trimmed 70316 records to 49853 (keeping 200 days of data) [2025-09-25T17:04:59.581917] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T17:04:59.603963] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-25T17:04:59.868053] [DEBUG] [LOCAL ] AESI: Primary data saved (49853 records). [2025-09-25T17:04:59.868204] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-25T17:04:59.868299] [INFO ] [MAIN ] Update Progress: 43/2372 symbols completed. AESI took 29.8s. Estimated remaining: 4h 27m 58s. Rate: 8.7 symbols/min [2025-09-25T17:04:59.894006] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-25T17:05:00.060014] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:00.066346] [DEBUG] [LOCAL ] AFGD: Loaded 1845 existing records from primary storage. [2025-09-25T17:05:00.066509] [INFO ] [MAIN ] AFGD: Loaded 1845 existing records. [2025-09-25T17:05:00.246211] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:00.246549] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-25T17:05:00.246598] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-25T17:05:00.247011] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-25T17:05:00.247070] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-25T17:05:00.523904] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T17:05:00.633581] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:00.688728] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-25T17:05:01.342034] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T17:05:01.488778] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-25T17:05:02.006537] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-25T17:05:02.288787] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-25T17:05:02.769561] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T17:05:03.088814] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-25T17:05:03.669820] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T17:05:03.888907] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-25T17:05:04.330166] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T17:05:04.688826] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-25T17:05:05.197464] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T17:05:05.488859] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-25T17:05:05.930013] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T17:05:06.288728] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-25T17:05:06.823984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-25T17:05:07.088721] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-25T17:05:07.888787] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-25T17:05:08.394146] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T17:05:08.688723] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-25T17:05:09.088785] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T17:05:09.124926] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T17:05:09.140058] [INFO ] [REMOTE ] AES: Full fetch complete (77723 records). [2025-09-25T17:05:09.140298] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-25T17:05:09.493803] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-25T17:05:09.605355] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-25T17:05:09.605458] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-25T17:05:09.606245] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-25T17:05:09.606315] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-25T17:05:09.608530] [DEBUG] [LOCAL ] AES: Trimmed 77723 records to 54061 (keeping 200 days of data) [2025-09-25T17:05:09.969271] [DEBUG] [LOCAL ] AES: Primary data saved (54061 records). [2025-09-25T17:05:09.969474] [INFO ] [MAIN ] AES: Full history saved. [2025-09-25T17:05:09.969670] [INFO ] [MAIN ] Update Progress: 44/2372 symbols completed. AES took 39.9s. Estimated remaining: 4h 30m 40s. Rate: 8.6 symbols/min [2025-09-25T17:05:10.096792] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T17:05:10.164139] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:10.175414] [DEBUG] [LOCAL ] AFGE: Loaded 2506 existing records from primary storage. [2025-09-25T17:05:10.175515] [INFO ] [MAIN ] AFGE: Loaded 2506 existing records. [2025-09-25T17:05:10.293803] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-25T17:05:10.374751] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:10.375255] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-25T17:05:10.375336] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-25T17:05:10.375594] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-25T17:05:10.375703] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-25T17:05:10.759720] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:10.774280] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T17:05:11.088719] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-25T17:05:11.723222] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T17:05:11.888717] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-25T17:05:12.361858] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T17:05:12.688728] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-25T17:05:13.169858] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T17:05:13.488732] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-25T17:05:14.036395] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T17:05:14.288733] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-25T17:05:14.718895] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T17:05:15.088724] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-25T17:05:15.629343] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T17:05:15.888719] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-25T17:05:16.323796] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T17:05:16.688719] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-25T17:05:17.136742] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T17:05:17.488738] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-25T17:05:18.106843] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T17:05:18.107868] [INFO ] [REMOTE ] AFGB: Full fetch complete (3647 records). [2025-09-25T17:05:18.107938] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-25T17:05:18.288798] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-25T17:05:18.496542] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-25T17:05:18.496631] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-25T17:05:18.496787] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-25T17:05:18.496831] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-25T17:05:18.497245] [DEBUG] [LOCAL ] AFGB: Trimmed 3647 records to 2394 (keeping 200 days of data) [2025-09-25T17:05:18.513795] [DEBUG] [LOCAL ] AFGB: Primary data saved (2394 records). [2025-09-25T17:05:18.513931] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-25T17:05:18.514052] [INFO ] [MAIN ] Update Progress: 45/2372 symbols completed. AFGB took 30.1s. Estimated remaining: 4h 31m 54s. Rate: 8.6 symbols/min [2025-09-25T17:05:18.688634] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:18.785344] [DEBUG] [LOCAL ] AFL: Loaded 53143 existing records from primary storage. [2025-09-25T17:05:18.785549] [INFO ] [MAIN ] AFL: Loaded 53143 existing records. [2025-09-25T17:05:18.963214] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T17:05:18.989752] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:18.990010] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-25T17:05:18.990059] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-25T17:05:18.990451] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-25T17:05:18.990512] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-25T17:05:19.099797] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-25T17:05:19.364491] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:19.774332] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T17:05:19.888709] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-25T17:05:20.344878] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T17:05:20.688740] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-25T17:05:21.488761] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-25T17:05:22.036543] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T17:05:22.288688] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-25T17:05:22.440075] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T17:05:22.680519] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T17:05:23.088726] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-25T17:05:23.589177] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-25T17:05:23.888730] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-25T17:05:24.554148] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T17:05:24.555625] [INFO ] [REMOTE ] AFGC: Full fetch complete (3718 records). [2025-09-25T17:05:24.556757] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-25T17:05:24.690389] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-25T17:05:24.979593] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-25T17:05:24.979710] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-25T17:05:24.979882] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-25T17:05:24.979934] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-25T17:05:24.980305] [DEBUG] [LOCAL ] AFGC: Trimmed 3718 records to 2590 (keeping 200 days of data) [2025-09-25T17:05:24.999311] [DEBUG] [LOCAL ] AFGC: Primary data saved (2590 records). [2025-09-25T17:05:24.999438] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-25T17:05:24.999517] [INFO ] [MAIN ] Update Progress: 46/2372 symbols completed. AFGC took 26.7s. Estimated remaining: 4h 31m 21s. Rate: 8.6 symbols/min [2025-09-25T17:05:25.120278] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T17:05:25.188383] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:25.251169] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-09-25T17:05:25.251348] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-09-25T17:05:25.438412] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:25.438723] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-25T17:05:25.438789] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-25T17:05:25.439062] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-25T17:05:25.439119] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-25T17:05:25.489084] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-25T17:05:25.798765] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:26.288737] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-25T17:05:26.777269] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T17:05:27.088738] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-25T17:05:27.230140] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T17:05:27.431694] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-25T17:05:27.888752] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-25T17:05:28.688713] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-25T17:05:29.254548] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T17:05:29.256130] [INFO ] [REMOTE ] AFGD: Full fetch complete (3191 records). [2025-09-25T17:05:29.256260] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-25T17:05:29.497017] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-25T17:05:29.680916] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-25T17:05:29.680994] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-25T17:05:29.681109] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-25T17:05:29.681147] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-25T17:05:29.681493] [DEBUG] [LOCAL ] AFGD: Trimmed 3191 records to 1852 (keeping 200 days of data) [2025-09-25T17:05:29.693447] [DEBUG] [LOCAL ] AFGD: Primary data saved (1852 records). [2025-09-25T17:05:29.693604] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-25T17:05:29.694183] [INFO ] [MAIN ] Update Progress: 47/2372 symbols completed. AFGD took 29.8s. Estimated remaining: 4h 29m 20s. Rate: 8.6 symbols/min [2025-09-25T17:05:29.874206] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T17:05:29.959344] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:30.008054] [DEBUG] [LOCAL ] AGCO: Loaded 42446 existing records from primary storage. [2025-09-25T17:05:30.008212] [INFO ] [MAIN ] AGCO: Loaded 42446 existing records. [2025-09-25T17:05:30.205960] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:30.206221] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-25T17:05:30.206268] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-25T17:05:30.206553] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-25T17:05:30.206613] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-25T17:05:30.293959] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-25T17:05:30.631571] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:31.088803] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-25T17:05:31.320057] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T17:05:31.609628] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T17:05:31.888694] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-25T17:05:32.289059] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T17:05:32.688724] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-25T17:05:33.455368] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T17:05:33.458561] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T17:05:33.488687] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-25T17:05:34.288970] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-25T17:05:35.088702] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-25T17:05:35.491171] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T17:05:35.722832] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T17:05:35.842915] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:05:35.888683] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-25T17:05:36.688776] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-25T17:05:37.488889] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-25T17:05:37.577227] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T17:05:37.996110] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T17:05:37.997919] [INFO ] [REMOTE ] AFGE: Full fetch complete (3488 records). [2025-09-25T17:05:37.998057] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-25T17:05:38.228735] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T17:05:38.289479] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-25T17:05:38.552275] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-25T17:05:38.552405] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-25T17:05:38.552601] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-25T17:05:38.552667] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-25T17:05:38.553391] [DEBUG] [LOCAL ] AFGE: Trimmed 3488 records to 2508 (keeping 200 days of data) [2025-09-25T17:05:38.572920] [DEBUG] [LOCAL ] AFGE: Primary data saved (2508 records). [2025-09-25T17:05:38.573122] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-25T17:05:38.573243] [INFO ] [MAIN ] Update Progress: 48/2372 symbols completed. AFGE took 28.6s. Estimated remaining: 4h 30m 46s. Rate: 8.6 symbols/min [2025-09-25T17:05:38.792159] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:38.825493] [DEBUG] [LOCAL ] AGD: Loaded 17713 existing records from primary storage. [2025-09-25T17:05:38.825746] [INFO ] [MAIN ] AGD: Loaded 17713 existing records. [2025-09-25T17:05:39.037202] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:39.038516] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-25T17:05:39.038572] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-25T17:05:39.038882] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-25T17:05:39.038943] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-25T17:05:39.090756] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-25T17:05:39.455152] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:39.888801] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-25T17:05:40.444449] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-25T17:05:40.688799] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-25T17:05:41.111678] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T17:05:41.329168] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T17:05:41.488839] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-25T17:05:42.288828] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-25T17:05:42.604588] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T17:05:42.964824] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T17:05:43.043475] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:05:43.088677] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-25T17:05:43.888701] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-25T17:05:44.252667] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T17:05:44.688769] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-25T17:05:45.488827] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-25T17:05:45.582498] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T17:05:46.289937] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-25T17:05:46.581664] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-25T17:05:47.088715] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-25T17:05:47.379307] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T17:05:47.763477] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-25T17:05:47.888745] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-25T17:05:48.546948] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T17:05:48.586118] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:05:48.688729] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-25T17:05:49.368507] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T17:05:49.488684] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-25T17:05:50.288824] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-25T17:05:51.055862] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T17:05:51.088771] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-25T17:05:51.888736] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-25T17:05:52.108870] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T17:05:52.688811] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-25T17:05:52.849366] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T17:05:53.387973] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-25T17:05:53.488697] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-25T17:05:54.288749] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-25T17:05:54.564003] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T17:05:54.575025] [INFO ] [REMOTE ] AFL: Full fetch complete (76922 records). [2025-09-25T17:05:54.575286] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-25T17:05:55.058103] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-25T17:05:55.058235] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-25T17:05:55.059109] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-25T17:05:55.059210] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-25T17:05:55.060938] [DEBUG] [LOCAL ] AFL: Trimmed 76922 records to 53532 (keeping 200 days of data) [2025-09-25T17:05:55.139581] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-25T17:05:55.462434] [DEBUG] [LOCAL ] AFL: Primary data saved (53532 records). [2025-09-25T17:05:55.462593] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-25T17:05:55.464905] [INFO ] [MAIN ] Update Progress: 49/2372 symbols completed. AFL took 37.0s. Estimated remaining: 4h 38m 29s. Rate: 8.3 symbols/min [2025-09-25T17:05:55.655631] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-25T17:05:55.698344] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T17:05:55.768701] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:55.833328] [DEBUG] [LOCAL ] AGI: Loaded 53419 existing records from primary storage. [2025-09-25T17:05:55.833499] [INFO ] [MAIN ] AGI: Loaded 53419 existing records. [2025-09-25T17:05:55.890503] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-25T17:05:56.027343] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:05:56.027856] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-25T17:05:56.027932] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-25T17:05:56.028292] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-25T17:05:56.028360] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-25T17:05:56.188916] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T17:05:56.427941] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:05:56.688794] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-25T17:05:57.433117] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T17:05:57.488682] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-25T17:05:57.734932] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T17:05:58.288773] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-25T17:05:58.851626] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T17:05:58.859984] [INFO ] [REMOTE ] AGCO: Full fetch complete (62051 records). [2025-09-25T17:05:58.860122] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-25T17:05:59.100774] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-25T17:05:59.318864] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-25T17:05:59.318970] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-25T17:05:59.319614] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-25T17:05:59.319691] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-25T17:05:59.321289] [DEBUG] [LOCAL ] AGCO: Trimmed 62051 records to 42791 (keeping 200 days of data) [2025-09-25T17:05:59.614718] [DEBUG] [LOCAL ] AGCO: Primary data saved (42791 records). [2025-09-25T17:05:59.614854] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-25T17:05:59.614991] [INFO ] [MAIN ] Update Progress: 50/2372 symbols completed. AGCO took 29.9s. Estimated remaining: 4h 36m 0s. Rate: 8.4 symbols/min [2025-09-25T17:05:59.808859] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:05:59.885209] [DEBUG] [LOCAL ] AGL: Loaded 52421 existing records from primary storage. [2025-09-25T17:05:59.885513] [INFO ] [MAIN ] AGL: Loaded 52421 existing records. [2025-09-25T17:05:59.890968] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-25T17:06:00.074914] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T17:06:00.152209] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:00.152661] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-25T17:06:00.152735] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-25T17:06:00.153137] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-25T17:06:00.153219] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-25T17:06:00.588105] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:00.688732] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-25T17:06:00.966217] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T17:06:01.104434] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T17:06:01.488742] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-25T17:06:02.288733] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-25T17:06:03.088785] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-25T17:06:03.325133] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T17:06:03.348080] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-25T17:06:03.360284] [INFO ] [REMOTE ] AG: Full fetch complete (77578 records). [2025-09-25T17:06:03.360541] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-25T17:06:03.796806] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-25T17:06:03.796989] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-25T17:06:03.800517] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-25T17:06:03.800608] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-25T17:06:03.817938] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T17:06:03.822842] [DEBUG] [LOCAL ] AG: Trimmed 77578 records to 54033 (keeping 200 days of data) [2025-09-25T17:06:03.890780] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-25T17:06:04.184134] [DEBUG] [LOCAL ] AG: Primary data saved (54033 records). [2025-09-25T17:06:04.184313] [INFO ] [MAIN ] AG: Full history saved. [2025-09-25T17:06:04.184428] [INFO ] [MAIN ] Update Progress: 51/2372 symbols completed. AG took 39.2s. Estimated remaining: 4h 33m 56s. Rate: 8.5 symbols/min [2025-09-25T17:06:04.278271] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T17:06:04.447430] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:04.468785] [DEBUG] [LOCAL ] AGM: Loaded 9961 existing records from primary storage. [2025-09-25T17:06:04.468942] [INFO ] [MAIN ] AGM: Loaded 9961 existing records. [2025-09-25T17:06:04.659920] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:04.660512] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-25T17:06:04.660558] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-25T17:06:04.660845] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-25T17:06:04.660904] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-25T17:06:04.693774] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-25T17:06:04.977474] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T17:06:04.981977] [INFO ] [REMOTE ] AGD: Full fetch complete (25390 records). [2025-09-25T17:06:04.982061] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-25T17:06:05.200393] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:05.483249] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-25T17:06:05.483343] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-25T17:06:05.483740] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-25T17:06:05.483803] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-25T17:06:05.484528] [DEBUG] [LOCAL ] AGD: Trimmed 25390 records to 17874 (keeping 200 days of data) [2025-09-25T17:06:05.488733] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-25T17:06:05.607443] [DEBUG] [LOCAL ] AGD: Primary data saved (17874 records). [2025-09-25T17:06:05.607598] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-25T17:06:05.607710] [INFO ] [MAIN ] Update Progress: 52/2372 symbols completed. AGD took 27.0s. Estimated remaining: 4h 29m 37s. Rate: 8.6 symbols/min [2025-09-25T17:06:05.779742] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:05.817510] [DEBUG] [LOCAL ] AGO: Loaded 28083 existing records from primary storage. [2025-09-25T17:06:05.817663] [INFO ] [MAIN ] AGO: Loaded 28083 existing records. [2025-09-25T17:06:05.997018] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:05.997351] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-25T17:06:05.997398] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-25T17:06:05.997698] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-25T17:06:05.997756] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-25T17:06:06.290718] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-25T17:06:06.380851] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:06.551054] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T17:06:06.964195] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T17:06:07.006419] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:06:07.088681] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-25T17:06:07.888711] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-25T17:06:08.509057] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T17:06:08.688733] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-25T17:06:09.082337] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T17:06:09.471807] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T17:06:09.488681] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-25T17:06:10.288840] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-25T17:06:10.943097] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T17:06:11.088718] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-25T17:06:11.888688] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-25T17:06:12.006908] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T17:06:12.116498] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T17:06:12.500880] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T17:06:12.688751] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-25T17:06:13.488824] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-25T17:06:14.191126] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T17:06:14.288737] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-25T17:06:14.464415] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:06:15.088732] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-25T17:06:15.888739] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-25T17:06:16.513780] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-25T17:06:16.688735] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-25T17:06:16.930150] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:06:17.005574] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T17:06:17.488743] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-25T17:06:18.288756] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-25T17:06:18.370422] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T17:06:19.088739] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-25T17:06:19.110370] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T17:06:19.229035] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:06:19.888723] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-25T17:06:20.688705] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-25T17:06:21.014875] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T17:06:21.424111] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T17:06:21.488719] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-25T17:06:21.639262] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T17:06:22.288734] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-25T17:06:22.824117] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T17:06:23.088735] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-25T17:06:23.888914] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-25T17:06:24.148234] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:06:24.221126] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T17:06:24.688870] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-25T17:06:25.488728] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-25T17:06:25.544386] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T17:06:25.979915] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T17:06:26.288699] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-25T17:06:27.088836] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-25T17:06:27.349409] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T17:06:27.888762] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-25T17:06:28.057004] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T17:06:28.243318] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:06:28.688729] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-25T17:06:28.907333] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:06:29.488733] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-25T17:06:29.682467] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T17:06:30.288787] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-25T17:06:30.524942] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:06:30.530934] [INFO ] [REMOTE ] AGO: Full fetch complete (39335 records). [2025-09-25T17:06:30.531069] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-25T17:06:30.990902] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-25T17:06:30.990999] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-25T17:06:30.991550] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-25T17:06:30.991681] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-25T17:06:30.993056] [DEBUG] [LOCAL ] AGO: Trimmed 39335 records to 28247 (keeping 200 days of data) [2025-09-25T17:06:31.115071] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-25T17:06:31.141875] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T17:06:31.230184] [DEBUG] [LOCAL ] AGO: Primary data saved (28247 records). [2025-09-25T17:06:31.230359] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-25T17:06:31.230521] [INFO ] [MAIN ] Update Progress: 53/2372 symbols completed. AGO took 25.6s. Estimated remaining: 4h 43m 6s. Rate: 8.2 symbols/min [2025-09-25T17:06:31.426420] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:31.478392] [DEBUG] [LOCAL ] AGRO: Loaded 33723 existing records from primary storage. [2025-09-25T17:06:31.478542] [INFO ] [MAIN ] AGRO: Loaded 33723 existing records. [2025-09-25T17:06:31.670904] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:31.671493] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-25T17:06:31.671564] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-25T17:06:31.672413] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-25T17:06:31.672485] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-25T17:06:31.897738] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-25T17:06:32.169073] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:32.688715] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-25T17:06:32.803627] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T17:06:32.808307] [INFO ] [REMOTE ] AGM: Full fetch complete (12525 records). [2025-09-25T17:06:32.808568] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-25T17:06:33.232067] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-25T17:06:33.232155] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-25T17:06:33.232435] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-25T17:06:33.232476] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-25T17:06:33.233134] [DEBUG] [LOCAL ] AGM: Trimmed 12525 records to 9994 (keeping 200 days of data) [2025-09-25T17:06:33.333912] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T17:06:33.347456] [INFO ] [REMOTE ] AGI: Full fetch complete (76738 records). [2025-09-25T17:06:33.347588] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-25T17:06:33.498415] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-25T17:06:33.504321] [DEBUG] [LOCAL ] AGM: Primary data saved (9994 records). [2025-09-25T17:06:33.504517] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-25T17:06:33.504631] [INFO ] [MAIN ] Update Progress: 54/2372 symbols completed. AGM took 29.3s. Estimated remaining: 4h 39m 22s. Rate: 8.3 symbols/min [2025-09-25T17:06:33.925684] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:33.976855] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-25T17:06:33.976954] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-25T17:06:33.977764] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-25T17:06:33.977829] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-25T17:06:33.991914] [DEBUG] [LOCAL ] AGI: Trimmed 76738 records to 53807 (keeping 200 days of data) [2025-09-25T17:06:34.026692] [DEBUG] [LOCAL ] AGX: Loaded 33392 existing records from primary storage. [2025-09-25T17:06:34.026866] [INFO ] [MAIN ] AGX: Loaded 33392 existing records. [2025-09-25T17:06:34.232185] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:06:34.360159] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-25T17:06:34.577735] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:34.578108] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-25T17:06:34.578158] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-25T17:06:34.585000] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-25T17:06:34.585063] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-25T17:06:34.755068] [DEBUG] [LOCAL ] AGI: Primary data saved (53807 records). [2025-09-25T17:06:34.767091] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-25T17:06:34.772340] [INFO ] [MAIN ] Update Progress: 55/2372 symbols completed. AGI took 39.3s. Estimated remaining: 4h 35m 3s. Rate: 8.4 symbols/min [2025-09-25T17:06:35.166164] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:35.256775] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:35.257101] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-25T17:06:35.290387] [DEBUG] [LOCAL ] AHH: Loaded 41386 existing records from primary storage. [2025-09-25T17:06:35.290559] [INFO ] [MAIN ] AHH: Loaded 41386 existing records. [2025-09-25T17:06:35.472750] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:35.473070] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-25T17:06:35.473116] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-25T17:06:35.476842] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-25T17:06:35.477046] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-25T17:06:35.868903] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-25T17:06:35.911269] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-25T17:06:35.950221] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:36.415319] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-25T17:06:36.688708] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-25T17:06:37.488714] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-25T17:06:38.331316] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (3.07 seconds). [2025-09-25T17:06:38.340853] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-25T17:06:38.413770] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T17:06:38.959228] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-09-25T17:06:38.976820] [INFO ] [REMOTE ] AGL: Full fetch complete (75439 records). [2025-09-25T17:06:38.977218] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-25T17:06:39.102925] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-25T17:06:39.431972] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-25T17:06:39.432079] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-25T17:06:39.433223] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-25T17:06:39.433312] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-25T17:06:39.435600] [DEBUG] [LOCAL ] AGL: Trimmed 75439 records to 52810 (keeping 200 days of data) [2025-09-25T17:06:39.680945] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T17:06:39.805020] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T17:06:39.829900] [DEBUG] [LOCAL ] AGL: Primary data saved (52810 records). [2025-09-25T17:06:39.830026] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-25T17:06:39.833957] [INFO ] [MAIN ] Update Progress: 56/2372 symbols completed. AGL took 40.2s. Estimated remaining: 4h 33m 31s. Rate: 8.5 symbols/min [2025-09-25T17:06:39.888931] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-25T17:06:40.017581] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:40.017808] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-25T17:06:40.017865] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-25T17:06:40.018200] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-25T17:06:40.018256] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-25T17:06:40.018325] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-25T17:06:40.018380] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-25T17:06:40.340365] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T17:06:40.421526] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:40.688734] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-25T17:06:41.065720] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T17:06:41.488739] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-25T17:06:42.221118] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T17:06:42.288719] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-25T17:06:42.485137] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:06:42.485498] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-25T17:06:43.084610] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T17:06:43.094742] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-25T17:06:43.888734] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-25T17:06:44.582689] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T17:06:44.688743] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-25T17:06:45.004224] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T17:06:45.488729] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-25T17:06:46.288811] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-25T17:06:47.015861] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-25T17:06:47.088735] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-25T17:06:47.273943] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T17:06:47.888750] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-25T17:06:48.427458] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-25T17:06:48.689675] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-25T17:06:48.916897] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:06:48.917261] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-25T17:06:48.957487] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T17:06:49.159685] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T17:06:49.488740] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-25T17:06:49.752749] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:06:49.753138] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-25T17:06:50.288721] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-25T17:06:50.500473] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:06:50.500892] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-25T17:06:51.088718] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-25T17:06:51.888719] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-25T17:06:52.628798] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T17:06:52.688695] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-25T17:06:52.839471] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T17:06:52.895975] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:06:52.896324] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-25T17:06:53.488737] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-25T17:06:54.288722] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-25T17:06:55.100148] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-25T17:06:55.103184] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T17:06:55.507986] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:06:55.515861] [INFO ] [REMOTE ] AGRO: Full fetch complete (49874 records). [2025-09-25T17:06:55.516035] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-25T17:06:55.899846] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-25T17:06:55.948293] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-25T17:06:55.948502] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-25T17:06:55.949245] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-25T17:06:55.949319] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-25T17:06:55.951137] [DEBUG] [LOCAL ] AGRO: Trimmed 49874 records to 33927 (keeping 200 days of data) [2025-09-25T17:06:56.177387] [DEBUG] [LOCAL ] AGRO: Primary data saved (33927 records). [2025-09-25T17:06:56.177604] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-25T17:06:56.177771] [INFO ] [MAIN ] Update Progress: 57/2372 symbols completed. AGRO took 24.9s. Estimated remaining: 4h 39m 40s. Rate: 8.3 symbols/min [2025-09-25T17:06:56.364220] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:06:56.428677] [DEBUG] [LOCAL ] AHR: Loaded 49294 existing records from primary storage. [2025-09-25T17:06:56.428899] [INFO ] [MAIN ] AHR: Loaded 49294 existing records. [2025-09-25T17:06:56.615163] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:06:56.615526] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-25T17:06:56.615597] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-25T17:06:56.617081] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-25T17:06:56.617144] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-25T17:06:56.696752] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-25T17:06:57.105558] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:06:57.109108] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T17:06:57.192408] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T17:06:57.488722] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-25T17:06:58.131943] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T17:06:58.288704] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-25T17:06:59.088724] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-25T17:06:59.888811] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-25T17:07:00.004523] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-25T17:07:00.056192] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:07:00.688721] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-25T17:07:00.929183] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:07:01.401548] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T17:07:01.488726] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-25T17:07:02.031826] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T17:07:02.288945] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-25T17:07:03.088782] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-25T17:07:03.140102] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:07:03.150162] [INFO ] [REMOTE ] AGX: Full fetch complete (48917 records). [2025-09-25T17:07:03.150359] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-25T17:07:03.565175] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-25T17:07:03.565512] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-25T17:07:03.566152] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-25T17:07:03.566254] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-25T17:07:03.567577] [DEBUG] [LOCAL ] AGX: Trimmed 48917 records to 33628 (keeping 200 days of data) [2025-09-25T17:07:03.812985] [DEBUG] [LOCAL ] AGX: Primary data saved (33628 records). [2025-09-25T17:07:03.813134] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-25T17:07:03.813241] [INFO ] [MAIN ] Update Progress: 58/2372 symbols completed. AGX took 30.3s. Estimated remaining: 4h 39m 48s. Rate: 8.3 symbols/min [2025-09-25T17:07:03.891538] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-25T17:07:03.957374] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T17:07:04.042210] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:04.052048] [DEBUG] [LOCAL ] AHT: Loaded 6070 existing records from primary storage. [2025-09-25T17:07:04.052164] [INFO ] [MAIN ] AHT: Loaded 6070 existing records. [2025-09-25T17:07:04.247752] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:04.248513] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-25T17:07:04.248577] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-25T17:07:04.249187] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-25T17:07:04.249274] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-25T17:07:04.679145] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:04.701690] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-25T17:07:04.731998] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T17:07:04.893036] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T17:07:05.488750] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-25T17:07:05.523667] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T17:07:06.289074] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-25T17:07:06.853390] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T17:07:07.088766] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-25T17:07:07.569625] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T17:07:07.888761] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-25T17:07:08.493401] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:07:08.503287] [INFO ] [REMOTE ] AHL: Full fetch complete (17799 records). [2025-09-25T17:07:08.503601] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-25T17:07:08.704666] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-25T17:07:08.776228] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 97 unique days, need 200 days [2025-09-25T17:07:08.778017] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:07:08.778391] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:07:08.778709] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-25T17:07:08.778833] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-25T17:07:08.778904] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-25T17:07:08.778988] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-25T17:07:08.779149] [INFO ] [MAIN ] Update Progress: 59/2372 symbols completed. AHL took 28.9s. Estimated remaining: 4h 38m 11s. Rate: 8.3 symbols/min [2025-09-25T17:07:09.068853] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:09.176594] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-25T17:07:09.176847] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-25T17:07:09.378531] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:09.379427] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-25T17:07:09.379491] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-25T17:07:09.379964] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-25T17:07:09.380027] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-25T17:07:09.493896] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-25T17:07:09.580664] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:07:09.915131] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:10.090547] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T17:07:10.288775] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-25T17:07:10.489098] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:07:11.088749] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-25T17:07:11.888804] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-25T17:07:12.688746] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-25T17:07:12.953138] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T17:07:12.987466] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T17:07:12.996446] [INFO ] [REMOTE ] AHH: Full fetch complete (60312 records). [2025-09-25T17:07:12.996682] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-25T17:07:13.194454] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-25T17:07:13.494176] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-25T17:07:13.517483] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T17:07:13.521150] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-25T17:07:13.521259] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-25T17:07:13.521985] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-25T17:07:13.522530] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-25T17:07:13.527981] [DEBUG] [LOCAL ] AHH: Trimmed 60312 records to 41636 (keeping 200 days of data) [2025-09-25T17:07:13.832332] [DEBUG] [LOCAL ] AHH: Primary data saved (41636 records). [2025-09-25T17:07:13.832584] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-25T17:07:13.832868] [INFO ] [MAIN ] Update Progress: 60/2372 symbols completed. AHH took 39.0s. Estimated remaining: 4h 36m 40s. Rate: 8.4 symbols/min [2025-09-25T17:07:14.026265] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:14.098830] [DEBUG] [LOCAL ] AIG: Loaded 53475 existing records from primary storage. [2025-09-25T17:07:14.099050] [INFO ] [MAIN ] AIG: Loaded 53475 existing records. [2025-09-25T17:07:14.289138] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-25T17:07:14.291893] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:14.292157] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-25T17:07:14.292221] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-25T17:07:14.292596] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-25T17:07:14.292720] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-25T17:07:14.694824] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:14.942472] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T17:07:15.088702] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-25T17:07:15.229722] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:07:15.781875] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T17:07:15.888753] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-25T17:07:16.688767] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-25T17:07:17.403323] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T17:07:17.488743] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-25T17:07:18.079914] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-25T17:07:18.288764] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-25T17:07:19.088811] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-25T17:07:19.438511] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T17:07:19.747067] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T17:07:19.888739] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-25T17:07:20.688713] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-25T17:07:21.272154] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T17:07:21.346995] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-25T17:07:21.488700] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-25T17:07:21.642267] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T17:07:22.201057] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T17:07:22.288679] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-25T17:07:22.938173] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T17:07:23.088682] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-25T17:07:23.855566] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T17:07:23.857671] [INFO ] [REMOTE ] AHT: Full fetch complete (9398 records). [2025-09-25T17:07:23.857746] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-25T17:07:23.893855] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-25T17:07:24.286830] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-25T17:07:24.286933] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-25T17:07:24.287186] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-25T17:07:24.287228] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-25T17:07:24.287794] [DEBUG] [LOCAL ] AHT: Trimmed 9398 records to 6122 (keeping 200 days of data) [2025-09-25T17:07:24.330162] [DEBUG] [LOCAL ] AHT: Primary data saved (6122 records). [2025-09-25T17:07:24.330335] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-25T17:07:24.330503] [INFO ] [MAIN ] Update Progress: 61/2372 symbols completed. AHT took 20.5s. Estimated remaining: 4h 38m 39s. Rate: 8.3 symbols/min [2025-09-25T17:07:24.516997] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:24.517199] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-25T17:07:24.517255] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-25T17:07:24.518148] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-25T17:07:24.518208] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-25T17:07:24.518278] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-25T17:07:24.518326] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-25T17:07:24.688855] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-25T17:07:25.024491] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:25.391412] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T17:07:25.488795] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-25T17:07:25.690531] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:07:25.691049] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-25T17:07:26.288701] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-25T17:07:26.482327] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:07:26.482538] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-25T17:07:26.540584] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T17:07:27.088721] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-25T17:07:27.309906] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:07:27.310223] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-25T17:07:27.888737] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-25T17:07:28.688743] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-25T17:07:28.914482] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:07:28.914864] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-25T17:07:29.488713] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-25T17:07:29.687204] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:07:29.687551] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-25T17:07:29.985942] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T17:07:30.288712] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-25T17:07:31.088708] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-25T17:07:31.888699] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-25T17:07:32.098145] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T17:07:32.219780] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T17:07:32.688761] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-25T17:07:33.488749] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-25T17:07:34.058945] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-25T17:07:34.288764] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-25T17:07:34.582948] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T17:07:34.612727] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T17:07:35.088734] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-25T17:07:35.659317] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T17:07:35.888741] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-25T17:07:36.686937] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-25T17:07:36.697746] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-25T17:07:37.467533] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T17:07:37.488710] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-25T17:07:37.576105] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:07:38.288756] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-25T17:07:39.088708] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-25T17:07:39.206853] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:07:39.210609] [INFO ] [REMOTE ] AII: Full fetch complete (10555 records). [2025-09-25T17:07:39.210747] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-25T17:07:39.433217] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T17:07:39.466184] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 97 unique days, need 200 days [2025-09-25T17:07:39.466822] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:07:39.466897] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:07:39.466963] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-25T17:07:39.467094] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-25T17:07:39.467160] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-25T17:07:39.467239] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-25T17:07:39.467334] [INFO ] [MAIN ] Update Progress: 62/2372 symbols completed. AII took 15.1s. Estimated remaining: 4h 43m 26s. Rate: 8.1 symbols/min [2025-09-25T17:07:39.652871] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:39.695379] [DEBUG] [LOCAL ] AIN: Loaded 24576 existing records from primary storage. [2025-09-25T17:07:39.696113] [INFO ] [MAIN ] AIN: Loaded 24576 existing records. [2025-09-25T17:07:39.884562] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:39.884968] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-25T17:07:39.885031] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-25T17:07:39.885568] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-25T17:07:39.885676] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-25T17:07:39.890631] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-25T17:07:40.273288] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:40.627558] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T17:07:40.637783] [INFO ] [REMOTE ] AHR: Full fetch complete (70973 records). [2025-09-25T17:07:40.637939] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-25T17:07:40.694832] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-25T17:07:41.095105] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-25T17:07:41.095242] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-25T17:07:41.096172] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-25T17:07:41.096258] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-25T17:07:41.098429] [DEBUG] [LOCAL ] AHR: Trimmed 70973 records to 49615 (keeping 200 days of data) [2025-09-25T17:07:41.425046] [DEBUG] [LOCAL ] AHR: Primary data saved (49615 records). [2025-09-25T17:07:41.425282] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-25T17:07:41.425475] [INFO ] [MAIN ] Update Progress: 63/2372 symbols completed. AHR took 45.2s. Estimated remaining: 4h 40m 1s. Rate: 8.2 symbols/min [2025-09-25T17:07:41.498841] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-25T17:07:41.618369] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:41.633781] [DEBUG] [LOCAL ] AIO: Loaded 13261 existing records from primary storage. [2025-09-25T17:07:41.633897] [INFO ] [MAIN ] AIO: Loaded 13261 existing records. [2025-09-25T17:07:41.825186] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:41.826092] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-25T17:07:41.826139] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-25T17:07:41.826470] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-25T17:07:41.826530] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-25T17:07:42.218867] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:42.254060] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-25T17:07:42.291795] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-25T17:07:42.376429] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T17:07:42.628878] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T17:07:43.088748] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-25T17:07:43.888735] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-25T17:07:43.957005] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T17:07:44.467082] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-25T17:07:44.688849] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-25T17:07:45.388174] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T17:07:45.488742] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-25T17:07:45.724958] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:07:46.288785] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-25T17:07:47.088695] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-25T17:07:47.461371] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T17:07:47.888716] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-25T17:07:47.973331] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-25T17:07:47.983434] [INFO ] [REMOTE ] AI: Full fetch complete (77896 records). [2025-09-25T17:07:47.983628] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-25T17:07:48.448252] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-25T17:07:48.448382] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-25T17:07:48.449774] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-25T17:07:48.449841] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-25T17:07:48.452347] [DEBUG] [LOCAL ] AI: Trimmed 77896 records to 54139 (keeping 200 days of data) [2025-09-25T17:07:48.697232] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-25T17:07:48.734339] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T17:07:48.863118] [DEBUG] [LOCAL ] AI: Primary data saved (54139 records). [2025-09-25T17:07:48.863266] [INFO ] [MAIN ] AI: Full history saved. [2025-09-25T17:07:48.866078] [INFO ] [MAIN ] Update Progress: 64/2372 symbols completed. AI took 40.1s. Estimated remaining: 4h 39m 59s. Rate: 8.2 symbols/min [2025-09-25T17:07:49.042878] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:49.080124] [DEBUG] [LOCAL ] AIR: Loaded 27507 existing records from primary storage. [2025-09-25T17:07:49.080321] [INFO ] [MAIN ] AIR: Loaded 27507 existing records. [2025-09-25T17:07:49.226183] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T17:07:49.302187] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:07:49.302707] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-25T17:07:49.302785] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-25T17:07:49.303107] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-25T17:07:49.303181] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-25T17:07:49.494967] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-25T17:07:49.689175] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:49.707788] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T17:07:50.288769] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-25T17:07:51.088849] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-25T17:07:51.246906] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T17:07:51.434138] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T17:07:51.888753] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-25T17:07:52.092079] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T17:07:52.633504] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:07:52.688711] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-25T17:07:53.488723] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-25T17:07:54.288722] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-25T17:07:54.380338] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:07:55.088739] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-25T17:07:55.418392] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T17:07:55.481142] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T17:07:55.492866] [INFO ] [REMOTE ] AIG: Full fetch complete (77379 records). [2025-09-25T17:07:55.493006] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-25T17:07:55.896235] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-25T17:07:55.979473] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-25T17:07:55.979585] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-25T17:07:55.980430] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-25T17:07:55.980511] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-25T17:07:55.983091] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T17:07:55.983324] [DEBUG] [LOCAL ] AIG: Trimmed 77379 records to 53865 (keeping 200 days of data) [2025-09-25T17:07:56.338706] [DEBUG] [LOCAL ] AIG: Primary data saved (53865 records). [2025-09-25T17:07:56.338859] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-25T17:07:56.339012] [INFO ] [MAIN ] Update Progress: 65/2372 symbols completed. AIG took 42.5s. Estimated remaining: 4h 39m 59s. Rate: 8.2 symbols/min [2025-09-25T17:07:56.509452] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:07:56.509621] [DEBUG] [LOCAL ] AIT: No existing data file found in primary storage. [2025-09-25T17:07:56.509687] [WARN ] [MAIN ] AIT: No existing data found, performing full refresh instead. [2025-09-25T17:07:56.509856] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-25T17:07:56.509945] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-25T17:07:56.510013] [DEBUG] [LOCAL ] AIT: No primary data file found to delete. [2025-09-25T17:07:56.510047] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-25T17:07:56.700713] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-25T17:07:56.876975] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:07:57.260475] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T17:07:57.488733] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-25T17:07:57.747490] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T17:07:58.288761] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-25T17:07:58.846331] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T17:07:59.088750] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-25T17:07:59.363886] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T17:07:59.888735] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-25T17:08:00.131088] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T17:08:00.688737] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-25T17:08:01.030076] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T17:08:01.488732] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-25T17:08:02.128715] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T17:08:02.288762] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-25T17:08:02.340569] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T17:08:03.088677] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-25T17:08:03.470140] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T17:08:03.888769] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-25T17:08:04.688741] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-25T17:08:05.488780] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-25T17:08:06.058084] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-25T17:08:06.132257] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-25T17:08:06.150879] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T17:08:06.297172] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-25T17:08:06.302446] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:08:07.088697] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-25T17:08:07.227844] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T17:08:07.888807] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-25T17:08:08.431932] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T17:08:08.688763] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-25T17:08:09.057787] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:08:09.488775] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-25T17:08:09.606984] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:08:09.610000] [INFO ] [REMOTE ] AIO: Full fetch complete (20045 records). [2025-09-25T17:08:09.610088] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-25T17:08:10.065499] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-25T17:08:10.065745] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-25T17:08:10.066299] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-25T17:08:10.066383] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-25T17:08:10.068111] [DEBUG] [LOCAL ] AIO: Trimmed 20045 records to 13365 (keeping 200 days of data) [2025-09-25T17:08:10.170837] [DEBUG] [LOCAL ] AIO: Primary data saved (13365 records). [2025-09-25T17:08:10.170999] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-25T17:08:10.171179] [INFO ] [MAIN ] Update Progress: 66/2372 symbols completed. AIO took 28.7s. Estimated remaining: 4h 43m 41s. Rate: 8.1 symbols/min [2025-09-25T17:08:10.293890] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-25T17:08:10.454153] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:10.501940] [DEBUG] [LOCAL ] AIV: Loaded 40245 existing records from primary storage. [2025-09-25T17:08:10.502098] [INFO ] [MAIN ] AIV: Loaded 40245 existing records. [2025-09-25T17:08:10.707434] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:08:10.743588] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:10.746845] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-25T17:08:10.749744] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-25T17:08:10.752730] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-25T17:08:10.752807] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-25T17:08:11.097855] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-25T17:08:11.130606] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:11.533741] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T17:08:11.888720] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-25T17:08:12.182282] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T17:08:12.688836] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-25T17:08:13.009288] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T17:08:13.488734] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-25T17:08:14.122589] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:08:14.288773] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-25T17:08:14.651010] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T17:08:15.088724] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-25T17:08:15.543064] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:08:15.550176] [INFO ] [REMOTE ] AIN: Full fetch complete (33251 records). [2025-09-25T17:08:15.550400] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-25T17:08:15.894738] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-25T17:08:16.047228] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-25T17:08:16.047385] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-25T17:08:16.048090] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-25T17:08:16.048201] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-25T17:08:16.049666] [DEBUG] [LOCAL ] AIN: Trimmed 33251 records to 24757 (keeping 200 days of data) [2025-09-25T17:08:16.233386] [DEBUG] [LOCAL ] AIN: Primary data saved (24757 records). [2025-09-25T17:08:16.233606] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-25T17:08:16.233836] [INFO ] [MAIN ] Update Progress: 67/2372 symbols completed. AIN took 36.8s. Estimated remaining: 4h 42m 48s. Rate: 8.2 symbols/min [2025-09-25T17:08:16.345669] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T17:08:16.473219] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:16.530058] [DEBUG] [LOCAL ] AIZ: Loaded 30117 existing records from primary storage. [2025-09-25T17:08:16.530309] [INFO ] [MAIN ] AIZ: Loaded 30117 existing records. [2025-09-25T17:08:16.696874] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-25T17:08:16.734676] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:16.735084] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-25T17:08:16.735140] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-25T17:08:16.745076] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-25T17:08:16.745306] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-25T17:08:17.141137] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:17.488785] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-25T17:08:17.605234] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T17:08:18.288927] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-25T17:08:18.618292] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T17:08:18.629869] [INFO ] [REMOTE ] AIT: Full fetch complete (39542 records). [2025-09-25T17:08:18.630250] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-25T17:08:19.064196] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-25T17:08:19.064315] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-25T17:08:19.064883] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-25T17:08:19.064951] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-25T17:08:19.066374] [DEBUG] [LOCAL ] AIT: Trimmed 39542 records to 28128 (keeping 200 days of data) [2025-09-25T17:08:19.137570] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-25T17:08:19.288806] [DEBUG] [LOCAL ] AIT: Primary data saved (28128 records). [2025-09-25T17:08:19.289023] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-25T17:08:19.289136] [INFO ] [MAIN ] Update Progress: 68/2372 symbols completed. AIT took 22.9s. Estimated remaining: 4h 40m 15s. Rate: 8.2 symbols/min [2025-09-25T17:08:19.517517] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T17:08:19.552128] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:19.582089] [DEBUG] [LOCAL ] AIZN: Loaded 3886 existing records from primary storage. [2025-09-25T17:08:19.582305] [INFO ] [MAIN ] AIZN: Loaded 3886 existing records. [2025-09-25T17:08:19.700548] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T17:08:19.815911] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:19.816304] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-25T17:08:19.816372] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-25T17:08:19.816735] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-25T17:08:19.816796] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-25T17:08:19.894762] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-25T17:08:20.227832] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:20.565099] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:08:20.571738] [INFO ] [REMOTE ] AIR: Full fetch complete (37769 records). [2025-09-25T17:08:20.571969] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-25T17:08:20.573392] [FATAL] [VALIDATOR ] AIR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:08:20.574003] [FATAL] [MAIN ] AIR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:08:20.574135] [WARN ] [MAIN ] AIR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:08:20.574400] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-25T17:08:20.574474] [DEBUG] [LOCAL ] AIR: No primary data file found to delete. [2025-09-25T17:08:20.574524] [INFO ] [LOCAL ] AIR: Starting deletion of derivative data. [2025-09-25T17:08:20.575016] [DEBUG] [LOCAL ] AIR: Deleted derivative data file. [2025-09-25T17:08:20.575146] [INFO ] [MAIN ] Update Progress: 69/2372 symbols completed. AIR took 31.7s. Estimated remaining: 4h 36m 47s. Rate: 8.3 symbols/min [2025-09-25T17:08:20.694744] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-25T17:08:20.768331] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:20.854425] [DEBUG] [LOCAL ] AJG: Loaded 47053 existing records from primary storage. [2025-09-25T17:08:20.854602] [INFO ] [MAIN ] AJG: Loaded 47053 existing records. [2025-09-25T17:08:21.059692] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:21.060248] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-25T17:08:21.060296] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-25T17:08:21.060622] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-25T17:08:21.060712] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-25T17:08:21.382421] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T17:08:21.459302] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:21.488666] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-25T17:08:22.294781] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-25T17:08:22.307934] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T17:08:23.059829] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T17:08:23.088698] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-25T17:08:23.333427] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T17:08:23.578107] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T17:08:23.889324] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-25T17:08:24.688808] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-25T17:08:25.038306] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-25T17:08:25.488758] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-25T17:08:25.779973] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T17:08:26.154101] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T17:08:26.288703] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-25T17:08:26.896030] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T17:08:27.088705] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-25T17:08:27.684723] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T17:08:27.888682] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-25T17:08:28.519774] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T17:08:28.688714] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-25T17:08:29.128046] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-25T17:08:29.488723] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-25T17:08:30.288747] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-25T17:08:31.088800] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-25T17:08:31.115111] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T17:08:31.796416] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T17:08:31.888690] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-25T17:08:32.535850] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:08:32.688704] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-25T17:08:33.064097] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:08:33.488702] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-25T17:08:34.231732] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T17:08:34.288734] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-25T17:08:34.569684] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T17:08:35.088723] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-25T17:08:35.742068] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T17:08:35.888730] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-25T17:08:36.055752] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T17:08:36.688718] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-25T17:08:37.149448] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T17:08:37.488722] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-25T17:08:38.110360] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T17:08:38.111581] [INFO ] [REMOTE ] AIZN: Full fetch complete (5740 records). [2025-09-25T17:08:38.111676] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-25T17:08:38.288754] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-25T17:08:38.431932] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T17:08:38.548054] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-25T17:08:38.548147] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-25T17:08:38.548370] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-25T17:08:38.548410] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-25T17:08:38.548836] [DEBUG] [LOCAL ] AIZN: Trimmed 5740 records to 3914 (keeping 200 days of data) [2025-09-25T17:08:38.575156] [DEBUG] [LOCAL ] AIZN: Primary data saved (3914 records). [2025-09-25T17:08:38.575303] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-25T17:08:38.575470] [INFO ] [MAIN ] Update Progress: 70/2372 symbols completed. AIZN took 19.3s. Estimated remaining: 4h 42m 34s. Rate: 8.1 symbols/min [2025-09-25T17:08:38.751967] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:38.752166] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-25T17:08:38.752221] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-25T17:08:38.752722] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-25T17:08:38.752786] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-25T17:08:38.752857] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-25T17:08:38.752913] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-25T17:08:39.093892] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-25T17:08:39.124362] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:39.888729] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-25T17:08:39.939801] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T17:08:40.347262] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T17:08:40.426272] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T17:08:40.688732] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-25T17:08:41.164367] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T17:08:41.488745] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-25T17:08:41.972220] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T17:08:42.288726] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-25T17:08:43.088728] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-25T17:08:43.599623] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T17:08:43.888724] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-25T17:08:44.288881] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T17:08:44.688760] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-25T17:08:44.860293] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:08:45.048240] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-25T17:08:45.488716] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-25T17:08:46.288719] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-25T17:08:46.776426] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T17:08:47.088729] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-25T17:08:47.571926] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T17:08:47.730997] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T17:08:47.888721] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-25T17:08:48.200183] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-25T17:08:48.688802] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-25T17:08:49.488720] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-25T17:08:50.288865] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-25T17:08:50.647637] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T17:08:50.732892] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T17:08:50.743061] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T17:08:51.088854] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-25T17:08:51.888765] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-25T17:08:52.688743] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-25T17:08:52.904815] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T17:08:52.921289] [INFO ] [REMOTE ] AJG: Full fetch complete (69806 records). [2025-09-25T17:08:52.921471] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-25T17:08:52.990029] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-25T17:08:53.018239] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T17:08:53.403029] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-25T17:08:53.403140] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-25T17:08:53.404535] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-25T17:08:53.404695] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-25T17:08:53.409729] [DEBUG] [LOCAL ] AJG: Trimmed 69806 records to 47404 (keeping 200 days of data) [2025-09-25T17:08:53.493911] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-25T17:08:53.757627] [DEBUG] [LOCAL ] AJG: Primary data saved (47404 records). [2025-09-25T17:08:53.757806] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-25T17:08:53.762854] [INFO ] [MAIN ] Update Progress: 71/2372 symbols completed. AJG took 33.2s. Estimated remaining: 4h 46m 40s. Rate: 8.0 symbols/min [2025-09-25T17:08:53.941452] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:54.005468] [DEBUG] [LOCAL ] AKR: Loaded 45761 existing records from primary storage. [2025-09-25T17:08:54.005620] [INFO ] [MAIN ] AKR: Loaded 45761 existing records. [2025-09-25T17:08:54.204783] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:54.205396] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-25T17:08:54.205448] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-25T17:08:54.206033] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-25T17:08:54.206114] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-25T17:08:54.293863] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-25T17:08:54.588142] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:54.718127] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:08:54.726412] [INFO ] [REMOTE ] AIZ: Full fetch complete (42944 records). [2025-09-25T17:08:54.726512] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-25T17:08:55.090454] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-25T17:08:55.119044] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-25T17:08:55.119150] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-25T17:08:55.119626] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-25T17:08:55.119724] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-25T17:08:55.121114] [DEBUG] [LOCAL ] AIZ: Trimmed 42944 records to 30320 (keeping 200 days of data) [2025-09-25T17:08:55.326112] [DEBUG] [LOCAL ] AIZ: Primary data saved (30320 records). [2025-09-25T17:08:55.326250] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-25T17:08:55.326396] [INFO ] [MAIN ] Update Progress: 72/2372 symbols completed. AIZ took 39.1s. Estimated remaining: 4h 43m 24s. Rate: 8.1 symbols/min [2025-09-25T17:08:55.515178] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:55.573019] [DEBUG] [LOCAL ] AL: Loaded 44086 existing records from primary storage. [2025-09-25T17:08:55.573153] [INFO ] [MAIN ] AL: Loaded 44086 existing records. [2025-09-25T17:08:55.613701] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-25T17:08:55.614529] [INFO ] [REMOTE ] AKA: Full fetch complete (2415 records). [2025-09-25T17:08:55.614598] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-25T17:08:55.898154] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-25T17:08:55.984341] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:08:56.041245] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:56.041576] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-25T17:08:56.048454] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T17:08:56.048704] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:08:56.048813] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:08:56.048908] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-25T17:08:56.048987] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-25T17:08:56.049057] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-25T17:08:56.049130] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-25T17:08:56.041628] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-25T17:08:56.049199] [INFO ] [MAIN ] Update Progress: 73/2372 symbols completed. AKA took 17.5s. Estimated remaining: 4h 39m 47s. Rate: 8.2 symbols/min [2025-09-25T17:08:56.083185] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-25T17:08:56.083475] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-25T17:08:56.376380] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:08:56.615692] [DEBUG] [LOCAL ] ALB: Loaded 53222 existing records from primary storage. [2025-09-25T17:08:56.615843] [INFO ] [MAIN ] ALB: Loaded 53222 existing records. [2025-09-25T17:08:56.731706] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-25T17:08:56.815194] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:56.901876] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:08:56.902137] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-25T17:08:56.902192] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-25T17:08:56.902551] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-25T17:08:56.902609] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-25T17:08:57.275329] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:08:57.489009] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-25T17:08:57.697970] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T17:08:57.934078] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T17:08:58.288756] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-25T17:08:59.088770] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-25T17:08:59.687716] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T17:08:59.748003] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T17:08:59.888726] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-25T17:09:00.688720] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-25T17:09:00.805233] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T17:09:01.493022] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-25T17:09:01.500081] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:09:02.045493] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T17:09:02.288772] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-25T17:09:03.048606] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:09:03.088734] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-25T17:09:03.841485] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T17:09:03.888684] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-25T17:09:04.596482] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T17:09:04.688793] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-25T17:09:05.178984] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T17:09:05.488731] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-25T17:09:05.839042] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-25T17:09:06.288728] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-25T17:09:06.912399] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T17:09:07.088727] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-25T17:09:07.888696] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-25T17:09:08.044520] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T17:09:08.053072] [INFO ] [REMOTE ] AIV: Full fetch complete (59265 records). [2025-09-25T17:09:08.053261] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-25T17:09:08.457594] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-25T17:09:08.457738] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-25T17:09:08.458385] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-25T17:09:08.458449] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-25T17:09:08.461114] [DEBUG] [LOCAL ] AIV: Trimmed 59265 records to 40567 (keeping 200 days of data) [2025-09-25T17:09:08.610512] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:09:08.693886] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-25T17:09:08.769202] [DEBUG] [LOCAL ] AIV: Primary data saved (40567 records). [2025-09-25T17:09:08.769353] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-25T17:09:08.769539] [INFO ] [MAIN ] Update Progress: 74/2372 symbols completed. AIV took 58.6s. Estimated remaining: 4h 42m 28s. Rate: 8.1 symbols/min [2025-09-25T17:09:08.948337] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:09.011305] [DEBUG] [LOCAL ] ALC: Loaded 50772 existing records from primary storage. [2025-09-25T17:09:09.011467] [INFO ] [MAIN ] ALC: Loaded 50772 existing records. [2025-09-25T17:09:09.196215] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:09.196531] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-25T17:09:09.196600] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-25T17:09:09.197055] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-25T17:09:09.197154] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-25T17:09:09.494813] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-25T17:09:09.674083] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:09.688385] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T17:09:10.288728] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-25T17:09:10.422983] [DEBUG] [REMOTE ] ALC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-25T17:09:10.423472] [WARN ] [REMOTE ] ALC: No data returned for month 2024-12 [2025-09-25T17:09:10.487406] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T17:09:11.088734] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-25T17:09:11.186991] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T17:09:11.888792] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-25T17:09:12.669070] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:09:12.688729] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-25T17:09:13.488723] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-25T17:09:13.858040] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T17:09:14.288755] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-25T17:09:14.433277] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T17:09:14.997640] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T17:09:15.088702] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-25T17:09:15.778822] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T17:09:15.888721] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-25T17:09:16.472752] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T17:09:16.688713] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-25T17:09:17.488693] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-25T17:09:17.602695] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:09:18.288723] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-25T17:09:18.345483] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T17:09:18.354479] [INFO ] [REMOTE ] AKR: Full fetch complete (65438 records). [2025-09-25T17:09:18.354734] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-25T17:09:18.796938] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-25T17:09:18.797037] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-25T17:09:18.797716] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-25T17:09:18.797784] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-25T17:09:18.806414] [DEBUG] [LOCAL ] AKR: Trimmed 65438 records to 46130 (keeping 200 days of data) [2025-09-25T17:09:18.811258] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T17:09:19.094629] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-25T17:09:19.108255] [DEBUG] [LOCAL ] AKR: Primary data saved (46130 records). [2025-09-25T17:09:19.108351] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-25T17:09:19.112000] [INFO ] [MAIN ] Update Progress: 75/2372 symbols completed. AKR took 25.3s. Estimated remaining: 4h 43m 51s. Rate: 8.1 symbols/min [2025-09-25T17:09:19.288493] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:19.329868] [DEBUG] [LOCAL ] ALE: Loaded 30136 existing records from primary storage. [2025-09-25T17:09:19.330014] [INFO ] [MAIN ] ALE: Loaded 30136 existing records. [2025-09-25T17:09:19.511761] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:19.512008] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-25T17:09:19.512052] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-25T17:09:19.512437] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-25T17:09:19.512496] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-25T17:09:19.876293] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:19.888684] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-25T17:09:20.284958] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T17:09:20.694954] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-25T17:09:20.699816] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:09:21.204297] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:09:21.488740] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-25T17:09:21.856122] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T17:09:22.288731] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-25T17:09:23.088724] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-25T17:09:23.336328] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T17:09:23.516465] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T17:09:23.526006] [INFO ] [REMOTE ] AL: Full fetch complete (62256 records). [2025-09-25T17:09:23.526161] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-25T17:09:23.888777] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-25T17:09:23.994431] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-25T17:09:23.994529] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-25T17:09:23.995347] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-25T17:09:23.995423] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-25T17:09:23.996901] [DEBUG] [LOCAL ] AL: Trimmed 62256 records to 44455 (keeping 200 days of data) [2025-09-25T17:09:24.292843] [DEBUG] [LOCAL ] AL: Primary data saved (44455 records). [2025-09-25T17:09:24.292980] [INFO ] [MAIN ] AL: Full history saved. [2025-09-25T17:09:24.293073] [INFO ] [MAIN ] Update Progress: 76/2372 symbols completed. AL took 29.0s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-09-25T17:09:24.470861] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:24.471039] [DEBUG] [LOCAL ] ALEX: No existing data file found in primary storage. [2025-09-25T17:09:24.471077] [WARN ] [MAIN ] ALEX: No existing data found, performing full refresh instead. [2025-09-25T17:09:24.471534] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-25T17:09:24.471581] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-25T17:09:24.471621] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-09-25T17:09:24.471679] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-25T17:09:24.694754] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-25T17:09:24.809684] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:09:24.958575] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:24.997141] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T17:09:25.489017] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-25T17:09:26.288788] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-25T17:09:26.478423] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T17:09:27.088735] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-25T17:09:27.207694] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-25T17:09:27.888755] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-25T17:09:28.175401] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T17:09:28.471151] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T17:09:28.688793] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-25T17:09:29.100099] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T17:09:29.488799] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-25T17:09:30.288677] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-25T17:09:30.711248] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:09:30.737230] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-25T17:09:31.088855] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-25T17:09:31.881850] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T17:09:31.891610] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-25T17:09:32.177778] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T17:09:32.688842] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-25T17:09:33.196578] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T17:09:33.488724] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-25T17:09:34.093614] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T17:09:34.226804] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:09:34.288760] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-25T17:09:35.088826] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-25T17:09:35.888733] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-25T17:09:36.167273] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T17:09:36.287273] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-25T17:09:36.688741] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-25T17:09:37.488910] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-25T17:09:38.143365] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-25T17:09:38.236120] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T17:09:38.249104] [INFO ] [REMOTE ] ALE: Full fetch complete (42396 records). [2025-09-25T17:09:38.249386] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-25T17:09:38.297589] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-25T17:09:38.683508] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-25T17:09:38.683625] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-25T17:09:38.684154] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-25T17:09:38.684258] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-25T17:09:38.688906] [DEBUG] [LOCAL ] ALE: Trimmed 42396 records to 30493 (keeping 200 days of data) [2025-09-25T17:09:38.908617] [DEBUG] [LOCAL ] ALE: Primary data saved (30493 records). [2025-09-25T17:09:38.908779] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-25T17:09:38.910456] [INFO ] [MAIN ] Update Progress: 77/2372 symbols completed. ALE took 19.8s. Estimated remaining: 4h 46m 4s. Rate: 8.0 symbols/min [2025-09-25T17:09:39.088733] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-25T17:09:39.175877] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:09:39.888729] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-25T17:09:40.554128] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-25T17:09:40.616195] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:09:40.688726] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-25T17:09:41.500514] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-25T17:09:41.507127] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T17:09:41.519631] [INFO ] [REMOTE ] ALC: Full fetch complete (67209 records). [2025-09-25T17:09:41.519900] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-25T17:09:41.757889] [WARN ] [VALIDATOR ] ALC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T17:09:41.761771] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:09:41.761897] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:09:41.762016] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-25T17:09:41.762144] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-09-25T17:09:41.762227] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-09-25T17:09:41.762919] [DEBUG] [LOCAL ] ALC: Deleted derivative data file. [2025-09-25T17:09:41.763114] [INFO ] [MAIN ] Update Progress: 78/2372 symbols completed. ALC took 33.0s. Estimated remaining: 4h 43m 41s. Rate: 8.1 symbols/min [2025-09-25T17:09:43.061342] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:09:43.080035] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-25T17:09:43.099443] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-25T17:09:43.111088] [INFO ] [REMOTE ] ALB: Full fetch complete (76771 records). [2025-09-25T17:09:43.111216] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-25T17:09:43.502994] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-25T17:09:43.503092] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-25T17:09:43.504812] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-25T17:09:43.504877] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-25T17:09:43.506622] [DEBUG] [LOCAL ] ALB: Trimmed 76771 records to 53612 (keeping 200 days of data) [2025-09-25T17:09:43.855718] [DEBUG] [LOCAL ] ALB: Primary data saved (53612 records). [2025-09-25T17:09:43.855888] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-25T17:09:43.856068] [INFO ] [MAIN ] Update Progress: 79/2372 symbols completed. ALB took 47.8s. Estimated remaining: 4h 40m 59s. Rate: 8.2 symbols/min [2025-09-25T17:09:44.539203] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T17:09:44.546570] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-25T17:09:45.803442] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T17:09:45.810709] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-25T17:09:46.908440] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T17:09:46.916011] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-25T17:09:47.760288] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T17:09:47.766396] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-25T17:09:49.162344] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:09:49.168717] [INFO ] [REMOTE ] ALEX: Full fetch complete (44590 records). [2025-09-25T17:09:49.168815] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-25T17:09:49.593787] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-25T17:09:49.593954] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-25T17:09:49.594571] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-25T17:09:49.594636] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-25T17:09:49.597170] [DEBUG] [LOCAL ] ALEX: Trimmed 44590 records to 31536 (keeping 200 days of data) [2025-09-25T17:09:49.801879] [DEBUG] [LOCAL ] ALEX: Primary data saved (31536 records). [2025-09-25T17:09:49.802022] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-25T17:09:49.802120] [INFO ] [MAIN ] Update Progress: 80/2372 symbols completed. ALEX took 25.5s. Estimated remaining: 4h 40m 11s. Rate: 8.2 symbols/min [2025-09-25T17:09:50.511821] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:50.515540] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:50.559155] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:50.576682] [DEBUG] [LOCAL ] ALG: Loaded 10414 existing records from primary storage. [2025-09-25T17:09:50.576847] [INFO ] [MAIN ] ALG: Loaded 10414 existing records. [2025-09-25T17:09:50.611374] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:09:50.738054] [DEBUG] [LOCAL ] ALL: Loaded 50194 existing records from primary storage. [2025-09-25T17:09:50.738213] [INFO ] [MAIN ] ALL: Loaded 50194 existing records. [2025-09-25T17:09:50.820291] [DEBUG] [LOCAL ] ALIT: Loaded 52761 existing records from primary storage. [2025-09-25T17:09:50.820455] [INFO ] [MAIN ] ALIT: Loaded 52761 existing records. [2025-09-25T17:09:51.034722] [DEBUG] [LOCAL ] ALK: Loaded 53068 existing records from primary storage. [2025-09-25T17:09:51.034892] [INFO ] [MAIN ] ALK: Loaded 53068 existing records. [2025-09-25T17:09:51.253729] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:51.253975] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-25T17:09:51.254020] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-25T17:09:51.254325] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-25T17:09:51.254397] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-25T17:09:51.529260] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:51.529510] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-25T17:09:51.529556] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-25T17:09:51.529884] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-25T17:09:51.529943] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-25T17:09:51.591982] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:51.592227] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-25T17:09:51.592271] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-25T17:09:51.592571] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-25T17:09:51.592629] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-25T17:09:51.694346] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:09:51.719439] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-25T17:09:51.719502] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-25T17:09:51.734422] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-25T17:09:51.734624] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-25T17:09:52.817733] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:52.833599] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-25T17:09:52.932217] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:52.932588] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-25T17:09:53.044380] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:53.071448] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-25T17:09:53.148807] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:09:53.149239] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-25T17:09:53.939926] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T17:09:53.943575] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-25T17:09:54.650231] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:09:54.660988] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-25T17:09:54.895467] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T17:09:54.911557] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-25T17:09:54.922495] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T17:09:54.926365] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-25T17:09:55.076380] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T17:09:55.088177] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-25T17:09:55.596418] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T17:09:55.599846] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-25T17:09:56.006078] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T17:09:56.017583] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-25T17:09:56.280012] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T17:09:56.284280] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-25T17:09:56.489524] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:09:56.504294] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-25T17:09:56.634313] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:09:56.688799] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-25T17:09:57.119753] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T17:09:57.489823] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-25T17:09:57.611034] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T17:09:58.090113] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T17:09:58.273960] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T17:09:58.288674] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-25T17:09:58.342788] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T17:09:59.088814] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-25T17:09:59.888792] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-25T17:10:00.145508] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T17:10:00.694621] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-25T17:10:00.705309] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T17:10:00.799344] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:10:01.488852] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-25T17:10:02.288745] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-25T17:10:02.409224] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T17:10:03.088740] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-25T17:10:03.119244] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T17:10:03.291754] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T17:10:03.888876] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-25T17:10:04.652173] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:10:04.688736] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-25T17:10:04.749076] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T17:10:05.488810] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-25T17:10:06.276990] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T17:10:06.279514] [INFO ] [REMOTE ] ALG: Full fetch complete (15793 records). [2025-09-25T17:10:06.279668] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-25T17:10:06.280854] [FATAL] [VALIDATOR ] ALG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:10:06.280951] [FATAL] [MAIN ] ALG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:10:06.281035] [WARN ] [MAIN ] ALG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:10:06.281183] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-25T17:10:06.281305] [DEBUG] [LOCAL ] ALG: No primary data file found to delete. [2025-09-25T17:10:06.281416] [INFO ] [LOCAL ] ALG: Starting deletion of derivative data. [2025-09-25T17:10:06.282149] [DEBUG] [LOCAL ] ALG: Deleted derivative data file. [2025-09-25T17:10:06.282411] [INFO ] [MAIN ] Update Progress: 81/2372 symbols completed. ALG took 16.5s. Estimated remaining: 4h 44m 23s. Rate: 8.1 symbols/min [2025-09-25T17:10:06.288801] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-25T17:10:06.502529] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T17:10:06.568415] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:06.665876] [DEBUG] [LOCAL ] ALLE: Loaded 45119 existing records from primary storage. [2025-09-25T17:10:06.666156] [INFO ] [MAIN ] ALLE: Loaded 45119 existing records. [2025-09-25T17:10:06.965559] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:06.966162] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-25T17:10:06.966251] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-25T17:10:06.967182] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-25T17:10:06.967258] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-25T17:10:07.094760] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-25T17:10:07.361225] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:07.888792] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-25T17:10:08.109263] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T17:10:08.688737] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-25T17:10:08.879265] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T17:10:09.488826] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-25T17:10:09.574251] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:10:10.288757] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-25T17:10:10.481684] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T17:10:10.861722] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T17:10:11.088758] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-25T17:10:11.792625] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T17:10:11.888741] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-25T17:10:12.688801] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-25T17:10:12.779808] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:10:13.382534] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T17:10:13.488714] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-25T17:10:14.288793] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-25T17:10:14.456322] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T17:10:15.088739] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-25T17:10:15.277685] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T17:10:15.579077] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T17:10:15.888760] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-25T17:10:16.585249] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T17:10:16.688754] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-25T17:10:17.233228] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:10:17.488754] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-25T17:10:18.106056] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T17:10:18.116099] [INFO ] [REMOTE ] ALL: Full fetch complete (72528 records). [2025-09-25T17:10:18.116300] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-25T17:10:18.299397] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-25T17:10:18.581332] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-25T17:10:18.581464] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-25T17:10:18.582362] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-25T17:10:18.582434] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-25T17:10:18.585022] [DEBUG] [LOCAL ] ALL: Trimmed 72528 records to 50565 (keeping 200 days of data) [2025-09-25T17:10:18.952022] [DEBUG] [LOCAL ] ALL: Primary data saved (50565 records). [2025-09-25T17:10:18.952231] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-25T17:10:18.952405] [INFO ] [MAIN ] Update Progress: 82/2372 symbols completed. ALL took 29.1s. Estimated remaining: 4h 46m 41s. Rate: 8.0 symbols/min [2025-09-25T17:10:19.094734] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-25T17:10:19.160454] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:19.236028] [DEBUG] [LOCAL ] ALLY: Loaded 53218 existing records from primary storage. [2025-09-25T17:10:19.236207] [INFO ] [MAIN ] ALLY: Loaded 53218 existing records. [2025-09-25T17:10:19.363850] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T17:10:19.482092] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:19.482764] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-25T17:10:19.482863] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-25T17:10:19.483328] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-25T17:10:19.483423] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-25T17:10:19.876056] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:19.888693] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-25T17:10:20.544325] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T17:10:20.688750] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-25T17:10:21.096453] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T17:10:21.488729] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-25T17:10:21.833834] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T17:10:21.846542] [INFO ] [REMOTE ] ALIT: Full fetch complete (76413 records). [2025-09-25T17:10:21.846746] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-25T17:10:22.231719] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T17:10:22.292754] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-25T17:10:22.335325] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-25T17:10:22.335427] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-25T17:10:22.336849] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-25T17:10:22.336925] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-25T17:10:22.338871] [DEBUG] [LOCAL ] ALIT: Trimmed 76413 records to 53147 (keeping 200 days of data) [2025-09-25T17:10:22.741132] [DEBUG] [LOCAL ] ALIT: Primary data saved (53147 records). [2025-09-25T17:10:22.741315] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-25T17:10:22.741444] [INFO ] [MAIN ] Update Progress: 83/2372 symbols completed. ALIT took 32.9s. Estimated remaining: 4h 44m 51s. Rate: 8.0 symbols/min [2025-09-25T17:10:23.015845] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:23.077336] [DEBUG] [LOCAL ] ALSN: Loaded 43286 existing records from primary storage. [2025-09-25T17:10:23.077540] [INFO ] [MAIN ] ALSN: Loaded 43286 existing records. [2025-09-25T17:10:23.090597] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-25T17:10:23.434602] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:23.435002] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-25T17:10:23.435059] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-25T17:10:23.435423] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-25T17:10:23.435494] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-25T17:10:23.475558] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T17:10:23.904354] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-25T17:10:23.945417] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T17:10:24.115059] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:24.565769] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:10:24.688687] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-25T17:10:25.488694] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-25T17:10:25.812502] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T17:10:26.288696] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-25T17:10:26.336690] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:10:26.349860] [INFO ] [REMOTE ] ALK: Full fetch complete (76832 records). [2025-09-25T17:10:26.350026] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-25T17:10:26.751233] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-25T17:10:26.751327] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-25T17:10:26.752105] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-25T17:10:26.752173] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-25T17:10:26.755101] [DEBUG] [LOCAL ] ALK: Trimmed 76832 records to 53452 (keeping 200 days of data) [2025-09-25T17:10:27.090151] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-25T17:10:27.111349] [DEBUG] [LOCAL ] ALK: Primary data saved (53452 records). [2025-09-25T17:10:27.111589] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-25T17:10:27.111761] [INFO ] [MAIN ] Update Progress: 84/2372 symbols completed. ALK took 37.3s. Estimated remaining: 4h 43m 19s. Rate: 8.1 symbols/min [2025-09-25T17:10:27.319526] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:27.363434] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T17:10:27.383735] [DEBUG] [LOCAL ] ALTG: Loaded 23914 existing records from primary storage. [2025-09-25T17:10:27.383908] [INFO ] [MAIN ] ALTG: Loaded 23914 existing records. [2025-09-25T17:10:27.603606] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:27.604181] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-25T17:10:27.604232] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-25T17:10:27.605139] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-25T17:10:27.605227] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-25T17:10:27.889822] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-25T17:10:28.056131] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T17:10:28.101814] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:28.518060] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:10:28.688782] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-25T17:10:29.407979] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:10:29.488715] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-25T17:10:30.288762] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-25T17:10:30.552029] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T17:10:30.728551] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T17:10:31.088722] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-25T17:10:31.596635] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T17:10:31.888709] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-25T17:10:32.655054] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T17:10:32.688675] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-25T17:10:33.427216] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T17:10:33.488695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-25T17:10:34.288850] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-25T17:10:34.702876] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T17:10:35.082841] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T17:10:35.095718] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-25T17:10:35.888712] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-25T17:10:36.080808] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T17:10:36.688764] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-25T17:10:36.720516] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T17:10:36.919291] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T17:10:37.488811] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-25T17:10:38.288696] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-25T17:10:38.520621] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T17:10:38.562130] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T17:10:38.575681] [INFO ] [REMOTE ] ALLE: Full fetch complete (64944 records). [2025-09-25T17:10:38.575962] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-25T17:10:38.991241] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-25T17:10:38.991368] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-25T17:10:38.992158] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-25T17:10:38.992263] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-25T17:10:38.994022] [DEBUG] [LOCAL ] ALLE: Trimmed 64944 records to 45377 (keeping 200 days of data) [2025-09-25T17:10:39.104804] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-25T17:10:39.339607] [DEBUG] [LOCAL ] ALLE: Primary data saved (45377 records). [2025-09-25T17:10:39.339832] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-25T17:10:39.344039] [INFO ] [MAIN ] Update Progress: 85/2372 symbols completed. ALLE took 33.1s. Estimated remaining: 4h 45m 21s. Rate: 8.0 symbols/min [2025-09-25T17:10:39.526340] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:39.551990] [DEBUG] [LOCAL ] ALUR: Loaded 10867 existing records from primary storage. [2025-09-25T17:10:39.552124] [INFO ] [MAIN ] ALUR: Loaded 10867 existing records. [2025-09-25T17:10:39.739426] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:39.739921] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-25T17:10:39.739995] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-25T17:10:39.740352] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-25T17:10:39.740435] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-25T17:10:39.852497] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:10:39.893892] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-25T17:10:40.164901] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:40.688695] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-25T17:10:40.748207] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T17:10:41.153501] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T17:10:41.488761] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-25T17:10:41.790170] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T17:10:42.288775] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-25T17:10:43.090017] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-25T17:10:43.266159] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T17:10:43.345699] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T17:10:43.888701] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-25T17:10:44.688710] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-25T17:10:44.738817] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T17:10:44.996440] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T17:10:45.488724] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-25T17:10:46.094297] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T17:10:46.288710] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-25T17:10:47.067260] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T17:10:47.088674] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-25T17:10:47.888736] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-25T17:10:48.172872] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T17:10:48.183207] [INFO ] [REMOTE ] ALLY: Full fetch complete (76893 records). [2025-09-25T17:10:48.183366] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-25T17:10:48.440234] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T17:10:48.464210] [INFO ] [REMOTE ] ALSN: Full fetch complete (62048 records). [2025-09-25T17:10:48.464371] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-25T17:10:48.645421] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T17:10:48.706057] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-25T17:10:48.947240] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-25T17:10:48.947346] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-25T17:10:48.948187] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-25T17:10:48.948256] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-25T17:10:48.962086] [DEBUG] [LOCAL ] ALLY: Trimmed 76893 records to 53608 (keeping 200 days of data) [2025-09-25T17:10:49.248502] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-25T17:10:49.248638] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-25T17:10:49.249318] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-25T17:10:49.249395] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-25T17:10:49.251593] [DEBUG] [LOCAL ] ALSN: Trimmed 62048 records to 43608 (keeping 200 days of data) [2025-09-25T17:10:49.494736] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-25T17:10:49.735887] [DEBUG] [LOCAL ] ALSN: Primary data saved (43608 records). [2025-09-25T17:10:49.736050] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-25T17:10:49.736207] [INFO ] [MAIN ] Update Progress: 86/2372 symbols completed. ALSN took 27.0s. Estimated remaining: 4h 46m 30s. Rate: 8.0 symbols/min [2025-09-25T17:10:49.840125] [DEBUG] [LOCAL ] ALLY: Primary data saved (53608 records). [2025-09-25T17:10:49.840309] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-25T17:10:49.840454] [INFO ] [MAIN ] Update Progress: 87/2372 symbols completed. ALLY took 30.9s. Estimated remaining: 4h 43m 8s. Rate: 8.1 symbols/min [2025-09-25T17:10:49.961905] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:10:50.077494] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:50.224503] [DEBUG] [LOCAL ] ALV: Loaded 42613 existing records from primary storage. [2025-09-25T17:10:50.224695] [INFO ] [MAIN ] ALV: Loaded 42613 existing records. [2025-09-25T17:10:50.241883] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:50.263680] [DEBUG] [LOCAL ] ALX: Loaded 6011 existing records from primary storage. [2025-09-25T17:10:50.263847] [INFO ] [MAIN ] ALX: Loaded 6011 existing records. [2025-09-25T17:10:50.292821] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-25T17:10:50.609730] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:50.610159] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-25T17:10:50.610213] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-25T17:10:50.610605] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-25T17:10:50.610700] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-25T17:10:50.729167] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T17:10:50.817184] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:10:50.854782] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-25T17:10:50.854921] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-25T17:10:50.855173] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-25T17:10:50.855236] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-25T17:10:51.104781] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-25T17:10:51.424927] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:51.521600] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T17:10:51.532994] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:51.888732] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-25T17:10:52.140502] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:10:52.380400] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-25T17:10:52.688743] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-25T17:10:53.488751] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-25T17:10:54.174730] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T17:10:54.179782] [INFO ] [REMOTE ] ALTG: Full fetch complete (33694 records). [2025-09-25T17:10:54.179927] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-25T17:10:54.294766] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-25T17:10:54.592940] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-25T17:10:54.593033] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-25T17:10:54.593470] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-25T17:10:54.593512] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-25T17:10:54.594897] [DEBUG] [LOCAL ] ALTG: Trimmed 33694 records to 24032 (keeping 200 days of data) [2025-09-25T17:10:54.767545] [DEBUG] [LOCAL ] ALTG: Primary data saved (24032 records). [2025-09-25T17:10:54.767711] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-25T17:10:54.767851] [INFO ] [MAIN ] Update Progress: 88/2372 symbols completed. ALTG took 27.7s. Estimated remaining: 4h 41m 56s. Rate: 8.1 symbols/min [2025-09-25T17:10:54.808714] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T17:10:54.945192] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:10:54.945388] [DEBUG] [LOCAL ] AM: No existing data file found in primary storage. [2025-09-25T17:10:54.945434] [WARN ] [MAIN ] AM: No existing data found, performing full refresh instead. [2025-09-25T17:10:54.946538] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-25T17:10:54.946583] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-25T17:10:54.946626] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-09-25T17:10:54.946701] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-25T17:10:55.102150] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-25T17:10:55.130092] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:10:55.364584] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:10:55.598181] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T17:10:55.888779] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-25T17:10:56.382999] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T17:10:56.688771] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-25T17:10:57.243436] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T17:10:57.488968] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-25T17:10:58.288786] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-25T17:10:59.088778] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-25T17:10:59.251375] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T17:10:59.580419] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-25T17:10:59.893837] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-25T17:10:59.914612] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T17:11:00.688732] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-25T17:11:00.891783] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T17:11:01.488773] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-25T17:11:02.117900] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T17:11:02.288689] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-25T17:11:02.449995] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T17:11:03.088762] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-25T17:11:03.799686] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T17:11:03.888730] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-25T17:11:03.973534] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T17:11:04.688827] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-25T17:11:05.405168] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T17:11:05.410058] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T17:11:05.488699] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-25T17:11:06.288763] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-25T17:11:07.088754] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-25T17:11:07.351489] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T17:11:07.783233] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T17:11:07.785600] [INFO ] [REMOTE ] ALX: Full fetch complete (6918 records). [2025-09-25T17:11:07.785792] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-25T17:11:07.894726] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-25T17:11:08.222767] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-25T17:11:08.222882] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-25T17:11:08.223136] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-25T17:11:08.223238] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-25T17:11:08.223793] [DEBUG] [LOCAL ] ALX: Trimmed 6918 records to 6059 (keeping 200 days of data) [2025-09-25T17:11:08.303292] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T17:11:08.323186] [DEBUG] [LOCAL ] ALX: Primary data saved (6059 records). [2025-09-25T17:11:08.323370] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-25T17:11:08.323580] [INFO ] [MAIN ] Update Progress: 89/2372 symbols completed. ALX took 18.5s. Estimated remaining: 4h 44m 26s. Rate: 8.0 symbols/min [2025-09-25T17:11:08.518034] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:08.572420] [DEBUG] [LOCAL ] AMBC: Loaded 37037 existing records from primary storage. [2025-09-25T17:11:08.572570] [INFO ] [MAIN ] AMBC: Loaded 37037 existing records. [2025-09-25T17:11:08.693862] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-25T17:11:08.766815] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:11:08.767127] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-25T17:11:08.767195] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-25T17:11:08.768678] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-25T17:11:08.768778] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-25T17:11:09.133225] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:09.488737] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-25T17:11:09.968382] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T17:11:10.222637] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T17:11:10.288699] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-25T17:11:10.899569] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T17:11:11.088743] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-25T17:11:11.836567] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:11:11.888673] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-25T17:11:12.481020] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T17:11:12.688729] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-25T17:11:13.488758] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-25T17:11:13.610820] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T17:11:14.253764] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T17:11:14.288970] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-25T17:11:14.290538] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T17:11:15.088737] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-25T17:11:15.245845] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T17:11:15.888804] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-25T17:11:16.688689] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-25T17:11:16.775477] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:11:17.208875] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T17:11:17.488698] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-25T17:11:17.701992] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T17:11:18.288729] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-25T17:11:18.973960] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T17:11:19.088712] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-25T17:11:19.565902] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T17:11:19.879169] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T17:11:19.888709] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-25T17:11:20.688736] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-25T17:11:21.380319] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T17:11:21.392422] [INFO ] [REMOTE ] ALV: Full fetch complete (61832 records). [2025-09-25T17:11:21.392586] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-25T17:11:21.493843] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-25T17:11:21.836222] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-25T17:11:21.836335] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-25T17:11:21.837260] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-25T17:11:21.837332] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-25T17:11:21.838896] [DEBUG] [LOCAL ] ALV: Trimmed 61832 records to 42904 (keeping 200 days of data) [2025-09-25T17:11:22.142813] [DEBUG] [LOCAL ] ALV: Primary data saved (42904 records). [2025-09-25T17:11:22.142965] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-25T17:11:22.143135] [INFO ] [MAIN ] Update Progress: 90/2372 symbols completed. ALV took 32.4s. Estimated remaining: 4h 46m 59s. Rate: 8.0 symbols/min [2025-09-25T17:11:22.322961] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:22.324690] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-25T17:11:22.335411] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T17:11:22.404756] [DEBUG] [LOCAL ] AMBP: Loaded 45326 existing records from primary storage. [2025-09-25T17:11:22.404926] [INFO ] [MAIN ] AMBP: Loaded 45326 existing records. [2025-09-25T17:11:22.566187] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T17:11:22.658009] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:11:22.658720] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-25T17:11:22.658838] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-25T17:11:22.659348] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-25T17:11:22.659431] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-25T17:11:23.049815] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:23.088731] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-25T17:11:23.503943] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T17:11:23.679585] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T17:11:23.683399] [INFO ] [REMOTE ] ALUR: Full fetch complete (20704 records). [2025-09-25T17:11:23.683497] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-25T17:11:23.893811] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-25T17:11:24.105760] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-25T17:11:24.105842] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-25T17:11:24.106166] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-25T17:11:24.106205] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-25T17:11:24.106823] [DEBUG] [LOCAL ] ALUR: Trimmed 20704 records to 10913 (keeping 200 days of data) [2025-09-25T17:11:24.191704] [DEBUG] [LOCAL ] ALUR: Primary data saved (10913 records). [2025-09-25T17:11:24.191848] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-25T17:11:24.191990] [INFO ] [MAIN ] Update Progress: 91/2372 symbols completed. ALUR took 44.8s. Estimated remaining: 4h 44m 34s. Rate: 8.0 symbols/min [2025-09-25T17:11:24.364602] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:24.364817] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-25T17:11:24.364872] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-25T17:11:24.365917] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-25T17:11:24.365960] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-25T17:11:24.366000] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-25T17:11:24.366033] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-25T17:11:24.702818] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-25T17:11:24.750506] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:25.503870] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T17:11:25.516270] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-25T17:11:25.709987] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:25.710334] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-25T17:11:26.288726] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-25T17:11:26.431423] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T17:11:26.440933] [INFO ] [REMOTE ] AM: Full fetch complete (75607 records). [2025-09-25T17:11:26.441077] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-25T17:11:26.878539] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-25T17:11:26.878623] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-25T17:11:26.879406] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-25T17:11:26.879463] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-25T17:11:26.881094] [DEBUG] [LOCAL ] AM: Trimmed 75607 records to 52519 (keeping 200 days of data) [2025-09-25T17:11:27.108731] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-25T17:11:27.230959] [DEBUG] [LOCAL ] AM: Primary data saved (52519 records). [2025-09-25T17:11:27.231111] [INFO ] [MAIN ] AM: Full history saved. [2025-09-25T17:11:27.231208] [INFO ] [MAIN ] Update Progress: 92/2372 symbols completed. AM took 32.5s. Estimated remaining: 4h 42m 36s. Rate: 8.1 symbols/min [2025-09-25T17:11:27.410044] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:27.473711] [DEBUG] [LOCAL ] AMC: Loaded 53759 existing records from primary storage. [2025-09-25T17:11:27.473885] [INFO ] [MAIN ] AMC: Loaded 53759 existing records. [2025-09-25T17:11:27.674264] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:11:27.675759] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-25T17:11:27.675820] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-25T17:11:27.676129] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-25T17:11:27.676191] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-25T17:11:27.766886] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:27.767474] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-25T17:11:27.844257] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:11:27.901724] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-25T17:11:28.151416] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:28.688712] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-25T17:11:29.159892] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T17:11:29.488862] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-25T17:11:29.690710] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:29.691113] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-25T17:11:30.289019] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-25T17:11:31.088726] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-25T17:11:31.337979] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-25T17:11:31.673175] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:31.673686] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-25T17:11:31.708613] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:11:31.888726] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-25T17:11:32.077984] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:32.078302] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-25T17:11:32.688820] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-25T17:11:33.488878] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-25T17:11:34.288772] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-25T17:11:34.356957] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T17:11:35.088774] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-25T17:11:35.283453] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T17:11:35.888811] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-25T17:11:36.088587] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:36.089050] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-25T17:11:36.373965] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T17:11:36.567681] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:11:36.688730] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-25T17:11:36.894062] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:11:36.894448] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-25T17:11:37.488852] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-25T17:11:38.288750] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-25T17:11:38.794831] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:11:38.802324] [INFO ] [REMOTE ] AMBC: Full fetch complete (51038 records). [2025-09-25T17:11:38.802575] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-25T17:11:39.093877] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-25T17:11:39.226695] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-25T17:11:39.226790] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-25T17:11:39.227386] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-25T17:11:39.227480] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-25T17:11:39.228703] [DEBUG] [LOCAL ] AMBC: Trimmed 51038 records to 37246 (keeping 200 days of data) [2025-09-25T17:11:39.463133] [DEBUG] [LOCAL ] AMBC: Primary data saved (37246 records). [2025-09-25T17:11:39.463385] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-25T17:11:39.463777] [INFO ] [MAIN ] Update Progress: 93/2372 symbols completed. AMBC took 31.1s. Estimated remaining: 4h 44m 27s. Rate: 8.0 symbols/min [2025-09-25T17:11:39.644376] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:39.709174] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-25T17:11:39.709368] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-09-25T17:11:39.825977] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T17:11:39.892343] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-25T17:11:39.911663] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:11:39.912062] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-25T17:11:39.912122] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-25T17:11:39.912568] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-25T17:11:39.912827] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-25T17:11:40.298144] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:40.416077] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-25T17:11:40.688739] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-25T17:11:41.452010] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:11:41.488679] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-25T17:11:41.847291] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:11:42.288801] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-25T17:11:43.046150] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:11:43.088669] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-25T17:11:43.888701] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-25T17:11:44.548203] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-25T17:11:44.688744] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-25T17:11:44.721829] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T17:11:45.178174] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T17:11:45.183219] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7985 records). [2025-09-25T17:11:45.183294] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-25T17:11:45.386824] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-25T17:11:45.387107] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:11:45.387183] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:11:45.387270] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-25T17:11:45.387385] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-25T17:11:45.387489] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-25T17:11:45.387560] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-25T17:11:45.387715] [INFO ] [MAIN ] Update Progress: 94/2372 symbols completed. AMBQ took 21.2s. Estimated remaining: 4h 43m 41s. Rate: 8.0 symbols/min [2025-09-25T17:11:45.488724] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-25T17:11:45.563000] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:45.563196] [DEBUG] [LOCAL ] AME: No existing data file found in primary storage. [2025-09-25T17:11:45.563252] [WARN ] [MAIN ] AME: No existing data found, performing full refresh instead. [2025-09-25T17:11:45.563448] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-25T17:11:45.563486] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-25T17:11:45.563525] [DEBUG] [LOCAL ] AME: No primary data file found to delete. [2025-09-25T17:11:45.563555] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-25T17:11:45.924319] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:11:46.288722] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-25T17:11:46.546452] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T17:11:47.088719] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-25T17:11:47.577273] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T17:11:47.888682] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-25T17:11:48.067413] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T17:11:48.688729] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-25T17:11:48.821813] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T17:11:49.488720] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-25T17:11:49.670153] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T17:11:50.288754] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-25T17:11:50.829497] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T17:11:51.088703] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-25T17:11:51.160543] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T17:11:51.708225] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T17:11:51.888720] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-25T17:11:52.512272] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:11:52.688706] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-25T17:11:53.444358] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:11:53.488795] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-25T17:11:54.288780] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-25T17:11:54.383145] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:11:55.088743] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-25T17:11:55.284408] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T17:11:55.720718] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:11:55.888691] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-25T17:11:56.260467] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:11:56.688788] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-25T17:11:57.488724] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-25T17:11:57.675345] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T17:11:58.288758] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-25T17:11:58.398410] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T17:11:58.410233] [INFO ] [REMOTE ] AMBP: Full fetch complete (65890 records). [2025-09-25T17:11:58.410443] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-25T17:11:58.859459] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-25T17:11:58.859666] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-25T17:11:58.860676] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-25T17:11:58.860760] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-25T17:11:58.862867] [DEBUG] [LOCAL ] AMBP: Trimmed 65890 records to 45578 (keeping 200 days of data) [2025-09-25T17:11:59.094009] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-25T17:11:59.187781] [DEBUG] [LOCAL ] AMBP: Primary data saved (45578 records). [2025-09-25T17:11:59.188006] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-25T17:11:59.188175] [INFO ] [MAIN ] Update Progress: 95/2372 symbols completed. AMBP took 37.0s. Estimated remaining: 4h 46m 5s. Rate: 8.0 symbols/min [2025-09-25T17:11:59.393862] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:11:59.432368] [DEBUG] [LOCAL ] AMG: Loaded 20745 existing records from primary storage. [2025-09-25T17:11:59.432762] [INFO ] [MAIN ] AMG: Loaded 20745 existing records. [2025-09-25T17:11:59.651065] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:11:59.651350] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-25T17:11:59.651398] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-25T17:11:59.651833] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-25T17:11:59.651894] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-25T17:11:59.781570] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-25T17:11:59.892859] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-25T17:12:00.157821] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:00.193389] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T17:12:00.688728] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-25T17:12:01.488875] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-25T17:12:01.542738] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-25T17:12:01.954055] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T17:12:01.992866] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-25T17:12:02.288757] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-25T17:12:02.937639] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T17:12:03.088767] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-25T17:12:03.888794] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-25T17:12:04.123542] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T17:12:04.688724] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-25T17:12:04.866266] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T17:12:05.080993] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:12:05.488778] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-25T17:12:06.288777] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-25T17:12:07.088851] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-25T17:12:07.152062] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T17:12:07.279530] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-25T17:12:07.373862] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T17:12:07.888768] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-25T17:12:08.688833] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-25T17:12:08.815232] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:12:09.123544] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T17:12:09.488703] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-25T17:12:10.288729] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-25T17:12:10.694000] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T17:12:11.088746] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-25T17:12:11.131142] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-25T17:12:11.888737] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-25T17:12:12.655259] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-25T17:12:12.667049] [INFO ] [REMOTE ] AME: Full fetch complete (69787 records). [2025-09-25T17:12:12.667247] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-25T17:12:12.692768] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-25T17:12:13.128416] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T17:12:13.172816] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-25T17:12:13.172905] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-25T17:12:13.173670] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-25T17:12:13.173777] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-25T17:12:13.175379] [DEBUG] [LOCAL ] AME: Trimmed 69787 records to 48905 (keeping 200 days of data) [2025-09-25T17:12:13.498678] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-25T17:12:13.523208] [DEBUG] [LOCAL ] AME: Primary data saved (48905 records). [2025-09-25T17:12:13.523323] [INFO ] [MAIN ] AME: Full history saved. [2025-09-25T17:12:13.523479] [INFO ] [MAIN ] Update Progress: 96/2372 symbols completed. AME took 28.1s. Estimated remaining: 4h 48m 39s. Rate: 7.9 symbols/min [2025-09-25T17:12:13.705662] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:13.774123] [DEBUG] [LOCAL ] AMH: Loaded 51691 existing records from primary storage. [2025-09-25T17:12:13.774281] [INFO ] [MAIN ] AMH: Loaded 51691 existing records. [2025-09-25T17:12:13.914139] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:12:13.985929] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:13.986164] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-25T17:12:13.986210] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-25T17:12:13.987138] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-25T17:12:13.987214] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-25T17:12:14.171273] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T17:12:14.215446] [INFO ] [REMOTE ] AMC: Full fetch complete (77533 records). [2025-09-25T17:12:14.222215] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-25T17:12:14.239181] [FATAL] [VALIDATOR ] AMC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:12:14.240700] [FATAL] [MAIN ] AMC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:12:14.308979] [WARN ] [MAIN ] AMC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:12:14.309108] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-25T17:12:14.309203] [DEBUG] [LOCAL ] AMC: No primary data file found to delete. [2025-09-25T17:12:14.309258] [INFO ] [LOCAL ] AMC: Starting deletion of derivative data. [2025-09-25T17:12:14.309834] [DEBUG] [LOCAL ] AMC: Deleted derivative data file. [2025-09-25T17:12:14.310002] [INFO ] [MAIN ] Update Progress: 97/2372 symbols completed. AMC took 47.1s. Estimated remaining: 4h 45m 51s. Rate: 8.0 symbols/min [2025-09-25T17:12:14.308719] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-25T17:12:14.658733] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:14.665921] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:14.710601] [DEBUG] [LOCAL ] AMN: Loaded 42019 existing records from primary storage. [2025-09-25T17:12:14.710821] [INFO ] [MAIN ] AMN: Loaded 42019 existing records. [2025-09-25T17:12:14.902944] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:14.903320] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-25T17:12:14.903368] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-25T17:12:14.903615] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-25T17:12:14.903706] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-25T17:12:15.089887] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-25T17:12:15.315465] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:15.349730] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T17:12:15.580196] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T17:12:15.888696] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-25T17:12:16.688732] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-25T17:12:16.906404] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T17:12:17.488743] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-25T17:12:17.637785] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T17:12:17.836228] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T17:12:18.288765] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-25T17:12:19.088739] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-25T17:12:19.244959] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T17:12:19.888781] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-25T17:12:20.688861] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-25T17:12:21.629369] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T17:12:21.643415] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-25T17:12:21.678982] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T17:12:22.288752] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-25T17:12:23.342062] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T17:12:23.356679] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-25T17:12:23.611286] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T17:12:23.617060] [INFO ] [REMOTE ] AMG: Full fetch complete (29828 records). [2025-09-25T17:12:23.617183] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-25T17:12:24.103469] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-25T17:12:24.103599] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-25T17:12:24.104037] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-25T17:12:24.104097] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-25T17:12:24.104954] [DEBUG] [LOCAL ] AMG: Trimmed 29828 records to 20906 (keeping 200 days of data) [2025-09-25T17:12:24.257716] [DEBUG] [LOCAL ] AMG: Primary data saved (20906 records). [2025-09-25T17:12:24.257850] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-25T17:12:24.257983] [INFO ] [MAIN ] Update Progress: 98/2372 symbols completed. AMG took 25.1s. Estimated remaining: 4h 46m 40s. Rate: 7.9 symbols/min [2025-09-25T17:12:24.432776] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:24.479517] [DEBUG] [LOCAL ] AMP: Loaded 32444 existing records from primary storage. [2025-09-25T17:12:24.479705] [INFO ] [MAIN ] AMP: Loaded 32444 existing records. [2025-09-25T17:12:24.660604] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:24.661192] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-25T17:12:24.661261] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-25T17:12:24.661601] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-25T17:12:24.661708] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-25T17:12:25.135035] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:25.135409] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-25T17:12:25.232829] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T17:12:25.243853] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-25T17:12:26.587781] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (8.30 seconds). [2025-09-25T17:12:26.595848] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-25T17:12:26.858793] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T17:12:26.869218] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-25T17:12:26.931291] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T17:12:27.088758] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-25T17:12:27.839484] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T17:12:27.888772] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-25T17:12:28.187078] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (9.10 seconds). [2025-09-25T17:12:28.197722] [INFO ] [REMOTE ] AMCR: Full fetch complete (77677 records). [2025-09-25T17:12:28.197856] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-25T17:12:28.564965] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:12:28.667057] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-25T17:12:28.667149] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-25T17:12:28.667972] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-25T17:12:28.668044] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-25T17:12:28.669700] [DEBUG] [LOCAL ] AMCR: Trimmed 77677 records to 54059 (keeping 200 days of data) [2025-09-25T17:12:28.688679] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-25T17:12:28.955715] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T17:12:29.098533] [DEBUG] [LOCAL ] AMCR: Primary data saved (54059 records). [2025-09-25T17:12:29.098728] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-25T17:12:29.098835] [INFO ] [MAIN ] Update Progress: 99/2372 symbols completed. AMCR took 49.6s. Estimated remaining: 4h 45m 30s. Rate: 8.0 symbols/min [2025-09-25T17:12:29.252264] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T17:12:29.330548] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:29.393259] [DEBUG] [LOCAL ] AMPX: Loaded 52169 existing records from primary storage. [2025-09-25T17:12:29.393441] [INFO ] [MAIN ] AMPX: Loaded 52169 existing records. [2025-09-25T17:12:29.493915] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-25T17:12:29.582423] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:29.582817] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-25T17:12:29.582871] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-25T17:12:29.583173] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-25T17:12:29.583233] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-25T17:12:29.950240] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T17:12:29.984230] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:30.288731] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-25T17:12:30.876741] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T17:12:31.088731] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-25T17:12:31.888756] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-25T17:12:31.971564] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:12:32.688705] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-25T17:12:32.859997] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T17:12:33.035164] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T17:12:33.488777] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-25T17:12:34.169342] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:12:34.288829] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-25T17:12:35.098741] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-25T17:12:35.105801] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T17:12:35.888832] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-25T17:12:36.120411] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T17:12:36.132920] [INFO ] [REMOTE ] AMH: Full fetch complete (74762 records). [2025-09-25T17:12:36.133073] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-25T17:12:36.533977] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-25T17:12:36.534058] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-25T17:12:36.534812] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-25T17:12:36.534901] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-25T17:12:36.536451] [DEBUG] [LOCAL ] AMH: Trimmed 74762 records to 52080 (keeping 200 days of data) [2025-09-25T17:12:36.734945] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-25T17:12:36.816762] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T17:12:36.928296] [DEBUG] [LOCAL ] AMH: Primary data saved (52080 records). [2025-09-25T17:12:36.928451] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-25T17:12:36.932187] [INFO ] [MAIN ] Update Progress: 100/2372 symbols completed. AMH took 23.4s. Estimated remaining: 4h 45m 29s. Rate: 8.0 symbols/min [2025-09-25T17:12:37.116833] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:37.175716] [DEBUG] [LOCAL ] AMPY: Loaded 37388 existing records from primary storage. [2025-09-25T17:12:37.175877] [INFO ] [MAIN ] AMPY: Loaded 37388 existing records. [2025-09-25T17:12:37.380892] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:37.381328] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-25T17:12:37.381409] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-25T17:12:37.384689] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-25T17:12:37.384764] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-25T17:12:37.492111] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-25T17:12:37.645156] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T17:12:37.838746] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:38.288973] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-25T17:12:38.331454] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T17:12:39.094057] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T17:12:39.103736] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-25T17:12:39.493808] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T17:12:39.888761] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-25T17:12:40.688789] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-25T17:12:40.723731] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T17:12:41.488773] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-25T17:12:41.575753] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:12:41.895825] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T17:12:42.288893] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-25T17:12:42.698958] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T17:12:43.088776] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-25T17:12:43.888716] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-25T17:12:44.029731] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T17:12:44.688761] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-25T17:12:44.895101] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T17:12:45.161291] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T17:12:45.488820] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-25T17:12:46.288730] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-25T17:12:46.464782] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:12:47.088764] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-25T17:12:47.211758] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T17:12:47.224021] [INFO ] [REMOTE ] AMN: Full fetch complete (60419 records). [2025-09-25T17:12:47.224338] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-25T17:12:47.692307] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-25T17:12:47.692491] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-25T17:12:47.693477] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-25T17:12:47.693566] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-25T17:12:47.695527] [DEBUG] [LOCAL ] AMN: Trimmed 60419 records to 42296 (keeping 200 days of data) [2025-09-25T17:12:47.897753] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-25T17:12:48.000153] [DEBUG] [LOCAL ] AMN: Primary data saved (42296 records). [2025-09-25T17:12:48.000367] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-25T17:12:48.000564] [INFO ] [MAIN ] Update Progress: 101/2372 symbols completed. AMN took 33.7s. Estimated remaining: 4h 46m 41s. Rate: 7.9 symbols/min [2025-09-25T17:12:48.211007] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:48.240471] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T17:12:48.286596] [DEBUG] [LOCAL ] AMR: Loaded 29069 existing records from primary storage. [2025-09-25T17:12:48.286828] [INFO ] [MAIN ] AMR: Loaded 29069 existing records. [2025-09-25T17:12:48.542012] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:48.542427] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-25T17:12:48.542501] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-25T17:12:48.543096] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-25T17:12:48.543185] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-25T17:12:48.553315] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T17:12:48.693820] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-25T17:12:48.969439] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:49.488792] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-25T17:12:49.601807] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:12:50.269741] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T17:12:50.288689] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-25T17:12:50.504536] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:12:51.088713] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-25T17:12:51.772933] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T17:12:51.888808] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-25T17:12:51.988013] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T17:12:52.688727] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-25T17:12:53.471291] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T17:12:53.488692] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-25T17:12:54.288686] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-25T17:12:54.660923] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-25T17:12:54.720029] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T17:12:54.729950] [INFO ] [REMOTE ] AMP: Full fetch complete (47526 records). [2025-09-25T17:12:54.730051] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-25T17:12:55.096288] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-25T17:12:55.150678] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-25T17:12:55.150781] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-25T17:12:55.151319] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-25T17:12:55.151364] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-25T17:12:55.152361] [DEBUG] [LOCAL ] AMP: Trimmed 47526 records to 32671 (keeping 200 days of data) [2025-09-25T17:12:55.383879] [DEBUG] [LOCAL ] AMP: Primary data saved (32671 records). [2025-09-25T17:12:55.384018] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-25T17:12:55.384128] [INFO ] [MAIN ] Update Progress: 102/2372 symbols completed. AMP took 31.1s. Estimated remaining: 4h 46m 29s. Rate: 7.9 symbols/min [2025-09-25T17:12:55.483404] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:12:55.588849] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:12:55.636791] [DEBUG] [LOCAL ] AMRC: Loaded 38324 existing records from primary storage. [2025-09-25T17:12:55.636943] [INFO ] [MAIN ] AMRC: Loaded 38324 existing records. [2025-09-25T17:12:55.813751] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:12:55.813979] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-25T17:12:55.814026] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-25T17:12:55.814375] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-25T17:12:55.814434] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-25T17:12:55.897754] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-25T17:12:56.209203] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:12:56.688757] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-25T17:12:57.198525] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T17:12:57.382583] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-25T17:12:57.488737] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-25T17:12:58.046575] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T17:12:58.288732] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-25T17:12:58.566065] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T17:12:59.088741] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-25T17:12:59.376178] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T17:12:59.890835] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-25T17:13:00.688813] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-25T17:13:01.177596] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-25T17:13:01.311835] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T17:13:01.488755] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-25T17:13:01.918960] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T17:13:02.288846] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-25T17:13:03.088807] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-25T17:13:03.883549] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-25T17:13:03.896719] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-25T17:13:03.898826] [INFO ] [REMOTE ] AMPX: Full fetch complete (74191 records). [2025-09-25T17:13:03.899105] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-25T17:13:03.904799] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:13:03.907799] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:13:03.907871] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:13:03.907942] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-25T17:13:03.908057] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-09-25T17:13:03.908133] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-09-25T17:13:03.908898] [DEBUG] [LOCAL ] AMPX: Deleted derivative data file. [2025-09-25T17:13:03.909051] [INFO ] [MAIN ] Update Progress: 103/2372 symbols completed. AMPX took 34.8s. Estimated remaining: 4h 46m 42s. Rate: 7.9 symbols/min [2025-09-25T17:13:04.027686] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T17:13:04.190731] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:04.191043] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-25T17:13:04.191103] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-25T17:13:04.191919] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-25T17:13:04.191968] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-25T17:13:04.192013] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-25T17:13:04.192051] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-25T17:13:04.566892] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:13:04.681312] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:04.688754] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-25T17:13:05.488728] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-25T17:13:05.532735] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T17:13:05.689978] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:05.690382] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-25T17:13:06.288725] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-25T17:13:06.464568] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T17:13:06.474909] [INFO ] [REMOTE ] AMPY: Full fetch complete (50490 records). [2025-09-25T17:13:06.475143] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-25T17:13:06.942740] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-25T17:13:06.942863] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-25T17:13:06.943498] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-25T17:13:06.943545] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-25T17:13:06.945193] [DEBUG] [LOCAL ] AMPY: Trimmed 50490 records to 37778 (keeping 200 days of data) [2025-09-25T17:13:07.090721] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-25T17:13:07.225753] [DEBUG] [LOCAL ] AMPY: Primary data saved (37778 records). [2025-09-25T17:13:07.225996] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-25T17:13:07.229121] [INFO ] [MAIN ] Update Progress: 104/2372 symbols completed. AMPY took 30.3s. Estimated remaining: 4h 45m 2s. Rate: 8.0 symbols/min [2025-09-25T17:13:07.443425] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:07.519948] [DEBUG] [LOCAL ] AMT: Loaded 52448 existing records from primary storage. [2025-09-25T17:13:07.520162] [INFO ] [MAIN ] AMT: Loaded 52448 existing records. [2025-09-25T17:13:07.583173] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T17:13:07.779216] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:07.779608] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-25T17:13:07.779783] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-25T17:13:07.780216] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-25T17:13:07.780276] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-25T17:13:07.893813] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-25T17:13:08.200250] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:08.497266] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T17:13:08.688724] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-25T17:13:09.478397] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T17:13:09.488668] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-25T17:13:09.725223] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T17:13:10.288694] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-25T17:13:10.745722] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T17:13:11.088716] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-25T17:13:11.770840] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T17:13:11.888706] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-25T17:13:12.610072] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T17:13:12.688707] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-25T17:13:13.260216] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T17:13:13.488789] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-25T17:13:13.707479] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:13.707986] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-25T17:13:14.215180] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T17:13:14.288784] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-25T17:13:14.488564] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:14.489248] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-25T17:13:15.088905] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-25T17:13:15.347941] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:15.350121] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-25T17:13:15.888767] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-25T17:13:16.688765] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-25T17:13:17.161392] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:13:17.173510] [INFO ] [REMOTE ] AMR: Full fetch complete (39812 records). [2025-09-25T17:13:17.173691] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-25T17:13:17.494806] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-25T17:13:17.721201] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-25T17:13:17.721314] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-25T17:13:17.721969] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-25T17:13:17.722044] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-25T17:13:17.724760] [DEBUG] [LOCAL ] AMR: Trimmed 39812 records to 29293 (keeping 200 days of data) [2025-09-25T17:13:17.926882] [DEBUG] [LOCAL ] AMR: Primary data saved (29293 records). [2025-09-25T17:13:17.927033] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-25T17:13:17.927137] [INFO ] [MAIN ] Update Progress: 105/2372 symbols completed. AMR took 29.9s. Estimated remaining: 4h 46m 2s. Rate: 7.9 symbols/min [2025-09-25T17:13:18.112953] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:18.171432] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T17:13:18.172386] [DEBUG] [LOCAL ] AMTB: Loaded 20392 existing records from primary storage. [2025-09-25T17:13:18.172473] [INFO ] [MAIN ] AMTB: Loaded 20392 existing records. [2025-09-25T17:13:18.194719] [INFO ] [REMOTE ] AMRC: Full fetch complete (52664 records). [2025-09-25T17:13:18.194972] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-25T17:13:18.306064] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-25T17:13:18.559148] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:18.559618] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-25T17:13:18.636943] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:18.637174] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-25T17:13:18.637234] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-25T17:13:18.648679] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-25T17:13:18.648805] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-25T17:13:19.117155] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-25T17:13:19.183939] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-25T17:13:19.184063] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-25T17:13:19.185703] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-25T17:13:19.185790] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-25T17:13:19.191003] [DEBUG] [LOCAL ] AMRC: Trimmed 52664 records to 38678 (keeping 200 days of data) [2025-09-25T17:13:19.378594] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:13:19.387048] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-25T17:13:19.456025] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T17:13:19.733282] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:19.751053] [DEBUG] [LOCAL ] AMRC: Primary data saved (38678 records). [2025-09-25T17:13:19.751212] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-25T17:13:19.751324] [INFO ] [MAIN ] Update Progress: 106/2372 symbols completed. AMRC took 24.4s. Estimated remaining: 4h 43m 52s. Rate: 8.0 symbols/min [2025-09-25T17:13:19.895488] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-25T17:13:19.931578] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:19.938797] [DEBUG] [LOCAL ] AMTD: Loaded 3560 existing records from primary storage. [2025-09-25T17:13:19.938898] [INFO ] [MAIN ] AMTD: Loaded 3560 existing records. [2025-09-25T17:13:20.118015] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:20.119083] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-25T17:13:20.119142] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-25T17:13:20.119350] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-25T17:13:20.119408] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-25T17:13:20.488018] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:20.688714] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-25T17:13:21.488780] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-25T17:13:21.682927] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T17:13:21.852220] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T17:13:22.288703] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-25T17:13:22.389447] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T17:13:23.088760] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-25T17:13:23.888816] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-25T17:13:23.965419] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T17:13:24.057373] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T17:13:24.631850] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T17:13:24.688688] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-25T17:13:25.323568] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T17:13:25.488735] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-25T17:13:26.160380] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T17:13:26.288738] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-25T17:13:26.861589] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T17:13:27.088735] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-25T17:13:27.888732] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-25T17:13:28.198133] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T17:13:28.374333] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T17:13:28.688759] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-25T17:13:29.488733] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-25T17:13:29.858971] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-25T17:13:30.100735] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T17:13:30.288751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-25T17:13:31.088759] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-25T17:13:31.888757] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-25T17:13:32.194252] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T17:13:32.688745] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-25T17:13:32.741017] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T17:13:32.811049] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-25T17:13:33.488729] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-25T17:13:34.288766] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-25T17:13:34.522085] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T17:13:34.673036] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T17:13:34.723085] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T17:13:35.088724] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-25T17:13:35.888715] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-25T17:13:36.000234] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T17:13:36.327030] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T17:13:36.688746] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-25T17:13:37.488734] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-25T17:13:37.932997] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T17:13:38.288776] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-25T17:13:39.088712] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-25T17:13:39.131552] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T17:13:39.412550] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T17:13:39.888735] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-25T17:13:40.688713] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-25T17:13:40.730943] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T17:13:40.734814] [INFO ] [REMOTE ] AMTB: Full fetch complete (30166 records). [2025-09-25T17:13:40.734905] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-25T17:13:40.973846] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T17:13:40.998586] [INFO ] [REMOTE ] AMRZ: Full fetch complete (24966 records). [2025-09-25T17:13:40.998894] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-25T17:13:40.999449] [FATAL] [VALIDATOR ] AMRZ: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:13:40.999584] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:13:40.999636] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:13:40.999748] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-25T17:13:41.000016] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-25T17:13:41.000106] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-25T17:13:41.000187] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-25T17:13:41.000310] [INFO ] [MAIN ] Update Progress: 107/2372 symbols completed. AMRZ took 37.1s. Estimated remaining: 4h 48m 35s. Rate: 7.8 symbols/min [2025-09-25T17:13:41.091731] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-25T17:13:41.459242] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:41.459527] [DEBUG] [LOCAL ] AMTM: No existing data file found in primary storage. [2025-09-25T17:13:41.459587] [WARN ] [MAIN ] AMTM: No existing data found, performing full refresh instead. [2025-09-25T17:13:41.463118] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-25T17:13:41.463179] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-25T17:13:41.463227] [DEBUG] [LOCAL ] AMTM: No primary data file found to delete. [2025-09-25T17:13:41.463315] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-25T17:13:41.498208] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-25T17:13:41.500270] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-25T17:13:41.500330] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-25T17:13:41.500781] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-25T17:13:41.500852] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-25T17:13:41.501836] [DEBUG] [LOCAL ] AMTB: Trimmed 30166 records to 20492 (keeping 200 days of data) [2025-09-25T17:13:41.712877] [DEBUG] [LOCAL ] AMTB: Primary data saved (20492 records). [2025-09-25T17:13:41.713014] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-25T17:13:41.713099] [INFO ] [MAIN ] Update Progress: 108/2372 symbols completed. AMTB took 23.8s. Estimated remaining: 4h 46m 2s. Rate: 7.9 symbols/min [2025-09-25T17:13:42.162092] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:42.198132] [DEBUG] [LOCAL ] AMWL: Loaded 8630 existing records from primary storage. [2025-09-25T17:13:42.198302] [INFO ] [MAIN ] AMWL: Loaded 8630 existing records. [2025-09-25T17:13:42.291743] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-25T17:13:42.334118] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:42.504116] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:42.504499] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-25T17:13:42.504550] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-25T17:13:42.504825] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-25T17:13:42.504889] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-25T17:13:42.792174] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T17:13:42.905176] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:43.088736] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-25T17:13:43.417698] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T17:13:43.888746] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-25T17:13:44.688802] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-25T17:13:44.763820] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T17:13:44.839742] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T17:13:45.427233] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T17:13:45.429865] [INFO ] [REMOTE ] AMTD: Full fetch complete (5581 records). [2025-09-25T17:13:45.429962] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-25T17:13:45.493984] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-25T17:13:45.869127] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-25T17:13:45.869475] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-25T17:13:45.869715] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-25T17:13:45.869809] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-25T17:13:45.870251] [DEBUG] [LOCAL ] AMTD: Trimmed 5581 records to 3578 (keeping 200 days of data) [2025-09-25T17:13:45.894051] [DEBUG] [LOCAL ] AMTD: Primary data saved (3578 records). [2025-09-25T17:13:45.894157] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-25T17:13:45.894275] [INFO ] [MAIN ] Update Progress: 109/2372 symbols completed. AMTD took 26.1s. Estimated remaining: 4h 44m 44s. Rate: 7.9 symbols/min [2025-09-25T17:13:46.067428] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:46.133274] [DEBUG] [LOCAL ] AMX: Loaded 49185 existing records from primary storage. [2025-09-25T17:13:46.133433] [INFO ] [MAIN ] AMX: Loaded 49185 existing records. [2025-09-25T17:13:46.311129] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-25T17:13:46.316006] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:46.316447] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-25T17:13:46.316499] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-25T17:13:46.317737] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-25T17:13:46.317833] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-25T17:13:46.695975] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:47.088704] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-25T17:13:47.283805] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T17:13:47.888830] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-25T17:13:48.173583] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T17:13:48.540132] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T17:13:48.677248] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T17:13:48.688683] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-25T17:13:49.248054] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T17:13:49.488803] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-25T17:13:50.288826] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-25T17:13:51.088869] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-25T17:13:51.190002] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:13:51.888771] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-25T17:13:51.920315] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T17:13:52.570691] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:13:52.688710] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-25T17:13:53.080420] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T17:13:53.488737] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-25T17:13:54.288737] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-25T17:13:54.604929] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T17:13:54.616458] [INFO ] [REMOTE ] AMT: Full fetch complete (76006 records). [2025-09-25T17:13:54.616747] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-25T17:13:54.859149] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T17:13:55.090322] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-25T17:13:55.130410] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-25T17:13:55.130510] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-25T17:13:55.131402] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-25T17:13:55.131485] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-25T17:13:55.133438] [DEBUG] [LOCAL ] AMT: Trimmed 76006 records to 52833 (keeping 200 days of data) [2025-09-25T17:13:55.499758] [DEBUG] [LOCAL ] AMT: Primary data saved (52833 records). [2025-09-25T17:13:55.499966] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-25T17:13:55.503748] [INFO ] [MAIN ] Update Progress: 110/2372 symbols completed. AMT took 48.3s. Estimated remaining: 4h 45m 19s. Rate: 7.9 symbols/min [2025-09-25T17:13:55.687448] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:13:55.742464] [DEBUG] [LOCAL ] AN: Loaded 32414 existing records from primary storage. [2025-09-25T17:13:55.742632] [INFO ] [MAIN ] AN: Loaded 32414 existing records. [2025-09-25T17:13:55.901970] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-25T17:13:55.954135] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T17:13:56.010472] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:13:56.011022] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-25T17:13:56.011091] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-25T17:13:56.011435] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-25T17:13:56.011513] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-25T17:13:56.374473] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:13:56.688955] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-25T17:13:56.712349] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T17:13:56.764611] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T17:13:57.488797] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-25T17:13:58.287623] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T17:13:58.294327] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-25T17:13:59.088806] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-25T17:13:59.095242] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T17:13:59.692067] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:13:59.841627] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T17:13:59.888714] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-25T17:14:00.688697] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-25T17:14:01.475167] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T17:14:01.488672] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-25T17:14:02.092274] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:14:02.288713] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-25T17:14:02.920889] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T17:14:03.088705] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-25T17:14:03.715552] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:14:03.888721] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-25T17:14:04.612427] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T17:14:04.688715] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-25T17:14:05.488713] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-25T17:14:05.670807] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T17:14:05.983137] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-25T17:14:06.278764] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T17:14:06.288670] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-25T17:14:07.088731] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-25T17:14:07.604066] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T17:14:07.628459] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T17:14:07.888739] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-25T17:14:08.688725] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-25T17:14:09.488700] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-25T17:14:09.511774] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T17:14:09.626903] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T17:14:10.288763] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-25T17:14:10.518951] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:14:11.088738] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-25T17:14:11.888767] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-25T17:14:12.207795] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T17:14:12.318121] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T17:14:12.688847] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-25T17:14:13.488810] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-25T17:14:13.638222] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T17:14:13.654990] [INFO ] [REMOTE ] AMX: Full fetch complete (70781 records). [2025-09-25T17:14:13.655147] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-25T17:14:14.079727] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-25T17:14:14.079825] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-25T17:14:14.080581] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-25T17:14:14.080671] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-25T17:14:14.084172] [DEBUG] [LOCAL ] AMX: Trimmed 70781 records to 49543 (keeping 200 days of data) [2025-09-25T17:14:14.290154] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-25T17:14:14.338295] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T17:14:14.469305] [DEBUG] [LOCAL ] AMX: Primary data saved (49543 records). [2025-09-25T17:14:14.469489] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-25T17:14:14.469633] [INFO ] [MAIN ] Update Progress: 111/2372 symbols completed. AMX took 28.6s. Estimated remaining: 4h 49m 3s. Rate: 7.8 symbols/min [2025-09-25T17:14:14.644788] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T17:14:14.720090] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:14.800283] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-25T17:14:14.800470] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-25T17:14:14.996538] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:14:14.999980] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-25T17:14:15.000047] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-25T17:14:15.000476] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-25T17:14:15.000537] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-25T17:14:15.097140] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-25T17:14:15.339807] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T17:14:15.462530] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:15.888759] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-25T17:14:16.134044] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:14:16.137205] [INFO ] [REMOTE ] AMWL: Full fetch complete (13984 records). [2025-09-25T17:14:16.137308] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-25T17:14:16.532777] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-25T17:14:16.532874] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-25T17:14:16.533203] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-25T17:14:16.533272] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-25T17:14:16.533919] [DEBUG] [LOCAL ] AMWL: Trimmed 13984 records to 8731 (keeping 200 days of data) [2025-09-25T17:14:16.596590] [DEBUG] [LOCAL ] AMWL: Primary data saved (8731 records). [2025-09-25T17:14:16.596777] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-25T17:14:16.596903] [INFO ] [MAIN ] Update Progress: 112/2372 symbols completed. AMWL took 34.9s. Estimated remaining: 4h 47m 4s. Rate: 7.9 symbols/min [2025-09-25T17:14:16.693772] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-25T17:14:16.868794] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:16.936042] [DEBUG] [LOCAL ] ANF: Loaded 52242 existing records from primary storage. [2025-09-25T17:14:16.936945] [INFO ] [MAIN ] ANF: Loaded 52242 existing records. [2025-09-25T17:14:17.117624] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:14:17.117982] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-25T17:14:17.118030] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-25T17:14:17.118411] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-25T17:14:17.118471] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-25T17:14:17.490579] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-25T17:14:17.521018] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:18.137875] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:14:18.199170] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-25T17:14:18.288705] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-25T17:14:18.915381] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T17:14:18.921410] [INFO ] [REMOTE ] AN: Full fetch complete (47675 records). [2025-09-25T17:14:18.921529] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-25T17:14:19.100511] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-25T17:14:19.367276] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-25T17:14:19.367374] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-25T17:14:19.368090] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-25T17:14:19.368180] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-25T17:14:19.372834] [DEBUG] [LOCAL ] AN: Trimmed 47675 records to 32630 (keeping 200 days of data) [2025-09-25T17:14:19.589736] [DEBUG] [LOCAL ] AN: Primary data saved (32630 records). [2025-09-25T17:14:19.589882] [INFO ] [MAIN ] AN: Full history saved. [2025-09-25T17:14:19.592336] [INFO ] [MAIN ] Update Progress: 113/2372 symbols completed. AN took 24.1s. Estimated remaining: 4h 45m 24s. Rate: 7.9 symbols/min [2025-09-25T17:14:19.771712] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:19.771968] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-25T17:14:19.772024] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-25T17:14:19.772228] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-25T17:14:19.772267] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-25T17:14:19.772308] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-25T17:14:19.772340] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-25T17:14:19.894004] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-25T17:14:20.149992] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T17:14:20.216211] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:20.688748] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-25T17:14:21.081174] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T17:14:21.092511] [INFO ] [REMOTE ] AMTM: Full fetch complete (73989 records). [2025-09-25T17:14:21.092825] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-25T17:14:21.489777] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-25T17:14:21.542922] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-25T17:14:21.543150] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-25T17:14:21.545038] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-25T17:14:21.545128] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-25T17:14:21.550692] [DEBUG] [LOCAL ] AMTM: Trimmed 73989 records to 51110 (keeping 200 days of data) [2025-09-25T17:14:21.941911] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:21.942330] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-25T17:14:21.955044] [DEBUG] [LOCAL ] AMTM: Primary data saved (51110 records). [2025-09-25T17:14:21.955272] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-25T17:14:21.955466] [INFO ] [MAIN ] Update Progress: 114/2372 symbols completed. AMTM took 41.0s. Estimated remaining: 4h 43m 33s. Rate: 8.0 symbols/min [2025-09-25T17:14:22.029140] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-25T17:14:22.220179] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:22.247193] [DEBUG] [LOCAL ] ANRO: Loaded 19271 existing records from primary storage. [2025-09-25T17:14:22.247348] [INFO ] [MAIN ] ANRO: Loaded 19271 existing records. [2025-09-25T17:14:22.300022] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-25T17:14:22.464433] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:14:22.464966] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-25T17:14:22.465060] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-25T17:14:22.465413] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-25T17:14:22.465496] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-25T17:14:22.582514] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:22.605093] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-25T17:14:22.688426] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T17:14:22.899282] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:23.088718] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-25T17:14:23.888952] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-25T17:14:24.105015] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:24.105373] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-25T17:14:24.688832] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-25T17:14:25.488743] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-25T17:14:25.533276] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-25T17:14:25.718904] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:25.719451] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-25T17:14:26.093337] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T17:14:26.288788] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-25T17:14:27.080552] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T17:14:27.088687] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-25T17:14:27.888861] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-25T17:14:28.688746] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-25T17:14:29.488789] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-25T17:14:29.554009] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-25T17:14:29.583730] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T17:14:29.677532] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T17:14:29.737320] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:29.737810] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-25T17:14:30.288753] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-25T17:14:31.088706] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-25T17:14:31.284103] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:31.284531] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-25T17:14:31.542752] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T17:14:31.888744] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-25T17:14:32.688780] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-25T17:14:33.032742] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T17:14:33.488754] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-25T17:14:34.288723] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-25T17:14:34.707599] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T17:14:35.088777] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-25T17:14:35.362469] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T17:14:35.556401] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T17:14:35.888765] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-25T17:14:36.101588] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:36.102050] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-25T17:14:36.574875] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:14:36.688817] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-25T17:14:37.488709] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-25T17:14:38.289177] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-25T17:14:38.397991] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T17:14:39.088703] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-25T17:14:39.259852] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T17:14:39.639423] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-25T17:14:39.888703] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-25T17:14:40.688757] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-25T17:14:40.891463] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:40.891928] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-25T17:14:41.012567] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T17:14:41.488806] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-25T17:14:41.683853] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:14:41.684313] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-25T17:14:41.749147] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:14:42.288734] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-25T17:14:43.088759] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-25T17:14:43.888735] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-25T17:14:44.688792] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-25T17:14:44.734519] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-25T17:14:44.891848] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T17:14:45.273731] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T17:14:45.488715] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-25T17:14:46.294537] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-25T17:14:46.315349] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T17:14:46.321573] [INFO ] [REMOTE ] ANGX: Full fetch complete (3864 records). [2025-09-25T17:14:46.321878] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-25T17:14:46.566879] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-25T17:14:46.567495] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:14:46.567567] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:14:46.567672] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-25T17:14:46.567854] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-25T17:14:46.567940] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-25T17:14:46.568028] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-25T17:14:46.568160] [INFO ] [MAIN ] Update Progress: 115/2372 symbols completed. ANGX took 27.0s. Estimated remaining: 4h 49m 1s. Rate: 7.8 symbols/min [2025-09-25T17:14:46.764488] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:46.830395] [DEBUG] [LOCAL ] ANVS: Loaded 23167 existing records from primary storage. [2025-09-25T17:14:46.830621] [INFO ] [MAIN ] ANVS: Loaded 23167 existing records. [2025-09-25T17:14:46.973059] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T17:14:47.093874] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-25T17:14:47.098700] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:14:47.117736] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:14:47.118144] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-25T17:14:47.118230] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-25T17:14:47.119129] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-25T17:14:47.119213] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-25T17:14:47.507253] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:47.798577] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T17:14:47.804080] [INFO ] [REMOTE ] ANRO: Full fetch complete (30151 records). [2025-09-25T17:14:47.804175] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-25T17:14:47.804857] [FATAL] [VALIDATOR ] ANRO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:14:47.804943] [FATAL] [MAIN ] ANRO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:14:47.805010] [WARN ] [MAIN ] ANRO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:14:47.805115] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-25T17:14:47.805223] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-09-25T17:14:47.805281] [INFO ] [LOCAL ] ANRO: Starting deletion of derivative data. [2025-09-25T17:14:47.805934] [DEBUG] [LOCAL ] ANRO: Deleted derivative data file. [2025-09-25T17:14:47.806125] [INFO ] [MAIN ] Update Progress: 116/2372 symbols completed. ANRO took 25.9s. Estimated remaining: 4h 46m 47s. Rate: 7.9 symbols/min [2025-09-25T17:14:47.890228] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-25T17:14:47.988442] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:14:48.030087] [DEBUG] [LOCAL ] AOD: Loaded 30057 existing records from primary storage. [2025-09-25T17:14:48.030236] [INFO ] [MAIN ] AOD: Loaded 30057 existing records. [2025-09-25T17:14:48.212374] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:14:48.212751] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-25T17:14:48.212816] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-25T17:14:48.213136] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-25T17:14:48.213197] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-25T17:14:48.580457] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:14:48.688684] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-25T17:14:49.488747] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-25T17:14:49.842772] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T17:14:50.085421] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-25T17:14:50.288788] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-25T17:14:51.030114] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T17:14:51.046210] [INFO ] [REMOTE ] ANF: Full fetch complete (75647 records). [2025-09-25T17:14:51.046420] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-25T17:14:51.094832] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-25T17:14:51.525465] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-25T17:14:51.525592] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-25T17:14:51.526507] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-25T17:14:51.526613] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-25T17:14:51.534754] [DEBUG] [LOCAL ] ANF: Trimmed 75647 records to 52603 (keeping 200 days of data) [2025-09-25T17:14:51.794493] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T17:14:51.893962] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-25T17:14:51.921217] [DEBUG] [LOCAL ] ANF: Primary data saved (52603 records). [2025-09-25T17:14:51.921348] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-25T17:14:51.921494] [INFO ] [MAIN ] Update Progress: 117/2372 symbols completed. ANF took 35.3s. Estimated remaining: 4h 45m 32s. Rate: 7.9 symbols/min [2025-09-25T17:14:52.688766] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-25T17:14:53.115400] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T17:14:53.488796] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-25T17:14:53.977301] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-25T17:14:53.991260] [INFO ] [REMOTE ] ANET: Full fetch complete (77859 records). [2025-09-25T17:14:53.991577] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-25T17:14:54.229726] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T17:14:54.290762] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-25T17:14:54.517538] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-25T17:14:54.517708] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-25T17:14:54.519072] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-25T17:14:54.519151] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-25T17:14:54.522320] [DEBUG] [LOCAL ] ANET: Trimmed 77859 records to 54156 (keeping 200 days of data) [2025-09-25T17:14:54.905876] [DEBUG] [LOCAL ] ANET: Primary data saved (54156 records). [2025-09-25T17:14:54.906103] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-25T17:14:54.906276] [INFO ] [MAIN ] Update Progress: 118/2372 symbols completed. ANET took 40.4s. Estimated remaining: 4h 43m 56s. Rate: 7.9 symbols/min [2025-09-25T17:14:54.933294] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T17:14:55.088746] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-25T17:14:55.382072] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T17:14:55.888744] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-25T17:14:56.271089] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:14:56.688867] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-25T17:14:57.001224] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T17:14:57.488728] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-25T17:14:57.733474] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T17:14:58.288731] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-25T17:14:58.597146] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T17:14:59.088781] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-25T17:14:59.588526] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T17:14:59.888823] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-25T17:15:00.445731] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:15:00.688728] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-25T17:15:01.286503] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:15:01.488807] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-25T17:15:01.957317] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T17:15:02.288800] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-25T17:15:03.329982] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T17:15:03.337509] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-25T17:15:03.449835] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T17:15:03.888729] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-25T17:15:04.390854] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T17:15:04.688736] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-25T17:15:05.326871] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:15:05.488768] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-25T17:15:05.704488] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T17:15:05.711704] [INFO ] [REMOTE ] ANVS: Full fetch complete (36558 records). [2025-09-25T17:15:05.711960] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-25T17:15:06.312347] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-25T17:15:06.317035] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-25T17:15:06.322112] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-25T17:15:06.322419] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-25T17:15:06.330897] [DEBUG] [LOCAL ] ANVS: Trimmed 36558 records to 23312 (keeping 200 days of data) [2025-09-25T17:15:06.593110] [DEBUG] [LOCAL ] ANVS: Primary data saved (23312 records). [2025-09-25T17:15:06.593407] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-25T17:15:06.593726] [INFO ] [MAIN ] Update Progress: 119/2372 symbols completed. ANVS took 20.0s. Estimated remaining: 4h 45m 7s. Rate: 7.9 symbols/min [2025-09-25T17:15:06.933566] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T17:15:06.948031] [INFO ] [REMOTE ] AOD: Full fetch complete (44048 records). [2025-09-25T17:15:06.948358] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-25T17:15:07.398512] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-25T17:15:07.398703] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-25T17:15:07.399389] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-25T17:15:07.399483] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-25T17:15:07.401205] [DEBUG] [LOCAL ] AOD: Trimmed 44048 records to 30246 (keeping 200 days of data) [2025-09-25T17:15:07.642077] [DEBUG] [LOCAL ] AOD: Primary data saved (30246 records). [2025-09-25T17:15:07.642291] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-25T17:15:07.642473] [INFO ] [MAIN ] Update Progress: 120/2372 symbols completed. AOD took 19.8s. Estimated remaining: 4h 42m 57s. Rate: 8.0 symbols/min [2025-09-25T17:15:08.413434] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:08.422357] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:08.466016] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:08.503828] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:08.533982] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-25T17:15:08.534088] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-25T17:15:08.534302] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-25T17:15:08.534388] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-25T17:15:08.534463] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-25T17:15:08.534532] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-25T17:15:08.568536] [DEBUG] [LOCAL ] AOMR: Loaded 16701 existing records from primary storage. [2025-09-25T17:15:08.568766] [INFO ] [MAIN ] AOMR: Loaded 16701 existing records. [2025-09-25T17:15:08.576744] [DEBUG] [LOCAL ] AORT: Loaded 29664 existing records from primary storage. [2025-09-25T17:15:08.576995] [INFO ] [MAIN ] AORT: Loaded 29664 existing records. [2025-09-25T17:15:08.693211] [DEBUG] [LOCAL ] AON: Loaded 45620 existing records from primary storage. [2025-09-25T17:15:08.693433] [INFO ] [MAIN ] AON: Loaded 45620 existing records. [2025-09-25T17:15:09.407269] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:09.407548] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-25T17:15:09.407595] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-25T17:15:09.408002] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-25T17:15:09.408124] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-25T17:15:09.519078] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:09.528081] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-25T17:15:09.528149] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-25T17:15:09.528477] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-25T17:15:09.528537] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-25T17:15:09.570108] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:09.570404] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-25T17:15:09.570450] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-25T17:15:09.588824] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-25T17:15:09.591275] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-25T17:15:10.170906] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:10.171310] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-25T17:15:10.583040] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:15:10.583543] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-25T17:15:10.599799] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-25T17:15:10.790037] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:10.790481] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-25T17:15:10.890798] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:15:10.891232] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-25T17:15:10.891559] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-25T17:15:10.930188] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:10.933667] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-25T17:15:10.957547] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:10.957931] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-25T17:15:11.092945] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:15:11.093301] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-25T17:15:11.093872] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-25T17:15:11.291582] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:15:11.291975] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-25T17:15:11.854710] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T17:15:11.888679] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-25T17:15:11.926700] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T17:15:12.530516] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T17:15:12.619598] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:15:12.688773] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-25T17:15:13.406429] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T17:15:13.488733] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-25T17:15:14.288728] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-25T17:15:14.673471] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:15:15.088717] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-25T17:15:15.687916] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T17:15:15.888711] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-25T17:15:16.108350] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:15:16.108833] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T17:15:16.113841] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-25T17:15:16.688745] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-25T17:15:17.488713] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-25T17:15:18.013180] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-25T17:15:18.293634] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-25T17:15:18.297036] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:15:18.890371] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T17:15:19.088683] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-25T17:15:19.593988] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T17:15:19.888747] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-25T17:15:20.688844] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-25T17:15:21.245227] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T17:15:21.488719] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-25T17:15:21.550345] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T17:15:22.288963] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-25T17:15:23.088736] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-25T17:15:23.438533] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T17:15:23.493191] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-25T17:15:23.499478] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T17:15:23.888780] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-25T17:15:24.688722] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-25T17:15:24.746804] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T17:15:25.072693] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-25T17:15:25.073839] [INFO ] [REMOTE ] AOMD: Full fetch complete (1801 records). [2025-09-25T17:15:25.073949] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-25T17:15:25.286111] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-25T17:15:25.286359] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:15:25.286437] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:15:25.286951] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-25T17:15:25.287071] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-25T17:15:25.287144] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-25T17:15:25.287224] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-25T17:15:25.287314] [INFO ] [MAIN ] Update Progress: 121/2372 symbols completed. AOMD took 17.6s. Estimated remaining: 4h 45m 57s. Rate: 7.9 symbols/min [2025-09-25T17:15:25.457288] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:25.499733] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-25T17:15:25.527385] [DEBUG] [LOCAL ] AOS: Loaded 49129 existing records from primary storage. [2025-09-25T17:15:25.527546] [INFO ] [MAIN ] AOS: Loaded 49129 existing records. [2025-09-25T17:15:25.715236] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:25.715547] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-25T17:15:25.715594] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-25T17:15:25.716094] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-25T17:15:25.716152] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-25T17:15:26.069605] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:26.288722] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-25T17:15:26.958115] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T17:15:27.088705] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-25T17:15:27.111306] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T17:15:27.888811] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-25T17:15:28.500346] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T17:15:28.688739] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-25T17:15:29.488717] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-25T17:15:29.531097] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:15:29.830151] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T17:15:30.288756] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-25T17:15:30.642274] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T17:15:31.088775] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-25T17:15:31.437329] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:15:31.888737] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-25T17:15:32.349509] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T17:15:32.355705] [INFO ] [REMOTE ] AOMR: Full fetch complete (23091 records). [2025-09-25T17:15:32.355823] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-25T17:15:32.693841] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-25T17:15:32.764034] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-25T17:15:32.764128] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-25T17:15:32.764565] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-25T17:15:32.764673] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-25T17:15:32.765626] [DEBUG] [LOCAL ] AOMR: Trimmed 23091 records to 16780 (keeping 200 days of data) [2025-09-25T17:15:32.879039] [DEBUG] [LOCAL ] AOMR: Primary data saved (16780 records). [2025-09-25T17:15:32.879195] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-25T17:15:32.879333] [INFO ] [MAIN ] Update Progress: 122/2372 symbols completed. AOMR took 25.2s. Estimated remaining: 4h 45m 49s. Rate: 7.9 symbols/min [2025-09-25T17:15:33.057306] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:33.057483] [DEBUG] [LOCAL ] AP: No existing data file found in primary storage. [2025-09-25T17:15:33.057522] [WARN ] [MAIN ] AP: No existing data found, performing full refresh instead. [2025-09-25T17:15:33.057839] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-25T17:15:33.057882] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-25T17:15:33.058384] [DEBUG] [LOCAL ] AP: No primary data file found to delete. [2025-09-25T17:15:33.058426] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-25T17:15:33.490452] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-25T17:15:33.504142] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:33.914698] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T17:15:33.958015] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T17:15:34.288730] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-25T17:15:34.928946] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T17:15:35.088733] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-25T17:15:35.142175] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T17:15:35.888822] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-25T17:15:36.506952] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T17:15:36.688768] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-25T17:15:37.163542] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T17:15:37.262432] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T17:15:37.488722] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-25T17:15:38.288770] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-25T17:15:39.059230] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T17:15:39.093551] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-25T17:15:39.106481] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T17:15:39.888838] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-25T17:15:40.303292] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-25T17:15:40.322908] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T17:15:40.329507] [INFO ] [REMOTE ] AORT: Full fetch complete (41712 records). [2025-09-25T17:15:40.329636] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-25T17:15:40.690070] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-25T17:15:40.795369] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-25T17:15:40.795464] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-25T17:15:40.796104] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-25T17:15:40.796173] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-25T17:15:40.797401] [DEBUG] [LOCAL ] AORT: Trimmed 41712 records to 29879 (keeping 200 days of data) [2025-09-25T17:15:40.999331] [DEBUG] [LOCAL ] AORT: Primary data saved (29879 records). [2025-09-25T17:15:40.999496] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-25T17:15:40.999672] [INFO ] [MAIN ] Update Progress: 123/2372 symbols completed. AORT took 33.3s. Estimated remaining: 4h 45m 50s. Rate: 7.9 symbols/min [2025-09-25T17:15:41.190636] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:41.190846] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-25T17:15:41.190886] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-25T17:15:41.191321] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-25T17:15:41.191378] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-25T17:15:41.191447] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-25T17:15:41.191503] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-25T17:15:41.493835] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-25T17:15:41.616234] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:42.288871] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-25T17:15:42.315821] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T17:15:42.347423] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T17:15:43.088802] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-25T17:15:43.733774] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T17:15:43.748698] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T17:15:43.888740] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-25T17:15:44.688735] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-25T17:15:45.326805] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T17:15:45.488727] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-25T17:15:46.192029] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:15:46.288728] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-25T17:15:46.765056] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T17:15:47.088727] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-25T17:15:47.888760] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-25T17:15:47.959427] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T17:15:48.591513] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T17:15:48.688700] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-25T17:15:48.727590] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T17:15:49.488732] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-25T17:15:50.288779] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-25T17:15:50.414462] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T17:15:50.946936] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T17:15:51.088681] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-25T17:15:51.510120] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T17:15:51.888693] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-25T17:15:52.688697] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-25T17:15:52.846113] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T17:15:52.857885] [INFO ] [REMOTE ] AON: Full fetch complete (64982 records). [2025-09-25T17:15:52.858039] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-25T17:15:53.184605] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T17:15:53.334547] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-25T17:15:53.334697] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-25T17:15:53.336326] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-25T17:15:53.336398] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-25T17:15:53.339086] [DEBUG] [LOCAL ] AON: Trimmed 64982 records to 45981 (keeping 200 days of data) [2025-09-25T17:15:53.495679] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-25T17:15:53.679327] [DEBUG] [LOCAL ] AON: Primary data saved (45981 records). [2025-09-25T17:15:53.679512] [INFO ] [MAIN ] AON: Full history saved. [2025-09-25T17:15:53.679712] [INFO ] [MAIN ] Update Progress: 124/2372 symbols completed. AON took 46.0s. Estimated remaining: 4h 47m 14s. Rate: 7.8 symbols/min [2025-09-25T17:15:53.863883] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:53.926609] [DEBUG] [LOCAL ] APD: Loaded 45371 existing records from primary storage. [2025-09-25T17:15:53.926809] [INFO ] [MAIN ] APD: Loaded 45371 existing records. [2025-09-25T17:15:54.110712] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:54.111088] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-25T17:15:54.111162] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-25T17:15:54.111538] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-25T17:15:54.111602] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-25T17:15:54.318121] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-25T17:15:54.503665] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:54.541072] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T17:15:54.831592] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T17:15:54.940953] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T17:15:55.088709] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-25T17:15:55.570413] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T17:15:55.888734] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-25T17:15:56.688709] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-25T17:15:56.738432] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T17:15:56.742520] [INFO ] [REMOTE ] AP: Full fetch complete (8889 records). [2025-09-25T17:15:56.742611] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-25T17:15:57.160180] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-25T17:15:57.160269] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-25T17:15:57.160545] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-25T17:15:57.160586] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-25T17:15:57.161134] [DEBUG] [LOCAL ] AP: Trimmed 8889 records to 7174 (keeping 200 days of data) [2025-09-25T17:15:57.207622] [DEBUG] [LOCAL ] AP: Primary data saved (7174 records). [2025-09-25T17:15:57.207821] [INFO ] [MAIN ] AP: Full history saved. [2025-09-25T17:15:57.207913] [INFO ] [MAIN ] Update Progress: 125/2372 symbols completed. AP took 24.3s. Estimated remaining: 4h 45m 52s. Rate: 7.9 symbols/min [2025-09-25T17:15:57.393975] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:15:57.464060] [DEBUG] [LOCAL ] APG: Loaded 50211 existing records from primary storage. [2025-09-25T17:15:57.464521] [INFO ] [MAIN ] APG: Loaded 50211 existing records. [2025-09-25T17:15:57.489998] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-25T17:15:57.657741] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:15:57.658166] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-25T17:15:57.658216] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-25T17:15:57.658490] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-25T17:15:57.658551] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-25T17:15:58.053445] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:15:58.167743] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T17:15:58.288767] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-25T17:15:59.088738] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-25T17:15:59.214801] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T17:15:59.458768] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:15:59.888760] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-25T17:16:00.688707] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-25T17:16:00.789465] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T17:16:01.083332] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T17:16:01.091882] [INFO ] [REMOTE ] APAM: Full fetch complete (51564 records). [2025-09-25T17:16:01.092002] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-25T17:16:01.486069] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-25T17:16:01.486182] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-25T17:16:01.486825] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-25T17:16:01.486891] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-25T17:16:01.488207] [DEBUG] [LOCAL ] APAM: Trimmed 51564 records to 36716 (keeping 200 days of data) [2025-09-25T17:16:01.488740] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-25T17:16:01.745053] [DEBUG] [LOCAL ] APAM: Primary data saved (36716 records). [2025-09-25T17:16:01.745253] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-25T17:16:01.745407] [INFO ] [MAIN ] Update Progress: 126/2372 symbols completed. APAM took 20.7s. Estimated remaining: 4h 44m 50s. Rate: 7.9 symbols/min [2025-09-25T17:16:01.941486] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:01.998617] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-25T17:16:01.998814] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-25T17:16:02.194761] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:02.195555] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-25T17:16:02.195615] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-25T17:16:02.196050] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-25T17:16:02.196124] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-25T17:16:02.297207] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-25T17:16:02.618036] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:02.674722] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T17:16:03.088819] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-25T17:16:03.228164] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:16:03.888696] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-25T17:16:04.302387] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T17:16:04.688736] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-25T17:16:05.276683] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T17:16:05.496142] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-25T17:16:05.502138] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T17:16:06.286355] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T17:16:06.295775] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-25T17:16:07.088944] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-25T17:16:07.432750] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T17:16:07.888831] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-25T17:16:08.047339] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:16:08.688808] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-25T17:16:08.748308] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T17:16:08.772096] [INFO ] [REMOTE ] AOS: Full fetch complete (70386 records). [2025-09-25T17:16:08.772562] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-25T17:16:08.776831] [FATAL] [VALIDATOR ] AOS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:16:08.777119] [FATAL] [MAIN ] AOS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:16:08.777218] [WARN ] [MAIN ] AOS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:16:08.777361] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-25T17:16:08.777492] [DEBUG] [LOCAL ] AOS: No primary data file found to delete. [2025-09-25T17:16:08.777618] [INFO ] [LOCAL ] AOS: Starting deletion of derivative data. [2025-09-25T17:16:08.778946] [DEBUG] [LOCAL ] AOS: Deleted derivative data file. [2025-09-25T17:16:08.779207] [INFO ] [MAIN ] Update Progress: 127/2372 symbols completed. AOS took 43.5s. Estimated remaining: 4h 44m 32s. Rate: 7.9 symbols/min [2025-09-25T17:16:08.984840] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:09.054280] [DEBUG] [LOCAL ] APLE: Loaded 52015 existing records from primary storage. [2025-09-25T17:16:09.054446] [INFO ] [MAIN ] APLE: Loaded 52015 existing records. [2025-09-25T17:16:09.231365] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T17:16:09.319317] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:09.319563] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-25T17:16:09.319609] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-25T17:16:09.320003] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-25T17:16:09.320066] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-25T17:16:09.494734] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-25T17:16:09.748267] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:10.288718] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-25T17:16:10.447721] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T17:16:10.820347] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T17:16:11.088736] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-25T17:16:11.888782] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-25T17:16:12.138550] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T17:16:12.688701] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-25T17:16:12.937277] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T17:16:13.488908] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-25T17:16:13.564358] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T17:16:14.222032] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T17:16:14.288755] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-25T17:16:15.088752] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-25T17:16:15.213669] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T17:16:15.791754] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T17:16:15.888803] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-25T17:16:16.688751] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-25T17:16:16.997696] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T17:16:17.488756] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-25T17:16:17.663289] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:16:18.288807] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-25T17:16:18.398367] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:16:18.756709] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T17:16:19.088747] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-25T17:16:19.648370] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T17:16:19.888779] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-25T17:16:20.688708] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-25T17:16:20.821235] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T17:16:21.235503] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T17:16:21.488797] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-25T17:16:22.288742] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-25T17:16:22.465255] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T17:16:22.923008] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T17:16:23.088727] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-25T17:16:23.888694] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-25T17:16:24.031454] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T17:16:24.671089] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T17:16:24.688680] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-25T17:16:25.488702] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-25T17:16:25.617382] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:16:26.288699] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-25T17:16:26.332109] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T17:16:26.341813] [INFO ] [REMOTE ] APD: Full fetch complete (66249 records). [2025-09-25T17:16:26.341973] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-25T17:16:26.346852] [FATAL] [VALIDATOR ] APD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:16:26.346956] [FATAL] [MAIN ] APD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:16:26.347013] [WARN ] [MAIN ] APD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:16:26.347080] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-25T17:16:26.347201] [DEBUG] [LOCAL ] APD: No primary data file found to delete. [2025-09-25T17:16:26.347267] [INFO ] [LOCAL ] APD: Starting deletion of derivative data. [2025-09-25T17:16:26.347707] [DEBUG] [LOCAL ] APD: Deleted derivative data file. [2025-09-25T17:16:26.350713] [INFO ] [MAIN ] Update Progress: 128/2372 symbols completed. APD took 32.7s. Estimated remaining: 4h 47m 19s. Rate: 7.8 symbols/min [2025-09-25T17:16:26.557604] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:26.652240] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-25T17:16:26.652406] [INFO ] [MAIN ] APO: Loaded 53385 existing records. [2025-09-25T17:16:26.831947] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:26.832289] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-25T17:16:26.832337] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-25T17:16:26.832797] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-25T17:16:26.832866] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-25T17:16:27.091395] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-25T17:16:27.230840] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:27.561455] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T17:16:27.888757] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-25T17:16:28.255270] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-25T17:16:28.624054] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T17:16:28.688735] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-25T17:16:29.488733] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-25T17:16:29.876969] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T17:16:30.288784] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-25T17:16:30.444171] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T17:16:31.088733] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-25T17:16:31.568833] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T17:16:31.888755] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-25T17:16:32.316737] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T17:16:32.697739] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-25T17:16:32.722290] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T17:16:33.488682] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-25T17:16:33.623375] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T17:16:34.122920] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:16:34.139221] [INFO ] [REMOTE ] APG: Full fetch complete (71284 records). [2025-09-25T17:16:34.139465] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-25T17:16:34.140385] [FATAL] [VALIDATOR ] APG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:16:34.140576] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:16:34.140697] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:16:34.140784] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-25T17:16:34.140895] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-25T17:16:34.140953] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-25T17:16:34.141413] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-09-25T17:16:34.141592] [INFO ] [MAIN ] Update Progress: 129/2372 symbols completed. APG took 36.9s. Estimated remaining: 4h 47m 13s. Rate: 7.8 symbols/min [2025-09-25T17:16:34.294684] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-25T17:16:34.420338] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:34.431314] [DEBUG] [LOCAL ] APOS: Loaded 7502 existing records from primary storage. [2025-09-25T17:16:34.431410] [INFO ] [MAIN ] APOS: Loaded 7502 existing records. [2025-09-25T17:16:34.611635] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:34.611954] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-25T17:16:34.612000] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-25T17:16:34.612280] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-25T17:16:34.612339] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-25T17:16:34.970496] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:35.088669] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-25T17:16:35.501245] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T17:16:35.762272] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T17:16:35.888721] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-25T17:16:36.087777] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T17:16:36.688726] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-25T17:16:37.488886] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-25T17:16:38.166679] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T17:16:38.179207] [INFO ] [REMOTE ] APH: Full fetch complete (77293 records). [2025-09-25T17:16:38.179395] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-25T17:16:38.180449] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:16:38.182448] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:16:38.182718] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:16:38.182961] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-25T17:16:38.183046] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-25T17:16:38.183105] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-09-25T17:16:38.183538] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-09-25T17:16:38.183761] [INFO ] [MAIN ] Update Progress: 130/2372 symbols completed. APH took 36.4s. Estimated remaining: 4h 46m 3s. Rate: 7.8 symbols/min [2025-09-25T17:16:38.304692] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-25T17:16:38.337411] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:16:38.353669] [INFO ] [REMOTE ] APLE: Full fetch complete (74255 records). [2025-09-25T17:16:38.353816] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-25T17:16:38.566203] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:38.906027] [DEBUG] [LOCAL ] APTV: Loaded 52216 existing records from primary storage. [2025-09-25T17:16:38.906174] [INFO ] [MAIN ] APTV: Loaded 52216 existing records. [2025-09-25T17:16:38.944235] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-25T17:16:38.944312] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-25T17:16:38.945117] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-25T17:16:38.945197] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-25T17:16:38.964691] [DEBUG] [LOCAL ] APLE: Trimmed 74255 records to 52397 (keeping 200 days of data) [2025-09-25T17:16:38.968352] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T17:16:39.094069] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-25T17:16:39.417279] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T17:16:39.473176] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:39.476361] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-25T17:16:39.476438] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-25T17:16:39.477267] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-25T17:16:39.477371] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-25T17:16:39.656352] [DEBUG] [LOCAL ] APLE: Primary data saved (52397 records). [2025-09-25T17:16:39.656539] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-25T17:16:39.656704] [INFO ] [MAIN ] Update Progress: 131/2372 symbols completed. APLE took 30.9s. Estimated remaining: 4h 44m 9s. Rate: 7.9 symbols/min [2025-09-25T17:16:39.937430] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-25T17:16:39.940849] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T17:16:40.083877] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:16:40.312589] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:40.317428] [DEBUG] [LOCAL ] AQN: Loaded 51928 existing records from primary storage. [2025-09-25T17:16:40.317609] [INFO ] [MAIN ] AQN: Loaded 51928 existing records. [2025-09-25T17:16:40.517187] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:16:40.517783] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-25T17:16:40.517844] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-25T17:16:40.518184] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-25T17:16:40.518243] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-25T17:16:40.693890] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-25T17:16:40.970263] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:16:41.488725] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-25T17:16:42.285160] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-25T17:16:42.297741] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-25T17:16:42.878431] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-25T17:16:42.997975] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-25T17:16:43.089096] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-25T17:16:43.096553] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T17:16:43.881101] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T17:16:43.888680] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-25T17:16:44.688784] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-25T17:16:45.488768] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-25T17:16:45.506032] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T17:16:45.686754] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T17:16:46.288727] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-25T17:16:47.058088] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:16:47.088664] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-25T17:16:47.888690] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-25T17:16:48.096951] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T17:16:48.688767] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-25T17:16:48.840412] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T17:16:49.488764] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-25T17:16:49.557221] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T17:16:50.062541] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T17:16:50.288817] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-25T17:16:51.088691] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-25T17:16:51.401181] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T17:16:51.714481] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:16:51.888737] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-25T17:16:52.688688] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-25T17:16:52.939219] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T17:16:53.488733] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-25T17:16:53.826735] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T17:16:54.102992] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T17:16:54.288752] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-25T17:16:54.555246] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T17:16:55.088733] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-25T17:16:55.888727] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-25T17:16:56.126303] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:16:56.575928] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T17:16:56.688691] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-25T17:16:56.792425] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:16:57.488701] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-25T17:16:58.288717] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-25T17:16:58.442179] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T17:16:58.842779] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T17:16:58.913747] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T17:16:59.088714] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-25T17:16:59.870314] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T17:16:59.872333] [INFO ] [REMOTE ] APOS: Full fetch complete (10427 records). [2025-09-25T17:16:59.872528] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-25T17:16:59.897418] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-25T17:17:00.321379] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-25T17:17:00.322281] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-25T17:17:00.322749] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-25T17:17:00.322847] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-25T17:17:00.324465] [DEBUG] [LOCAL ] APOS: Trimmed 10427 records to 7545 (keeping 200 days of data) [2025-09-25T17:17:00.383537] [DEBUG] [LOCAL ] APOS: Primary data saved (7545 records). [2025-09-25T17:17:00.383730] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-25T17:17:00.383946] [INFO ] [MAIN ] Update Progress: 132/2372 symbols completed. APOS took 26.2s. Estimated remaining: 4h 47m 44s. Rate: 7.8 symbols/min [2025-09-25T17:17:00.575999] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:00.587467] [DEBUG] [LOCAL ] AQNB: Loaded 4187 existing records from primary storage. [2025-09-25T17:17:00.587636] [INFO ] [MAIN ] AQNB: Loaded 4187 existing records. [2025-09-25T17:17:00.693910] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-25T17:17:00.799885] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:17:00.800253] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-25T17:17:00.800324] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-25T17:17:00.800620] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-25T17:17:00.800736] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-25T17:17:01.168266] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:01.488712] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-25T17:17:01.997812] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T17:17:02.010530] [INFO ] [REMOTE ] APO: Full fetch complete (76904 records). [2025-09-25T17:17:02.010790] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-25T17:17:02.011979] [FATAL] [VALIDATOR ] APO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:17:02.012862] [FATAL] [MAIN ] APO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:17:02.013099] [WARN ] [MAIN ] APO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:17:02.013380] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-25T17:17:02.013463] [DEBUG] [LOCAL ] APO: No primary data file found to delete. [2025-09-25T17:17:02.013519] [INFO ] [LOCAL ] APO: Starting deletion of derivative data. [2025-09-25T17:17:02.013918] [DEBUG] [LOCAL ] APO: Deleted derivative data file. [2025-09-25T17:17:02.015845] [INFO ] [MAIN ] Update Progress: 133/2372 symbols completed. APO took 35.7s. Estimated remaining: 4h 45m 54s. Rate: 7.8 symbols/min [2025-09-25T17:17:02.237873] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T17:17:02.293726] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-25T17:17:02.303002] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:02.304426] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-09-25T17:17:02.304488] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-09-25T17:17:02.305018] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-25T17:17:02.305062] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-25T17:17:02.305103] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-09-25T17:17:02.305137] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-25T17:17:02.698547] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:02.940799] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T17:17:03.060811] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T17:17:03.088700] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-25T17:17:03.553662] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T17:17:03.888719] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-25T17:17:04.688730] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-25T17:17:05.461676] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:17:05.488676] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-25T17:17:06.288769] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-25T17:17:06.557573] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T17:17:07.088737] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-25T17:17:07.409817] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T17:17:07.537981] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T17:17:07.888700] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-25T17:17:08.126368] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T17:17:08.454322] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T17:17:08.688751] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-25T17:17:09.228541] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T17:17:09.488742] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-25T17:17:10.288737] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-25T17:17:11.088749] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-25T17:17:11.332854] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T17:17:11.342389] [INFO ] [REMOTE ] APTV: Full fetch complete (75666 records). [2025-09-25T17:17:11.342581] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-25T17:17:11.343415] [FATAL] [VALIDATOR ] APTV: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:17:11.343607] [FATAL] [MAIN ] APTV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:17:11.343685] [WARN ] [MAIN ] APTV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:17:11.343747] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-25T17:17:11.343855] [DEBUG] [LOCAL ] APTV: No primary data file found to delete. [2025-09-25T17:17:11.343914] [INFO ] [LOCAL ] APTV: Starting deletion of derivative data. [2025-09-25T17:17:11.344552] [DEBUG] [LOCAL ] APTV: Deleted derivative data file. [2025-09-25T17:17:11.344718] [INFO ] [MAIN ] Update Progress: 134/2372 symbols completed. APTV took 33.2s. Estimated remaining: 4h 46m 14s. Rate: 7.8 symbols/min [2025-09-25T17:17:11.541803] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:11.610785] [DEBUG] [LOCAL ] ARCO: Loaded 44642 existing records from primary storage. [2025-09-25T17:17:11.610946] [INFO ] [MAIN ] ARCO: Loaded 44642 existing records. [2025-09-25T17:17:11.795142] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:17:11.795423] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-25T17:17:11.795479] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-25T17:17:11.796528] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-25T17:17:11.796605] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-25T17:17:11.890776] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-25T17:17:12.195884] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T17:17:12.213136] [INFO ] [REMOTE ] AQN: Full fetch complete (75265 records). [2025-09-25T17:17:12.213295] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-25T17:17:12.250104] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:12.474700] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T17:17:12.579909] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T17:17:12.694022] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-25T17:17:12.806184] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-25T17:17:12.806301] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-25T17:17:12.807152] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-25T17:17:12.807224] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-25T17:17:12.809066] [DEBUG] [LOCAL ] AQN: Trimmed 75265 records to 52302 (keeping 200 days of data) [2025-09-25T17:17:13.130393] [DEBUG] [LOCAL ] AQN: Primary data saved (52302 records). [2025-09-25T17:17:13.130558] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-25T17:17:13.130714] [INFO ] [MAIN ] Update Progress: 135/2372 symbols completed. AQN took 33.5s. Estimated remaining: 4h 44m 29s. Rate: 7.9 symbols/min [2025-09-25T17:17:13.331774] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:13.354100] [DEBUG] [LOCAL ] ARDC: Loaded 14492 existing records from primary storage. [2025-09-25T17:17:13.354255] [INFO ] [MAIN ] ARDC: Loaded 14492 existing records. [2025-09-25T17:17:13.395483] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T17:17:13.493790] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-25T17:17:13.552594] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:17:13.552922] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-25T17:17:13.552973] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-25T17:17:13.553238] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-25T17:17:13.553297] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-25T17:17:13.920993] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:14.288761] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-25T17:17:15.088730] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-25T17:17:15.203518] [DEBUG] [REMOTE ] AQNB: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-25T17:17:15.204020] [WARN ] [REMOTE ] AQNB: No data returned for month 2025-07 [2025-09-25T17:17:15.307912] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T17:17:15.888713] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-25T17:17:16.218116] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T17:17:16.688943] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-25T17:17:16.857357] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T17:17:17.488734] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-25T17:17:18.304359] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T17:17:18.325568] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T17:17:18.314244] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-25T17:17:18.808152] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T17:17:19.088717] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-25T17:17:19.888724] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-25T17:17:20.091736] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T17:17:20.688718] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-25T17:17:21.114411] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T17:17:21.488702] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-25T17:17:22.276825] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T17:17:22.288666] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-25T17:17:22.906450] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-25T17:17:23.088732] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-25T17:17:23.302723] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T17:17:23.888826] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-25T17:17:24.688804] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-25T17:17:24.896037] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:17:25.310782] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:17:25.311057] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T17:17:25.323701] [INFO ] [REMOTE ] AQNB: Full fetch complete (5377 records). [2025-09-25T17:17:25.323912] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-25T17:17:25.493860] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-25T17:17:25.594351] [WARN ] [VALIDATOR ] AQNB: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-25T17:17:25.595250] [FATAL] [MAIN ] AQNB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:17:25.595426] [WARN ] [MAIN ] AQNB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:17:25.595562] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-25T17:17:25.595713] [DEBUG] [LOCAL ] AQNB: No primary data file found to delete. [2025-09-25T17:17:25.595831] [INFO ] [LOCAL ] AQNB: Starting deletion of derivative data. [2025-09-25T17:17:25.596787] [DEBUG] [LOCAL ] AQNB: Deleted derivative data file. [2025-09-25T17:17:25.597033] [INFO ] [MAIN ] Update Progress: 136/2372 symbols completed. AQNB took 25.2s. Estimated remaining: 4h 45m 41s. Rate: 7.8 symbols/min [2025-09-25T17:17:25.796956] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:25.797260] [DEBUG] [LOCAL ] ARDT: No existing data file found in primary storage. [2025-09-25T17:17:25.797307] [WARN ] [MAIN ] ARDT: No existing data found, performing full refresh instead. [2025-09-25T17:17:25.797688] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-25T17:17:25.797744] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-25T17:17:25.797789] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-09-25T17:17:25.797846] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-25T17:17:26.193771] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:26.288726] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-25T17:17:26.315580] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T17:17:27.088808] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-25T17:17:27.851778] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:17:27.888677] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-25T17:17:28.077136] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T17:17:28.688714] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-25T17:17:29.446759] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:17:29.494325] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-25T17:17:29.497374] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:17:30.288740] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-25T17:17:30.853064] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T17:17:30.905528] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T17:17:31.089266] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-25T17:17:31.888732] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-25T17:17:32.688770] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-25T17:17:33.034521] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T17:17:33.180936] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T17:17:33.488688] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-25T17:17:33.782588] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T17:17:33.786536] [INFO ] [REMOTE ] ARDC: Full fetch complete (20389 records). [2025-09-25T17:17:33.786658] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-25T17:17:34.189917] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-25T17:17:34.190075] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-25T17:17:34.190459] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-25T17:17:34.190539] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-25T17:17:34.191504] [DEBUG] [LOCAL ] ARDC: Trimmed 20389 records to 14647 (keeping 200 days of data) [2025-09-25T17:17:34.288829] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-25T17:17:34.318207] [DEBUG] [LOCAL ] ARDC: Primary data saved (14647 records). [2025-09-25T17:17:34.318376] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-25T17:17:34.318551] [INFO ] [MAIN ] Update Progress: 137/2372 symbols completed. ARDC took 21.2s. Estimated remaining: 4h 45m 51s. Rate: 7.8 symbols/min [2025-09-25T17:17:34.502279] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:34.574364] [DEBUG] [LOCAL ] ARE: Loaded 50610 existing records from primary storage. [2025-09-25T17:17:34.574527] [INFO ] [MAIN ] ARE: Loaded 50610 existing records. [2025-09-25T17:17:34.691412] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T17:17:34.785265] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:17:34.785982] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-25T17:17:34.786092] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-25T17:17:34.786466] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-25T17:17:34.786579] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-25T17:17:35.091084] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-25T17:17:35.191126] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:35.888742] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-25T17:17:36.134592] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:17:36.234100] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T17:17:36.688731] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-25T17:17:37.493852] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-25T17:17:37.512819] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T17:17:38.288699] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-25T17:17:38.586769] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T17:17:38.933337] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:17:39.088717] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-25T17:17:39.888732] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-25T17:17:39.983957] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:17:40.688726] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-25T17:17:40.952313] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T17:17:41.129043] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T17:17:41.488727] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-25T17:17:42.073204] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T17:17:42.081244] [INFO ] [REMOTE ] ARCO: Full fetch complete (65618 records). [2025-09-25T17:17:42.081402] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-25T17:17:42.325938] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-25T17:17:42.562731] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-25T17:17:42.562845] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-25T17:17:42.563785] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-25T17:17:42.563859] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-25T17:17:42.565859] [DEBUG] [LOCAL ] ARCO: Trimmed 65618 records to 44935 (keeping 200 days of data) [2025-09-25T17:17:42.864255] [DEBUG] [LOCAL ] ARCO: Primary data saved (44935 records). [2025-09-25T17:17:42.864406] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-25T17:17:42.864513] [INFO ] [MAIN ] Update Progress: 138/2372 symbols completed. ARCO took 31.5s. Estimated remaining: 4h 45m 57s. Rate: 7.8 symbols/min [2025-09-25T17:17:43.013215] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T17:17:43.078673] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:43.078857] [DEBUG] [LOCAL ] ARES: No existing data file found in primary storage. [2025-09-25T17:17:43.078896] [WARN ] [MAIN ] ARES: No existing data found, performing full refresh instead. [2025-09-25T17:17:43.079068] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-25T17:17:43.079114] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-25T17:17:43.079154] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-09-25T17:17:43.079189] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-25T17:17:43.089483] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-25T17:17:43.482890] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:43.888719] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-25T17:17:44.233888] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T17:17:44.247710] [INFO ] [REMOTE ] AR: Full fetch complete (77532 records). [2025-09-25T17:17:44.247930] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-25T17:17:44.415101] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T17:17:44.708796] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-25T17:17:44.718471] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-25T17:17:44.718559] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-25T17:17:44.719448] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-25T17:17:44.719528] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-25T17:17:44.724315] [DEBUG] [LOCAL ] AR: Trimmed 77532 records to 53974 (keeping 200 days of data) [2025-09-25T17:17:45.090944] [DEBUG] [LOCAL ] AR: Primary data saved (53974 records). [2025-09-25T17:17:45.091080] [INFO ] [MAIN ] AR: Full history saved. [2025-09-25T17:17:45.091162] [INFO ] [MAIN ] Update Progress: 139/2372 symbols completed. AR took 43.1s. Estimated remaining: 4h 44m 22s. Rate: 7.9 symbols/min [2025-09-25T17:17:45.274662] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:17:45.319413] [DEBUG] [LOCAL ] ARI: Loaded 43442 existing records from primary storage. [2025-09-25T17:17:45.319561] [INFO ] [MAIN ] ARI: Loaded 43442 existing records. [2025-09-25T17:17:45.471226] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:17:45.492511] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-25T17:17:45.574200] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:17:45.574703] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-25T17:17:45.574765] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-25T17:17:45.575233] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-25T17:17:45.575296] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-25T17:17:45.959541] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:17:46.081396] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T17:17:46.288760] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-25T17:17:47.088735] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-25T17:17:47.363704] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:17:47.888701] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-25T17:17:47.966950] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T17:17:48.688748] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-25T17:17:48.863256] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T17:17:49.242421] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T17:17:49.488694] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-25T17:17:50.050786] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:17:50.288726] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-25T17:17:51.088774] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-25T17:17:51.179488] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T17:17:51.214544] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T17:17:51.888784] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-25T17:17:52.464044] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T17:17:52.688761] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-25T17:17:53.330845] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T17:17:53.488696] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-25T17:17:54.288688] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-25T17:17:54.611161] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T17:17:54.752088] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T17:17:55.088746] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-25T17:17:55.888748] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-25T17:17:56.176993] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T17:17:56.662109] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:17:56.688744] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-25T17:17:57.488690] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-25T17:17:57.992801] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T17:17:58.288770] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-25T17:17:58.527563] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T17:17:59.088766] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-25T17:17:59.203828] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T17:17:59.888800] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-25T17:18:00.147421] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:18:00.688706] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-25T17:18:01.079927] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T17:18:01.489421] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-25T17:18:01.500170] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T17:18:01.507230] [INFO ] [REMOTE ] ARDT: Full fetch complete (41332 records). [2025-09-25T17:18:01.507322] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-25T17:18:01.982141] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-25T17:18:01.982237] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-25T17:18:01.982763] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-25T17:18:01.982854] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-25T17:18:01.984747] [DEBUG] [LOCAL ] ARDT: Trimmed 41332 records to 28351 (keeping 200 days of data) [2025-09-25T17:18:02.192830] [DEBUG] [LOCAL ] ARDT: Primary data saved (28351 records). [2025-09-25T17:18:02.192989] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-25T17:18:02.193126] [INFO ] [MAIN ] Update Progress: 140/2372 symbols completed. ARDT took 36.6s. Estimated remaining: 4h 46m 45s. Rate: 7.8 symbols/min [2025-09-25T17:18:02.299752] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-25T17:18:02.401260] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:02.402325] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-25T17:18:02.402386] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-25T17:18:02.402755] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-25T17:18:02.402835] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-25T17:18:02.402937] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-25T17:18:02.403011] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-25T17:18:02.677133] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T17:18:02.911611] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:03.088885] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-25T17:18:03.299496] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:18:03.888809] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-25T17:18:04.000566] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T17:18:04.688738] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-25T17:18:04.815393] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:18:05.184303] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T17:18:05.488732] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-25T17:18:06.089101] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T17:18:06.288721] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-25T17:18:07.088736] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-25T17:18:07.135224] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T17:18:07.888731] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-25T17:18:08.255692] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T17:18:08.267312] [INFO ] [REMOTE ] ARES: Full fetch complete (70283 records). [2025-09-25T17:18:08.268768] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-25T17:18:08.276479] [FATAL] [VALIDATOR ] ARES: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:18:08.276582] [FATAL] [MAIN ] ARES: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:18:08.276638] [WARN ] [MAIN ] ARES: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:18:08.276739] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-25T17:18:08.276863] [DEBUG] [LOCAL ] ARES: No primary data file found to delete. [2025-09-25T17:18:08.276947] [INFO ] [LOCAL ] ARES: Starting deletion of derivative data. [2025-09-25T17:18:08.277042] [DEBUG] [LOCAL ] ARES: No derivative data file found to delete. [2025-09-25T17:18:08.277142] [INFO ] [MAIN ] Update Progress: 141/2372 symbols completed. ARES took 25.4s. Estimated remaining: 4h 46m 12s. Rate: 7.8 symbols/min [2025-09-25T17:18:08.470194] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:08.552582] [DEBUG] [LOCAL ] ARLO: Loaded 43875 existing records from primary storage. [2025-09-25T17:18:08.552791] [INFO ] [MAIN ] ARLO: Loaded 43875 existing records. [2025-09-25T17:18:08.693984] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-25T17:18:08.760637] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:18:08.761051] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-25T17:18:08.761121] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-25T17:18:08.761756] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-25T17:18:08.761851] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-25T17:18:08.919262] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T17:18:08.940760] [INFO ] [REMOTE ] ARE: Full fetch complete (72588 records). [2025-09-25T17:18:08.955203] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-25T17:18:09.456708] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T17:18:09.511077] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-25T17:18:09.573829] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:09.707573] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-25T17:18:09.707697] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-25T17:18:09.708448] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-25T17:18:09.708497] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-25T17:18:09.710134] [DEBUG] [LOCAL ] ARE: Trimmed 72588 records to 50963 (keeping 200 days of data) [2025-09-25T17:18:10.048799] [DEBUG] [LOCAL ] ARE: Primary data saved (50963 records). [2025-09-25T17:18:10.048961] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-25T17:18:10.049089] [INFO ] [MAIN ] Update Progress: 142/2372 symbols completed. ARE took 35.7s. Estimated remaining: 4h 44m 31s. Rate: 7.8 symbols/min [2025-09-25T17:18:10.261457] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:10.299571] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-25T17:18:10.330916] [DEBUG] [LOCAL ] ARMK: Loaded 50354 existing records from primary storage. [2025-09-25T17:18:10.331085] [INFO ] [MAIN ] ARMK: Loaded 50354 existing records. [2025-09-25T17:18:10.553614] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T17:18:10.569860] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:18:10.571760] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-25T17:18:10.571820] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-25T17:18:10.572166] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-25T17:18:10.572227] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-25T17:18:10.694224] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:18:11.060025] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:11.088674] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-25T17:18:11.888805] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-25T17:18:12.040428] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:18:12.688688] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-25T17:18:12.824449] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:18:13.488707] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-25T17:18:13.622881] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:18:14.260455] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T17:18:14.288716] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-25T17:18:14.895222] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T17:18:15.088769] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-25T17:18:15.870222] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T17:18:15.888760] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-25T17:18:15.999381] [DEBUG] [REMOTE ] ARI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-25T17:18:15.999720] [WARN ] [REMOTE ] ARI: No data returned for month 2025-09 [2025-09-25T17:18:15.999880] [INFO ] [REMOTE ] ARI: Full fetch complete (57382 records). [2025-09-25T17:18:15.999982] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-25T17:18:16.001326] [FATAL] [VALIDATOR ] ARI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:18:16.001412] [FATAL] [MAIN ] ARI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:18:16.001499] [WARN ] [MAIN ] ARI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:18:16.001600] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-25T17:18:16.001741] [DEBUG] [LOCAL ] ARI: No primary data file found to delete. [2025-09-25T17:18:16.001816] [INFO ] [LOCAL ] ARI: Starting deletion of derivative data. [2025-09-25T17:18:16.002377] [DEBUG] [LOCAL ] ARI: Deleted derivative data file. [2025-09-25T17:18:16.002545] [INFO ] [MAIN ] Update Progress: 143/2372 symbols completed. ARI took 30.9s. Estimated remaining: 4h 43m 57s. Rate: 7.9 symbols/min [2025-09-25T17:18:16.220190] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:16.289191] [DEBUG] [LOCAL ] AROC: Loaded 48972 existing records from primary storage. [2025-09-25T17:18:16.289353] [INFO ] [MAIN ] AROC: Loaded 48972 existing records. [2025-09-25T17:18:16.499486] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:18:16.499966] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-25T17:18:16.500022] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-25T17:18:16.500310] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-25T17:18:16.500378] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-25T17:18:16.672733] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T17:18:16.690000] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-25T17:18:16.961233] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:17.488707] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-25T17:18:18.242603] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T17:18:18.288677] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-25T17:18:19.088718] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-25T17:18:19.350706] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T17:18:19.780415] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:18:19.888734] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-25T17:18:20.495668] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T17:18:20.688762] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-25T17:18:21.429528] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T17:18:21.488783] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-25T17:18:22.010453] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:18:22.288754] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-25T17:18:23.005061] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:18:23.088741] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-25T17:18:23.605924] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T17:18:23.888937] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-25T17:18:24.688759] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-25T17:18:24.948268] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:18:25.488772] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-25T17:18:25.666902] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:18:25.813824] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T17:18:26.288804] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-25T17:18:26.696370] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T17:18:27.088727] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-25T17:18:27.888754] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-25T17:18:28.070471] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:18:28.609930] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T17:18:28.688747] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-25T17:18:29.175809] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T17:18:29.488797] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-25T17:18:30.288801] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-25T17:18:30.433283] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T17:18:31.088739] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-25T17:18:31.227448] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:18:31.838733] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T17:18:31.847549] [INFO ] [REMOTE ] ARLO: Full fetch complete (62436 records). [2025-09-25T17:18:31.847712] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-25T17:18:31.893488] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-25T17:18:32.253930] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-25T17:18:32.254025] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-25T17:18:32.254872] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-25T17:18:32.255441] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-25T17:18:32.256931] [DEBUG] [LOCAL ] ARLO: Trimmed 62436 records to 44209 (keeping 200 days of data) [2025-09-25T17:18:32.524010] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T17:18:32.571278] [DEBUG] [LOCAL ] ARLO: Primary data saved (44209 records). [2025-09-25T17:18:32.571413] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-25T17:18:32.571518] [INFO ] [MAIN ] Update Progress: 144/2372 symbols completed. ARLO took 24.3s. Estimated remaining: 4h 46m 7s. Rate: 7.8 symbols/min [2025-09-25T17:18:32.693775] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-25T17:18:32.749198] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:32.749351] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-09-25T17:18:32.749389] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-09-25T17:18:32.749559] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-25T17:18:32.749617] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-25T17:18:32.750192] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-09-25T17:18:32.750238] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-25T17:18:33.108161] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:33.488705] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-25T17:18:33.518697] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T17:18:34.288767] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-25T17:18:34.328716] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T17:18:35.088707] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-25T17:18:35.179113] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:18:35.769980] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T17:18:35.888728] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-25T17:18:36.688699] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-25T17:18:37.090338] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T17:18:37.422230] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:18:37.488748] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-25T17:18:38.288695] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-25T17:18:38.632526] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T17:18:38.943744] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T17:18:39.088766] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-25T17:18:39.802433] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T17:18:39.888784] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-25T17:18:40.535326] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T17:18:40.688732] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-25T17:18:41.470086] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T17:18:41.488782] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-25T17:18:42.294469] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-25T17:18:42.311433] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T17:18:42.322373] [INFO ] [REMOTE ] ARIS: Full fetch complete (60042 records). [2025-09-25T17:18:42.322568] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-25T17:18:42.736763] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-25T17:18:42.736874] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-25T17:18:42.737611] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-25T17:18:42.737693] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-25T17:18:42.739264] [DEBUG] [LOCAL ] ARIS: Trimmed 60042 records to 42320 (keeping 200 days of data) [2025-09-25T17:18:43.051821] [DEBUG] [LOCAL ] ARIS: Primary data saved (42320 records). [2025-09-25T17:18:43.052049] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-25T17:18:43.052153] [INFO ] [MAIN ] Update Progress: 145/2372 symbols completed. ARIS took 40.9s. Estimated remaining: 4h 46m 42s. Rate: 7.8 symbols/min [2025-09-25T17:18:43.110714] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-25T17:18:43.314028] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:43.345418] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T17:18:43.381132] [DEBUG] [LOCAL ] ARW: Loaded 33201 existing records from primary storage. [2025-09-25T17:18:43.381302] [INFO ] [MAIN ] ARW: Loaded 33201 existing records. [2025-09-25T17:18:43.565094] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:18:43.565403] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-25T17:18:43.565467] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-25T17:18:43.566008] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-25T17:18:43.566073] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-25T17:18:43.894777] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-25T17:18:43.955671] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:44.237591] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T17:18:44.660017] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T17:18:44.688707] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-25T17:18:45.488735] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-25T17:18:45.661127] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T17:18:45.674692] [INFO ] [REMOTE ] AROC: Full fetch complete (70291 records). [2025-09-25T17:18:45.674897] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-25T17:18:45.675928] [FATAL] [VALIDATOR ] AROC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:18:45.676371] [FATAL] [MAIN ] AROC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:18:45.676482] [WARN ] [MAIN ] AROC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:18:45.676575] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-25T17:18:45.676692] [DEBUG] [LOCAL ] AROC: No primary data file found to delete. [2025-09-25T17:18:45.676749] [INFO ] [LOCAL ] AROC: Starting deletion of derivative data. [2025-09-25T17:18:45.677308] [DEBUG] [LOCAL ] AROC: Deleted derivative data file. [2025-09-25T17:18:45.677505] [INFO ] [MAIN ] Update Progress: 146/2372 symbols completed. AROC took 29.7s. Estimated remaining: 4h 45m 17s. Rate: 7.8 symbols/min [2025-09-25T17:18:45.866496] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:45.866714] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-25T17:18:45.866768] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-25T17:18:45.866929] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-25T17:18:45.866985] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-25T17:18:45.867030] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-25T17:18:45.867062] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-25T17:18:46.232075] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:46.288729] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-25T17:18:46.754545] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T17:18:47.070135] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:18:47.088722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-25T17:18:47.863949] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T17:18:47.881527] [INFO ] [REMOTE ] ARMK: Full fetch complete (72555 records). [2025-09-25T17:18:47.881906] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-25T17:18:47.899293] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-25T17:18:48.179782] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:18:48.180162] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-25T17:18:48.314988] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-25T17:18:48.315070] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-25T17:18:48.315909] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-25T17:18:48.316022] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-25T17:18:48.317542] [DEBUG] [LOCAL ] ARMK: Trimmed 72555 records to 50735 (keeping 200 days of data) [2025-09-25T17:18:48.643455] [DEBUG] [LOCAL ] ARMK: Primary data saved (50735 records). [2025-09-25T17:18:48.643626] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-25T17:18:48.646798] [INFO ] [MAIN ] Update Progress: 147/2372 symbols completed. ARMK took 38.6s. Estimated remaining: 4h 43m 57s. Rate: 7.8 symbols/min [2025-09-25T17:18:48.693412] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-25T17:18:48.834968] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:18:48.901280] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:18:48.901584] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-25T17:18:48.906270] [DEBUG] [LOCAL ] AS: Loaded 53077 existing records from primary storage. [2025-09-25T17:18:48.906450] [INFO ] [MAIN ] AS: Loaded 53077 existing records. [2025-09-25T17:18:49.158452] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T17:18:49.176067] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:18:49.176552] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-25T17:18:49.176611] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-25T17:18:49.177148] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-25T17:18:49.177222] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-25T17:18:49.497709] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-25T17:18:49.538835] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:18:49.763548] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:18:49.763974] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-25T17:18:50.288873] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-25T17:18:51.088788] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-25T17:18:51.888791] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-25T17:18:52.040071] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T17:18:52.688770] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-25T17:18:52.947109] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:18:53.048359] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T17:18:53.488722] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-25T17:18:54.288775] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-25T17:18:54.481309] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T17:18:55.088698] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-25T17:18:55.406686] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T17:18:55.550049] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T17:18:55.888821] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-25T17:18:56.541764] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:18:56.688792] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-25T17:18:56.901625] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:18:56.902092] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-25T17:18:57.488906] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-25T17:18:57.604413] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T17:18:58.288706] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-25T17:18:59.088733] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-25T17:18:59.644767] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T17:18:59.888713] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-25T17:19:00.025569] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T17:19:00.210254] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T17:19:00.688720] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-25T17:19:00.918341] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:19:00.918712] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-25T17:19:01.488730] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-25T17:19:01.942868] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-25T17:19:01.953616] [INFO ] [REMOTE ] ARR: Full fetch complete (74763 records). [2025-09-25T17:19:01.954090] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-25T17:19:01.957297] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:19:01.957501] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:19:01.957825] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:19:01.957929] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-25T17:19:01.958056] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-09-25T17:19:01.958135] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-09-25T17:19:01.958206] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-09-25T17:19:01.958331] [INFO ] [MAIN ] Update Progress: 148/2372 symbols completed. ARR took 29.4s. Estimated remaining: 4h 45m 15s. Rate: 7.8 symbols/min [2025-09-25T17:19:02.186534] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:02.208372] [DEBUG] [LOCAL ] ASA: Loaded 13835 existing records from primary storage. [2025-09-25T17:19:02.208539] [INFO ] [MAIN ] ASA: Loaded 13835 existing records. [2025-09-25T17:19:02.291829] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-25T17:19:02.408858] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:02.409075] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-25T17:19:02.409122] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-25T17:19:02.409365] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-25T17:19:02.409432] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-25T17:19:02.774025] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:02.900302] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T17:19:03.088713] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-25T17:19:03.888808] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-25T17:19:03.926851] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T17:19:04.045323] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T17:19:04.688743] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-25T17:19:04.977065] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T17:19:05.488728] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-25T17:19:06.285139] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T17:19:06.295811] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-25T17:19:06.314917] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T17:19:06.545894] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:19:06.546239] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-25T17:19:07.088763] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-25T17:19:07.299204] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:19:07.299588] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-25T17:19:07.888763] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-25T17:19:08.688704] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-25T17:19:08.768699] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T17:19:09.488700] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-25T17:19:10.237941] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T17:19:10.288714] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-25T17:19:11.088706] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-25T17:19:11.322633] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T17:19:11.574487] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T17:19:11.825876] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T17:19:11.888681] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-25T17:19:12.688722] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-25T17:19:13.488729] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-25T17:19:13.747184] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T17:19:14.084570] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:19:14.091940] [INFO ] [REMOTE ] ARW: Full fetch complete (47841 records). [2025-09-25T17:19:14.092078] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-25T17:19:14.324445] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-25T17:19:14.534281] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T17:19:14.597678] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-25T17:19:14.597803] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-25T17:19:14.598555] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-25T17:19:14.598627] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-25T17:19:14.600111] [DEBUG] [LOCAL ] ARW: Trimmed 47841 records to 33429 (keeping 200 days of data) [2025-09-25T17:19:14.872440] [DEBUG] [LOCAL ] ARW: Primary data saved (33429 records). [2025-09-25T17:19:14.872605] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-25T17:19:14.872765] [INFO ] [MAIN ] Update Progress: 149/2372 symbols completed. ARW took 31.8s. Estimated remaining: 4h 46m 25s. Rate: 7.8 symbols/min [2025-09-25T17:19:15.062746] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:15.096721] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-25T17:19:15.121785] [DEBUG] [LOCAL ] ASAN: Loaded 52745 existing records from primary storage. [2025-09-25T17:19:15.121939] [INFO ] [MAIN ] ASAN: Loaded 52745 existing records. [2025-09-25T17:19:15.309965] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:15.310238] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-25T17:19:15.310300] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-25T17:19:15.312801] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-25T17:19:15.312870] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-25T17:19:15.681358] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:15.888699] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-25T17:19:16.058865] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:19:16.688771] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-25T17:19:16.790121] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:19:17.488738] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-25T17:19:17.950160] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-25T17:19:18.288691] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-25T17:19:18.419406] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T17:19:18.428620] [INFO ] [REMOTE ] AS: Full fetch complete (76135 records). [2025-09-25T17:19:18.428793] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-25T17:19:18.429500] [FATAL] [VALIDATOR ] AS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:19:18.429621] [FATAL] [MAIN ] AS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:19:18.429701] [WARN ] [MAIN ] AS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:19:18.429856] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-25T17:19:18.429953] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-25T17:19:18.430009] [INFO ] [LOCAL ] AS: Starting deletion of derivative data. [2025-09-25T17:19:18.430712] [DEBUG] [LOCAL ] AS: Deleted derivative data file. [2025-09-25T17:19:18.430832] [INFO ] [MAIN ] Update Progress: 150/2372 symbols completed. AS took 29.8s. Estimated remaining: 4h 45m 15s. Rate: 7.8 symbols/min [2025-09-25T17:19:18.602323] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:18.602528] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-09-25T17:19:18.602565] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-09-25T17:19:18.602805] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-25T17:19:18.602858] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-25T17:19:18.602899] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-09-25T17:19:18.602930] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-25T17:19:18.839403] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T17:19:18.859363] [INFO ] [REMOTE ] ARX: Full fetch complete (14020 records). [2025-09-25T17:19:18.859464] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-25T17:19:19.095745] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-25T17:19:19.139576] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:19.248130] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-25T17:19:19.248610] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:19:19.248889] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:19:19.248993] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-25T17:19:19.249120] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-25T17:19:19.249180] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-25T17:19:19.249227] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-25T17:19:19.249406] [INFO ] [MAIN ] Update Progress: 151/2372 symbols completed. ARX took 33.6s. Estimated remaining: 4h 43m 26s. Rate: 7.8 symbols/min [2025-09-25T17:19:19.447944] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:19.459918] [DEBUG] [LOCAL ] ASBA: Loaded 3433 existing records from primary storage. [2025-09-25T17:19:19.460069] [INFO ] [MAIN ] ASBA: Loaded 3433 existing records. [2025-09-25T17:19:19.659093] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:19.659504] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-25T17:19:19.659553] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-25T17:19:19.659950] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-25T17:19:19.660012] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-25T17:19:19.909559] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-25T17:19:20.120322] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:20.202996] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T17:19:20.231959] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T17:19:20.688715] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-25T17:19:21.488734] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-25T17:19:21.652680] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:19:22.288781] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-25T17:19:22.314174] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T17:19:22.456741] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T17:19:23.088823] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-25T17:19:23.549035] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T17:19:23.888707] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-25T17:19:24.688782] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-25T17:19:24.948687] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T17:19:25.016370] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T17:19:25.406126] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T17:19:25.488688] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-25T17:19:26.288782] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-25T17:19:27.088809] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-25T17:19:27.315883] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:19:27.888740] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-25T17:19:28.026706] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:19:28.042695] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T17:19:28.688733] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-25T17:19:29.445333] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T17:19:29.488759] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-25T17:19:29.611720] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:19:30.288729] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-25T17:19:30.545323] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T17:19:31.088763] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-25T17:19:31.573511] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T17:19:31.701616] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T17:19:31.888730] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-25T17:19:32.423097] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T17:19:32.688780] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-25T17:19:33.488865] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-25T17:19:34.288733] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-25T17:19:34.609021] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T17:19:34.634578] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T17:19:34.638950] [INFO ] [REMOTE ] ASA: Full fetch complete (18506 records). [2025-09-25T17:19:34.639066] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-25T17:19:34.777735] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T17:19:35.060169] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-25T17:19:35.060279] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-25T17:19:35.060626] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-25T17:19:35.060816] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-25T17:19:35.061547] [DEBUG] [LOCAL ] ASA: Trimmed 18506 records to 13926 (keeping 200 days of data) [2025-09-25T17:19:35.110724] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-25T17:19:35.179470] [DEBUG] [LOCAL ] ASA: Primary data saved (13926 records). [2025-09-25T17:19:35.179689] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-25T17:19:35.179915] [INFO ] [MAIN ] Update Progress: 152/2372 symbols completed. ASA took 33.2s. Estimated remaining: 4h 45m 20s. Rate: 7.8 symbols/min [2025-09-25T17:19:35.394121] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:35.447511] [DEBUG] [LOCAL ] ASC: Loaded 37684 existing records from primary storage. [2025-09-25T17:19:35.447675] [INFO ] [MAIN ] ASC: Loaded 37684 existing records. [2025-09-25T17:19:35.625484] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:35.627866] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-25T17:19:35.627934] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-25T17:19:35.628420] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-25T17:19:35.628501] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-25T17:19:35.893967] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-25T17:19:36.010169] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:36.448025] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T17:19:36.688704] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-25T17:19:37.488681] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-25T17:19:37.757949] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:19:38.032156] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T17:19:38.069056] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T17:19:38.288707] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-25T17:19:39.088740] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-25T17:19:39.518900] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T17:19:39.754222] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T17:19:39.888677] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-25T17:19:40.688716] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-25T17:19:41.150689] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T17:19:41.344762] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:19:41.488677] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-25T17:19:42.288806] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-25T17:19:42.961014] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T17:19:43.088704] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-25T17:19:43.888736] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-25T17:19:44.098255] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T17:19:44.418283] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T17:19:44.688723] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-25T17:19:45.488719] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-25T17:19:45.968768] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-25T17:19:46.057795] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T17:19:46.252547] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:19:46.288681] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-25T17:19:47.088721] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-25T17:19:47.888726] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-25T17:19:48.212924] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T17:19:48.332490] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T17:19:48.590415] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-25T17:19:48.688929] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-25T17:19:49.488808] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-25T17:19:50.020114] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T17:19:50.022073] [INFO ] [REMOTE ] ASBA: Full fetch complete (5235 records). [2025-09-25T17:19:50.022190] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-25T17:19:50.022757] [FATAL] [VALIDATOR ] ASBA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:19:50.022853] [FATAL] [MAIN ] ASBA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:19:50.023017] [WARN ] [MAIN ] ASBA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:19:50.023376] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-25T17:19:50.023484] [DEBUG] [LOCAL ] ASBA: No primary data file found to delete. [2025-09-25T17:19:50.023551] [INFO ] [LOCAL ] ASBA: Starting deletion of derivative data. [2025-09-25T17:19:50.024217] [DEBUG] [LOCAL ] ASBA: Deleted derivative data file. [2025-09-25T17:19:50.024482] [INFO ] [MAIN ] Update Progress: 153/2372 symbols completed. ASBA took 30.8s. Estimated remaining: 4h 46m 55s. Rate: 7.7 symbols/min [2025-09-25T17:19:50.254973] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T17:19:50.291995] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-25T17:19:50.412584] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:50.412800] [DEBUG] [LOCAL ] ASG: No existing data file found in primary storage. [2025-09-25T17:19:50.412845] [WARN ] [MAIN ] ASG: No existing data found, performing full refresh instead. [2025-09-25T17:19:50.412998] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-25T17:19:50.413042] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-25T17:19:50.413085] [DEBUG] [LOCAL ] ASG: No primary data file found to delete. [2025-09-25T17:19:50.413118] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-25T17:19:50.799120] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:51.088733] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-25T17:19:51.834491] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T17:19:51.888750] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-25T17:19:52.554835] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T17:19:52.568672] [INFO ] [REMOTE ] ASB: Full fetch complete (71573 records). [2025-09-25T17:19:52.568897] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-25T17:19:52.693833] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-25T17:19:53.007205] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-25T17:19:53.007306] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-25T17:19:53.008034] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-25T17:19:53.008100] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-25T17:19:53.009482] [DEBUG] [LOCAL ] ASB: Trimmed 71573 records to 49933 (keeping 200 days of data) [2025-09-25T17:19:53.330511] [DEBUG] [LOCAL ] ASB: Primary data saved (49933 records). [2025-09-25T17:19:53.330700] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-25T17:19:53.330798] [INFO ] [MAIN ] Update Progress: 154/2372 symbols completed. ASB took 34.9s. Estimated remaining: 4h 45m 44s. Rate: 7.8 symbols/min [2025-09-25T17:19:53.501074] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:53.501734] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-25T17:19:53.528792] [DEBUG] [LOCAL ] ASGI: Loaded 22386 existing records from primary storage. [2025-09-25T17:19:53.528934] [INFO ] [MAIN ] ASGI: Loaded 22386 existing records. [2025-09-25T17:19:53.718524] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:53.719392] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-25T17:19:53.719444] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-25T17:19:53.719734] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-25T17:19:53.719792] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-25T17:19:54.134322] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-25T17:19:54.164782] [INFO ] [REMOTE ] ASAN: Full fetch complete (76552 records). [2025-09-25T17:19:54.164967] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-25T17:19:54.175550] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:19:54.217555] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:54.294729] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-25T17:19:54.628509] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T17:19:54.721467] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-25T17:19:54.721555] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-25T17:19:54.722359] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-25T17:19:54.722430] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-25T17:19:54.723950] [DEBUG] [LOCAL ] ASAN: Trimmed 76552 records to 53132 (keeping 200 days of data) [2025-09-25T17:19:55.062900] [DEBUG] [LOCAL ] ASAN: Primary data saved (53132 records). [2025-09-25T17:19:55.063042] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-25T17:19:55.063140] [INFO ] [MAIN ] Update Progress: 155/2372 symbols completed. ASAN took 40.2s. Estimated remaining: 4h 44m 10s. Rate: 7.8 symbols/min [2025-09-25T17:19:55.094798] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-25T17:19:55.252582] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:55.296318] [DEBUG] [LOCAL ] ASGN: Loaded 35922 existing records from primary storage. [2025-09-25T17:19:55.296471] [INFO ] [MAIN ] ASGN: Loaded 35922 existing records. [2025-09-25T17:19:55.489857] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:55.490415] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-25T17:19:55.490464] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-25T17:19:55.490852] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-25T17:19:55.490912] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-25T17:19:55.811457] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T17:19:55.833378] [INFO ] [REMOTE ] ASC: Full fetch complete (57018 records). [2025-09-25T17:19:55.833540] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-25T17:19:55.896362] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-25T17:19:55.994348] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:56.001549] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T17:19:56.326939] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-25T17:19:56.327025] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-25T17:19:56.327685] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-25T17:19:56.327749] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-25T17:19:56.329011] [DEBUG] [LOCAL ] ASC: Trimmed 57018 records to 37925 (keeping 200 days of data) [2025-09-25T17:19:56.561723] [DEBUG] [LOCAL ] ASC: Primary data saved (37925 records). [2025-09-25T17:19:56.561868] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-25T17:19:56.561954] [INFO ] [MAIN ] Update Progress: 156/2372 symbols completed. ASC took 21.4s. Estimated remaining: 4h 42m 34s. Rate: 7.8 symbols/min [2025-09-25T17:19:56.693828] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-25T17:19:56.764917] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:19:56.803710] [DEBUG] [LOCAL ] ASH: Loaded 37748 existing records from primary storage. [2025-09-25T17:19:56.803856] [INFO ] [MAIN ] ASH: Loaded 37748 existing records. [2025-09-25T17:19:57.016486] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:19:57.016916] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-25T17:19:57.016969] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-25T17:19:57.017295] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-25T17:19:57.017354] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-25T17:19:57.197456] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T17:19:57.423395] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:19:57.488728] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-25T17:19:57.988075] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T17:19:58.288794] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-25T17:19:58.565841] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T17:19:59.088723] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-25T17:19:59.557843] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T17:19:59.888689] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-25T17:20:00.301259] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T17:20:00.688805] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-25T17:20:01.032837] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T17:20:01.488768] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-25T17:20:01.781233] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T17:20:02.288731] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-25T17:20:02.911815] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T17:20:03.088732] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-25T17:20:03.536451] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T17:20:03.888722] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-25T17:20:04.688736] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-25T17:20:04.809262] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T17:20:05.464410] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:20:05.489016] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-25T17:20:05.738458] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T17:20:06.288754] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-25T17:20:06.702860] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T17:20:07.088706] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-25T17:20:07.789889] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T17:20:07.888743] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-25T17:20:08.611776] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T17:20:08.688731] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-25T17:20:08.879869] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T17:20:09.494524] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-25T17:20:09.498789] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:20:10.288766] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-25T17:20:10.896842] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:20:11.088679] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-25T17:20:11.169326] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T17:20:11.888825] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-25T17:20:12.432819] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T17:20:12.688734] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-25T17:20:13.488771] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-25T17:20:13.744864] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T17:20:14.288693] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-25T17:20:14.686627] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:20:15.088775] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-25T17:20:15.167680] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (3.28 seconds). [2025-09-25T17:20:15.664279] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T17:20:15.888846] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-25T17:20:16.141088] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T17:20:16.688778] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-25T17:20:17.154255] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T17:20:17.488724] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-25T17:20:17.959245] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:20:17.963729] [INFO ] [REMOTE ] ASG: Full fetch complete (31294 records). [2025-09-25T17:20:17.963886] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-25T17:20:18.293803] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-25T17:20:18.353417] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T17:20:18.410900] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-25T17:20:18.410989] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-25T17:20:18.411446] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-25T17:20:18.411561] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-25T17:20:18.413357] [DEBUG] [LOCAL ] ASG: Trimmed 31294 records to 20501 (keeping 200 days of data) [2025-09-25T17:20:18.574822] [DEBUG] [LOCAL ] ASG: Primary data saved (20501 records). [2025-09-25T17:20:18.575002] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-25T17:20:18.575241] [INFO ] [MAIN ] Update Progress: 157/2372 symbols completed. ASG took 28.6s. Estimated remaining: 4h 45m 49s. Rate: 7.7 symbols/min [2025-09-25T17:20:19.088798] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-25T17:20:19.885429] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:20:19.889502] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-25T17:20:20.112122] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T17:20:20.688833] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-25T17:20:20.904523] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:20:21.488788] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-25T17:20:22.268585] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T17:20:22.288675] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-25T17:20:22.968120] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T17:20:23.088743] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-25T17:20:23.514663] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T17:20:23.527128] [INFO ] [REMOTE ] ASGN: Full fetch complete (51506 records). [2025-09-25T17:20:23.527277] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-25T17:20:23.528431] [FATAL] [VALIDATOR ] ASGN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:20:23.528580] [FATAL] [MAIN ] ASGN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:20:23.528667] [WARN ] [MAIN ] ASGN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:20:23.528762] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-25T17:20:23.528899] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-25T17:20:23.528997] [INFO ] [LOCAL ] ASGN: Starting deletion of derivative data. [2025-09-25T17:20:23.529754] [DEBUG] [LOCAL ] ASGN: Deleted derivative data file. [2025-09-25T17:20:23.529975] [INFO ] [MAIN ] Update Progress: 158/2372 symbols completed. ASGN took 28.5s. Estimated remaining: 4h 45m 3s. Rate: 7.8 symbols/min [2025-09-25T17:20:23.888721] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-25T17:20:24.032436] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T17:20:24.038744] [INFO ] [REMOTE ] ASGI: Full fetch complete (33404 records). [2025-09-25T17:20:24.038866] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-25T17:20:24.458505] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-25T17:20:24.458733] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-25T17:20:24.459188] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-25T17:20:24.459231] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-25T17:20:24.460164] [DEBUG] [LOCAL ] ASGI: Trimmed 33404 records to 22522 (keeping 200 days of data) [2025-09-25T17:20:24.615726] [DEBUG] [LOCAL ] ASGI: Primary data saved (22522 records). [2025-09-25T17:20:24.615883] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-25T17:20:24.616052] [INFO ] [MAIN ] Update Progress: 159/2372 symbols completed. ASGI took 31.3s. Estimated remaining: 4h 43m 22s. Rate: 7.8 symbols/min [2025-09-25T17:20:25.153214] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:20:25.161624] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-25T17:20:26.359692] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-25T17:20:26.367960] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-25T17:20:27.830997] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T17:20:27.838006] [INFO ] [REMOTE ] ASH: Full fetch complete (54736 records). [2025-09-25T17:20:27.838114] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-25T17:20:28.278393] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-25T17:20:28.278473] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-25T17:20:28.279093] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-25T17:20:28.279155] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-25T17:20:28.280323] [DEBUG] [LOCAL ] ASH: Trimmed 54736 records to 38035 (keeping 200 days of data) [2025-09-25T17:20:28.540673] [DEBUG] [LOCAL ] ASH: Primary data saved (38035 records). [2025-09-25T17:20:28.540834] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-25T17:20:28.541010] [INFO ] [MAIN ] Update Progress: 160/2372 symbols completed. ASH took 32.0s. Estimated remaining: 4h 42m 23s. Rate: 7.8 symbols/min [2025-09-25T17:20:29.214056] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:29.247719] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:29.296896] [DEBUG] [LOCAL ] ASIX: No existing data file found in primary storage. [2025-09-25T17:20:29.296982] [WARN ] [MAIN ] ASIX: No existing data found, performing full refresh instead. [2025-09-25T17:20:29.297178] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-25T17:20:29.297226] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-25T17:20:29.297268] [DEBUG] [LOCAL ] ASIX: No primary data file found to delete. [2025-09-25T17:20:29.297335] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-25T17:20:29.305737] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:29.452258] [DEBUG] [LOCAL ] ASR: Loaded 9262 existing records from primary storage. [2025-09-25T17:20:29.452401] [INFO ] [MAIN ] ASR: Loaded 9262 existing records. [2025-09-25T17:20:29.451672] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:29.616809] [DEBUG] [LOCAL ] ASPN: Loaded 49580 existing records from primary storage. [2025-09-25T17:20:29.616966] [INFO ] [MAIN ] ASPN: Loaded 49580 existing records. [2025-09-25T17:20:29.936579] [DEBUG] [LOCAL ] ASX: Loaded 52874 existing records from primary storage. [2025-09-25T17:20:29.967912] [INFO ] [MAIN ] ASX: Loaded 52874 existing records. [2025-09-25T17:20:30.149628] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:20:30.216002] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-25T17:20:30.216071] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-25T17:20:30.216353] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-25T17:20:30.216412] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-25T17:20:30.368877] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:20:30.389143] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-25T17:20:30.389240] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-25T17:20:30.396898] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-25T17:20:30.402872] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-25T17:20:30.754563] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:20:30.766690] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-25T17:20:30.766748] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-25T17:20:30.767062] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-25T17:20:30.767121] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-25T17:20:30.861660] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:30.870026] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-25T17:20:31.420241] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:31.438612] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-25T17:20:31.613413] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:31.613786] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-25T17:20:31.673203] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:31.673450] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-25T17:20:32.011491] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T17:20:32.015011] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-25T17:20:32.363330] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T17:20:32.365798] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-25T17:20:32.939222] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T17:20:32.941212] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-25T17:20:33.005582] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T17:20:33.010984] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-25T17:20:33.272200] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T17:20:33.283148] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-25T17:20:33.325081] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:20:33.488734] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-25T17:20:33.531745] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T17:20:33.594664] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T17:20:34.288726] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-25T17:20:34.852765] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T17:20:35.081949] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T17:20:35.094816] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-25T17:20:35.128593] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T17:20:35.888725] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-25T17:20:36.688709] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-25T17:20:36.779679] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T17:20:36.948556] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T17:20:37.488740] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-25T17:20:38.288705] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-25T17:20:38.511614] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T17:20:38.730278] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T17:20:39.088704] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-25T17:20:39.888722] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-25T17:20:40.204891] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T17:20:40.688699] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-25T17:20:40.974514] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T17:20:41.111572] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T17:20:41.488731] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-25T17:20:42.288767] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-25T17:20:42.414868] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T17:20:43.088753] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-25T17:20:43.199420] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T17:20:43.313751] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T17:20:43.888676] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-25T17:20:44.262892] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:20:44.539599] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-25T17:20:44.688710] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-25T17:20:45.461004] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T17:20:45.488706] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-25T17:20:46.288732] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-25T17:20:46.551033] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T17:20:47.088747] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-25T17:20:47.888708] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-25T17:20:48.260127] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T17:20:48.387923] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T17:20:48.688746] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-25T17:20:48.956266] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T17:20:49.488737] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-25T17:20:50.288722] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-25T17:20:50.317061] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T17:20:50.319508] [INFO ] [REMOTE ] ASR: Full fetch complete (12364 records). [2025-09-25T17:20:50.319580] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-25T17:20:50.544928] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:20:50.786067] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-25T17:20:50.786283] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-25T17:20:50.786553] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-25T17:20:50.786592] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-25T17:20:50.787076] [DEBUG] [LOCAL ] ASR: Trimmed 12364 records to 9322 (keeping 200 days of data) [2025-09-25T17:20:50.845921] [DEBUG] [LOCAL ] ASR: Primary data saved (9322 records). [2025-09-25T17:20:50.846060] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-25T17:20:50.846145] [INFO ] [MAIN ] Update Progress: 161/2372 symbols completed. ASR took 22.3s. Estimated remaining: 4h 45m 36s. Rate: 7.7 symbols/min [2025-09-25T17:20:51.023580] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:51.071464] [DEBUG] [LOCAL ] ATEN: Loaded 39882 existing records from primary storage. [2025-09-25T17:20:51.071612] [INFO ] [MAIN ] ATEN: Loaded 39882 existing records. [2025-09-25T17:20:51.094725] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-25T17:20:51.374865] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:20:51.375168] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-25T17:20:51.375213] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-25T17:20:51.375568] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-25T17:20:51.386070] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T17:20:51.375628] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-25T17:20:51.768329] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:51.888699] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-25T17:20:52.688688] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-25T17:20:52.805021] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T17:20:53.495213] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-25T17:20:53.521379] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:20:53.572341] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T17:20:54.288717] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-25T17:20:55.088709] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-25T17:20:55.167335] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T17:20:55.888706] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-25T17:20:56.271362] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T17:20:56.528769] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T17:20:56.537131] [INFO ] [REMOTE ] ASIX: Full fetch complete (29840 records). [2025-09-25T17:20:56.537233] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-25T17:20:56.699729] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-25T17:20:56.946504] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-25T17:20:56.946577] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-25T17:20:56.946971] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-25T17:20:56.947068] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-25T17:20:56.948083] [DEBUG] [LOCAL ] ASIX: Trimmed 29840 records to 22682 (keeping 200 days of data) [2025-09-25T17:20:57.100707] [DEBUG] [LOCAL ] ASIX: Primary data saved (22682 records). [2025-09-25T17:20:57.100839] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-25T17:20:57.100965] [INFO ] [MAIN ] Update Progress: 162/2372 symbols completed. ASIX took 28.5s. Estimated remaining: 4h 45m 8s. Rate: 7.8 symbols/min [2025-09-25T17:20:57.291451] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:20:57.327301] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T17:20:57.373812] [DEBUG] [LOCAL ] ATGE: Loaded 31901 existing records from primary storage. [2025-09-25T17:20:57.373951] [INFO ] [MAIN ] ATGE: Loaded 31901 existing records. [2025-09-25T17:20:57.493837] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-25T17:20:57.558893] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:20:57.561107] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-25T17:20:57.561163] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-25T17:20:57.561700] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-25T17:20:57.561768] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-25T17:20:57.919025] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:20:58.289944] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-25T17:20:58.600043] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T17:20:58.700143] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T17:20:59.088735] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-25T17:20:59.715259] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T17:20:59.888721] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-25T17:21:00.642980] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T17:21:00.688671] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-25T17:21:01.481592] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T17:21:01.489668] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-25T17:21:01.507702] [INFO ] [REMOTE ] ASX: Full fetch complete (76227 records). [2025-09-25T17:21:01.507941] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-25T17:21:01.511517] [FATAL] [VALIDATOR ] ASX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:21:01.511697] [FATAL] [MAIN ] ASX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:21:01.511768] [WARN ] [MAIN ] ASX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:21:01.511850] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-25T17:21:01.511958] [DEBUG] [LOCAL ] ASX: No primary data file found to delete. [2025-09-25T17:21:01.512025] [INFO ] [LOCAL ] ASX: Starting deletion of derivative data. [2025-09-25T17:21:01.512472] [DEBUG] [LOCAL ] ASX: Deleted derivative data file. [2025-09-25T17:21:01.512629] [INFO ] [MAIN ] Update Progress: 163/2372 symbols completed. ASX took 33.0s. Estimated remaining: 4h 44m 15s. Rate: 7.8 symbols/min [2025-09-25T17:21:01.683909] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T17:21:01.775195] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:01.820560] [DEBUG] [LOCAL ] ATHM: Loaded 32665 existing records from primary storage. [2025-09-25T17:21:01.820739] [INFO ] [MAIN ] ATHM: Loaded 32665 existing records. [2025-09-25T17:21:02.006629] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:02.007237] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-25T17:21:02.007312] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-25T17:21:02.007585] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-25T17:21:02.007680] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-25T17:21:02.289587] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-25T17:21:02.410585] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:03.065336] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T17:21:03.088839] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-25T17:21:03.232364] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T17:21:03.888775] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-25T17:21:04.699467] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-25T17:21:04.703117] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T17:21:05.488716] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-25T17:21:05.575793] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:21:05.891799] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T17:21:06.288731] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-25T17:21:07.088853] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-25T17:21:07.272605] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T17:21:07.888739] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-25T17:21:08.054587] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T17:21:08.064771] [INFO ] [REMOTE ] ASPN: Full fetch complete (72299 records). [2025-09-25T17:21:08.064970] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-25T17:21:08.508018] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-25T17:21:08.508138] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-25T17:21:08.509019] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-25T17:21:08.509090] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-25T17:21:08.512506] [DEBUG] [LOCAL ] ASPN: Trimmed 72299 records to 49938 (keeping 200 days of data) [2025-09-25T17:21:08.624626] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T17:21:08.688842] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-25T17:21:08.899746] [DEBUG] [LOCAL ] ASPN: Primary data saved (49938 records). [2025-09-25T17:21:08.899915] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-25T17:21:08.900035] [INFO ] [MAIN ] Update Progress: 164/2372 symbols completed. ASPN took 40.4s. Estimated remaining: 4h 44m 3s. Rate: 7.8 symbols/min [2025-09-25T17:21:09.096956] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:09.140534] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T17:21:09.161215] [DEBUG] [LOCAL ] ATHS: Loaded 7098 existing records from primary storage. [2025-09-25T17:21:09.161385] [INFO ] [MAIN ] ATHS: Loaded 7098 existing records. [2025-09-25T17:21:09.365964] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:09.367621] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-25T17:21:09.367738] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-25T17:21:09.368079] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-25T17:21:09.368188] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-25T17:21:09.488973] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-25T17:21:09.774828] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T17:21:09.823409] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:10.288735] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-25T17:21:10.789125] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T17:21:10.940957] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T17:21:11.088704] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-25T17:21:11.701340] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T17:21:11.888709] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-25T17:21:12.688724] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-25T17:21:13.326879] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T17:21:13.488705] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-25T17:21:13.929886] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T17:21:14.059304] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T17:21:14.288694] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-25T17:21:15.088722] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-25T17:21:15.394442] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T17:21:15.888754] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-25T17:21:16.638518] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T17:21:16.661585] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T17:21:16.688663] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-25T17:21:17.399033] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T17:21:17.488701] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-25T17:21:18.104750] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T17:21:18.288760] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-25T17:21:19.088720] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-25T17:21:19.399691] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T17:21:19.888719] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-25T17:21:20.568667] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:21:20.688677] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-25T17:21:21.137126] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:21:21.142732] [INFO ] [REMOTE ] ATGE: Full fetch complete (46236 records). [2025-09-25T17:21:21.142911] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-25T17:21:21.494721] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-25T17:21:21.614321] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-25T17:21:21.614437] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-25T17:21:21.615021] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-25T17:21:21.615090] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-25T17:21:21.616316] [DEBUG] [LOCAL ] ATGE: Trimmed 46236 records to 32073 (keeping 200 days of data) [2025-09-25T17:21:21.849577] [DEBUG] [LOCAL ] ATGE: Primary data saved (32073 records). [2025-09-25T17:21:21.849911] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-25T17:21:21.850050] [INFO ] [MAIN ] Update Progress: 165/2372 symbols completed. ATGE took 24.7s. Estimated remaining: 4h 45m 5s. Rate: 7.7 symbols/min [2025-09-25T17:21:22.001009] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:21:22.042047] [INFO ] [REMOTE ] ATEN: Full fetch complete (57197 records). [2025-09-25T17:21:22.042214] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-25T17:21:22.049219] [FATAL] [VALIDATOR ] ATEN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:21:22.049403] [FATAL] [MAIN ] ATEN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:21:22.049450] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:21:22.049487] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-25T17:21:22.049558] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-25T17:21:22.049613] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-09-25T17:21:22.050125] [DEBUG] [LOCAL ] ATEN: Deleted derivative data file. [2025-09-25T17:21:22.050226] [INFO ] [MAIN ] Update Progress: 166/2372 symbols completed. ATEN took 31.2s. Estimated remaining: 4h 43m 17s. Rate: 7.8 symbols/min [2025-09-25T17:21:22.080576] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:22.281018] [DEBUG] [LOCAL ] ATI: Loaded 51530 existing records from primary storage. [2025-09-25T17:21:22.281174] [INFO ] [MAIN ] ATI: Loaded 51530 existing records. [2025-09-25T17:21:22.297422] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-25T17:21:22.361341] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:22.480667] [DEBUG] [LOCAL ] ATKR: Loaded 35658 existing records from primary storage. [2025-09-25T17:21:22.480874] [INFO ] [MAIN ] ATKR: Loaded 35658 existing records. [2025-09-25T17:21:22.637726] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:22.637986] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-25T17:21:22.638035] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-25T17:21:22.638399] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-25T17:21:22.638461] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-25T17:21:22.914419] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:22.917904] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-25T17:21:22.917990] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-25T17:21:22.918862] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-25T17:21:22.918936] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-25T17:21:22.926784] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:21:23.092717] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-25T17:21:23.092587] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T17:21:23.628937] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:23.736829] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:23.888714] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-25T17:21:24.688715] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-25T17:21:24.809378] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:21:25.114867] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T17:21:25.488691] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-25T17:21:25.584426] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T17:21:26.288697] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-25T17:21:27.023529] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T17:21:27.088708] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-25T17:21:27.401273] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T17:21:27.888792] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-25T17:21:28.469392] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T17:21:28.579457] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T17:21:28.688697] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-25T17:21:29.488856] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-25T17:21:29.766554] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T17:21:30.288770] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-25T17:21:30.828855] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T17:21:31.088850] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-25T17:21:31.872700] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T17:21:31.888670] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-25T17:21:31.924986] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T17:21:32.688758] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-25T17:21:33.481304] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T17:21:33.499907] [INFO ] [REMOTE ] ATHS: Full fetch complete (10033 records). [2025-09-25T17:21:33.509848] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T17:21:33.499699] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-25T17:21:33.519782] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-25T17:21:33.524419] [FATAL] [VALIDATOR ] ATHS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:21:33.529187] [FATAL] [MAIN ] ATHS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:21:33.529326] [WARN ] [MAIN ] ATHS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:21:33.529466] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-25T17:21:33.529591] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-09-25T17:21:33.529705] [INFO ] [LOCAL ] ATHS: Starting deletion of derivative data. [2025-09-25T17:21:33.530316] [DEBUG] [LOCAL ] ATHS: Deleted derivative data file. [2025-09-25T17:21:33.530555] [INFO ] [MAIN ] Update Progress: 167/2372 symbols completed. ATHS took 24.6s. Estimated remaining: 4h 43m 59s. Rate: 7.8 symbols/min [2025-09-25T17:21:33.747923] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:33.748101] [DEBUG] [LOCAL ] ATMU: No existing data file found in primary storage. [2025-09-25T17:21:33.748155] [WARN ] [MAIN ] ATMU: No existing data found, performing full refresh instead. [2025-09-25T17:21:33.748583] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-25T17:21:33.748686] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-25T17:21:33.748750] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-25T17:21:33.748783] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-25T17:21:34.106174] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:34.288738] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-25T17:21:34.713407] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T17:21:35.088844] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-25T17:21:35.888742] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-25T17:21:35.929035] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:21:36.484610] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:21:36.688677] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-25T17:21:37.314897] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:21:37.320008] [INFO ] [REMOTE ] ATHM: Full fetch complete (51714 records). [2025-09-25T17:21:37.320154] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-25T17:21:37.493829] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-25T17:21:37.772325] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-25T17:21:37.772414] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-25T17:21:37.773018] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-25T17:21:37.773099] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-25T17:21:37.774187] [DEBUG] [LOCAL ] ATHM: Trimmed 51714 records to 32842 (keeping 200 days of data) [2025-09-25T17:21:38.003615] [DEBUG] [LOCAL ] ATHM: Primary data saved (32842 records). [2025-09-25T17:21:38.003800] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-25T17:21:38.003925] [INFO ] [MAIN ] Update Progress: 168/2372 symbols completed. ATHM took 36.5s. Estimated remaining: 4h 43m 9s. Rate: 7.8 symbols/min [2025-09-25T17:21:38.139928] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T17:21:38.229062] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:38.290921] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-25T17:21:38.292802] [DEBUG] [LOCAL ] ATO: Loaded 41900 existing records from primary storage. [2025-09-25T17:21:38.292962] [INFO ] [MAIN ] ATO: Loaded 41900 existing records. [2025-09-25T17:21:38.484748] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:38.485209] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-25T17:21:38.485279] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-25T17:21:38.485623] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-25T17:21:38.485738] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-25T17:21:38.897293] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:39.055044] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:21:39.088686] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-25T17:21:39.498845] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T17:21:39.888766] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-25T17:21:40.410739] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T17:21:40.688755] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-25T17:21:41.488707] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-25T17:21:41.580084] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T17:21:41.966415] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T17:21:42.288758] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-25T17:21:43.088728] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-25T17:21:43.169484] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T17:21:43.588886] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T17:21:43.888714] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-25T17:21:44.688699] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-25T17:21:44.833901] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T17:21:44.915904] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T17:21:44.922958] [INFO ] [REMOTE ] ATKR: Full fetch complete (53628 records). [2025-09-25T17:21:44.923058] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-25T17:21:45.360903] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-25T17:21:45.361009] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-25T17:21:45.361903] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-25T17:21:45.361970] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-25T17:21:45.363307] [DEBUG] [LOCAL ] ATKR: Trimmed 53628 records to 35914 (keeping 200 days of data) [2025-09-25T17:21:45.489711] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-25T17:21:45.622197] [DEBUG] [LOCAL ] ATKR: Primary data saved (35914 records). [2025-09-25T17:21:45.622335] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-25T17:21:45.622467] [INFO ] [MAIN ] Update Progress: 169/2372 symbols completed. ATKR took 23.6s. Estimated remaining: 4h 43m 0s. Rate: 7.8 symbols/min [2025-09-25T17:21:45.796381] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:21:45.842173] [DEBUG] [LOCAL ] ATR: Loaded 30413 existing records from primary storage. [2025-09-25T17:21:45.842309] [INFO ] [MAIN ] ATR: Loaded 30413 existing records. [2025-09-25T17:21:46.023624] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:21:46.025950] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-25T17:21:46.026008] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-25T17:21:46.026344] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-25T17:21:46.027729] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-25T17:21:46.211219] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:21:46.289054] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-25T17:21:46.425867] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:21:46.981828] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:21:47.088742] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-25T17:21:47.888729] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-25T17:21:47.979715] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T17:21:48.581438] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:21:48.688681] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-25T17:21:49.175967] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T17:21:49.488727] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-25T17:21:50.122453] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:21:50.288734] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-25T17:21:50.928222] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T17:21:51.088742] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-25T17:21:51.888735] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-25T17:21:51.923235] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T17:21:52.519368] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T17:21:52.688765] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-25T17:21:53.203909] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:21:53.488768] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-25T17:21:54.289053] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-25T17:21:54.288896] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T17:21:55.088686] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-25T17:21:55.246452] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T17:21:55.888730] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-25T17:21:56.202589] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T17:21:56.484352] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T17:21:56.688733] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-25T17:21:57.145792] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T17:21:57.488697] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-25T17:21:58.153768] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T17:21:58.288739] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-25T17:21:59.088694] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-25T17:21:59.214620] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:21:59.706290] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:21:59.888696] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-25T17:22:00.280854] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T17:22:00.688755] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-25T17:22:01.129932] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T17:22:01.488734] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-25T17:22:02.222794] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T17:22:02.288721] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-25T17:22:03.089414] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-25T17:22:03.101134] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T17:22:03.111985] [INFO ] [REMOTE ] ATMU: Full fetch complete (56626 records). [2025-09-25T17:22:03.112147] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-25T17:22:03.112907] [FATAL] [VALIDATOR ] ATMU: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:22:03.114731] [FATAL] [MAIN ] ATMU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:22:03.114780] [WARN ] [MAIN ] ATMU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:22:03.114906] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-25T17:22:03.115006] [DEBUG] [LOCAL ] ATMU: No primary data file found to delete. [2025-09-25T17:22:03.115063] [INFO ] [LOCAL ] ATMU: Starting deletion of derivative data. [2025-09-25T17:22:03.115121] [DEBUG] [LOCAL ] ATMU: No derivative data file found to delete. [2025-09-25T17:22:03.115206] [INFO ] [MAIN ] Update Progress: 170/2372 symbols completed. ATMU took 29.6s. Estimated remaining: 4h 44m 59s. Rate: 7.7 symbols/min [2025-09-25T17:22:03.318748] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:03.345598] [DEBUG] [LOCAL ] ATS: Loaded 17957 existing records from primary storage. [2025-09-25T17:22:03.345769] [INFO ] [MAIN ] ATS: Loaded 17957 existing records. [2025-09-25T17:22:03.551325] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T17:22:03.593314] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:03.593629] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-25T17:22:03.593709] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-25T17:22:03.594040] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-25T17:22:03.594101] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-25T17:22:03.895881] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-25T17:22:04.022102] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:04.035523] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T17:22:04.688723] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-25T17:22:05.488745] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-25T17:22:05.580936] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:22:05.707170] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T17:22:06.288723] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-25T17:22:07.088723] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-25T17:22:07.250935] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T17:22:07.263400] [INFO ] [REMOTE ] ATO: Full fetch complete (60435 records). [2025-09-25T17:22:07.263560] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-25T17:22:07.360069] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T17:22:07.691309] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-25T17:22:07.692072] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-25T17:22:07.692755] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-25T17:22:07.692865] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-25T17:22:07.695765] [DEBUG] [LOCAL ] ATO: Trimmed 60435 records to 42204 (keeping 200 days of data) [2025-09-25T17:22:07.790743] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T17:22:07.933568] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-25T17:22:08.054143] [DEBUG] [LOCAL ] ATO: Primary data saved (42204 records). [2025-09-25T17:22:08.054400] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-25T17:22:08.054567] [INFO ] [MAIN ] Update Progress: 171/2372 symbols completed. ATO took 30.1s. Estimated remaining: 4h 44m 15s. Rate: 7.7 symbols/min [2025-09-25T17:22:08.250082] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:08.250277] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-25T17:22:08.250385] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-25T17:22:08.250534] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-25T17:22:08.250576] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-25T17:22:08.250618] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-25T17:22:08.250756] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-25T17:22:08.650259] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:08.690803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-25T17:22:08.698144] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T17:22:09.488803] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-25T17:22:10.288765] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-25T17:22:10.622936] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T17:22:10.697545] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T17:22:11.088768] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-25T17:22:11.888759] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-25T17:22:12.101587] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T17:22:12.538493] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T17:22:12.579773] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T17:22:12.688728] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-25T17:22:13.488834] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-25T17:22:14.288756] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-25T17:22:14.449963] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T17:22:14.465175] [INFO ] [REMOTE ] ATI: Full fetch complete (73877 records). [2025-09-25T17:22:14.465350] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-25T17:22:14.661867] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T17:22:14.896531] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-25T17:22:14.896619] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-25T17:22:14.897417] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-25T17:22:14.897493] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-25T17:22:14.899053] [DEBUG] [LOCAL ] ATI: Trimmed 73877 records to 51903 (keeping 200 days of data) [2025-09-25T17:22:15.101242] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-25T17:22:15.247103] [DEBUG] [LOCAL ] ATI: Primary data saved (51903 records). [2025-09-25T17:22:15.247292] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-25T17:22:15.247449] [INFO ] [MAIN ] Update Progress: 172/2372 symbols completed. ATI took 53.4s. Estimated remaining: 4h 44m 0s. Rate: 7.7 symbols/min [2025-09-25T17:22:15.444008] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:15.504923] [DEBUG] [LOCAL ] AU: Loaded 52936 existing records from primary storage. [2025-09-25T17:22:15.505078] [INFO ] [MAIN ] AU: Loaded 52936 existing records. [2025-09-25T17:22:15.691287] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:15.691760] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-25T17:22:15.691826] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-25T17:22:15.692246] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-25T17:22:15.692319] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-25T17:22:15.920133] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-25T17:22:15.939776] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:22:15.967197] [INFO ] [REMOTE ] ATR: Full fetch complete (43430 records). [2025-09-25T17:22:15.967339] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-25T17:22:16.369171] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:16.609028] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-25T17:22:16.609696] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-25T17:22:16.610445] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-25T17:22:16.610518] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-25T17:22:16.612472] [DEBUG] [LOCAL ] ATR: Trimmed 43430 records to 30652 (keeping 200 days of data) [2025-09-25T17:22:16.736568] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-25T17:22:16.777522] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T17:22:16.887977] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-25T17:22:16.906426] [DEBUG] [LOCAL ] ATR: Primary data saved (30652 records). [2025-09-25T17:22:16.906565] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-25T17:22:16.906689] [INFO ] [MAIN ] Update Progress: 173/2372 symbols completed. ATR took 31.3s. Estimated remaining: 4h 42m 35s. Rate: 7.8 symbols/min [2025-09-25T17:22:17.112856] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:17.166404] [DEBUG] [LOCAL ] AUB: Loaded 46415 existing records from primary storage. [2025-09-25T17:22:17.166571] [INFO ] [MAIN ] AUB: Loaded 46415 existing records. [2025-09-25T17:22:17.370583] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:17.371092] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-25T17:22:17.371154] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-25T17:22:17.371446] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-25T17:22:17.371523] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-25T17:22:17.493808] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-25T17:22:17.787190] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:18.288780] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-25T17:22:18.824793] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T17:22:19.091911] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-25T17:22:19.110131] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T17:22:19.660988] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T17:22:19.888730] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-25T17:22:19.963927] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T17:22:20.688829] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-25T17:22:21.049836] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T17:22:21.488727] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-25T17:22:21.954795] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T17:22:22.288732] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-25T17:22:22.620345] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T17:22:23.088738] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-25T17:22:23.888762] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-25T17:22:24.042966] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T17:22:24.548307] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:22:24.688788] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-25T17:22:25.488709] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-25T17:22:25.802822] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T17:22:26.208936] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T17:22:26.288693] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-25T17:22:26.407319] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T17:22:27.088716] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-25T17:22:27.618046] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T17:22:27.621545] [INFO ] [REMOTE ] ATS: Full fetch complete (25648 records). [2025-09-25T17:22:27.621635] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-25T17:22:27.893795] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-25T17:22:28.058886] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-25T17:22:28.058976] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-25T17:22:28.059329] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-25T17:22:28.059371] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-25T17:22:28.060081] [DEBUG] [LOCAL ] ATS: Trimmed 25648 records to 18022 (keeping 200 days of data) [2025-09-25T17:22:28.178568] [DEBUG] [LOCAL ] ATS: Primary data saved (18022 records). [2025-09-25T17:22:28.178755] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-25T17:22:28.178896] [INFO ] [MAIN ] Update Progress: 174/2372 symbols completed. ATS took 25.1s. Estimated remaining: 4h 43m 12s. Rate: 7.8 symbols/min [2025-09-25T17:22:28.350706] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:28.350888] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-09-25T17:22:28.350943] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-09-25T17:22:28.351108] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-25T17:22:28.351162] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-25T17:22:28.351229] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-09-25T17:22:28.351264] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-25T17:22:28.695722] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-25T17:22:28.726520] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:28.937762] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T17:22:29.311264] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:22:29.488802] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-25T17:22:30.288736] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-25T17:22:30.500666] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T17:22:30.843204] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T17:22:31.028290] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T17:22:31.088682] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-25T17:22:31.789701] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T17:22:31.888701] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-25T17:22:32.303917] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-25T17:22:32.688741] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-25T17:22:33.285675] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T17:22:33.488743] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-25T17:22:34.288748] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-25T17:22:34.889407] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:22:34.908735] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T17:22:35.088735] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-25T17:22:35.726290] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T17:22:35.888704] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-25T17:22:36.688707] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-25T17:22:37.488736] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-25T17:22:37.866732] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T17:22:37.932882] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T17:22:38.288723] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-25T17:22:39.088734] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-25T17:22:39.186944] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T17:22:39.865170] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T17:22:39.888691] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-25T17:22:40.688836] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-25T17:22:41.119410] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T17:22:41.329614] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T17:22:41.462963] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:22:41.488697] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-25T17:22:41.872074] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-25T17:22:42.288735] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-25T17:22:43.088731] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-25T17:22:43.558944] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T17:22:43.888683] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-25T17:22:44.045806] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T17:22:44.688726] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-25T17:22:45.380164] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T17:22:45.488772] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-25T17:22:46.288743] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-25T17:22:46.681719] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T17:22:46.815636] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T17:22:46.817802] [INFO ] [REMOTE ] AUNA: Full fetch complete (7603 records). [2025-09-25T17:22:46.817912] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-25T17:22:47.090723] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-25T17:22:47.235166] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-25T17:22:47.235250] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-25T17:22:47.235537] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-25T17:22:47.235634] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-25T17:22:47.236097] [DEBUG] [LOCAL ] AUNA: Trimmed 7603 records to 4907 (keeping 200 days of data) [2025-09-25T17:22:47.266203] [DEBUG] [LOCAL ] AUNA: Primary data saved (4907 records). [2025-09-25T17:22:47.266327] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-25T17:22:47.266424] [INFO ] [MAIN ] Update Progress: 175/2372 symbols completed. AUNA took 19.1s. Estimated remaining: 4h 45m 27s. Rate: 7.7 symbols/min [2025-09-25T17:22:47.427325] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:22:47.452735] [INFO ] [REMOTE ] ATUS: Full fetch complete (70618 records). [2025-09-25T17:22:47.465431] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-25T17:22:47.477359] [FATAL] [VALIDATOR ] ATUS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:22:47.477605] [FATAL] [MAIN ] ATUS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:22:47.477716] [WARN ] [MAIN ] ATUS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:22:47.477798] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-25T17:22:47.477897] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-25T17:22:47.477984] [INFO ] [LOCAL ] ATUS: Starting deletion of derivative data. [2025-09-25T17:22:47.478071] [DEBUG] [LOCAL ] ATUS: No derivative data file found to delete. [2025-09-25T17:22:47.478163] [INFO ] [MAIN ] Update Progress: 176/2372 symbols completed. ATUS took 39.4s. Estimated remaining: 4h 43m 45s. Rate: 7.7 symbols/min [2025-09-25T17:22:47.547218] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:47.670806] [DEBUG] [LOCAL ] AVA: Loaded 39617 existing records from primary storage. [2025-09-25T17:22:47.670933] [INFO ] [MAIN ] AVA: Loaded 39617 existing records. [2025-09-25T17:22:47.916346] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-25T17:22:47.988067] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:47.984677] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:47.988987] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-25T17:22:47.989054] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-25T17:22:47.989401] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-25T17:22:47.989460] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-25T17:22:48.060385] [DEBUG] [LOCAL ] AVAL: Loaded 8932 existing records from primary storage. [2025-09-25T17:22:48.060520] [INFO ] [MAIN ] AVAL: Loaded 8932 existing records. [2025-09-25T17:22:48.419682] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:48.419938] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-25T17:22:48.419987] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-25T17:22:48.420225] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-25T17:22:48.420284] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-25T17:22:48.801027] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:48.801372] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-25T17:22:48.929315] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T17:22:49.026914] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:49.282374] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T17:22:49.290490] [INFO ] [REMOTE ] AUB: Full fetch complete (65475 records). [2025-09-25T17:22:49.290687] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-25T17:22:49.494810] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-25T17:22:49.730035] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-25T17:22:49.730388] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-25T17:22:49.731102] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-25T17:22:49.731182] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-25T17:22:49.732505] [DEBUG] [LOCAL ] AUB: Trimmed 65475 records to 46780 (keeping 200 days of data) [2025-09-25T17:22:50.030565] [DEBUG] [LOCAL ] AUB: Primary data saved (46780 records). [2025-09-25T17:22:50.030732] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-25T17:22:50.030844] [INFO ] [MAIN ] Update Progress: 177/2372 symbols completed. AUB took 33.1s. Estimated remaining: 4h 42m 32s. Rate: 7.8 symbols/min [2025-09-25T17:22:50.216059] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:22:50.275898] [DEBUG] [LOCAL ] AVB: Loaded 41784 existing records from primary storage. [2025-09-25T17:22:50.276052] [INFO ] [MAIN ] AVB: Loaded 41784 existing records. [2025-09-25T17:22:50.292891] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-25T17:22:50.338052] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:22:50.380347] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T17:22:50.569097] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:22:50.569466] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-25T17:22:50.569513] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-25T17:22:50.570088] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-25T17:22:50.570149] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-25T17:22:50.929020] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:22:51.088740] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-25T17:22:51.888824] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-25T17:22:52.688730] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-25T17:23:05.466026] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (12.78 seconds). [2025-09-25T17:23:05.477336] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-25T17:23:06.933738] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T17:23:06.942855] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-25T17:23:07.598157] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (15.71 seconds). [2025-09-25T17:23:07.601560] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-25T17:23:08.282224] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T17:23:08.293570] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-25T17:23:08.344249] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:23:08.347795] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-25T17:23:09.235769] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T17:23:09.239578] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-25T17:23:09.570114] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T17:23:09.579603] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-25T17:23:09.752673] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T17:23:09.756288] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-25T17:23:09.778322] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (18.69 seconds). [2025-09-25T17:23:09.785605] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-25T17:23:10.330085] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T17:23:10.334358] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-25T17:23:10.789095] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T17:23:10.796913] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-25T17:23:10.862285] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T17:23:10.866678] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-25T17:23:11.329056] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T17:23:11.338936] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-25T17:23:11.747521] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T17:23:11.750339] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-25T17:23:12.219032] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (21.93 seconds). [2025-09-25T17:23:12.231264] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-25T17:23:12.289687] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:23:12.298828] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-25T17:23:12.513868] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:23:12.525834] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-25T17:23:13.586907] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T17:23:13.595922] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-25T17:23:13.913846] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T17:23:13.916754] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-25T17:23:14.162292] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T17:23:14.174245] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-25T17:23:14.759206] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T17:23:14.761222] [INFO ] [REMOTE ] AVAL: Full fetch complete (14645 records). [2025-09-25T17:23:14.761315] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-25T17:23:15.144154] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:23:15.162857] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-25T17:23:15.253398] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (3.02 seconds). [2025-09-25T17:23:15.293014] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-25T17:23:15.293106] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-25T17:23:15.293456] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-25T17:23:15.293528] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-25T17:23:15.294928] [DEBUG] [LOCAL ] AVAL: Trimmed 14645 records to 9011 (keeping 200 days of data) [2025-09-25T17:23:15.293947] [INFO ] [REMOTE ] AU: Full fetch complete (76264 records). [2025-09-25T17:23:15.334835] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-25T17:23:15.350749] [DEBUG] [LOCAL ] AVAL: Primary data saved (9011 records). [2025-09-25T17:23:15.350919] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-25T17:23:15.351055] [INFO ] [MAIN ] Update Progress: 178/2372 symbols completed. AVAL took 27.9s. Estimated remaining: 4h 46m 2s. Rate: 7.7 symbols/min [2025-09-25T17:23:15.701934] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:15.702145] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-25T17:23:15.702201] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-25T17:23:15.702377] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-25T17:23:15.702430] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-25T17:23:15.702500] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-25T17:23:15.702536] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-25T17:23:15.821219] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T17:23:15.850672] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-25T17:23:16.387931] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-25T17:23:16.388021] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-25T17:23:16.388920] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-25T17:23:16.388989] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-25T17:23:16.390424] [DEBUG] [LOCAL ] AU: Trimmed 76264 records to 53326 (keeping 200 days of data) [2025-09-25T17:23:16.609676] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:16.610104] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-25T17:23:16.765503] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T17:23:16.777051] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-25T17:23:16.852307] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:16.853144] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-25T17:23:16.853800] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-25T17:23:16.898857] [DEBUG] [LOCAL ] AU: Primary data saved (53326 records). [2025-09-25T17:23:16.898970] [INFO ] [MAIN ] AU: Full history saved. [2025-09-25T17:23:16.899059] [INFO ] [MAIN ] Update Progress: 179/2372 symbols completed. AU took 1m 2s. Estimated remaining: 4h 44m 37s. Rate: 7.7 symbols/min [2025-09-25T17:23:17.100982] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:17.125997] [DEBUG] [LOCAL ] AVD: Loaded 22808 existing records from primary storage. [2025-09-25T17:23:17.126128] [INFO ] [MAIN ] AVD: Loaded 22808 existing records. [2025-09-25T17:23:17.323159] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:17.323456] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-25T17:23:17.323510] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-25T17:23:17.323806] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-25T17:23:17.323875] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-25T17:23:17.426110] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:17.426493] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-25T17:23:17.426840] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-25T17:23:17.584885] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:23:17.607818] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-25T17:23:17.680783] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:17.681081] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-25T17:23:17.681838] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-25T17:23:17.766398] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:17.766756] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-25T17:23:18.041556] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:23:18.052702] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-25T17:23:19.032125] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T17:23:19.039481] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-25T17:23:19.392851] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T17:23:19.401409] [INFO ] [REMOTE ] AVB: Full fetch complete (58310 records). [2025-09-25T17:23:19.401561] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-25T17:23:19.810949] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-25T17:23:19.811060] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-25T17:23:19.811835] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-25T17:23:19.811903] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-25T17:23:19.813381] [DEBUG] [LOCAL ] AVB: Trimmed 58310 records to 42140 (keeping 200 days of data) [2025-09-25T17:23:20.127425] [DEBUG] [LOCAL ] AVB: Primary data saved (42140 records). [2025-09-25T17:23:20.127612] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-25T17:23:20.127783] [INFO ] [MAIN ] Update Progress: 180/2372 symbols completed. AVB took 30.1s. Estimated remaining: 4h 43m 34s. Rate: 7.7 symbols/min [2025-09-25T17:23:20.232491] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:23:20.239038] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-25T17:23:20.348801] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:20.377875] [DEBUG] [LOCAL ] AVK: Loaded 17864 existing records from primary storage. [2025-09-25T17:23:20.378033] [INFO ] [MAIN ] AVK: Loaded 17864 existing records. [2025-09-25T17:23:20.565997] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:20.566432] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-25T17:23:20.566501] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-25T17:23:20.566784] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-25T17:23:20.566857] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-25T17:23:20.935089] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:20.935452] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-25T17:23:21.269442] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T17:23:21.276808] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-25T17:23:22.600619] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:23:22.607103] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-25T17:23:23.707722] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T17:23:23.715049] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-25T17:23:24.935316] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:23:24.942637] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-25T17:23:24.964910] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (4.03 seconds). [2025-09-25T17:23:24.969504] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-25T17:23:25.083907] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:25.084303] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-25T17:23:25.084943] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-25T17:23:25.463637] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:25.464013] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-25T17:23:25.464485] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-25T17:23:25.684204] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:25.684603] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-25T17:23:25.685456] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-25T17:23:25.805509] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T17:23:25.976904] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:25.977212] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-25T17:23:25.991289] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T17:23:26.288696] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-25T17:23:26.630819] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (8.58 seconds). [2025-09-25T17:23:26.965440] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-25T17:23:27.088707] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-25T17:23:27.888718] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-25T17:23:28.138981] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T17:23:28.688725] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-25T17:23:29.193810] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:23:29.201055] [INFO ] [REMOTE ] AVA: Full fetch complete (55665 records). [2025-09-25T17:23:29.201166] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-25T17:23:29.493791] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-25T17:23:29.628358] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-25T17:23:29.629298] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-25T17:23:29.630763] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-25T17:23:29.630832] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-25T17:23:29.634185] [DEBUG] [LOCAL ] AVA: Trimmed 55665 records to 39928 (keeping 200 days of data) [2025-09-25T17:23:29.740683] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:23:29.741033] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-25T17:23:29.881856] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T17:23:29.922904] [DEBUG] [LOCAL ] AVA: Primary data saved (39928 records). [2025-09-25T17:23:29.923042] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-25T17:23:29.923149] [INFO ] [MAIN ] Update Progress: 181/2372 symbols completed. AVA took 42.7s. Estimated remaining: 4h 43m 50s. Rate: 7.7 symbols/min [2025-09-25T17:23:30.095071] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:30.142028] [DEBUG] [LOCAL ] AVNS: Loaded 33619 existing records from primary storage. [2025-09-25T17:23:30.142166] [INFO ] [MAIN ] AVNS: Loaded 33619 existing records. [2025-09-25T17:23:30.293803] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-25T17:23:30.325897] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:30.326538] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-25T17:23:30.326687] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-25T17:23:30.326996] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-25T17:23:30.327056] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-25T17:23:30.694726] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:31.088699] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-25T17:23:31.319384] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T17:23:31.888681] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-25T17:23:32.277180] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T17:23:32.688728] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-25T17:23:33.167810] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T17:23:33.171908] [INFO ] [REMOTE ] AVD: Full fetch complete (33884 records). [2025-09-25T17:23:33.171994] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-25T17:23:33.501809] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-25T17:23:33.604821] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:23:33.607576] [INFO ] [REMOTE ] AVBC: Full fetch complete (4592 records). [2025-09-25T17:23:33.607677] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-25T17:23:33.610841] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-25T17:23:33.610933] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-25T17:23:33.611419] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-25T17:23:33.611511] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-25T17:23:33.608094] [FATAL] [VALIDATOR ] AVBC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:23:33.612745] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:23:33.613031] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:23:33.613255] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-25T17:23:33.613336] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-25T17:23:33.613404] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-25T17:23:33.613484] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-25T17:23:33.613607] [INFO ] [MAIN ] Update Progress: 182/2372 symbols completed. AVBC took 18.3s. Estimated remaining: 4h 42m 54s. Rate: 7.7 symbols/min [2025-09-25T17:23:33.646784] [DEBUG] [LOCAL ] AVD: Trimmed 33884 records to 22939 (keeping 200 days of data) [2025-09-25T17:23:33.907854] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:33.908005] [DEBUG] [LOCAL ] AVNT: No existing data file found in primary storage. [2025-09-25T17:23:33.908043] [WARN ] [MAIN ] AVNT: No existing data found, performing full refresh instead. [2025-09-25T17:23:33.908157] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-25T17:23:33.908195] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-25T17:23:33.908234] [DEBUG] [LOCAL ] AVNT: No primary data file found to delete. [2025-09-25T17:23:33.908266] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-25T17:23:33.933793] [DEBUG] [LOCAL ] AVD: Primary data saved (22939 records). [2025-09-25T17:23:33.933952] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-25T17:23:33.934049] [INFO ] [MAIN ] Update Progress: 183/2372 symbols completed. AVD took 17.0s. Estimated remaining: 4h 41m 17s. Rate: 7.8 symbols/min [2025-09-25T17:23:34.291995] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-25T17:23:34.404351] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:34.599008] [DEBUG] [LOCAL ] AVTR: Loaded 53567 existing records from primary storage. [2025-09-25T17:23:34.599168] [INFO ] [MAIN ] AVTR: Loaded 53567 existing records. [2025-09-25T17:23:34.627717] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:34.637075] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T17:23:34.807904] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:34.809413] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-25T17:23:34.809463] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-25T17:23:34.809857] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-25T17:23:34.809916] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-25T17:23:35.093833] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-25T17:23:35.169217] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:35.678677] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T17:23:35.888705] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-25T17:23:36.507341] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T17:23:36.688736] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-25T17:23:36.936685] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T17:23:37.488736] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-25T17:23:38.120020] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T17:23:38.288702] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-25T17:23:38.923840] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T17:23:39.088751] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-25T17:23:39.630988] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T17:23:39.888722] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-25T17:23:40.583767] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T17:23:40.688682] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-25T17:23:40.897279] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T17:23:41.488767] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-25T17:23:42.288722] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-25T17:23:42.436534] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T17:23:42.541756] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T17:23:43.088734] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-25T17:23:43.561167] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T17:23:43.888728] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-25T17:23:44.688779] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T17:23:44.697791] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-25T17:23:44.739270] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T17:23:45.488732] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-25T17:23:46.267004] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:23:46.288672] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-25T17:23:47.088703] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-25T17:23:47.182157] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T17:23:47.431201] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T17:23:47.872786] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T17:23:47.888700] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-25T17:23:48.688723] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-25T17:23:49.488775] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-25T17:23:49.612304] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T17:23:49.894797] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T17:23:50.288710] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-25T17:23:50.924537] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T17:23:51.088736] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-25T17:23:51.435347] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T17:23:51.440932] [INFO ] [REMOTE ] AVK: Full fetch complete (26568 records). [2025-09-25T17:23:51.441048] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-25T17:23:51.894260] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-25T17:23:51.981099] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-25T17:23:51.981179] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-25T17:23:51.981563] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-25T17:23:51.981608] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-25T17:23:51.982434] [DEBUG] [LOCAL ] AVK: Trimmed 26568 records to 17966 (keeping 200 days of data) [2025-09-25T17:23:52.112232] [DEBUG] [LOCAL ] AVK: Primary data saved (17966 records). [2025-09-25T17:23:52.112408] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-25T17:23:52.112504] [INFO ] [MAIN ] Update Progress: 184/2372 symbols completed. AVK took 32.0s. Estimated remaining: 4h 43m 14s. Rate: 7.7 symbols/min [2025-09-25T17:23:52.313837] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:52.382432] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T17:23:52.408539] [DEBUG] [LOCAL ] AVY: Loaded 37582 existing records from primary storage. [2025-09-25T17:23:52.408716] [INFO ] [MAIN ] AVY: Loaded 37582 existing records. [2025-09-25T17:23:52.596510] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:52.596982] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-25T17:23:52.597032] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-25T17:23:52.597355] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-25T17:23:52.597416] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-25T17:23:52.689303] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-25T17:23:53.026726] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:53.387477] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:23:53.488732] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-25T17:23:54.288709] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-25T17:23:54.465937] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:23:54.971092] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T17:23:54.982326] [INFO ] [REMOTE ] AVNT: Full fetch complete (56167 records). [2025-09-25T17:23:54.982514] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-25T17:23:55.095717] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-25T17:23:55.419414] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-25T17:23:55.419504] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-25T17:23:55.420145] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-25T17:23:55.420224] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-25T17:23:55.422389] [DEBUG] [LOCAL ] AVNT: Trimmed 56167 records to 39555 (keeping 200 days of data) [2025-09-25T17:23:55.705893] [DEBUG] [LOCAL ] AVNT: Primary data saved (39555 records). [2025-09-25T17:23:55.706065] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-25T17:23:55.706986] [INFO ] [MAIN ] Update Progress: 185/2372 symbols completed. AVNT took 22.1s. Estimated remaining: 4h 42m 17s. Rate: 7.7 symbols/min [2025-09-25T17:23:55.892195] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-25T17:23:55.908280] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T17:23:55.937959] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:23:55.966820] [DEBUG] [LOCAL ] AWF: Loaded 24291 existing records from primary storage. [2025-09-25T17:23:55.966954] [INFO ] [MAIN ] AWF: Loaded 24291 existing records. [2025-09-25T17:23:56.154599] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:23:56.154931] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-25T17:23:56.154979] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-25T17:23:56.155256] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-25T17:23:56.155313] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-25T17:23:56.560195] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:23:56.603008] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:23:56.688707] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-25T17:23:57.288586] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T17:23:57.488716] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-25T17:23:58.149845] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T17:23:58.288716] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-25T17:23:59.088778] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-25T17:23:59.144030] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T17:23:59.403462] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T17:23:59.888827] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-25T17:24:00.421368] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T17:24:00.688731] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-25T17:24:00.805303] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T17:24:01.488734] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-25T17:24:01.968333] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T17:24:02.288767] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-25T17:24:02.642990] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T17:24:03.088800] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-25T17:24:03.447411] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:24:03.888739] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-25T17:24:04.356739] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T17:24:04.688756] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-25T17:24:05.321515] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:24:05.328903] [INFO ] [REMOTE ] AVNS: Full fetch complete (47970 records). [2025-09-25T17:24:05.329084] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-25T17:24:05.494717] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-25T17:24:05.770702] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-25T17:24:05.770819] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-25T17:24:05.771478] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-25T17:24:05.771547] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-25T17:24:05.773502] [DEBUG] [LOCAL ] AVNS: Trimmed 47970 records to 33862 (keeping 200 days of data) [2025-09-25T17:24:06.022526] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T17:24:06.043454] [DEBUG] [LOCAL ] AVNS: Primary data saved (33862 records). [2025-09-25T17:24:06.043565] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-25T17:24:06.043706] [INFO ] [MAIN ] Update Progress: 186/2372 symbols completed. AVNS took 36.1s. Estimated remaining: 4h 42m 39s. Rate: 7.7 symbols/min [2025-09-25T17:24:06.221618] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:06.263616] [DEBUG] [LOCAL ] AWI: Loaded 25923 existing records from primary storage. [2025-09-25T17:24:06.263777] [INFO ] [MAIN ] AWI: Loaded 25923 existing records. [2025-09-25T17:24:06.296622] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-25T17:24:06.476936] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:06.477239] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-25T17:24:06.477300] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-25T17:24:06.477603] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-25T17:24:06.477908] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-25T17:24:06.836133] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T17:24:06.909708] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:07.088740] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-25T17:24:07.888755] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-25T17:24:07.966172] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T17:24:08.589679] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:24:08.688709] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-25T17:24:08.941788] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T17:24:09.488735] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-25T17:24:10.288800] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-25T17:24:10.470848] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:24:10.701235] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T17:24:11.088729] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-25T17:24:11.315091] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:24:11.888721] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-25T17:24:12.344080] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T17:24:12.688698] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-25T17:24:13.010836] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T17:24:13.488717] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-25T17:24:13.768864] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T17:24:14.288727] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-25T17:24:15.089011] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-25T17:24:15.088930] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T17:24:15.805966] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T17:24:15.888703] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-25T17:24:16.204308] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T17:24:16.657777] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T17:24:16.688759] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-25T17:24:17.488742] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-25T17:24:18.136345] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T17:24:18.288724] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-25T17:24:19.088694] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-25T17:24:19.476043] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T17:24:19.488295] [INFO ] [REMOTE ] AVTR: Full fetch complete (77052 records). [2025-09-25T17:24:19.488437] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-25T17:24:19.491501] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:24:19.491596] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:24:19.491689] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:24:19.491807] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-25T17:24:19.491914] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-09-25T17:24:19.491984] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-09-25T17:24:19.492533] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-09-25T17:24:19.492754] [INFO ] [MAIN ] Update Progress: 187/2372 symbols completed. AVTR took 45.6s. Estimated remaining: 4h 43m 38s. Rate: 7.7 symbols/min [2025-09-25T17:24:19.655061] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T17:24:19.775899] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:19.854270] [DEBUG] [LOCAL ] AWK: Loaded 48797 existing records from primary storage. [2025-09-25T17:24:19.854420] [INFO ] [MAIN ] AWK: Loaded 48797 existing records. [2025-09-25T17:24:19.892210] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-25T17:24:20.051225] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T17:24:20.089876] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:20.090560] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-25T17:24:20.090609] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-25T17:24:20.091041] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-25T17:24:20.091120] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-25T17:24:20.466893] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:20.688717] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-25T17:24:21.155839] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T17:24:21.488673] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-25T17:24:21.889328] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:24:22.288711] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-25T17:24:22.914555] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:24:22.919884] [INFO ] [REMOTE ] AWF: Full fetch complete (36005 records). [2025-09-25T17:24:22.920004] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-25T17:24:23.099536] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-25T17:24:23.380929] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-25T17:24:23.381027] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-25T17:24:23.381771] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-25T17:24:23.381846] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-25T17:24:23.382900] [DEBUG] [LOCAL ] AWF: Trimmed 36005 records to 24455 (keeping 200 days of data) [2025-09-25T17:24:23.508942] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T17:24:23.588998] [DEBUG] [LOCAL ] AWF: Primary data saved (24455 records). [2025-09-25T17:24:23.589145] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-25T17:24:23.589237] [INFO ] [MAIN ] Update Progress: 188/2372 symbols completed. AWF took 27.9s. Estimated remaining: 4h 42m 47s. Rate: 7.7 symbols/min [2025-09-25T17:24:23.773735] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:23.797176] [DEBUG] [LOCAL ] AWP: Loaded 21617 existing records from primary storage. [2025-09-25T17:24:23.797323] [INFO ] [MAIN ] AWP: Loaded 21617 existing records. [2025-09-25T17:24:23.891957] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-25T17:24:24.001843] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:24.002150] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-25T17:24:24.002197] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-25T17:24:24.002503] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-25T17:24:24.002571] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-25T17:24:24.388568] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:24.440057] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T17:24:24.688719] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-25T17:24:25.146063] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:24:25.156019] [INFO ] [REMOTE ] AVY: Full fetch complete (55910 records). [2025-09-25T17:24:25.156187] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-25T17:24:25.156895] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:24:25.157078] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:24:25.157149] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:24:25.157216] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-25T17:24:25.157330] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-09-25T17:24:25.157385] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-09-25T17:24:25.157630] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-09-25T17:24:25.157763] [INFO ] [MAIN ] Update Progress: 189/2372 symbols completed. AVY took 33.0s. Estimated remaining: 4h 41m 28s. Rate: 7.8 symbols/min [2025-09-25T17:24:25.345870] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:25.371112] [DEBUG] [LOCAL ] AWR: Loaded 22612 existing records from primary storage. [2025-09-25T17:24:25.371261] [INFO ] [MAIN ] AWR: Loaded 22612 existing records. [2025-09-25T17:24:25.494773] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-25T17:24:25.568325] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:25.568680] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-25T17:24:25.568745] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-25T17:24:25.568984] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-25T17:24:25.569479] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-25T17:24:25.942013] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:26.288756] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-25T17:24:26.365859] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T17:24:26.792410] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T17:24:27.088761] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-25T17:24:27.355869] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T17:24:27.888827] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-25T17:24:28.370922] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T17:24:28.688727] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-25T17:24:28.808880] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T17:24:29.488763] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-25T17:24:29.667219] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T17:24:29.674476] [INFO ] [REMOTE ] AWI: Full fetch complete (35521 records). [2025-09-25T17:24:29.674668] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-25T17:24:30.069952] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-25T17:24:30.070033] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-25T17:24:30.070469] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-25T17:24:30.070572] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-25T17:24:30.071718] [DEBUG] [LOCAL ] AWI: Trimmed 35521 records to 26071 (keeping 200 days of data) [2025-09-25T17:24:30.261318] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T17:24:30.287935] [DEBUG] [LOCAL ] AWI: Primary data saved (26071 records). [2025-09-25T17:24:30.288102] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-25T17:24:30.288291] [INFO ] [MAIN ] Update Progress: 190/2372 symbols completed. AWI took 24.2s. Estimated remaining: 4h 40m 50s. Rate: 7.8 symbols/min [2025-09-25T17:24:30.288799] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-25T17:24:30.469578] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:30.506957] [DEBUG] [LOCAL ] AX: Loaded 28543 existing records from primary storage. [2025-09-25T17:24:30.507095] [INFO ] [MAIN ] AX: Loaded 28543 existing records. [2025-09-25T17:24:30.694162] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:30.694805] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-25T17:24:30.694860] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-25T17:24:30.695316] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-25T17:24:30.695408] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-25T17:24:31.081475] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:31.088689] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-25T17:24:31.144935] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T17:24:31.888818] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-25T17:24:32.578100] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T17:24:32.642530] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T17:24:32.688732] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-25T17:24:33.429615] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:24:33.488664] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-25T17:24:34.288691] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-25T17:24:34.607861] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T17:24:35.088739] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-25T17:24:35.357463] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T17:24:35.888724] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-25T17:24:36.656370] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T17:24:36.688712] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-25T17:24:36.939625] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T17:24:37.488740] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-25T17:24:37.897856] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T17:24:38.288773] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-25T17:24:39.088794] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-25T17:24:39.266086] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:24:39.292856] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T17:24:39.888711] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-25T17:24:40.262546] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T17:24:40.688757] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-25T17:24:40.882049] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T17:24:41.488743] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-25T17:24:41.939963] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T17:24:42.288700] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-25T17:24:42.341384] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T17:24:43.088713] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-25T17:24:43.888687] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-25T17:24:43.976889] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T17:24:43.995023] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T17:24:44.000819] [INFO ] [REMOTE ] AWP: Full fetch complete (32528 records). [2025-09-25T17:24:44.000901] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-25T17:24:44.410666] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-25T17:24:44.410766] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-25T17:24:44.411348] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-25T17:24:44.411430] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-25T17:24:44.412320] [DEBUG] [LOCAL ] AWP: Trimmed 32528 records to 21735 (keeping 200 days of data) [2025-09-25T17:24:44.558717] [DEBUG] [LOCAL ] AWP: Primary data saved (21735 records). [2025-09-25T17:24:44.558856] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-25T17:24:44.559581] [INFO ] [MAIN ] Update Progress: 191/2372 symbols completed. AWP took 21.0s. Estimated remaining: 4h 41m 57s. Rate: 7.7 symbols/min [2025-09-25T17:24:44.693899] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-25T17:24:44.745476] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:44.810482] [DEBUG] [LOCAL ] AXL: Loaded 50488 existing records from primary storage. [2025-09-25T17:24:44.810673] [INFO ] [MAIN ] AXL: Loaded 50488 existing records. [2025-09-25T17:24:45.014354] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:45.014817] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-25T17:24:45.014879] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-25T17:24:45.015141] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-25T17:24:45.015200] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-25T17:24:45.412637] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:45.488682] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-25T17:24:45.538293] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:24:45.559611] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T17:24:46.288774] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-25T17:24:47.093843] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-25T17:24:47.122113] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:24:47.346907] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T17:24:47.888695] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-25T17:24:48.688763] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-25T17:24:48.737966] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T17:24:48.809557] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T17:24:49.488784] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-25T17:24:50.158565] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T17:24:50.288690] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-25T17:24:50.796023] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:24:50.805880] [INFO ] [REMOTE ] AWR: Full fetch complete (31843 records). [2025-09-25T17:24:50.805991] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-25T17:24:51.093793] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-25T17:24:51.206402] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-25T17:24:51.206484] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-25T17:24:51.206914] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-25T17:24:51.206977] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-25T17:24:51.207880] [DEBUG] [LOCAL ] AWR: Trimmed 31843 records to 22806 (keeping 200 days of data) [2025-09-25T17:24:51.339016] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T17:24:51.396092] [DEBUG] [LOCAL ] AWR: Primary data saved (22806 records). [2025-09-25T17:24:51.396218] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-25T17:24:51.396327] [INFO ] [MAIN ] Update Progress: 192/2372 symbols completed. AWR took 26.2s. Estimated remaining: 4h 41m 39s. Rate: 7.7 symbols/min [2025-09-25T17:24:51.566893] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:24:51.633534] [DEBUG] [LOCAL ] AXP: Loaded 53254 existing records from primary storage. [2025-09-25T17:24:51.633708] [INFO ] [MAIN ] AXP: Loaded 53254 existing records. [2025-09-25T17:24:51.811756] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:24:51.812028] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-25T17:24:51.812096] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-25T17:24:51.812566] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-25T17:24:51.812680] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-25T17:24:51.893801] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-25T17:24:52.169411] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:24:52.372412] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T17:24:52.688696] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-25T17:24:52.835692] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T17:24:53.488727] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-25T17:24:54.286078] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T17:24:54.290194] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-25T17:24:54.536601] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T17:24:55.088786] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-25T17:24:55.888691] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-25T17:24:56.259837] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:24:56.401155] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-25T17:24:56.688704] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-25T17:24:57.446227] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T17:24:57.488714] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-25T17:24:57.824792] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T17:24:58.288698] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-25T17:24:59.088731] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-25T17:24:59.142073] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T17:24:59.189384] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T17:24:59.888850] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-25T17:25:00.688712] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-25T17:25:00.979556] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T17:25:01.013414] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T17:25:01.027574] [INFO ] [REMOTE ] AWK: Full fetch complete (70507 records). [2025-09-25T17:25:01.027905] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-25T17:25:01.494725] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-25T17:25:01.543301] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-25T17:25:01.543414] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-25T17:25:01.544517] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-25T17:25:01.544685] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-25T17:25:01.546717] [DEBUG] [LOCAL ] AWK: Trimmed 70507 records to 49161 (keeping 200 days of data) [2025-09-25T17:25:01.931860] [DEBUG] [LOCAL ] AWK: Primary data saved (49161 records). [2025-09-25T17:25:01.932038] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-25T17:25:01.932400] [INFO ] [MAIN ] Update Progress: 193/2372 symbols completed. AWK took 42.4s. Estimated remaining: 4h 42m 3s. Rate: 7.7 symbols/min [2025-09-25T17:25:02.137090] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:02.148286] [DEBUG] [LOCAL ] AXR: Loaded 3151 existing records from primary storage. [2025-09-25T17:25:02.148438] [INFO ] [MAIN ] AXR: Loaded 3151 existing records. [2025-09-25T17:25:02.296834] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-25T17:25:02.370732] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:02.370996] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-25T17:25:02.371044] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-25T17:25:02.371323] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-25T17:25:02.371382] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-25T17:25:02.687121] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T17:25:02.976148] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:03.089696] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-25T17:25:03.316091] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T17:25:03.748858] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T17:25:03.755879] [INFO ] [REMOTE ] AX: Full fetch complete (42698 records). [2025-09-25T17:25:03.756017] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-25T17:25:03.897835] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-25T17:25:04.179100] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-25T17:25:04.179177] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-25T17:25:04.179688] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-25T17:25:04.179752] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-25T17:25:04.180693] [DEBUG] [LOCAL ] AX: Trimmed 42698 records to 28738 (keeping 200 days of data) [2025-09-25T17:25:04.351437] [DEBUG] [LOCAL ] AX: Primary data saved (28738 records). [2025-09-25T17:25:04.351570] [INFO ] [MAIN ] AX: Full history saved. [2025-09-25T17:25:04.351680] [INFO ] [MAIN ] Update Progress: 194/2372 symbols completed. AX took 34.1s. Estimated remaining: 4h 40m 55s. Rate: 7.8 symbols/min [2025-09-25T17:25:04.530480] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:04.584717] [DEBUG] [LOCAL ] AXS: Loaded 38308 existing records from primary storage. [2025-09-25T17:25:04.584911] [INFO ] [MAIN ] AXS: Loaded 38308 existing records. [2025-09-25T17:25:04.688685] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-25T17:25:04.800725] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:04.801056] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-25T17:25:04.801103] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-25T17:25:04.801386] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-25T17:25:04.801444] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-25T17:25:04.839631] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T17:25:05.106770] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-25T17:25:05.252734] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:05.488714] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-25T17:25:06.075205] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T17:25:06.252016] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:25:06.288732] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-25T17:25:07.088752] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-25T17:25:07.888750] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-25T17:25:08.150004] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T17:25:08.372575] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T17:25:08.688734] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-25T17:25:09.122604] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-25T17:25:09.488859] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-25T17:25:10.207444] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T17:25:10.288687] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-25T17:25:11.088767] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-25T17:25:11.141142] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:25:11.777555] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T17:25:11.888714] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-25T17:25:11.960225] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T17:25:12.330950] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T17:25:12.688766] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-25T17:25:13.488920] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-25T17:25:14.288706] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-25T17:25:14.933286] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T17:25:15.088819] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-25T17:25:15.097817] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T17:25:15.888741] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-25T17:25:16.130073] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:25:16.519431] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T17:25:16.688722] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-25T17:25:17.007702] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T17:25:17.488824] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-25T17:25:18.288712] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-25T17:25:18.608135] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T17:25:18.621358] [INFO ] [REMOTE ] AXL: Full fetch complete (72501 records). [2025-09-25T17:25:18.621569] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-25T17:25:19.054080] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-25T17:25:19.054198] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-25T17:25:19.054980] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-25T17:25:19.055100] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-25T17:25:19.056744] [DEBUG] [LOCAL ] AXL: Trimmed 72501 records to 50863 (keeping 200 days of data) [2025-09-25T17:25:19.119719] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-25T17:25:19.426489] [DEBUG] [LOCAL ] AXL: Primary data saved (50863 records). [2025-09-25T17:25:19.426677] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-25T17:25:19.426857] [INFO ] [MAIN ] Update Progress: 195/2372 symbols completed. AXL took 34.9s. Estimated remaining: 4h 42m 9s. Rate: 7.7 symbols/min [2025-09-25T17:25:19.527066] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-25T17:25:19.574838] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T17:25:19.652192] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:19.675061] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T17:25:19.737065] [DEBUG] [LOCAL ] AXTA: Loaded 52058 existing records from primary storage. [2025-09-25T17:25:19.737216] [INFO ] [MAIN ] AXTA: Loaded 52058 existing records. [2025-09-25T17:25:19.904590] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-25T17:25:19.962032] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:19.963349] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-25T17:25:19.963416] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-25T17:25:19.963849] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-25T17:25:19.963937] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-25T17:25:20.294173] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-25T17:25:20.385471] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:20.688757] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-25T17:25:21.022284] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-25T17:25:21.488727] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-25T17:25:22.288848] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-25T17:25:23.009809] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T17:25:23.088761] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-25T17:25:23.746933] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T17:25:23.751290] [INFO ] [REMOTE ] AXR: Full fetch complete (5001 records). [2025-09-25T17:25:23.751434] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-25T17:25:23.893952] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-25T17:25:24.187950] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-25T17:25:24.188073] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-25T17:25:24.188286] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-25T17:25:24.188350] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-25T17:25:24.188776] [DEBUG] [LOCAL ] AXR: Trimmed 5001 records to 3174 (keeping 200 days of data) [2025-09-25T17:25:24.210106] [DEBUG] [LOCAL ] AXR: Primary data saved (3174 records). [2025-09-25T17:25:24.210273] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-25T17:25:24.210439] [INFO ] [MAIN ] Update Progress: 196/2372 symbols completed. AXR took 22.3s. Estimated remaining: 4h 41m 28s. Rate: 7.7 symbols/min [2025-09-25T17:25:24.414962] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T17:25:24.480612] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:24.531135] [DEBUG] [LOCAL ] AYI: Loaded 25117 existing records from primary storage. [2025-09-25T17:25:24.531338] [INFO ] [MAIN ] AYI: Loaded 25117 existing records. [2025-09-25T17:25:24.697522] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-25T17:25:24.746702] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:24.746981] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-25T17:25:24.747045] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-25T17:25:24.747366] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-25T17:25:24.747425] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-25T17:25:25.155806] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:25.340316] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T17:25:25.488727] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-25T17:25:26.288799] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-25T17:25:26.754200] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T17:25:26.787233] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T17:25:27.088734] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-25T17:25:27.689096] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T17:25:27.888756] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-25T17:25:28.688779] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-25T17:25:29.067563] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:25:29.156118] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-25T17:25:29.165718] [INFO ] [REMOTE ] AXP: Full fetch complete (76541 records). [2025-09-25T17:25:29.165908] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-25T17:25:29.167054] [FATAL] [VALIDATOR ] AXP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:25:29.167201] [FATAL] [MAIN ] AXP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:25:29.167257] [WARN ] [MAIN ] AXP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:25:29.167335] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-25T17:25:29.167456] [DEBUG] [LOCAL ] AXP: No primary data file found to delete. [2025-09-25T17:25:29.167534] [INFO ] [LOCAL ] AXP: Starting deletion of derivative data. [2025-09-25T17:25:29.168052] [DEBUG] [LOCAL ] AXP: Deleted derivative data file. [2025-09-25T17:25:29.168196] [INFO ] [MAIN ] Update Progress: 197/2372 symbols completed. AXP took 37.8s. Estimated remaining: 4h 40m 50s. Rate: 7.7 symbols/min [2025-09-25T17:25:29.488767] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-25T17:25:30.271450] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T17:25:30.294441] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-25T17:25:30.307786] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T17:25:31.088719] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-25T17:25:31.684834] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T17:25:31.888711] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-25T17:25:32.148863] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T17:25:32.688700] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-25T17:25:33.086493] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:25:33.488720] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-25T17:25:34.271613] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T17:25:34.288669] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-25T17:25:34.905916] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:25:35.088747] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-25T17:25:35.271220] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T17:25:35.888703] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-25T17:25:36.696103] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-25T17:25:36.699413] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T17:25:37.488761] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-25T17:25:37.606056] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:25:38.067911] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T17:25:38.288749] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-25T17:25:38.950021] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T17:25:39.088731] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-25T17:25:39.128315] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T17:25:39.888729] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-25T17:25:40.083798] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-25T17:25:40.679300] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T17:25:40.688719] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-25T17:25:41.488719] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-25T17:25:42.197597] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:25:42.288748] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-25T17:25:42.712603] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:25:42.720291] [INFO ] [REMOTE ] AXS: Full fetch complete (55491 records). [2025-09-25T17:25:42.720471] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-25T17:25:43.093817] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-25T17:25:43.168200] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T17:25:43.189744] [INFO ] [REMOTE ] AYI: Full fetch complete (36691 records). [2025-09-25T17:25:43.189955] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-25T17:25:43.373453] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-25T17:25:43.373563] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-25T17:25:43.374568] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-25T17:25:43.386122] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-25T17:25:43.405712] [DEBUG] [LOCAL ] AXS: Trimmed 55491 records to 38615 (keeping 200 days of data) [2025-09-25T17:25:44.166834] [DEBUG] [LOCAL ] AXS: Primary data saved (38615 records). [2025-09-25T17:25:44.166983] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-25T17:25:44.167102] [INFO ] [MAIN ] Update Progress: 198/2372 symbols completed. AXS took 39.8s. Estimated remaining: 4h 42m 1s. Rate: 7.7 symbols/min [2025-09-25T17:25:44.208370] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-25T17:25:44.208454] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-25T17:25:44.208940] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-25T17:25:44.209009] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-25T17:25:44.210430] [DEBUG] [LOCAL ] AYI: Trimmed 36691 records to 25307 (keeping 200 days of data) [2025-09-25T17:25:44.417831] [DEBUG] [LOCAL ] AYI: Primary data saved (25307 records). [2025-09-25T17:25:44.417976] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-25T17:25:44.418066] [INFO ] [MAIN ] Update Progress: 199/2372 symbols completed. AYI took 20.2s. Estimated remaining: 4h 40m 31s. Rate: 7.7 symbols/min [2025-09-25T17:25:44.825536] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T17:25:44.836909] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-25T17:25:46.562261] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T17:25:46.574667] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-25T17:25:48.262000] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:25:48.275487] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-25T17:25:49.867684] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T17:25:49.880371] [INFO ] [REMOTE ] AXTA: Full fetch complete (74842 records). [2025-09-25T17:25:49.880536] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-25T17:25:50.296985] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-25T17:25:50.297118] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-25T17:25:50.298168] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-25T17:25:50.298241] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-25T17:25:50.303239] [DEBUG] [LOCAL ] AXTA: Trimmed 74842 records to 52445 (keeping 200 days of data) [2025-09-25T17:25:50.652137] [DEBUG] [LOCAL ] AXTA: Primary data saved (52445 records). [2025-09-25T17:25:50.652345] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-25T17:25:50.652461] [INFO ] [MAIN ] Update Progress: 200/2372 symbols completed. AXTA took 31.2s. Estimated remaining: 4h 40m 7s. Rate: 7.8 symbols/min [2025-09-25T17:25:51.389830] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:51.466313] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:51.488060] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:51.509426] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:25:51.509639] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-25T17:25:51.509726] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-25T17:25:51.509990] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-25T17:25:51.510058] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-25T17:25:51.510129] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-25T17:25:51.510177] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-25T17:25:51.597432] [DEBUG] [LOCAL ] AZO: Loaded 11473 existing records from primary storage. [2025-09-25T17:25:51.597690] [INFO ] [MAIN ] AZO: Loaded 11473 existing records. [2025-09-25T17:25:51.613623] [DEBUG] [LOCAL ] AZZ: Loaded 22152 existing records from primary storage. [2025-09-25T17:25:51.614057] [INFO ] [MAIN ] AZZ: Loaded 22152 existing records. [2025-09-25T17:25:51.674754] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-25T17:25:51.674909] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-25T17:25:52.367449] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:52.383477] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-25T17:25:52.383610] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-25T17:25:52.384295] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-25T17:25:52.384366] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-25T17:25:52.375366] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:52.403559] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-25T17:25:52.403615] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-25T17:25:52.403989] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-25T17:25:52.404051] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-25T17:25:52.487874] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:25:52.488222] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-25T17:25:52.488286] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-25T17:25:52.488611] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-25T17:25:52.488718] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-25T17:25:53.201432] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:53.229362] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-25T17:25:53.759098] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:53.759547] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-25T17:25:53.842738] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:53.843050] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-25T17:25:53.865486] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:25:53.865781] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-25T17:25:55.043588] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T17:25:55.054764] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-25T17:25:55.067175] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T17:25:55.070565] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-25T17:25:55.176301] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T17:25:55.183694] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-25T17:25:55.696586] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T17:25:55.699442] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-25T17:25:56.233727] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T17:25:56.242551] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-25T17:25:56.355804] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-25T17:25:56.369217] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-25T17:25:56.378711] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-25T17:25:56.382042] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-25T17:25:56.630546] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:25:56.637471] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-25T17:25:56.844478] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:25:56.845009] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-25T17:25:56.845835] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-25T17:25:57.029364] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T17:25:57.035663] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-25T17:25:57.035080] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:25:57.037065] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-25T17:25:57.422010] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T17:25:57.488712] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-25T17:25:58.106432] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T17:25:58.288710] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-25T17:25:58.306315] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T17:25:58.484043] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T17:25:59.088721] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-25T17:25:59.132970] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T17:25:59.888746] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-25T17:26:00.057753] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-25T17:26:00.688713] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-25T17:26:01.488838] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-25T17:26:01.775058] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T17:26:02.077394] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:26:02.077861] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-25T17:26:02.134960] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-25T17:26:02.288735] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-25T17:26:03.088725] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-25T17:26:03.888698] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-25T17:26:03.982078] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T17:26:04.034513] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T17:26:04.688691] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-25T17:26:04.921418] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:26:05.435796] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-25T17:26:05.488733] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-25T17:26:06.288848] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-25T17:26:06.773014] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T17:26:07.088761] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-25T17:26:07.888774] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-25T17:26:08.505581] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-25T17:26:08.688711] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-25T17:26:08.993339] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T17:26:09.225363] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-25T17:26:09.423558] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T17:26:09.488737] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-25T17:26:10.288765] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-25T17:26:11.088718] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-25T17:26:11.564472] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T17:26:11.569106] [INFO ] [REMOTE ] AZZ: Full fetch complete (30769 records). [2025-09-25T17:26:11.569212] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-25T17:26:11.570317] [FATAL] [VALIDATOR ] AZZ: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:26:11.570441] [FATAL] [MAIN ] AZZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:26:11.570515] [WARN ] [MAIN ] AZZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:26:11.570672] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-25T17:26:11.570830] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-25T17:26:11.570927] [INFO ] [LOCAL ] AZZ: Starting deletion of derivative data. [2025-09-25T17:26:11.571456] [DEBUG] [LOCAL ] AZZ: Deleted derivative data file. [2025-09-25T17:26:11.571620] [INFO ] [MAIN ] Update Progress: 201/2372 symbols completed. AZZ took 20.9s. Estimated remaining: 4h 42m 22s. Rate: 7.7 symbols/min [2025-09-25T17:26:11.774871] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:11.860715] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-25T17:26:11.860901] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-25T17:26:11.894171] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-25T17:26:12.070055] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:12.070462] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-25T17:26:12.070519] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-25T17:26:12.081384] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-25T17:26:12.098941] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-25T17:26:12.172131] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-25T17:26:12.510847] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:12.688679] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-25T17:26:12.858831] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T17:26:12.881536] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T17:26:12.885154] [INFO ] [REMOTE ] AZO: Full fetch complete (16412 records). [2025-09-25T17:26:12.885231] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-25T17:26:13.254967] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-25T17:26:13.255062] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-25T17:26:13.255384] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-25T17:26:13.255460] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-25T17:26:13.256046] [DEBUG] [LOCAL ] AZO: Trimmed 16412 records to 11599 (keeping 200 days of data) [2025-09-25T17:26:13.336857] [DEBUG] [LOCAL ] AZO: Primary data saved (11599 records). [2025-09-25T17:26:13.337031] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-25T17:26:13.337126] [INFO ] [MAIN ] Update Progress: 202/2372 symbols completed. AZO took 22.7s. Estimated remaining: 4h 41m 9s. Rate: 7.7 symbols/min [2025-09-25T17:26:13.514729] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-25T17:26:13.517463] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:13.592384] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-25T17:26:13.592559] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-25T17:26:13.776226] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:13.776519] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-25T17:26:13.776573] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-25T17:26:13.776978] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-25T17:26:13.777040] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-25T17:26:14.138001] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:14.288735] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-25T17:26:14.968603] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-25T17:26:15.088981] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-25T17:26:15.888713] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-25T17:26:16.296329] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T17:26:16.308528] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-25T17:26:16.688733] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-25T17:26:17.495895] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-25T17:26:17.519978] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-25T17:26:18.049800] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T17:26:18.288717] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-25T17:26:19.059848] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-25T17:26:19.088664] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-25T17:26:19.888708] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-25T17:26:19.973480] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-25T17:26:20.696758] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-25T17:26:20.723754] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-25T17:26:21.170072] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T17:26:21.488739] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-25T17:26:21.996601] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-25T17:26:22.010848] [INFO ] [REMOTE ] B: Full fetch complete (45300 records). [2025-09-25T17:26:22.011111] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-25T17:26:22.240522] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-25T17:26:22.242930] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:26:22.243200] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:26:22.243295] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-25T17:26:22.243386] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-25T17:26:22.243438] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-25T17:26:22.243510] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-25T17:26:22.244254] [INFO ] [MAIN ] Update Progress: 203/2372 symbols completed. B took 31.6s. Estimated remaining: 4h 41m 14s. Rate: 7.7 symbols/min [2025-09-25T17:26:22.297743] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-25T17:26:22.457471] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:22.568943] [DEBUG] [LOCAL ] BAH: Loaded 51721 existing records from primary storage. [2025-09-25T17:26:22.569192] [INFO ] [MAIN ] BAH: Loaded 51721 existing records. [2025-09-25T17:26:22.778691] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:22.779036] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-25T17:26:22.779088] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-25T17:26:22.779547] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-25T17:26:22.779610] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-25T17:26:23.048448] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-25T17:26:23.146135] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-25T17:26:23.242542] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:23.485129] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T17:26:23.888741] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-25T17:26:24.688724] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-25T17:26:24.787082] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-25T17:26:25.492865] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-25T17:26:25.509230] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-25T17:26:25.931127] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-25T17:26:26.288741] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-25T17:26:26.947449] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T17:26:26.958193] [INFO ] [REMOTE ] BA: Full fetch complete (77925 records). [2025-09-25T17:26:26.958443] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-25T17:26:27.089147] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-25T17:26:27.428324] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-25T17:26:27.428456] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-25T17:26:27.429540] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-25T17:26:27.429613] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-25T17:26:27.431886] [DEBUG] [LOCAL ] BA: Trimmed 77925 records to 54181 (keeping 200 days of data) [2025-09-25T17:26:27.897436] [DEBUG] [LOCAL ] BA: Primary data saved (54181 records). [2025-09-25T17:26:27.897747] [INFO ] [MAIN ] BA: Full history saved. [2025-09-25T17:26:27.905925] [INFO ] [MAIN ] Update Progress: 204/2372 symbols completed. BA took 37.2s. Estimated remaining: 4h 40m 43s. Rate: 7.7 symbols/min [2025-09-25T17:26:28.038463] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T17:26:28.062129] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-25T17:26:28.206486] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:28.294244] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-25T17:26:28.324505] [DEBUG] [LOCAL ] BAK: Loaded 38810 existing records from primary storage. [2025-09-25T17:26:28.324753] [INFO ] [MAIN ] BAK: Loaded 38810 existing records. [2025-09-25T17:26:28.508050] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:28.509229] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-25T17:26:28.509281] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-25T17:26:28.509620] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-25T17:26:28.509718] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-25T17:26:28.723353] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-25T17:26:28.903096] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:29.488787] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-25T17:26:29.674433] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:26:29.738831] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-25T17:26:30.288740] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-25T17:26:31.087118] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T17:26:31.096177] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-25T17:26:31.201238] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-25T17:26:31.888694] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-25T17:26:32.053506] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T17:26:32.688738] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-25T17:26:33.011474] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T17:26:33.488793] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-25T17:26:33.929269] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-25T17:26:34.289697] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-25T17:26:34.496929] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:26:34.635213] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T17:26:35.088772] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-25T17:26:35.888874] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-25T17:26:36.718313] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-25T17:26:36.764798] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-25T17:26:36.884705] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T17:26:36.930772] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T17:26:37.488723] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-25T17:26:38.288704] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-25T17:26:38.514571] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:26:38.906362] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-25T17:26:39.088740] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-25T17:26:39.888730] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-25T17:26:40.625742] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-25T17:26:40.688680] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-25T17:26:41.079054] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T17:26:41.498239] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-25T17:26:41.526868] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-25T17:26:42.288741] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-25T17:26:42.777774] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-25T17:26:42.995930] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T17:26:43.088769] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-25T17:26:43.888756] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-25T17:26:44.497257] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T17:26:44.688717] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-25T17:26:45.032880] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-25T17:26:45.488814] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-25T17:26:46.075934] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T17:26:46.090134] [INFO ] [REMOTE ] BAC: Full fetch complete (77943 records). [2025-09-25T17:26:46.090321] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-25T17:26:46.291080] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-25T17:26:46.531864] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T17:26:46.672989] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-25T17:26:46.672718] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T17:26:46.681785] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-25T17:26:46.683487] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-25T17:26:46.683635] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-25T17:26:46.685545] [DEBUG] [LOCAL ] BAC: Trimmed 77943 records to 54198 (keeping 200 days of data) [2025-09-25T17:26:47.043310] [DEBUG] [LOCAL ] BAC: Primary data saved (54198 records). [2025-09-25T17:26:47.043522] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-25T17:26:47.043736] [INFO ] [MAIN ] Update Progress: 205/2372 symbols completed. BAC took 33.7s. Estimated remaining: 4h 42m 36s. Rate: 7.7 symbols/min [2025-09-25T17:26:47.094797] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-25T17:26:47.232810] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:47.289504] [DEBUG] [LOCAL ] BALL: Loaded 51811 existing records from primary storage. [2025-09-25T17:26:47.289673] [INFO ] [MAIN ] BALL: Loaded 51811 existing records. [2025-09-25T17:26:47.473744] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:47.474339] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-25T17:26:47.474401] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-25T17:26:47.474798] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-25T17:26:47.474874] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-25T17:26:47.843831] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:47.888679] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-25T17:26:48.484402] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T17:26:48.688695] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-25T17:26:49.122534] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-25T17:26:49.142585] [INFO ] [REMOTE ] BABA: Full fetch complete (77983 records). [2025-09-25T17:26:49.144890] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-25T17:26:49.488174] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T17:26:49.490301] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-25T17:26:49.653899] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-25T17:26:49.653994] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-25T17:26:49.654896] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-25T17:26:49.654964] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-25T17:26:49.656698] [DEBUG] [LOCAL ] BABA: Trimmed 77983 records to 54210 (keeping 200 days of data) [2025-09-25T17:26:50.029288] [DEBUG] [LOCAL ] BABA: Primary data saved (54210 records). [2025-09-25T17:26:50.029475] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-25T17:26:50.029668] [INFO ] [MAIN ] Update Progress: 206/2372 symbols completed. BABA took 38.5s. Estimated remaining: 4h 41m 37s. Rate: 7.7 symbols/min [2025-09-25T17:26:50.165625] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:26:50.248997] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:50.249191] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-25T17:26:50.249228] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-25T17:26:50.249354] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-25T17:26:50.249395] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-25T17:26:50.249436] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-25T17:26:50.249468] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-25T17:26:50.293838] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-25T17:26:50.633921] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:51.084761] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T17:26:51.095722] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-25T17:26:51.102007] [INFO ] [REMOTE ] BAH: Full fetch complete (74831 records). [2025-09-25T17:26:51.102159] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-25T17:26:51.555233] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-25T17:26:51.555347] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-25T17:26:51.556217] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-25T17:26:51.556284] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-25T17:26:51.557878] [DEBUG] [LOCAL ] BAH: Trimmed 74831 records to 52108 (keeping 200 days of data) [2025-09-25T17:26:51.890712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-25T17:26:51.908532] [DEBUG] [LOCAL ] BAH: Primary data saved (52108 records). [2025-09-25T17:26:51.908707] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-25T17:26:51.910628] [INFO ] [MAIN ] Update Progress: 207/2372 symbols completed. BAH took 29.7s. Estimated remaining: 4h 40m 27s. Rate: 7.7 symbols/min [2025-09-25T17:26:52.128059] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T17:26:52.170677] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:52.236869] [DEBUG] [LOCAL ] BAM: Loaded 52001 existing records from primary storage. [2025-09-25T17:26:52.237072] [INFO ] [MAIN ] BAM: Loaded 52001 existing records. [2025-09-25T17:26:52.375050] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T17:26:52.415298] [INFO ] [REMOTE ] BAK: Full fetch complete (56932 records). [2025-09-25T17:26:52.415451] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-25T17:26:52.495752] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:52.550789] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-25T17:26:52.568708] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-25T17:26:52.580718] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-25T17:26:52.580900] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-25T17:26:52.696733] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-25T17:26:52.963999] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T17:26:53.265912] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-25T17:26:53.266009] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-25T17:26:53.266967] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-25T17:26:53.267034] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-25T17:26:53.268392] [DEBUG] [LOCAL ] BAK: Trimmed 56932 records to 39033 (keeping 200 days of data) [2025-09-25T17:26:53.361680] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:53.505688] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-25T17:26:53.548124] [DEBUG] [LOCAL ] BAK: Primary data saved (39033 records). [2025-09-25T17:26:53.548280] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-25T17:26:53.548409] [INFO ] [MAIN ] Update Progress: 208/2372 symbols completed. BAK took 25.6s. Estimated remaining: 4h 39m 16s. Rate: 7.7 symbols/min [2025-09-25T17:26:53.731712] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:26:53.792090] [DEBUG] [LOCAL ] BANC: Loaded 51263 existing records from primary storage. [2025-09-25T17:26:53.792254] [INFO ] [MAIN ] BANC: Loaded 51263 existing records. [2025-09-25T17:26:53.976051] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:26:53.977084] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-25T17:26:53.977147] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-25T17:26:53.977403] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-25T17:26:53.977472] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-25T17:26:54.293859] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-25T17:26:54.369955] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:26:54.516006] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T17:26:54.753347] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T17:26:55.095398] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-25T17:26:55.113050] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T17:26:55.888769] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-25T17:26:56.688712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-25T17:26:56.997663] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T17:26:57.147607] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T17:26:57.452770] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T17:26:57.488717] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-25T17:26:58.288229] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T17:26:58.288985] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-25T17:26:59.088742] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-25T17:26:59.534364] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T17:26:59.597147] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T17:26:59.888737] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-25T17:27:00.688727] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-25T17:27:00.805489] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T17:27:01.488728] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-25T17:27:02.260169] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T17:27:02.288697] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-25T17:27:02.372431] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T17:27:03.088732] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-25T17:27:03.888717] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-25T17:27:03.910380] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T17:27:03.964768] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T17:27:04.688737] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-25T17:27:05.280941] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T17:27:05.488694] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-25T17:27:05.658688] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T17:27:06.288720] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-25T17:27:07.088755] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-25T17:27:07.280255] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T17:27:07.668364] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T17:27:07.888782] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-25T17:27:08.601360] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:27:08.688761] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-25T17:27:08.861720] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T17:27:08.864411] [INFO ] [REMOTE ] BALY: Full fetch complete (17272 records). [2025-09-25T17:27:08.864492] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-25T17:27:09.066146] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T17:27:09.066802] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:27:09.066972] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:27:09.067120] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-25T17:27:09.067331] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-25T17:27:09.067439] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-25T17:27:09.067560] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-25T17:27:09.067763] [INFO ] [MAIN ] Update Progress: 209/2372 symbols completed. BALY took 19.0s. Estimated remaining: 4h 40m 28s. Rate: 7.7 symbols/min [2025-09-25T17:27:09.324790] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:09.367171] [DEBUG] [LOCAL ] BAP: Loaded 26395 existing records from primary storage. [2025-09-25T17:27:09.367429] [INFO ] [MAIN ] BAP: Loaded 26395 existing records. [2025-09-25T17:27:09.493904] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-25T17:27:09.576263] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:09.576744] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-25T17:27:09.576813] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-25T17:27:09.577353] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-25T17:27:09.577420] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-25T17:27:09.949226] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:10.175477] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:27:10.288756] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-25T17:27:11.088799] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-25T17:27:11.179244] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:27:11.888757] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-25T17:27:12.093213] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T17:27:12.570722] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T17:27:12.688710] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-25T17:27:13.488834] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-25T17:27:13.609554] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T17:27:14.284841] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T17:27:14.289543] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-25T17:27:14.730371] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T17:27:15.088832] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-25T17:27:15.893754] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-25T17:27:15.901101] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:27:16.377250] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T17:27:16.688739] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-25T17:27:17.488888] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-25T17:27:17.664004] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:27:17.983356] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T17:27:18.288759] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-25T17:27:19.001226] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:27:19.091685] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-25T17:27:19.564435] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T17:27:19.888759] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-25T17:27:20.623787] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T17:27:20.688692] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-25T17:27:21.488784] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-25T17:27:21.744421] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T17:27:21.764853] [INFO ] [REMOTE ] BALL: Full fetch complete (75381 records). [2025-09-25T17:27:21.765128] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-25T17:27:22.250306] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-25T17:27:22.250514] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-25T17:27:22.251779] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-25T17:27:22.251911] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-25T17:27:22.254302] [DEBUG] [LOCAL ] BALL: Trimmed 75381 records to 52197 (keeping 200 days of data) [2025-09-25T17:27:22.335676] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-25T17:27:22.626309] [DEBUG] [LOCAL ] BALL: Primary data saved (52197 records). [2025-09-25T17:27:22.626505] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-25T17:27:22.626688] [INFO ] [MAIN ] Update Progress: 210/2372 symbols completed. BALL took 35.6s. Estimated remaining: 4h 41m 20s. Rate: 7.7 symbols/min [2025-09-25T17:27:22.712356] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T17:27:22.877490] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:22.926633] [DEBUG] [LOCAL ] BARK: Loaded 38436 existing records from primary storage. [2025-09-25T17:27:22.926827] [INFO ] [MAIN ] BARK: Loaded 38436 existing records. [2025-09-25T17:27:23.119257] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:23.120296] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-25T17:27:23.120365] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-25T17:27:23.089824] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-25T17:27:23.123788] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-25T17:27:23.123927] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-25T17:27:23.467263] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T17:27:23.640752] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:23.741268] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T17:27:23.888722] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-25T17:27:24.482164] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T17:27:24.688705] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-25T17:27:25.275915] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T17:27:25.488793] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-25T17:27:26.288718] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-25T17:27:26.472819] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T17:27:26.487914] [INFO ] [REMOTE ] BAM: Full fetch complete (74137 records). [2025-09-25T17:27:26.488077] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-25T17:27:26.919575] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T17:27:26.977227] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-25T17:27:26.977335] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-25T17:27:26.978226] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-25T17:27:26.978304] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-25T17:27:26.980217] [DEBUG] [LOCAL ] BAM: Trimmed 74137 records to 52391 (keeping 200 days of data) [2025-09-25T17:27:27.097222] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-25T17:27:27.344488] [DEBUG] [LOCAL ] BAM: Primary data saved (52391 records). [2025-09-25T17:27:27.344637] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-25T17:27:27.347086] [INFO ] [MAIN ] Update Progress: 211/2372 symbols completed. BAM took 35.4s. Estimated remaining: 4h 40m 41s. Rate: 7.7 symbols/min [2025-09-25T17:27:27.441432] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:27:27.549216] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:27.613465] [DEBUG] [LOCAL ] BAX: Loaded 53493 existing records from primary storage. [2025-09-25T17:27:27.613620] [INFO ] [MAIN ] BAX: Loaded 53493 existing records. [2025-09-25T17:27:27.792551] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:27.793284] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-25T17:27:27.793351] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-25T17:27:27.793819] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-25T17:27:27.793898] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-25T17:27:27.893797] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-25T17:27:28.172316] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:28.688776] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-25T17:27:28.859670] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T17:27:28.871742] [INFO ] [REMOTE ] BANC: Full fetch complete (74152 records). [2025-09-25T17:27:28.871997] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-25T17:27:29.157807] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:27:29.490349] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-25T17:27:29.529229] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-25T17:27:29.529389] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-25T17:27:29.530331] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-25T17:27:29.530425] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-25T17:27:29.532387] [DEBUG] [LOCAL ] BANC: Trimmed 74152 records to 51644 (keeping 200 days of data) [2025-09-25T17:27:29.895987] [DEBUG] [LOCAL ] BANC: Primary data saved (51644 records). [2025-09-25T17:27:29.896141] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-25T17:27:29.896252] [INFO ] [MAIN ] Update Progress: 212/2372 symbols completed. BANC took 36.3s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-25T17:27:30.074395] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:30.125392] [DEBUG] [LOCAL ] BB: Loaded 52921 existing records from primary storage. [2025-09-25T17:27:30.125565] [INFO ] [MAIN ] BB: Loaded 52921 existing records. [2025-09-25T17:27:30.293723] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-25T17:27:30.318410] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:30.319608] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-25T17:27:30.319689] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-25T17:27:30.319978] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-25T17:27:30.320037] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-25T17:27:30.374303] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:27:30.726595] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:31.088694] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-25T17:27:31.249276] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T17:27:31.392227] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T17:27:31.888721] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-25T17:27:32.276139] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:27:32.688719] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-25T17:27:33.197786] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:27:33.204788] [INFO ] [REMOTE ] BAP: Full fetch complete (37813 records). [2025-09-25T17:27:33.204994] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-25T17:27:33.493844] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-25T17:27:33.613609] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-25T17:27:33.613759] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-25T17:27:33.614608] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-25T17:27:33.614716] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-25T17:27:33.616969] [DEBUG] [LOCAL ] BAP: Trimmed 37813 records to 26518 (keeping 200 days of data) [2025-09-25T17:27:33.815667] [DEBUG] [LOCAL ] BAP: Primary data saved (26518 records). [2025-09-25T17:27:33.816157] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-25T17:27:33.816371] [INFO ] [MAIN ] Update Progress: 213/2372 symbols completed. BAP took 24.7s. Estimated remaining: 4h 38m 53s. Rate: 7.7 symbols/min [2025-09-25T17:27:33.992993] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:34.054183] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-25T17:27:34.054340] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-25T17:27:34.144843] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:27:34.272895] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:34.275080] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-25T17:27:34.275131] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-25T17:27:34.275404] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-25T17:27:34.275485] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-25T17:27:34.294705] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-25T17:27:34.662755] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:35.088707] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-25T17:27:35.304591] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T17:27:35.888706] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-25T17:27:36.276167] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-25T17:27:36.688767] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-25T17:27:37.185051] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T17:27:37.488776] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-25T17:27:37.661753] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-25T17:27:38.288756] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-25T17:27:38.452279] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T17:27:38.798387] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T17:27:39.088739] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-25T17:27:39.888725] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-25T17:27:40.518781] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:27:40.675188] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-25T17:27:40.688675] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-25T17:27:41.439755] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T17:27:41.488687] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-25T17:27:42.288706] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-25T17:27:43.088781] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-25T17:27:43.334791] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-25T17:27:43.377212] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T17:27:43.888847] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-25T17:27:43.991127] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T17:27:44.688741] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-25T17:27:44.941711] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T17:27:45.488708] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-25T17:27:45.664240] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:27:46.288706] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-25T17:27:46.330436] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T17:27:47.088838] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-25T17:27:47.535758] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T17:27:47.888825] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-25T17:27:48.454754] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T17:27:48.688706] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-25T17:27:48.738727] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-25T17:27:49.488732] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-25T17:27:49.797259] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T17:27:49.804520] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T17:27:49.822541] [INFO ] [REMOTE ] BARK: Full fetch complete (56967 records). [2025-09-25T17:27:49.822762] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-25T17:27:50.212974] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-25T17:27:50.213081] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-25T17:27:50.213735] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-25T17:27:50.213840] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-25T17:27:50.215036] [DEBUG] [LOCAL ] BARK: Trimmed 56967 records to 38678 (keeping 200 days of data) [2025-09-25T17:27:50.306820] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-25T17:27:50.458529] [DEBUG] [LOCAL ] BARK: Primary data saved (38678 records). [2025-09-25T17:27:50.458732] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-25T17:27:50.458921] [INFO ] [MAIN ] Update Progress: 214/2372 symbols completed. BARK took 27.8s. Estimated remaining: 4h 40m 15s. Rate: 7.7 symbols/min [2025-09-25T17:27:50.637383] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:27:50.690757] [DEBUG] [LOCAL ] BBAR: Loaded 41302 existing records from primary storage. [2025-09-25T17:27:50.690902] [INFO ] [MAIN ] BBAR: Loaded 41302 existing records. [2025-09-25T17:27:50.875744] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:27:50.876045] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-25T17:27:50.876092] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-25T17:27:50.879001] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-25T17:27:50.879084] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-25T17:27:51.106750] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-25T17:27:51.279809] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:27:51.882178] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-25T17:27:51.893744] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-25T17:27:52.061177] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T17:27:52.688686] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-25T17:27:52.851269] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T17:27:53.267134] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T17:27:53.488792] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-25T17:27:54.288791] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-25T17:27:55.039626] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T17:27:55.088751] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-25T17:27:55.357916] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-25T17:27:55.660020] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T17:27:55.888768] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-25T17:27:56.688812] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-25T17:27:56.898061] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T17:27:57.082463] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T17:27:57.488741] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-25T17:27:58.289348] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-25T17:27:58.936251] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-25T17:27:59.088772] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-25T17:27:59.428072] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T17:27:59.728378] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:27:59.888741] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-25T17:28:00.285103] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T17:28:00.688850] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-25T17:28:01.488889] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-25T17:28:02.248848] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T17:28:02.288702] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-25T17:28:02.747857] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-25T17:28:03.088709] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-25T17:28:03.271607] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T17:28:03.284191] [INFO ] [REMOTE ] BAX: Full fetch complete (77050 records). [2025-09-25T17:28:03.284454] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-25T17:28:03.286984] [FATAL] [VALIDATOR ] BAX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:28:03.288332] [FATAL] [MAIN ] BAX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:28:03.288397] [WARN ] [MAIN ] BAX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:28:03.288508] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-25T17:28:03.288700] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-09-25T17:28:03.288787] [INFO ] [LOCAL ] BAX: Starting deletion of derivative data. [2025-09-25T17:28:03.289483] [DEBUG] [LOCAL ] BAX: Deleted derivative data file. [2025-09-25T17:28:03.291350] [INFO ] [MAIN ] Update Progress: 215/2372 symbols completed. BAX took 35.9s. Estimated remaining: 4h 40m 57s. Rate: 7.7 symbols/min [2025-09-25T17:28:03.511063] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:03.636699] [DEBUG] [LOCAL ] BBD: Loaded 53181 existing records from primary storage. [2025-09-25T17:28:03.636971] [INFO ] [MAIN ] BBD: Loaded 53181 existing records. [2025-09-25T17:28:03.837425] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:03.838444] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-25T17:28:03.838502] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-25T17:28:03.838967] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-25T17:28:03.839044] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-25T17:28:03.919750] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-25T17:28:04.220071] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T17:28:04.340914] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:04.480681] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T17:28:04.688816] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-25T17:28:05.488734] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-25T17:28:06.288702] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-25T17:28:06.569014] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-25T17:28:06.617424] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T17:28:07.088681] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-25T17:28:07.280915] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T17:28:07.683624] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T17:28:07.888737] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-25T17:28:08.688725] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-25T17:28:09.488745] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-25T17:28:09.663168] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T17:28:09.676397] [INFO ] [REMOTE ] BB: Full fetch complete (76982 records). [2025-09-25T17:28:09.676562] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-25T17:28:09.989144] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T17:28:10.202348] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-25T17:28:10.202444] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-25T17:28:10.203287] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-25T17:28:10.203355] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-25T17:28:10.208413] [DEBUG] [LOCAL ] BB: Trimmed 76982 records to 53311 (keeping 200 days of data) [2025-09-25T17:28:10.208297] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (3.12 seconds). [2025-09-25T17:28:10.230327] [INFO ] [REMOTE ] BBAI: Full fetch complete (77999 records). [2025-09-25T17:28:10.230485] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-25T17:28:10.297687] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-25T17:28:10.983835] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:28:11.062285] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-25T17:28:11.063325] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-25T17:28:11.065403] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-25T17:28:11.065913] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-25T17:28:11.069754] [DEBUG] [LOCAL ] BBAI: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-09-25T17:28:11.143700] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-25T17:28:11.180310] [DEBUG] [LOCAL ] BB: Primary data saved (53311 records). [2025-09-25T17:28:11.180488] [INFO ] [MAIN ] BB: Full history saved. [2025-09-25T17:28:11.180630] [INFO ] [MAIN ] Update Progress: 216/2372 symbols completed. BB took 41.3s. Estimated remaining: 4h 40m 50s. Rate: 7.7 symbols/min [2025-09-25T17:28:11.410425] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:11.643837] [DEBUG] [LOCAL ] BBAI: Primary data saved (54210 records). [2025-09-25T17:28:11.643994] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-25T17:28:11.644113] [INFO ] [MAIN ] Update Progress: 217/2372 symbols completed. BBAI took 37.8s. Estimated remaining: 4h 39m 29s. Rate: 7.7 symbols/min [2025-09-25T17:28:11.700839] [DEBUG] [LOCAL ] BBDC: Loaded 33300 existing records from primary storage. [2025-09-25T17:28:11.701028] [INFO ] [MAIN ] BBDC: Loaded 33300 existing records. [2025-09-25T17:28:11.820357] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T17:28:11.907022] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-25T17:28:12.037398] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:12.081063] [DEBUG] [LOCAL ] BBDO: Loaded 5017 existing records from primary storage. [2025-09-25T17:28:12.081236] [INFO ] [MAIN ] BBDO: Loaded 5017 existing records. [2025-09-25T17:28:12.172479] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:12.172774] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-25T17:28:12.172826] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-25T17:28:12.173114] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-25T17:28:12.173173] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-25T17:28:12.430840] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:12.431530] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-25T17:28:12.431578] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-25T17:28:12.431817] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-25T17:28:12.434722] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-25T17:28:12.841543] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T17:28:12.872109] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-25T17:28:13.004822] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:13.142864] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:13.488698] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-25T17:28:13.543175] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T17:28:14.288737] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-25T17:28:14.730390] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T17:28:14.741112] [INFO ] [REMOTE ] BBAR: Full fetch complete (60670 records). [2025-09-25T17:28:14.741234] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-25T17:28:15.093822] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-25T17:28:15.282235] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T17:28:15.311613] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-25T17:28:15.311701] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-25T17:28:15.312452] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-25T17:28:15.312499] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-25T17:28:15.313934] [DEBUG] [LOCAL ] BBAR: Trimmed 60670 records to 41667 (keeping 200 days of data) [2025-09-25T17:28:15.589871] [DEBUG] [LOCAL ] BBAR: Primary data saved (41667 records). [2025-09-25T17:28:15.590041] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-25T17:28:15.590160] [INFO ] [MAIN ] Update Progress: 218/2372 symbols completed. BBAR took 25.1s. Estimated remaining: 4h 38m 44s. Rate: 7.7 symbols/min [2025-09-25T17:28:15.786921] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:15.808781] [DEBUG] [LOCAL ] BBN: Loaded 17983 existing records from primary storage. [2025-09-25T17:28:15.809022] [INFO ] [MAIN ] BBN: Loaded 17983 existing records. [2025-09-25T17:28:15.893847] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-25T17:28:15.993103] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T17:28:16.038298] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:16.040481] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-25T17:28:16.040533] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-25T17:28:16.040891] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-25T17:28:16.040972] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-25T17:28:16.133682] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:28:16.446012] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:16.688776] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-25T17:28:17.154007] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T17:28:17.488745] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-25T17:28:17.985732] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T17:28:18.288733] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-25T17:28:18.372532] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T17:28:19.088796] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-25T17:28:19.240950] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T17:28:19.888820] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-25T17:28:20.688709] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-25T17:28:20.803763] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T17:28:20.808907] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T17:28:21.488722] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-25T17:28:21.655811] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T17:28:22.288768] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-25T17:28:23.088732] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-25T17:28:23.227120] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T17:28:23.311271] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T17:28:23.888721] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-25T17:28:24.545495] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:28:24.652946] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T17:28:24.688682] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-25T17:28:25.488832] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-25T17:28:26.288824] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-25T17:28:26.421862] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:28:26.473961] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T17:28:26.781328] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T17:28:27.088716] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-25T17:28:27.888747] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-25T17:28:28.688745] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-25T17:28:28.704215] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T17:28:28.810910] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T17:28:29.289832] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T17:28:29.488765] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-25T17:28:30.288690] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-25T17:28:30.354188] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T17:28:31.088745] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-25T17:28:31.888712] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-25T17:28:32.027043] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T17:28:32.039345] [INFO ] [REMOTE ] BBD: Full fetch complete (77120 records). [2025-09-25T17:28:32.039545] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-25T17:28:32.506056] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-25T17:28:32.506353] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-25T17:28:32.507199] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-25T17:28:32.508185] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-25T17:28:32.509958] [DEBUG] [LOCAL ] BBD: Trimmed 77120 records to 53571 (keeping 200 days of data) [2025-09-25T17:28:32.596528] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T17:28:32.664615] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T17:28:32.696713] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-25T17:28:32.918564] [DEBUG] [LOCAL ] BBD: Primary data saved (53571 records). [2025-09-25T17:28:32.918766] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-25T17:28:32.920666] [INFO ] [MAIN ] Update Progress: 219/2372 symbols completed. BBD took 29.6s. Estimated remaining: 4h 40m 10s. Rate: 7.7 symbols/min [2025-09-25T17:28:33.107880] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:33.108084] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-25T17:28:33.108141] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-25T17:28:33.108891] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-25T17:28:33.108957] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-25T17:28:33.109032] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-25T17:28:33.109094] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-25T17:28:33.223153] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T17:28:33.495813] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-25T17:28:33.501229] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:34.288740] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-25T17:28:34.497332] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:34.498062] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-25T17:28:34.718803] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:28:35.088719] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-25T17:28:35.715168] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T17:28:35.888751] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-25T17:28:36.109919] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:36.110252] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-25T17:28:36.688727] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-25T17:28:36.904685] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:36.904996] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-25T17:28:37.488766] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-25T17:28:38.288732] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-25T17:28:39.032446] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T17:28:39.088695] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-25T17:28:39.126843] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T17:28:39.849497] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T17:28:39.888671] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-25T17:28:40.688724] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-25T17:28:40.810494] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:28:40.817020] [INFO ] [REMOTE ] BBN: Full fetch complete (26832 records). [2025-09-25T17:28:40.817185] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-25T17:28:40.929830] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:40.941568] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-25T17:28:41.217626] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-25T17:28:41.217739] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-25T17:28:41.218174] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-25T17:28:41.218216] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-25T17:28:41.218945] [DEBUG] [LOCAL ] BBN: Trimmed 26832 records to 18100 (keeping 200 days of data) [2025-09-25T17:28:41.337840] [DEBUG] [LOCAL ] BBN: Primary data saved (18100 records). [2025-09-25T17:28:41.337987] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-25T17:28:41.338110] [INFO ] [MAIN ] Update Progress: 220/2372 symbols completed. BBN took 25.7s. Estimated remaining: 4h 40m 8s. Rate: 7.7 symbols/min [2025-09-25T17:28:41.490772] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-25T17:28:41.515426] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:41.525312] [DEBUG] [LOCAL ] BBU: Loaded 4110 existing records from primary storage. [2025-09-25T17:28:41.525452] [INFO ] [MAIN ] BBU: Loaded 4110 existing records. [2025-09-25T17:28:41.705251] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:41.705561] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-25T17:28:41.705613] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-25T17:28:41.705994] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-25T17:28:41.706054] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-25T17:28:41.980868] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T17:28:42.071272] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:42.288718] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-25T17:28:42.476911] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:42.477257] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-25T17:28:43.088726] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-25T17:28:43.888678] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-25T17:28:44.352296] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:28:44.561024] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T17:28:44.562517] [INFO ] [REMOTE ] BBDO: Full fetch complete (7697 records). [2025-09-25T17:28:44.562602] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-25T17:28:44.694854] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-25T17:28:44.988589] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-25T17:28:44.988696] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-25T17:28:44.988963] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-25T17:28:44.989069] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-25T17:28:44.989491] [DEBUG] [LOCAL ] BBDO: Trimmed 7697 records to 5030 (keeping 200 days of data) [2025-09-25T17:28:45.032134] [DEBUG] [LOCAL ] BBDO: Primary data saved (5030 records). [2025-09-25T17:28:45.032275] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-25T17:28:45.032403] [INFO ] [MAIN ] Update Progress: 221/2372 symbols completed. BBDO took 33.4s. Estimated remaining: 4h 39m 20s. Rate: 7.7 symbols/min [2025-09-25T17:28:45.208680] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:45.230588] [DEBUG] [LOCAL ] BBUC: Loaded 13112 existing records from primary storage. [2025-09-25T17:28:45.230783] [INFO ] [MAIN ] BBUC: Loaded 13112 existing records. [2025-09-25T17:28:45.417036] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:45.417750] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-25T17:28:45.417807] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-25T17:28:45.418028] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-25T17:28:45.418089] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-25T17:28:45.496720] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-25T17:28:45.757447] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:45.757801] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-25T17:28:45.814901] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:46.025600] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T17:28:46.288707] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-25T17:28:46.523313] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:46.523680] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-25T17:28:47.088740] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-25T17:28:47.660290] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T17:28:47.888898] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-25T17:28:48.479527] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T17:28:48.688908] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-25T17:28:49.225012] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-25T17:28:49.488760] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-25T17:28:49.701931] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:49.702264] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-25T17:28:50.288791] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-25T17:28:51.088873] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-25T17:28:51.296900] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:28:51.297380] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-25T17:28:51.492205] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T17:28:51.500256] [INFO ] [REMOTE ] BBDC: Full fetch complete (48931 records). [2025-09-25T17:28:51.500497] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-25T17:28:51.890189] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-25T17:28:51.942826] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-25T17:28:51.942901] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-25T17:28:51.943504] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-25T17:28:51.943601] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-25T17:28:51.944758] [DEBUG] [LOCAL ] BBDC: Trimmed 48931 records to 33540 (keeping 200 days of data) [2025-09-25T17:28:52.162376] [DEBUG] [LOCAL ] BBDC: Primary data saved (33540 records). [2025-09-25T17:28:52.162532] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-25T17:28:52.162673] [INFO ] [MAIN ] Update Progress: 222/2372 symbols completed. BBDC took 41.0s. Estimated remaining: 4h 39m 6s. Rate: 7.7 symbols/min [2025-09-25T17:28:52.344172] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:52.424259] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-25T17:28:52.429206] [DEBUG] [LOCAL ] BBVA: Loaded 49477 existing records from primary storage. [2025-09-25T17:28:52.429417] [INFO ] [MAIN ] BBVA: Loaded 49477 existing records. [2025-09-25T17:28:52.615238] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:52.617033] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-25T17:28:52.617110] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-25T17:28:52.617907] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-25T17:28:52.617979] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-25T17:28:52.694733] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-25T17:28:52.992906] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:53.488818] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-25T17:28:54.085141] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T17:28:54.097699] [INFO ] [REMOTE ] BBT: Full fetch complete (5349 records). [2025-09-25T17:28:54.097868] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-25T17:28:54.294716] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-25T17:28:54.349054] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 18 unique days, need 200 days [2025-09-25T17:28:54.350183] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:28:54.350303] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:28:54.350598] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-25T17:28:54.350738] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-25T17:28:54.350813] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-25T17:28:54.350899] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-25T17:28:54.351022] [INFO ] [MAIN ] Update Progress: 223/2372 symbols completed. BBT took 21.4s. Estimated remaining: 4h 38m 4s. Rate: 7.7 symbols/min [2025-09-25T17:28:54.560483] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:28:54.621864] [DEBUG] [LOCAL ] BBW: Loaded 26707 existing records from primary storage. [2025-09-25T17:28:54.622039] [INFO ] [MAIN ] BBW: Loaded 26707 existing records. [2025-09-25T17:28:54.816856] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:28:54.817499] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-25T17:28:54.817551] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-25T17:28:54.817962] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-25T17:28:54.818243] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-25T17:28:54.887553] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T17:28:54.966418] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T17:28:55.093868] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-25T17:28:55.274267] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:28:55.888810] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-25T17:28:56.673562] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T17:28:56.688701] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-25T17:28:56.889155] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T17:28:57.241390] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T17:28:57.488859] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-25T17:28:58.005067] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-25T17:28:58.288855] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-25T17:28:59.088811] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-25T17:28:59.432553] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T17:28:59.888739] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-25T17:29:00.218625] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-25T17:29:00.688778] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-25T17:29:01.013015] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T17:29:01.488763] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-25T17:29:01.650291] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T17:29:02.003547] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T17:29:02.288757] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-25T17:29:03.088757] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-25T17:29:03.120489] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T17:29:03.888724] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-25T17:29:04.293945] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T17:29:04.688698] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-25T17:29:04.738874] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:29:05.488760] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-25T17:29:05.949217] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T17:29:06.223514] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T17:29:06.288720] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-25T17:29:06.734916] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T17:29:07.088722] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-25T17:29:07.884875] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T17:29:07.888927] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-25T17:29:08.672973] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T17:29:08.677181] [INFO ] [REMOTE ] BBUC: Full fetch complete (17554 records). [2025-09-25T17:29:08.677340] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-25T17:29:08.695952] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-25T17:29:09.118319] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-25T17:29:09.118482] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-25T17:29:09.118952] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-25T17:29:09.119043] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-25T17:29:09.120188] [DEBUG] [LOCAL ] BBUC: Trimmed 17554 records to 13336 (keeping 200 days of data) [2025-09-25T17:29:09.225964] [DEBUG] [LOCAL ] BBUC: Primary data saved (13336 records). [2025-09-25T17:29:09.226171] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-25T17:29:09.226545] [INFO ] [MAIN ] Update Progress: 224/2372 symbols completed. BBUC took 24.2s. Estimated remaining: 4h 39m 5s. Rate: 7.7 symbols/min [2025-09-25T17:29:09.434445] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:09.489700] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-25T17:29:09.520559] [DEBUG] [LOCAL ] BBWI: Loaded 53580 existing records from primary storage. [2025-09-25T17:29:09.520751] [INFO ] [MAIN ] BBWI: Loaded 53580 existing records. [2025-09-25T17:29:09.732410] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:29:09.733079] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-25T17:29:09.733153] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-25T17:29:09.733540] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-25T17:29:09.733617] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-25T17:29:10.142709] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:10.288717] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-25T17:29:10.447864] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:29:10.518208] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:29:11.061950] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T17:29:11.088730] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-25T17:29:11.888722] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-25T17:29:12.381547] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T17:29:12.622927] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T17:29:12.688717] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-25T17:29:13.488757] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-25T17:29:13.520258] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T17:29:13.522451] [INFO ] [REMOTE ] BBU: Full fetch complete (6312 records). [2025-09-25T17:29:13.522537] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-25T17:29:13.944769] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-25T17:29:13.944883] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-25T17:29:13.945166] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-25T17:29:13.945208] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-25T17:29:13.945727] [DEBUG] [LOCAL ] BBU: Trimmed 6312 records to 4332 (keeping 200 days of data) [2025-09-25T17:29:13.978364] [DEBUG] [LOCAL ] BBU: Primary data saved (4332 records). [2025-09-25T17:29:13.978504] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-25T17:29:13.978604] [INFO ] [MAIN ] Update Progress: 225/2372 symbols completed. BBU took 32.6s. Estimated remaining: 4h 38m 28s. Rate: 7.7 symbols/min [2025-09-25T17:29:14.162454] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:14.239489] [DEBUG] [LOCAL ] BBY: Loaded 53480 existing records from primary storage. [2025-09-25T17:29:14.239721] [INFO ] [MAIN ] BBY: Loaded 53480 existing records. [2025-09-25T17:29:14.296824] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-25T17:29:14.457525] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:29:14.458723] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-25T17:29:14.458790] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-25T17:29:14.459125] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-25T17:29:14.459196] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-25T17:29:14.865188] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:15.088742] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-25T17:29:15.366109] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T17:29:15.888811] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-25T17:29:16.126690] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:29:16.178162] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T17:29:16.688744] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-25T17:29:17.488726] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-25T17:29:17.599370] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T17:29:17.624825] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T17:29:18.288725] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-25T17:29:19.088740] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-25T17:29:19.559154] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-25T17:29:19.888779] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-25T17:29:20.126846] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T17:29:20.688699] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-25T17:29:20.764499] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T17:29:20.920880] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T17:29:21.488767] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-25T17:29:22.288858] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-25T17:29:22.443737] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T17:29:22.915401] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T17:29:23.088747] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-25T17:29:23.899432] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-25T17:29:23.916082] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T17:29:23.923759] [INFO ] [REMOTE ] BBW: Full fetch complete (39122 records). [2025-09-25T17:29:23.923929] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-25T17:29:24.372123] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-25T17:29:24.372290] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-25T17:29:24.373183] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-25T17:29:24.373396] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-25T17:29:24.381488] [DEBUG] [LOCAL ] BBW: Trimmed 39122 records to 26921 (keeping 200 days of data) [2025-09-25T17:29:24.629978] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T17:29:24.656771] [DEBUG] [LOCAL ] BBW: Primary data saved (26921 records). [2025-09-25T17:29:24.656908] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-25T17:29:24.657094] [INFO ] [MAIN ] Update Progress: 226/2372 symbols completed. BBW took 30.3s. Estimated remaining: 4h 38m 48s. Rate: 7.7 symbols/min [2025-09-25T17:29:24.690108] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-25T17:29:25.042466] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:25.106547] [DEBUG] [LOCAL ] BC: Loaded 44422 existing records from primary storage. [2025-09-25T17:29:25.106746] [INFO ] [MAIN ] BC: Loaded 44422 existing records. [2025-09-25T17:29:25.317245] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:29:25.317898] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-25T17:29:25.317951] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-25T17:29:25.318441] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-25T17:29:25.318503] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-25T17:29:25.405931] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T17:29:25.502593] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-25T17:29:25.731475] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:26.288702] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-25T17:29:26.677561] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T17:29:27.088717] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-25T17:29:27.523729] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T17:29:27.576423] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T17:29:27.888770] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-25T17:29:28.688794] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-25T17:29:28.857778] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T17:29:29.488741] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-25T17:29:29.844787] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T17:29:30.288847] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-25T17:29:30.450301] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T17:29:31.093783] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-25T17:29:31.116969] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T17:29:31.888738] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-25T17:29:32.266226] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T17:29:32.641211] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T17:29:32.688844] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-25T17:29:33.488888] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-25T17:29:33.639268] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T17:29:34.288741] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-25T17:29:34.584791] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T17:29:35.089755] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-25T17:29:35.217484] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T17:29:35.574540] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T17:29:35.888699] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-25T17:29:36.688735] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-25T17:29:36.741344] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T17:29:37.488746] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-25T17:29:37.784138] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T17:29:37.794280] [INFO ] [REMOTE ] BBWI: Full fetch complete (77415 records). [2025-09-25T17:29:37.794441] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-25T17:29:38.243605] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-25T17:29:38.243849] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-25T17:29:38.244730] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-25T17:29:38.244807] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-25T17:29:38.246665] [DEBUG] [LOCAL ] BBWI: Trimmed 77415 records to 53970 (keeping 200 days of data) [2025-09-25T17:29:38.333734] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-25T17:29:38.413568] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T17:29:38.731112] [DEBUG] [LOCAL ] BBWI: Primary data saved (53970 records). [2025-09-25T17:29:38.731363] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-25T17:29:38.731509] [INFO ] [MAIN ] Update Progress: 227/2372 symbols completed. BBWI took 29.5s. Estimated remaining: 4h 39m 39s. Rate: 7.7 symbols/min [2025-09-25T17:29:38.922799] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:38.923014] [DEBUG] [LOCAL ] BCAT: No existing data file found in primary storage. [2025-09-25T17:29:38.923071] [WARN ] [MAIN ] BCAT: No existing data found, performing full refresh instead. [2025-09-25T17:29:38.923356] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-25T17:29:38.923422] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-25T17:29:38.923619] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-25T17:29:38.923717] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-25T17:29:39.077701] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T17:29:39.122316] [INFO ] [REMOTE ] BBVA: Full fetch complete (71595 records). [2025-09-25T17:29:39.122557] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-25T17:29:39.096776] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-25T17:29:39.636147] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:39.802998] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-25T17:29:39.803136] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-25T17:29:39.804034] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-25T17:29:39.804112] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-25T17:29:39.808547] [DEBUG] [LOCAL ] BBVA: Trimmed 71595 records to 49832 (keeping 200 days of data) [2025-09-25T17:29:39.894023] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-25T17:29:40.114104] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T17:29:40.219104] [DEBUG] [LOCAL ] BBVA: Primary data saved (49832 records). [2025-09-25T17:29:40.219333] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-25T17:29:40.219485] [INFO ] [MAIN ] Update Progress: 228/2372 symbols completed. BBVA took 48.1s. Estimated remaining: 4h 38m 32s. Rate: 7.7 symbols/min [2025-09-25T17:29:40.409562] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:40.457400] [DEBUG] [LOCAL ] BCC: Loaded 28355 existing records from primary storage. [2025-09-25T17:29:40.457609] [INFO ] [MAIN ] BCC: Loaded 28355 existing records. [2025-09-25T17:29:40.643065] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:29:40.645426] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-25T17:29:40.645538] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-25T17:29:40.645875] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-25T17:29:40.645935] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-25T17:29:40.713770] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-25T17:29:41.061584] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:41.216158] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-25T17:29:41.250011] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T17:29:41.488736] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-25T17:29:42.307709] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-25T17:29:42.313129] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T17:29:42.523239] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T17:29:43.088711] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-25T17:29:43.470426] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T17:29:43.888732] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-25T17:29:44.688683] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-25T17:29:45.047503] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T17:29:45.054020] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T17:29:45.071458] [INFO ] [REMOTE ] BBY: Full fetch complete (77250 records). [2025-09-25T17:29:45.071597] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-25T17:29:45.476615] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-25T17:29:45.476729] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-25T17:29:45.477503] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-25T17:29:45.477547] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-25T17:29:45.479050] [DEBUG] [LOCAL ] BBY: Trimmed 77250 records to 53868 (keeping 200 days of data) [2025-09-25T17:29:45.488740] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-25T17:29:45.837740] [DEBUG] [LOCAL ] BBY: Primary data saved (53868 records). [2025-09-25T17:29:45.837890] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-25T17:29:45.837992] [INFO ] [MAIN ] Update Progress: 229/2372 symbols completed. BBY took 31.9s. Estimated remaining: 4h 38m 4s. Rate: 7.7 symbols/min [2025-09-25T17:29:45.984895] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T17:29:46.040561] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:29:46.102673] [DEBUG] [LOCAL ] BCE: Loaded 52340 existing records from primary storage. [2025-09-25T17:29:46.102830] [INFO ] [MAIN ] BCE: Loaded 52340 existing records. [2025-09-25T17:29:46.286941] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:29:46.287271] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-25T17:29:46.287316] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-25T17:29:46.287776] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-25T17:29:46.287836] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-25T17:29:46.293252] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-25T17:29:46.665962] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:29:47.088730] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-25T17:29:47.224818] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T17:29:47.613596] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:29:47.888692] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-25T17:29:48.272186] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:29:48.688724] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-25T17:29:48.879991] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T17:29:49.488709] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-25T17:29:49.867261] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T17:29:50.288723] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-25T17:29:51.088719] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-25T17:29:51.467541] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-25T17:29:51.888687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-25T17:29:51.978320] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T17:29:52.563741] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T17:29:52.688730] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-25T17:29:53.333900] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T17:29:53.488739] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-25T17:29:53.771722] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T17:29:54.288713] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-25T17:29:54.976742] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T17:29:55.088687] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-25T17:29:55.458198] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:29:55.888766] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-25T17:29:56.688743] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-25T17:29:56.908460] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T17:29:57.230637] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T17:29:57.488754] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-25T17:29:58.154126] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T17:29:58.288766] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-25T17:29:58.400955] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T17:29:59.088738] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-25T17:29:59.788790] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:29:59.888767] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-25T17:30:00.675673] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T17:30:00.688669] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-25T17:30:01.096367] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T17:30:01.488755] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-25T17:30:02.288895] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-25T17:30:02.540091] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T17:30:03.100757] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-25T17:30:03.100553] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T17:30:03.115613] [INFO ] [REMOTE ] BCAT: Full fetch complete (49707 records). [2025-09-25T17:30:03.115947] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-25T17:30:03.117461] [FATAL] [VALIDATOR ] BCAT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:30:03.117975] [FATAL] [MAIN ] BCAT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:30:03.118095] [WARN ] [MAIN ] BCAT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:30:03.118232] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-25T17:30:03.118351] [DEBUG] [LOCAL ] BCAT: No primary data file found to delete. [2025-09-25T17:30:03.118435] [INFO ] [LOCAL ] BCAT: Starting deletion of derivative data. [2025-09-25T17:30:03.118519] [DEBUG] [LOCAL ] BCAT: No derivative data file found to delete. [2025-09-25T17:30:03.118697] [INFO ] [MAIN ] Update Progress: 230/2372 symbols completed. BCAT took 24.4s. Estimated remaining: 4h 39m 24s. Rate: 7.7 symbols/min [2025-09-25T17:30:03.358596] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:03.358939] [DEBUG] [LOCAL ] BCH: No existing data file found in primary storage. [2025-09-25T17:30:03.358999] [WARN ] [MAIN ] BCH: No existing data found, performing full refresh instead. [2025-09-25T17:30:03.359334] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-25T17:30:03.359390] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-25T17:30:03.359437] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-25T17:30:03.359565] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-25T17:30:03.762738] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T17:30:03.853243] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:03.888725] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-25T17:30:04.688730] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-25T17:30:05.088189] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T17:30:05.426903] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:30:05.488749] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-25T17:30:06.269956] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T17:30:06.288693] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-25T17:30:06.699271] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T17:30:07.088840] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-25T17:30:07.678575] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T17:30:07.888806] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-25T17:30:08.351759] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T17:30:08.688740] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-25T17:30:09.488776] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-25T17:30:09.718798] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T17:30:09.728220] [INFO ] [REMOTE ] BC: Full fetch complete (63818 records). [2025-09-25T17:30:09.728521] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-25T17:30:10.220742] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-25T17:30:10.220861] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-25T17:30:10.221676] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-25T17:30:10.221779] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-25T17:30:10.239514] [DEBUG] [LOCAL ] BC: Trimmed 63818 records to 44723 (keeping 200 days of data) [2025-09-25T17:30:10.294733] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-25T17:30:10.299065] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:30:10.313101] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T17:30:10.632658] [DEBUG] [LOCAL ] BC: Primary data saved (44723 records). [2025-09-25T17:30:10.632893] [INFO ] [MAIN ] BC: Full history saved. [2025-09-25T17:30:10.635871] [INFO ] [MAIN ] Update Progress: 231/2372 symbols completed. BC took 46.0s. Estimated remaining: 4h 39m 14s. Rate: 7.7 symbols/min [2025-09-25T17:30:10.818622] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:10.854723] [DEBUG] [LOCAL ] BCO: Loaded 26443 existing records from primary storage. [2025-09-25T17:30:10.854859] [INFO ] [MAIN ] BCO: Loaded 26443 existing records. [2025-09-25T17:30:11.037788] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:30:11.039515] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-25T17:30:11.039572] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-25T17:30:11.039886] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-25T17:30:11.039954] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-25T17:30:11.090251] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-25T17:30:11.404801] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:11.888694] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-25T17:30:12.165068] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T17:30:12.171148] [INFO ] [REMOTE ] BCC: Full fetch complete (40376 records). [2025-09-25T17:30:12.171277] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-25T17:30:12.599077] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-25T17:30:12.599206] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-25T17:30:12.599847] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-25T17:30:12.599912] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-25T17:30:12.601117] [DEBUG] [LOCAL ] BCC: Trimmed 40376 records to 28556 (keeping 200 days of data) [2025-09-25T17:30:12.709281] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-25T17:30:12.808921] [DEBUG] [LOCAL ] BCC: Primary data saved (28556 records). [2025-09-25T17:30:12.809072] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-25T17:30:12.809178] [INFO ] [MAIN ] Update Progress: 232/2372 symbols completed. BCC took 32.6s. Estimated remaining: 4h 38m 14s. Rate: 7.7 symbols/min [2025-09-25T17:30:12.888680] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T17:30:13.037964] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:13.038151] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-25T17:30:13.038208] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-25T17:30:13.038331] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-25T17:30:13.038392] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-25T17:30:13.038454] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-25T17:30:13.038499] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-25T17:30:13.092475] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T17:30:13.120423] [INFO ] [REMOTE ] BCE: Full fetch complete (76124 records). [2025-09-25T17:30:13.120597] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-25T17:30:13.491104] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-25T17:30:13.921029] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:13.996026] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-25T17:30:13.996155] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-25T17:30:13.997159] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-25T17:30:13.997241] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-25T17:30:13.999357] [DEBUG] [LOCAL ] BCE: Trimmed 76124 records to 52712 (keeping 200 days of data) [2025-09-25T17:30:14.290265] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-25T17:30:14.338927] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:30:14.444892] [DEBUG] [LOCAL ] BCE: Primary data saved (52712 records). [2025-09-25T17:30:14.445062] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-25T17:30:14.445243] [INFO ] [MAIN ] Update Progress: 233/2372 symbols completed. BCE took 28.6s. Estimated remaining: 4h 37m 9s. Rate: 7.7 symbols/min [2025-09-25T17:30:14.629175] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:14.664118] [DEBUG] [LOCAL ] BCSF: Loaded 27844 existing records from primary storage. [2025-09-25T17:30:14.664458] [INFO ] [MAIN ] BCSF: Loaded 27844 existing records. [2025-09-25T17:30:14.849609] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T17:30:14.893195] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:30:14.893424] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-25T17:30:14.893481] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-25T17:30:14.894549] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-25T17:30:14.894613] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-25T17:30:15.094011] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-25T17:30:15.297699] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:15.888785] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-25T17:30:16.327709] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-25T17:30:16.688718] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-25T17:30:16.716337] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T17:30:16.789390] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T17:30:17.488714] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-25T17:30:18.288730] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-25T17:30:18.766094] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T17:30:19.088696] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-25T17:30:19.424325] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T17:30:19.841238] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (3.15 seconds). [2025-09-25T17:30:19.888683] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-25T17:30:20.187869] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T17:30:20.688706] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-25T17:30:20.772028] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T17:30:21.488711] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-25T17:30:22.288692] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-25T17:30:22.396965] [DEBUG] [REMOTE ] BCH: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-25T17:30:22.397234] [WARN ] [REMOTE ] BCH: No data returned for month 2025-07 [2025-09-25T17:30:22.521972] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T17:30:22.811889] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T17:30:23.088742] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-25T17:30:23.888712] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-25T17:30:24.647118] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:30:24.688669] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-25T17:30:25.493874] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-25T17:30:25.502741] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:30:26.288704] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-25T17:30:26.759885] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-25T17:30:26.805300] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T17:30:27.088724] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-25T17:30:27.508539] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:30:27.518227] [INFO ] [REMOTE ] BCH: Full fetch complete (35926 records). [2025-09-25T17:30:27.518462] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-25T17:30:27.876168] [WARN ] [VALIDATOR ] BCH: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-25T17:30:27.878012] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:30:27.878307] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:30:27.878669] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-25T17:30:27.878852] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-25T17:30:27.878929] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-25T17:30:27.878999] [DEBUG] [LOCAL ] BCH: No derivative data file found to delete. [2025-09-25T17:30:27.879127] [INFO ] [MAIN ] Update Progress: 234/2372 symbols completed. BCH took 24.8s. Estimated remaining: 4h 37m 53s. Rate: 7.7 symbols/min [2025-09-25T17:30:27.899088] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-25T17:30:28.166795] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T17:30:28.179486] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:28.213568] [DEBUG] [LOCAL ] BCX: Loaded 21656 existing records from primary storage. [2025-09-25T17:30:28.213751] [INFO ] [MAIN ] BCX: Loaded 21656 existing records. [2025-09-25T17:30:28.404913] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:30:28.405716] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-25T17:30:28.405774] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-25T17:30:28.406164] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-25T17:30:28.406225] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-25T17:30:28.693793] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-25T17:30:28.774030] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:29.488736] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-25T17:30:29.841395] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T17:30:29.925150] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T17:30:30.288714] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-25T17:30:30.329219] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T17:30:31.088724] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-25T17:30:31.548029] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T17:30:31.888731] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-25T17:30:32.688731] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-25T17:30:33.089431] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-25T17:30:33.118940] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T17:30:33.488702] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-25T17:30:33.771180] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T17:30:34.288707] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-25T17:30:35.049079] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T17:30:35.088678] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-25T17:30:35.633204] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:30:35.888723] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-25T17:30:36.688708] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-25T17:30:36.865953] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T17:30:36.990264] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T17:30:37.428343] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:30:37.488725] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-25T17:30:38.288842] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-25T17:30:38.677898] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T17:30:38.682524] [INFO ] [REMOTE ] BCO: Full fetch complete (36619 records). [2025-09-25T17:30:38.682762] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-25T17:30:38.683345] [FATAL] [VALIDATOR ] BCO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:30:38.683421] [FATAL] [MAIN ] BCO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:30:38.683486] [WARN ] [MAIN ] BCO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:30:38.683542] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-25T17:30:38.683629] [DEBUG] [LOCAL ] BCO: No primary data file found to delete. [2025-09-25T17:30:38.683722] [INFO ] [LOCAL ] BCO: Starting deletion of derivative data. [2025-09-25T17:30:38.684197] [DEBUG] [LOCAL ] BCO: Deleted derivative data file. [2025-09-25T17:30:38.684325] [INFO ] [MAIN ] Update Progress: 235/2372 symbols completed. BCO took 28.0s. Estimated remaining: 4h 38m 13s. Rate: 7.7 symbols/min [2025-09-25T17:30:38.891554] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:38.925782] [DEBUG] [LOCAL ] BDC: Loaded 24794 existing records from primary storage. [2025-09-25T17:30:38.925933] [INFO ] [MAIN ] BDC: Loaded 24794 existing records. [2025-09-25T17:30:39.093844] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-25T17:30:39.131566] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:30:39.131957] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-25T17:30:39.132008] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-25T17:30:39.132282] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-25T17:30:39.132342] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-25T17:30:39.521659] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:39.541512] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T17:30:39.888759] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-25T17:30:40.688758] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-25T17:30:40.772826] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T17:30:40.845196] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T17:30:41.488775] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-25T17:30:42.054363] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T17:30:42.288672] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-25T17:30:42.343342] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:30:43.088756] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-25T17:30:43.548297] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T17:30:43.888725] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-25T17:30:44.688851] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-25T17:30:44.993363] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T17:30:45.128214] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T17:30:45.142390] [INFO ] [REMOTE ] BCS: Full fetch complete (77281 records). [2025-09-25T17:30:45.142759] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-25T17:30:45.489736] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-25T17:30:45.677585] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-25T17:30:45.677775] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-25T17:30:45.679847] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-25T17:30:45.685540] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-25T17:30:45.699139] [DEBUG] [LOCAL ] BCS: Trimmed 77281 records to 53855 (keeping 200 days of data) [2025-09-25T17:30:45.704943] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T17:30:46.125781] [DEBUG] [LOCAL ] BCS: Primary data saved (53855 records). [2025-09-25T17:30:46.126022] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-25T17:30:46.126234] [INFO ] [MAIN ] Update Progress: 236/2372 symbols completed. BCS took 33.3s. Estimated remaining: 4h 38m 2s. Rate: 7.7 symbols/min [2025-09-25T17:30:46.293939] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-25T17:30:46.359725] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:30:46.359989] [DEBUG] [LOCAL ] BDJ: No existing data file found in primary storage. [2025-09-25T17:30:46.360029] [WARN ] [MAIN ] BDJ: No existing data found, performing full refresh instead. [2025-09-25T17:30:46.360287] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-25T17:30:46.360334] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-25T17:30:46.360375] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-25T17:30:46.360436] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-25T17:30:46.681866] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T17:30:46.885748] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:30:47.088726] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-25T17:30:47.421479] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T17:30:47.888745] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-25T17:30:48.054054] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T17:30:48.064183] [INFO ] [REMOTE ] BCSF: Full fetch complete (38093 records). [2025-09-25T17:30:48.064418] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-25T17:30:48.456530] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-25T17:30:48.456673] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-25T17:30:48.457936] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-25T17:30:48.458017] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-25T17:30:48.459693] [DEBUG] [LOCAL ] BCSF: Trimmed 38093 records to 28030 (keeping 200 days of data) [2025-09-25T17:30:48.655580] [DEBUG] [LOCAL ] BCSF: Primary data saved (28030 records). [2025-09-25T17:30:48.655768] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-25T17:30:48.655893] [INFO ] [MAIN ] Update Progress: 237/2372 symbols completed. BCSF took 34.2s. Estimated remaining: 4h 37m 6s. Rate: 7.7 symbols/min [2025-09-25T17:30:48.688739] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-25T17:30:49.021192] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T17:30:49.488703] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-25T17:30:49.797851] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T17:30:50.288774] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-25T17:30:50.388110] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T17:30:51.088761] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-25T17:30:51.259746] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T17:30:51.888751] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-25T17:30:52.381832] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T17:30:52.688824] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-25T17:30:52.828349] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T17:30:53.488686] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-25T17:30:53.940993] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T17:30:54.288727] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-25T17:30:54.481150] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T17:30:55.088692] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-25T17:30:55.477112] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T17:30:55.888753] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-25T17:30:56.144995] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T17:30:56.688710] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-25T17:30:57.141972] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T17:30:57.488709] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-25T17:30:57.816122] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T17:30:58.288752] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-25T17:30:58.734177] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T17:30:59.088688] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-25T17:30:59.233602] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T17:30:59.888733] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-25T17:31:00.688728] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-25T17:31:00.840965] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T17:31:01.154426] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:31:01.158199] [INFO ] [REMOTE ] BCX: Full fetch complete (33754 records). [2025-09-25T17:31:01.158284] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-25T17:31:01.159266] [FATAL] [VALIDATOR ] BCX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:31:01.159506] [FATAL] [MAIN ] BCX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:31:01.159569] [WARN ] [MAIN ] BCX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:31:01.159628] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-25T17:31:01.159783] [DEBUG] [LOCAL ] BCX: No primary data file found to delete. [2025-09-25T17:31:01.159852] [INFO ] [LOCAL ] BCX: Starting deletion of derivative data. [2025-09-25T17:31:01.160423] [DEBUG] [LOCAL ] BCX: Deleted derivative data file. [2025-09-25T17:31:01.160552] [INFO ] [MAIN ] Update Progress: 238/2372 symbols completed. BCX took 33.3s. Estimated remaining: 4h 37m 41s. Rate: 7.7 symbols/min [2025-09-25T17:31:01.488762] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-25T17:31:01.912787] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T17:31:02.288737] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-25T17:31:02.420765] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T17:31:03.088786] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-25T17:31:03.144389] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T17:31:03.888727] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-25T17:31:04.180786] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T17:31:04.688849] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-25T17:31:05.155156] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:31:05.163727] [INFO ] [REMOTE ] BDC: Full fetch complete (35642 records). [2025-09-25T17:31:05.163996] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-25T17:31:05.164948] [FATAL] [VALIDATOR ] BDC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:31:05.165049] [FATAL] [MAIN ] BDC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:31:05.165090] [WARN ] [MAIN ] BDC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:31:05.165131] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-25T17:31:05.165203] [DEBUG] [LOCAL ] BDC: No primary data file found to delete. [2025-09-25T17:31:05.165240] [INFO ] [LOCAL ] BDC: Starting deletion of derivative data. [2025-09-25T17:31:05.165833] [DEBUG] [LOCAL ] BDC: Deleted derivative data file. [2025-09-25T17:31:05.166028] [INFO ] [MAIN ] Update Progress: 239/2372 symbols completed. BDC took 26.5s. Estimated remaining: 4h 36m 59s. Rate: 7.7 symbols/min [2025-09-25T17:31:05.857171] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:31:05.867891] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-25T17:31:07.209876] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T17:31:07.214801] [INFO ] [REMOTE ] BDJ: Full fetch complete (42574 records). [2025-09-25T17:31:07.214905] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-25T17:31:07.215481] [FATAL] [VALIDATOR ] BDJ: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:31:07.215573] [FATAL] [MAIN ] BDJ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:31:07.215619] [WARN ] [MAIN ] BDJ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:31:07.215723] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-25T17:31:07.215823] [DEBUG] [LOCAL ] BDJ: No primary data file found to delete. [2025-09-25T17:31:07.215886] [INFO ] [LOCAL ] BDJ: Starting deletion of derivative data. [2025-09-25T17:31:07.215964] [DEBUG] [LOCAL ] BDJ: No derivative data file found to delete. [2025-09-25T17:31:07.216045] [INFO ] [MAIN ] Update Progress: 240/2372 symbols completed. BDJ took 21.1s. Estimated remaining: 4h 36m 0s. Rate: 7.7 symbols/min [2025-09-25T17:31:08.031184] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:08.031411] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-25T17:31:08.031524] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-25T17:31:08.040803] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-25T17:31:08.040852] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-25T17:31:08.040897] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-25T17:31:08.040941] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-25T17:31:08.035061] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:08.046343] [DEBUG] [LOCAL ] BDX: No existing data file found in primary storage. [2025-09-25T17:31:08.046388] [WARN ] [MAIN ] BDX: No existing data found, performing full refresh instead. [2025-09-25T17:31:08.046488] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-25T17:31:08.046525] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-25T17:31:08.046565] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-09-25T17:31:08.046594] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-25T17:31:08.093268] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:08.093470] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-09-25T17:31:08.093526] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-09-25T17:31:08.108116] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-25T17:31:08.108164] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-25T17:31:08.108239] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-25T17:31:08.108311] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-25T17:31:08.117681] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:08.508617] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-25T17:31:08.508835] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-25T17:31:09.150863] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:31:09.151219] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-25T17:31:09.151269] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-25T17:31:09.159983] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-25T17:31:09.160090] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-25T17:31:09.569089] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:09.572703] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-25T17:31:09.600086] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:09.600368] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-25T17:31:09.782590] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:09.796447] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-25T17:31:09.991867] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:09.992200] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-25T17:31:10.587702] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T17:31:10.589479] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-25T17:31:10.906342] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-25T17:31:10.907603] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-25T17:31:11.265775] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T17:31:11.267019] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-25T17:31:11.331699] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T17:31:11.444571] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T17:31:11.545391] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T17:31:11.637574] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-25T17:31:11.888737] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-25T17:31:12.280255] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T17:31:12.688730] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-25T17:31:13.488741] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-25T17:31:14.182850] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T17:31:14.288769] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-25T17:31:14.680943] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-25T17:31:15.088693] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-25T17:31:15.449904] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T17:31:15.465736] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T17:31:15.888735] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-25T17:31:16.688734] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-25T17:31:17.488824] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-25T17:31:17.622550] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T17:31:18.251997] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:31:18.288720] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-25T17:31:18.570706] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-25T17:31:18.896804] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T17:31:19.088940] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-25T17:31:19.888769] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-25T17:31:20.126345] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-25T17:31:20.688824] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-25T17:31:20.988377] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T17:31:21.488753] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-25T17:31:22.003056] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T17:31:22.004157] [INFO ] [REMOTE ] BEDU: Full fetch complete (1428 records). [2025-09-25T17:31:22.004261] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-25T17:31:22.244628] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-25T17:31:22.245276] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:31:22.245387] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:31:22.245513] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-25T17:31:22.258155] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:31:22.264290] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-25T17:31:22.264524] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-25T17:31:22.264604] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-25T17:31:22.264731] [INFO ] [MAIN ] Update Progress: 241/2372 symbols completed. BEDU took 15.0s. Estimated remaining: 4h 36m 57s. Rate: 7.7 symbols/min [2025-09-25T17:31:22.289223] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-25T17:31:22.448084] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:22.448279] [DEBUG] [LOCAL ] BEKE: No existing data file found in primary storage. [2025-09-25T17:31:22.448333] [WARN ] [MAIN ] BEKE: No existing data found, performing full refresh instead. [2025-09-25T17:31:22.448532] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-25T17:31:22.448572] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-25T17:31:22.448611] [DEBUG] [LOCAL ] BEKE: No primary data file found to delete. [2025-09-25T17:31:22.448661] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-25T17:31:22.818408] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:23.088728] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-25T17:31:23.888722] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-25T17:31:24.049051] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T17:31:24.688735] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-25T17:31:25.107702] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T17:31:25.488712] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-25T17:31:26.130988] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-25T17:31:26.288698] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-25T17:31:26.495796] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T17:31:27.088762] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-25T17:31:27.256924] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T17:31:27.625736] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T17:31:27.888788] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-25T17:31:28.688725] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-25T17:31:28.921479] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T17:31:29.488682] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-25T17:31:30.000808] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-25T17:31:30.288698] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-25T17:31:30.335702] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T17:31:31.088685] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-25T17:31:31.200517] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T17:31:31.888685] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-25T17:31:32.160695] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T17:31:32.522635] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:31:32.688718] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-25T17:31:33.488832] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-25T17:31:33.630050] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T17:31:34.288751] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-25T17:31:34.524269] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:31:34.697679] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T17:31:35.088774] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-25T17:31:35.888739] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-25T17:31:36.085855] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T17:31:36.688850] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-25T17:31:37.132792] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T17:31:37.488718] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-25T17:31:37.549781] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T17:31:38.288754] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-25T17:31:38.473460] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T17:31:39.088728] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-25T17:31:39.164842] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:31:39.888756] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-25T17:31:40.614462] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-25T17:31:40.688726] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-25T17:31:40.961526] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T17:31:41.488803] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-25T17:31:41.635758] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T17:31:42.288771] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-25T17:31:42.983635] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T17:31:42.996738] [INFO ] [REMOTE ] BDX: Full fetch complete (75860 records). [2025-09-25T17:31:42.997129] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-25T17:31:43.041043] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-25T17:31:43.095772] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-25T17:31:43.102762] [INFO ] [REMOTE ] BE: Full fetch complete (77662 records). [2025-09-25T17:31:43.135014] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-25T17:31:44.005187] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-25T17:31:44.005329] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-25T17:31:44.006300] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-25T17:31:44.006404] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-25T17:31:44.016073] [DEBUG] [LOCAL ] BDX: Trimmed 75860 records to 52828 (keeping 200 days of data) [2025-09-25T17:31:44.032624] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T17:31:44.156066] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-25T17:31:44.156196] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-25T17:31:44.157111] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-25T17:31:44.157181] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-25T17:31:44.159102] [INFO ] [REMOTE ] BDN: Full fetch complete (68904 records). [2025-09-25T17:31:44.159226] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-25T17:31:44.160130] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:31:44.160269] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:31:44.160323] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:31:44.160467] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-25T17:31:44.160578] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-25T17:31:44.160676] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-09-25T17:31:44.160747] [DEBUG] [LOCAL ] BDN: No derivative data file found to delete. [2025-09-25T17:31:44.160849] [INFO ] [MAIN ] Update Progress: 242/2372 symbols completed. BDN took 36.9s. Estimated remaining: 4h 38m 53s. Rate: 7.6 symbols/min [2025-09-25T17:31:44.172881] [DEBUG] [LOCAL ] BE: Trimmed 77662 records to 54043 (keeping 200 days of data) [2025-09-25T17:31:44.868611] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:44.922821] [DEBUG] [LOCAL ] BDX: Primary data saved (52828 records). [2025-09-25T17:31:44.925009] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-25T17:31:44.929414] [INFO ] [MAIN ] Update Progress: 243/2372 symbols completed. BDX took 37.7s. Estimated remaining: 4h 37m 43s. Rate: 7.7 symbols/min [2025-09-25T17:31:44.955619] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T17:31:44.991376] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-25T17:31:45.033123] [DEBUG] [LOCAL ] BEN: Loaded 53059 existing records from primary storage. [2025-09-25T17:31:45.036246] [INFO ] [MAIN ] BEN: Loaded 53059 existing records. [2025-09-25T17:31:45.266819] [DEBUG] [LOCAL ] BE: Primary data saved (54043 records). [2025-09-25T17:31:45.266959] [INFO ] [MAIN ] BE: Full history saved. [2025-09-25T17:31:45.267052] [INFO ] [MAIN ] Update Progress: 244/2372 symbols completed. BE took 38.0s. Estimated remaining: 4h 36m 30s. Rate: 7.7 symbols/min [2025-09-25T17:31:45.509728] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:45.513822] [DEBUG] [LOCAL ] BEP: No existing data file found in primary storage. [2025-09-25T17:31:45.513878] [WARN ] [MAIN ] BEP: No existing data found, performing full refresh instead. [2025-09-25T17:31:45.514037] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-25T17:31:45.514079] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-25T17:31:45.514120] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-25T17:31:45.514163] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-25T17:31:45.673413] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:31:45.679031] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-25T17:31:45.679078] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-25T17:31:45.679451] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-25T17:31:45.679509] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-25T17:31:45.752404] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:31:45.752629] [DEBUG] [LOCAL ] BEPC: No existing data file found in primary storage. [2025-09-25T17:31:45.752714] [WARN ] [MAIN ] BEPC: No existing data found, performing full refresh instead. [2025-09-25T17:31:45.752853] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-25T17:31:45.752894] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-25T17:31:45.752976] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-25T17:31:45.753045] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-25T17:31:46.608173] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:46.608544] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-25T17:31:46.820349] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:46.820734] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-25T17:31:46.837327] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:31:46.837610] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-25T17:31:47.011569] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T17:31:47.088675] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-25T17:31:48.314373] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T17:31:48.323781] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-25T17:31:48.457695] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:31:48.505639] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T17:31:48.688718] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-25T17:31:49.488699] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-25T17:31:50.001260] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T17:31:50.288710] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-25T17:31:50.557580] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:31:51.061440] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T17:31:51.088704] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-25T17:31:51.625066] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T17:31:51.843258] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (4.75 seconds). [2025-09-25T17:31:51.888699] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-25T17:31:52.540748] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:31:52.688721] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-25T17:31:53.443143] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T17:31:53.488675] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-25T17:31:54.247383] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:31:54.288683] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-25T17:31:54.724806] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T17:31:55.088730] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-25T17:31:55.888731] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-25T17:31:56.210897] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T17:31:56.433596] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:31:56.688731] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-25T17:31:57.313679] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T17:31:57.488752] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-25T17:31:57.919830] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T17:31:58.288752] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-25T17:31:58.988955] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T17:31:59.088723] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-25T17:31:59.888798] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-25T17:32:00.028566] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T17:32:00.038834] [INFO ] [REMOTE ] BEKE: Full fetch complete (77196 records). [2025-09-25T17:32:00.039026] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-25T17:32:00.467983] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-25T17:32:00.468096] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-25T17:32:00.469077] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-25T17:32:00.469148] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-25T17:32:00.472831] [DEBUG] [LOCAL ] BEKE: Trimmed 77196 records to 53637 (keeping 200 days of data) [2025-09-25T17:32:00.689900] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-25T17:32:00.800810] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T17:32:00.904310] [DEBUG] [LOCAL ] BEKE: Primary data saved (53637 records). [2025-09-25T17:32:00.904465] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-25T17:32:00.904562] [INFO ] [MAIN ] Update Progress: 245/2372 symbols completed. BEKE took 38.6s. Estimated remaining: 4h 37m 30s. Rate: 7.7 symbols/min [2025-09-25T17:32:01.092694] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:01.103483] [DEBUG] [LOCAL ] BEPH: Loaded 5099 existing records from primary storage. [2025-09-25T17:32:01.103609] [INFO ] [MAIN ] BEPH: Loaded 5099 existing records. [2025-09-25T17:32:01.306922] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:01.307206] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-25T17:32:01.307298] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-25T17:32:01.307573] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-25T17:32:01.307634] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-25T17:32:01.494409] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-25T17:32:01.588388] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T17:32:01.750997] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:02.149495] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T17:32:02.288779] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-25T17:32:03.050399] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T17:32:03.088674] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-25T17:32:03.623006] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T17:32:03.888677] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-25T17:32:04.688693] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-25T17:32:04.997635] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T17:32:05.236241] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T17:32:05.488776] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-25T17:32:06.257236] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:32:06.288736] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-25T17:32:07.088878] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-25T17:32:07.136310] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T17:32:07.754740] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T17:32:07.888759] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-25T17:32:07.925943] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T17:32:08.688868] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-25T17:32:09.488820] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-25T17:32:10.006960] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-25T17:32:10.020385] [INFO ] [REMOTE ] BEN: Full fetch complete (76882 records). [2025-09-25T17:32:10.020665] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-25T17:32:10.060779] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T17:32:10.125778] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T17:32:10.289546] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-25T17:32:10.529796] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-25T17:32:10.529893] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-25T17:32:10.530764] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-25T17:32:10.530926] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-25T17:32:10.532476] [DEBUG] [LOCAL ] BEN: Trimmed 76882 records to 53445 (keeping 200 days of data) [2025-09-25T17:32:10.876380] [DEBUG] [LOCAL ] BEN: Primary data saved (53445 records). [2025-09-25T17:32:10.876521] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-25T17:32:10.876739] [INFO ] [MAIN ] Update Progress: 246/2372 symbols completed. BEN took 26.7s. Estimated remaining: 4h 37m 41s. Rate: 7.7 symbols/min [2025-09-25T17:32:11.062934] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:11.084328] [DEBUG] [LOCAL ] BEPI: Loaded 3425 existing records from primary storage. [2025-09-25T17:32:11.084441] [INFO ] [MAIN ] BEPI: Loaded 3425 existing records. [2025-09-25T17:32:11.092456] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-25T17:32:11.287733] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:11.288415] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-25T17:32:11.288471] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-25T17:32:11.288971] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-25T17:32:11.289063] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-25T17:32:11.487518] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T17:32:11.529820] [INFO ] [REMOTE ] BEP: Full fetch complete (57987 records). [2025-09-25T17:32:11.529982] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-25T17:32:11.530905] [FATAL] [VALIDATOR ] BEP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:32:11.530989] [FATAL] [MAIN ] BEP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:32:11.531057] [WARN ] [MAIN ] BEP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:32:11.531123] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-25T17:32:11.531199] [DEBUG] [LOCAL ] BEP: No primary data file found to delete. [2025-09-25T17:32:11.531283] [INFO ] [LOCAL ] BEP: Starting deletion of derivative data. [2025-09-25T17:32:11.531366] [DEBUG] [LOCAL ] BEP: No derivative data file found to delete. [2025-09-25T17:32:11.531473] [INFO ] [MAIN ] Update Progress: 247/2372 symbols completed. BEP took 26.6s. Estimated remaining: 4h 36m 31s. Rate: 7.7 symbols/min [2025-09-25T17:32:11.731401] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T17:32:11.873959] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:11.892540] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-25T17:32:11.967431] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:11.971679] [DEBUG] [LOCAL ] BEPJ: Loaded 3247 existing records from primary storage. [2025-09-25T17:32:11.971812] [INFO ] [MAIN ] BEPJ: Loaded 3247 existing records. [2025-09-25T17:32:12.149755] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:12.150371] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-25T17:32:12.150424] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-25T17:32:12.150737] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-25T17:32:12.150799] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-25T17:32:12.528326] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:12.660202] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T17:32:12.688776] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-25T17:32:13.224193] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T17:32:13.488753] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-25T17:32:14.288904] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-25T17:32:14.945247] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T17:32:15.088717] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-25T17:32:15.357549] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T17:32:15.367337] [INFO ] [REMOTE ] BEPC: Full fetch complete (68124 records). [2025-09-25T17:32:15.367521] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-25T17:32:15.368843] [FATAL] [VALIDATOR ] BEPC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:32:15.368952] [FATAL] [MAIN ] BEPC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:32:15.369003] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:32:15.369100] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-25T17:32:15.369223] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-09-25T17:32:15.369282] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-09-25T17:32:15.369325] [DEBUG] [LOCAL ] BEPC: No derivative data file found to delete. [2025-09-25T17:32:15.369470] [INFO ] [MAIN ] Update Progress: 248/2372 symbols completed. BEPC took 30.1s. Estimated remaining: 4h 35m 50s. Rate: 7.7 symbols/min [2025-09-25T17:32:15.561859] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:15.619802] [DEBUG] [LOCAL ] BFAM: Loaded 33023 existing records from primary storage. [2025-09-25T17:32:15.619938] [INFO ] [MAIN ] BFAM: Loaded 33023 existing records. [2025-09-25T17:32:15.676717] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T17:32:15.837308] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:15.837559] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-25T17:32:15.837607] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-25T17:32:15.837998] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-25T17:32:15.838061] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-25T17:32:15.889589] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-25T17:32:16.243587] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:16.585962] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-25T17:32:16.688726] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-25T17:32:17.249923] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T17:32:17.488727] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-25T17:32:17.957118] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T17:32:18.288728] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-25T17:32:18.929516] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T17:32:19.088742] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-25T17:32:19.888723] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-25T17:32:20.309516] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T17:32:20.557330] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T17:32:20.688745] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-25T17:32:21.201357] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T17:32:21.488761] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-25T17:32:22.060090] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T17:32:22.288728] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-25T17:32:23.089356] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-25T17:32:23.330893] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:32:23.615011] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T17:32:23.888732] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-25T17:32:24.688799] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-25T17:32:24.716808] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T17:32:24.718755] [INFO ] [REMOTE ] BEPH: Full fetch complete (7531 records). [2025-09-25T17:32:24.718866] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-25T17:32:25.116634] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T17:32:25.150840] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-25T17:32:25.150973] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-25T17:32:25.151427] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-25T17:32:25.151498] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-25T17:32:25.152753] [DEBUG] [LOCAL ] BEPH: Trimmed 7531 records to 5160 (keeping 200 days of data) [2025-09-25T17:32:25.193802] [DEBUG] [LOCAL ] BEPH: Primary data saved (5160 records). [2025-09-25T17:32:25.194024] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-25T17:32:25.194138] [INFO ] [MAIN ] Update Progress: 249/2372 symbols completed. BEPH took 24.3s. Estimated remaining: 4h 35m 59s. Rate: 7.7 symbols/min [2025-09-25T17:32:25.386591] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:25.456330] [DEBUG] [LOCAL ] BFH: Loaded 41716 existing records from primary storage. [2025-09-25T17:32:25.456552] [INFO ] [MAIN ] BFH: Loaded 41716 existing records. [2025-09-25T17:32:25.493818] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-25T17:32:25.674695] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:25.675182] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-25T17:32:25.675233] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-25T17:32:25.675686] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-25T17:32:25.675748] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-25T17:32:26.041824] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:26.288715] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-25T17:32:26.721200] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T17:32:26.915350] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T17:32:27.088703] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-25T17:32:27.888737] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-25T17:32:28.447013] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-25T17:32:28.474898] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T17:32:28.688722] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-25T17:32:29.489100] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-25T17:32:30.069252] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T17:32:30.160222] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T17:32:30.288728] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-25T17:32:31.088764] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-25T17:32:31.409351] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-25T17:32:31.741101] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:32:31.888733] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-25T17:32:32.362390] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T17:32:32.688876] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-25T17:32:33.488744] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-25T17:32:34.252121] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T17:32:34.269439] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T17:32:34.288688] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-25T17:32:35.088707] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-25T17:32:35.314786] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:32:35.888761] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-25T17:32:36.640861] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T17:32:36.688671] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-25T17:32:37.271030] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T17:32:37.348152] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T17:32:37.488692] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-25T17:32:38.288717] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-25T17:32:38.746087] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T17:32:39.088716] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-25T17:32:39.323925] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:32:39.383348] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-25T17:32:39.888733] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-25T17:32:40.460940] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T17:32:40.462220] [INFO ] [REMOTE ] BEPI: Full fetch complete (4972 records). [2025-09-25T17:32:40.462304] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-25T17:32:40.693780] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-25T17:32:40.852988] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-25T17:32:40.853080] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-25T17:32:40.853253] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-25T17:32:40.853313] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-25T17:32:40.853713] [DEBUG] [LOCAL ] BEPI: Trimmed 4972 records to 3452 (keeping 200 days of data) [2025-09-25T17:32:40.879276] [DEBUG] [LOCAL ] BEPI: Primary data saved (3452 records). [2025-09-25T17:32:40.879387] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-25T17:32:40.879498] [INFO ] [MAIN ] Update Progress: 250/2372 symbols completed. BEPI took 30.0s. Estimated remaining: 4h 36m 58s. Rate: 7.7 symbols/min [2025-09-25T17:32:41.055539] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:41.074222] [DEBUG] [LOCAL ] BFK: Loaded 13975 existing records from primary storage. [2025-09-25T17:32:41.074369] [INFO ] [MAIN ] BFK: Loaded 13975 existing records. [2025-09-25T17:32:41.261852] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:41.262217] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-25T17:32:41.262297] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-25T17:32:41.262624] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-25T17:32:41.265339] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-25T17:32:41.436092] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T17:32:41.490718] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-25T17:32:41.667605] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:42.288704] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-25T17:32:42.661327] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-25T17:32:43.043151] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:32:43.088712] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-25T17:32:43.888741] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-25T17:32:44.021353] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T17:32:44.257044] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-25T17:32:44.258063] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4482 records). [2025-09-25T17:32:44.258148] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-25T17:32:44.627323] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-25T17:32:44.627405] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-25T17:32:44.627569] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-25T17:32:44.627608] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-25T17:32:44.628024] [DEBUG] [LOCAL ] BEPJ: Trimmed 4482 records to 3259 (keeping 200 days of data) [2025-09-25T17:32:44.650747] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3259 records). [2025-09-25T17:32:44.650890] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-25T17:32:44.651021] [INFO ] [MAIN ] Update Progress: 251/2372 symbols completed. BEPJ took 33.1s. Estimated remaining: 4h 36m 16s. Rate: 7.7 symbols/min [2025-09-25T17:32:44.695005] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-25T17:32:44.839801] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:44.914963] [DEBUG] [LOCAL ] BFLY: Loaded 51826 existing records from primary storage. [2025-09-25T17:32:44.915127] [INFO ] [MAIN ] BFLY: Loaded 51826 existing records. [2025-09-25T17:32:45.098693] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:45.099001] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-25T17:32:45.099048] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-25T17:32:45.099343] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-25T17:32:45.099402] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-25T17:32:45.464637] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:45.488677] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-25T17:32:45.998866] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T17:32:46.288716] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-25T17:32:46.991903] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T17:32:47.088731] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-25T17:32:47.888704] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-25T17:32:48.128891] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T17:32:48.237422] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T17:32:48.688704] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-25T17:32:49.393382] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:32:49.488684] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-25T17:32:50.073823] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T17:32:50.288711] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-25T17:32:50.994686] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T17:32:51.088671] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-25T17:32:51.340471] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T17:32:51.346739] [INFO ] [REMOTE ] BFAM: Full fetch complete (46791 records). [2025-09-25T17:32:51.346846] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-25T17:32:51.347543] [FATAL] [VALIDATOR ] BFAM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:32:51.347693] [FATAL] [MAIN ] BFAM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:32:51.347747] [WARN ] [MAIN ] BFAM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:32:51.347788] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-25T17:32:51.347885] [DEBUG] [LOCAL ] BFAM: No primary data file found to delete. [2025-09-25T17:32:51.347941] [INFO ] [LOCAL ] BFAM: Starting deletion of derivative data. [2025-09-25T17:32:51.348292] [DEBUG] [LOCAL ] BFAM: Deleted derivative data file. [2025-09-25T17:32:51.348426] [INFO ] [MAIN ] Update Progress: 252/2372 symbols completed. BFAM took 36.0s. Estimated remaining: 4h 35m 59s. Rate: 7.7 symbols/min [2025-09-25T17:32:51.545101] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:51.545358] [DEBUG] [LOCAL ] BFS: No existing data file found in primary storage. [2025-09-25T17:32:51.545409] [WARN ] [MAIN ] BFS: No existing data found, performing full refresh instead. [2025-09-25T17:32:51.545570] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-25T17:32:51.545620] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-25T17:32:51.545772] [DEBUG] [LOCAL ] BFS: No primary data file found to delete. [2025-09-25T17:32:51.545819] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-25T17:32:51.898725] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-25T17:32:51.904116] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:52.442907] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T17:32:52.450081] [INFO ] [REMOTE ] BFH: Full fetch complete (59677 records). [2025-09-25T17:32:52.450220] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-25T17:32:52.694097] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-25T17:32:52.863179] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-25T17:32:52.863260] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-25T17:32:52.863947] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-25T17:32:52.864011] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-25T17:32:52.866836] [DEBUG] [LOCAL ] BFH: Trimmed 59677 records to 42012 (keeping 200 days of data) [2025-09-25T17:32:53.145595] [DEBUG] [LOCAL ] BFH: Primary data saved (42012 records). [2025-09-25T17:32:53.145756] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-25T17:32:53.145845] [INFO ] [MAIN ] Update Progress: 253/2372 symbols completed. BFH took 28.0s. Estimated remaining: 4h 35m 1s. Rate: 7.7 symbols/min [2025-09-25T17:32:53.336323] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:32:53.356758] [DEBUG] [LOCAL ] BFZ: Loaded 11925 existing records from primary storage. [2025-09-25T17:32:53.356894] [INFO ] [MAIN ] BFZ: Loaded 11925 existing records. [2025-09-25T17:32:53.493870] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-25T17:32:53.566188] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:32:53.567253] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-25T17:32:53.567304] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-25T17:32:53.567516] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-25T17:32:53.567576] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-25T17:32:53.649789] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T17:32:53.791796] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T17:32:54.030715] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:32:54.288697] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-25T17:32:54.538341] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:32:55.088725] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-25T17:32:55.888721] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-25T17:32:55.920558] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T17:32:56.172203] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T17:32:56.660262] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T17:32:56.688709] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-25T17:32:57.488849] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-25T17:32:58.288687] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-25T17:32:58.381874] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T17:32:58.567977] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T17:32:58.727251] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T17:32:59.088716] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-25T17:32:59.864619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T17:32:59.888667] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-25T17:33:00.642749] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T17:33:00.688677] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-25T17:33:01.368711] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T17:33:01.488722] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-25T17:33:02.239834] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T17:33:02.288751] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-25T17:33:03.088732] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-25T17:33:03.888711] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-25T17:33:04.013508] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T17:33:04.050636] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T17:33:04.495720] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T17:33:04.688728] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-25T17:33:05.376625] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T17:33:05.488716] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-25T17:33:06.288721] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-25T17:33:07.088897] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-25T17:33:07.178586] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T17:33:07.388696] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T17:33:07.855910] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T17:33:07.859842] [INFO ] [REMOTE ] BFS: Full fetch complete (12587 records). [2025-09-25T17:33:07.859967] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-25T17:33:07.893788] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-25T17:33:08.268469] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-25T17:33:08.268599] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-25T17:33:08.269145] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-25T17:33:08.269277] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-25T17:33:08.270034] [DEBUG] [LOCAL ] BFS: Trimmed 12587 records to 9144 (keeping 200 days of data) [2025-09-25T17:33:08.340374] [DEBUG] [LOCAL ] BFS: Primary data saved (9144 records). [2025-09-25T17:33:08.340639] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-25T17:33:08.340837] [INFO ] [MAIN ] Update Progress: 254/2372 symbols completed. BFS took 17.0s. Estimated remaining: 4h 35m 55s. Rate: 7.7 symbols/min [2025-09-25T17:33:08.529557] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:08.529851] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-09-25T17:33:08.529953] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-09-25T17:33:08.530251] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-25T17:33:08.530302] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-25T17:33:08.530351] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-09-25T17:33:08.530397] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-25T17:33:08.689340] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-25T17:33:08.916245] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:09.333774] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T17:33:09.488696] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-25T17:33:09.638711] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T17:33:10.288760] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-25T17:33:11.019072] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:33:11.088768] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-25T17:33:11.105709] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T17:33:11.888782] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-25T17:33:12.688759] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-25T17:33:12.792537] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T17:33:12.922990] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T17:33:13.488802] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-25T17:33:14.288772] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-25T17:33:14.965722] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T17:33:15.088757] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-25T17:33:15.451798] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T17:33:15.464897] [INFO ] [REMOTE ] BFLY: Full fetch complete (75254 records). [2025-09-25T17:33:15.465104] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-25T17:33:15.756012] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (3.07 seconds). [2025-09-25T17:33:15.884062] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T17:33:15.893830] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-25T17:33:16.016402] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-25T17:33:16.016488] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-25T17:33:16.017275] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-25T17:33:16.017340] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-25T17:33:16.021713] [DEBUG] [LOCAL ] BFLY: Trimmed 75254 records to 52211 (keeping 200 days of data) [2025-09-25T17:33:16.330085] [DEBUG] [LOCAL ] BFLY: Primary data saved (52211 records). [2025-09-25T17:33:16.330228] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-25T17:33:16.330315] [INFO ] [MAIN ] Update Progress: 255/2372 symbols completed. BFLY took 31.7s. Estimated remaining: 4h 35m 48s. Rate: 7.7 symbols/min [2025-09-25T17:33:16.509617] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:16.531895] [DEBUG] [LOCAL ] BGB: Loaded 17384 existing records from primary storage. [2025-09-25T17:33:16.532013] [INFO ] [MAIN ] BGB: Loaded 17384 existing records. [2025-09-25T17:33:16.690321] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-25T17:33:16.721805] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:16.722334] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-25T17:33:16.722392] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-25T17:33:16.722744] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-25T17:33:16.722814] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-25T17:33:16.921750] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:33:17.112731] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:17.488779] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-25T17:33:18.270220] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:33:18.289010] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-25T17:33:18.613925] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T17:33:19.089057] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-25T17:33:19.889104] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-25T17:33:19.926770] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T17:33:20.090328] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T17:33:20.688703] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-25T17:33:21.003292] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T17:33:21.488765] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-25T17:33:21.539814] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:33:22.290587] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-25T17:33:22.291357] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T17:33:23.089112] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-25T17:33:23.208305] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T17:33:23.888772] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-25T17:33:23.928345] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T17:33:24.688722] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-25T17:33:25.038681] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T17:33:25.488750] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-25T17:33:25.581094] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T17:33:25.584857] [INFO ] [REMOTE ] BFZ: Full fetch complete (18125 records). [2025-09-25T17:33:25.584954] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-25T17:33:25.988969] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-25T17:33:25.989058] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-25T17:33:25.989376] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-25T17:33:25.989415] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-25T17:33:25.990725] [DEBUG] [LOCAL ] BFZ: Trimmed 18125 records to 12147 (keeping 200 days of data) [2025-09-25T17:33:26.074430] [DEBUG] [LOCAL ] BFZ: Primary data saved (12147 records). [2025-09-25T17:33:26.074569] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-25T17:33:26.074692] [INFO ] [MAIN ] Update Progress: 256/2372 symbols completed. BFZ took 32.9s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-25T17:33:26.247714] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:26.277215] [DEBUG] [LOCAL ] BGH: Loaded 16392 existing records from primary storage. [2025-09-25T17:33:26.277390] [INFO ] [MAIN ] BGH: Loaded 16392 existing records. [2025-09-25T17:33:26.288918] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-25T17:33:26.474320] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:26.474588] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-25T17:33:26.474826] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-25T17:33:26.475185] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-25T17:33:26.475255] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-25T17:33:26.713823] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T17:33:26.903726] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:27.088713] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-25T17:33:27.898009] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-25T17:33:27.920433] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T17:33:28.022747] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T17:33:28.594316] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-25T17:33:28.688731] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-25T17:33:29.453767] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T17:33:29.488725] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-25T17:33:30.288715] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-25T17:33:30.312092] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T17:33:31.088705] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-25T17:33:31.241731] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T17:33:31.671921] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-25T17:33:31.888720] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-25T17:33:32.688706] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-25T17:33:32.962703] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T17:33:33.488718] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-25T17:33:33.779034] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T17:33:34.288710] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-25T17:33:34.400315] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T17:33:35.088709] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-25T17:33:35.222895] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T17:33:35.888725] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-25T17:33:36.179227] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T17:33:36.182591] [INFO ] [REMOTE ] BFK: Full fetch complete (19350 records). [2025-09-25T17:33:36.182771] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-25T17:33:36.552270] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-25T17:33:36.552348] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-25T17:33:36.552692] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-25T17:33:36.552753] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-25T17:33:36.553503] [DEBUG] [LOCAL ] BFK: Trimmed 19350 records to 14083 (keeping 200 days of data) [2025-09-25T17:33:36.645930] [DEBUG] [LOCAL ] BFK: Primary data saved (14083 records). [2025-09-25T17:33:36.646070] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-25T17:33:36.646155] [INFO ] [MAIN ] Update Progress: 257/2372 symbols completed. BFK took 55.8s. Estimated remaining: 4h 36m 11s. Rate: 7.7 symbols/min [2025-09-25T17:33:36.691792] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-25T17:33:36.700207] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:33:36.840280] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:36.857450] [DEBUG] [LOCAL ] BGR: Loaded 13451 existing records from primary storage. [2025-09-25T17:33:36.857576] [INFO ] [MAIN ] BGR: Loaded 13451 existing records. [2025-09-25T17:33:37.034803] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:37.035134] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-25T17:33:37.035185] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-25T17:33:37.035401] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-25T17:33:37.035458] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-25T17:33:37.390148] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:37.488674] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-25T17:33:38.288700] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-25T17:33:38.501591] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:33:38.557108] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T17:33:39.088716] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-25T17:33:39.186821] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T17:33:39.817351] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T17:33:39.888786] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-25T17:33:40.688739] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-25T17:33:41.395468] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T17:33:41.488698] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-25T17:33:41.626556] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:33:42.254901] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T17:33:42.288687] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-25T17:33:43.088685] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-25T17:33:43.233242] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T17:33:43.888715] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-25T17:33:44.625014] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T17:33:44.688723] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-25T17:33:44.923154] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T17:33:44.930955] [INFO ] [REMOTE ] BGB: Full fetch complete (26883 records). [2025-09-25T17:33:44.931313] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-25T17:33:45.392619] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-25T17:33:45.392796] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-25T17:33:45.393459] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-25T17:33:45.393719] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-25T17:33:45.395662] [DEBUG] [LOCAL ] BGB: Trimmed 26883 records to 17478 (keeping 200 days of data) [2025-09-25T17:33:45.498801] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-25T17:33:45.547487] [DEBUG] [LOCAL ] BGB: Primary data saved (17478 records). [2025-09-25T17:33:45.550772] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-25T17:33:45.551057] [INFO ] [MAIN ] Update Progress: 258/2372 symbols completed. BGB took 29.2s. Estimated remaining: 4h 36m 12s. Rate: 7.7 symbols/min [2025-09-25T17:33:45.739763] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:45.795701] [DEBUG] [LOCAL ] BGS: Loaded 50445 existing records from primary storage. [2025-09-25T17:33:45.795852] [INFO ] [MAIN ] BGS: Loaded 50445 existing records. [2025-09-25T17:33:45.981513] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:45.982224] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-25T17:33:45.982278] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-25T17:33:45.982719] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-25T17:33:45.982791] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-25T17:33:46.194353] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T17:33:46.291462] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-25T17:33:46.412866] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:46.426426] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T17:33:47.088727] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-25T17:33:47.289886] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T17:33:47.888736] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-25T17:33:48.688703] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-25T17:33:48.739547] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:33:49.491872] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-25T17:33:49.499490] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:33:49.771185] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T17:33:50.288817] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-25T17:33:50.538502] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T17:33:51.063307] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T17:33:51.088676] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-25T17:33:51.838243] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T17:33:51.842221] [INFO ] [REMOTE ] BGR: Full fetch complete (20294 records). [2025-09-25T17:33:51.842356] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-25T17:33:51.893921] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-25T17:33:52.270534] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-25T17:33:52.270703] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-25T17:33:52.271200] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-25T17:33:52.271267] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-25T17:33:52.272219] [DEBUG] [LOCAL ] BGR: Trimmed 20294 records to 13568 (keeping 200 days of data) [2025-09-25T17:33:52.375367] [DEBUG] [LOCAL ] BGR: Primary data saved (13568 records). [2025-09-25T17:33:52.375612] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-25T17:33:52.375800] [INFO ] [MAIN ] Update Progress: 259/2372 symbols completed. BGR took 15.7s. Estimated remaining: 4h 35m 56s. Rate: 7.7 symbols/min [2025-09-25T17:33:52.563975] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:52.581062] [DEBUG] [LOCAL ] BGSF: Loaded 6821 existing records from primary storage. [2025-09-25T17:33:52.581235] [INFO ] [MAIN ] BGSF: Loaded 6821 existing records. [2025-09-25T17:33:52.691242] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-25T17:33:52.786412] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:52.787031] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-25T17:33:52.787113] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-25T17:33:52.787471] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-25T17:33:52.787584] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-25T17:33:52.991834] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T17:33:53.201246] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:53.488741] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-25T17:33:54.288747] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-25T17:33:54.488812] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T17:33:54.499537] [INFO ] [REMOTE ] BG: Full fetch complete (72779 records). [2025-09-25T17:33:54.499729] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-25T17:33:54.809477] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T17:33:54.935804] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-25T17:33:54.935918] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-25T17:33:54.936759] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-25T17:33:54.936827] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-25T17:33:54.946311] [DEBUG] [LOCAL ] BG: Trimmed 72779 records to 50757 (keeping 200 days of data) [2025-09-25T17:33:54.975840] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T17:33:55.089552] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-25T17:33:55.345360] [DEBUG] [LOCAL ] BG: Primary data saved (50757 records). [2025-09-25T17:33:55.345566] [INFO ] [MAIN ] BG: Full history saved. [2025-09-25T17:33:55.345709] [INFO ] [MAIN ] Update Progress: 260/2372 symbols completed. BG took 47.0s. Estimated remaining: 4h 35m 9s. Rate: 7.7 symbols/min [2025-09-25T17:33:55.526210] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:33:55.552293] [DEBUG] [LOCAL ] BGT: Loaded 16560 existing records from primary storage. [2025-09-25T17:33:55.552427] [INFO ] [MAIN ] BGT: Loaded 16560 existing records. [2025-09-25T17:33:55.729984] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:33:55.730367] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-25T17:33:55.730415] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-25T17:33:55.730741] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-25T17:33:55.730800] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-25T17:33:55.903832] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-25T17:33:56.111766] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:33:56.658987] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:33:56.662990] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:33:56.688688] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-25T17:33:57.488710] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-25T17:33:58.099795] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T17:33:58.288675] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-25T17:33:58.399800] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T17:33:59.024919] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T17:33:59.088681] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-25T17:33:59.888733] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-25T17:34:00.688753] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-25T17:34:00.886226] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T17:34:00.930679] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:34:00.933978] [INFO ] [REMOTE ] BGH: Full fetch complete (21829 records). [2025-09-25T17:34:00.934053] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-25T17:34:01.182217] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T17:34:01.338794] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-25T17:34:01.338878] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-25T17:34:01.339261] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-25T17:34:01.339300] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-25T17:34:01.340397] [DEBUG] [LOCAL ] BGH: Trimmed 21829 records to 16544 (keeping 200 days of data) [2025-09-25T17:34:01.464796] [DEBUG] [LOCAL ] BGH: Primary data saved (16544 records). [2025-09-25T17:34:01.464962] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-25T17:34:01.465106] [INFO ] [MAIN ] Update Progress: 261/2372 symbols completed. BGH took 35.4s. Estimated remaining: 4h 34m 47s. Rate: 7.7 symbols/min [2025-09-25T17:34:01.491205] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-25T17:34:01.658345] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:01.684731] [DEBUG] [LOCAL ] BGX: Loaded 10704 existing records from primary storage. [2025-09-25T17:34:01.684913] [INFO ] [MAIN ] BGX: Loaded 10704 existing records. [2025-09-25T17:34:01.879056] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:01.879380] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-25T17:34:01.879428] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-25T17:34:01.879747] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-25T17:34:01.879806] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-25T17:34:02.250272] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:02.288697] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-25T17:34:03.088775] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-25T17:34:03.224491] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:34:03.298117] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T17:34:03.709860] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T17:34:03.888748] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-25T17:34:04.384088] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T17:34:04.688741] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-25T17:34:05.273813] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T17:34:05.488689] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-25T17:34:06.288700] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-25T17:34:06.369817] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T17:34:07.026426] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T17:34:07.088731] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-25T17:34:07.699724] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T17:34:07.888782] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-25T17:34:08.688717] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-25T17:34:08.746013] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T17:34:09.404334] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T17:34:09.488700] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-25T17:34:10.288754] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-25T17:34:10.350407] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T17:34:11.088727] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-25T17:34:11.133151] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T17:34:11.616245] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-25T17:34:11.888721] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-25T17:34:12.688777] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-25T17:34:13.488709] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-25T17:34:13.683458] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T17:34:13.759373] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T17:34:14.072982] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T17:34:14.288725] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-25T17:34:15.088875] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-25T17:34:15.852298] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:34:15.888672] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-25T17:34:16.357103] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T17:34:16.688724] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-25T17:34:17.159445] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:34:17.165136] [INFO ] [REMOTE ] BGSF: Full fetch complete (8118 records). [2025-09-25T17:34:17.165295] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-25T17:34:17.166489] [FATAL] [VALIDATOR ] BGSF: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:34:17.166766] [FATAL] [MAIN ] BGSF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:34:17.166854] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:34:17.166975] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-25T17:34:17.167085] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-09-25T17:34:17.167162] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-09-25T17:34:17.167834] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-09-25T17:34:17.168106] [INFO ] [MAIN ] Update Progress: 262/2372 symbols completed. BGSF took 24.8s. Estimated remaining: 4h 35m 43s. Rate: 7.7 symbols/min [2025-09-25T17:34:17.427728] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:17.494233] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-25T17:34:17.503899] [DEBUG] [LOCAL ] BGY: Loaded 22545 existing records from primary storage. [2025-09-25T17:34:17.504180] [INFO ] [MAIN ] BGY: Loaded 22545 existing records. [2025-09-25T17:34:17.709529] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T17:34:17.946964] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:17.947799] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-25T17:34:17.947884] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-25T17:34:17.948451] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-25T17:34:17.948532] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-25T17:34:18.298034] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-25T17:34:18.382186] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T17:34:18.510471] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:19.088725] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-25T17:34:19.148397] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:34:19.888733] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-25T17:34:20.125949] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T17:34:20.688726] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-25T17:34:21.488215] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T17:34:21.499186] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-25T17:34:21.767947] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T17:34:22.288878] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-25T17:34:22.571400] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T17:34:23.088783] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-25T17:34:23.888698] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-25T17:34:24.137608] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T17:34:24.378305] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T17:34:24.494725] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-25T17:34:24.504440] [INFO ] [REMOTE ] BGS: Full fetch complete (72513 records). [2025-09-25T17:34:24.504570] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-25T17:34:24.690384] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-25T17:34:24.930668] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-25T17:34:24.930767] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-25T17:34:24.931570] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-25T17:34:24.931635] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-25T17:34:24.934904] [DEBUG] [LOCAL ] BGS: Trimmed 72513 records to 50823 (keeping 200 days of data) [2025-09-25T17:34:25.250240] [DEBUG] [LOCAL ] BGS: Primary data saved (50823 records). [2025-09-25T17:34:25.250389] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-25T17:34:25.250522] [INFO ] [MAIN ] Update Progress: 263/2372 symbols completed. BGS took 39.7s. Estimated remaining: 4h 35m 37s. Rate: 7.7 symbols/min [2025-09-25T17:34:25.444090] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:25.444266] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-09-25T17:34:25.444305] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-09-25T17:34:25.444717] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-25T17:34:25.444782] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-25T17:34:25.444851] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-09-25T17:34:25.444898] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-25T17:34:25.499724] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-25T17:34:25.763902] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T17:34:25.899084] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:26.288690] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-25T17:34:26.490720] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T17:34:26.717432] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-25T17:34:27.088715] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-25T17:34:27.888701] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-25T17:34:28.253362] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T17:34:28.688684] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-25T17:34:28.719233] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T17:34:29.488683] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-25T17:34:29.776509] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T17:34:30.179479] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T17:34:30.182209] [INFO ] [REMOTE ] BGX: Full fetch complete (15775 records). [2025-09-25T17:34:30.182284] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-25T17:34:30.293809] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-25T17:34:30.559229] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-25T17:34:30.559327] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-25T17:34:30.559664] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-25T17:34:30.559725] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-25T17:34:30.560406] [DEBUG] [LOCAL ] BGX: Trimmed 15775 records to 10782 (keeping 200 days of data) [2025-09-25T17:34:30.636787] [DEBUG] [LOCAL ] BGX: Primary data saved (10782 records). [2025-09-25T17:34:30.636943] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-25T17:34:30.637044] [INFO ] [MAIN ] Update Progress: 264/2372 symbols completed. BGX took 29.2s. Estimated remaining: 4h 35m 10s. Rate: 7.7 symbols/min [2025-09-25T17:34:30.822771] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:30.892328] [DEBUG] [LOCAL ] BHC: Loaded 46794 existing records from primary storage. [2025-09-25T17:34:30.892494] [INFO ] [MAIN ] BHC: Loaded 46794 existing records. [2025-09-25T17:34:31.085162] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:31.086480] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-25T17:34:31.086533] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-25T17:34:31.086853] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-25T17:34:31.086911] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-25T17:34:31.101705] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-25T17:34:31.309461] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T17:34:31.340930] [INFO ] [REMOTE ] BGT: Full fetch complete (24229 records). [2025-09-25T17:34:31.341083] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-25T17:34:31.341794] [FATAL] [VALIDATOR ] BGT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:34:31.342283] [FATAL] [MAIN ] BGT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:34:31.342483] [WARN ] [MAIN ] BGT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:34:31.376749] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-25T17:34:31.376851] [DEBUG] [LOCAL ] BGT: No primary data file found to delete. [2025-09-25T17:34:31.376912] [INFO ] [LOCAL ] BGT: Starting deletion of derivative data. [2025-09-25T17:34:31.377263] [DEBUG] [LOCAL ] BGT: Deleted derivative data file. [2025-09-25T17:34:31.377402] [INFO ] [MAIN ] Update Progress: 265/2372 symbols completed. BGT took 36.0s. Estimated remaining: 4h 34m 5s. Rate: 7.7 symbols/min [2025-09-25T17:34:31.700258] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:31.702018] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:31.742533] [DEBUG] [LOCAL ] BHE: Loaded 25094 existing records from primary storage. [2025-09-25T17:34:31.742702] [INFO ] [MAIN ] BHE: Loaded 25094 existing records. [2025-09-25T17:34:31.891012] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-25T17:34:31.927720] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T17:34:31.944968] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:31.945322] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-25T17:34:31.945372] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-25T17:34:31.945690] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-25T17:34:31.945751] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-25T17:34:32.334600] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:32.688743] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-25T17:34:33.104889] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T17:34:33.488788] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-25T17:34:33.938216] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T17:34:34.072421] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T17:34:34.288736] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-25T17:34:35.088750] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-25T17:34:35.232667] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:34:35.888813] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-25T17:34:36.334626] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T17:34:36.619593] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T17:34:36.688756] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-25T17:34:37.484671] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T17:34:37.488720] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-25T17:34:38.288776] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-25T17:34:38.679311] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:34:39.088750] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-25T17:34:39.374722] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T17:34:39.741111] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T17:34:39.888724] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-25T17:34:40.688779] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-25T17:34:40.994934] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T17:34:41.488854] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-25T17:34:41.664993] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T17:34:42.288823] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-25T17:34:42.618851] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T17:34:42.624102] [INFO ] [REMOTE ] BGY: Full fetch complete (33327 records). [2025-09-25T17:34:42.624326] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-25T17:34:43.043979] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-25T17:34:43.044078] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-25T17:34:43.044550] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-25T17:34:43.044767] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-25T17:34:43.045702] [DEBUG] [LOCAL ] BGY: Trimmed 33327 records to 22657 (keeping 200 days of data) [2025-09-25T17:34:43.106000] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-25T17:34:43.208557] [DEBUG] [LOCAL ] BGY: Primary data saved (22657 records). [2025-09-25T17:34:43.208735] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-25T17:34:43.209022] [INFO ] [MAIN ] Update Progress: 266/2372 symbols completed. BGY took 26.0s. Estimated remaining: 4h 34m 29s. Rate: 7.7 symbols/min [2025-09-25T17:34:43.312633] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T17:34:43.432219] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:43.468172] [DEBUG] [LOCAL ] BHK: Loaded 22541 existing records from primary storage. [2025-09-25T17:34:43.468316] [INFO ] [MAIN ] BHK: Loaded 22541 existing records. [2025-09-25T17:34:43.665447] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:43.665852] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-25T17:34:43.665924] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-25T17:34:43.666252] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-25T17:34:43.666321] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-25T17:34:43.857248] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T17:34:43.890292] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-25T17:34:44.092237] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:44.688726] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-25T17:34:44.785286] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T17:34:45.488745] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-25T17:34:46.288707] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-25T17:34:46.494784] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T17:34:46.525373] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T17:34:47.049739] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:34:47.088721] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-25T17:34:47.888903] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-25T17:34:48.679553] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T17:34:48.690974] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-25T17:34:49.285029] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T17:34:49.488693] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-25T17:34:49.613797] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T17:34:50.289040] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-25T17:34:51.043395] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:34:51.088725] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-25T17:34:51.636913] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T17:34:51.641069] [INFO ] [REMOTE ] BH: Full fetch complete (19395 records). [2025-09-25T17:34:51.641222] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-25T17:34:51.892122] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-25T17:34:52.038399] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-25T17:34:52.038499] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-25T17:34:52.038904] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-25T17:34:52.038970] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-25T17:34:52.040144] [DEBUG] [LOCAL ] BH: Trimmed 19395 records to 15800 (keeping 200 days of data) [2025-09-25T17:34:52.154280] [DEBUG] [LOCAL ] BH: Primary data saved (15800 records). [2025-09-25T17:34:52.154431] [INFO ] [MAIN ] BH: Full history saved. [2025-09-25T17:34:52.154540] [INFO ] [MAIN ] Update Progress: 267/2372 symbols completed. BH took 26.9s. Estimated remaining: 4h 34m 30s. Rate: 7.7 symbols/min [2025-09-25T17:34:52.331303] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:34:52.411132] [DEBUG] [LOCAL ] BHP: Loaded 53374 existing records from primary storage. [2025-09-25T17:34:52.411287] [INFO ] [MAIN ] BHP: Loaded 53374 existing records. [2025-09-25T17:34:52.573494] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T17:34:52.672269] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:34:52.674837] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-25T17:34:52.674900] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-25T17:34:52.675281] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-25T17:34:52.675355] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-25T17:34:52.697450] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-25T17:34:53.060270] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:34:53.204854] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T17:34:53.266015] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T17:34:53.488732] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-25T17:34:54.288719] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-25T17:34:55.088725] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-25T17:34:55.263397] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T17:34:55.888618] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T17:34:55.895668] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-25T17:34:55.973402] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T17:34:56.688710] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-25T17:34:57.488728] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-25T17:34:57.883214] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T17:34:58.097075] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T17:34:58.136980] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T17:34:58.288738] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-25T17:34:59.088712] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-25T17:34:59.888780] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-25T17:35:00.016712] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T17:35:00.688712] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-25T17:35:00.954510] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T17:35:01.024415] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T17:35:01.488738] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-25T17:35:02.288730] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-25T17:35:02.629004] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T17:35:03.088728] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-25T17:35:03.410313] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T17:35:03.436352] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:35:03.888758] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-25T17:35:04.688768] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-25T17:35:04.774255] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T17:35:04.791884] [INFO ] [REMOTE ] BHC: Full fetch complete (66828 records). [2025-09-25T17:35:04.792066] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-25T17:35:05.068745] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T17:35:05.289743] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-25T17:35:05.289892] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-25T17:35:05.290902] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-25T17:35:05.291039] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-25T17:35:05.294910] [DEBUG] [LOCAL ] BHC: Trimmed 66828 records to 47170 (keeping 200 days of data) [2025-09-25T17:35:05.500594] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-25T17:35:05.637865] [DEBUG] [LOCAL ] BHC: Primary data saved (47170 records). [2025-09-25T17:35:05.638042] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-25T17:35:05.638234] [INFO ] [MAIN ] Update Progress: 268/2372 symbols completed. BHC took 35.0s. Estimated remaining: 4h 35m 7s. Rate: 7.6 symbols/min [2025-09-25T17:35:05.826593] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T17:35:05.858439] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:05.889436] [DEBUG] [LOCAL ] BHR: Loaded 21489 existing records from primary storage. [2025-09-25T17:35:05.889609] [INFO ] [MAIN ] BHR: Loaded 21489 existing records. [2025-09-25T17:35:06.074136] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:35:06.074469] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-25T17:35:06.074517] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-25T17:35:06.077333] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-25T17:35:06.077413] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-25T17:35:06.288987] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-25T17:35:06.479749] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:07.088739] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-25T17:35:07.558779] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T17:35:07.738932] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T17:35:07.888741] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-25T17:35:08.335351] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T17:35:08.688706] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-25T17:35:09.274518] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T17:35:09.279871] [INFO ] [REMOTE ] BHK: Full fetch complete (29804 records). [2025-09-25T17:35:09.279952] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-25T17:35:09.489250] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-25T17:35:09.747533] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-25T17:35:09.747624] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-25T17:35:09.748138] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-25T17:35:09.748212] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-25T17:35:09.749372] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T17:35:09.753325] [DEBUG] [LOCAL ] BHK: Trimmed 29804 records to 22729 (keeping 200 days of data) [2025-09-25T17:35:09.918341] [DEBUG] [LOCAL ] BHK: Primary data saved (22729 records). [2025-09-25T17:35:09.918752] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-25T17:35:09.918928] [INFO ] [MAIN ] Update Progress: 269/2372 symbols completed. BHK took 26.7s. Estimated remaining: 4h 34m 31s. Rate: 7.7 symbols/min [2025-09-25T17:35:10.132637] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:10.132889] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-25T17:35:10.132954] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-25T17:35:10.134256] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-25T17:35:10.134325] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-25T17:35:10.134397] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-25T17:35:10.134455] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-25T17:35:10.294912] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-25T17:35:10.776962] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:10.798283] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T17:35:11.088737] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-25T17:35:11.402707] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T17:35:11.888759] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-25T17:35:12.300153] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T17:35:12.306237] [INFO ] [REMOTE ] BHE: Full fetch complete (36529 records). [2025-09-25T17:35:12.306369] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-25T17:35:12.689105] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-25T17:35:12.690603] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-25T17:35:12.690686] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-25T17:35:12.691398] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-25T17:35:12.691479] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-25T17:35:12.703394] [DEBUG] [LOCAL ] BHE: Trimmed 36529 records to 25227 (keeping 200 days of data) [2025-09-25T17:35:12.886132] [DEBUG] [LOCAL ] BHE: Primary data saved (25227 records). [2025-09-25T17:35:12.886276] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-25T17:35:12.886399] [INFO ] [MAIN ] Update Progress: 270/2372 symbols completed. BHE took 41.5s. Estimated remaining: 4h 33m 46s. Rate: 7.7 symbols/min [2025-09-25T17:35:13.063492] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:13.127522] [DEBUG] [LOCAL ] BHVN: Loaded 49636 existing records from primary storage. [2025-09-25T17:35:13.127700] [INFO ] [MAIN ] BHVN: Loaded 49636 existing records. [2025-09-25T17:35:13.219935] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-25T17:35:13.348066] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:35:13.348325] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-25T17:35:13.348372] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-25T17:35:13.348991] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-25T17:35:13.349057] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-25T17:35:13.493801] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-25T17:35:13.796929] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:13.822008] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-25T17:35:13.876635] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T17:35:14.288959] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-25T17:35:14.655997] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-25T17:35:15.088734] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-25T17:35:15.888748] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-25T17:35:16.688865] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-25T17:35:17.036904] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-25T17:35:17.316944] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-25T17:35:17.382314] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T17:35:17.488753] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-25T17:35:18.288757] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-25T17:35:18.438766] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T17:35:18.571256] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-25T17:35:19.088755] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-25T17:35:19.888790] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-25T17:35:20.668413] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:35:20.688671] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-25T17:35:21.109686] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T17:35:21.202728] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T17:35:21.488733] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-25T17:35:22.288722] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-25T17:35:22.956736] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T17:35:23.088753] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-25T17:35:23.406103] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T17:35:23.523757] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T17:35:23.888730] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-25T17:35:24.688730] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-25T17:35:24.846029] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T17:35:25.488706] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-25T17:35:25.845381] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-25T17:35:26.092317] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T17:35:26.288704] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-25T17:35:26.634301] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T17:35:27.088721] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-25T17:35:27.888729] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-25T17:35:28.426416] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T17:35:28.427373] [INFO ] [REMOTE ] BHV: Full fetch complete (1376 records). [2025-09-25T17:35:28.427467] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-25T17:35:28.651148] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-25T17:35:28.651718] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:35:28.651819] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:35:28.651942] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-25T17:35:28.652089] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-25T17:35:28.652164] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-25T17:35:28.652246] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-25T17:35:28.652353] [INFO ] [MAIN ] Update Progress: 271/2372 symbols completed. BHV took 18.7s. Estimated remaining: 4h 34m 39s. Rate: 7.6 symbols/min [2025-09-25T17:35:28.697757] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-25T17:35:28.839791] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:28.927608] [DEBUG] [LOCAL ] BILL: Loaded 52325 existing records from primary storage. [2025-09-25T17:35:28.927781] [INFO ] [MAIN ] BILL: Loaded 52325 existing records. [2025-09-25T17:35:28.948240] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T17:35:29.135521] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:35:29.135861] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-25T17:35:29.135910] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-25T17:35:29.136407] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-25T17:35:29.136476] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-25T17:35:29.493803] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-25T17:35:29.559987] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:30.288714] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-25T17:35:30.361541] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T17:35:30.527033] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T17:35:31.088706] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-25T17:35:31.888703] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-25T17:35:32.102916] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T17:35:32.688694] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-25T17:35:32.779082] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:35:33.464402] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T17:35:33.488730] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-25T17:35:34.152958] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T17:35:34.288725] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-25T17:35:35.088744] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-25T17:35:35.305834] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T17:35:35.888744] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-25T17:35:36.266512] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T17:35:36.280245] [INFO ] [REMOTE ] BHP: Full fetch complete (77235 records). [2025-09-25T17:35:36.280448] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-25T17:35:36.689934] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-25T17:35:36.728252] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T17:35:36.793675] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-25T17:35:36.793778] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-25T17:35:36.794724] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-25T17:35:36.794800] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-25T17:35:36.796582] [DEBUG] [LOCAL ] BHP: Trimmed 77235 records to 53763 (keeping 200 days of data) [2025-09-25T17:35:37.152297] [DEBUG] [LOCAL ] BHP: Primary data saved (53763 records). [2025-09-25T17:35:37.152444] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-25T17:35:37.152532] [INFO ] [MAIN ] Update Progress: 272/2372 symbols completed. BHP took 45.0s. Estimated remaining: 4h 34m 37s. Rate: 7.6 symbols/min [2025-09-25T17:35:37.348739] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:37.381319] [DEBUG] [LOCAL ] BIO: Loaded 25314 existing records from primary storage. [2025-09-25T17:35:37.381451] [INFO ] [MAIN ] BIO: Loaded 25314 existing records. [2025-09-25T17:35:37.506394] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-25T17:35:37.560672] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T17:35:37.636413] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:35:37.636869] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-25T17:35:37.636931] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-25T17:35:37.637280] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-25T17:35:37.637340] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-25T17:35:37.672305] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T17:35:38.023983] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:38.288729] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-25T17:35:39.088694] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-25T17:35:39.201770] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T17:35:39.224466] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T17:35:39.888706] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-25T17:35:40.570161] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T17:35:40.592480] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T17:35:40.688718] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-25T17:35:41.488725] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-25T17:35:41.690618] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-25T17:35:42.288816] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-25T17:35:43.088683] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-25T17:35:43.615713] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-25T17:35:43.888756] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-25T17:35:44.224814] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:35:44.236370] [INFO ] [REMOTE ] BHVN: Full fetch complete (69528 records). [2025-09-25T17:35:44.236498] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-25T17:35:44.558819] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T17:35:44.678142] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-25T17:35:44.678249] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-25T17:35:44.679097] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-25T17:35:44.679170] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-25T17:35:44.680803] [DEBUG] [LOCAL ] BHVN: Trimmed 69528 records to 50018 (keeping 200 days of data) [2025-09-25T17:35:44.742112] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-25T17:35:45.020968] [DEBUG] [LOCAL ] BHVN: Primary data saved (50018 records). [2025-09-25T17:35:45.021155] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-25T17:35:45.022905] [INFO ] [MAIN ] Update Progress: 273/2372 symbols completed. BHVN took 32.1s. Estimated remaining: 4h 34m 29s. Rate: 7.6 symbols/min [2025-09-25T17:35:45.202510] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:45.202749] [DEBUG] [LOCAL ] BIP: No existing data file found in primary storage. [2025-09-25T17:35:45.202805] [WARN ] [MAIN ] BIP: No existing data found, performing full refresh instead. [2025-09-25T17:35:45.202971] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-25T17:35:45.203040] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-25T17:35:45.203092] [DEBUG] [LOCAL ] BIP: No primary data file found to delete. [2025-09-25T17:35:45.203127] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-25T17:35:45.500064] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-25T17:35:45.628944] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:45.821858] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T17:35:46.130039] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T17:35:46.288737] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-25T17:35:46.786783] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T17:35:46.793934] [INFO ] [REMOTE ] BHR: Full fetch complete (30570 records). [2025-09-25T17:35:46.794029] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-25T17:35:47.097728] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-25T17:35:47.267061] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-25T17:35:47.267395] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-25T17:35:47.267909] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-25T17:35:47.268005] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-25T17:35:47.268901] [DEBUG] [LOCAL ] BHR: Trimmed 30570 records to 21634 (keeping 200 days of data) [2025-09-25T17:35:47.410044] [DEBUG] [LOCAL ] BHR: Primary data saved (21634 records). [2025-09-25T17:35:47.410177] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-25T17:35:47.410286] [INFO ] [MAIN ] Update Progress: 274/2372 symbols completed. BHR took 41.8s. Estimated remaining: 4h 33m 39s. Rate: 7.7 symbols/min [2025-09-25T17:35:47.587451] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:35:47.630352] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T17:35:47.667193] [DEBUG] [LOCAL ] BIPC: Loaded 41668 existing records from primary storage. [2025-09-25T17:35:47.667340] [INFO ] [MAIN ] BIPC: Loaded 41668 existing records. [2025-09-25T17:35:47.845916] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:35:47.846217] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-25T17:35:47.846263] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-25T17:35:47.846886] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-25T17:35:47.846959] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-25T17:35:47.889714] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-25T17:35:48.221008] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:35:48.569332] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T17:35:48.688683] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-25T17:35:48.925064] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:35:49.488731] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-25T17:35:50.083257] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T17:35:50.288700] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-25T17:35:51.088685] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-25T17:35:51.226799] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T17:35:51.314436] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T17:35:51.888711] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-25T17:35:52.369548] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T17:35:52.688718] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-25T17:35:53.321703] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T17:35:53.488817] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-25T17:35:53.886011] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:35:54.288857] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-25T17:35:54.913472] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T17:35:55.088756] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-25T17:35:55.409199] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T17:35:55.888728] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-25T17:35:56.688901] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-25T17:35:56.828887] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T17:35:57.488703] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-25T17:35:57.622079] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T17:35:57.707018] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T17:35:58.288769] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-25T17:35:59.088769] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-25T17:35:59.430811] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:35:59.444948] [INFO ] [REMOTE ] BILL: Full fetch complete (75590 records). [2025-09-25T17:35:59.445136] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-25T17:35:59.906446] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T17:35:59.919233] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-25T17:35:59.963627] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-25T17:35:59.963748] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-25T17:35:59.964663] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-25T17:35:59.964757] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-25T17:35:59.966321] [DEBUG] [LOCAL ] BILL: Trimmed 75590 records to 52715 (keeping 200 days of data) [2025-09-25T17:36:00.290916] [DEBUG] [LOCAL ] BILL: Primary data saved (52715 records). [2025-09-25T17:36:00.291068] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-25T17:36:00.291202] [INFO ] [MAIN ] Update Progress: 275/2372 symbols completed. BILL took 31.6s. Estimated remaining: 4h 34m 10s. Rate: 7.6 symbols/min [2025-09-25T17:36:00.472415] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:00.472594] [DEBUG] [LOCAL ] BIPH: No existing data file found in primary storage. [2025-09-25T17:36:00.472632] [WARN ] [MAIN ] BIPH: No existing data found, performing full refresh instead. [2025-09-25T17:36:00.474022] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-25T17:36:00.474086] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-25T17:36:00.474296] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-09-25T17:36:00.474368] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-25T17:36:00.696690] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-25T17:36:00.795984] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:36:00.918267] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:00.944365] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T17:36:01.488707] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-25T17:36:02.244460] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:36:02.288687] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-25T17:36:02.877957] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T17:36:03.088813] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-25T17:36:03.438198] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:36:03.888733] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-25T17:36:04.656386] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:36:04.688683] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-25T17:36:05.340134] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T17:36:05.408990] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T17:36:05.488690] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-25T17:36:06.288702] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-25T17:36:06.769490] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T17:36:06.878948] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T17:36:07.088700] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-25T17:36:07.888698] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-25T17:36:08.230378] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T17:36:08.238300] [INFO ] [REMOTE ] BIO: Full fetch complete (34167 records). [2025-09-25T17:36:08.238512] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-25T17:36:08.400262] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T17:36:08.677609] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-25T17:36:08.677725] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-25T17:36:08.678227] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-25T17:36:08.678270] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-25T17:36:08.679685] [DEBUG] [LOCAL ] BIO: Trimmed 34167 records to 25432 (keeping 200 days of data) [2025-09-25T17:36:08.688776] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-25T17:36:08.885891] [DEBUG] [LOCAL ] BIO: Primary data saved (25432 records). [2025-09-25T17:36:08.886036] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-25T17:36:08.886175] [INFO ] [MAIN ] Update Progress: 276/2372 symbols completed. BIO took 31.7s. Estimated remaining: 4h 34m 8s. Rate: 7.6 symbols/min [2025-09-25T17:36:09.069877] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:09.083537] [DEBUG] [LOCAL ] BIPI: Loaded 3248 existing records from primary storage. [2025-09-25T17:36:09.083672] [INFO ] [MAIN ] BIPI: Loaded 3248 existing records. [2025-09-25T17:36:09.286577] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:09.287008] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-25T17:36:09.287096] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-25T17:36:09.287411] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-25T17:36:09.287475] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-25T17:36:09.494715] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-25T17:36:09.681679] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:09.906421] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-25T17:36:10.260215] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T17:36:10.288714] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-25T17:36:11.088743] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-25T17:36:11.427437] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T17:36:11.691368] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T17:36:11.888723] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-25T17:36:12.688710] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-25T17:36:13.067994] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-25T17:36:13.488749] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-25T17:36:13.612730] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T17:36:13.626790] [INFO ] [REMOTE ] BIP: Full fetch complete (56503 records). [2025-09-25T17:36:13.626960] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-25T17:36:13.947145] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T17:36:14.048956] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-25T17:36:14.049040] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-25T17:36:14.049677] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-25T17:36:14.049744] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-25T17:36:14.050935] [DEBUG] [LOCAL ] BIP: Trimmed 56503 records to 39863 (keeping 200 days of data) [2025-09-25T17:36:14.295422] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-25T17:36:14.321094] [DEBUG] [LOCAL ] BIP: Primary data saved (39863 records). [2025-09-25T17:36:14.321229] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-25T17:36:14.321321] [INFO ] [MAIN ] Update Progress: 277/2372 symbols completed. BIP took 29.3s. Estimated remaining: 4h 33m 42s. Rate: 7.7 symbols/min [2025-09-25T17:36:14.789034] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T17:36:15.088708] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-25T17:36:15.888729] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-25T17:36:16.641300] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T17:36:16.688675] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-25T17:36:16.720915] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T17:36:17.223861] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T17:36:17.488725] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-25T17:36:17.984147] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T17:36:18.288700] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-25T17:36:19.088724] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-25T17:36:19.530409] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T17:36:19.602582] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T17:36:19.604638] [INFO ] [REMOTE ] BIPH: Full fetch complete (4308 records). [2025-09-25T17:36:19.604734] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-25T17:36:19.891571] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-25T17:36:19.979911] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-25T17:36:19.980050] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-25T17:36:19.980256] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-25T17:36:19.980298] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-25T17:36:19.984062] [DEBUG] [LOCAL ] BIPH: Trimmed 4308 records to 2608 (keeping 200 days of data) [2025-09-25T17:36:20.006612] [DEBUG] [LOCAL ] BIPH: Primary data saved (2608 records). [2025-09-25T17:36:20.006801] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-25T17:36:20.006960] [INFO ] [MAIN ] Update Progress: 278/2372 symbols completed. BIPH took 19.7s. Estimated remaining: 4h 33m 18s. Rate: 7.7 symbols/min [2025-09-25T17:36:20.688727] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-25T17:36:21.364200] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T17:36:21.488712] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-25T17:36:21.621227] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T17:36:21.630221] [INFO ] [REMOTE ] BIPC: Full fetch complete (59655 records). [2025-09-25T17:36:21.630399] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-25T17:36:22.048330] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-25T17:36:22.048426] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-25T17:36:22.049405] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-25T17:36:22.049497] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-25T17:36:22.051382] [DEBUG] [LOCAL ] BIPC: Trimmed 59655 records to 42014 (keeping 200 days of data) [2025-09-25T17:36:22.163321] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-25T17:36:22.291263] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-25T17:36:22.345028] [DEBUG] [LOCAL ] BIPC: Primary data saved (42014 records). [2025-09-25T17:36:22.345161] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-25T17:36:22.345266] [INFO ] [MAIN ] Update Progress: 279/2372 symbols completed. BIPC took 34.9s. Estimated remaining: 4h 32m 29s. Rate: 7.7 symbols/min [2025-09-25T17:36:22.708182] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T17:36:23.088733] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-25T17:36:23.546030] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T17:36:23.888873] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-25T17:36:24.411864] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T17:36:24.688817] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-25T17:36:25.266591] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T17:36:25.488778] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-25T17:36:26.140677] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T17:36:26.143494] [INFO ] [REMOTE ] BIPI: Full fetch complete (5239 records). [2025-09-25T17:36:26.143760] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-25T17:36:26.584581] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-25T17:36:26.584766] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-25T17:36:26.585028] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-25T17:36:26.585168] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-25T17:36:26.585741] [DEBUG] [LOCAL ] BIPI: Trimmed 5239 records to 3269 (keeping 200 days of data) [2025-09-25T17:36:26.613112] [DEBUG] [LOCAL ] BIPI: Primary data saved (3269 records). [2025-09-25T17:36:26.613329] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-25T17:36:26.613569] [INFO ] [MAIN ] Update Progress: 280/2372 symbols completed. BIPI took 17.7s. Estimated remaining: 4h 31m 55s. Rate: 7.7 symbols/min [2025-09-25T17:36:27.301243] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:27.462952] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:27.479263] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:27.482467] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:27.537083] [DEBUG] [LOCAL ] BIPJ: Loaded 2962 existing records from primary storage. [2025-09-25T17:36:27.537248] [INFO ] [MAIN ] BIPJ: Loaded 2962 existing records. [2025-09-25T17:36:27.599343] [DEBUG] [LOCAL ] BIRK: Loaded 50906 existing records from primary storage. [2025-09-25T17:36:27.599545] [INFO ] [MAIN ] BIRK: Loaded 50906 existing records. [2025-09-25T17:36:27.613984] [DEBUG] [LOCAL ] BIT: Loaded 22357 existing records from primary storage. [2025-09-25T17:36:27.620028] [INFO ] [MAIN ] BIT: Loaded 22357 existing records. [2025-09-25T17:36:27.877245] [DEBUG] [LOCAL ] BJ: Loaded 51395 existing records from primary storage. [2025-09-25T17:36:27.937773] [INFO ] [MAIN ] BJ: Loaded 51395 existing records. [2025-09-25T17:36:28.314214] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:28.314619] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-25T17:36:28.314709] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-25T17:36:28.315215] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-25T17:36:28.315291] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-25T17:36:28.334638] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:28.334947] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-25T17:36:28.334998] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-25T17:36:28.335276] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-25T17:36:28.335335] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-25T17:36:28.519487] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:28.535199] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-25T17:36:28.535300] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-25T17:36:28.535727] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-25T17:36:28.535792] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-25T17:36:28.707857] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:28.712804] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-25T17:36:28.712858] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-25T17:36:28.713177] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-25T17:36:28.713235] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-25T17:36:29.812329] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:29.832109] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-25T17:36:30.060907] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:30.061268] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-25T17:36:30.101104] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:30.101375] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-25T17:36:30.130233] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:30.130633] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-25T17:36:30.556535] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T17:36:30.558492] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-25T17:36:31.093798] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-25T17:36:31.095224] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-25T17:36:31.102908] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T17:36:31.107772] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-25T17:36:31.279599] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T17:36:31.499516] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T17:36:31.717776] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T17:36:31.888690] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-25T17:36:32.177390] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T17:36:32.688757] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-25T17:36:33.387053] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T17:36:33.488731] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-25T17:36:33.934069] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T17:36:34.288753] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-25T17:36:35.047283] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:36:35.088714] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-25T17:36:35.798197] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T17:36:35.888722] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-25T17:36:36.424217] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:36:36.688775] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-25T17:36:37.226666] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:36:37.488713] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-25T17:36:37.661688] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T17:36:38.288734] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-25T17:36:38.812155] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T17:36:39.088716] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-25T17:36:39.244387] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T17:36:39.888728] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-25T17:36:40.688704] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-25T17:36:40.771160] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T17:36:40.882899] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T17:36:41.488705] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-25T17:36:42.245458] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-25T17:36:42.288676] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-25T17:36:42.562553] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T17:36:43.088733] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-25T17:36:43.223918] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:36:43.654121] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T17:36:43.888725] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-25T17:36:44.688703] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-25T17:36:45.269122] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T17:36:45.488692] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-25T17:36:46.288716] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-25T17:36:46.469250] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T17:36:46.623256] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T17:36:47.088727] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-25T17:36:47.658729] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T17:36:47.888728] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-25T17:36:47.950799] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T17:36:48.688724] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-25T17:36:48.806244] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T17:36:49.143886] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T17:36:49.488738] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-25T17:36:50.288721] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-25T17:36:50.620175] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T17:36:50.628019] [INFO ] [REMOTE ] BIT: Full fetch complete (31221 records). [2025-09-25T17:36:50.628178] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-25T17:36:51.019173] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-25T17:36:51.019274] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-25T17:36:51.019728] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-25T17:36:51.019790] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-25T17:36:51.020515] [DEBUG] [LOCAL ] BIT: Trimmed 31221 records to 22535 (keeping 200 days of data) [2025-09-25T17:36:51.094719] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-25T17:36:51.187824] [DEBUG] [LOCAL ] BIT: Primary data saved (22535 records). [2025-09-25T17:36:51.187971] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-25T17:36:51.188109] [INFO ] [MAIN ] Update Progress: 281/2372 symbols completed. BIT took 24.6s. Estimated remaining: 4h 33m 52s. Rate: 7.6 symbols/min [2025-09-25T17:36:51.359666] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:51.432882] [DEBUG] [LOCAL ] BK: Loaded 53553 existing records from primary storage. [2025-09-25T17:36:51.433033] [INFO ] [MAIN ] BK: Loaded 53553 existing records. [2025-09-25T17:36:51.623159] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:51.623757] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-25T17:36:51.623836] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-25T17:36:51.624233] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-25T17:36:51.624311] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-25T17:36:51.891953] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-25T17:36:52.038409] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:52.270831] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T17:36:52.302886] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T17:36:52.629593] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T17:36:52.688791] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-25T17:36:53.488739] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-25T17:36:54.289103] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-25T17:36:54.295401] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:36:54.329595] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:36:55.088733] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-25T17:36:55.888745] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-25T17:36:56.077220] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T17:36:56.086733] [INFO ] [REMOTE ] BIRK: Full fetch complete (72874 records). [2025-09-25T17:36:56.086848] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-25T17:36:56.199615] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-25T17:36:56.494217] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-25T17:36:56.494301] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-25T17:36:56.495112] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-25T17:36:56.495177] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-25T17:36:56.496674] [DEBUG] [LOCAL ] BIRK: Trimmed 72874 records to 51295 (keeping 200 days of data) [2025-09-25T17:36:56.688821] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-25T17:36:56.780301] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:36:56.918458] [DEBUG] [LOCAL ] BIRK: Primary data saved (51295 records). [2025-09-25T17:36:56.921669] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-25T17:36:56.921853] [INFO ] [MAIN ] Update Progress: 282/2372 symbols completed. BIRK took 30.3s. Estimated remaining: 4h 33m 28s. Rate: 7.6 symbols/min [2025-09-25T17:36:57.107677] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:57.165912] [DEBUG] [LOCAL ] BKD: Loaded 50137 existing records from primary storage. [2025-09-25T17:36:57.166059] [INFO ] [MAIN ] BKD: Loaded 50137 existing records. [2025-09-25T17:36:57.353605] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:57.353908] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-25T17:36:57.353955] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-25T17:36:57.354257] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-25T17:36:57.354317] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-25T17:36:57.493775] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-25T17:36:57.636741] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T17:36:57.638095] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4350 records). [2025-09-25T17:36:57.638166] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-25T17:36:57.878898] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:58.168211] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-25T17:36:58.168299] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-25T17:36:58.168444] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-25T17:36:58.168512] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-25T17:36:58.169350] [DEBUG] [LOCAL ] BIPJ: Trimmed 4350 records to 3002 (keeping 200 days of data) [2025-09-25T17:36:58.190176] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3002 records). [2025-09-25T17:36:58.190245] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-25T17:36:58.190327] [INFO ] [MAIN ] Update Progress: 283/2372 symbols completed. BIPJ took 31.5s. Estimated remaining: 4h 32m 32s. Rate: 7.7 symbols/min [2025-09-25T17:36:58.290568] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-25T17:36:58.371275] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:36:58.442346] [DEBUG] [LOCAL ] BKE: Loaded 34750 existing records from primary storage. [2025-09-25T17:36:58.442492] [INFO ] [MAIN ] BKE: Loaded 34750 existing records. [2025-09-25T17:36:58.620126] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:36:58.620486] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-25T17:36:58.620532] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-25T17:36:58.620825] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-25T17:36:58.620882] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-25T17:36:59.028035] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:36:59.088725] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-25T17:36:59.335869] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T17:36:59.483744] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T17:36:59.888708] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-25T17:37:00.628493] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:37:00.688724] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-25T17:37:01.488815] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-25T17:37:01.639257] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T17:37:01.651187] [INFO ] [REMOTE ] BJ: Full fetch complete (73756 records). [2025-09-25T17:37:01.651382] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-25T17:37:02.097287] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-25T17:37:02.097389] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-25T17:37:02.098160] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-25T17:37:02.098257] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-25T17:37:02.100026] [DEBUG] [LOCAL ] BJ: Trimmed 73756 records to 51779 (keeping 200 days of data) [2025-09-25T17:37:02.300690] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-25T17:37:02.447902] [DEBUG] [LOCAL ] BJ: Primary data saved (51779 records). [2025-09-25T17:37:02.448104] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-25T17:37:02.448226] [INFO ] [MAIN ] Update Progress: 284/2372 symbols completed. BJ took 35.8s. Estimated remaining: 4h 31m 57s. Rate: 7.7 symbols/min [2025-09-25T17:37:02.578814] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T17:37:02.655014] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T17:37:02.736093] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:02.788800] [DEBUG] [LOCAL ] BKH: Loaded 36608 existing records from primary storage. [2025-09-25T17:37:02.788968] [INFO ] [MAIN ] BKH: Loaded 36608 existing records. [2025-09-25T17:37:02.971008] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:02.971346] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-25T17:37:02.971402] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-25T17:37:02.971732] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-25T17:37:02.971817] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-25T17:37:03.094707] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-25T17:37:03.338462] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:03.862070] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:37:03.888673] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-25T17:37:04.292137] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T17:37:04.688743] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-25T17:37:05.212508] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:37:05.488706] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-25T17:37:06.003276] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T17:37:06.288714] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-25T17:37:06.714928] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T17:37:07.088718] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-25T17:37:07.888823] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-25T17:37:08.073636] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T17:37:08.541619] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T17:37:08.688717] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-25T17:37:09.295497] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T17:37:09.488675] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-25T17:37:09.918756] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T17:37:10.288722] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-25T17:37:11.088729] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-25T17:37:11.129055] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T17:37:11.798553] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:37:11.888729] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-25T17:37:12.386294] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T17:37:12.688818] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-25T17:37:13.488746] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-25T17:37:13.553332] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T17:37:14.306218] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T17:37:14.313263] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-25T17:37:15.088741] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-25T17:37:15.197068] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T17:37:15.735034] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T17:37:15.888743] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-25T17:37:16.286897] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T17:37:16.688722] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-25T17:37:17.027747] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T17:37:17.488712] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-25T17:37:18.122156] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:37:18.288722] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-25T17:37:19.061935] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:37:19.088678] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-25T17:37:19.888705] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-25T17:37:19.985511] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T17:37:20.688784] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-25T17:37:20.901044] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T17:37:21.392703] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T17:37:21.488681] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-25T17:37:21.815211] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T17:37:22.288778] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-25T17:37:22.574394] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T17:37:23.088794] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-25T17:37:23.888759] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-25T17:37:24.123762] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T17:37:24.688756] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-25T17:37:25.310225] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T17:37:25.313466] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T17:37:25.330628] [INFO ] [REMOTE ] BK: Full fetch complete (77482 records). [2025-09-25T17:37:25.330868] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-25T17:37:25.494996] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-25T17:37:25.801554] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-25T17:37:25.801707] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-25T17:37:25.802691] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-25T17:37:25.802763] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-25T17:37:25.804984] [DEBUG] [LOCAL ] BK: Trimmed 77482 records to 53936 (keeping 200 days of data) [2025-09-25T17:37:26.189667] [DEBUG] [LOCAL ] BK: Primary data saved (53936 records). [2025-09-25T17:37:26.189878] [INFO ] [MAIN ] BK: Full history saved. [2025-09-25T17:37:26.190140] [INFO ] [MAIN ] Update Progress: 285/2372 symbols completed. BK took 35.0s. Estimated remaining: 4h 33m 46s. Rate: 7.6 symbols/min [2025-09-25T17:37:26.294720] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-25T17:37:26.406191] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:26.483100] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T17:37:26.512361] [INFO ] [REMOTE ] BKD: Full fetch complete (71517 records). [2025-09-25T17:37:26.512630] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-25T17:37:26.514027] [DEBUG] [LOCAL ] BKKT: Loaded 34400 existing records from primary storage. [2025-09-25T17:37:26.514121] [INFO ] [MAIN ] BKKT: Loaded 34400 existing records. [2025-09-25T17:37:26.903122] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T17:37:26.963519] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:26.986976] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-25T17:37:26.987100] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-25T17:37:26.987478] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-25T17:37:26.987561] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-25T17:37:27.131723] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-25T17:37:27.471407] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-25T17:37:27.471519] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-25T17:37:27.472448] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-25T17:37:27.472526] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-25T17:37:27.474426] [DEBUG] [LOCAL ] BKD: Trimmed 71517 records to 50514 (keeping 200 days of data) [2025-09-25T17:37:27.703914] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T17:37:27.782999] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:27.895751] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-25T17:37:28.007710] [DEBUG] [LOCAL ] BKD: Primary data saved (50514 records). [2025-09-25T17:37:28.007944] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-25T17:37:28.008128] [INFO ] [MAIN ] Update Progress: 286/2372 symbols completed. BKD took 31.1s. Estimated remaining: 4h 32m 54s. Rate: 7.6 symbols/min [2025-09-25T17:37:28.199383] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:28.217448] [DEBUG] [LOCAL ] BKN: Loaded 7731 existing records from primary storage. [2025-09-25T17:37:28.217668] [INFO ] [MAIN ] BKN: Loaded 7731 existing records. [2025-09-25T17:37:28.422973] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:28.423298] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-25T17:37:28.423346] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-25T17:37:28.424800] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-09-25T17:37:28.424872] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-25T17:37:28.663422] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:37:28.716756] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-25T17:37:28.948846] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:29.451992] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T17:37:29.459008] [INFO ] [REMOTE ] BKE: Full fetch complete (50220 records). [2025-09-25T17:37:29.459132] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-25T17:37:29.490242] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-25T17:37:29.893789] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-25T17:37:29.893909] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-25T17:37:29.894894] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-25T17:37:29.894964] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-25T17:37:29.896513] [DEBUG] [LOCAL ] BKE: Trimmed 50220 records to 34985 (keeping 200 days of data) [2025-09-25T17:37:30.131274] [DEBUG] [LOCAL ] BKE: Primary data saved (34985 records). [2025-09-25T17:37:30.131478] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-25T17:37:30.131608] [INFO ] [MAIN ] Update Progress: 287/2372 symbols completed. BKE took 31.9s. Estimated remaining: 4h 32m 5s. Rate: 7.7 symbols/min [2025-09-25T17:37:30.320889] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:30.294895] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-25T17:37:30.387023] [DEBUG] [LOCAL ] BKSY: Loaded 48281 existing records from primary storage. [2025-09-25T17:37:30.387272] [INFO ] [MAIN ] BKSY: Loaded 48281 existing records. [2025-09-25T17:37:30.599633] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T17:37:30.645012] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:30.646341] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-25T17:37:30.646394] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-25T17:37:30.646896] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-25T17:37:30.646962] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-25T17:37:31.058488] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:31.068790] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T17:37:31.088672] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-25T17:37:31.293555] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T17:37:31.889081] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-25T17:37:31.889576] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T17:37:32.688852] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-25T17:37:33.462675] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T17:37:33.488745] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-25T17:37:33.863540] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T17:37:33.873527] [INFO ] [REMOTE ] BKH: Full fetch complete (52161 records). [2025-09-25T17:37:33.873763] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-25T17:37:34.303395] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-25T17:37:34.326161] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-25T17:37:34.326282] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-25T17:37:34.327112] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-25T17:37:34.327225] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-25T17:37:34.330433] [DEBUG] [LOCAL ] BKH: Trimmed 52161 records to 36896 (keeping 200 days of data) [2025-09-25T17:37:34.631809] [DEBUG] [LOCAL ] BKH: Primary data saved (36896 records). [2025-09-25T17:37:34.632088] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-25T17:37:34.632284] [INFO ] [MAIN ] Update Progress: 288/2372 symbols completed. BKH took 32.2s. Estimated remaining: 4h 31m 33s. Rate: 7.7 symbols/min [2025-09-25T17:37:34.813816] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:34.830786] [DEBUG] [LOCAL ] BKT: Loaded 10910 existing records from primary storage. [2025-09-25T17:37:34.830896] [INFO ] [MAIN ] BKT: Loaded 10910 existing records. [2025-09-25T17:37:35.020458] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:35.020782] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-25T17:37:35.020839] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-25T17:37:35.021339] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-25T17:37:35.021411] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-25T17:37:35.096890] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-25T17:37:35.134500] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:37:35.467555] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:35.681319] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T17:37:35.719707] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T17:37:35.888752] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-25T17:37:36.688782] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-25T17:37:36.711513] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T17:37:37.488775] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-25T17:37:38.274340] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T17:37:38.288676] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-25T17:37:38.408780] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T17:37:39.052445] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T17:37:39.088708] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-25T17:37:39.888780] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-25T17:37:40.687063] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T17:37:40.689514] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-25T17:37:41.052052] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T17:37:41.488711] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-25T17:37:42.288758] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-25T17:37:42.335865] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T17:37:42.972716] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T17:37:43.088726] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-25T17:37:43.180147] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T17:37:43.888731] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-25T17:37:44.217949] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T17:37:44.688714] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-25T17:37:44.730741] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T17:37:45.488740] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-25T17:37:46.288725] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-25T17:37:46.379348] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T17:37:46.509774] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T17:37:47.088704] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-25T17:37:47.299944] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T17:37:47.539383] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T17:37:47.888712] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-25T17:37:48.641724] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T17:37:48.688680] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-25T17:37:49.381019] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T17:37:49.488711] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-25T17:37:50.285912] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T17:37:50.288771] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-25T17:37:51.088763] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-25T17:37:51.888712] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-25T17:37:52.119913] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T17:37:52.601754] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T17:37:52.660104] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:37:52.688693] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-25T17:37:53.488720] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-25T17:37:54.108637] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T17:37:54.288719] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-25T17:37:55.088730] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-25T17:37:55.312080] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T17:37:55.483558] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T17:37:55.487688] [INFO ] [REMOTE ] BKT: Full fetch complete (15004 records). [2025-09-25T17:37:55.487784] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-25T17:37:55.894732] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-25T17:37:55.972383] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-25T17:37:55.972479] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-25T17:37:55.972863] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-25T17:37:55.972926] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-25T17:37:55.973460] [DEBUG] [LOCAL ] BKT: Trimmed 15004 records to 11032 (keeping 200 days of data) [2025-09-25T17:37:56.050146] [DEBUG] [LOCAL ] BKT: Primary data saved (11032 records). [2025-09-25T17:37:56.050296] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-25T17:37:56.050402] [INFO ] [MAIN ] Update Progress: 289/2372 symbols completed. BKT took 21.4s. Estimated remaining: 4h 33m 3s. Rate: 7.6 symbols/min [2025-09-25T17:37:56.224495] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:56.284163] [DEBUG] [LOCAL ] BKU: Loaded 41905 existing records from primary storage. [2025-09-25T17:37:56.284317] [INFO ] [MAIN ] BKU: Loaded 41905 existing records. [2025-09-25T17:37:56.464571] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:37:56.464945] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-25T17:37:56.464993] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-25T17:37:56.465343] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-25T17:37:56.465401] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-25T17:37:56.482550] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T17:37:56.689486] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-25T17:37:56.849233] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T17:37:56.874504] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:37:57.071635] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-25T17:37:57.488679] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-25T17:37:58.288679] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-25T17:37:58.970622] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T17:37:59.088667] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-25T17:37:59.151713] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T17:37:59.154853] [INFO ] [REMOTE ] BKN: Full fetch complete (11992 records). [2025-09-25T17:37:59.155160] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-25T17:37:59.546918] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-25T17:37:59.547027] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-25T17:37:59.547418] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-25T17:37:59.547458] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-25T17:37:59.547963] [DEBUG] [LOCAL ] BKN: Trimmed 11992 records to 7820 (keeping 200 days of data) [2025-09-25T17:37:59.602052] [DEBUG] [LOCAL ] BKN: Primary data saved (7820 records). [2025-09-25T17:37:59.602212] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-25T17:37:59.602308] [INFO ] [MAIN ] Update Progress: 290/2372 symbols completed. BKN took 31.6s. Estimated remaining: 4h 32m 24s. Rate: 7.6 symbols/min [2025-09-25T17:37:59.786520] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:37:59.823231] [DEBUG] [LOCAL ] BKV: Loaded 29686 existing records from primary storage. [2025-09-25T17:37:59.823379] [INFO ] [MAIN ] BKV: Loaded 29686 existing records. [2025-09-25T17:37:59.894720] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-25T17:38:00.019398] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:00.020722] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-25T17:38:00.020778] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-25T17:38:00.021025] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-25T17:38:00.021083] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-25T17:38:00.372829] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:00.688735] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-25T17:38:01.220230] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-25T17:38:01.229956] [INFO ] [REMOTE ] BKKT: Full fetch complete (49847 records). [2025-09-25T17:38:01.230087] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-25T17:38:01.494430] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-25T17:38:01.658266] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-25T17:38:01.658356] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-25T17:38:01.659096] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-25T17:38:01.659163] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-25T17:38:01.660355] [DEBUG] [LOCAL ] BKKT: Trimmed 49847 records to 34785 (keeping 200 days of data) [2025-09-25T17:38:01.910673] [DEBUG] [LOCAL ] BKKT: Primary data saved (34785 records). [2025-09-25T17:38:01.910985] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-25T17:38:01.911119] [INFO ] [MAIN ] Update Progress: 291/2372 symbols completed. BKKT took 35.7s. Estimated remaining: 4h 31m 37s. Rate: 7.7 symbols/min [2025-09-25T17:38:02.083798] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-25T17:38:02.191362] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:02.211752] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T17:38:02.263000] [DEBUG] [LOCAL ] BLCO: Loaded 35617 existing records from primary storage. [2025-09-25T17:38:02.263170] [INFO ] [MAIN ] BLCO: Loaded 35617 existing records. [2025-09-25T17:38:02.289372] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-25T17:38:02.468631] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:02.469573] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-25T17:38:02.469684] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-25T17:38:02.469978] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-25T17:38:02.470037] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-25T17:38:02.868703] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:03.097207] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-25T17:38:03.103159] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T17:38:03.888694] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-25T17:38:04.057132] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T17:38:04.295105] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T17:38:04.688746] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-25T17:38:05.366001] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T17:38:05.488677] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-25T17:38:06.136447] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T17:38:06.288716] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-25T17:38:06.526868] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:38:07.088733] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-25T17:38:07.739847] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:38:07.888794] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-25T17:38:08.688706] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-25T17:38:09.111300] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T17:38:09.120551] [INFO ] [REMOTE ] BKSY: Full fetch complete (69401 records). [2025-09-25T17:38:09.120730] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-25T17:38:09.385227] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T17:38:09.494728] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-25T17:38:09.619588] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-25T17:38:09.619714] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-25T17:38:09.620697] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-25T17:38:09.620768] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-25T17:38:09.622232] [DEBUG] [LOCAL ] BKSY: Trimmed 69401 records to 48651 (keeping 200 days of data) [2025-09-25T17:38:09.941800] [DEBUG] [LOCAL ] BKSY: Primary data saved (48651 records). [2025-09-25T17:38:09.941969] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-25T17:38:09.944061] [INFO ] [MAIN ] Update Progress: 292/2372 symbols completed. BKSY took 39.8s. Estimated remaining: 4h 31m 30s. Rate: 7.7 symbols/min [2025-09-25T17:38:10.153211] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:10.194743] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T17:38:10.225322] [DEBUG] [LOCAL ] BLD: Loaded 28097 existing records from primary storage. [2025-09-25T17:38:10.225464] [INFO ] [MAIN ] BLD: Loaded 28097 existing records. [2025-09-25T17:38:10.289090] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-25T17:38:10.421577] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:10.422419] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-25T17:38:10.422468] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-25T17:38:10.422778] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-25T17:38:10.422838] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-25T17:38:10.784259] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T17:38:10.815154] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:11.088699] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-25T17:38:11.654155] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T17:38:11.888832] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-25T17:38:12.676264] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T17:38:12.688719] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-25T17:38:13.417159] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T17:38:13.488730] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-25T17:38:13.825275] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T17:38:14.288753] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-25T17:38:14.602941] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T17:38:15.088798] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-25T17:38:15.889714] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-25T17:38:15.894298] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T17:38:16.391512] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T17:38:16.688675] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-25T17:38:16.782574] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T17:38:17.488741] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-25T17:38:17.789312] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T17:38:18.288716] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-25T17:38:18.707753] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T17:38:19.088717] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-25T17:38:19.297356] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T17:38:19.888743] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-25T17:38:20.688829] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-25T17:38:20.731399] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T17:38:20.771041] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T17:38:20.776045] [INFO ] [REMOTE ] BKV: Full fetch complete (44973 records). [2025-09-25T17:38:20.776169] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-25T17:38:21.214512] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-25T17:38:21.214623] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-25T17:38:21.215257] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-25T17:38:21.215371] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-25T17:38:21.217524] [DEBUG] [LOCAL ] BKV: Trimmed 44973 records to 29986 (keeping 200 days of data) [2025-09-25T17:38:21.410297] [DEBUG] [LOCAL ] BKV: Primary data saved (29986 records). [2025-09-25T17:38:21.410461] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-25T17:38:21.410677] [INFO ] [MAIN ] Update Progress: 293/2372 symbols completed. BKV took 21.8s. Estimated remaining: 4h 31m 48s. Rate: 7.6 symbols/min [2025-09-25T17:38:21.495819] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-25T17:38:21.611478] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:21.684315] [DEBUG] [LOCAL ] BLDR: Loaded 51664 existing records from primary storage. [2025-09-25T17:38:21.684472] [INFO ] [MAIN ] BLDR: Loaded 51664 existing records. [2025-09-25T17:38:21.883500] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:21.886019] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-25T17:38:21.886083] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-25T17:38:21.886510] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-25T17:38:21.886578] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-25T17:38:22.076977] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T17:38:22.286392] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:22.288677] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-25T17:38:23.088699] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-25T17:38:23.295258] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T17:38:23.711680] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T17:38:23.888766] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-25T17:38:24.688705] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-25T17:38:24.849316] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T17:38:25.112001] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T17:38:25.488723] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-25T17:38:26.060376] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T17:38:26.288680] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-25T17:38:26.628022] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T17:38:27.088720] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-25T17:38:27.539776] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T17:38:27.888674] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-25T17:38:28.222855] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T17:38:28.688789] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-25T17:38:29.495717] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-25T17:38:29.514867] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T17:38:29.680103] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T17:38:30.288726] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-25T17:38:30.898478] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T17:38:31.088706] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-25T17:38:31.784841] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T17:38:31.794779] [INFO ] [REMOTE ] BLCO: Full fetch complete (52728 records). [2025-09-25T17:38:31.794908] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-25T17:38:31.893794] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-25T17:38:32.216043] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-25T17:38:32.216144] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-25T17:38:32.216781] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-25T17:38:32.216902] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-25T17:38:32.218043] [DEBUG] [LOCAL ] BLCO: Trimmed 52728 records to 35907 (keeping 200 days of data) [2025-09-25T17:38:32.452556] [DEBUG] [LOCAL ] BLCO: Primary data saved (35907 records). [2025-09-25T17:38:32.452766] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-25T17:38:32.452914] [INFO ] [MAIN ] Update Progress: 294/2372 symbols completed. BLCO took 30.5s. Estimated remaining: 4h 32m 3s. Rate: 7.6 symbols/min [2025-09-25T17:38:32.647541] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:32.665812] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T17:38:32.689757] [DEBUG] [LOCAL ] BLE: Loaded 14568 existing records from primary storage. [2025-09-25T17:38:32.689898] [INFO ] [MAIN ] BLE: Loaded 14568 existing records. [2025-09-25T17:38:32.703686] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-25T17:38:32.880693] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:32.880976] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-25T17:38:32.881035] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-25T17:38:32.881348] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-25T17:38:32.881426] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-25T17:38:33.235218] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:33.480244] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T17:38:33.489883] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-25T17:38:34.076214] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T17:38:34.086102] [INFO ] [REMOTE ] BKU: Full fetch complete (59729 records). [2025-09-25T17:38:34.086277] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-25T17:38:34.290534] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-25T17:38:34.537343] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-25T17:38:34.537427] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-25T17:38:34.538094] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-25T17:38:34.538165] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-25T17:38:34.540398] [DEBUG] [LOCAL ] BKU: Trimmed 59729 records to 42162 (keeping 200 days of data) [2025-09-25T17:38:34.796838] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T17:38:34.852991] [DEBUG] [LOCAL ] BKU: Primary data saved (42162 records). [2025-09-25T17:38:34.853129] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-25T17:38:34.853253] [INFO ] [MAIN ] Update Progress: 295/2372 symbols completed. BKU took 38.8s. Estimated remaining: 4h 31m 17s. Rate: 7.7 symbols/min [2025-09-25T17:38:35.022287] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:35.063276] [DEBUG] [LOCAL ] BLK: Loaded 34754 existing records from primary storage. [2025-09-25T17:38:35.063433] [INFO ] [MAIN ] BLK: Loaded 34754 existing records. [2025-09-25T17:38:35.095724] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-25T17:38:35.263133] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:35.263557] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-25T17:38:35.263607] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-25T17:38:35.263919] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-25T17:38:35.264008] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-25T17:38:35.662718] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:35.718374] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T17:38:35.888728] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-25T17:38:36.234274] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T17:38:36.688727] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-25T17:38:37.472951] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T17:38:37.490700] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-25T17:38:37.502277] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T17:38:38.288724] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-25T17:38:39.088715] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-25T17:38:39.270451] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:38:39.407621] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T17:38:39.888724] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-25T17:38:40.601729] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T17:38:40.688704] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-25T17:38:41.333288] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T17:38:41.488674] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-25T17:38:41.667508] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T17:38:41.675123] [INFO ] [REMOTE ] BLD: Full fetch complete (40440 records). [2025-09-25T17:38:41.675225] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-25T17:38:42.090801] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-25T17:38:42.090887] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-25T17:38:42.091413] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-25T17:38:42.091455] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-25T17:38:42.092503] [DEBUG] [LOCAL ] BLD: Trimmed 40440 records to 28248 (keeping 200 days of data) [2025-09-25T17:38:42.278347] [DEBUG] [LOCAL ] BLD: Primary data saved (28248 records). [2025-09-25T17:38:42.278488] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-25T17:38:42.278571] [INFO ] [MAIN ] Update Progress: 296/2372 symbols completed. BLD took 32.3s. Estimated remaining: 4h 31m 6s. Rate: 7.7 symbols/min [2025-09-25T17:38:42.294729] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-25T17:38:42.469967] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:42.543419] [DEBUG] [LOCAL ] BLND: Loaded 49442 existing records from primary storage. [2025-09-25T17:38:42.543562] [INFO ] [MAIN ] BLND: Loaded 49442 existing records. [2025-09-25T17:38:42.741175] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:38:42.741430] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-25T17:38:42.741476] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-25T17:38:42.741840] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-25T17:38:42.741902] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-25T17:38:43.107030] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:43.100698] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-25T17:38:43.426310] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T17:38:43.706175] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T17:38:43.888686] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-25T17:38:44.053958] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T17:38:44.688727] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-25T17:38:44.786450] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T17:38:45.488821] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-25T17:38:46.288754] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-25T17:38:46.448878] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T17:38:47.088752] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-25T17:38:47.321338] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:38:47.343555] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T17:38:47.888753] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-25T17:38:48.688771] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-25T17:38:49.079477] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T17:38:49.369184] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T17:38:49.488691] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-25T17:38:49.762315] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T17:38:50.288756] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-25T17:38:51.088736] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-25T17:38:51.139485] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:38:51.489173] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:38:51.888805] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-25T17:38:52.688766] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-25T17:38:52.891448] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T17:38:52.986184] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T17:38:53.488832] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-25T17:38:54.228387] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T17:38:54.288749] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-25T17:38:55.092081] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-25T17:38:55.108040] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T17:38:55.888719] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-25T17:38:56.050950] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T17:38:56.688737] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-25T17:38:56.712743] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T17:38:56.963357] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T17:38:56.976725] [INFO ] [REMOTE ] BLDR: Full fetch complete (74349 records). [2025-09-25T17:38:56.976968] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-25T17:38:57.405351] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-25T17:38:57.405523] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-25T17:38:57.406970] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-25T17:38:57.407176] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-25T17:38:57.409391] [DEBUG] [LOCAL ] BLDR: Trimmed 74349 records to 52046 (keeping 200 days of data) [2025-09-25T17:38:57.514627] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-25T17:38:57.769424] [DEBUG] [LOCAL ] BLDR: Primary data saved (52046 records). [2025-09-25T17:38:57.769571] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-25T17:38:57.769802] [INFO ] [MAIN ] Update Progress: 297/2372 symbols completed. BLDR took 36.4s. Estimated remaining: 4h 31m 52s. Rate: 7.6 symbols/min [2025-09-25T17:38:57.951040] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:38:57.951232] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-25T17:38:57.951287] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-25T17:38:57.952040] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-25T17:38:57.952124] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-25T17:38:57.952201] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-25T17:38:57.953053] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-25T17:38:58.240437] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T17:38:58.269477] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T17:38:58.296719] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-25T17:38:58.417197] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:38:59.088717] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-25T17:38:59.888732] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-25T17:38:59.949758] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:38:59.956207] [INFO ] [REMOTE ] BLK: Full fetch complete (52814 records). [2025-09-25T17:38:59.956315] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-25T17:39:00.151007] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:00.188992] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-25T17:39:00.447494] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-25T17:39:00.447594] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-25T17:39:00.448316] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-25T17:39:00.448383] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-25T17:39:00.449862] [DEBUG] [LOCAL ] BLK: Trimmed 52814 records to 35037 (keeping 200 days of data) [2025-09-25T17:39:00.747570] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-25T17:39:00.841211] [DEBUG] [LOCAL ] BLK: Primary data saved (35037 records). [2025-09-25T17:39:00.841421] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-25T17:39:00.841584] [INFO ] [MAIN ] Update Progress: 298/2372 symbols completed. BLK took 26.0s. Estimated remaining: 4h 31m 11s. Rate: 7.6 symbols/min [2025-09-25T17:39:01.052273] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:01.052805] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-25T17:39:01.153606] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-25T17:39:01.193634] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:01.217939] [DEBUG] [LOCAL ] BLW: Loaded 12773 existing records from primary storage. [2025-09-25T17:39:01.218135] [INFO ] [MAIN ] BLW: Loaded 12773 existing records. [2025-09-25T17:39:01.427859] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:01.428135] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-25T17:39:01.428203] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-25T17:39:01.428568] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-25T17:39:01.429172] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-25T17:39:01.488871] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-25T17:39:01.794817] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:02.288695] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-25T17:39:03.088675] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-25T17:39:03.265195] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:39:03.304892] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:03.305210] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-25T17:39:03.409035] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T17:39:03.888728] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-25T17:39:04.688706] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-25T17:39:04.931848] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:39:04.936126] [INFO ] [REMOTE ] BLE: Full fetch complete (20546 records). [2025-09-25T17:39:04.936215] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-25T17:39:05.346097] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-25T17:39:05.346181] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-25T17:39:05.346503] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-25T17:39:05.346541] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-25T17:39:05.348106] [DEBUG] [LOCAL ] BLE: Trimmed 20546 records to 14657 (keeping 200 days of data) [2025-09-25T17:39:05.448189] [DEBUG] [LOCAL ] BLE: Primary data saved (14657 records). [2025-09-25T17:39:05.448315] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-25T17:39:05.448418] [INFO ] [MAIN ] Update Progress: 299/2372 symbols completed. BLE took 33.0s. Estimated remaining: 4h 30m 40s. Rate: 7.7 symbols/min [2025-09-25T17:39:05.499820] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-25T17:39:05.485711] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T17:39:05.642226] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:05.666698] [DEBUG] [LOCAL ] BLX: Loaded 15678 existing records from primary storage. [2025-09-25T17:39:05.666836] [INFO ] [MAIN ] BLX: Loaded 15678 existing records. [2025-09-25T17:39:05.731762] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:05.748875] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-25T17:39:05.858275] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:05.858861] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-25T17:39:05.858921] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-25T17:39:05.859277] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-25T17:39:05.859336] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-25T17:39:06.224827] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:06.288706] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-25T17:39:06.490319] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:06.490605] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-25T17:39:07.088717] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-25T17:39:07.825719] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:39:07.888672] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-25T17:39:08.688716] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-25T17:39:08.881804] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:08.882152] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-25T17:39:08.999753] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T17:39:09.488720] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-25T17:39:09.722081] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:09.722426] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-25T17:39:10.288734] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-25T17:39:10.522353] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:39:10.522703] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-25T17:39:11.088724] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-25T17:39:11.888726] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-25T17:39:12.688728] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-25T17:39:12.760810] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T17:39:12.838013] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T17:39:13.440267] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T17:39:13.488703] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-25T17:39:14.288730] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-25T17:39:14.328837] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T17:39:15.088722] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-25T17:39:15.888677] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-25T17:39:16.136676] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T17:39:16.245868] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T17:39:16.688741] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-25T17:39:16.911729] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T17:39:17.488711] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-25T17:39:18.288722] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-25T17:39:18.551737] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T17:39:19.003547] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T17:39:19.088691] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-25T17:39:19.223314] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-25T17:39:19.232792] [INFO ] [REMOTE ] BLSH: Full fetch complete (11826 records). [2025-09-25T17:39:19.232868] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-25T17:39:19.413953] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 31 unique days, need 200 days [2025-09-25T17:39:19.414225] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:39:19.414287] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:39:19.414349] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-25T17:39:19.414440] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-25T17:39:19.414508] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-25T17:39:19.414588] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-25T17:39:19.415808] [INFO ] [MAIN ] Update Progress: 300/2372 symbols completed. BLSH took 21.6s. Estimated remaining: 4h 31m 15s. Rate: 7.6 symbols/min [2025-09-25T17:39:19.586750] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:19.628106] [DEBUG] [LOCAL ] BMA: Loaded 35033 existing records from primary storage. [2025-09-25T17:39:19.628246] [INFO ] [MAIN ] BMA: Loaded 35033 existing records. [2025-09-25T17:39:19.804679] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:19.805310] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-25T17:39:19.805357] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-25T17:39:19.805685] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-25T17:39:19.805745] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-25T17:39:19.896796] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-25T17:39:20.166832] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:20.227195] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T17:39:20.688720] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-25T17:39:21.498636] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-25T17:39:21.526407] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T17:39:22.028783] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T17:39:22.186458] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T17:39:22.288735] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-25T17:39:23.095157] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T17:39:23.098711] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-25T17:39:23.888712] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-25T17:39:24.029703] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T17:39:24.688757] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-25T17:39:25.398178] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T17:39:25.488677] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-25T17:39:25.501185] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T17:39:26.288677] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-25T17:39:26.416337] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T17:39:27.088725] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-25T17:39:27.695569] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T17:39:27.888729] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-25T17:39:28.519773] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T17:39:28.688683] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-25T17:39:28.857550] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T17:39:28.862373] [INFO ] [REMOTE ] BLW: Full fetch complete (18891 records). [2025-09-25T17:39:28.862464] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-25T17:39:29.259841] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-25T17:39:29.259945] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-25T17:39:29.260794] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-25T17:39:29.260881] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-25T17:39:29.261556] [DEBUG] [LOCAL ] BLW: Trimmed 18891 records to 12881 (keeping 200 days of data) [2025-09-25T17:39:29.349595] [DEBUG] [LOCAL ] BLW: Primary data saved (12881 records). [2025-09-25T17:39:29.349767] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-25T17:39:29.349946] [INFO ] [MAIN ] Update Progress: 301/2372 symbols completed. BLW took 28.5s. Estimated remaining: 4h 31m 21s. Rate: 7.6 symbols/min [2025-09-25T17:39:29.502737] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-25T17:39:29.540147] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:29.558539] [DEBUG] [LOCAL ] BME: Loaded 10831 existing records from primary storage. [2025-09-25T17:39:29.558681] [INFO ] [MAIN ] BME: Loaded 10831 existing records. [2025-09-25T17:39:29.738251] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:29.738938] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-25T17:39:29.738992] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-25T17:39:29.739263] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-25T17:39:29.739322] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-25T17:39:30.135146] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:30.249482] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T17:39:30.288674] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-25T17:39:30.837967] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T17:39:31.088725] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-25T17:39:31.139016] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T17:39:31.888828] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-25T17:39:32.688759] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-25T17:39:33.012746] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T17:39:33.454953] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T17:39:33.488668] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-25T17:39:33.698454] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T17:39:33.702836] [INFO ] [REMOTE ] BLX: Full fetch complete (22629 records). [2025-09-25T17:39:33.703000] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-25T17:39:33.704062] [FATAL] [VALIDATOR ] BLX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:39:33.704168] [FATAL] [MAIN ] BLX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:39:33.704229] [WARN ] [MAIN ] BLX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:39:33.704323] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-25T17:39:33.704420] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-25T17:39:33.704498] [INFO ] [LOCAL ] BLX: Starting deletion of derivative data. [2025-09-25T17:39:33.705259] [DEBUG] [LOCAL ] BLX: Deleted derivative data file. [2025-09-25T17:39:33.705437] [INFO ] [MAIN ] Update Progress: 302/2372 symbols completed. BLX took 28.3s. Estimated remaining: 4h 30m 49s. Rate: 7.6 symbols/min [2025-09-25T17:39:33.907198] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:33.945766] [DEBUG] [LOCAL ] BMEZ: Loaded 26022 existing records from primary storage. [2025-09-25T17:39:33.945916] [INFO ] [MAIN ] BMEZ: Loaded 26022 existing records. [2025-09-25T17:39:34.146968] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:34.147225] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-25T17:39:34.147271] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-25T17:39:34.147580] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-25T17:39:34.147739] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-25T17:39:34.294077] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-25T17:39:34.535305] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:34.837149] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T17:39:35.088724] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-25T17:39:35.819070] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T17:39:35.830044] [INFO ] [REMOTE ] BLND: Full fetch complete (72296 records). [2025-09-25T17:39:35.830260] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-25T17:39:35.889788] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-25T17:39:36.247131] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-25T17:39:36.247215] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-25T17:39:36.247993] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-25T17:39:36.248059] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-25T17:39:36.249492] [DEBUG] [LOCAL ] BLND: Trimmed 72296 records to 49802 (keeping 200 days of data) [2025-09-25T17:39:36.515919] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T17:39:36.628822] [DEBUG] [LOCAL ] BLND: Primary data saved (49802 records). [2025-09-25T17:39:36.629018] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-25T17:39:36.631008] [INFO ] [MAIN ] Update Progress: 303/2372 symbols completed. BLND took 54.4s. Estimated remaining: 4h 30m 8s. Rate: 7.7 symbols/min [2025-09-25T17:39:36.689584] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-25T17:39:36.827097] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:36.864505] [DEBUG] [LOCAL ] BMI: Loaded 24210 existing records from primary storage. [2025-09-25T17:39:36.864727] [INFO ] [MAIN ] BMI: Loaded 24210 existing records. [2025-09-25T17:39:37.061888] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:37.062407] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-25T17:39:37.062508] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-25T17:39:37.062880] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-25T17:39:37.062945] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-25T17:39:37.476702] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T17:39:37.502213] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-25T17:39:37.554667] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:37.788206] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T17:39:38.288754] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-25T17:39:38.824630] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T17:39:39.088770] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-25T17:39:39.596415] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T17:39:39.888776] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-25T17:39:40.342942] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T17:39:40.688739] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-25T17:39:40.933464] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:39:41.489039] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-25T17:39:41.563304] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T17:39:42.288745] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-25T17:39:42.834892] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T17:39:43.088751] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-25T17:39:43.210208] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T17:39:43.888746] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-25T17:39:44.694358] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-25T17:39:44.699606] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T17:39:44.710358] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T17:39:44.720440] [INFO ] [REMOTE ] BMA: Full fetch complete (51196 records). [2025-09-25T17:39:44.720560] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-25T17:39:45.185634] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-25T17:39:45.185802] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-25T17:39:45.186629] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-25T17:39:45.186812] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-25T17:39:45.189336] [DEBUG] [LOCAL ] BMA: Trimmed 51196 records to 35339 (keeping 200 days of data) [2025-09-25T17:39:45.435668] [DEBUG] [LOCAL ] BMA: Primary data saved (35339 records). [2025-09-25T17:39:45.435842] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-25T17:39:45.435971] [INFO ] [MAIN ] Update Progress: 304/2372 symbols completed. BMA took 26.0s. Estimated remaining: 4h 30m 7s. Rate: 7.7 symbols/min [2025-09-25T17:39:45.482579] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T17:39:45.497983] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-25T17:39:45.651010] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:45.659190] [DEBUG] [LOCAL ] BMN: Loaded 2520 existing records from primary storage. [2025-09-25T17:39:45.659370] [INFO ] [MAIN ] BMN: Loaded 2520 existing records. [2025-09-25T17:39:45.845720] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:45.846063] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-25T17:39:45.846139] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-25T17:39:45.846349] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-25T17:39:45.846424] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-25T17:39:46.200036] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:46.288677] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-25T17:39:46.383917] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T17:39:46.838197] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T17:39:47.088724] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-25T17:39:47.888676] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-25T17:39:47.945611] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T17:39:48.285842] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T17:39:48.688718] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-25T17:39:49.438498] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:39:49.488728] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-25T17:39:49.863849] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-25T17:39:50.288718] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-25T17:39:50.730677] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T17:39:51.088711] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-25T17:39:51.888721] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-25T17:39:51.937550] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:39:52.688727] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-25T17:39:53.021081] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T17:39:53.488823] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-25T17:39:53.514156] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T17:39:53.944263] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T17:39:54.288736] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-25T17:39:55.088722] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-25T17:39:55.659996] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T17:39:55.815041] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T17:39:55.888785] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-25T17:39:56.688689] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-25T17:39:57.075790] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T17:39:57.351732] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T17:39:57.354429] [INFO ] [REMOTE ] BME: Full fetch complete (16056 records). [2025-09-25T17:39:57.354509] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-25T17:39:57.493781] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-25T17:39:57.759085] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-25T17:39:57.759177] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-25T17:39:57.759519] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-25T17:39:57.759559] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-25T17:39:57.760140] [DEBUG] [LOCAL ] BME: Trimmed 16056 records to 10912 (keeping 200 days of data) [2025-09-25T17:39:57.834061] [DEBUG] [LOCAL ] BME: Primary data saved (10912 records). [2025-09-25T17:39:57.834209] [INFO ] [MAIN ] BME: Full history saved. [2025-09-25T17:39:57.834327] [INFO ] [MAIN ] Update Progress: 305/2372 symbols completed. BME took 28.5s. Estimated remaining: 4h 30m 30s. Rate: 7.6 symbols/min [2025-09-25T17:39:58.009746] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:39:58.065675] [DEBUG] [LOCAL ] BMO: Loaded 41316 existing records from primary storage. [2025-09-25T17:39:58.065828] [INFO ] [MAIN ] BMO: Loaded 41316 existing records. [2025-09-25T17:39:58.243452] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:39:58.243943] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-25T17:39:58.243990] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-25T17:39:58.244378] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-25T17:39:58.244436] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-25T17:39:58.291148] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-25T17:39:58.617862] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:39:58.839972] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-25T17:39:58.866454] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T17:39:59.088727] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-25T17:39:59.542478] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T17:39:59.888725] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-25T17:40:00.688723] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-25T17:40:00.893278] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T17:40:01.488735] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-25T17:40:01.919565] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T17:40:02.288751] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-25T17:40:02.468485] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T17:40:03.088716] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-25T17:40:03.315180] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:40:03.422272] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-25T17:40:03.888729] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-25T17:40:04.688820] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-25T17:40:05.181700] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T17:40:05.488908] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-25T17:40:05.766266] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T17:40:06.288731] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-25T17:40:07.088729] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-25T17:40:07.351722] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T17:40:07.653845] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T17:40:07.888717] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-25T17:40:08.430602] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T17:40:08.432274] [INFO ] [REMOTE ] BMN: Full fetch complete (3715 records). [2025-09-25T17:40:08.432472] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-25T17:40:08.558736] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T17:40:08.693801] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-25T17:40:08.964171] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-25T17:40:08.964258] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-25T17:40:08.964435] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-25T17:40:08.964500] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-25T17:40:08.964974] [DEBUG] [LOCAL ] BMN: Trimmed 3715 records to 2536 (keeping 200 days of data) [2025-09-25T17:40:08.989431] [DEBUG] [LOCAL ] BMN: Primary data saved (2536 records). [2025-09-25T17:40:08.989591] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-25T17:40:08.989768] [INFO ] [MAIN ] Update Progress: 306/2372 symbols completed. BMN took 23.6s. Estimated remaining: 4h 30m 44s. Rate: 7.6 symbols/min [2025-09-25T17:40:09.188865] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:09.260481] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-25T17:40:09.260712] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-25T17:40:09.449430] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:09.451407] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-25T17:40:09.451482] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-25T17:40:09.451997] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-25T17:40:09.452064] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-25T17:40:09.490483] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-25T17:40:09.845874] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:09.944825] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T17:40:10.288721] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-25T17:40:11.094930] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-25T17:40:11.097843] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:40:11.888679] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-25T17:40:12.354380] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-25T17:40:12.453055] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T17:40:12.462163] [INFO ] [REMOTE ] BMEZ: Full fetch complete (41004 records). [2025-09-25T17:40:12.462335] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-25T17:40:12.698727] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-25T17:40:12.890862] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-25T17:40:12.890941] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-25T17:40:12.891441] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-25T17:40:12.891503] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-25T17:40:12.893902] [DEBUG] [LOCAL ] BMEZ: Trimmed 41004 records to 26209 (keeping 200 days of data) [2025-09-25T17:40:13.066243] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26209 records). [2025-09-25T17:40:13.066410] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-25T17:40:13.066550] [INFO ] [MAIN ] Update Progress: 307/2372 symbols completed. BMEZ took 39.4s. Estimated remaining: 4h 30m 11s. Rate: 7.6 symbols/min [2025-09-25T17:40:13.238243] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:13.304469] [DEBUG] [LOCAL ] BN: Loaded 52994 existing records from primary storage. [2025-09-25T17:40:13.304705] [INFO ] [MAIN ] BN: Loaded 52994 existing records. [2025-09-25T17:40:13.488854] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-25T17:40:13.494429] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:13.497239] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-25T17:40:13.497306] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-25T17:40:13.497557] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-25T17:40:13.497615] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-25T17:40:13.658265] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T17:40:13.925783] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:14.288811] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-25T17:40:14.567609] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T17:40:14.632568] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T17:40:15.088805] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-25T17:40:15.888685] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-25T17:40:15.980182] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:40:16.688711] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-25T17:40:17.209200] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-25T17:40:17.254832] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T17:40:17.264085] [INFO ] [REMOTE ] BMI: Full fetch complete (32716 records). [2025-09-25T17:40:17.264273] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-25T17:40:17.265744] [FATAL] [VALIDATOR ] BMI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:40:17.265992] [FATAL] [MAIN ] BMI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:40:17.266081] [WARN ] [MAIN ] BMI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:40:17.266205] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-25T17:40:17.266315] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-25T17:40:17.266384] [INFO ] [LOCAL ] BMI: Starting deletion of derivative data. [2025-09-25T17:40:17.267005] [DEBUG] [LOCAL ] BMI: Deleted derivative data file. [2025-09-25T17:40:17.267136] [INFO ] [MAIN ] Update Progress: 308/2372 symbols completed. BMI took 40.6s. Estimated remaining: 4h 29m 39s. Rate: 7.7 symbols/min [2025-09-25T17:40:17.472134] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:17.488752] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-25T17:40:17.520246] [DEBUG] [LOCAL ] BNED: Loaded 29914 existing records from primary storage. [2025-09-25T17:40:17.520411] [INFO ] [MAIN ] BNED: Loaded 29914 existing records. [2025-09-25T17:40:17.721187] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:17.721514] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-25T17:40:17.721559] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-25T17:40:17.721803] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-25T17:40:17.721871] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-25T17:40:18.100475] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:18.288750] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-25T17:40:18.736023] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T17:40:19.088723] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-25T17:40:19.609453] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T17:40:19.836942] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:40:19.888676] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-25T17:40:20.409318] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T17:40:20.688733] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-25T17:40:21.454570] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T17:40:21.488694] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-25T17:40:22.288703] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-25T17:40:22.407436] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T17:40:23.089855] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-25T17:40:23.089717] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T17:40:23.888720] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-25T17:40:24.541180] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-25T17:40:24.688693] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-25T17:40:24.871461] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T17:40:25.291532] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T17:40:25.488730] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-25T17:40:26.288695] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-25T17:40:26.557695] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T17:40:27.058734] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T17:40:27.086237] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T17:40:27.092249] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-25T17:40:27.888736] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-25T17:40:28.688886] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-25T17:40:29.193826] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-25T17:40:29.248104] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T17:40:29.488760] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-25T17:40:30.101838] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T17:40:30.288815] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-25T17:40:31.021601] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T17:40:31.088746] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-25T17:40:31.671555] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T17:40:31.681396] [INFO ] [REMOTE ] BMO: Full fetch complete (59823 records). [2025-09-25T17:40:31.681661] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-25T17:40:31.895063] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-25T17:40:32.171793] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-25T17:40:32.171936] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-25T17:40:32.172785] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-25T17:40:32.172856] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-25T17:40:32.175995] [DEBUG] [LOCAL ] BMO: Trimmed 59823 records to 41667 (keeping 200 days of data) [2025-09-25T17:40:32.498786] [DEBUG] [LOCAL ] BMO: Primary data saved (41667 records). [2025-09-25T17:40:32.498972] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-25T17:40:32.499121] [INFO ] [MAIN ] Update Progress: 309/2372 symbols completed. BMO took 34.7s. Estimated remaining: 4h 30m 20s. Rate: 7.6 symbols/min [2025-09-25T17:40:32.523322] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:40:32.694458] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-25T17:40:32.708563] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:32.719542] [DEBUG] [LOCAL ] BNH: Loaded 4826 existing records from primary storage. [2025-09-25T17:40:32.719716] [INFO ] [MAIN ] BNH: Loaded 4826 existing records. [2025-09-25T17:40:32.916695] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:32.917402] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-25T17:40:32.917468] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-25T17:40:32.918392] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-25T17:40:32.918464] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-25T17:40:33.315611] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:33.488750] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-25T17:40:33.702823] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T17:40:33.957742] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T17:40:34.194166] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T17:40:34.288724] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-25T17:40:35.088720] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-25T17:40:35.487903] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T17:40:35.696879] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T17:40:35.888766] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-25T17:40:36.688849] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-25T17:40:36.927476] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T17:40:37.488707] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-25T17:40:38.048051] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T17:40:38.288734] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-25T17:40:38.638313] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T17:40:39.088714] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-25T17:40:39.708990] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T17:40:39.719015] [INFO ] [REMOTE ] BMY: Full fetch complete (77405 records). [2025-09-25T17:40:39.719340] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-25T17:40:39.720345] [FATAL] [VALIDATOR ] BMY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:40:39.720478] [FATAL] [MAIN ] BMY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:40:39.720552] [WARN ] [MAIN ] BMY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:40:39.720603] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-25T17:40:39.720724] [DEBUG] [LOCAL ] BMY: No primary data file found to delete. [2025-09-25T17:40:39.720784] [INFO ] [LOCAL ] BMY: Starting deletion of derivative data. [2025-09-25T17:40:39.721281] [DEBUG] [LOCAL ] BMY: Deleted derivative data file. [2025-09-25T17:40:39.721493] [INFO ] [MAIN ] Update Progress: 310/2372 symbols completed. BMY took 30.7s. Estimated remaining: 4h 30m 8s. Rate: 7.6 symbols/min [2025-09-25T17:40:39.893807] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-25T17:40:39.950819] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:39.956550] [DEBUG] [LOCAL ] BNJ: Loaded 2584 existing records from primary storage. [2025-09-25T17:40:39.956669] [INFO ] [MAIN ] BNJ: Loaded 2584 existing records. [2025-09-25T17:40:40.173827] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T17:40:40.209075] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:40.209320] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-25T17:40:40.209365] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-25T17:40:40.209631] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-25T17:40:40.209795] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-25T17:40:40.591517] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:40.688715] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-25T17:40:41.240189] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T17:40:41.404393] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T17:40:41.411913] [INFO ] [REMOTE ] BNED: Full fetch complete (44041 records). [2025-09-25T17:40:41.412046] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-25T17:40:41.414136] [FATAL] [VALIDATOR ] BNED: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:40:41.414349] [FATAL] [MAIN ] BNED: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:40:41.414426] [WARN ] [MAIN ] BNED: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:40:41.414505] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-25T17:40:41.414638] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-25T17:40:41.414729] [INFO ] [LOCAL ] BNED: Starting deletion of derivative data. [2025-09-25T17:40:41.415379] [DEBUG] [LOCAL ] BNED: Deleted derivative data file. [2025-09-25T17:40:41.415529] [INFO ] [MAIN ] Update Progress: 311/2372 symbols completed. BNED took 24.1s. Estimated remaining: 4h 29m 19s. Rate: 7.7 symbols/min [2025-09-25T17:40:41.494928] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-25T17:40:41.653299] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:41.728510] [DEBUG] [LOCAL ] BNL: Loaded 46864 existing records from primary storage. [2025-09-25T17:40:41.728687] [INFO ] [MAIN ] BNL: Loaded 46864 existing records. [2025-09-25T17:40:41.927873] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:40:41.928269] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-25T17:40:41.928342] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-25T17:40:41.928737] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-25T17:40:41.928809] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-25T17:40:42.280117] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T17:40:42.288768] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-25T17:40:42.356581] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:43.088740] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-25T17:40:43.547736] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T17:40:43.888719] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-25T17:40:44.099803] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T17:40:44.354275] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T17:40:44.688703] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-25T17:40:45.241509] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T17:40:45.488688] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-25T17:40:46.055761] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T17:40:46.289117] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-25T17:40:46.747165] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T17:40:47.088755] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-25T17:40:47.591031] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-25T17:40:47.888752] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-25T17:40:48.688732] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-25T17:40:49.115668] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T17:40:49.434928] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T17:40:49.488700] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-25T17:40:49.923539] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-25T17:40:50.288819] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-25T17:40:51.088772] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-25T17:40:51.783253] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T17:40:51.888709] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-25T17:40:52.688773] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-25T17:40:52.731962] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T17:40:53.343214] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:40:53.482730] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T17:40:53.488670] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-25T17:40:53.918841] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T17:40:54.288725] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-25T17:40:55.088730] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-25T17:40:55.708131] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T17:40:55.710084] [INFO ] [REMOTE ] BNJ: Full fetch complete (4434 records). [2025-09-25T17:40:55.710182] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-25T17:40:55.894800] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-25T17:40:56.252359] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-25T17:40:56.252538] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-25T17:40:56.252897] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-25T17:40:56.252993] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-25T17:40:56.253906] [DEBUG] [LOCAL ] BNJ: Trimmed 4434 records to 2610 (keeping 200 days of data) [2025-09-25T17:40:56.291945] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T17:40:56.301116] [DEBUG] [LOCAL ] BNJ: Primary data saved (2610 records). [2025-09-25T17:40:56.301205] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-25T17:40:56.301379] [INFO ] [MAIN ] Update Progress: 312/2372 symbols completed. BNJ took 16.6s. Estimated remaining: 4h 29m 58s. Rate: 7.6 symbols/min [2025-09-25T17:40:56.489588] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:40:56.489910] [DEBUG] [LOCAL ] BNS: No existing data file found in primary storage. [2025-09-25T17:40:56.489967] [WARN ] [MAIN ] BNS: No existing data found, performing full refresh instead. [2025-09-25T17:40:56.490255] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-25T17:40:56.490339] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-25T17:40:56.490409] [DEBUG] [LOCAL ] BNS: No primary data file found to delete. [2025-09-25T17:40:56.490483] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-25T17:40:56.695806] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-25T17:40:56.918489] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:40:57.287570] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T17:40:57.488817] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-25T17:40:57.621914] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T17:40:58.288722] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-25T17:40:59.088721] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-25T17:40:59.209043] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T17:40:59.753402] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T17:40:59.888714] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-25T17:41:00.699812] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-25T17:41:00.720974] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:41:01.313244] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T17:41:01.486459] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T17:41:01.489999] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-25T17:41:02.288721] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-25T17:41:03.037920] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:41:03.088671] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-25T17:41:03.846887] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T17:41:03.888677] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-25T17:41:04.303487] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T17:41:04.688794] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-25T17:41:05.356741] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T17:41:05.488752] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-25T17:41:06.288737] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-25T17:41:06.679775] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T17:41:06.690775] [INFO ] [REMOTE ] BN: Full fetch complete (76635 records). [2025-09-25T17:41:06.691038] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-25T17:41:06.958370] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T17:41:07.093047] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-25T17:41:07.118178] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T17:41:07.258242] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-25T17:41:07.258398] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-25T17:41:07.259727] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-25T17:41:07.259880] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-25T17:41:07.265164] [DEBUG] [LOCAL ] BN: Trimmed 76635 records to 53384 (keeping 200 days of data) [2025-09-25T17:41:07.653877] [DEBUG] [LOCAL ] BN: Primary data saved (53384 records). [2025-09-25T17:41:07.654119] [INFO ] [MAIN ] BN: Full history saved. [2025-09-25T17:41:07.654344] [INFO ] [MAIN ] Update Progress: 313/2372 symbols completed. BN took 54.6s. Estimated remaining: 4h 30m 13s. Rate: 7.6 symbols/min [2025-09-25T17:41:07.860088] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:07.864542] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T17:41:07.866483] [INFO ] [REMOTE ] BNH: Full fetch complete (6884 records). [2025-09-25T17:41:07.868680] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-25T17:41:07.874802] [DEBUG] [LOCAL ] BNT: Loaded 3412 existing records from primary storage. [2025-09-25T17:41:07.898908] [INFO ] [MAIN ] BNT: Loaded 3412 existing records. [2025-09-25T17:41:07.916057] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-25T17:41:08.337849] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:08.381765] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-25T17:41:08.381861] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-25T17:41:08.422682] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-25T17:41:08.442682] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-25T17:41:08.649048] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-25T17:41:08.649139] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-25T17:41:08.649377] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-25T17:41:08.649415] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-25T17:41:08.649893] [DEBUG] [LOCAL ] BNH: Trimmed 6884 records to 4902 (keeping 200 days of data) [2025-09-25T17:41:08.697193] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-25T17:41:08.742129] [DEBUG] [LOCAL ] BNH: Primary data saved (4902 records). [2025-09-25T17:41:08.742288] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-25T17:41:08.742429] [INFO ] [MAIN ] Update Progress: 314/2372 symbols completed. BNH took 36.2s. Estimated remaining: 4h 29m 21s. Rate: 7.6 symbols/min [2025-09-25T17:41:09.111523] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:09.139854] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:09.156203] [DEBUG] [LOCAL ] BNY: Loaded 7382 existing records from primary storage. [2025-09-25T17:41:09.156343] [INFO ] [MAIN ] BNY: Loaded 7382 existing records. [2025-09-25T17:41:09.345627] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:09.345914] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-25T17:41:09.345963] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-25T17:41:09.346225] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-25T17:41:09.346284] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-25T17:41:09.498892] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-25T17:41:09.805010] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:09.834430] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T17:41:10.249262] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T17:41:10.288699] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-25T17:41:10.403427] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T17:41:10.415294] [INFO ] [REMOTE ] BNL: Full fetch complete (66720 records). [2025-09-25T17:41:10.415511] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-25T17:41:10.897148] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-25T17:41:10.897295] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-25T17:41:10.898385] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-25T17:41:10.898462] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-25T17:41:10.900580] [DEBUG] [LOCAL ] BNL: Trimmed 66720 records to 47233 (keeping 200 days of data) [2025-09-25T17:41:11.100674] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-25T17:41:11.233814] [DEBUG] [LOCAL ] BNL: Primary data saved (47233 records). [2025-09-25T17:41:11.234024] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-25T17:41:11.235863] [INFO ] [MAIN ] Update Progress: 315/2372 symbols completed. BNL took 29.8s. Estimated remaining: 4h 28m 38s. Rate: 7.7 symbols/min [2025-09-25T17:41:11.421070] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:11.455754] [DEBUG] [LOCAL ] BOC: Loaded 18381 existing records from primary storage. [2025-09-25T17:41:11.455962] [INFO ] [MAIN ] BOC: Loaded 18381 existing records. [2025-09-25T17:41:11.680564] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:11.681063] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-25T17:41:11.681118] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-25T17:41:11.681694] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-25T17:41:11.681773] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-25T17:41:11.892797] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-25T17:41:12.102097] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:41:12.121259] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T17:41:12.165093] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:12.308461] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-25T17:41:12.688719] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-25T17:41:13.225866] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T17:41:13.488731] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-25T17:41:14.288778] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-25T17:41:14.576751] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T17:41:15.088724] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-25T17:41:15.646764] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T17:41:15.888688] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-25T17:41:16.145442] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T17:41:16.688717] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-25T17:41:17.006791] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T17:41:17.488756] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-25T17:41:18.181431] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T17:41:18.209037] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T17:41:18.288789] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-25T17:41:19.088732] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-25T17:41:19.699416] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T17:41:19.888716] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-25T17:41:20.161812] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T17:41:20.636359] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T17:41:20.689223] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-25T17:41:21.488693] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-25T17:41:21.599567] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T17:41:22.288735] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-25T17:41:22.443285] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T17:41:22.895126] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T17:41:23.088700] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-25T17:41:23.888733] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-25T17:41:24.120155] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:41:24.496727] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T17:41:24.688702] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-25T17:41:25.226168] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-25T17:41:25.488692] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-25T17:41:26.203700] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T17:41:26.288701] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-25T17:41:26.950559] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T17:41:27.088692] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-25T17:41:27.888723] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-25T17:41:28.273283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T17:41:28.688698] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-25T17:41:28.749453] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T17:41:29.488756] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-25T17:41:29.526604] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T17:41:30.288767] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-25T17:41:30.978869] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T17:41:31.088747] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-25T17:41:31.254194] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T17:41:31.263933] [INFO ] [REMOTE ] BNS: Full fetch complete (74200 records). [2025-09-25T17:41:31.264133] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-25T17:41:31.708077] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-25T17:41:31.708191] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-25T17:41:31.709029] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-25T17:41:31.709149] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-25T17:41:31.710886] [DEBUG] [LOCAL ] BNS: Trimmed 74200 records to 51844 (keeping 200 days of data) [2025-09-25T17:41:31.913470] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-25T17:41:31.946444] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T17:41:32.055921] [DEBUG] [LOCAL ] BNS: Primary data saved (51844 records). [2025-09-25T17:41:32.056084] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-25T17:41:32.056244] [INFO ] [MAIN ] Update Progress: 316/2372 symbols completed. BNS took 35.8s. Estimated remaining: 4h 29m 54s. Rate: 7.6 symbols/min [2025-09-25T17:41:32.235966] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:32.265943] [DEBUG] [LOCAL ] BOE: Loaded 17572 existing records from primary storage. [2025-09-25T17:41:32.266090] [INFO ] [MAIN ] BOE: Loaded 17572 existing records. [2025-09-25T17:41:32.466156] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:32.466511] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-25T17:41:32.466592] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-25T17:41:32.467278] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-25T17:41:32.467378] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-25T17:41:32.580579] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T17:41:32.689595] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-25T17:41:32.848805] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:33.488714] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-25T17:41:33.577301] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T17:41:33.579836] [INFO ] [REMOTE ] BNY: Full fetch complete (10488 records). [2025-09-25T17:41:33.579923] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-25T17:41:33.950057] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-25T17:41:33.950191] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-25T17:41:33.950473] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-25T17:41:33.950515] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-25T17:41:33.951104] [DEBUG] [LOCAL ] BNY: Trimmed 10488 records to 7428 (keeping 200 days of data) [2025-09-25T17:41:34.004673] [DEBUG] [LOCAL ] BNY: Primary data saved (7428 records). [2025-09-25T17:41:34.004828] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-25T17:41:34.004934] [INFO ] [MAIN ] Update Progress: 317/2372 symbols completed. BNY took 25.3s. Estimated remaining: 4h 29m 8s. Rate: 7.6 symbols/min [2025-09-25T17:41:34.288724] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-25T17:41:34.426600] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:41:35.088727] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-25T17:41:35.390845] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T17:41:35.862507] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T17:41:35.888675] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-25T17:41:36.688706] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-25T17:41:36.894431] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T17:41:37.488728] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-25T17:41:37.803176] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T17:41:37.813078] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-25T17:41:38.288724] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-25T17:41:38.932735] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T17:41:38.934383] [INFO ] [REMOTE ] BNT: Full fetch complete (4474 records). [2025-09-25T17:41:38.934473] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-25T17:41:39.093949] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-25T17:41:39.322905] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-25T17:41:39.322981] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-25T17:41:39.323125] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-25T17:41:39.323161] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-25T17:41:39.323527] [DEBUG] [LOCAL ] BNT: Trimmed 4474 records to 3437 (keeping 200 days of data) [2025-09-25T17:41:39.349222] [DEBUG] [LOCAL ] BNT: Primary data saved (3437 records). [2025-09-25T17:41:39.349364] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-25T17:41:39.349475] [INFO ] [MAIN ] Update Progress: 318/2372 symbols completed. BNT took 31.7s. Estimated remaining: 4h 28m 44s. Rate: 7.6 symbols/min [2025-09-25T17:41:39.888731] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-25T17:41:40.317000] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T17:41:40.688720] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-25T17:41:41.005834] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T17:41:41.009425] [INFO ] [REMOTE ] BOC: Full fetch complete (25826 records). [2025-09-25T17:41:41.009502] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-25T17:41:41.384247] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-25T17:41:41.384331] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-25T17:41:41.384753] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-25T17:41:41.384823] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-25T17:41:41.386580] [DEBUG] [LOCAL ] BOC: Trimmed 25826 records to 18500 (keeping 200 days of data) [2025-09-25T17:41:41.510447] [DEBUG] [LOCAL ] BOC: Primary data saved (18500 records). [2025-09-25T17:41:41.510604] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-25T17:41:41.510741] [INFO ] [MAIN ] Update Progress: 319/2372 symbols completed. BOC took 30.3s. Estimated remaining: 4h 27m 60s. Rate: 7.7 symbols/min [2025-09-25T17:41:41.591615] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T17:41:41.596031] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-25T17:41:42.550190] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T17:41:42.559489] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-25T17:41:43.312982] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:41:43.318855] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-25T17:41:44.247440] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T17:41:44.251695] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-25T17:41:45.273031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T17:41:45.278066] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-25T17:41:46.038573] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:41:46.042353] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-25T17:41:47.261479] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:41:47.267068] [INFO ] [REMOTE ] BOE: Full fetch complete (26562 records). [2025-09-25T17:41:47.267220] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-25T17:41:47.267816] [FATAL] [VALIDATOR ] BOE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:41:47.267982] [FATAL] [MAIN ] BOE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:41:47.268058] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:41:47.268121] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-25T17:41:47.268223] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-09-25T17:41:47.268291] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-09-25T17:41:47.269690] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-09-25T17:41:47.269862] [INFO ] [MAIN ] Update Progress: 320/2372 symbols completed. BOE took 15.2s. Estimated remaining: 4h 27m 38s. Rate: 7.7 symbols/min [2025-09-25T17:41:47.955511] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:48.016546] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:48.031056] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:48.099672] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:41:48.144118] [DEBUG] [LOCAL ] BORR: Loaded 51165 existing records from primary storage. [2025-09-25T17:41:48.144281] [INFO ] [MAIN ] BORR: Loaded 51165 existing records. [2025-09-25T17:41:48.181196] [DEBUG] [LOCAL ] BOH: Loaded 31331 existing records from primary storage. [2025-09-25T17:41:48.181352] [INFO ] [MAIN ] BOH: Loaded 31331 existing records. [2025-09-25T17:41:48.292356] [DEBUG] [LOCAL ] BOND: Loaded 32119 existing records from primary storage. [2025-09-25T17:41:48.292563] [INFO ] [MAIN ] BOND: Loaded 32119 existing records. [2025-09-25T17:41:48.596356] [DEBUG] [LOCAL ] BOOT: Loaded 40846 existing records from primary storage. [2025-09-25T17:41:48.628931] [INFO ] [MAIN ] BOOT: Loaded 40846 existing records. [2025-09-25T17:41:48.702753] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:48.709141] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-25T17:41:48.709216] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-25T17:41:48.717512] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-25T17:41:48.717608] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-25T17:41:49.053400] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:49.053676] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-25T17:41:49.061767] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-25T17:41:49.062175] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-25T17:41:49.062235] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-25T17:41:49.079804] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:49.080001] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-25T17:41:49.080043] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-25T17:41:49.080258] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-25T17:41:49.080316] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-25T17:41:49.338380] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:41:49.338704] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-25T17:41:49.338761] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-25T17:41:49.339016] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-25T17:41:49.339074] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-25T17:41:50.161453] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:50.176109] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-25T17:41:50.532450] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:50.543996] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-25T17:41:50.557212] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:50.558373] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-25T17:41:50.652011] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:41:50.652283] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-25T17:41:51.482787] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T17:41:51.490497] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-25T17:41:51.902816] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T17:41:51.911562] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-25T17:41:52.090119] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T17:41:52.101386] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-25T17:41:52.159147] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T17:41:52.166170] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-25T17:41:52.504069] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T17:41:52.688726] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-25T17:41:53.166157] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T17:41:53.225973] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T17:41:53.489700] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-25T17:41:53.500384] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T17:41:53.830483] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T17:41:54.288723] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-25T17:41:55.082272] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T17:41:55.090697] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-25T17:41:55.533743] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T17:41:55.888714] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-25T17:41:56.688714] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-25T17:41:57.112238] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-25T17:41:57.174421] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T17:41:57.488728] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-25T17:41:58.227021] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T17:41:58.288692] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-25T17:41:58.347160] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T17:41:59.088733] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-25T17:41:59.624037] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T17:41:59.888768] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-25T17:42:00.688709] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-25T17:42:01.144345] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T17:42:01.318726] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:42:01.488708] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-25T17:42:02.288762] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-25T17:42:02.370871] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T17:42:03.088764] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-25T17:42:03.266724] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T17:42:03.700679] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T17:42:03.888729] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-25T17:42:04.529259] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T17:42:04.688768] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-25T17:42:05.409190] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T17:42:05.488691] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-25T17:42:06.217604] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:42:06.283188] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T17:42:06.288883] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-25T17:42:07.088723] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-25T17:42:07.888683] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-25T17:42:08.030301] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:42:08.213915] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T17:42:08.688703] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-25T17:42:09.289581] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T17:42:09.488683] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-25T17:42:10.288744] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-25T17:42:10.511940] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T17:42:10.720925] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T17:42:10.730701] [INFO ] [REMOTE ] BOOT: Full fetch complete (60334 records). [2025-09-25T17:42:10.730889] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-25T17:42:11.109042] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-25T17:42:11.220754] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-25T17:42:11.220851] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-25T17:42:11.221529] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-25T17:42:11.221570] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-25T17:42:11.222811] [DEBUG] [LOCAL ] BOOT: Trimmed 60334 records to 41144 (keeping 200 days of data) [2025-09-25T17:42:11.323354] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T17:42:11.519987] [DEBUG] [LOCAL ] BOOT: Primary data saved (41144 records). [2025-09-25T17:42:11.520122] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-25T17:42:11.520256] [INFO ] [MAIN ] Update Progress: 321/2372 symbols completed. BOOT took 24.2s. Estimated remaining: 4h 29m 16s. Rate: 7.6 symbols/min [2025-09-25T17:42:11.694728] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:11.725241] [DEBUG] [LOCAL ] BOW: Loaded 23628 existing records from primary storage. [2025-09-25T17:42:11.725372] [INFO ] [MAIN ] BOW: Loaded 23628 existing records. [2025-09-25T17:42:11.900740] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-25T17:42:11.905250] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:11.905470] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-25T17:42:11.905517] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-25T17:42:11.908672] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-25T17:42:11.908750] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-25T17:42:12.266458] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:12.509961] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:42:12.688698] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-25T17:42:12.845090] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T17:42:13.488703] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-25T17:42:14.231572] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T17:42:14.288733] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-25T17:42:14.581799] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T17:42:15.088721] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-25T17:42:15.689208] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T17:42:15.888722] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-25T17:42:16.688691] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-25T17:42:16.956675] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T17:42:17.330497] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T17:42:17.336306] [INFO ] [REMOTE ] BOH: Full fetch complete (44903 records). [2025-09-25T17:42:17.336396] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-25T17:42:17.495335] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-25T17:42:17.555934] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T17:42:17.737396] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-25T17:42:17.737485] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-25T17:42:17.738111] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-25T17:42:17.738174] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-25T17:42:17.739181] [DEBUG] [LOCAL ] BOH: Trimmed 44903 records to 31510 (keeping 200 days of data) [2025-09-25T17:42:17.946855] [DEBUG] [LOCAL ] BOH: Primary data saved (31510 records). [2025-09-25T17:42:17.946998] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-25T17:42:17.947088] [INFO ] [MAIN ] Update Progress: 322/2372 symbols completed. BOH took 30.7s. Estimated remaining: 4h 28m 58s. Rate: 7.6 symbols/min [2025-09-25T17:42:18.120415] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:18.180124] [DEBUG] [LOCAL ] BOX: Loaded 50296 existing records from primary storage. [2025-09-25T17:42:18.180280] [INFO ] [MAIN ] BOX: Loaded 50296 existing records. [2025-09-25T17:42:18.293808] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-25T17:42:18.362603] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:18.362949] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-25T17:42:18.363001] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-25T17:42:18.363314] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-25T17:42:18.363373] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-25T17:42:18.721011] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:19.003560] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T17:42:19.088691] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-25T17:42:19.227301] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T17:42:19.241773] [INFO ] [REMOTE ] BORR: Full fetch complete (74740 records). [2025-09-25T17:42:19.242053] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-25T17:42:19.692486] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-25T17:42:19.692631] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-25T17:42:19.693807] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-25T17:42:19.693895] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-25T17:42:19.697149] [DEBUG] [LOCAL ] BORR: Trimmed 74740 records to 51538 (keeping 200 days of data) [2025-09-25T17:42:19.897556] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-25T17:42:20.084038] [DEBUG] [LOCAL ] BORR: Primary data saved (51538 records). [2025-09-25T17:42:20.084317] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-25T17:42:20.086382] [INFO ] [MAIN ] Update Progress: 323/2372 symbols completed. BORR took 32.8s. Estimated remaining: 4h 28m 14s. Rate: 7.6 symbols/min [2025-09-25T17:42:20.299489] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:20.375513] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-25T17:42:20.375812] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-25T17:42:20.580787] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:20.581918] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-25T17:42:20.581971] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-25T17:42:20.582339] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-25T17:42:20.582404] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-25T17:42:20.698731] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-25T17:42:20.726055] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:42:21.067827] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:21.408015] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T17:42:21.488732] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-25T17:42:22.034199] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T17:42:22.288728] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-25T17:42:22.742454] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T17:42:23.088733] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-25T17:42:23.711342] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T17:42:23.717875] [INFO ] [REMOTE ] BOND: Full fetch complete (46345 records). [2025-09-25T17:42:23.717981] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-25T17:42:23.893884] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-25T17:42:24.111100] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-25T17:42:24.111212] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-25T17:42:24.111811] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-25T17:42:24.111876] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-25T17:42:24.116443] [DEBUG] [LOCAL ] BOND: Trimmed 46345 records to 32348 (keeping 200 days of data) [2025-09-25T17:42:24.246367] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T17:42:24.357238] [DEBUG] [LOCAL ] BOND: Primary data saved (32348 records). [2025-09-25T17:42:24.357392] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-25T17:42:24.357497] [INFO ] [MAIN ] Update Progress: 324/2372 symbols completed. BOND took 37.0s. Estimated remaining: 4h 27m 44s. Rate: 7.6 symbols/min [2025-09-25T17:42:24.536843] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:24.580663] [DEBUG] [LOCAL ] BR: Loaded 34707 existing records from primary storage. [2025-09-25T17:42:24.580819] [INFO ] [MAIN ] BR: Loaded 34707 existing records. [2025-09-25T17:42:24.694781] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-25T17:42:24.773053] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:24.773302] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-25T17:42:24.773346] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-25T17:42:24.773606] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-25T17:42:24.773985] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-25T17:42:25.148851] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:25.488755] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-25T17:42:25.781385] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T17:42:26.288722] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-25T17:42:26.342448] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T17:42:26.985460] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T17:42:27.088696] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-25T17:42:27.136922] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:42:27.888719] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-25T17:42:28.688697] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-25T17:42:28.834438] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:42:29.158016] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T17:42:29.309704] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T17:42:29.488718] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-25T17:42:30.288684] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-25T17:42:30.649399] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:42:31.088739] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-25T17:42:31.572753] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T17:42:31.888750] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-25T17:42:32.009596] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:42:32.014837] [INFO ] [REMOTE ] BOW: Full fetch complete (31121 records). [2025-09-25T17:42:32.014987] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-25T17:42:32.412313] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-25T17:42:32.412447] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-25T17:42:32.413118] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-25T17:42:32.413190] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-25T17:42:32.415063] [DEBUG] [LOCAL ] BOW: Trimmed 31121 records to 23795 (keeping 200 days of data) [2025-09-25T17:42:32.571580] [DEBUG] [LOCAL ] BOW: Primary data saved (23795 records). [2025-09-25T17:42:32.571823] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-25T17:42:32.571943] [INFO ] [MAIN ] Update Progress: 325/2372 symbols completed. BOW took 21.1s. Estimated remaining: 4h 27m 38s. Rate: 7.6 symbols/min [2025-09-25T17:42:32.693857] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-25T17:42:32.761904] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:32.829044] [DEBUG] [LOCAL ] BRBR: Loaded 51234 existing records from primary storage. [2025-09-25T17:42:32.829259] [INFO ] [MAIN ] BRBR: Loaded 51234 existing records. [2025-09-25T17:42:33.000457] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T17:42:33.079857] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:33.080342] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-25T17:42:33.080419] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-25T17:42:33.080799] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-25T17:42:33.080860] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-25T17:42:33.475686] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:33.488677] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-25T17:42:34.292104] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-25T17:42:34.298682] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T17:42:35.088708] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-25T17:42:35.124988] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:42:35.888731] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-25T17:42:36.259731] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-25T17:42:36.326039] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T17:42:36.688697] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-25T17:42:37.488714] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-25T17:42:37.650688] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T17:42:38.289003] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-25T17:42:38.676257] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T17:42:39.088781] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-25T17:42:39.429737] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T17:42:39.888790] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-25T17:42:39.999192] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T17:42:40.688839] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-25T17:42:41.294717] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-25T17:42:41.359223] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T17:42:41.488768] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-25T17:42:42.288815] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-25T17:42:42.514057] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T17:42:42.811109] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:42:43.088758] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-25T17:42:43.888860] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-25T17:42:44.445846] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T17:42:44.677995] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-25T17:42:44.693062] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-25T17:42:44.979043] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T17:42:45.488853] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-25T17:42:46.288676] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-25T17:42:46.352275] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T17:42:46.918295] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:42:47.088697] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-25T17:42:47.888760] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-25T17:42:48.550563] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T17:42:48.634916] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-25T17:42:48.688721] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-25T17:42:49.488907] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-25T17:42:49.549957] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T17:42:50.288857] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-25T17:42:50.813092] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T17:42:50.834108] [INFO ] [REMOTE ] BR: Full fetch complete (48765 records). [2025-09-25T17:42:50.834416] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-25T17:42:50.854242] [FATAL] [VALIDATOR ] BR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:42:50.854483] [FATAL] [MAIN ] BR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:42:50.854573] [WARN ] [MAIN ] BR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:42:50.857282] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-25T17:42:50.857606] [DEBUG] [LOCAL ] BR: No primary data file found to delete. [2025-09-25T17:42:50.857873] [INFO ] [LOCAL ] BR: Starting deletion of derivative data. [2025-09-25T17:42:50.858333] [DEBUG] [LOCAL ] BR: Deleted derivative data file. [2025-09-25T17:42:50.859090] [INFO ] [MAIN ] Update Progress: 326/2372 symbols completed. BR took 26.5s. Estimated remaining: 4h 28m 36s. Rate: 7.6 symbols/min [2025-09-25T17:42:50.912342] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-25T17:42:51.088970] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-25T17:42:51.112680] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:51.149727] [DEBUG] [LOCAL ] BRC: Loaded 19348 existing records from primary storage. [2025-09-25T17:42:51.149888] [INFO ] [MAIN ] BRC: Loaded 19348 existing records. [2025-09-25T17:42:51.334047] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:51.334422] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-25T17:42:51.334479] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-25T17:42:51.334725] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-25T17:42:51.334793] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-25T17:42:51.707034] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:51.888709] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-25T17:42:52.102480] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T17:42:52.112056] [INFO ] [REMOTE ] BOX: Full fetch complete (72102 records). [2025-09-25T17:42:52.112194] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-25T17:42:52.511162] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-25T17:42:52.511254] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-25T17:42:52.512049] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-25T17:42:52.512127] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-25T17:42:52.513573] [DEBUG] [LOCAL ] BOX: Trimmed 72102 records to 50653 (keeping 200 days of data) [2025-09-25T17:42:52.704741] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-25T17:42:52.861776] [DEBUG] [LOCAL ] BOX: Primary data saved (50653 records). [2025-09-25T17:42:52.861938] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-25T17:42:52.862077] [INFO ] [MAIN ] Update Progress: 327/2372 symbols completed. BOX took 34.9s. Estimated remaining: 4h 27m 51s. Rate: 7.6 symbols/min [2025-09-25T17:42:53.054045] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:53.124962] [DEBUG] [LOCAL ] BRCC: Loaded 40396 existing records from primary storage. [2025-09-25T17:42:53.125112] [INFO ] [MAIN ] BRCC: Loaded 40396 existing records. [2025-09-25T17:42:53.137583] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T17:42:53.326491] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:42:53.326800] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-25T17:42:53.326850] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-25T17:42:53.327089] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-25T17:42:53.327147] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-25T17:42:53.486368] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T17:42:53.507784] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-25T17:42:53.772584] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:42:54.023519] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T17:42:54.288773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-25T17:42:55.093816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-25T17:42:55.107690] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T17:42:55.572740] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T17:42:55.888756] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-25T17:42:56.688742] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-25T17:42:56.823990] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:42:57.488760] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-25T17:42:57.683230] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T17:42:58.243216] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T17:42:58.288715] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-25T17:42:58.709451] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T17:42:58.723042] [INFO ] [REMOTE ] BP: Full fetch complete (77763 records). [2025-09-25T17:42:58.723244] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-25T17:42:59.094771] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-25T17:42:59.202383] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-25T17:42:59.202517] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-25T17:42:59.203604] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-25T17:42:59.203703] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-25T17:42:59.208994] [DEBUG] [LOCAL ] BP: Trimmed 77763 records to 54101 (keeping 200 days of data) [2025-09-25T17:42:59.466573] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:42:59.633905] [DEBUG] [LOCAL ] BP: Primary data saved (54101 records). [2025-09-25T17:42:59.634130] [INFO ] [MAIN ] BP: Full history saved. [2025-09-25T17:42:59.634277] [INFO ] [MAIN ] Update Progress: 328/2372 symbols completed. BP took 39.5s. Estimated remaining: 4h 27m 37s. Rate: 7.6 symbols/min [2025-09-25T17:42:59.814671] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:42:59.888742] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-25T17:42:59.894901] [DEBUG] [LOCAL ] BRO: Loaded 51915 existing records from primary storage. [2025-09-25T17:42:59.895159] [INFO ] [MAIN ] BRO: Loaded 51915 existing records. [2025-09-25T17:43:00.098315] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:00.098698] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-25T17:43:00.098773] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-25T17:43:00.099169] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-25T17:43:00.099229] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-25T17:43:00.481251] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T17:43:00.534841] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:00.688669] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-25T17:43:01.014636] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T17:43:01.488901] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-25T17:43:01.897579] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T17:43:02.288763] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-25T17:43:03.088686] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-25T17:43:03.170945] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T17:43:03.888745] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-25T17:43:04.080634] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T17:43:04.290534] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T17:43:04.688716] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-25T17:43:05.488733] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-25T17:43:05.576942] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:43:06.079067] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T17:43:06.288716] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-25T17:43:06.690967] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T17:43:07.088711] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-25T17:43:07.888777] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-25T17:43:08.125682] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:43:08.688727] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-25T17:43:08.722319] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T17:43:08.755096] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T17:43:09.488774] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-25T17:43:10.288784] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-25T17:43:10.399574] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T17:43:10.561821] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:43:11.088774] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-25T17:43:11.692167] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:43:11.888792] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-25T17:43:12.678472] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T17:43:12.688827] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-25T17:43:12.690978] [INFO ] [REMOTE ] BRBR: Full fetch complete (71848 records). [2025-09-25T17:43:12.691079] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-25T17:43:13.122271] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-25T17:43:13.122393] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-25T17:43:13.123384] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-25T17:43:13.123467] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-25T17:43:13.125777] [DEBUG] [LOCAL ] BRBR: Trimmed 71848 records to 51612 (keeping 200 days of data) [2025-09-25T17:43:13.479529] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:43:13.493424] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-25T17:43:13.509905] [DEBUG] [LOCAL ] BRBR: Primary data saved (51612 records). [2025-09-25T17:43:13.510143] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-25T17:43:13.512121] [INFO ] [MAIN ] Update Progress: 329/2372 symbols completed. BRBR took 40.9s. Estimated remaining: 4h 28m 6s. Rate: 7.6 symbols/min [2025-09-25T17:43:13.707945] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:13.726832] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T17:43:13.790885] [DEBUG] [LOCAL ] BROS: Loaded 53287 existing records from primary storage. [2025-09-25T17:43:13.791125] [INFO ] [MAIN ] BROS: Loaded 53287 existing records. [2025-09-25T17:43:13.980099] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:13.980410] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-25T17:43:13.980457] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-25T17:43:13.980824] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-25T17:43:13.980884] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-25T17:43:14.293881] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-25T17:43:14.376631] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:15.017739] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T17:43:15.088731] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-25T17:43:15.567624] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T17:43:15.888748] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-25T17:43:16.342048] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:43:16.348366] [INFO ] [REMOTE ] BRC: Full fetch complete (29149 records). [2025-09-25T17:43:16.348639] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-25T17:43:16.695469] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-25T17:43:16.746051] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-25T17:43:16.746155] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-25T17:43:16.746611] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-25T17:43:16.746706] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-25T17:43:16.747728] [DEBUG] [LOCAL ] BRC: Trimmed 29149 records to 19466 (keeping 200 days of data) [2025-09-25T17:43:16.865944] [DEBUG] [LOCAL ] BRC: Primary data saved (19466 records). [2025-09-25T17:43:16.866086] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-25T17:43:16.866173] [INFO ] [MAIN ] Update Progress: 330/2372 symbols completed. BRC took 26.0s. Estimated remaining: 4h 27m 30s. Rate: 7.6 symbols/min [2025-09-25T17:43:17.036548] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:17.036753] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-25T17:43:17.036809] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-25T17:43:17.036964] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-25T17:43:17.037006] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-25T17:43:17.037045] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-25T17:43:17.037077] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-25T17:43:17.418513] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:17.488684] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-25T17:43:17.557718] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T17:43:17.706637] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:17.707023] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-25T17:43:18.242710] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T17:43:18.288676] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-25T17:43:18.511925] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:18.512266] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-25T17:43:19.088766] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-25T17:43:19.888767] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-25T17:43:20.688791] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-25T17:43:20.988676] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T17:43:21.488734] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-25T17:43:21.695274] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T17:43:21.963058] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:43:21.973610] [INFO ] [REMOTE ] BRCC: Full fetch complete (57930 records). [2025-09-25T17:43:21.973942] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-25T17:43:22.293916] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-25T17:43:22.388098] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-25T17:43:22.388233] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-25T17:43:22.389469] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-25T17:43:22.389552] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-25T17:43:22.391638] [DEBUG] [LOCAL ] BRCC: Trimmed 57930 records to 40672 (keeping 200 days of data) [2025-09-25T17:43:22.600058] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:22.601367] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-25T17:43:22.643194] [DEBUG] [LOCAL ] BRCC: Primary data saved (40672 records). [2025-09-25T17:43:22.643393] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-25T17:43:22.643505] [INFO ] [MAIN ] Update Progress: 331/2372 symbols completed. BRCC took 29.8s. Estimated remaining: 4h 27m 10s. Rate: 7.6 symbols/min [2025-09-25T17:43:22.827851] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:22.868639] [DEBUG] [LOCAL ] BRSP: Loaded 36996 existing records from primary storage. [2025-09-25T17:43:22.868908] [INFO ] [MAIN ] BRSP: Loaded 36996 existing records. [2025-09-25T17:43:23.065926] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:23.066512] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-25T17:43:23.066752] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-25T17:43:23.067103] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-25T17:43:23.067170] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-25T17:43:23.098026] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-25T17:43:23.226987] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:43:23.519235] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:23.888721] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-25T17:43:24.091591] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:24.091967] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-25T17:43:24.688781] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-25T17:43:24.847628] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:43:25.488724] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-25T17:43:26.288800] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-25T17:43:26.437143] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T17:43:27.088788] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-25T17:43:27.283200] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T17:43:27.294700] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:27.296152] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-25T17:43:27.607073] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T17:43:27.888715] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-25T17:43:28.688742] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-25T17:43:28.896830] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:28.897191] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-25T17:43:29.301917] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T17:43:29.488742] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-25T17:43:30.288776] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-25T17:43:31.088698] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-25T17:43:31.282803] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:43:31.283119] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-25T17:43:31.553550] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T17:43:31.876353] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:43:31.888667] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-25T17:43:32.688734] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-25T17:43:33.488687] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-25T17:43:33.531199] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T17:43:34.250691] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T17:43:34.288671] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-25T17:43:34.995057] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T17:43:35.088714] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-25T17:43:35.888833] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-25T17:43:36.225412] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T17:43:36.279111] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T17:43:36.688776] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-25T17:43:37.356880] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T17:43:37.488682] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-25T17:43:38.283973] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T17:43:38.292851] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-25T17:43:38.294745] [INFO ] [REMOTE ] BRO: Full fetch complete (74213 records). [2025-09-25T17:43:38.294836] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-25T17:43:38.694008] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-25T17:43:38.694207] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-25T17:43:38.695128] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-25T17:43:38.695269] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-25T17:43:38.697518] [DEBUG] [LOCAL ] BRO: Trimmed 74213 records to 52300 (keeping 200 days of data) [2025-09-25T17:43:38.849631] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T17:43:38.861063] [INFO ] [REMOTE ] BRSL: Full fetch complete (21972 records). [2025-09-25T17:43:38.863880] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-25T17:43:39.106177] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-25T17:43:39.162913] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 60 unique days, need 200 days [2025-09-25T17:43:39.167128] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:43:39.167434] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:43:39.170575] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-25T17:43:39.174631] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-25T17:43:39.174934] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-25T17:43:39.178609] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-25T17:43:39.182416] [INFO ] [MAIN ] Update Progress: 332/2372 symbols completed. BRSL took 22.3s. Estimated remaining: 4h 27m 55s. Rate: 7.6 symbols/min [2025-09-25T17:43:39.425824] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:39.439310] [DEBUG] [LOCAL ] BRO: Primary data saved (52300 records). [2025-09-25T17:43:39.439488] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-25T17:43:39.439587] [INFO ] [MAIN ] Update Progress: 333/2372 symbols completed. BRO took 39.8s. Estimated remaining: 4h 27m 1s. Rate: 7.6 symbols/min [2025-09-25T17:43:39.549228] [DEBUG] [LOCAL ] BRT: Loaded 4967 existing records from primary storage. [2025-09-25T17:43:39.549416] [INFO ] [MAIN ] BRT: Loaded 4967 existing records. [2025-09-25T17:43:39.716991] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:39.834390] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:39.835065] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-25T17:43:39.835316] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-25T17:43:39.835685] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-25T17:43:39.842725] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-25T17:43:39.876673] [DEBUG] [LOCAL ] BRW: Loaded 19261 existing records from primary storage. [2025-09-25T17:43:39.888235] [INFO ] [MAIN ] BRW: Loaded 19261 existing records. [2025-09-25T17:43:40.294122] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T17:43:40.340494] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:40.389029] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-25T17:43:40.394381] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-25T17:43:40.420439] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-25T17:43:40.413424] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-25T17:43:40.420682] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-25T17:43:40.589848] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:40.692485] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-25T17:43:40.882878] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:40.929077] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T17:43:41.335149] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T17:43:41.488774] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-25T17:43:41.880238] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T17:43:42.288726] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-25T17:43:42.328585] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T17:43:43.088787] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-25T17:43:43.307538] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T17:43:43.888757] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-25T17:43:44.273168] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:43:44.688720] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-25T17:43:44.828776] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T17:43:45.488709] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-25T17:43:46.288765] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-25T17:43:46.932709] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T17:43:47.049890] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-25T17:43:47.071617] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T17:43:47.088664] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-25T17:43:47.888760] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-25T17:43:48.688738] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-25T17:43:49.057270] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:43:49.349208] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T17:43:49.359327] [INFO ] [REMOTE ] BROS: Full fetch complete (76998 records). [2025-09-25T17:43:49.359485] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-25T17:43:49.495596] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-25T17:43:49.523068] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T17:43:49.782781] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-25T17:43:49.782863] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-25T17:43:49.783636] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-25T17:43:49.783758] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-25T17:43:49.785320] [DEBUG] [LOCAL ] BROS: Trimmed 76998 records to 53677 (keeping 200 days of data) [2025-09-25T17:43:50.112991] [DEBUG] [LOCAL ] BROS: Primary data saved (53677 records). [2025-09-25T17:43:50.113242] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-25T17:43:50.114296] [INFO ] [MAIN ] Update Progress: 334/2372 symbols completed. BROS took 36.6s. Estimated remaining: 4h 27m 10s. Rate: 7.6 symbols/min [2025-09-25T17:43:50.228890] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T17:43:50.293903] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-25T17:43:50.296198] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:50.358778] [DEBUG] [LOCAL ] BRX: Loaded 51773 existing records from primary storage. [2025-09-25T17:43:50.358918] [INFO ] [MAIN ] BRX: Loaded 51773 existing records. [2025-09-25T17:43:50.542251] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:50.542582] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-25T17:43:50.542693] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-25T17:43:50.543102] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-25T17:43:50.543186] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-25T17:43:50.844137] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T17:43:50.928619] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:51.088728] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-25T17:43:51.731837] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T17:43:51.888789] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-25T17:43:52.546038] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T17:43:52.688753] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-25T17:43:53.488822] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-25T17:43:54.080739] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T17:43:54.188303] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T17:43:54.195407] [INFO ] [REMOTE ] BRSP: Full fetch complete (54026 records). [2025-09-25T17:43:54.195535] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-25T17:43:54.293983] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-25T17:43:54.622843] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-25T17:43:54.622929] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-25T17:43:54.623632] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-25T17:43:54.623733] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-25T17:43:54.628381] [DEBUG] [LOCAL ] BRSP: Trimmed 54026 records to 37224 (keeping 200 days of data) [2025-09-25T17:43:54.857932] [DEBUG] [LOCAL ] BRSP: Primary data saved (37224 records). [2025-09-25T17:43:54.858098] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-25T17:43:54.858227] [INFO ] [MAIN ] Update Progress: 335/2372 symbols completed. BRSP took 32.2s. Estimated remaining: 4h 26m 43s. Rate: 7.6 symbols/min [2025-09-25T17:43:55.037869] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:55.076358] [DEBUG] [LOCAL ] BSAC: Loaded 33027 existing records from primary storage. [2025-09-25T17:43:55.076517] [INFO ] [MAIN ] BSAC: Loaded 33027 existing records. [2025-09-25T17:43:55.097357] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-25T17:43:55.265449] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:55.265801] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-25T17:43:55.265860] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-25T17:43:55.266088] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-25T17:43:55.266177] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-25T17:43:55.630536] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:43:55.758022] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T17:43:55.888689] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-25T17:43:55.923223] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:43:56.530557] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T17:43:56.688728] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-25T17:43:57.488769] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-25T17:43:58.216603] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T17:43:58.288689] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-25T17:43:58.451246] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T17:43:58.970061] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T17:43:58.971686] [INFO ] [REMOTE ] BRT: Full fetch complete (6831 records). [2025-09-25T17:43:58.971758] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-25T17:43:59.093901] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-25T17:43:59.355827] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-25T17:43:59.355914] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-25T17:43:59.356157] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-25T17:43:59.356196] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-25T17:43:59.356935] [DEBUG] [LOCAL ] BRT: Trimmed 6831 records to 4999 (keeping 200 days of data) [2025-09-25T17:43:59.391618] [DEBUG] [LOCAL ] BRT: Primary data saved (4999 records). [2025-09-25T17:43:59.391755] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-25T17:43:59.391868] [INFO ] [MAIN ] Update Progress: 336/2372 symbols completed. BRT took 20.2s. Estimated remaining: 4h 26m 15s. Rate: 7.6 symbols/min [2025-09-25T17:43:59.580528] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:43:59.626630] [DEBUG] [LOCAL ] BSBR: Loaded 35185 existing records from primary storage. [2025-09-25T17:43:59.626840] [INFO ] [MAIN ] BSBR: Loaded 35185 existing records. [2025-09-25T17:43:59.820402] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:43:59.820754] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-25T17:43:59.820827] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-25T17:43:59.821083] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-25T17:43:59.821156] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-25T17:43:59.894563] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-25T17:44:00.210228] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T17:44:00.246368] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:00.688709] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-25T17:44:01.210123] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T17:44:01.488733] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-25T17:44:02.105297] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T17:44:02.177351] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T17:44:02.288721] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-25T17:44:03.088731] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-25T17:44:03.697025] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T17:44:03.888739] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-25T17:44:04.333526] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T17:44:04.688739] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-25T17:44:05.211732] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:44:05.488743] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-25T17:44:05.987515] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T17:44:06.226220] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T17:44:06.288711] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-25T17:44:07.088724] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-25T17:44:07.737523] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T17:44:07.888719] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-25T17:44:08.586858] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T17:44:08.626094] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T17:44:08.688724] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-25T17:44:09.488806] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-25T17:44:10.133849] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T17:44:10.288733] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-25T17:44:11.088713] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-25T17:44:11.148870] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:44:11.343554] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T17:44:11.888737] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-25T17:44:12.534465] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T17:44:12.688751] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-25T17:44:13.186481] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T17:44:13.488755] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-25T17:44:14.061230] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T17:44:14.288753] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-25T17:44:15.043324] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:44:15.088699] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-25T17:44:15.311106] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T17:44:15.888759] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-25T17:44:16.405808] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T17:44:16.688736] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-25T17:44:16.976356] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T17:44:17.488750] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-25T17:44:17.778932] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T17:44:18.288787] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-25T17:44:18.806306] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T17:44:19.088726] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-25T17:44:19.888694] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-25T17:44:19.974022] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T17:44:20.106983] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T17:44:20.688739] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-25T17:44:21.159468] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:44:21.165836] [INFO ] [REMOTE ] BSAC: Full fetch complete (43626 records). [2025-09-25T17:44:21.165945] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-25T17:44:21.493880] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-25T17:44:21.583715] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-25T17:44:21.583816] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-25T17:44:21.584550] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-25T17:44:21.584620] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-25T17:44:21.585843] [DEBUG] [LOCAL ] BSAC: Trimmed 43626 records to 33282 (keeping 200 days of data) [2025-09-25T17:44:21.787092] [DEBUG] [LOCAL ] BSAC: Primary data saved (33282 records). [2025-09-25T17:44:21.787263] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-25T17:44:21.787375] [INFO ] [MAIN ] Update Progress: 337/2372 symbols completed. BSAC took 26.9s. Estimated remaining: 4h 27m 35s. Rate: 7.6 symbols/min [2025-09-25T17:44:21.957589] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:21.957790] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-09-25T17:44:21.957834] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-09-25T17:44:21.958000] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-25T17:44:21.958054] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-25T17:44:21.958123] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-09-25T17:44:21.958158] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-25T17:44:22.293722] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-25T17:44:22.333834] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:22.369704] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T17:44:22.897981] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T17:44:22.903342] [INFO ] [REMOTE ] BRW: Full fetch complete (29642 records). [2025-09-25T17:44:22.903475] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-25T17:44:23.089859] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-25T17:44:23.299708] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-25T17:44:23.299804] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-25T17:44:23.300220] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-25T17:44:23.300263] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-25T17:44:23.301189] [DEBUG] [LOCAL ] BRW: Trimmed 29642 records to 19574 (keeping 200 days of data) [2025-09-25T17:44:23.430877] [DEBUG] [LOCAL ] BRW: Primary data saved (19574 records). [2025-09-25T17:44:23.431036] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-25T17:44:23.431148] [INFO ] [MAIN ] Update Progress: 338/2372 symbols completed. BRW took 44.0s. Estimated remaining: 4h 26m 50s. Rate: 7.6 symbols/min [2025-09-25T17:44:23.628061] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:23.680321] [DEBUG] [LOCAL ] BSM: Loaded 32388 existing records from primary storage. [2025-09-25T17:44:23.680553] [INFO ] [MAIN ] BSM: Loaded 32388 existing records. [2025-09-25T17:44:23.890048] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-25T17:44:23.903708] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:44:23.905231] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-25T17:44:23.905344] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-25T17:44:23.905861] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-25T17:44:23.905945] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-25T17:44:24.008170] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T17:44:24.307061] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:24.688725] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-25T17:44:24.806100] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T17:44:24.836760] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T17:44:25.488725] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-25T17:44:25.969018] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T17:44:26.196040] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T17:44:26.288690] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-25T17:44:27.088790] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-25T17:44:27.888712] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-25T17:44:27.929961] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T17:44:27.940311] [INFO ] [REMOTE ] BRX: Full fetch complete (74886 records). [2025-09-25T17:44:27.940555] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-25T17:44:28.372171] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-25T17:44:28.372338] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-25T17:44:28.373745] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-25T17:44:28.373868] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-25T17:44:28.403411] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T17:44:28.412462] [DEBUG] [LOCAL ] BRX: Trimmed 74886 records to 52115 (keeping 200 days of data) [2025-09-25T17:44:28.414101] [INFO ] [REMOTE ] BSBR: Full fetch complete (50632 records). [2025-09-25T17:44:28.414224] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-25T17:44:28.692877] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-25T17:44:28.720094] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T17:44:28.996318] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-25T17:44:28.996767] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-25T17:44:28.997802] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-25T17:44:28.997900] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-25T17:44:29.002287] [DEBUG] [LOCAL ] BSBR: Trimmed 50632 records to 35491 (keeping 200 days of data) [2025-09-25T17:44:29.419578] [DEBUG] [LOCAL ] BSBR: Primary data saved (35491 records). [2025-09-25T17:44:29.420346] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-25T17:44:29.421346] [INFO ] [MAIN ] Update Progress: 339/2372 symbols completed. BSBR took 30.0s. Estimated remaining: 4h 26m 31s. Rate: 7.6 symbols/min [2025-09-25T17:44:29.494155] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-25T17:44:29.599680] [DEBUG] [LOCAL ] BRX: Primary data saved (52115 records). [2025-09-25T17:44:29.619482] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-25T17:44:29.621742] [INFO ] [MAIN ] Update Progress: 340/2372 symbols completed. BRX took 39.5s. Estimated remaining: 4h 25m 37s. Rate: 7.7 symbols/min [2025-09-25T17:44:29.621474] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:29.810320] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:29.820234] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-09-25T17:44:29.820637] [DEBUG] [LOCAL ] BST: Loaded 19137 existing records from primary storage. [2025-09-25T17:44:29.820765] [INFO ] [MAIN ] BST: Loaded 19137 existing records. [2025-09-25T17:44:29.852390] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-09-25T17:44:29.909415] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-25T17:44:29.927622] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-25T17:44:29.927801] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-25T17:44:29.928170] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-25T17:44:30.136782] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:44:30.207840] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T17:44:30.207114] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-25T17:44:30.269188] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-25T17:44:30.293794] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-25T17:44:30.293880] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-25T17:44:30.346728] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-25T17:44:30.467223] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T17:44:30.540803] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:30.848583] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:31.088737] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-25T17:44:31.091132] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T17:44:31.888814] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-25T17:44:32.087857] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T17:44:32.688723] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-25T17:44:33.013189] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T17:44:33.167169] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T17:44:33.488731] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-25T17:44:34.194870] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T17:44:34.288776] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-25T17:44:35.088726] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-25T17:44:35.463012] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T17:44:35.888715] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-25T17:44:36.272801] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:44:36.688706] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-25T17:44:37.311666] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T17:44:37.488804] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-25T17:44:37.535881] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T17:44:38.288745] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-25T17:44:38.697308] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T17:44:39.088720] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-25T17:44:39.177117] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T17:44:39.888735] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-25T17:44:40.447374] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T17:44:40.688804] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-25T17:44:40.831748] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T17:44:41.488736] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-25T17:44:41.725797] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:44:42.288773] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-25T17:44:42.582269] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T17:44:43.088741] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-25T17:44:43.486620] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T17:44:43.888720] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-25T17:44:44.407604] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T17:44:44.420560] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-25T17:44:44.688747] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-25T17:44:45.397622] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T17:44:45.401058] [INFO ] [REMOTE ] BSL: Full fetch complete (12621 records). [2025-09-25T17:44:45.401371] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-25T17:44:45.493900] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-25T17:44:45.775086] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-25T17:44:45.775176] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-25T17:44:45.775478] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-25T17:44:45.775517] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-25T17:44:45.776039] [DEBUG] [LOCAL ] BSL: Trimmed 12621 records to 8077 (keeping 200 days of data) [2025-09-25T17:44:45.827939] [DEBUG] [LOCAL ] BSL: Primary data saved (8077 records). [2025-09-25T17:44:45.828089] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-25T17:44:45.828183] [INFO ] [MAIN ] Update Progress: 341/2372 symbols completed. BSL took 24.0s. Estimated remaining: 4h 26m 19s. Rate: 7.6 symbols/min [2025-09-25T17:44:45.998730] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:46.060599] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-25T17:44:46.060812] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-25T17:44:46.240839] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:44:46.241112] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-25T17:44:46.241180] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-25T17:44:46.241421] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-25T17:44:46.241478] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-25T17:44:46.305058] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-25T17:44:46.562153] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T17:44:46.636408] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:47.088758] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-25T17:44:47.787725] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T17:44:47.888697] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-25T17:44:48.250161] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T17:44:48.688797] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-25T17:44:49.493821] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-25T17:44:49.518168] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:44:49.795442] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T17:44:50.288688] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-25T17:44:50.519497] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T17:44:51.088779] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-25T17:44:51.876686] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T17:44:51.888675] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-25T17:44:52.688779] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-25T17:44:53.195890] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T17:44:53.284283] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T17:44:53.488743] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-25T17:44:53.621490] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T17:44:54.288850] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-25T17:44:54.985888] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T17:44:54.994979] [INFO ] [REMOTE ] BSM: Full fetch complete (47548 records). [2025-09-25T17:44:54.995238] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-25T17:44:55.102903] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-25T17:44:55.520277] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-25T17:44:55.520405] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-25T17:44:55.521314] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-25T17:44:55.521385] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-25T17:44:55.523219] [DEBUG] [LOCAL ] BSM: Trimmed 47548 records to 32577 (keeping 200 days of data) [2025-09-25T17:44:55.742680] [DEBUG] [LOCAL ] BSM: Primary data saved (32577 records). [2025-09-25T17:44:55.742905] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-25T17:44:55.743103] [INFO ] [MAIN ] Update Progress: 342/2372 symbols completed. BSM took 32.3s. Estimated remaining: 4h 26m 23s. Rate: 7.6 symbols/min [2025-09-25T17:44:55.899317] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-25T17:44:55.937378] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:44:55.948466] [DEBUG] [LOCAL ] BTA: Loaded 5372 existing records from primary storage. [2025-09-25T17:44:55.948679] [INFO ] [MAIN ] BTA: Loaded 5372 existing records. [2025-09-25T17:44:56.145907] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:44:56.146564] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-25T17:44:56.146845] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-25T17:44:56.147292] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-25T17:44:56.147512] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-25T17:44:56.385533] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-25T17:44:56.629278] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:44:56.693868] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-25T17:44:56.732890] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:44:56.965389] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T17:44:57.488710] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-25T17:44:58.176724] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T17:44:58.288671] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-25T17:44:58.607838] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T17:44:59.086530] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T17:44:59.090024] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-25T17:44:59.848748] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T17:44:59.888706] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-25T17:45:00.688715] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-25T17:45:01.488732] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-25T17:45:01.724424] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T17:45:01.862063] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T17:45:02.288782] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-25T17:45:02.570806] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T17:45:03.088780] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-25T17:45:03.650046] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-25T17:45:03.885608] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T17:45:03.896623] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-25T17:45:04.688720] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-25T17:45:05.026354] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T17:45:05.488799] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-25T17:45:05.954742] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:45:05.959774] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36625 records). [2025-09-25T17:45:05.959913] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-25T17:45:06.293851] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-25T17:45:06.364009] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-25T17:45:06.364103] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-25T17:45:06.364612] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-25T17:45:06.364700] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-25T17:45:06.365893] [DEBUG] [LOCAL ] BSTZ: Trimmed 36625 records to 25007 (keeping 200 days of data) [2025-09-25T17:45:06.526154] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25007 records). [2025-09-25T17:45:06.526739] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-25T17:45:06.526968] [INFO ] [MAIN ] Update Progress: 343/2372 symbols completed. BSTZ took 36.9s. Estimated remaining: 4h 26m 32s. Rate: 7.6 symbols/min [2025-09-25T17:45:06.714809] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:06.732112] [DEBUG] [LOCAL ] BTCM: Loaded 14856 existing records from primary storage. [2025-09-25T17:45:06.732254] [INFO ] [MAIN ] BTCM: Loaded 14856 existing records. [2025-09-25T17:45:06.931479] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:45:06.931798] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-25T17:45:06.931856] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-25T17:45:06.932085] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-25T17:45:06.932145] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-25T17:45:07.044968] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T17:45:07.092139] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-25T17:45:07.332208] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:07.363779] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T17:45:07.888720] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-25T17:45:08.293413] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T17:45:08.297367] [INFO ] [REMOTE ] BST: Full fetch complete (28588 records). [2025-09-25T17:45:08.297476] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-25T17:45:08.298064] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:45:08.298156] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:45:08.298201] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:45:08.298270] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-25T17:45:08.298388] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-09-25T17:45:08.298469] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-09-25T17:45:08.299093] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-09-25T17:45:08.299232] [INFO ] [MAIN ] Update Progress: 344/2372 symbols completed. BST took 38.9s. Estimated remaining: 4h 25m 49s. Rate: 7.6 symbols/min [2025-09-25T17:45:08.482138] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:08.482385] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-09-25T17:45:08.482427] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-09-25T17:45:08.482582] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-25T17:45:08.482624] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-25T17:45:08.482704] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-09-25T17:45:08.482749] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-25T17:45:08.693804] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-25T17:45:08.869829] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T17:45:08.876071] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:09.488779] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-25T17:45:10.207144] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T17:45:10.288690] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-25T17:45:10.570576] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T17:45:11.083320] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T17:45:11.088670] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-25T17:45:11.847682] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T17:45:11.888704] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-25T17:45:12.522064] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T17:45:12.688757] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-25T17:45:13.488755] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-25T17:45:14.288749] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-25T17:45:14.616295] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T17:45:14.665922] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T17:45:15.088800] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-25T17:45:15.126225] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T17:45:15.888786] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-25T17:45:16.688702] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-25T17:45:16.783885] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:45:17.394616] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T17:45:17.488729] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-25T17:45:17.919150] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T17:45:17.920574] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T17:45:17.933304] [INFO ] [REMOTE ] BSX: Full fetch complete (77690 records). [2025-09-25T17:45:17.933459] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-25T17:45:18.302106] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-25T17:45:18.365992] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-25T17:45:18.366090] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-25T17:45:18.366913] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-25T17:45:18.366979] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-25T17:45:18.368507] [DEBUG] [LOCAL ] BSX: Trimmed 77690 records to 54078 (keeping 200 days of data) [2025-09-25T17:45:18.701470] [DEBUG] [LOCAL ] BSX: Primary data saved (54078 records). [2025-09-25T17:45:18.701625] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-25T17:45:18.701751] [INFO ] [MAIN ] Update Progress: 345/2372 symbols completed. BSX took 32.9s. Estimated remaining: 4h 25m 56s. Rate: 7.6 symbols/min [2025-09-25T17:45:18.878959] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:18.930506] [DEBUG] [LOCAL ] BTI: Loaded 53558 existing records from primary storage. [2025-09-25T17:45:18.930940] [INFO ] [MAIN ] BTI: Loaded 53558 existing records. [2025-09-25T17:45:19.005213] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-25T17:45:19.093983] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-25T17:45:19.134159] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:45:19.134428] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-25T17:45:19.134480] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-25T17:45:19.134851] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-25T17:45:19.134912] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-25T17:45:19.495116] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:19.888745] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-25T17:45:19.922893] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T17:45:20.688713] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-25T17:45:21.393353] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T17:45:21.488717] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-25T17:45:21.889596] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T17:45:22.288730] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-25T17:45:23.088703] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-25T17:45:23.185380] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T17:45:23.888759] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-25T17:45:24.057600] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T17:45:24.059770] [INFO ] [REMOTE ] BTA: Full fetch complete (9546 records). [2025-09-25T17:45:24.060017] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-25T17:45:24.079191] [FATAL] [VALIDATOR ] BTA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:45:24.079325] [FATAL] [MAIN ] BTA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:45:24.079463] [WARN ] [MAIN ] BTA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:45:24.079711] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-25T17:45:24.080936] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T17:45:24.080216] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-25T17:45:24.088063] [INFO ] [LOCAL ] BTA: Starting deletion of derivative data. [2025-09-25T17:45:24.088985] [DEBUG] [LOCAL ] BTA: Deleted derivative data file. [2025-09-25T17:45:24.089096] [INFO ] [MAIN ] Update Progress: 346/2372 symbols completed. BTA took 28.3s. Estimated remaining: 4h 25m 33s. Rate: 7.6 symbols/min [2025-09-25T17:45:24.266251] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:24.266451] [DEBUG] [LOCAL ] BTO: No existing data file found in primary storage. [2025-09-25T17:45:24.266491] [WARN ] [MAIN ] BTO: No existing data found, performing full refresh instead. [2025-09-25T17:45:24.266669] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-25T17:45:24.266728] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-25T17:45:24.266775] [DEBUG] [LOCAL ] BTO: No primary data file found to delete. [2025-09-25T17:45:24.266809] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-25T17:45:24.630248] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:24.688677] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-25T17:45:25.469741] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T17:45:25.488721] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-25T17:45:25.631927] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T17:45:26.219327] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T17:45:26.288705] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-25T17:45:27.033318] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:45:27.088754] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-25T17:45:27.888725] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-25T17:45:28.446200] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T17:45:28.507741] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T17:45:28.688743] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-25T17:45:29.488774] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-25T17:45:30.288733] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-25T17:45:30.692913] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T17:45:31.088684] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-25T17:45:31.155422] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T17:45:31.888692] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-25T17:45:31.934409] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T17:45:31.938925] [INFO ] [REMOTE ] BTCM: Full fetch complete (19456 records). [2025-09-25T17:45:31.939010] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-25T17:45:31.939450] [FATAL] [VALIDATOR ] BTCM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:45:31.939570] [FATAL] [MAIN ] BTCM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:45:31.939667] [WARN ] [MAIN ] BTCM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:45:31.939758] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-25T17:45:31.939859] [DEBUG] [LOCAL ] BTCM: No primary data file found to delete. [2025-09-25T17:45:31.939915] [INFO ] [LOCAL ] BTCM: Starting deletion of derivative data. [2025-09-25T17:45:31.940177] [DEBUG] [LOCAL ] BTCM: Deleted derivative data file. [2025-09-25T17:45:31.940269] [INFO ] [MAIN ] Update Progress: 347/2372 symbols completed. BTCM took 25.4s. Estimated remaining: 4h 25m 25s. Rate: 7.6 symbols/min [2025-09-25T17:45:32.113282] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:32.130891] [DEBUG] [LOCAL ] BTT: Loaded 15944 existing records from primary storage. [2025-09-25T17:45:32.131030] [INFO ] [MAIN ] BTT: Loaded 15944 existing records. [2025-09-25T17:45:32.310829] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:45:32.311073] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-25T17:45:32.311121] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-25T17:45:32.311345] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-25T17:45:32.311406] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-25T17:45:32.692045] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:32.692144] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-25T17:45:32.830132] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T17:45:32.828138] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T17:45:33.488774] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-25T17:45:34.288691] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-25T17:45:34.485176] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T17:45:34.897011] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T17:45:35.060144] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T17:45:35.088687] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-25T17:45:35.888750] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-25T17:45:36.688720] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-25T17:45:36.772688] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T17:45:37.139475] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T17:45:37.488764] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-25T17:45:38.288743] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-25T17:45:38.340622] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T17:45:38.997725] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T17:45:39.088778] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-25T17:45:39.371070] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T17:45:39.718405] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T17:45:39.888780] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-25T17:45:40.602773] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T17:45:40.688760] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-25T17:45:41.488757] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-25T17:45:42.288710] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-25T17:45:42.525205] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T17:45:43.088709] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-25T17:45:43.295289] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T17:45:43.483907] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T17:45:43.568403] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T17:45:43.570701] [INFO ] [REMOTE ] BTO: Full fetch complete (13300 records). [2025-09-25T17:45:43.570776] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-25T17:45:43.903275] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-25T17:45:43.955512] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-25T17:45:43.955685] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-25T17:45:43.956132] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-25T17:45:43.956215] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-25T17:45:43.957261] [DEBUG] [LOCAL ] BTO: Trimmed 13300 records to 8942 (keeping 200 days of data) [2025-09-25T17:45:44.032301] [DEBUG] [LOCAL ] BTO: Primary data saved (8942 records). [2025-09-25T17:45:44.032471] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-25T17:45:44.032556] [INFO ] [MAIN ] Update Progress: 348/2372 symbols completed. BTO took 19.9s. Estimated remaining: 4h 25m 42s. Rate: 7.6 symbols/min [2025-09-25T17:45:44.206591] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:44.266274] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-25T17:45:44.266502] [INFO ] [MAIN ] BTU: Loaded 53303 existing records. [2025-09-25T17:45:44.459590] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:45:44.459886] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-25T17:45:44.459935] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-25T17:45:44.460234] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-25T17:45:44.460350] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-25T17:45:44.693860] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-25T17:45:44.856883] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:44.940545] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:45:45.488772] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-25T17:45:46.297865] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-25T17:45:46.321934] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T17:45:46.436605] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T17:45:47.088786] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-25T17:45:47.824262] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T17:45:47.888709] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-25T17:45:48.688754] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-25T17:45:48.763197] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T17:45:49.488696] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-25T17:45:49.547309] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T17:45:50.288804] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-25T17:45:50.378374] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T17:45:51.088732] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-25T17:45:51.380507] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T17:45:51.390580] [INFO ] [REMOTE ] BTE: Full fetch complete (75980 records). [2025-09-25T17:45:51.390761] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-25T17:45:51.814252] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-25T17:45:51.814356] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-25T17:45:51.815198] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-25T17:45:51.815283] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-25T17:45:51.818161] [DEBUG] [LOCAL ] BTE: Trimmed 75980 records to 53117 (keeping 200 days of data) [2025-09-25T17:45:51.910664] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-25T17:45:52.158815] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T17:45:52.183234] [INFO ] [REMOTE ] BTI: Full fetch complete (77424 records). [2025-09-25T17:45:52.188491] [DEBUG] [LOCAL ] BTE: Primary data saved (53117 records). [2025-09-25T17:45:52.188808] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-25T17:45:52.189068] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-25T17:45:52.189289] [INFO ] [MAIN ] Update Progress: 349/2372 symbols completed. BTE took 43.9s. Estimated remaining: 4h 25m 36s. Rate: 7.6 symbols/min [2025-09-25T17:45:52.658533] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:52.734182] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-25T17:45:52.734566] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-25T17:45:52.817440] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-25T17:45:52.837621] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-25T17:45:52.837901] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-25T17:45:52.838890] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-25T17:45:52.838155] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-25T17:45:52.839183] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-25T17:45:52.847468] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-25T17:45:52.888096] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-25T17:45:52.932784] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T17:45:52.981425] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-25T17:45:52.945511] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T17:45:53.037185] [DEBUG] [LOCAL ] BTI: Trimmed 77424 records to 53946 (keeping 200 days of data) [2025-09-25T17:45:53.395098] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:53.516783] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-25T17:45:53.665788] [DEBUG] [LOCAL ] BTI: Primary data saved (53946 records). [2025-09-25T17:45:53.665992] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-25T17:45:53.666137] [INFO ] [MAIN ] Update Progress: 350/2372 symbols completed. BTI took 35.0s. Estimated remaining: 4h 24m 51s. Rate: 7.6 symbols/min [2025-09-25T17:45:53.865175] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:45:53.891534] [DEBUG] [LOCAL ] BTZ: Loaded 22755 existing records from primary storage. [2025-09-25T17:45:53.891703] [INFO ] [MAIN ] BTZ: Loaded 22755 existing records. [2025-09-25T17:45:54.149680] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:45:54.149906] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:45:54.156072] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-25T17:45:54.156270] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-25T17:45:54.156672] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-25T17:45:54.156736] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-25T17:45:54.304596] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-25T17:45:54.549682] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:45:54.623096] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:45:54.623417] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-25T17:45:55.088692] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-25T17:45:55.439406] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T17:45:55.888745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-25T17:45:56.051892] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T17:45:56.688774] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-25T17:45:56.900071] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:45:56.900580] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-25T17:45:57.488778] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-25T17:45:57.920852] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T17:45:58.266680] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T17:45:58.288708] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-25T17:45:59.088760] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-25T17:45:59.311344] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:45:59.827597] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T17:45:59.888716] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-25T17:46:00.688723] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-25T17:46:01.271935] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T17:46:01.488745] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-25T17:46:01.972360] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T17:46:02.288756] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-25T17:46:02.583699] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T17:46:03.088686] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-25T17:46:03.451850] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T17:46:03.888771] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-25T17:46:04.410389] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T17:46:04.688734] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-25T17:46:04.709931] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T17:46:04.714571] [INFO ] [REMOTE ] BTT: Full fetch complete (24340 records). [2025-09-25T17:46:04.714680] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-25T17:46:05.107516] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-25T17:46:05.107604] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-25T17:46:05.108002] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-25T17:46:05.108081] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-25T17:46:05.109016] [DEBUG] [LOCAL ] BTT: Trimmed 24340 records to 16032 (keeping 200 days of data) [2025-09-25T17:46:05.220238] [DEBUG] [LOCAL ] BTT: Primary data saved (16032 records). [2025-09-25T17:46:05.220434] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-25T17:46:05.220626] [INFO ] [MAIN ] Update Progress: 351/2372 symbols completed. BTT took 33.3s. Estimated remaining: 4h 25m 4s. Rate: 7.6 symbols/min [2025-09-25T17:46:05.459735] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:05.488719] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-25T17:46:05.530968] [DEBUG] [LOCAL ] BUD: Loaded 52737 existing records from primary storage. [2025-09-25T17:46:05.531129] [INFO ] [MAIN ] BUD: Loaded 52737 existing records. [2025-09-25T17:46:05.717395] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:05.717746] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-25T17:46:05.717805] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-25T17:46:05.718042] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-25T17:46:05.718102] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-25T17:46:06.077283] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:06.288735] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-25T17:46:06.479797] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T17:46:06.754281] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T17:46:07.088763] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-25T17:46:07.888726] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-25T17:46:08.027068] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:46:08.688743] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-25T17:46:08.816973] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T17:46:09.233450] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T17:46:09.488777] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-25T17:46:09.923900] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T17:46:10.288797] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-25T17:46:10.771152] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T17:46:11.088724] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-25T17:46:11.888719] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-25T17:46:12.155625] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T17:46:12.589382] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T17:46:12.666815] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T17:46:12.688663] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-25T17:46:13.488723] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-25T17:46:14.288695] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-25T17:46:14.584797] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T17:46:14.739274] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T17:46:15.088714] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-25T17:46:15.888702] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-25T17:46:16.123373] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T17:46:16.189150] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T17:46:16.688722] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-25T17:46:17.334856] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T17:46:17.340358] [INFO ] [REMOTE ] BTX: Full fetch complete (35773 records). [2025-09-25T17:46:17.340463] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-25T17:46:17.341173] [FATAL] [VALIDATOR ] BTX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:46:17.341261] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:46:17.341304] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:46:17.341378] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-25T17:46:17.341472] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-25T17:46:17.341528] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-25T17:46:17.341570] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-25T17:46:17.341661] [INFO ] [MAIN ] Update Progress: 352/2372 symbols completed. BTX took 25.2s. Estimated remaining: 4h 25m 21s. Rate: 7.6 symbols/min [2025-09-25T17:46:17.501807] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-25T17:46:17.536934] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:17.551699] [DEBUG] [LOCAL ] BUI: Loaded 11472 existing records from primary storage. [2025-09-25T17:46:17.551909] [INFO ] [MAIN ] BUI: Loaded 11472 existing records. [2025-09-25T17:46:17.740733] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:17.741078] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-25T17:46:17.741135] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-25T17:46:17.741353] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-25T17:46:17.741411] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-25T17:46:18.113593] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:18.288737] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-25T17:46:18.531452] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T17:46:19.088675] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-25T17:46:19.134835] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:46:19.461096] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T17:46:19.471295] [INFO ] [REMOTE ] BTU: Full fetch complete (76839 records). [2025-09-25T17:46:19.471440] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-25T17:46:19.886509] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-25T17:46:19.886603] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-25T17:46:19.887405] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-25T17:46:19.887471] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-25T17:46:19.888705] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-25T17:46:19.890117] [DEBUG] [LOCAL ] BTU: Trimmed 76839 records to 53693 (keeping 200 days of data) [2025-09-25T17:46:20.235758] [DEBUG] [LOCAL ] BTU: Primary data saved (53693 records). [2025-09-25T17:46:20.235960] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-25T17:46:20.236126] [INFO ] [MAIN ] Update Progress: 353/2372 symbols completed. BTU took 36.2s. Estimated remaining: 4h 24m 44s. Rate: 7.6 symbols/min [2025-09-25T17:46:20.410309] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:20.453606] [DEBUG] [LOCAL ] BUR: Loaded 45078 existing records from primary storage. [2025-09-25T17:46:20.453791] [INFO ] [MAIN ] BUR: Loaded 45078 existing records. [2025-09-25T17:46:20.634952] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:20.635188] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-25T17:46:20.635251] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-25T17:46:20.635492] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-25T17:46:20.635550] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-25T17:46:20.699076] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-25T17:46:20.748522] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T17:46:21.011151] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:21.488735] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-25T17:46:21.842810] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T17:46:22.107684] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T17:46:22.288761] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-25T17:46:23.091255] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-25T17:46:23.092131] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T17:46:23.888777] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-25T17:46:24.543157] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T17:46:24.688776] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-25T17:46:25.103450] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T17:46:25.488759] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-25T17:46:26.054080] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T17:46:26.288696] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-25T17:46:26.453191] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T17:46:26.458875] [INFO ] [REMOTE ] BTZ: Full fetch complete (33790 records). [2025-09-25T17:46:26.459082] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-25T17:46:26.875435] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-25T17:46:26.875565] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-25T17:46:26.876187] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-25T17:46:26.876256] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-25T17:46:26.877757] [DEBUG] [LOCAL ] BTZ: Trimmed 33790 records to 22899 (keeping 200 days of data) [2025-09-25T17:46:27.042915] [DEBUG] [LOCAL ] BTZ: Primary data saved (22899 records). [2025-09-25T17:46:27.043123] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-25T17:46:27.043242] [INFO ] [MAIN ] Update Progress: 354/2372 symbols completed. BTZ took 33.4s. Estimated remaining: 4h 24m 30s. Rate: 7.6 symbols/min [2025-09-25T17:46:27.111302] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-25T17:46:27.227500] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:27.282052] [DEBUG] [LOCAL ] BURL: Loaded 46310 existing records from primary storage. [2025-09-25T17:46:27.282266] [INFO ] [MAIN ] BURL: Loaded 46310 existing records. [2025-09-25T17:46:27.496377] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:27.496962] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-25T17:46:27.497100] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-25T17:46:27.497427] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-25T17:46:27.497500] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-25T17:46:27.905975] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:27.900168] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T17:46:27.906455] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-25T17:46:28.062192] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T17:46:28.688755] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-25T17:46:29.488715] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-25T17:46:29.499357] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T17:46:29.644076] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:46:30.288801] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-25T17:46:30.907513] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:46:31.035684] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:46:31.088671] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-25T17:46:31.843373] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T17:46:31.888739] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-25T17:46:32.688780] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-25T17:46:33.115270] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T17:46:33.400769] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T17:46:33.488688] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-25T17:46:34.271050] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T17:46:34.288670] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-25T17:46:35.088719] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-25T17:46:35.749039] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T17:46:35.888692] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-25T17:46:36.683432] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T17:46:36.691784] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-25T17:46:37.490547] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-25T17:46:37.495943] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T17:46:37.616190] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T17:46:37.619140] [INFO ] [REMOTE ] BUI: Full fetch complete (16115 records). [2025-09-25T17:46:37.619215] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-25T17:46:37.619786] [FATAL] [VALIDATOR ] BUI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:46:37.619876] [FATAL] [MAIN ] BUI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:46:37.619930] [WARN ] [MAIN ] BUI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:46:37.620111] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-25T17:46:37.620200] [DEBUG] [LOCAL ] BUI: No primary data file found to delete. [2025-09-25T17:46:37.620251] [INFO ] [LOCAL ] BUI: Starting deletion of derivative data. [2025-09-25T17:46:37.620507] [DEBUG] [LOCAL ] BUI: Deleted derivative data file. [2025-09-25T17:46:37.620605] [INFO ] [MAIN ] Update Progress: 355/2372 symbols completed. BUI took 20.3s. Estimated remaining: 4h 24m 38s. Rate: 7.6 symbols/min [2025-09-25T17:46:37.801370] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:37.820584] [DEBUG] [LOCAL ] BUXX: Loaded 15128 existing records from primary storage. [2025-09-25T17:46:37.820763] [INFO ] [MAIN ] BUXX: Loaded 15128 existing records. [2025-09-25T17:46:38.004269] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:38.004534] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-25T17:46:38.004581] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-25T17:46:38.004826] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-25T17:46:38.004887] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-25T17:46:38.290290] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-25T17:46:38.384072] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:39.088818] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-25T17:46:39.276502] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T17:46:39.484080] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T17:46:39.888843] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-25T17:46:40.034614] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T17:46:40.688799] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-25T17:46:41.427103] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T17:46:41.488676] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-25T17:46:41.537746] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T17:46:42.288718] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-25T17:46:42.825349] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T17:46:43.088831] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-25T17:46:43.888711] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-25T17:46:44.239277] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T17:46:44.532069] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T17:46:44.629423] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T17:46:44.637796] [INFO ] [REMOTE ] BUR: Full fetch complete (63347 records). [2025-09-25T17:46:44.637944] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-25T17:46:44.695783] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-25T17:46:45.047574] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-25T17:46:45.047730] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-25T17:46:45.048679] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-25T17:46:45.048748] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-25T17:46:45.050251] [DEBUG] [LOCAL ] BUR: Trimmed 63347 records to 45395 (keeping 200 days of data) [2025-09-25T17:46:45.333785] [DEBUG] [LOCAL ] BUR: Primary data saved (45395 records). [2025-09-25T17:46:45.333938] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-25T17:46:45.334053] [INFO ] [MAIN ] Update Progress: 356/2372 symbols completed. BUR took 25.1s. Estimated remaining: 4h 24m 29s. Rate: 7.6 symbols/min [2025-09-25T17:46:45.492532] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-25T17:46:45.511191] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:46:45.550065] [DEBUG] [LOCAL ] BV: Loaded 38509 existing records from primary storage. [2025-09-25T17:46:45.550216] [INFO ] [MAIN ] BV: Loaded 38509 existing records. [2025-09-25T17:46:45.728563] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:46:45.728842] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-25T17:46:45.728914] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-25T17:46:45.729205] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-25T17:46:45.729262] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-25T17:46:46.098504] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:46:46.288709] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-25T17:46:46.383757] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T17:46:46.563060] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T17:46:47.088767] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-25T17:46:47.601166] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T17:46:47.888784] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-25T17:46:48.241560] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T17:46:48.688771] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-25T17:46:48.913198] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T17:46:49.488733] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-25T17:46:49.875744] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T17:46:50.244315] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-25T17:46:50.288692] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-25T17:46:51.088894] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-25T17:46:51.172889] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T17:46:51.888749] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-25T17:46:52.643281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T17:46:52.688688] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-25T17:46:52.809098] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T17:46:53.488736] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-25T17:46:54.288770] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-25T17:46:54.484186] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (35.40 seconds). [2025-09-25T17:46:54.564027] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T17:46:54.573457] [INFO ] [REMOTE ] BURL: Full fetch complete (65724 records). [2025-09-25T17:46:54.573669] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-25T17:46:54.752368] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T17:46:55.048293] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-25T17:46:55.049795] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:46:55.049260] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-25T17:46:55.054718] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-25T17:46:55.055015] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-25T17:46:55.057252] [DEBUG] [LOCAL ] BURL: Trimmed 65724 records to 46617 (keeping 200 days of data) [2025-09-25T17:46:55.111409] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-25T17:46:55.350716] [DEBUG] [LOCAL ] BURL: Primary data saved (46617 records). [2025-09-25T17:46:55.350872] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-25T17:46:55.350964] [INFO ] [MAIN ] Update Progress: 357/2372 symbols completed. BURL took 28.3s. Estimated remaining: 4h 24m 33s. Rate: 7.6 symbols/min [2025-09-25T17:46:55.888712] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-25T17:46:56.152767] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:46:56.155945] [INFO ] [REMOTE ] BUXX: Full fetch complete (20147 records). [2025-09-25T17:46:56.156067] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-25T17:46:56.156841] [FATAL] [VALIDATOR ] BUXX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:46:56.156966] [FATAL] [MAIN ] BUXX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:46:56.157013] [WARN ] [MAIN ] BUXX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:46:56.157053] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-25T17:46:56.157122] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-09-25T17:46:56.157162] [INFO ] [LOCAL ] BUXX: Starting deletion of derivative data. [2025-09-25T17:46:56.157554] [DEBUG] [LOCAL ] BUXX: Deleted derivative data file. [2025-09-25T17:46:56.157694] [INFO ] [MAIN ] Update Progress: 358/2372 symbols completed. BUXX took 18.5s. Estimated remaining: 4h 23m 46s. Rate: 7.6 symbols/min [2025-09-25T17:46:56.688731] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-25T17:46:57.087050] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T17:46:57.488768] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-25T17:46:58.323027] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T17:46:58.335470] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-25T17:46:58.770477] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T17:46:59.088763] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-25T17:47:00.280202] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T17:47:00.294401] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-25T17:47:00.416261] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T17:47:00.688777] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-25T17:47:02.071322] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T17:47:02.082606] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-25T17:47:02.403164] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-25T17:47:02.415803] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-25T17:47:03.488135] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T17:47:03.498397] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-25T17:47:04.240284] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T17:47:04.254829] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-25T17:47:05.127017] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T17:47:05.136828] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-25T17:47:06.259999] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T17:47:06.270794] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-25T17:47:06.381881] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-25T17:47:06.394743] [INFO ] [REMOTE ] BUD: Full fetch complete (76491 records). [2025-09-25T17:47:06.395009] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-25T17:47:06.834384] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-25T17:47:06.834528] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-25T17:47:06.835695] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-25T17:47:06.835767] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-25T17:47:06.837955] [DEBUG] [LOCAL ] BUD: Trimmed 76491 records to 53125 (keeping 200 days of data) [2025-09-25T17:47:07.198098] [DEBUG] [LOCAL ] BUD: Primary data saved (53125 records). [2025-09-25T17:47:07.198279] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-25T17:47:07.201909] [INFO ] [MAIN ] Update Progress: 359/2372 symbols completed. BUD took 1m 2s. Estimated remaining: 4h 23m 56s. Rate: 7.6 symbols/min [2025-09-25T17:47:07.721931] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T17:47:07.730794] [INFO ] [REMOTE ] BV: Full fetch complete (53792 records). [2025-09-25T17:47:07.730955] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-25T17:47:08.110976] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-25T17:47:08.111054] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-25T17:47:08.111633] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-25T17:47:08.111713] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-25T17:47:08.112866] [DEBUG] [LOCAL ] BV: Trimmed 53792 records to 38782 (keeping 200 days of data) [2025-09-25T17:47:08.340243] [DEBUG] [LOCAL ] BV: Primary data saved (38782 records). [2025-09-25T17:47:08.340388] [INFO ] [MAIN ] BV: Full history saved. [2025-09-25T17:47:08.340470] [INFO ] [MAIN ] Update Progress: 360/2372 symbols completed. BV took 23.0s. Estimated remaining: 4h 23m 10s. Rate: 7.6 symbols/min [2025-09-25T17:47:08.970683] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:09.010935] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:09.108140] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:09.139181] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:09.154845] [DEBUG] [LOCAL ] BWG: Loaded 12359 existing records from primary storage. [2025-09-25T17:47:09.155134] [INFO ] [MAIN ] BWG: Loaded 12359 existing records. [2025-09-25T17:47:09.418355] [DEBUG] [LOCAL ] BW: Loaded 39574 existing records from primary storage. [2025-09-25T17:47:09.448471] [INFO ] [MAIN ] BW: Loaded 39574 existing records. [2025-09-25T17:47:09.417610] [DEBUG] [LOCAL ] BVN: Loaded 43807 existing records from primary storage. [2025-09-25T17:47:09.456015] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:09.470290] [INFO ] [MAIN ] BVN: Loaded 43807 existing records. [2025-09-25T17:47:09.470178] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-25T17:47:09.524328] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-25T17:47:09.559790] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-25T17:47:09.651835] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-25T17:47:09.641369] [DEBUG] [LOCAL ] BWA: Loaded 52242 existing records from primary storage. [2025-09-25T17:47:09.693530] [INFO ] [MAIN ] BWA: Loaded 52242 existing records. [2025-09-25T17:47:10.101792] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:10.172609] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:10.200569] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-25T17:47:10.207402] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-25T17:47:10.243092] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-25T17:47:10.223550] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-25T17:47:10.270310] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-25T17:47:10.263873] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-25T17:47:10.301025] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-25T17:47:10.311437] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-25T17:47:10.638631] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:10.750204] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-25T17:47:10.763372] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-25T17:47:10.850101] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-25T17:47:10.872729] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-25T17:47:11.117218] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:11.172203] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-25T17:47:11.808880] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:11.838971] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:11.839562] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-25T17:47:11.852713] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-25T17:47:11.998194] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:11.998608] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-25T17:47:12.235510] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T17:47:12.238098] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-25T17:47:13.421539] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:47:13.455453] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T17:47:13.456762] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-25T17:47:13.465213] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-25T17:47:13.464511] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T17:47:13.478098] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-25T17:47:13.537626] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:47:13.549572] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-25T17:47:14.308080] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T17:47:14.310964] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-25T17:47:14.924454] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T17:47:14.925817] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T17:47:14.939045] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-25T17:47:15.009637] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T17:47:15.088812] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-25T17:47:15.221881] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T17:47:15.739054] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T17:47:15.888710] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-25T17:47:16.241782] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T17:47:16.404352] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-25T17:47:16.688720] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-25T17:47:17.488704] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-25T17:47:17.542415] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T17:47:18.288747] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-25T17:47:19.004095] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T17:47:19.088747] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-25T17:47:19.445103] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T17:47:19.888753] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-25T17:47:20.389403] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T17:47:20.688712] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-25T17:47:21.354602] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T17:47:21.488775] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-25T17:47:22.066553] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T17:47:22.288717] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-25T17:47:23.088686] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-25T17:47:23.248478] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T17:47:23.888697] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-25T17:47:23.923359] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T17:47:24.086528] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T17:47:24.688757] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-25T17:47:25.433703] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T17:47:25.453504] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:47:25.488688] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-25T17:47:26.288740] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-25T17:47:27.022979] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T17:47:27.039106] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T17:47:27.042337] [INFO ] [REMOTE ] BWG: Full fetch complete (17726 records). [2025-09-25T17:47:27.042417] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-25T17:47:27.096527] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-25T17:47:27.415384] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-25T17:47:27.415469] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-25T17:47:27.415849] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-25T17:47:27.415913] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-25T17:47:27.416483] [DEBUG] [LOCAL ] BWG: Trimmed 17726 records to 12430 (keeping 200 days of data) [2025-09-25T17:47:27.489820] [DEBUG] [LOCAL ] BWG: Primary data saved (12430 records). [2025-09-25T17:47:27.489958] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-25T17:47:27.490045] [INFO ] [MAIN ] Update Progress: 361/2372 symbols completed. BWG took 19.1s. Estimated remaining: 4h 24m 5s. Rate: 7.6 symbols/min [2025-09-25T17:47:27.660172] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:27.660376] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-09-25T17:47:27.660432] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-09-25T17:47:27.660585] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-25T17:47:27.660628] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-25T17:47:27.660710] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-25T17:47:27.660753] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-25T17:47:27.893853] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-25T17:47:28.023744] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:28.549866] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T17:47:28.688677] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-25T17:47:29.242305] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T17:47:29.488716] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-25T17:47:30.288693] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-25T17:47:30.628554] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T17:47:30.678664] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T17:47:31.088723] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-25T17:47:31.843496] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T17:47:31.888777] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-25T17:47:32.688810] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-25T17:47:32.930534] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:47:33.488748] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-25T17:47:33.776569] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T17:47:34.288849] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-25T17:47:34.411222] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T17:47:35.088718] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-25T17:47:35.418147] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T17:47:35.454218] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T17:47:35.888786] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-25T17:47:36.411167] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T17:47:36.419536] [INFO ] [REMOTE ] BVN: Full fetch complete (62352 records). [2025-09-25T17:47:36.419688] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-25T17:47:36.420365] [FATAL] [VALIDATOR ] BVN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:47:36.420453] [FATAL] [MAIN ] BVN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:47:36.420497] [WARN ] [MAIN ] BVN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:47:36.420536] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-25T17:47:36.420594] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-09-25T17:47:36.420629] [INFO ] [LOCAL ] BVN: Starting deletion of derivative data. [2025-09-25T17:47:36.420977] [DEBUG] [LOCAL ] BVN: Deleted derivative data file. [2025-09-25T17:47:36.421073] [INFO ] [MAIN ] Update Progress: 362/2372 symbols completed. BVN took 28.1s. Estimated remaining: 4h 24m 3s. Rate: 7.6 symbols/min [2025-09-25T17:47:36.592013] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:36.601857] [DEBUG] [LOCAL ] BWMX: Loaded 7626 existing records from primary storage. [2025-09-25T17:47:36.601972] [INFO ] [MAIN ] BWMX: Loaded 7626 existing records. [2025-09-25T17:47:36.693826] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-25T17:47:36.785639] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:36.785920] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-25T17:47:36.785968] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-25T17:47:36.786162] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-25T17:47:36.786219] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-25T17:47:37.153714] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:37.470099] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T17:47:37.488676] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-25T17:47:38.199912] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T17:47:38.209150] [INFO ] [REMOTE ] BW: Full fetch complete (58722 records). [2025-09-25T17:47:38.209326] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-25T17:47:38.293980] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-25T17:47:38.621187] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-25T17:47:38.621277] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-25T17:47:38.622002] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-25T17:47:38.622072] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-25T17:47:38.623489] [DEBUG] [LOCAL ] BW: Trimmed 58722 records to 39935 (keeping 200 days of data) [2025-09-25T17:47:38.876983] [DEBUG] [LOCAL ] BW: Primary data saved (39935 records). [2025-09-25T17:47:38.877143] [INFO ] [MAIN ] BW: Full history saved. [2025-09-25T17:47:38.877235] [INFO ] [MAIN ] Update Progress: 363/2372 symbols completed. BW took 30.5s. Estimated remaining: 4h 23m 26s. Rate: 7.6 symbols/min [2025-09-25T17:47:39.064902] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:39.072485] [DEBUG] [LOCAL ] BWNB: Loaded 4454 existing records from primary storage. [2025-09-25T17:47:39.072600] [INFO ] [MAIN ] BWNB: Loaded 4454 existing records. [2025-09-25T17:47:39.095186] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-25T17:47:39.174524] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T17:47:39.275540] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:47:39.276038] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-25T17:47:39.276166] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-25T17:47:39.276521] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-25T17:47:39.276585] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-25T17:47:39.701590] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-25T17:47:39.707621] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:39.888723] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-25T17:47:40.212573] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T17:47:40.357523] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-25T17:47:40.688725] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-25T17:47:41.488760] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-25T17:47:42.070570] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T17:47:42.288990] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-25T17:47:42.414424] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:47:43.088755] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-25T17:47:43.705203] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T17:47:43.707202] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:47:43.888756] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-25T17:47:44.336073] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T17:47:44.688744] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-25T17:47:45.488764] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-25T17:47:46.288758] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-25T17:47:46.398432] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T17:47:46.408627] [INFO ] [REMOTE ] BWA: Full fetch complete (75740 records). [2025-09-25T17:47:46.408820] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-25T17:47:46.722886] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T17:47:46.815569] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-25T17:47:46.815699] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-25T17:47:46.816500] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-25T17:47:46.816610] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-25T17:47:46.818270] [DEBUG] [LOCAL ] BWA: Trimmed 75740 records to 52616 (keeping 200 days of data) [2025-09-25T17:47:47.113235] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-25T17:47:47.159332] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T17:47:47.185953] [DEBUG] [LOCAL ] BWA: Primary data saved (52616 records). [2025-09-25T17:47:47.186080] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-25T17:47:47.186166] [INFO ] [MAIN ] Update Progress: 364/2372 symbols completed. BWA took 38.8s. Estimated remaining: 4h 23m 20s. Rate: 7.6 symbols/min [2025-09-25T17:47:47.355031] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:47:47.355181] [DEBUG] [LOCAL ] BWSN: No existing data file found in primary storage. [2025-09-25T17:47:47.355217] [WARN ] [MAIN ] BWSN: No existing data found, performing full refresh instead. [2025-09-25T17:47:47.355409] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-25T17:47:47.355487] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-25T17:47:47.355573] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-25T17:47:47.355678] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-25T17:47:47.713754] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:47:47.717865] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T17:47:47.888678] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-25T17:47:48.460791] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T17:47:48.688718] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-25T17:47:49.488715] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-25T17:47:50.220205] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T17:47:50.221984] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T17:47:50.288678] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-25T17:47:50.941949] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T17:47:51.088719] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-25T17:47:51.768622] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T17:47:51.888739] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-25T17:47:52.631215] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T17:47:52.688731] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-25T17:47:53.082288] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T17:47:53.488727] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-25T17:47:54.235576] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:47:54.288758] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-25T17:47:55.030970] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T17:47:55.088758] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-25T17:47:55.532188] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T17:47:55.888887] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-25T17:47:56.497144] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T17:47:56.688795] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-25T17:47:57.242820] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T17:47:57.488710] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-25T17:47:58.215584] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T17:47:58.288684] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-25T17:47:59.088755] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-25T17:47:59.175419] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T17:47:59.637247] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T17:47:59.888724] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-25T17:48:00.382989] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T17:48:00.688722] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-25T17:48:01.386274] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-25T17:48:01.488784] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-25T17:48:02.288796] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-25T17:48:02.444737] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T17:48:03.088767] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-25T17:48:03.093533] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T17:48:03.096564] [INFO ] [REMOTE ] BWNB: Full fetch complete (5740 records). [2025-09-25T17:48:03.096726] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-25T17:48:03.498313] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-25T17:48:03.498693] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-25T17:48:03.498975] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-25T17:48:03.499070] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-25T17:48:03.499616] [DEBUG] [LOCAL ] BWNB: Trimmed 5740 records to 4463 (keeping 200 days of data) [2025-09-25T17:48:03.534924] [DEBUG] [LOCAL ] BWNB: Primary data saved (4463 records). [2025-09-25T17:48:03.535130] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-25T17:48:03.535273] [INFO ] [MAIN ] Update Progress: 365/2372 symbols completed. BWNB took 24.7s. Estimated remaining: 4h 23m 59s. Rate: 7.6 symbols/min [2025-09-25T17:48:03.721041] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:03.784492] [DEBUG] [LOCAL ] BWXT: Loaded 46755 existing records from primary storage. [2025-09-25T17:48:03.784667] [INFO ] [MAIN ] BWXT: Loaded 46755 existing records. [2025-09-25T17:48:03.893892] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-25T17:48:03.969386] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:48:03.969740] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-25T17:48:03.969797] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-25T17:48:03.970233] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-25T17:48:03.970303] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-25T17:48:04.343598] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:04.647358] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T17:48:04.679412] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T17:48:04.688692] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-25T17:48:05.473855] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T17:48:05.475566] [INFO ] [REMOTE ] BWMX: Full fetch complete (10026 records). [2025-09-25T17:48:05.475692] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-25T17:48:05.476146] [FATAL] [VALIDATOR ] BWMX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:48:05.476231] [FATAL] [MAIN ] BWMX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:48:05.476274] [WARN ] [MAIN ] BWMX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:48:05.476311] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-25T17:48:05.476450] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-25T17:48:05.476529] [INFO ] [LOCAL ] BWMX: Starting deletion of derivative data. [2025-09-25T17:48:05.476845] [DEBUG] [LOCAL ] BWMX: Deleted derivative data file. [2025-09-25T17:48:05.476951] [INFO ] [MAIN ] Update Progress: 366/2372 symbols completed. BWMX took 29.1s. Estimated remaining: 4h 23m 18s. Rate: 7.6 symbols/min [2025-09-25T17:48:05.493928] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-25T17:48:05.650262] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:05.650456] [DEBUG] [LOCAL ] BX: No existing data file found in primary storage. [2025-09-25T17:48:05.650494] [WARN ] [MAIN ] BX: No existing data found, performing full refresh instead. [2025-09-25T17:48:05.650637] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-25T17:48:05.650722] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-25T17:48:05.650769] [DEBUG] [LOCAL ] BX: No primary data file found to delete. [2025-09-25T17:48:05.650802] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-25T17:48:06.009171] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:06.288744] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-25T17:48:07.088726] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-25T17:48:07.387340] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T17:48:07.557369] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T17:48:07.888736] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-25T17:48:07.969863] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T17:48:08.688808] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-25T17:48:09.487133] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T17:48:09.488759] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-25T17:48:09.623740] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T17:48:10.288723] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-25T17:48:10.830770] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T17:48:10.831862] [INFO ] [REMOTE ] BWSN: Full fetch complete (6129 records). [2025-09-25T17:48:10.831943] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-25T17:48:10.832558] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:48:10.832689] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:48:10.832759] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:48:10.832840] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-25T17:48:10.832928] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-25T17:48:10.832975] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-09-25T17:48:10.833043] [DEBUG] [LOCAL ] BWSN: No derivative data file found to delete. [2025-09-25T17:48:10.833117] [INFO ] [MAIN ] Update Progress: 367/2372 symbols completed. BWSN took 23.6s. Estimated remaining: 4h 22m 57s. Rate: 7.6 symbols/min [2025-09-25T17:48:11.032934] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:11.033188] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-09-25T17:48:11.033243] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-09-25T17:48:11.033402] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-25T17:48:11.033449] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-25T17:48:11.033491] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-09-25T17:48:11.033524] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-25T17:48:11.095777] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-25T17:48:11.462235] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:11.500076] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T17:48:11.888778] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-25T17:48:12.688725] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-25T17:48:12.771680] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T17:48:12.832121] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T17:48:13.488781] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-25T17:48:13.762526] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T17:48:14.288744] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-25T17:48:15.088691] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-25T17:48:15.210781] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T17:48:15.702789] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T17:48:15.888774] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-25T17:48:16.688813] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-25T17:48:16.825632] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T17:48:17.191176] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T17:48:17.488697] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-25T17:48:17.842706] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T17:48:18.288723] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-25T17:48:18.836790] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T17:48:18.904122] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T17:48:18.910165] [INFO ] [REMOTE ] BWLP: Full fetch complete (48472 records). [2025-09-25T17:48:18.910295] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-25T17:48:19.091046] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-25T17:48:19.321214] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-25T17:48:19.321296] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-25T17:48:19.321914] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-25T17:48:19.321977] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-25T17:48:19.323125] [DEBUG] [LOCAL ] BWLP: Trimmed 48472 records to 32989 (keeping 200 days of data) [2025-09-25T17:48:19.555157] [DEBUG] [LOCAL ] BWLP: Primary data saved (32989 records). [2025-09-25T17:48:19.555551] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-25T17:48:19.555748] [INFO ] [MAIN ] Update Progress: 368/2372 symbols completed. BWLP took 52.1s. Estimated remaining: 4h 22m 54s. Rate: 7.6 symbols/min [2025-09-25T17:48:19.753811] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:19.808220] [DEBUG] [LOCAL ] BXMT: Loaded 47261 existing records from primary storage. [2025-09-25T17:48:19.808362] [INFO ] [MAIN ] BXMT: Loaded 47261 existing records. [2025-09-25T17:48:19.893807] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-25T17:48:19.990692] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:48:19.990934] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-25T17:48:19.990982] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-25T17:48:19.991206] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-25T17:48:19.991266] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-25T17:48:20.359015] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:20.688712] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-25T17:48:20.924374] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T17:48:21.488732] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-25T17:48:21.939879] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T17:48:22.148571] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T17:48:22.289058] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-25T17:48:22.451404] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T17:48:23.088738] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-25T17:48:23.888734] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-25T17:48:23.932947] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T17:48:24.688749] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-25T17:48:25.119900] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T17:48:25.497340] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-25T17:48:25.533195] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T17:48:25.559326] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-25T17:48:26.288724] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-25T17:48:27.088692] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-25T17:48:27.135480] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T17:48:27.374620] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T17:48:27.888708] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-25T17:48:28.669065] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T17:48:28.688672] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-25T17:48:28.726980] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T17:48:29.488777] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-25T17:48:30.288694] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-25T17:48:30.349259] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T17:48:30.702534] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T17:48:31.088733] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-25T17:48:31.893926] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-25T17:48:31.910007] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T17:48:32.688735] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-25T17:48:32.726172] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T17:48:33.095444] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T17:48:33.488728] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-25T17:48:34.288706] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-25T17:48:34.336891] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T17:48:34.387331] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T17:48:34.391378] [INFO ] [REMOTE ] BXC: Full fetch complete (17807 records). [2025-09-25T17:48:34.391462] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-25T17:48:34.817614] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-25T17:48:34.817742] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-25T17:48:34.818064] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-25T17:48:34.818104] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-25T17:48:34.818862] [DEBUG] [LOCAL ] BXC: Trimmed 17807 records to 13822 (keeping 200 days of data) [2025-09-25T17:48:34.911998] [DEBUG] [LOCAL ] BXC: Primary data saved (13822 records). [2025-09-25T17:48:34.912150] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-25T17:48:34.912231] [INFO ] [MAIN ] Update Progress: 369/2372 symbols completed. BXC took 24.1s. Estimated remaining: 4h 23m 26s. Rate: 7.6 symbols/min [2025-09-25T17:48:35.084018] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:35.088757] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-25T17:48:35.109052] [DEBUG] [LOCAL ] BXMX: Loaded 19561 existing records from primary storage. [2025-09-25T17:48:35.109173] [INFO ] [MAIN ] BXMX: Loaded 19561 existing records. [2025-09-25T17:48:35.302519] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:48:35.302785] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-25T17:48:35.302840] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-25T17:48:35.303078] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-25T17:48:35.303141] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-25T17:48:35.714456] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:35.888682] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-25T17:48:36.420502] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T17:48:36.475390] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T17:48:36.688736] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-25T17:48:37.489581] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-25T17:48:37.492100] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T17:48:37.502142] [INFO ] [REMOTE ] BWXT: Full fetch complete (67334 records). [2025-09-25T17:48:37.502297] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-25T17:48:37.892230] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-25T17:48:37.892380] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-25T17:48:37.893248] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-25T17:48:37.893319] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-25T17:48:37.895703] [DEBUG] [LOCAL ] BWXT: Trimmed 67334 records to 47108 (keeping 200 days of data) [2025-09-25T17:48:38.217195] [DEBUG] [LOCAL ] BWXT: Primary data saved (47108 records). [2025-09-25T17:48:38.217455] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-25T17:48:38.218676] [INFO ] [MAIN ] Update Progress: 370/2372 symbols completed. BWXT took 34.7s. Estimated remaining: 4h 22m 54s. Rate: 7.6 symbols/min [2025-09-25T17:48:38.289979] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-25T17:48:38.399359] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:38.436034] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T17:48:38.492687] [DEBUG] [LOCAL ] BXP: Loaded 49802 existing records from primary storage. [2025-09-25T17:48:38.492840] [INFO ] [MAIN ] BXP: Loaded 49802 existing records. [2025-09-25T17:48:38.674361] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:48:38.674595] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-25T17:48:38.674680] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-25T17:48:38.674941] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-25T17:48:38.674998] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-25T17:48:38.999691] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T17:48:39.065043] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:39.088666] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-25T17:48:39.631997] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T17:48:39.888725] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-25T17:48:39.910607] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T17:48:40.688728] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-25T17:48:41.488768] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-25T17:48:41.705032] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T17:48:41.714924] [INFO ] [REMOTE ] BX: Full fetch complete (77406 records). [2025-09-25T17:48:41.715047] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-25T17:48:42.157504] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-25T17:48:42.160025] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T17:48:42.160171] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-25T17:48:42.172860] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-25T17:48:42.173432] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-25T17:48:42.176226] [DEBUG] [LOCAL ] BX: Trimmed 77406 records to 53887 (keeping 200 days of data) [2025-09-25T17:48:42.288728] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-25T17:48:42.541121] [DEBUG] [LOCAL ] BX: Primary data saved (53887 records). [2025-09-25T17:48:42.541261] [INFO ] [MAIN ] BX: Full history saved. [2025-09-25T17:48:42.541420] [INFO ] [MAIN ] Update Progress: 371/2372 symbols completed. BX took 37.1s. Estimated remaining: 4h 22m 27s. Rate: 7.6 symbols/min [2025-09-25T17:48:42.716749] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:42.716936] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-09-25T17:48:42.716999] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-09-25T17:48:42.717225] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-25T17:48:42.717325] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-25T17:48:42.717431] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-09-25T17:48:42.717485] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-25T17:48:43.117937] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:43.118210] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-25T17:48:43.132328] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:48:43.888745] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-25T17:48:44.053575] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T17:48:44.348138] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T17:48:44.688750] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-25T17:48:45.217936] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T17:48:45.488821] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-25T17:48:45.949107] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T17:48:46.288756] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-25T17:48:47.088773] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-25T17:48:47.197326] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T17:48:47.786670] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T17:48:47.888776] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-25T17:48:48.088435] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T17:48:48.688777] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-25T17:48:49.159850] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T17:48:49.488730] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-25T17:48:50.288718] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-25T17:48:50.454921] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T17:48:51.093144] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-25T17:48:51.099058] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:48:51.448807] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T17:48:51.888728] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-25T17:48:52.489223] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T17:48:52.688780] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-25T17:48:53.488713] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-25T17:48:53.613815] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T17:48:54.213145] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-25T17:48:54.288768] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-25T17:48:54.366585] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T17:48:55.088787] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-25T17:48:55.827773] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T17:48:55.888665] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-25T17:48:56.118266] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T17:48:56.688722] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-25T17:48:57.488688] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-25T17:48:57.527749] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T17:48:58.064686] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T17:48:58.073850] [INFO ] [REMOTE ] BXMT: Full fetch complete (69496 records). [2025-09-25T17:48:58.074035] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-25T17:48:58.293831] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-25T17:48:58.499604] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-25T17:48:58.499747] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-25T17:48:58.500607] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-25T17:48:58.500707] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-25T17:48:58.502506] [DEBUG] [LOCAL ] BXMT: Trimmed 69496 records to 47634 (keeping 200 days of data) [2025-09-25T17:48:58.833056] [DEBUG] [LOCAL ] BXMT: Primary data saved (47634 records). [2025-09-25T17:48:58.833279] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-25T17:48:58.833413] [INFO ] [MAIN ] Update Progress: 372/2372 symbols completed. BXMT took 39.3s. Estimated remaining: 4h 23m 4s. Rate: 7.6 symbols/min [2025-09-25T17:48:59.031524] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:48:59.058126] [DEBUG] [LOCAL ] BY: Loaded 21597 existing records from primary storage. [2025-09-25T17:48:59.058363] [INFO ] [MAIN ] BY: Loaded 21597 existing records. [2025-09-25T17:48:59.093893] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-25T17:48:59.255759] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:48:59.256145] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-25T17:48:59.256215] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-25T17:48:59.256548] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-25T17:48:59.256625] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-25T17:48:59.658979] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:48:59.694722] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T17:48:59.888757] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-25T17:49:00.158937] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T17:49:00.183524] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T17:49:00.688757] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-25T17:49:01.497552] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-25T17:49:01.502530] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T17:49:01.665546] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T17:49:01.669297] [INFO ] [REMOTE ] BXMX: Full fetch complete (28618 records). [2025-09-25T17:49:01.669374] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-25T17:49:01.669953] [FATAL] [VALIDATOR ] BXMX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:49:01.670039] [FATAL] [MAIN ] BXMX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:49:01.670082] [WARN ] [MAIN ] BXMX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:49:01.670119] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-25T17:49:01.670176] [DEBUG] [LOCAL ] BXMX: No primary data file found to delete. [2025-09-25T17:49:01.670212] [INFO ] [LOCAL ] BXMX: Starting deletion of derivative data. [2025-09-25T17:49:01.670460] [DEBUG] [LOCAL ] BXMX: Deleted derivative data file. [2025-09-25T17:49:01.670550] [INFO ] [MAIN ] Update Progress: 373/2372 symbols completed. BXMX took 26.8s. Estimated remaining: 4h 22m 29s. Rate: 7.6 symbols/min [2025-09-25T17:49:01.846456] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:01.846680] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-09-25T17:49:01.846734] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-09-25T17:49:01.846949] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-25T17:49:01.847004] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-25T17:49:01.847046] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-09-25T17:49:01.847078] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-25T17:49:02.226962] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:02.288667] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-25T17:49:03.088733] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-25T17:49:03.289795] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T17:49:03.888687] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-25T17:49:03.929585] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T17:49:03.950568] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T17:49:04.688829] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-25T17:49:05.488700] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-25T17:49:05.813449] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T17:49:05.823087] [INFO ] [REMOTE ] BXP: Full fetch complete (71294 records). [2025-09-25T17:49:05.823219] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-25T17:49:06.208154] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T17:49:06.264191] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-25T17:49:06.264267] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-25T17:49:06.265026] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-25T17:49:06.265092] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-25T17:49:06.266694] [DEBUG] [LOCAL ] BXP: Trimmed 71294 records to 50191 (keeping 200 days of data) [2025-09-25T17:49:06.326530] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-25T17:49:06.582397] [DEBUG] [LOCAL ] BXP: Primary data saved (50191 records). [2025-09-25T17:49:06.582525] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-25T17:49:06.582606] [INFO ] [MAIN ] Update Progress: 374/2372 symbols completed. BXP took 28.4s. Estimated remaining: 4h 22m 5s. Rate: 7.6 symbols/min [2025-09-25T17:49:06.777507] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:06.811953] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T17:49:06.827729] [DEBUG] [LOCAL ] BYM: Loaded 12061 existing records from primary storage. [2025-09-25T17:49:06.827873] [INFO ] [MAIN ] BYM: Loaded 12061 existing records. [2025-09-25T17:49:07.017277] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:49:07.017605] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-25T17:49:07.017687] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-25T17:49:07.017966] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-25T17:49:07.018026] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-25T17:49:07.099306] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-25T17:49:07.434621] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:07.888709] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-25T17:49:08.076512] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:49:08.688692] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-25T17:49:08.770706] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T17:49:08.815701] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T17:49:09.488748] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-25T17:49:10.259225] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T17:49:10.288692] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-25T17:49:10.760896] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T17:49:11.088755] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-25T17:49:11.888697] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-25T17:49:11.943269] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T17:49:12.688677] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-25T17:49:12.907680] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T17:49:12.967973] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T17:49:12.976969] [INFO ] [REMOTE ] BXSL: Full fetch complete (68888 records). [2025-09-25T17:49:12.977086] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-25T17:49:12.977899] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:49:12.977991] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:49:12.978032] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:49:12.978095] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-25T17:49:12.978177] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-09-25T17:49:12.978231] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-09-25T17:49:12.978292] [DEBUG] [LOCAL ] BXSL: No derivative data file found to delete. [2025-09-25T17:49:12.978384] [INFO ] [MAIN ] Update Progress: 375/2372 symbols completed. BXSL took 30.4s. Estimated remaining: 4h 21m 49s. Rate: 7.6 symbols/min [2025-09-25T17:49:13.152531] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:13.188996] [DEBUG] [LOCAL ] BZH: Loaded 32665 existing records from primary storage. [2025-09-25T17:49:13.189130] [INFO ] [MAIN ] BZH: Loaded 32665 existing records. [2025-09-25T17:49:13.369934] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:49:13.370194] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-25T17:49:13.370246] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-25T17:49:13.370455] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-25T17:49:13.370512] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-25T17:49:13.489589] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-25T17:49:13.756982] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:14.051175] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:49:14.288733] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-25T17:49:14.427381] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T17:49:15.088723] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-25T17:49:15.377161] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T17:49:15.888714] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-25T17:49:16.688711] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-25T17:49:16.840429] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T17:49:17.116135] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T17:49:17.340498] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T17:49:17.488674] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-25T17:49:18.288753] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-25T17:49:18.547416] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T17:49:19.088764] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-25T17:49:19.198321] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T17:49:19.888741] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-25T17:49:20.665528] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T17:49:20.688676] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-25T17:49:20.697680] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T17:49:21.488715] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-25T17:49:22.140593] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T17:49:22.288793] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-25T17:49:23.088754] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-25T17:49:23.196197] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T17:49:23.242429] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T17:49:23.888739] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-25T17:49:24.001509] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T17:49:24.688757] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-25T17:49:24.904134] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T17:49:25.488744] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-25T17:49:26.288727] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-25T17:49:26.553706] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T17:49:26.561880] [INFO ] [REMOTE ] BYD: Full fetch complete (64930 records). [2025-09-25T17:49:26.562035] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-25T17:49:27.007142] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-25T17:49:27.007294] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-25T17:49:27.008178] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-25T17:49:27.008293] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-25T17:49:27.009789] [DEBUG] [LOCAL ] BYD: Trimmed 64930 records to 45502 (keeping 200 days of data) [2025-09-25T17:49:27.089932] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-25T17:49:27.147732] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:49:27.163446] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-25T17:49:27.357980] [DEBUG] [LOCAL ] BYD: Primary data saved (45502 records). [2025-09-25T17:49:27.358123] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-25T17:49:27.358216] [INFO ] [MAIN ] Update Progress: 376/2372 symbols completed. BYD took 25.7s. Estimated remaining: 4h 22m 16s. Rate: 7.6 symbols/min [2025-09-25T17:49:27.531219] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:27.585233] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-25T17:49:27.585397] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-25T17:49:27.773278] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:49:27.773555] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-25T17:49:27.773603] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-25T17:49:27.773908] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-25T17:49:27.773969] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-25T17:49:27.893934] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-25T17:49:28.157424] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:28.267600] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T17:49:28.688775] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-25T17:49:29.311760] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T17:49:29.488751] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-25T17:49:30.288708] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-25T17:49:30.340168] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:49:30.845366] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:49:31.088724] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-25T17:49:31.195881] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T17:49:31.888752] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-25T17:49:32.068536] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T17:49:32.688722] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-25T17:49:33.488692] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-25T17:49:33.499168] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T17:49:34.102350] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-25T17:49:34.288717] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-25T17:49:34.767488] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T17:49:34.771872] [INFO ] [REMOTE ] BY: Full fetch complete (29223 records). [2025-09-25T17:49:34.771958] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-25T17:49:35.093844] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-25T17:49:35.158698] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-25T17:49:35.158776] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-25T17:49:35.159213] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-25T17:49:35.159253] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-25T17:49:35.160094] [DEBUG] [LOCAL ] BY: Trimmed 29223 records to 21748 (keeping 200 days of data) [2025-09-25T17:49:35.293964] [DEBUG] [LOCAL ] BY: Primary data saved (21748 records). [2025-09-25T17:49:35.294098] [INFO ] [MAIN ] BY: Full history saved. [2025-09-25T17:49:35.294181] [INFO ] [MAIN ] Update Progress: 377/2372 symbols completed. BY took 36.5s. Estimated remaining: 4h 22m 9s. Rate: 7.6 symbols/min [2025-09-25T17:49:35.465308] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:35.485851] [DEBUG] [LOCAL ] CAAP: Loaded 19503 existing records from primary storage. [2025-09-25T17:49:35.485988] [INFO ] [MAIN ] CAAP: Loaded 19503 existing records. [2025-09-25T17:49:35.700808] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:49:35.701088] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-25T17:49:35.701142] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-25T17:49:35.701432] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-25T17:49:35.701490] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-25T17:49:35.916124] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-25T17:49:36.072033] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:36.354023] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-25T17:49:36.581461] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T17:49:36.688677] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-25T17:49:36.717436] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T17:49:37.488794] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-25T17:49:37.931446] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T17:49:38.085120] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T17:49:38.288804] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-25T17:49:39.088717] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-25T17:49:39.684460] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T17:49:39.888768] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-25T17:49:40.688727] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-25T17:49:40.854895] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T17:49:41.057106] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T17:49:41.488711] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-25T17:49:42.155369] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T17:49:42.288674] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-25T17:49:43.088753] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-25T17:49:43.685117] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-25T17:49:43.716445] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:49:43.723030] [INFO ] [REMOTE ] BZH: Full fetch complete (47048 records). [2025-09-25T17:49:43.723177] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-25T17:49:43.890570] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-25T17:49:44.038724] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T17:49:44.057702] [INFO ] [REMOTE ] BYM: Full fetch complete (17918 records). [2025-09-25T17:49:44.057820] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-25T17:49:44.068684] [FATAL] [VALIDATOR ] BYM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:49:44.092740] [FATAL] [MAIN ] BYM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:49:44.102391] [WARN ] [MAIN ] BYM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:49:44.119584] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-25T17:49:44.123479] [DEBUG] [LOCAL ] BYM: No primary data file found to delete. [2025-09-25T17:49:44.132627] [INFO ] [LOCAL ] BYM: Starting deletion of derivative data. [2025-09-25T17:49:44.135204] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-25T17:49:44.135303] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-25T17:49:44.135955] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-25T17:49:44.136037] [DEBUG] [LOCAL ] BYM: Deleted derivative data file. [2025-09-25T17:49:44.136252] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-25T17:49:44.136201] [INFO ] [MAIN ] Update Progress: 378/2372 symbols completed. BYM took 37.6s. Estimated remaining: 4h 22m 6s. Rate: 7.6 symbols/min [2025-09-25T17:49:44.237761] [DEBUG] [LOCAL ] BZH: Trimmed 47048 records to 32872 (keeping 200 days of data) [2025-09-25T17:49:44.395634] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:44.397069] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-09-25T17:49:44.397141] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-09-25T17:49:44.397980] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-25T17:49:44.398305] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-25T17:49:44.398696] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-25T17:49:44.399049] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-25T17:49:44.689100] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-25T17:49:44.725714] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T17:49:44.820322] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:44.909006] [DEBUG] [LOCAL ] BZH: Primary data saved (32872 records). [2025-09-25T17:49:44.909149] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-25T17:49:44.909237] [INFO ] [MAIN ] Update Progress: 379/2372 symbols completed. BZH took 31.9s. Estimated remaining: 4h 21m 20s. Rate: 7.6 symbols/min [2025-09-25T17:49:45.078782] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:49:45.102627] [DEBUG] [LOCAL ] CACI: Loaded 25045 existing records from primary storage. [2025-09-25T17:49:45.102782] [INFO ] [MAIN ] CACI: Loaded 25045 existing records. [2025-09-25T17:49:45.289602] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:49:45.290301] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-25T17:49:45.290357] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-25T17:49:45.290881] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-25T17:49:45.290941] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-25T17:49:45.498303] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-25T17:49:45.648228] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:49:46.288801] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-25T17:49:46.577858] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T17:49:46.819833] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T17:49:47.088750] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-25T17:49:47.295456] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T17:49:47.888738] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-25T17:49:48.688769] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-25T17:49:48.885398] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T17:49:48.956385] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T17:49:49.488753] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-25T17:49:49.724615] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T17:49:50.288758] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-25T17:49:50.730032] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T17:49:51.088697] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-25T17:49:51.541122] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T17:49:51.888719] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-25T17:49:52.688716] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-25T17:49:53.032393] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T17:49:53.171122] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-25T17:49:53.371752] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T17:49:53.488792] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-25T17:49:54.288717] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-25T17:49:54.583671] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T17:49:55.004909] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T17:49:55.088830] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-25T17:49:55.888803] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-25T17:49:56.622506] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:49:56.688741] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-25T17:49:57.488776] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-25T17:49:58.048563] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T17:49:58.111892] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T17:49:58.288720] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-25T17:49:58.390068] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T17:49:59.088731] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-25T17:49:59.570007] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T17:49:59.888769] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-25T17:50:00.342006] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T17:50:00.353102] [INFO ] [REMOTE ] CAAP: Full fetch complete (27480 records). [2025-09-25T17:50:00.354096] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-25T17:50:00.354827] [FATAL] [VALIDATOR ] CAAP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:50:00.354948] [FATAL] [MAIN ] CAAP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:50:00.355037] [WARN ] [MAIN ] CAAP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:50:00.355110] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-25T17:50:00.355204] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-09-25T17:50:00.355335] [INFO ] [LOCAL ] CAAP: Starting deletion of derivative data. [2025-09-25T17:50:00.356133] [DEBUG] [LOCAL ] CAAP: Deleted derivative data file. [2025-09-25T17:50:00.356281] [INFO ] [MAIN ] Update Progress: 380/2372 symbols completed. CAAP took 25.1s. Estimated remaining: 4h 21m 52s. Rate: 7.6 symbols/min [2025-09-25T17:50:00.527923] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:00.581629] [DEBUG] [LOCAL ] CADE: Loaded 48819 existing records from primary storage. [2025-09-25T17:50:00.581792] [INFO ] [MAIN ] CADE: Loaded 48819 existing records. [2025-09-25T17:50:00.693796] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-25T17:50:00.763072] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:00.763289] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-25T17:50:00.763336] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-25T17:50:00.763571] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-25T17:50:00.763630] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-25T17:50:01.126151] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:01.488809] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-25T17:50:02.098763] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:50:02.165130] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T17:50:02.175254] [INFO ] [REMOTE ] C: Full fetch complete (77395 records). [2025-09-25T17:50:02.175429] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-25T17:50:02.180750] [FATAL] [VALIDATOR ] C: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:50:02.180925] [FATAL] [MAIN ] C: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:50:02.180997] [WARN ] [MAIN ] C: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:50:02.181069] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-25T17:50:02.181149] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-25T17:50:02.181205] [INFO ] [LOCAL ] C: Starting deletion of derivative data. [2025-09-25T17:50:02.181391] [DEBUG] [LOCAL ] C: Deleted derivative data file. [2025-09-25T17:50:02.183444] [INFO ] [MAIN ] Update Progress: 381/2372 symbols completed. C took 34.8s. Estimated remaining: 4h 21m 13s. Rate: 7.6 symbols/min [2025-09-25T17:50:02.290434] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-25T17:50:02.376194] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:02.387442] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T17:50:02.441158] [DEBUG] [LOCAL ] CAE: Loaded 39010 existing records from primary storage. [2025-09-25T17:50:02.441321] [INFO ] [MAIN ] CAE: Loaded 39010 existing records. [2025-09-25T17:50:02.624474] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:02.624757] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-25T17:50:02.624816] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-25T17:50:02.625018] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-25T17:50:02.625078] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-25T17:50:03.069162] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:03.088680] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-25T17:50:03.626583] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T17:50:03.888750] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-25T17:50:04.460086] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T17:50:04.688739] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-25T17:50:05.488740] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-25T17:50:05.631549] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T17:50:05.704705] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:50:06.288712] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-25T17:50:06.592902] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T17:50:07.088727] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-25T17:50:07.476583] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T17:50:07.480702] [INFO ] [REMOTE ] CACI: Full fetch complete (39181 records). [2025-09-25T17:50:07.480821] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-25T17:50:07.883304] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-25T17:50:07.883388] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-25T17:50:07.883943] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-25T17:50:07.884027] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-25T17:50:07.885091] [DEBUG] [LOCAL ] CACI: Trimmed 39181 records to 25258 (keeping 200 days of data) [2025-09-25T17:50:07.888754] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-25T17:50:08.059195] [DEBUG] [LOCAL ] CACI: Primary data saved (25258 records). [2025-09-25T17:50:08.059349] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-25T17:50:08.059503] [INFO ] [MAIN ] Update Progress: 382/2372 symbols completed. CACI took 23.2s. Estimated remaining: 4h 20m 55s. Rate: 7.6 symbols/min [2025-09-25T17:50:08.240153] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:08.246821] [DEBUG] [LOCAL ] CAF: Loaded 3440 existing records from primary storage. [2025-09-25T17:50:08.246916] [INFO ] [MAIN ] CAF: Loaded 3440 existing records. [2025-09-25T17:50:08.436395] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:08.437137] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-25T17:50:08.437199] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-25T17:50:08.437425] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-25T17:50:08.437485] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-25T17:50:08.699300] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-25T17:50:08.753859] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T17:50:08.883490] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:09.488724] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-25T17:50:09.588679] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:50:09.726153] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T17:50:10.288736] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-25T17:50:11.025811] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T17:50:11.088667] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-25T17:50:11.145964] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:50:11.675879] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T17:50:11.888718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-25T17:50:12.496327] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T17:50:12.688737] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-25T17:50:13.488731] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-25T17:50:14.289599] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-25T17:50:14.292795] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T17:50:14.876937] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T17:50:14.988169] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T17:50:15.088674] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-25T17:50:15.888774] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-25T17:50:16.272823] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T17:50:16.688718] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-25T17:50:17.280244] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-25T17:50:17.488788] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-25T17:50:17.707306] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T17:50:18.288737] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-25T17:50:18.968852] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T17:50:19.088719] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-25T17:50:19.888741] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-25T17:50:20.370592] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T17:50:20.413075] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-25T17:50:20.537901] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T17:50:20.688705] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-25T17:50:21.488726] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-25T17:50:22.219632] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T17:50:22.288727] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-25T17:50:22.945424] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T17:50:23.088692] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-25T17:50:23.743108] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T17:50:23.750515] [INFO ] [REMOTE ] CAE: Full fetch complete (55763 records). [2025-09-25T17:50:23.750635] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-25T17:50:23.901852] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-25T17:50:24.150415] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-25T17:50:24.150496] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-25T17:50:24.151146] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-25T17:50:24.151210] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-25T17:50:24.152344] [DEBUG] [LOCAL ] CAE: Trimmed 55763 records to 39345 (keeping 200 days of data) [2025-09-25T17:50:24.387930] [DEBUG] [LOCAL ] CAE: Primary data saved (39345 records). [2025-09-25T17:50:24.388095] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-25T17:50:24.388244] [INFO ] [MAIN ] Update Progress: 383/2372 symbols completed. CAE took 22.2s. Estimated remaining: 4h 21m 31s. Rate: 7.6 symbols/min [2025-09-25T17:50:24.497034] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T17:50:24.569156] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:24.624787] [DEBUG] [LOCAL ] CAG: Loaded 53659 existing records from primary storage. [2025-09-25T17:50:24.624937] [INFO ] [MAIN ] CAG: Loaded 53659 existing records. [2025-09-25T17:50:24.689452] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-25T17:50:24.809911] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:24.810356] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-25T17:50:24.832989] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-25T17:50:24.836414] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-25T17:50:24.837505] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-25T17:50:24.837453] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T17:50:25.203625] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:25.488696] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-25T17:50:25.763388] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T17:50:26.288734] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-25T17:50:27.088702] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-25T17:50:27.211307] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T17:50:27.616924] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-25T17:50:27.809831] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T17:50:27.888723] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-25T17:50:28.688717] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-25T17:50:29.452774] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T17:50:29.488740] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-25T17:50:30.239911] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T17:50:30.288799] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-25T17:50:31.088747] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-25T17:50:31.264679] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T17:50:31.370810] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T17:50:31.506249] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-25T17:50:31.888718] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-25T17:50:32.688715] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-25T17:50:33.488684] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-25T17:50:33.596843] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:50:33.884713] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T17:50:34.156405] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T17:50:34.157892] [INFO ] [REMOTE ] CAF: Full fetch complete (5741 records). [2025-09-25T17:50:34.157980] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-25T17:50:34.293810] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-25T17:50:34.541132] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-25T17:50:34.541221] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-25T17:50:34.541383] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-25T17:50:34.541420] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-25T17:50:34.541841] [DEBUG] [LOCAL ] CAF: Trimmed 5741 records to 3458 (keeping 200 days of data) [2025-09-25T17:50:34.562976] [DEBUG] [LOCAL ] CAF: Primary data saved (3458 records). [2025-09-25T17:50:34.563055] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-25T17:50:34.563131] [INFO ] [MAIN ] Update Progress: 384/2372 symbols completed. CAF took 26.5s. Estimated remaining: 4h 21m 35s. Rate: 7.6 symbols/min [2025-09-25T17:50:34.736918] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:34.795974] [DEBUG] [LOCAL ] CAH: Loaded 51442 existing records from primary storage. [2025-09-25T17:50:34.796122] [INFO ] [MAIN ] CAH: Loaded 51442 existing records. [2025-09-25T17:50:34.976308] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:34.976610] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-25T17:50:34.976714] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-25T17:50:34.977021] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-25T17:50:34.977084] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-25T17:50:35.093912] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-25T17:50:35.369278] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:35.425114] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T17:50:35.888747] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-25T17:50:36.688701] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-25T17:50:36.726568] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T17:50:36.744423] [INFO ] [REMOTE ] CADE: Full fetch complete (69696 records). [2025-09-25T17:50:36.744856] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-25T17:50:37.044216] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:50:37.198738] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-25T17:50:37.198875] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-25T17:50:37.199979] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-25T17:50:37.200058] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-25T17:50:37.202739] [DEBUG] [LOCAL ] CADE: Trimmed 69696 records to 49165 (keeping 200 days of data) [2025-09-25T17:50:37.491737] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-25T17:50:37.557757] [DEBUG] [LOCAL ] CADE: Primary data saved (49165 records). [2025-09-25T17:50:37.558014] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-25T17:50:37.559629] [INFO ] [MAIN ] Update Progress: 385/2372 symbols completed. CADE took 37.2s. Estimated remaining: 4h 21m 1s. Rate: 7.6 symbols/min [2025-09-25T17:50:37.748678] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:37.802243] [DEBUG] [LOCAL ] CAL: Loaded 43227 existing records from primary storage. [2025-09-25T17:50:37.802395] [INFO ] [MAIN ] CAL: Loaded 43227 existing records. [2025-09-25T17:50:38.047831] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:38.048124] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-25T17:50:38.048173] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-25T17:50:38.048399] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-25T17:50:38.048459] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-25T17:50:38.307194] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-25T17:50:38.420901] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T17:50:38.443849] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:38.449959] [INFO ] [REMOTE ] CABO: Full fetch complete (23003 records). [2025-09-25T17:50:38.450197] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-25T17:50:38.598788] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T17:50:38.898903] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-25T17:50:38.898989] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-25T17:50:38.899351] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-25T17:50:38.899390] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-25T17:50:38.900045] [DEBUG] [LOCAL ] CABO: Trimmed 23003 records to 17466 (keeping 200 days of data) [2025-09-25T17:50:39.017531] [DEBUG] [LOCAL ] CABO: Primary data saved (17466 records). [2025-09-25T17:50:39.017701] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-25T17:50:39.017789] [INFO ] [MAIN ] Update Progress: 386/2372 symbols completed. CABO took 54.9s. Estimated remaining: 4h 20m 20s. Rate: 7.6 symbols/min [2025-09-25T17:50:39.095160] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-25T17:50:39.194286] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:39.240585] [DEBUG] [LOCAL ] CALX: Loaded 38509 existing records from primary storage. [2025-09-25T17:50:39.240928] [INFO ] [MAIN ] CALX: Loaded 38509 existing records. [2025-09-25T17:50:39.426195] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:39.426591] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-25T17:50:39.426668] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-25T17:50:39.426901] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-25T17:50:39.426968] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-25T17:50:39.783480] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:39.888719] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-25T17:50:40.251216] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T17:50:40.499055] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T17:50:40.688696] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-25T17:50:41.052532] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T17:50:41.488784] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-25T17:50:42.288745] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-25T17:50:42.462352] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T17:50:42.532430] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:50:43.088775] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-25T17:50:43.490026] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T17:50:43.888713] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-25T17:50:44.693866] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-25T17:50:44.709471] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T17:50:45.287713] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T17:50:45.488729] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-25T17:50:45.780699] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T17:50:46.288729] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-25T17:50:46.665013] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T17:50:47.088805] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-25T17:50:47.888688] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-25T17:50:48.167732] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T17:50:48.647374] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T17:50:48.688668] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-25T17:50:49.208074] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:50:49.488729] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-25T17:50:50.120247] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T17:50:50.288730] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-25T17:50:51.088737] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-25T17:50:51.282869] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T17:50:51.823069] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:50:51.888712] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-25T17:50:52.696348] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-25T17:50:52.718630] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T17:50:53.491083] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-25T17:50:53.499304] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T17:50:54.241839] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:50:54.288690] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-25T17:50:54.569049] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T17:50:55.088740] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-25T17:50:55.497966] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T17:50:55.888766] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-25T17:50:56.398272] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T17:50:56.688734] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-25T17:50:57.488709] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-25T17:50:57.689587] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T17:50:57.700353] [INFO ] [REMOTE ] CAG: Full fetch complete (77649 records). [2025-09-25T17:50:57.700530] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-25T17:50:58.114744] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-25T17:50:58.114904] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-25T17:50:58.115765] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-25T17:50:58.115830] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-25T17:50:58.117688] [DEBUG] [LOCAL ] CAG: Trimmed 77649 records to 54049 (keeping 200 days of data) [2025-09-25T17:50:58.257441] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T17:50:58.288713] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-25T17:50:58.521568] [DEBUG] [LOCAL ] CAG: Primary data saved (54049 records). [2025-09-25T17:50:58.521880] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-25T17:50:58.522020] [INFO ] [MAIN ] Update Progress: 387/2372 symbols completed. CAG took 34.1s. Estimated remaining: 4h 21m 12s. Rate: 7.6 symbols/min [2025-09-25T17:50:58.701561] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:50:58.728404] [DEBUG] [LOCAL ] CANG: Loaded 26695 existing records from primary storage. [2025-09-25T17:50:58.728544] [INFO ] [MAIN ] CANG: Loaded 26695 existing records. [2025-09-25T17:50:58.911455] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:50:58.911768] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-25T17:50:58.911838] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-25T17:50:58.912073] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-25T17:50:58.912143] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-25T17:50:59.091164] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-25T17:50:59.291636] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:50:59.325121] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:50:59.780297] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T17:50:59.788689] [INFO ] [REMOTE ] CAL: Full fetch complete (61874 records). [2025-09-25T17:50:59.788822] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-25T17:50:59.892895] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-25T17:51:00.184704] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-25T17:51:00.184800] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-25T17:51:00.185457] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-25T17:51:00.185499] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-25T17:51:00.186818] [DEBUG] [LOCAL ] CAL: Trimmed 61874 records to 43552 (keeping 200 days of data) [2025-09-25T17:51:00.484499] [DEBUG] [LOCAL ] CAL: Primary data saved (43552 records). [2025-09-25T17:51:00.485362] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-25T17:51:00.486031] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T17:51:00.486296] [INFO ] [MAIN ] Update Progress: 388/2372 symbols completed. CAL took 22.9s. Estimated remaining: 4h 20m 34s. Rate: 7.6 symbols/min [2025-09-25T17:51:00.674397] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:00.683061] [DEBUG] [LOCAL ] CAPL: Loaded 5870 existing records from primary storage. [2025-09-25T17:51:00.683196] [INFO ] [MAIN ] CAPL: Loaded 5870 existing records. [2025-09-25T17:51:00.694420] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-25T17:51:00.864037] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:00.864363] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-25T17:51:00.864418] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-25T17:51:00.864609] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-25T17:51:00.864755] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-25T17:51:01.237326] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:01.488744] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-25T17:51:01.788919] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T17:51:02.288734] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-25T17:51:02.553533] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T17:51:03.098564] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-25T17:51:03.138275] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T17:51:03.888715] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-25T17:51:03.923940] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T17:51:03.993476] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T17:51:04.688720] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-25T17:51:05.306670] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T17:51:05.488772] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-25T17:51:06.218146] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:51:06.288673] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-25T17:51:06.575519] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T17:51:07.088727] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-25T17:51:07.888684] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-25T17:51:07.999945] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T17:51:08.270029] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T17:51:08.688724] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-25T17:51:09.163682] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T17:51:09.171012] [INFO ] [REMOTE ] CALX: Full fetch complete (54255 records). [2025-09-25T17:51:09.171132] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-25T17:51:09.493884] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-25T17:51:09.571526] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-25T17:51:09.571609] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-25T17:51:09.572240] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-25T17:51:09.572301] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-25T17:51:09.573449] [DEBUG] [LOCAL ] CALX: Trimmed 54255 records to 38755 (keeping 200 days of data) [2025-09-25T17:51:09.807376] [DEBUG] [LOCAL ] CALX: Primary data saved (38755 records). [2025-09-25T17:51:09.807558] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-25T17:51:09.807822] [INFO ] [MAIN ] Update Progress: 389/2372 symbols completed. CALX took 30.8s. Estimated remaining: 4h 20m 33s. Rate: 7.6 symbols/min [2025-09-25T17:51:10.004019] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:10.065805] [DEBUG] [LOCAL ] CARR: Loaded 53594 existing records from primary storage. [2025-09-25T17:51:10.066047] [INFO ] [MAIN ] CARR: Loaded 53594 existing records. [2025-09-25T17:51:10.275810] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:10.276823] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-25T17:51:10.276923] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-25T17:51:10.277342] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-25T17:51:10.277438] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-25T17:51:10.300067] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-25T17:51:10.633845] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T17:51:10.718285] [INFO ] [REMOTE ] CAH: Full fetch complete (74571 records). [2025-09-25T17:51:10.718098] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:10.718766] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-25T17:51:10.913809] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T17:51:11.093956] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-25T17:51:11.125363] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T17:51:11.152497] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-25T17:51:11.152577] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-25T17:51:11.153404] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-25T17:51:11.153470] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-25T17:51:11.155047] [DEBUG] [LOCAL ] CAH: Trimmed 74571 records to 51826 (keeping 200 days of data) [2025-09-25T17:51:11.482476] [DEBUG] [LOCAL ] CAH: Primary data saved (51826 records). [2025-09-25T17:51:11.482611] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-25T17:51:11.482720] [INFO ] [MAIN ] Update Progress: 390/2372 symbols completed. CAH took 36.9s. Estimated remaining: 4h 19m 54s. Rate: 7.6 symbols/min [2025-09-25T17:51:11.652164] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:11.689951] [DEBUG] [LOCAL ] CARS: Loaded 40146 existing records from primary storage. [2025-09-25T17:51:11.690089] [INFO ] [MAIN ] CARS: Loaded 40146 existing records. [2025-09-25T17:51:11.868380] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:11.868721] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-25T17:51:11.868779] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-25T17:51:11.868999] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-25T17:51:11.869056] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-25T17:51:11.899620] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-25T17:51:12.210464] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T17:51:12.249716] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:12.688715] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-25T17:51:13.492768] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-25T17:51:13.498381] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T17:51:13.900919] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T17:51:13.966490] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T17:51:14.288765] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-25T17:51:15.088714] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-25T17:51:15.673337] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T17:51:15.888693] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-25T17:51:15.940912] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T17:51:16.688788] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-25T17:51:17.220193] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T17:51:17.488723] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-25T17:51:18.021136] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T17:51:18.212504] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T17:51:18.288680] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-25T17:51:18.833384] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-25T17:51:19.088712] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-25T17:51:19.888705] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-25T17:51:20.409466] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T17:51:20.450013] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T17:51:20.688710] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-25T17:51:21.488731] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-25T17:51:22.188548] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T17:51:22.288728] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-25T17:51:23.101968] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-25T17:51:23.112695] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T17:51:23.697604] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T17:51:23.881824] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T17:51:23.891799] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-25T17:51:24.569046] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T17:51:24.688793] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-25T17:51:25.488758] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-25T17:51:25.504542] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T17:51:25.506336] [INFO ] [REMOTE ] CAPL: Full fetch complete (8941 records). [2025-09-25T17:51:25.506410] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-25T17:51:25.900966] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-25T17:51:25.901070] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-25T17:51:25.901380] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-25T17:51:25.901420] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-25T17:51:25.901967] [DEBUG] [LOCAL ] CAPL: Trimmed 8941 records to 5904 (keeping 200 days of data) [2025-09-25T17:51:25.944515] [DEBUG] [LOCAL ] CAPL: Primary data saved (5904 records). [2025-09-25T17:51:25.944774] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-25T17:51:25.944913] [INFO ] [MAIN ] Update Progress: 391/2372 symbols completed. CAPL took 25.5s. Estimated remaining: 4h 20m 20s. Rate: 7.6 symbols/min [2025-09-25T17:51:26.160770] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:26.221443] [DEBUG] [LOCAL ] CAT: Loaded 52923 existing records from primary storage. [2025-09-25T17:51:26.221951] [INFO ] [MAIN ] CAT: Loaded 52923 existing records. [2025-09-25T17:51:26.293993] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-25T17:51:26.419350] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:26.419630] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-25T17:51:26.419711] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-25T17:51:26.420022] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-25T17:51:26.420081] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-25T17:51:26.788854] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:27.088734] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-25T17:51:27.217619] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:51:27.424476] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T17:51:27.888714] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-25T17:51:28.688759] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-25T17:51:28.829176] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T17:51:28.927280] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T17:51:29.488747] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-25T17:51:29.671496] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T17:51:30.288732] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-25T17:51:31.023131] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T17:51:31.088764] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-25T17:51:31.830743] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T17:51:31.888726] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-25T17:51:32.406272] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T17:51:32.688766] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-25T17:51:33.488768] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-25T17:51:34.170601] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T17:51:34.178684] [INFO ] [REMOTE ] CARS: Full fetch complete (55360 records). [2025-09-25T17:51:34.178879] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-25T17:51:34.339760] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-25T17:51:34.370927] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-25T17:51:34.650575] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-25T17:51:34.650695] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-25T17:51:34.651453] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-25T17:51:34.651522] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-25T17:51:34.652857] [DEBUG] [LOCAL ] CARS: Trimmed 55360 records to 40380 (keeping 200 days of data) [2025-09-25T17:51:34.893897] [DEBUG] [LOCAL ] CARS: Primary data saved (40380 records). [2025-09-25T17:51:34.894043] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-25T17:51:34.894134] [INFO ] [MAIN ] Update Progress: 392/2372 symbols completed. CARS took 23.4s. Estimated remaining: 4h 20m 17s. Rate: 7.6 symbols/min [2025-09-25T17:51:35.072167] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:35.081526] [DEBUG] [LOCAL ] CATO: Loaded 7234 existing records from primary storage. [2025-09-25T17:51:35.081663] [INFO ] [MAIN ] CATO: Loaded 7234 existing records. [2025-09-25T17:51:35.102333] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-25T17:51:35.284443] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:35.284870] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-25T17:51:35.284947] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-25T17:51:35.285332] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-25T17:51:35.285415] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-25T17:51:35.647797] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-25T17:51:35.747603] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:35.757245] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T17:51:35.888722] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-25T17:51:36.688719] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-25T17:51:37.282553] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-25T17:51:37.322227] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T17:51:37.328399] [INFO ] [REMOTE ] CANG: Full fetch complete (40622 records). [2025-09-25T17:51:37.328490] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-25T17:51:37.501620] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-25T17:51:37.677283] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T17:51:37.773539] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-25T17:51:37.773636] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-25T17:51:37.774222] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-25T17:51:37.774270] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-25T17:51:37.775411] [DEBUG] [LOCAL ] CANG: Trimmed 40622 records to 26949 (keeping 200 days of data) [2025-09-25T17:51:37.927706] [DEBUG] [LOCAL ] CANG: Primary data saved (26949 records). [2025-09-25T17:51:37.927871] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-25T17:51:37.927973] [INFO ] [MAIN ] Update Progress: 393/2372 symbols completed. CANG took 39.4s. Estimated remaining: 4h 19m 45s. Rate: 7.6 symbols/min [2025-09-25T17:51:38.116598] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:38.171413] [DEBUG] [LOCAL ] CAVA: Loaded 53550 existing records from primary storage. [2025-09-25T17:51:38.171599] [INFO ] [MAIN ] CAVA: Loaded 53550 existing records. [2025-09-25T17:51:38.293848] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-25T17:51:38.367705] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:38.367963] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-25T17:51:38.368013] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-25T17:51:38.368257] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-25T17:51:38.368317] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-25T17:51:38.733732] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:39.088784] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-25T17:51:39.189825] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T17:51:39.803665] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T17:51:39.888800] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-25T17:51:40.383555] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-25T17:51:40.685946] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T17:51:40.688917] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-25T17:51:41.478764] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T17:51:41.488699] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-25T17:51:42.139064] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T17:51:42.288736] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-25T17:51:43.088728] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-25T17:51:43.888750] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-25T17:51:44.491841] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T17:51:44.510304] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T17:51:44.688810] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-25T17:51:44.931200] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T17:51:45.488726] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-25T17:51:46.111592] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T17:51:46.288747] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-25T17:51:46.978549] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T17:51:47.088717] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-25T17:51:47.428287] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T17:51:47.739739] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T17:51:47.888749] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-25T17:51:48.688735] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-25T17:51:49.371467] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T17:51:49.488736] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-25T17:51:49.784920] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T17:51:50.288716] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-25T17:51:51.088766] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-25T17:51:51.607582] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T17:51:51.888706] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-25T17:51:52.019480] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:51:52.688705] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-25T17:51:52.946814] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T17:51:53.328937] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T17:51:53.403720] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T17:51:53.405966] [INFO ] [REMOTE ] CATO: Full fetch complete (11908 records). [2025-09-25T17:51:53.406039] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-25T17:51:53.493967] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-25T17:51:53.772475] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-25T17:51:53.772557] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-25T17:51:53.772864] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-25T17:51:53.772924] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-25T17:51:53.773419] [DEBUG] [LOCAL ] CATO: Trimmed 11908 records to 7254 (keeping 200 days of data) [2025-09-25T17:51:53.816896] [DEBUG] [LOCAL ] CATO: Primary data saved (7254 records). [2025-09-25T17:51:53.817056] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-25T17:51:53.817161] [INFO ] [MAIN ] Update Progress: 394/2372 symbols completed. CATO took 18.9s. Estimated remaining: 4h 20m 17s. Rate: 7.6 symbols/min [2025-09-25T17:51:53.997902] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:54.047296] [DEBUG] [LOCAL ] CB: Loaded 50082 existing records from primary storage. [2025-09-25T17:51:54.047446] [INFO ] [MAIN ] CB: Loaded 50082 existing records. [2025-09-25T17:51:54.230977] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:54.231250] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-25T17:51:54.231298] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-25T17:51:54.231682] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-25T17:51:54.231743] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-25T17:51:54.294057] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-25T17:51:54.604665] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:55.088702] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-25T17:51:55.292346] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T17:51:55.305087] [INFO ] [REMOTE ] CARR: Full fetch complete (77602 records). [2025-09-25T17:51:55.305225] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-25T17:51:55.704869] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-25T17:51:55.704984] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-25T17:51:55.706213] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-25T17:51:55.706297] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-25T17:51:55.710701] [DEBUG] [LOCAL ] CARR: Trimmed 77602 records to 53984 (keeping 200 days of data) [2025-09-25T17:51:55.893321] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-25T17:51:56.048409] [DEBUG] [LOCAL ] CARR: Primary data saved (53984 records). [2025-09-25T17:51:56.048553] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-25T17:51:56.048696] [INFO ] [MAIN ] Update Progress: 395/2372 symbols completed. CARR took 46.2s. Estimated remaining: 4h 19m 41s. Rate: 7.6 symbols/min [2025-09-25T17:51:56.219027] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:51:56.232756] [DEBUG] [LOCAL ] CBAN: Loaded 11061 existing records from primary storage. [2025-09-25T17:51:56.232886] [INFO ] [MAIN ] CBAN: Loaded 11061 existing records. [2025-09-25T17:51:56.418282] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:51:56.419420] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-25T17:51:56.419491] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-25T17:51:56.420278] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-25T17:51:56.420344] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-25T17:51:56.790028] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:51:56.790597] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-25T17:51:56.940767] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-25T17:51:57.497593] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-25T17:51:57.526949] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-25T17:51:57.723826] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T17:51:57.905716] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T17:51:58.288729] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-25T17:51:59.088807] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-25T17:51:59.321639] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T17:51:59.888799] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-25T17:52:00.437222] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-25T17:52:00.688694] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-25T17:52:00.957895] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:52:01.488794] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-25T17:52:01.820001] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T17:52:02.288730] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-25T17:52:02.331226] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T17:52:02.860731] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T17:52:02.872061] [INFO ] [REMOTE ] CAT: Full fetch complete (76644 records). [2025-09-25T17:52:02.872367] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-25T17:52:03.088921] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-25T17:52:03.332096] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-25T17:52:03.332217] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-25T17:52:03.333236] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-25T17:52:03.333329] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-25T17:52:03.344305] [DEBUG] [LOCAL ] CAT: Trimmed 76644 records to 53313 (keeping 200 days of data) [2025-09-25T17:52:03.782100] [DEBUG] [LOCAL ] CAT: Primary data saved (53313 records). [2025-09-25T17:52:03.782277] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-25T17:52:03.785246] [INFO ] [MAIN ] Update Progress: 396/2372 symbols completed. CAT took 37.8s. Estimated remaining: 4h 19m 32s. Rate: 7.6 symbols/min [2025-09-25T17:52:03.889547] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-25T17:52:03.962974] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:03.987761] [DEBUG] [LOCAL ] CBL: Loaded 16676 existing records from primary storage. [2025-09-25T17:52:03.987909] [INFO ] [MAIN ] CBL: Loaded 16676 existing records. [2025-09-25T17:52:04.178820] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:52:04.179100] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-25T17:52:04.179151] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-25T17:52:04.179467] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-25T17:52:04.179539] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-25T17:52:04.546356] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:04.688700] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-25T17:52:05.524913] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (3.24 seconds). [2025-09-25T17:52:05.537852] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-25T17:52:05.589605] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T17:52:05.600635] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-25T17:52:05.618993] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T17:52:06.288740] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-25T17:52:07.066324] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T17:52:07.088666] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-25T17:52:07.837133] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-25T17:52:07.888667] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-25T17:52:08.085965] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T17:52:08.688758] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-25T17:52:09.488785] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-25T17:52:09.895470] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T17:52:09.971890] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T17:52:10.288693] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-25T17:52:10.641816] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-25T17:52:11.088742] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-25T17:52:11.284550] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T17:52:11.888735] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-25T17:52:12.688770] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-25T17:52:12.749409] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T17:52:13.011853] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T17:52:13.488725] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-25T17:52:14.288768] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-25T17:52:14.895493] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T17:52:15.088735] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-25T17:52:15.562329] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T17:52:15.659687] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-25T17:52:15.888744] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-25T17:52:15.929837] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T17:52:16.688688] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-25T17:52:16.889418] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T17:52:17.488745] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-25T17:52:18.228832] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T17:52:18.293815] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-25T17:52:18.310181] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T17:52:19.050122] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T17:52:19.088761] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-25T17:52:19.888752] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-25T17:52:20.688741] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-25T17:52:20.798753] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T17:52:21.396899] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-25T17:52:21.407591] [INFO ] [REMOTE ] CAVA: Full fetch complete (77284 records). [2025-09-25T17:52:21.407861] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-25T17:52:21.493784] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-25T17:52:21.837410] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-25T17:52:21.837603] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-25T17:52:21.838543] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-25T17:52:21.848919] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-25T17:52:21.850265] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:52:21.856130] [DEBUG] [LOCAL ] CAVA: Trimmed 77284 records to 53940 (keeping 200 days of data) [2025-09-25T17:52:22.198427] [DEBUG] [LOCAL ] CAVA: Primary data saved (53940 records). [2025-09-25T17:52:22.198613] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-25T17:52:22.201352] [INFO ] [MAIN ] Update Progress: 397/2372 symbols completed. CAVA took 44.3s. Estimated remaining: 4h 20m 17s. Rate: 7.6 symbols/min [2025-09-25T17:52:22.288735] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-25T17:52:22.407074] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T17:52:23.088716] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-25T17:52:23.888740] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-25T17:52:24.261133] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T17:52:24.264600] [INFO ] [REMOTE ] CBL: Full fetch complete (25600 records). [2025-09-25T17:52:24.264708] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-25T17:52:24.678073] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-25T17:52:24.678439] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-25T17:52:24.678951] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-25T17:52:24.679043] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-25T17:52:24.687467] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T17:52:24.690837] [DEBUG] [LOCAL ] CBL: Trimmed 25600 records to 16777 (keeping 200 days of data) [2025-09-25T17:52:24.691271] [INFO ] [REMOTE ] CBAN: Full fetch complete (16069 records). [2025-09-25T17:52:24.692050] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-25T17:52:25.111910] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-25T17:52:25.171970] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-25T17:52:25.248261] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-25T17:52:25.247944] [DEBUG] [LOCAL ] CBL: Primary data saved (16777 records). [2025-09-25T17:52:25.248510] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-25T17:52:25.248673] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-25T17:52:25.249222] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-25T17:52:25.249431] [INFO ] [MAIN ] Update Progress: 398/2372 symbols completed. CBL took 21.5s. Estimated remaining: 4h 19m 45s. Rate: 7.6 symbols/min [2025-09-25T17:52:25.249552] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-25T17:52:25.250443] [DEBUG] [LOCAL ] CBAN: Trimmed 16069 records to 11105 (keeping 200 days of data) [2025-09-25T17:52:25.325841] [DEBUG] [LOCAL ] CBAN: Primary data saved (11105 records). [2025-09-25T17:52:25.325997] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-25T17:52:25.326112] [INFO ] [MAIN ] Update Progress: 399/2372 symbols completed. CBAN took 29.3s. Estimated remaining: 4h 18m 58s. Rate: 7.6 symbols/min [2025-09-25T17:52:27.180594] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T17:52:27.193077] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-25T17:52:29.179536] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T17:52:29.188957] [INFO ] [REMOTE ] CB: Full fetch complete (72746 records). [2025-09-25T17:52:29.189115] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-25T17:52:29.635026] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-25T17:52:29.635142] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-25T17:52:29.636266] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-25T17:52:29.636340] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-25T17:52:29.637939] [DEBUG] [LOCAL ] CB: Trimmed 72746 records to 50444 (keeping 200 days of data) [2025-09-25T17:52:29.971821] [DEBUG] [LOCAL ] CB: Primary data saved (50444 records). [2025-09-25T17:52:29.971962] [INFO ] [MAIN ] CB: Full history saved. [2025-09-25T17:52:29.972070] [INFO ] [MAIN ] Update Progress: 400/2372 symbols completed. CB took 36.2s. Estimated remaining: 4h 18m 34s. Rate: 7.6 symbols/min [2025-09-25T17:52:30.545738] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:30.656473] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:30.681951] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:30.690366] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-25T17:52:30.714622] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:30.715142] [DEBUG] [LOCAL ] CBNA: Loaded 2887 existing records from primary storage. [2025-09-25T17:52:30.715333] [INFO ] [MAIN ] CBNA: Loaded 2887 existing records. [2025-09-25T17:52:30.715197] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-25T17:52:30.745750] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-25T17:52:30.751296] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-25T17:52:30.771031] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-25T17:52:30.771169] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-25T17:52:31.116834] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:52:31.118848] [DEBUG] [LOCAL ] CBT: Loaded 31097 existing records from primary storage. [2025-09-25T17:52:31.165386] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-25T17:52:31.195665] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-25T17:52:31.184561] [INFO ] [MAIN ] CBT: Loaded 31097 existing records. [2025-09-25T17:52:31.208674] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-25T17:52:31.218568] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-25T17:52:31.475708] [DEBUG] [LOCAL ] CBRE: Loaded 50635 existing records from primary storage. [2025-09-25T17:52:31.527758] [INFO ] [MAIN ] CBRE: Loaded 50635 existing records. [2025-09-25T17:52:31.783904] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:52:31.787793] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:31.897993] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-25T17:52:31.936488] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-25T17:52:31.952251] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-25T17:52:32.028504] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-25T17:52:32.041428] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-25T17:52:32.098791] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:52:32.188963] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:32.203304] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-25T17:52:32.237707] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-25T17:52:32.212775] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-25T17:52:32.243236] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:32.254034] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-25T17:52:32.265727] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-25T17:52:32.265817] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-25T17:52:32.284950] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-25T17:52:32.532331] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:32.587551] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-25T17:52:32.601915] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-25T17:52:32.899322] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:32.888273] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:32.917142] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-25T17:52:32.957581] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:32.926577] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-25T17:52:32.958127] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-25T17:52:32.958343] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-25T17:52:33.004487] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T17:52:33.006259] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-25T17:52:33.296354] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-25T17:52:33.297318] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-25T17:52:33.499353] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.20 seconds). [2025-09-25T17:52:33.500195] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-25T17:52:33.723073] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T17:52:34.253608] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T17:52:34.288715] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-25T17:52:34.572481] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-25T17:52:34.577305] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T17:52:34.630459] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T17:52:35.088770] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-25T17:52:35.543378] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T17:52:35.888831] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-25T17:52:36.688732] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-25T17:52:37.246252] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T17:52:37.488738] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-25T17:52:37.847982] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-25T17:52:38.288690] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-25T17:52:38.403448] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T17:52:38.737349] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-25T17:52:39.088757] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-25T17:52:39.464043] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-25T17:52:39.888736] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-25T17:52:40.688730] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-25T17:52:41.229471] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T17:52:41.488750] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-25T17:52:42.288713] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-25T17:52:42.390712] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T17:52:42.516636] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-25T17:52:42.848016] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T17:52:43.088719] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-25T17:52:43.394803] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:43.395122] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-25T17:52:43.888759] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-25T17:52:44.688734] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-25T17:52:45.357591] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T17:52:45.488753] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-25T17:52:46.288743] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-25T17:52:46.519514] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T17:52:46.919051] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:52:46.931846] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T17:52:47.088757] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-25T17:52:47.888752] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-25T17:52:48.688768] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-25T17:52:48.711601] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:48.711985] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-25T17:52:48.712105] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-25T17:52:48.712235] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-25T17:52:48.713531] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:52:48.713614] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:52:48.713701] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:52:48.713773] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-25T17:52:48.713887] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-25T17:52:48.713952] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-25T17:52:48.714031] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-25T17:52:48.714132] [INFO ] [MAIN ] Update Progress: 401/2372 symbols completed. CBO took 18.7s. Estimated remaining: 4h 19m 20s. Rate: 7.6 symbols/min [2025-09-25T17:52:48.895517] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:48.930812] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T17:52:48.958460] [DEBUG] [LOCAL ] CBU: Loaded 22866 existing records from primary storage. [2025-09-25T17:52:48.958610] [INFO ] [MAIN ] CBU: Loaded 22866 existing records. [2025-09-25T17:52:49.143133] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:52:49.143317] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T17:52:49.143751] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-25T17:52:49.145258] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-25T17:52:49.145506] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-25T17:52:49.145575] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-25T17:52:49.498320] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-25T17:52:49.504748] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:50.066406] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T17:52:50.288766] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-25T17:52:51.088777] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-25T17:52:51.810738] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T17:52:51.888666] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-25T17:52:52.245097] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T17:52:52.688729] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-25T17:52:53.231171] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T17:52:53.232401] [INFO ] [REMOTE ] CBNA: Full fetch complete (4670 records). [2025-09-25T17:52:53.232513] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-25T17:52:53.490965] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-25T17:52:53.635639] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-25T17:52:53.635846] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-25T17:52:53.636037] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-25T17:52:53.636113] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-25T17:52:53.649905] [DEBUG] [LOCAL ] CBNA: Trimmed 4670 records to 2908 (keeping 200 days of data) [2025-09-25T17:52:53.674027] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T17:52:53.701666] [DEBUG] [LOCAL ] CBNA: Primary data saved (2908 records). [2025-09-25T17:52:53.701769] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-25T17:52:53.701862] [INFO ] [MAIN ] Update Progress: 402/2372 symbols completed. CBNA took 23.7s. Estimated remaining: 4h 18m 58s. Rate: 7.6 symbols/min [2025-09-25T17:52:53.879856] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:52:53.880110] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-25T17:52:53.880166] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-25T17:52:53.880356] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-25T17:52:53.880417] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-25T17:52:53.880486] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-25T17:52:53.880523] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-25T17:52:54.266468] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:52:54.288771] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-25T17:52:54.505760] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:52:54.506314] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-25T17:52:54.666410] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T17:52:55.088745] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-25T17:52:55.888709] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-25T17:52:56.254762] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T17:52:56.688769] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-25T17:52:57.488683] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-25T17:52:57.660809] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T17:52:57.868870] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T17:52:58.288779] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-25T17:52:58.869282] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T17:52:59.088789] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-25T17:52:59.428304] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T17:52:59.888745] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-25T17:53:00.151813] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T17:53:00.157617] [INFO ] [REMOTE ] CBT: Full fetch complete (45916 records). [2025-09-25T17:53:00.157782] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-25T17:53:00.543611] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-25T17:53:00.543729] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-25T17:53:00.544302] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-25T17:53:00.544346] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-25T17:53:00.545438] [DEBUG] [LOCAL ] CBT: Trimmed 45916 records to 31329 (keeping 200 days of data) [2025-09-25T17:53:00.701133] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-25T17:53:00.747523] [DEBUG] [LOCAL ] CBT: Primary data saved (31329 records). [2025-09-25T17:53:00.747686] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-25T17:53:00.747823] [INFO ] [MAIN ] Update Progress: 403/2372 symbols completed. CBT took 30.8s. Estimated remaining: 4h 18m 46s. Rate: 7.6 symbols/min [2025-09-25T17:53:00.917622] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:00.951950] [DEBUG] [LOCAL ] CBZ: Loaded 33505 existing records from primary storage. [2025-09-25T17:53:00.952091] [INFO ] [MAIN ] CBZ: Loaded 33505 existing records. [2025-09-25T17:53:01.131857] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:01.132103] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-25T17:53:01.132150] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-25T17:53:01.132410] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-25T17:53:01.132468] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-25T17:53:01.495468] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-25T17:53:01.501029] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:01.558824] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T17:53:01.724423] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:01.724836] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-25T17:53:01.983380] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T17:53:02.288775] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-25T17:53:03.088732] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-25T17:53:03.652810] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T17:53:03.888749] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-25T17:53:04.080100] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:04.080423] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-25T17:53:04.688741] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-25T17:53:04.892460] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T17:53:04.901819] [INFO ] [REMOTE ] CBRE: Full fetch complete (73962 records). [2025-09-25T17:53:04.901976] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-25T17:53:05.304116] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-25T17:53:05.304235] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-25T17:53:05.305068] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-25T17:53:05.305137] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-25T17:53:05.310017] [DEBUG] [LOCAL ] CBRE: Trimmed 73962 records to 51010 (keeping 200 days of data) [2025-09-25T17:53:05.489574] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-25T17:53:05.630928] [DEBUG] [LOCAL ] CBRE: Primary data saved (51010 records). [2025-09-25T17:53:05.631082] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-25T17:53:05.631171] [INFO ] [MAIN ] Update Progress: 404/2372 symbols completed. CBRE took 35.7s. Estimated remaining: 4h 18m 23s. Rate: 7.6 symbols/min [2025-09-25T17:53:05.836462] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:05.837621] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T17:53:05.893158] [DEBUG] [LOCAL ] CC: Loaded 53032 existing records from primary storage. [2025-09-25T17:53:05.893302] [INFO ] [MAIN ] CC: Loaded 53032 existing records. [2025-09-25T17:53:06.071265] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:06.071531] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-25T17:53:06.071579] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-25T17:53:06.071913] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-25T17:53:06.071976] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-25T17:53:06.294866] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-25T17:53:06.444015] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:06.558344] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T17:53:06.564464] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:06.565243] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-25T17:53:07.088751] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-25T17:53:07.888786] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-25T17:53:08.314014] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T17:53:08.688684] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-25T17:53:08.887718] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:08.888128] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-25T17:53:08.981137] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T17:53:09.488722] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-25T17:53:10.288745] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-25T17:53:10.562553] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T17:53:11.088703] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-25T17:53:11.123750] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T17:53:11.888715] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-25T17:53:12.244302] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T17:53:12.688766] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-25T17:53:13.109571] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T17:53:13.488736] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-25T17:53:13.737082] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-25T17:53:14.174232] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:53:14.288729] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-25T17:53:14.510310] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-25T17:53:15.088721] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-25T17:53:15.888717] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-25T17:53:16.104313] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:16.104624] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-25T17:53:16.688750] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-25T17:53:16.822250] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T17:53:17.488753] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-25T17:53:18.051345] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T17:53:18.288756] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-25T17:53:18.770816] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T17:53:19.088781] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-25T17:53:19.189734] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T17:53:19.888717] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-25T17:53:20.659566] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T17:53:20.688692] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-25T17:53:21.293808] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T17:53:21.488693] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-25T17:53:22.288689] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-25T17:53:22.401863] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:53:22.630537] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:53:22.630890] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-25T17:53:22.630995] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-25T17:53:22.631068] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-25T17:53:22.631759] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:53:22.631840] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:53:22.631885] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:53:22.631927] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-25T17:53:22.632000] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-25T17:53:22.632058] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-25T17:53:22.632107] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-25T17:53:22.632189] [INFO ] [MAIN ] Update Progress: 405/2372 symbols completed. CBX took 28.9s. Estimated remaining: 4h 18m 60s. Rate: 7.6 symbols/min [2025-09-25T17:53:22.813776] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T17:53:22.841107] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:22.921444] [DEBUG] [LOCAL ] CCI: Loaded 53149 existing records from primary storage. [2025-09-25T17:53:22.921619] [INFO ] [MAIN ] CCI: Loaded 53149 existing records. [2025-09-25T17:53:23.094204] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-25T17:53:23.100100] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:23.101259] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-25T17:53:23.101322] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-25T17:53:23.101708] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-25T17:53:23.101771] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-25T17:53:23.466594] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:23.888721] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-25T17:53:24.513261] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T17:53:24.688769] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-25T17:53:25.105697] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:53:25.110724] [INFO ] [REMOTE ] CBU: Full fetch complete (32217 records). [2025-09-25T17:53:25.110927] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-25T17:53:25.488704] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-25T17:53:25.520221] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-25T17:53:25.520305] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-25T17:53:25.520830] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-25T17:53:25.520893] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-25T17:53:25.521751] [DEBUG] [LOCAL ] CBU: Trimmed 32217 records to 23004 (keeping 200 days of data) [2025-09-25T17:53:25.680420] [DEBUG] [LOCAL ] CBU: Primary data saved (23004 records). [2025-09-25T17:53:25.680552] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-25T17:53:25.680636] [INFO ] [MAIN ] Update Progress: 406/2372 symbols completed. CBU took 37.0s. Estimated remaining: 4h 18m 28s. Rate: 7.6 symbols/min [2025-09-25T17:53:25.850913] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:25.851096] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-25T17:53:25.851150] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-25T17:53:25.851295] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-25T17:53:25.851337] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-25T17:53:25.851381] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-25T17:53:25.851412] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-25T17:53:26.214114] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:26.237357] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T17:53:26.245327] [INFO ] [REMOTE ] CBZ: Full fetch complete (44947 records). [2025-09-25T17:53:26.245431] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-25T17:53:26.293788] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-25T17:53:26.667949] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-25T17:53:26.668037] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-25T17:53:26.668624] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-25T17:53:26.668705] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-25T17:53:26.669849] [DEBUG] [LOCAL ] CBZ: Trimmed 44947 records to 33818 (keeping 200 days of data) [2025-09-25T17:53:26.879875] [DEBUG] [LOCAL ] CBZ: Primary data saved (33818 records). [2025-09-25T17:53:26.880041] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-25T17:53:26.880141] [INFO ] [MAIN ] Update Progress: 407/2372 symbols completed. CBZ took 26.1s. Estimated remaining: 4h 17m 48s. Rate: 7.6 symbols/min [2025-09-25T17:53:27.069141] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:27.085608] [DEBUG] [LOCAL ] CCIF: Loaded 15401 existing records from primary storage. [2025-09-25T17:53:27.085795] [INFO ] [MAIN ] CCIF: Loaded 15401 existing records. [2025-09-25T17:53:27.099099] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-25T17:53:27.292952] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:27.293551] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-25T17:53:27.293751] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-25T17:53:27.294029] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-25T17:53:27.294089] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-25T17:53:27.685089] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T17:53:27.697224] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:27.759334] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-25T17:53:27.874941] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T17:53:27.889276] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-25T17:53:28.688774] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-25T17:53:28.727019] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T17:53:29.488727] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-25T17:53:29.850959] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-25T17:53:30.213203] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T17:53:30.288718] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-25T17:53:30.629616] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-25T17:53:31.088731] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-25T17:53:31.888730] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-25T17:53:32.213657] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-25T17:53:32.688713] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-25T17:53:32.914033] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T17:53:33.488727] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-25T17:53:34.210520] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T17:53:34.288684] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-25T17:53:34.537018] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T17:53:35.088715] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-25T17:53:35.394612] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-25T17:53:35.888693] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-25T17:53:35.979118] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T17:53:36.688721] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-25T17:53:37.488708] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-25T17:53:37.873478] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T17:53:38.062505] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T17:53:38.288706] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-25T17:53:38.577518] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T17:53:38.760487] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T17:53:39.088753] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-25T17:53:39.446676] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T17:53:39.888719] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-25T17:53:40.688733] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-25T17:53:41.108245] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T17:53:41.488748] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-25T17:53:41.531686] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T17:53:41.908557] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-25T17:53:42.288735] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-25T17:53:43.088738] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-25T17:53:43.304823] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T17:53:43.888736] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-25T17:53:44.615480] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T17:53:44.650623] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T17:53:44.688683] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-25T17:53:45.488753] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-25T17:53:45.519999] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T17:53:46.288724] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-25T17:53:46.643948] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-25T17:53:46.644852] [INFO ] [REMOTE ] CCIA: Full fetch complete (2047 records). [2025-09-25T17:53:46.644922] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-25T17:53:46.826186] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T17:53:46.826423] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:53:46.826513] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:53:46.826606] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-25T17:53:46.826759] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-25T17:53:46.826819] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-25T17:53:46.826881] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-25T17:53:46.826965] [INFO ] [MAIN ] Update Progress: 408/2372 symbols completed. CCIA took 21.1s. Estimated remaining: 4h 18m 39s. Rate: 7.6 symbols/min [2025-09-25T17:53:47.000313] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:47.055458] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-25T17:53:47.058942] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-25T17:53:47.091173] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-25T17:53:47.202590] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T17:53:47.258305] [INFO ] [REMOTE ] CC: Full fetch complete (75552 records). [2025-09-25T17:53:47.262526] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-25T17:53:47.282578] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:47.283058] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-25T17:53:47.283137] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-25T17:53:47.359607] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-25T17:53:47.384063] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-25T17:53:47.894928] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-25T17:53:48.060691] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-25T17:53:48.067164] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-25T17:53:48.078006] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-25T17:53:48.078094] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-25T17:53:48.100525] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:48.101777] [DEBUG] [LOCAL ] CC: Trimmed 75552 records to 53416 (keeping 200 days of data) [2025-09-25T17:53:48.438463] [DEBUG] [LOCAL ] CC: Primary data saved (53416 records). [2025-09-25T17:53:48.438612] [INFO ] [MAIN ] CC: Full history saved. [2025-09-25T17:53:48.438726] [INFO ] [MAIN ] Update Progress: 409/2372 symbols completed. CC took 42.8s. Estimated remaining: 4h 18m 0s. Rate: 7.6 symbols/min [2025-09-25T17:53:48.620704] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:48.666905] [DEBUG] [LOCAL ] CCK: Loaded 46358 existing records from primary storage. [2025-09-25T17:53:48.667069] [INFO ] [MAIN ] CCK: Loaded 46358 existing records. [2025-09-25T17:53:48.697014] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-25T17:53:48.855174] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T17:53:48.873301] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:53:48.873638] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-25T17:53:48.873887] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-25T17:53:48.874291] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-25T17:53:48.874352] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-25T17:53:49.276221] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:53:49.278781] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-25T17:53:49.488711] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-25T17:53:50.288718] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-25T17:53:50.664160] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T17:53:50.893698] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T17:53:51.088719] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-25T17:53:51.221987] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T17:53:51.888723] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-25T17:53:52.688684] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-25T17:53:52.830791] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T17:53:52.917277] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T17:53:53.488725] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-25T17:53:54.288707] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-25T17:53:54.729941] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-25T17:53:55.088726] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-25T17:53:55.389169] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T17:53:55.451137] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T17:53:55.888756] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-25T17:53:56.688717] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-25T17:53:56.967099] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T17:53:57.488763] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-25T17:53:57.725111] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:53:58.288697] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-25T17:53:58.391481] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T17:53:59.088734] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-25T17:53:59.122775] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T17:53:59.126824] [INFO ] [REMOTE ] CCIF: Full fetch complete (21561 records). [2025-09-25T17:53:59.127025] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-25T17:53:59.293263] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T17:53:59.550797] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-25T17:53:59.550932] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-25T17:53:59.551308] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-25T17:53:59.551348] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-25T17:53:59.552003] [DEBUG] [LOCAL ] CCIF: Trimmed 21561 records to 15490 (keeping 200 days of data) [2025-09-25T17:53:59.642634] [DEBUG] [LOCAL ] CCIF: Primary data saved (15490 records). [2025-09-25T17:53:59.642793] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-25T17:53:59.642881] [INFO ] [MAIN ] Update Progress: 410/2372 symbols completed. CCIF took 32.8s. Estimated remaining: 4h 18m 8s. Rate: 7.6 symbols/min [2025-09-25T17:53:59.812796] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:53:59.863184] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-25T17:53:59.863325] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-09-25T17:53:59.893828] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-25T17:54:00.047803] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:00.048104] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-25T17:54:00.048167] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-25T17:54:00.048449] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-25T17:54:00.048532] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-25T17:54:00.420840] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:00.668556] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T17:54:00.688671] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-25T17:54:01.488728] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-25T17:54:01.851196] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T17:54:01.964255] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T17:54:02.288786] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-25T17:54:03.088768] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-25T17:54:03.383310] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T17:54:03.393216] [INFO ] [REMOTE ] CCI: Full fetch complete (77000 records). [2025-09-25T17:54:03.393348] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-25T17:54:03.792899] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-25T17:54:03.792979] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-25T17:54:03.793783] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-25T17:54:03.793847] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-25T17:54:03.795310] [DEBUG] [LOCAL ] CCI: Trimmed 77000 records to 53536 (keeping 200 days of data) [2025-09-25T17:54:03.889248] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-25T17:54:04.066115] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T17:54:04.183139] [DEBUG] [LOCAL ] CCI: Primary data saved (53536 records). [2025-09-25T17:54:04.183283] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-25T17:54:04.186232] [INFO ] [MAIN ] Update Progress: 411/2372 symbols completed. CCI took 41.6s. Estimated remaining: 4h 17m 45s. Rate: 7.6 symbols/min [2025-09-25T17:54:04.361569] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:04.413396] [DEBUG] [LOCAL ] CCO: Loaded 47658 existing records from primary storage. [2025-09-25T17:54:04.413558] [INFO ] [MAIN ] CCO: Loaded 47658 existing records. [2025-09-25T17:54:04.598382] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:04.598685] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-25T17:54:04.598744] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-25T17:54:04.599055] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-25T17:54:04.599115] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-25T17:54:04.699625] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-25T17:54:04.965981] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:05.333906] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-25T17:54:05.426220] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T17:54:05.488675] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-25T17:54:06.288731] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-25T17:54:06.671540] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T17:54:06.718767] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T17:54:07.088790] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-25T17:54:07.730199] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T17:54:07.888737] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-25T17:54:08.688702] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-25T17:54:08.734280] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T17:54:09.488812] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-25T17:54:10.073495] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T17:54:10.293690] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-25T17:54:10.296787] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-25T17:54:11.076245] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T17:54:11.088665] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-25T17:54:11.888765] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-25T17:54:12.393580] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T17:54:12.688692] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-25T17:54:13.112583] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T17:54:13.121933] [INFO ] [REMOTE ] CCK: Full fetch complete (67746 records). [2025-09-25T17:54:13.122109] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-25T17:54:13.489478] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-25T17:54:13.563283] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-25T17:54:13.563527] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-25T17:54:13.564577] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-25T17:54:13.564693] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-25T17:54:13.569683] [DEBUG] [LOCAL ] CCK: Trimmed 67746 records to 46723 (keeping 200 days of data) [2025-09-25T17:54:13.885776] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T17:54:13.900231] [DEBUG] [LOCAL ] CCK: Primary data saved (46723 records). [2025-09-25T17:54:13.900320] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-25T17:54:13.900397] [INFO ] [MAIN ] Update Progress: 412/2372 symbols completed. CCK took 25.5s. Estimated remaining: 4h 17m 45s. Rate: 7.6 symbols/min [2025-09-25T17:54:14.075465] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:14.086087] [DEBUG] [LOCAL ] CCRD: Loaded 9021 existing records from primary storage. [2025-09-25T17:54:14.086188] [INFO ] [MAIN ] CCRD: Loaded 9021 existing records. [2025-09-25T17:54:14.297751] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-25T17:54:14.297527] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:14.298960] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-25T17:54:14.311825] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-25T17:54:14.320184] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-25T17:54:14.320311] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-25T17:54:14.327023] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T17:54:14.698585] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:15.088724] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-25T17:54:15.474190] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T17:54:15.888761] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-25T17:54:16.004005] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T17:54:16.688700] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-25T17:54:16.785852] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-25T17:54:17.488715] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-25T17:54:18.003218] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T17:54:18.182342] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:54:18.288682] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-25T17:54:18.389918] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-25T17:54:18.399841] [INFO ] [REMOTE ] CCJ: Full fetch complete (77685 records). [2025-09-25T17:54:18.399965] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-25T17:54:18.809980] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-25T17:54:18.810090] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-25T17:54:18.811261] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-25T17:54:18.811353] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-25T17:54:18.813134] [DEBUG] [LOCAL ] CCJ: Trimmed 77685 records to 54065 (keeping 200 days of data) [2025-09-25T17:54:19.090967] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-25T17:54:19.141473] [DEBUG] [LOCAL ] CCJ: Primary data saved (54065 records). [2025-09-25T17:54:19.141593] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-25T17:54:19.141744] [INFO ] [MAIN ] Update Progress: 413/2372 symbols completed. CCJ took 32.3s. Estimated remaining: 4h 17m 25s. Rate: 7.6 symbols/min [2025-09-25T17:54:19.323437] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:19.360135] [DEBUG] [LOCAL ] CCS: Loaded 30736 existing records from primary storage. [2025-09-25T17:54:19.360300] [INFO ] [MAIN ] CCS: Loaded 30736 existing records. [2025-09-25T17:54:19.554965] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:19.555407] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-25T17:54:19.555508] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-25T17:54:19.556487] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-25T17:54:19.556559] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-25T17:54:19.698486] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T17:54:19.892922] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-25T17:54:19.968865] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:19.999731] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T17:54:20.688804] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-25T17:54:20.747072] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T17:54:21.488790] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-25T17:54:22.127872] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T17:54:22.288732] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-25T17:54:22.819884] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-25T17:54:22.892171] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T17:54:23.088812] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-25T17:54:23.888746] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-25T17:54:24.502018] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T17:54:24.688735] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-25T17:54:25.488739] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-25T17:54:25.721872] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T17:54:26.062513] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-25T17:54:26.288703] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-25T17:54:27.088705] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-25T17:54:27.226747] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T17:54:27.392769] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T17:54:27.888749] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-25T17:54:28.017546] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T17:54:28.688723] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-25T17:54:29.345325] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T17:54:29.488762] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-25T17:54:30.194972] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T17:54:30.288735] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-25T17:54:30.800883] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T17:54:31.005721] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T17:54:31.088735] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-25T17:54:31.888723] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-25T17:54:32.015252] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T17:54:32.688757] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-25T17:54:33.488735] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-25T17:54:34.211279] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-25T17:54:34.288747] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-25T17:54:34.417095] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T17:54:34.976513] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T17:54:35.088700] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-25T17:54:35.888714] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-25T17:54:36.468080] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T17:54:36.613479] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T17:54:36.616517] [INFO ] [REMOTE ] CCRD: Full fetch complete (11887 records). [2025-09-25T17:54:36.616597] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-25T17:54:36.698031] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-25T17:54:36.957983] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-25T17:54:37.050145] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-25T17:54:37.050230] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-25T17:54:37.050497] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-25T17:54:37.050578] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-25T17:54:37.052400] [DEBUG] [LOCAL ] CCRD: Trimmed 11887 records to 9067 (keeping 200 days of data) [2025-09-25T17:54:37.111496] [DEBUG] [LOCAL ] CCRD: Primary data saved (9067 records). [2025-09-25T17:54:37.111612] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-25T17:54:37.111798] [INFO ] [MAIN ] Update Progress: 414/2372 symbols completed. CCRD took 23.2s. Estimated remaining: 4h 18m 5s. Rate: 7.6 symbols/min [2025-09-25T17:54:37.281663] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:37.309993] [DEBUG] [LOCAL ] CCU: Loaded 23608 existing records from primary storage. [2025-09-25T17:54:37.310112] [INFO ] [MAIN ] CCU: Loaded 23608 existing records. [2025-09-25T17:54:37.487667] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:37.487896] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-25T17:54:37.487946] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-25T17:54:37.488186] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-25T17:54:37.488255] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-25T17:54:37.499344] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-25T17:54:37.856973] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:38.045161] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T17:54:38.288771] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-25T17:54:38.722167] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:54:38.732100] [INFO ] [REMOTE ] CCO: Full fetch complete (66242 records). [2025-09-25T17:54:38.732225] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-25T17:54:39.089805] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-25T17:54:39.138075] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-25T17:54:39.138168] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-25T17:54:39.138994] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-25T17:54:39.139061] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-25T17:54:39.140749] [DEBUG] [LOCAL ] CCO: Trimmed 66242 records to 48012 (keeping 200 days of data) [2025-09-25T17:54:39.423702] [DEBUG] [LOCAL ] CCO: Primary data saved (48012 records). [2025-09-25T17:54:39.423898] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-25T17:54:39.424931] [INFO ] [MAIN ] Update Progress: 415/2372 symbols completed. CCO took 35.2s. Estimated remaining: 4h 17m 30s. Rate: 7.6 symbols/min [2025-09-25T17:54:39.564316] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T17:54:39.618280] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:39.618393] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-25T17:54:39.618433] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-25T17:54:39.618573] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-25T17:54:39.618614] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-25T17:54:39.618684] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-25T17:54:39.618734] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-25T17:54:39.894758] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-25T17:54:39.976741] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:40.688693] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-25T17:54:40.849618] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T17:54:41.496697] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-25T17:54:41.521634] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-25T17:54:41.589237] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T17:54:42.288690] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-25T17:54:42.532097] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T17:54:43.088690] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-25T17:54:43.527337] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T17:54:43.888766] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-25T17:54:44.401686] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T17:54:44.688718] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-25T17:54:45.068672] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T17:54:45.074303] [INFO ] [REMOTE ] CCS: Full fetch complete (44895 records). [2025-09-25T17:54:45.074394] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-25T17:54:45.259528] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T17:54:45.466399] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-25T17:54:45.466506] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-25T17:54:45.467261] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-25T17:54:45.467345] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-25T17:54:45.468362] [DEBUG] [LOCAL ] CCS: Trimmed 44895 records to 30944 (keeping 200 days of data) [2025-09-25T17:54:45.532250] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-25T17:54:45.667898] [DEBUG] [LOCAL ] CCS: Primary data saved (30944 records). [2025-09-25T17:54:45.668035] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-25T17:54:45.668145] [INFO ] [MAIN ] Update Progress: 416/2372 symbols completed. CCS took 26.5s. Estimated remaining: 4h 17m 15s. Rate: 7.6 symbols/min [2025-09-25T17:54:45.853443] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-25T17:54:45.856733] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:45.918412] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-25T17:54:45.918636] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-25T17:54:46.098854] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:46.099106] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-25T17:54:46.099161] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-25T17:54:46.099411] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-25T17:54:46.099468] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-25T17:54:46.297951] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-25T17:54:46.489579] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:47.088735] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-25T17:54:47.436223] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T17:54:47.888766] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-25T17:54:48.109905] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-25T17:54:48.688702] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-25T17:54:48.912210] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-25T17:54:49.332694] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-25T17:54:49.342841] [INFO ] [REMOTE ] CCL: Full fetch complete (77920 records). [2025-09-25T17:54:49.343011] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-25T17:54:49.493889] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-25T17:54:49.754119] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-25T17:54:49.754216] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-25T17:54:49.755183] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-25T17:54:49.755257] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-25T17:54:49.756898] [DEBUG] [LOCAL ] CCL: Trimmed 77920 records to 54190 (keeping 200 days of data) [2025-09-25T17:54:50.124046] [DEBUG] [LOCAL ] CCL: Primary data saved (54190 records). [2025-09-25T17:54:50.124259] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-25T17:54:50.124427] [INFO ] [MAIN ] Update Progress: 417/2372 symbols completed. CCL took 50.5s. Estimated remaining: 4h 16m 51s. Rate: 7.6 symbols/min [2025-09-25T17:54:50.289743] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-25T17:54:50.310980] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:50.323860] [DEBUG] [LOCAL ] CDLR: Loaded 9802 existing records from primary storage. [2025-09-25T17:54:50.324003] [INFO ] [MAIN ] CDLR: Loaded 9802 existing records. [2025-09-25T17:54:50.524628] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:50.525187] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-25T17:54:50.525330] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-25T17:54:50.525605] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-25T17:54:50.526029] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-25T17:54:50.671843] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-25T17:54:50.920155] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:54:50.921921] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T17:54:51.088736] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-25T17:54:51.312388] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-25T17:54:51.888759] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-25T17:54:52.688803] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-25T17:54:52.923565] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:54:52.923986] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-25T17:54:53.488740] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-25T17:54:53.703116] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T17:54:54.288752] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-25T17:54:54.611512] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T17:54:55.088715] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-25T17:54:55.888748] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-25T17:54:56.096286] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T17:54:56.351754] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T17:54:56.352951] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T17:54:56.688756] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-25T17:54:57.488715] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-25T17:54:57.724767] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T17:54:58.288755] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-25T17:54:58.516174] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-25T17:54:59.088723] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-25T17:54:59.300609] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T17:54:59.428172] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-25T17:54:59.428940] [INFO ] [REMOTE ] CCZ: Full fetch complete (111 records). [2025-09-25T17:54:59.429035] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-25T17:54:59.429419] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:54:59.429504] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:54:59.429560] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:54:59.429636] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-25T17:54:59.429774] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-25T17:54:59.429831] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-25T17:54:59.429915] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-25T17:54:59.429996] [INFO ] [MAIN ] Update Progress: 418/2372 symbols completed. CCZ took 20.0s. Estimated remaining: 4h 16m 50s. Rate: 7.6 symbols/min [2025-09-25T17:54:59.623741] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:54:59.698606] [DEBUG] [LOCAL ] CDP: Loaded 42701 existing records from primary storage. [2025-09-25T17:54:59.698846] [INFO ] [MAIN ] CDP: Loaded 42701 existing records. [2025-09-25T17:54:59.880311] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:54:59.880558] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-25T17:54:59.880617] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-25T17:54:59.880972] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-25T17:54:59.881030] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-25T17:54:59.893843] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-25T17:55:00.270337] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:00.688712] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-25T17:55:01.488838] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-25T17:55:01.591487] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T17:55:01.912895] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T17:55:02.288785] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-25T17:55:03.096534] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-25T17:55:03.114033] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T17:55:03.429315] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T17:55:03.434351] [INFO ] [REMOTE ] CCU: Full fetch complete (33165 records). [2025-09-25T17:55:03.434572] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-25T17:55:03.812793] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-25T17:55:03.812874] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-25T17:55:03.813331] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-25T17:55:03.813371] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-25T17:55:03.814171] [DEBUG] [LOCAL ] CCU: Trimmed 33165 records to 23712 (keeping 200 days of data) [2025-09-25T17:55:03.904227] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-25T17:55:03.968541] [DEBUG] [LOCAL ] CCU: Primary data saved (23712 records). [2025-09-25T17:55:03.968736] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-25T17:55:03.968880] [INFO ] [MAIN ] Update Progress: 419/2372 symbols completed. CCU took 26.9s. Estimated remaining: 4h 16m 26s. Rate: 7.6 symbols/min [2025-09-25T17:55:04.149832] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:04.176785] [DEBUG] [LOCAL ] CDRE: Loaded 25426 existing records from primary storage. [2025-09-25T17:55:04.176931] [INFO ] [MAIN ] CDRE: Loaded 25426 existing records. [2025-09-25T17:55:04.375370] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:04.375725] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-25T17:55:04.375782] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-25T17:55:04.376008] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-25T17:55:04.376066] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-25T17:55:04.704794] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-25T17:55:04.751858] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:05.102867] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T17:55:05.229110] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-25T17:55:05.273766] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T17:55:05.488737] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-25T17:55:06.157243] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T17:55:06.288716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-25T17:55:07.088755] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-25T17:55:07.469549] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T17:55:07.888782] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-25T17:55:08.383799] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T17:55:08.644159] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T17:55:08.688774] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-25T17:55:09.488745] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-25T17:55:09.541547] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T17:55:10.288737] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-25T17:55:11.088745] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-25T17:55:11.274451] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T17:55:11.439564] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T17:55:11.888746] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-25T17:55:12.523740] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T17:55:12.688778] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-25T17:55:13.463851] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T17:55:13.488799] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-25T17:55:13.851212] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T17:55:14.288715] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-25T17:55:15.052540] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T17:55:15.088724] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-25T17:55:15.394578] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T17:55:15.888729] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-25T17:55:16.452046] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T17:55:16.688716] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-25T17:55:17.424714] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T17:55:17.428471] [INFO ] [REMOTE ] CDLR: Full fetch complete (13052 records). [2025-09-25T17:55:17.428630] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-25T17:55:17.491466] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-25T17:55:17.650812] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T17:55:17.933671] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-25T17:55:17.933759] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-25T17:55:17.934046] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-25T17:55:17.934084] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-25T17:55:17.934577] [DEBUG] [LOCAL ] CDLR: Trimmed 13052 records to 9877 (keeping 200 days of data) [2025-09-25T17:55:17.995639] [DEBUG] [LOCAL ] CDLR: Primary data saved (9877 records). [2025-09-25T17:55:17.995822] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-25T17:55:17.995926] [INFO ] [MAIN ] Update Progress: 420/2372 symbols completed. CDLR took 27.9s. Estimated remaining: 4h 16m 47s. Rate: 7.6 symbols/min [2025-09-25T17:55:18.169161] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:18.225316] [DEBUG] [LOCAL ] CE: Loaded 51543 existing records from primary storage. [2025-09-25T17:55:18.225506] [INFO ] [MAIN ] CE: Loaded 51543 existing records. [2025-09-25T17:55:18.293859] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-25T17:55:18.417968] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:18.418247] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-25T17:55:18.418339] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-25T17:55:18.418600] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-25T17:55:18.418704] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-25T17:55:18.801238] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:18.810231] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T17:55:19.088754] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-25T17:55:19.866088] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T17:55:19.885007] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T17:55:19.888676] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-25T17:55:20.688727] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-25T17:55:21.488789] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-25T17:55:22.288744] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-25T17:55:22.379149] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-25T17:55:22.550916] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T17:55:22.987979] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T17:55:23.088670] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-25T17:55:23.152011] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T17:55:23.888748] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-25T17:55:24.366294] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T17:55:24.688757] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-25T17:55:25.170901] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T17:55:25.488691] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-25T17:55:25.864206] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T17:55:26.288721] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-25T17:55:27.088680] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-25T17:55:27.367557] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T17:55:27.888711] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-25T17:55:28.120592] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T17:55:28.230904] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T17:55:28.239200] [INFO ] [REMOTE ] CDP: Full fetch complete (61844 records). [2025-09-25T17:55:28.239338] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-25T17:55:28.645985] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-25T17:55:28.646095] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-25T17:55:28.646812] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-25T17:55:28.646876] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-25T17:55:28.648448] [DEBUG] [LOCAL ] CDP: Trimmed 61844 records to 43032 (keeping 200 days of data) [2025-09-25T17:55:28.704948] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-25T17:55:28.915741] [DEBUG] [LOCAL ] CDP: Primary data saved (43032 records). [2025-09-25T17:55:28.915876] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-25T17:55:28.916025] [INFO ] [MAIN ] Update Progress: 421/2372 symbols completed. CDP took 29.5s. Estimated remaining: 4h 16m 53s. Rate: 7.6 symbols/min [2025-09-25T17:55:29.087105] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:29.097954] [DEBUG] [LOCAL ] CEE: Loaded 6649 existing records from primary storage. [2025-09-25T17:55:29.098085] [INFO ] [MAIN ] CEE: Loaded 6649 existing records. [2025-09-25T17:55:29.288119] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:29.288470] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-25T17:55:29.288528] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-25T17:55:29.288774] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-25T17:55:29.288834] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-25T17:55:29.498539] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-25T17:55:29.665115] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:29.725352] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T17:55:30.288700] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-25T17:55:30.364940] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:55:30.557120] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T17:55:31.088734] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-25T17:55:31.888757] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-25T17:55:32.088858] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T17:55:32.688696] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-25T17:55:32.729375] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-25T17:55:32.739777] [INFO ] [REMOTE ] CDE: Full fetch complete (77578 records). [2025-09-25T17:55:32.739934] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-25T17:55:33.155205] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-25T17:55:33.155343] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-25T17:55:33.156243] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-25T17:55:33.156313] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-25T17:55:33.157898] [DEBUG] [LOCAL ] CDE: Trimmed 77578 records to 54031 (keeping 200 days of data) [2025-09-25T17:55:33.489569] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-25T17:55:33.491012] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T17:55:33.528360] [DEBUG] [LOCAL ] CDE: Primary data saved (54031 records). [2025-09-25T17:55:33.528510] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-25T17:55:33.528596] [INFO ] [MAIN ] Update Progress: 422/2372 symbols completed. CDE took 47.9s. Estimated remaining: 4h 16m 30s. Rate: 7.6 symbols/min [2025-09-25T17:55:33.716042] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:33.749460] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T17:55:33.764629] [DEBUG] [LOCAL ] CEPU: Loaded 26053 existing records from primary storage. [2025-09-25T17:55:33.764804] [INFO ] [MAIN ] CEPU: Loaded 26053 existing records. [2025-09-25T17:55:33.968068] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:33.968325] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-25T17:55:33.968432] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-25T17:55:33.968764] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-25T17:55:33.968824] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-25T17:55:34.258567] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T17:55:34.293838] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-25T17:55:34.413728] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:35.088723] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-25T17:55:35.399251] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T17:55:35.404632] [INFO ] [REMOTE ] CDRE: Full fetch complete (35467 records). [2025-09-25T17:55:35.404754] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-25T17:55:35.793066] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-25T17:55:35.793181] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-25T17:55:35.793695] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-25T17:55:35.793757] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-25T17:55:35.794610] [DEBUG] [LOCAL ] CDRE: Trimmed 35467 records to 25608 (keeping 200 days of data) [2025-09-25T17:55:35.888892] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-25T17:55:35.954675] [DEBUG] [LOCAL ] CDRE: Primary data saved (25608 records). [2025-09-25T17:55:35.954822] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-25T17:55:35.954917] [INFO ] [MAIN ] Update Progress: 423/2372 symbols completed. CDRE took 32.0s. Estimated remaining: 4h 15m 57s. Rate: 7.6 symbols/min [2025-09-25T17:55:36.128122] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:36.181248] [DEBUG] [LOCAL ] CF: Loaded 52229 existing records from primary storage. [2025-09-25T17:55:36.181390] [INFO ] [MAIN ] CF: Loaded 52229 existing records. [2025-09-25T17:55:36.369497] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:36.369880] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-25T17:55:36.369951] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-25T17:55:36.370279] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-25T17:55:36.370340] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-25T17:55:36.690498] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-25T17:55:36.784122] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:36.816609] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:55:36.977040] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T17:55:37.163420] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T17:55:37.488750] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-25T17:55:38.157536] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T17:55:38.288687] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-25T17:55:39.088732] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-25T17:55:39.888762] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-25T17:55:39.975678] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:55:40.014288] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T17:55:40.688761] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-25T17:55:41.427974] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T17:55:41.488690] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-25T17:55:41.982211] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T17:55:42.288786] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-25T17:55:43.011535] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T17:55:43.088727] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-25T17:55:43.888677] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-25T17:55:44.158476] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T17:55:44.291093] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T17:55:44.615116] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T17:55:44.688750] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-25T17:55:45.264923] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T17:55:45.488718] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-25T17:55:46.027493] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T17:55:46.288753] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-25T17:55:47.088712] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-25T17:55:47.888836] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-25T17:55:48.042131] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T17:55:48.094985] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T17:55:48.688724] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-25T17:55:49.488746] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-25T17:55:49.579429] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T17:55:49.617578] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T17:55:49.972611] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T17:55:50.288745] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-25T17:55:51.088737] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-25T17:55:51.560124] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T17:55:51.888722] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-25T17:55:52.649905] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T17:55:52.688732] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-25T17:55:52.992879] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T17:55:53.488725] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-25T17:55:54.288708] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-25T17:55:54.694437] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T17:55:54.839240] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T17:55:54.848745] [INFO ] [REMOTE ] CE: Full fetch complete (74883 records). [2025-09-25T17:55:54.848910] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-25T17:55:55.091571] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-25T17:55:55.252316] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-25T17:55:55.252494] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-25T17:55:55.253353] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-25T17:55:55.253490] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-25T17:55:55.259539] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T17:55:55.262746] [DEBUG] [LOCAL ] CE: Trimmed 74883 records to 51931 (keeping 200 days of data) [2025-09-25T17:55:55.584434] [DEBUG] [LOCAL ] CE: Primary data saved (51931 records). [2025-09-25T17:55:55.584581] [INFO ] [MAIN ] CE: Full history saved. [2025-09-25T17:55:55.584727] [INFO ] [MAIN ] Update Progress: 424/2372 symbols completed. CE took 37.6s. Estimated remaining: 4h 16m 43s. Rate: 7.6 symbols/min [2025-09-25T17:55:55.755174] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:55:55.804907] [DEBUG] [LOCAL ] CFG: Loaded 53624 existing records from primary storage. [2025-09-25T17:55:55.805076] [INFO ] [MAIN ] CFG: Loaded 53624 existing records. [2025-09-25T17:55:55.894024] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-25T17:55:55.995316] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:55:55.995590] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-25T17:55:55.995684] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-25T17:55:55.995964] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-25T17:55:55.996023] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-25T17:55:56.368483] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:55:56.688769] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-25T17:55:56.880264] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T17:55:57.123368] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T17:55:57.488739] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-25T17:55:58.288679] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-25T17:55:58.467554] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T17:55:58.658574] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T17:55:59.088782] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-25T17:55:59.888708] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-25T17:56:00.006122] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T17:56:00.188753] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T17:56:00.195454] [INFO ] [REMOTE ] CEPU: Full fetch complete (39635 records). [2025-09-25T17:56:00.195694] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-25T17:56:00.580717] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-25T17:56:00.580818] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-25T17:56:00.581370] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-25T17:56:00.581413] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-25T17:56:00.582493] [DEBUG] [LOCAL ] CEPU: Trimmed 39635 records to 26270 (keeping 200 days of data) [2025-09-25T17:56:00.688762] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-25T17:56:00.739198] [DEBUG] [LOCAL ] CEPU: Primary data saved (26270 records). [2025-09-25T17:56:00.739353] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-25T17:56:00.739441] [INFO ] [MAIN ] Update Progress: 425/2372 symbols completed. CEPU took 27.2s. Estimated remaining: 4h 16m 22s. Rate: 7.6 symbols/min [2025-09-25T17:56:00.916381] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:00.916555] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-25T17:56:00.916712] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-25T17:56:00.916867] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-25T17:56:00.916910] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-25T17:56:00.916951] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-25T17:56:00.916983] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-25T17:56:00.996733] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T17:56:01.032528] [INFO ] [REMOTE ] CEE: Full fetch complete (10228 records). [2025-09-25T17:56:01.032710] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-25T17:56:01.493946] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-25T17:56:01.623017] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:01.734307] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-25T17:56:01.734390] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-25T17:56:01.734630] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-25T17:56:01.734706] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-25T17:56:01.735374] [DEBUG] [LOCAL ] CEE: Trimmed 10228 records to 6682 (keeping 200 days of data) [2025-09-25T17:56:01.774898] [DEBUG] [LOCAL ] CEE: Primary data saved (6682 records). [2025-09-25T17:56:01.775044] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-25T17:56:01.775135] [INFO ] [MAIN ] Update Progress: 426/2372 symbols completed. CEE took 32.9s. Estimated remaining: 4h 15m 43s. Rate: 7.6 symbols/min [2025-09-25T17:56:01.954755] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:01.994015] [DEBUG] [LOCAL ] CFR: Loaded 33520 existing records from primary storage. [2025-09-25T17:56:01.994168] [INFO ] [MAIN ] CFR: Loaded 33520 existing records. [2025-09-25T17:56:02.185598] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:02.185879] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-25T17:56:02.185925] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-25T17:56:02.186186] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-25T17:56:02.186245] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-25T17:56:02.291806] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-25T17:56:02.536053] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:02.545977] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-25T17:56:02.568410] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:02.600409] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T17:56:03.080492] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T17:56:03.090505] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-25T17:56:03.888733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-25T17:56:04.688720] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-25T17:56:05.066387] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T17:56:05.488688] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-25T17:56:05.527281] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T17:56:05.684214] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:05.684555] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-25T17:56:06.116465] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T17:56:06.288738] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-25T17:56:06.511211] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:06.511536] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-25T17:56:07.088733] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-25T17:56:07.888718] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-25T17:56:08.107394] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:08.107776] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-25T17:56:08.688683] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-25T17:56:08.931786] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:08.932361] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-25T17:56:08.934433] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T17:56:08.944246] [INFO ] [REMOTE ] CF: Full fetch complete (75165 records). [2025-09-25T17:56:08.944413] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-25T17:56:09.344167] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-25T17:56:09.344249] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-25T17:56:09.345072] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-25T17:56:09.345139] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-25T17:56:09.346673] [DEBUG] [LOCAL ] CF: Trimmed 75165 records to 52619 (keeping 200 days of data) [2025-09-25T17:56:09.533910] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-25T17:56:09.682393] [DEBUG] [LOCAL ] CF: Primary data saved (52619 records). [2025-09-25T17:56:09.682545] [INFO ] [MAIN ] CF: Full history saved. [2025-09-25T17:56:09.682635] [INFO ] [MAIN ] Update Progress: 427/2372 symbols completed. CF took 33.7s. Estimated remaining: 4h 15m 35s. Rate: 7.6 symbols/min [2025-09-25T17:56:09.783917] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:09.786981] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-25T17:56:09.882156] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:09.929750] [DEBUG] [LOCAL ] CGAU: Loaded 42718 existing records from primary storage. [2025-09-25T17:56:09.930209] [INFO ] [MAIN ] CGAU: Loaded 42718 existing records. [2025-09-25T17:56:10.110465] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:10.110864] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-25T17:56:10.110938] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-25T17:56:10.111395] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-25T17:56:10.111455] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-25T17:56:10.295098] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-25T17:56:10.478464] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:11.088783] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-25T17:56:11.888692] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-25T17:56:12.015338] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T17:56:12.080224] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:12.080515] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-25T17:56:12.545267] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T17:56:12.688718] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-25T17:56:12.928359] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:56:12.928694] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-25T17:56:13.488829] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-25T17:56:14.288749] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-25T17:56:14.862110] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T17:56:15.088720] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-25T17:56:15.550532] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T17:56:15.888718] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-25T17:56:16.224284] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T17:56:16.688711] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-25T17:56:17.437276] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T17:56:17.488729] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-25T17:56:17.597576] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T17:56:18.288731] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-25T17:56:19.088705] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-25T17:56:19.360687] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T17:56:19.767032] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T17:56:19.888733] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-25T17:56:20.363779] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T17:56:20.688707] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-25T17:56:21.488744] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-25T17:56:21.668626] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T17:56:21.669342] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T17:56:21.681487] [INFO ] [REMOTE ] CFND: Full fetch complete (2569 records). [2025-09-25T17:56:21.681559] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-25T17:56:21.882174] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-25T17:56:21.882402] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:56:21.882481] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:56:21.882566] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-25T17:56:21.882669] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-25T17:56:21.882780] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-25T17:56:21.882867] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-25T17:56:21.882976] [INFO ] [MAIN ] Update Progress: 428/2372 symbols completed. CFND took 21.1s. Estimated remaining: 4h 15m 47s. Rate: 7.6 symbols/min [2025-09-25T17:56:22.058507] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:22.062966] [DEBUG] [LOCAL ] CGV: Loaded 1403 existing records from primary storage. [2025-09-25T17:56:22.063046] [INFO ] [MAIN ] CGV: Loaded 1403 existing records. [2025-09-25T17:56:22.239169] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:22.239407] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-25T17:56:22.239459] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-25T17:56:22.239736] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-25T17:56:22.239795] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-25T17:56:22.293975] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-25T17:56:22.601842] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:23.094886] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-25T17:56:23.111364] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T17:56:23.824313] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T17:56:23.880769] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T17:56:23.888689] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-25T17:56:24.333045] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T17:56:24.688795] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-25T17:56:25.131592] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T17:56:25.488734] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-25T17:56:26.288727] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-25T17:56:27.088725] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-25T17:56:27.317673] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T17:56:27.888705] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-25T17:56:28.031722] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T17:56:28.253941] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-25T17:56:28.489529] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:56:28.688695] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-25T17:56:29.111638] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-25T17:56:29.488811] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-25T17:56:29.898770] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T17:56:30.288744] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-25T17:56:31.088731] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-25T17:56:31.417396] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T17:56:31.888743] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-25T17:56:32.324278] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T17:56:32.688752] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-25T17:56:33.284964] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T17:56:33.488715] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-25T17:56:34.190727] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T17:56:34.288733] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-25T17:56:34.814179] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T17:56:34.827597] [INFO ] [REMOTE ] CFG: Full fetch complete (77575 records). [2025-09-25T17:56:34.827796] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-25T17:56:35.093878] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-25T17:56:35.261248] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-25T17:56:35.261334] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-25T17:56:35.262175] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-25T17:56:35.262268] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-25T17:56:35.263924] [DEBUG] [LOCAL ] CFG: Trimmed 77575 records to 54014 (keeping 200 days of data) [2025-09-25T17:56:35.631803] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T17:56:35.636772] [DEBUG] [LOCAL ] CFG: Primary data saved (54014 records). [2025-09-25T17:56:35.636879] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-25T17:56:35.637028] [INFO ] [MAIN ] Update Progress: 429/2372 symbols completed. CFG took 40.1s. Estimated remaining: 4h 16m 6s. Rate: 7.6 symbols/min [2025-09-25T17:56:35.845603] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:35.841805] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T17:56:35.880269] [DEBUG] [LOCAL ] CHCT: Loaded 23991 existing records from primary storage. [2025-09-25T17:56:35.880400] [INFO ] [MAIN ] CHCT: Loaded 23991 existing records. [2025-09-25T17:56:35.893900] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-25T17:56:36.067478] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:36.067870] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-25T17:56:36.067960] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-25T17:56:36.068487] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-25T17:56:36.068574] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-25T17:56:36.350053] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T17:56:36.440858] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:36.688694] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-25T17:56:37.079557] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-25T17:56:37.488721] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-25T17:56:38.288838] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-25T17:56:38.920827] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T17:56:39.088722] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-25T17:56:39.856295] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T17:56:39.888664] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-25T17:56:40.497120] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T17:56:40.688743] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-25T17:56:41.135556] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T17:56:41.136490] [INFO ] [REMOTE ] CGV: Full fetch complete (2297 records). [2025-09-25T17:56:41.136559] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-25T17:56:41.504452] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-25T17:56:41.511587] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-25T17:56:41.511773] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-25T17:56:41.512813] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-25T17:56:41.512892] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-25T17:56:41.513452] [DEBUG] [LOCAL ] CGV: Trimmed 2297 records to 1421 (keeping 200 days of data) [2025-09-25T17:56:41.547480] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T17:56:41.546535] [DEBUG] [LOCAL ] CGV: Primary data saved (1421 records). [2025-09-25T17:56:41.556057] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-25T17:56:41.556278] [INFO ] [MAIN ] Update Progress: 430/2372 symbols completed. CGV took 19.7s. Estimated remaining: 4h 15m 49s. Rate: 7.6 symbols/min [2025-09-25T17:56:41.556694] [INFO ] [REMOTE ] CGAU: Full fetch complete (60625 records). [2025-09-25T17:56:41.600236] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-25T17:56:41.907020] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:42.166187] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-25T17:56:42.166287] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-25T17:56:42.167045] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-25T17:56:42.167126] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-25T17:56:42.183738] [DEBUG] [LOCAL ] CGAU: Trimmed 60625 records to 43062 (keeping 200 days of data) [2025-09-25T17:56:42.204670] [DEBUG] [LOCAL ] CHD: Loaded 52017 existing records from primary storage. [2025-09-25T17:56:42.204845] [INFO ] [MAIN ] CHD: Loaded 52017 existing records. [2025-09-25T17:56:42.307209] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-25T17:56:42.519929] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:42.530042] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-25T17:56:42.530283] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-25T17:56:42.530791] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-25T17:56:42.530852] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-25T17:56:42.935614] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T17:56:43.036621] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:43.078521] [DEBUG] [LOCAL ] CGAU: Primary data saved (43062 records). [2025-09-25T17:56:43.078703] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-25T17:56:43.078858] [INFO ] [MAIN ] Update Progress: 431/2372 symbols completed. CGAU took 33.4s. Estimated remaining: 4h 15m 12s. Rate: 7.6 symbols/min [2025-09-25T17:56:43.093871] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-25T17:56:43.259939] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:43.279462] [DEBUG] [LOCAL ] CHE: Loaded 14812 existing records from primary storage. [2025-09-25T17:56:43.279596] [INFO ] [MAIN ] CHE: Loaded 14812 existing records. [2025-09-25T17:56:43.465240] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:43.465813] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-25T17:56:43.466034] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-25T17:56:43.466514] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-25T17:56:43.466580] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-25T17:56:43.729343] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T17:56:43.785334] [INFO ] [REMOTE ] CFR: Full fetch complete (48516 records). [2025-09-25T17:56:43.785527] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-25T17:56:43.892523] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-25T17:56:43.972804] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:44.281238] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T17:56:44.280735] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-25T17:56:44.285992] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-25T17:56:44.286992] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-25T17:56:44.287079] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-25T17:56:44.288482] [DEBUG] [LOCAL ] CFR: Trimmed 48516 records to 33773 (keeping 200 days of data) [2025-09-25T17:56:44.517702] [DEBUG] [LOCAL ] CFR: Primary data saved (33773 records). [2025-09-25T17:56:44.517883] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-25T17:56:44.518059] [INFO ] [MAIN ] Update Progress: 432/2372 symbols completed. CFR took 42.7s. Estimated remaining: 4h 14m 35s. Rate: 7.6 symbols/min [2025-09-25T17:56:44.693065] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:56:44.693145] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-25T17:56:44.744049] [DEBUG] [LOCAL ] CHGG: Loaded 47701 existing records from primary storage. [2025-09-25T17:56:44.744200] [INFO ] [MAIN ] CHGG: Loaded 47701 existing records. [2025-09-25T17:56:44.923099] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:56:44.923334] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-25T17:56:44.923381] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-25T17:56:44.923697] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-25T17:56:44.923764] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-25T17:56:45.287525] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:56:45.488683] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-25T17:56:45.578482] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T17:56:45.772033] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T17:56:46.271359] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T17:56:46.288668] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-25T17:56:47.088727] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-25T17:56:47.837360] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T17:56:47.893792] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-25T17:56:47.901840] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T17:56:48.688743] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-25T17:56:49.432613] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:56:49.488715] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-25T17:56:49.537825] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T17:56:50.288730] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-25T17:56:51.088697] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-25T17:56:51.191023] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T17:56:51.487868] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T17:56:51.888686] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-25T17:56:52.119332] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T17:56:52.473523] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T17:56:52.688759] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-25T17:56:53.488704] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-25T17:56:53.858521] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T17:56:54.288767] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-25T17:56:54.406727] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T17:56:55.088696] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-25T17:56:55.194721] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T17:56:55.888728] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-25T17:56:56.688698] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-25T17:56:56.926024] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T17:56:57.443293] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T17:56:57.488666] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-25T17:56:57.893138] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T17:56:58.288770] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-25T17:56:59.088696] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-25T17:56:59.149446] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T17:56:59.524272] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T17:56:59.888731] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-25T17:57:00.034793] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T17:57:00.688714] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-25T17:57:01.126097] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T17:57:01.132770] [INFO ] [REMOTE ] CHCT: Full fetch complete (34997 records). [2025-09-25T17:57:01.132901] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-25T17:57:01.492472] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-25T17:57:01.527453] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-25T17:57:01.527671] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-25T17:57:01.528336] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-25T17:57:01.528554] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-25T17:57:01.529761] [DEBUG] [LOCAL ] CHCT: Trimmed 34997 records to 24167 (keeping 200 days of data) [2025-09-25T17:57:01.668192] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T17:57:01.706093] [DEBUG] [LOCAL ] CHCT: Primary data saved (24167 records). [2025-09-25T17:57:01.706240] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-25T17:57:01.706332] [INFO ] [MAIN ] Update Progress: 433/2372 symbols completed. CHCT took 26.1s. Estimated remaining: 4h 15m 9s. Rate: 7.6 symbols/min [2025-09-25T17:57:01.886686] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:01.925172] [DEBUG] [LOCAL ] CHH: Loaded 32181 existing records from primary storage. [2025-09-25T17:57:01.925334] [INFO ] [MAIN ] CHH: Loaded 32181 existing records. [2025-09-25T17:57:02.135421] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:02.135749] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-25T17:57:02.135807] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-25T17:57:02.136048] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-25T17:57:02.136107] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-25T17:57:02.299043] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-25T17:57:02.513196] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:03.088695] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-25T17:57:03.302599] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T17:57:03.712484] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T17:57:03.888683] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-25T17:57:03.938288] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T17:57:04.688734] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-25T17:57:04.702704] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T17:57:05.488721] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-25T17:57:06.153777] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T17:57:06.288757] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-25T17:57:07.088781] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-25T17:57:07.540237] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T17:57:07.598861] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T17:57:07.888729] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-25T17:57:08.413038] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T17:57:08.688736] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-25T17:57:09.488724] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-25T17:57:09.677828] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T17:57:10.022709] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T17:57:10.288749] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-25T17:57:10.475059] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T17:57:11.088736] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-25T17:57:11.888732] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-25T17:57:11.948263] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T17:57:12.226495] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T17:57:12.230395] [INFO ] [REMOTE ] CHE: Full fetch complete (19739 records). [2025-09-25T17:57:12.230511] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-25T17:57:12.603509] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-25T17:57:12.603591] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-25T17:57:12.604043] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-25T17:57:12.604109] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-25T17:57:12.604812] [DEBUG] [LOCAL ] CHE: Trimmed 19739 records to 14915 (keeping 200 days of data) [2025-09-25T17:57:12.688709] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-25T17:57:12.709394] [DEBUG] [LOCAL ] CHE: Primary data saved (14915 records). [2025-09-25T17:57:12.709513] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-25T17:57:12.709609] [INFO ] [MAIN ] Update Progress: 434/2372 symbols completed. CHE took 29.6s. Estimated remaining: 4h 15m 15s. Rate: 7.6 symbols/min [2025-09-25T17:57:12.884746] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:12.907488] [DEBUG] [LOCAL ] CHMI: Loaded 22062 existing records from primary storage. [2025-09-25T17:57:12.907624] [INFO ] [MAIN ] CHMI: Loaded 22062 existing records. [2025-09-25T17:57:13.089832] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:13.090412] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-25T17:57:13.090562] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-25T17:57:13.090876] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-25T17:57:13.090949] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-25T17:57:13.213700] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T17:57:13.475233] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:13.488665] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-25T17:57:14.288739] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-25T17:57:14.731139] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T17:57:14.757309] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T17:57:15.088713] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-25T17:57:15.888710] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-25T17:57:16.443266] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T17:57:16.680696] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T17:57:16.689621] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-25T17:57:17.007418] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T17:57:17.488748] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-25T17:57:18.288737] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-25T17:57:18.333472] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T17:57:18.891203] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T17:57:19.088751] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-25T17:57:19.874004] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T17:57:19.888670] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-25T17:57:20.131766] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T17:57:20.688720] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-25T17:57:21.399473] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T17:57:21.409938] [INFO ] [REMOTE ] CHD: Full fetch complete (74383 records). [2025-09-25T17:57:21.410072] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-25T17:57:21.493910] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-25T17:57:21.822380] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-25T17:57:21.822522] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-25T17:57:21.823439] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-25T17:57:21.823510] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-25T17:57:21.825396] [DEBUG] [LOCAL ] CHD: Trimmed 74383 records to 52397 (keeping 200 days of data) [2025-09-25T17:57:22.182030] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T17:57:22.200856] [DEBUG] [LOCAL ] CHD: Primary data saved (52397 records). [2025-09-25T17:57:22.201040] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-25T17:57:22.201150] [INFO ] [MAIN ] Update Progress: 435/2372 symbols completed. CHD took 40.6s. Estimated remaining: 4h 15m 14s. Rate: 7.6 symbols/min [2025-09-25T17:57:22.293799] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-25T17:57:22.391910] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:22.399995] [DEBUG] [LOCAL ] CHN: Loaded 4808 existing records from primary storage. [2025-09-25T17:57:22.400115] [INFO ] [MAIN ] CHN: Loaded 4808 existing records. [2025-09-25T17:57:22.590915] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:22.592239] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T17:57:22.596533] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-25T17:57:22.597281] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-25T17:57:22.597471] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-25T17:57:22.597537] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-25T17:57:23.019006] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:23.088734] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-25T17:57:23.888742] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-25T17:57:24.227635] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T17:57:24.502258] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-25T17:57:24.511330] [INFO ] [REMOTE ] CHGG: Full fetch complete (70638 records). [2025-09-25T17:57:24.511468] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-25T17:57:24.705453] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-25T17:57:24.924026] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-25T17:57:24.924277] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-25T17:57:24.925221] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-25T17:57:24.925323] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-25T17:57:24.927337] [DEBUG] [LOCAL ] CHGG: Trimmed 70638 records to 48072 (keeping 200 days of data) [2025-09-25T17:57:25.038248] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T17:57:25.233311] [DEBUG] [LOCAL ] CHGG: Primary data saved (48072 records). [2025-09-25T17:57:25.233453] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-25T17:57:25.234272] [INFO ] [MAIN ] Update Progress: 436/2372 symbols completed. CHGG took 40.7s. Estimated remaining: 4h 14m 45s. Rate: 7.6 symbols/min [2025-09-25T17:57:25.418432] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:25.470152] [DEBUG] [LOCAL ] CHPT: Loaded 49274 existing records from primary storage. [2025-09-25T17:57:25.470315] [INFO ] [MAIN ] CHPT: Loaded 49274 existing records. [2025-09-25T17:57:25.493940] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-25T17:57:25.672300] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:25.672623] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-25T17:57:25.672893] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-25T17:57:25.673392] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-25T17:57:25.673478] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-25T17:57:26.070870] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:26.288733] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-25T17:57:26.365010] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T17:57:26.735263] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T17:57:26.741178] [INFO ] [REMOTE ] CHH: Full fetch complete (46430 records). [2025-09-25T17:57:26.741344] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-25T17:57:27.095156] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-25T17:57:27.132845] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-25T17:57:27.132927] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-25T17:57:27.133497] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-25T17:57:27.133538] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-25T17:57:27.134606] [DEBUG] [LOCAL ] CHH: Trimmed 46430 records to 32491 (keeping 200 days of data) [2025-09-25T17:57:27.342439] [DEBUG] [LOCAL ] CHH: Primary data saved (32491 records). [2025-09-25T17:57:27.342583] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-25T17:57:27.342692] [INFO ] [MAIN ] Update Progress: 437/2372 symbols completed. CHH took 25.6s. Estimated remaining: 4h 14m 11s. Rate: 7.6 symbols/min [2025-09-25T17:57:27.882130] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T17:57:27.888674] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-25T17:57:28.402891] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-25T17:57:28.688718] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-25T17:57:29.014682] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T17:57:29.321791] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T17:57:29.488699] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-25T17:57:30.288775] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-25T17:57:30.909123] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T17:57:31.088710] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-25T17:57:31.752732] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-25T17:57:31.783461] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T17:57:31.888703] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-25T17:57:32.332069] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T17:57:32.688713] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-25T17:57:33.319053] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T17:57:33.488711] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-25T17:57:34.071535] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T17:57:34.288745] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-25T17:57:35.088771] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-25T17:57:35.691819] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T17:57:35.888731] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-25T17:57:36.459996] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-25T17:57:36.515838] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T17:57:36.688709] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-25T17:57:37.488728] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-25T17:57:37.937346] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T17:57:38.220745] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T17:57:38.222377] [INFO ] [REMOTE ] CHN: Full fetch complete (7628 records). [2025-09-25T17:57:38.222450] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-25T17:57:38.293972] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-25T17:57:38.609352] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-25T17:57:38.609432] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-25T17:57:38.609669] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-25T17:57:38.609731] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-25T17:57:38.610144] [DEBUG] [LOCAL ] CHN: Trimmed 7628 records to 4885 (keeping 200 days of data) [2025-09-25T17:57:38.639633] [DEBUG] [LOCAL ] CHN: Primary data saved (4885 records). [2025-09-25T17:57:38.639752] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-25T17:57:38.639843] [INFO ] [MAIN ] Update Progress: 438/2372 symbols completed. CHN took 16.4s. Estimated remaining: 4h 14m 18s. Rate: 7.6 symbols/min [2025-09-25T17:57:39.088757] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-25T17:57:40.074190] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T17:57:40.079088] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-25T17:57:40.865007] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-25T17:57:40.876529] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-25T17:57:41.151519] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T17:57:41.488766] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-25T17:57:42.382900] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T17:57:42.389630] [INFO ] [REMOTE ] CHMI: Full fetch complete (31635 records). [2025-09-25T17:57:42.389928] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-25T17:57:42.834736] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-25T17:57:42.834896] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-25T17:57:42.835690] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-25T17:57:42.835771] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-25T17:57:42.837084] [DEBUG] [LOCAL ] CHMI: Trimmed 31635 records to 22183 (keeping 200 days of data) [2025-09-25T17:57:42.966770] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T17:57:42.983766] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-25T17:57:43.025436] [DEBUG] [LOCAL ] CHMI: Primary data saved (22183 records). [2025-09-25T17:57:43.025630] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-25T17:57:43.025806] [INFO ] [MAIN ] Update Progress: 439/2372 symbols completed. CHMI took 30.3s. Estimated remaining: 4h 13m 55s. Rate: 7.6 symbols/min [2025-09-25T17:57:45.101899] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T17:57:45.114697] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-25T17:57:47.222402] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-25T17:57:47.234098] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-25T17:57:49.589467] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-25T17:57:49.602872] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-25T17:57:51.422151] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T17:57:51.432199] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-25T17:57:53.186395] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T17:57:53.194863] [INFO ] [REMOTE ] CHPT: Full fetch complete (73253 records). [2025-09-25T17:57:53.195129] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-25T17:57:53.618617] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-25T17:57:53.618804] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-25T17:57:53.620000] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-25T17:57:53.620074] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-25T17:57:53.622371] [DEBUG] [LOCAL ] CHPT: Trimmed 73253 records to 49531 (keeping 200 days of data) [2025-09-25T17:57:53.956072] [DEBUG] [LOCAL ] CHPT: Primary data saved (49531 records). [2025-09-25T17:57:53.956311] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-25T17:57:53.957127] [INFO ] [MAIN ] Update Progress: 440/2372 symbols completed. CHPT took 28.7s. Estimated remaining: 4h 14m 1s. Rate: 7.6 symbols/min [2025-09-25T17:57:54.638275] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:54.742820] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:54.806179] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:54.880397] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:57:54.891997] [DEBUG] [LOCAL ] CHT: Loaded 19530 existing records from primary storage. [2025-09-25T17:57:54.898542] [INFO ] [MAIN ] CHT: Loaded 19530 existing records. [2025-09-25T17:57:55.012818] [DEBUG] [LOCAL ] CIA: Loaded 17021 existing records from primary storage. [2025-09-25T17:57:55.013135] [INFO ] [MAIN ] CIA: Loaded 17021 existing records. [2025-09-25T17:57:55.189010] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-09-25T17:57:55.251977] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-09-25T17:57:55.338165] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:55.432359] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-25T17:57:55.432671] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-25T17:57:55.431805] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:55.467782] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-25T17:57:55.473212] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-25T17:57:55.500720] [DEBUG] [LOCAL ] CI: Loaded 49852 existing records from primary storage. [2025-09-25T17:57:55.473399] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-25T17:57:55.479833] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-25T17:57:55.506369] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-25T17:57:55.506563] [INFO ] [MAIN ] CI: Loaded 49852 existing records. [2025-09-25T17:57:55.522267] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-25T17:57:55.999857] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:56.023120] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-25T17:57:56.060721] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-25T17:57:56.258210] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-25T17:57:56.266305] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:57:56.424033] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-25T17:57:56.372365] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-25T17:57:56.462633] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-25T17:57:56.544491] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-25T17:57:56.582678] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-25T17:57:56.906228] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:56.892857] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:56.946675] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-25T17:57:56.946288] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-25T17:57:57.535361] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:57.535873] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-25T17:57:57.529780] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:57:57.537750] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-25T17:57:58.104610] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T17:57:58.108295] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-25T17:57:58.119804] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T17:57:58.124130] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-25T17:57:58.870950] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T17:57:58.875447] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-25T17:57:59.012509] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T17:57:59.016343] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-25T17:57:59.183145] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T17:57:59.193460] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-25T17:57:59.504470] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T17:57:59.510729] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-25T17:57:59.689999] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-25T17:57:59.700841] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-25T17:57:59.915400] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T17:57:59.919072] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-25T17:58:00.293376] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T17:58:00.299726] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-25T17:58:00.886493] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T17:58:00.891210] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-25T17:58:01.110711] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T17:58:01.126722] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-25T17:58:01.450633] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T17:58:01.456528] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-25T17:58:01.541285] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T17:58:01.545430] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-25T17:58:01.636374] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T17:58:01.647433] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-25T17:58:02.127091] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T17:58:02.134697] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-25T17:58:02.460215] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T17:58:02.473942] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-25T17:58:02.491829] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T17:58:02.501531] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-25T17:58:02.904370] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T17:58:03.088795] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-25T17:58:03.175562] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T17:58:03.315347] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T17:58:03.888775] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-25T17:58:04.105900] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T17:58:04.128752] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T17:58:04.688709] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-25T17:58:05.488705] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-25T17:58:05.696436] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T17:58:05.763944] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T17:58:06.288721] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-25T17:58:06.323142] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T17:58:07.088756] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-25T17:58:07.232977] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T17:58:07.236820] [INFO ] [REMOTE ] CHT: Full fetch complete (27296 records). [2025-09-25T17:58:07.236942] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-25T17:58:07.614394] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-25T17:58:07.614491] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-25T17:58:07.614969] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-25T17:58:07.615034] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-25T17:58:07.615904] [DEBUG] [LOCAL ] CHT: Trimmed 27296 records to 19677 (keeping 200 days of data) [2025-09-25T17:58:07.738399] [DEBUG] [LOCAL ] CHT: Primary data saved (19677 records). [2025-09-25T17:58:07.738558] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-25T17:58:07.738686] [INFO ] [MAIN ] Update Progress: 441/2372 symbols completed. CHT took 13.8s. Estimated remaining: 4h 14m 18s. Rate: 7.6 symbols/min [2025-09-25T17:58:07.909429] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-25T17:58:07.913250] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:07.948840] [DEBUG] [LOCAL ] CIB: Loaded 31023 existing records from primary storage. [2025-09-25T17:58:07.948986] [INFO ] [MAIN ] CIB: Loaded 31023 existing records. [2025-09-25T17:58:08.129479] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:58:08.129759] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-25T17:58:08.129819] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-25T17:58:08.130074] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-25T17:58:08.130132] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-25T17:58:08.490017] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:08.688721] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-25T17:58:08.817513] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T17:58:08.931018] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T17:58:09.488776] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-25T17:58:10.288781] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-25T17:58:10.511099] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T17:58:10.598738] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T17:58:11.089983] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-25T17:58:11.888690] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-25T17:58:12.052021] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T17:58:12.128904] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T17:58:12.131966] [INFO ] [REMOTE ] CIA: Full fetch complete (23393 records). [2025-09-25T17:58:12.132047] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-25T17:58:12.510138] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-25T17:58:12.510219] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-25T17:58:12.510628] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-25T17:58:12.510704] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-25T17:58:12.511367] [DEBUG] [LOCAL ] CIA: Trimmed 23393 records to 17101 (keeping 200 days of data) [2025-09-25T17:58:12.606447] [DEBUG] [LOCAL ] CIA: Primary data saved (17101 records). [2025-09-25T17:58:12.606589] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-25T17:58:12.606697] [INFO ] [MAIN ] Update Progress: 442/2372 symbols completed. CIA took 18.6s. Estimated remaining: 4h 13m 57s. Rate: 7.6 symbols/min [2025-09-25T17:58:12.693953] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-25T17:58:12.783549] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:12.783712] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-25T17:58:12.783763] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-25T17:58:12.783903] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-25T17:58:12.783946] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-25T17:58:12.783988] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-25T17:58:12.784020] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-25T17:58:13.151718] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:13.488709] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-25T17:58:13.717879] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T17:58:13.928975] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T17:58:14.129635] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T17:58:14.288698] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-25T17:58:14.645737] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-25T17:58:15.088730] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-25T17:58:15.888724] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-25T17:58:16.252639] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T17:58:16.688741] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-25T17:58:16.879240] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T17:58:17.092022] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T17:58:17.488719] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-25T17:58:18.288763] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-25T17:58:18.866892] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T17:58:19.088766] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-25T17:58:19.518039] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-25T17:58:19.888731] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-25T17:58:20.321566] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T17:58:20.688729] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-25T17:58:21.446914] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T17:58:21.488726] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-25T17:58:21.842559] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T17:58:22.288689] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-25T17:58:22.324299] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T17:58:22.696519] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-25T17:58:23.088715] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-25T17:58:23.888742] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-25T17:58:24.688697] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-25T17:58:24.965169] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T17:58:25.488760] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-25T17:58:25.777273] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T17:58:25.862371] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T17:58:25.872152] [INFO ] [REMOTE ] CHWY: Full fetch complete (77635 records). [2025-09-25T17:58:25.872296] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-25T17:58:26.270730] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-25T17:58:26.270835] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-25T17:58:26.271775] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-25T17:58:26.271852] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-25T17:58:26.273574] [DEBUG] [LOCAL ] CHWY: Trimmed 77635 records to 54044 (keeping 200 days of data) [2025-09-25T17:58:26.326912] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-25T17:58:26.612106] [DEBUG] [LOCAL ] CHWY: Primary data saved (54044 records). [2025-09-25T17:58:26.612268] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-25T17:58:26.612362] [INFO ] [MAIN ] Update Progress: 443/2372 symbols completed. CHWY took 32.7s. Estimated remaining: 4h 14m 16s. Rate: 7.6 symbols/min [2025-09-25T17:58:26.798565] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:26.855324] [DEBUG] [LOCAL ] CIEN: Loaded 52083 existing records from primary storage. [2025-09-25T17:58:26.855479] [INFO ] [MAIN ] CIEN: Loaded 52083 existing records. [2025-09-25T17:58:26.933545] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T17:58:27.065326] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:58:27.065925] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-25T17:58:27.066002] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-25T17:58:27.066529] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-25T17:58:27.066612] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-25T17:58:27.097695] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-25T17:58:27.254459] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T17:58:27.541251] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:27.888712] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-25T17:58:28.495602] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T17:58:28.688704] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-25T17:58:29.488696] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-25T17:58:29.604516] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T17:58:29.613592] [INFO ] [REMOTE ] CI: Full fetch complete (72543 records). [2025-09-25T17:58:29.613760] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-25T17:58:29.798791] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-25T17:58:30.028120] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-25T17:58:30.028205] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-25T17:58:30.029163] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-25T17:58:30.029342] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-25T17:58:30.030910] [DEBUG] [LOCAL ] CI: Trimmed 72543 records to 50220 (keeping 200 days of data) [2025-09-25T17:58:30.148416] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T17:58:30.288789] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-25T17:58:30.387886] [DEBUG] [LOCAL ] CI: Primary data saved (50220 records). [2025-09-25T17:58:30.388034] [INFO ] [MAIN ] CI: Full history saved. [2025-09-25T17:58:30.389336] [INFO ] [MAIN ] Update Progress: 444/2372 symbols completed. CI took 36.4s. Estimated remaining: 4h 13m 50s. Rate: 7.6 symbols/min [2025-09-25T17:58:30.560565] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:30.568192] [DEBUG] [LOCAL ] CIF: Loaded 4350 existing records from primary storage. [2025-09-25T17:58:30.568327] [INFO ] [MAIN ] CIF: Loaded 4350 existing records. [2025-09-25T17:58:30.754693] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:58:30.754979] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-25T17:58:30.755029] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-25T17:58:30.755210] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-25T17:58:30.755271] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-25T17:58:31.112402] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-25T17:58:31.117959] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:31.888688] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-25T17:58:32.158992] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T17:58:32.536298] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T17:58:32.537534] [INFO ] [REMOTE ] CICB: Full fetch complete (2116 records). [2025-09-25T17:58:32.549931] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-25T17:58:32.558327] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:58:32.560692] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T17:58:32.559101] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:58:32.567931] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:58:32.568032] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-25T17:58:32.568166] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-25T17:58:32.568556] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-25T17:58:32.568618] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-25T17:58:32.568741] [INFO ] [MAIN ] Update Progress: 445/2372 symbols completed. CICB took 20.0s. Estimated remaining: 4h 13m 18s. Rate: 7.6 symbols/min [2025-09-25T17:58:32.693805] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-25T17:58:32.751510] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:32.794880] [DEBUG] [LOCAL ] CIG: Loaded 43740 existing records from primary storage. [2025-09-25T17:58:32.795036] [INFO ] [MAIN ] CIG: Loaded 43740 existing records. [2025-09-25T17:58:32.979944] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:58:32.980211] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-25T17:58:32.980262] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-25T17:58:32.980489] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-25T17:58:32.980549] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-25T17:58:33.348488] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:33.488720] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-25T17:58:33.809890] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T17:58:34.288773] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-25T17:58:35.019702] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T17:58:35.024980] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T17:58:35.088737] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-25T17:58:35.888773] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-25T17:58:36.438911] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-25T17:58:36.688731] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-25T17:58:36.858299] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T17:58:37.308990] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T17:58:37.488715] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-25T17:58:38.288749] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-25T17:58:38.967103] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T17:58:39.088687] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-25T17:58:39.402991] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T17:58:39.888758] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-25T17:58:40.461960] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T17:58:40.688719] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-25T17:58:40.996580] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T17:58:41.488734] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-25T17:58:41.719841] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T17:58:42.288720] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-25T17:58:43.088703] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-25T17:58:43.422747] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T17:58:43.688359] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T17:58:43.888749] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-25T17:58:44.231857] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T17:58:44.237999] [INFO ] [REMOTE ] CIB: Full fetch complete (44354 records). [2025-09-25T17:58:44.238094] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-25T17:58:44.634161] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-25T17:58:44.634246] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-25T17:58:44.634860] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-25T17:58:44.634925] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-25T17:58:44.636047] [DEBUG] [LOCAL ] CIB: Trimmed 44354 records to 31225 (keeping 200 days of data) [2025-09-25T17:58:44.696746] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-25T17:58:44.829211] [DEBUG] [LOCAL ] CIB: Primary data saved (31225 records). [2025-09-25T17:58:44.829362] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-25T17:58:44.829449] [INFO ] [MAIN ] Update Progress: 446/2372 symbols completed. CIB took 37.1s. Estimated remaining: 4h 13m 29s. Rate: 7.6 symbols/min [2025-09-25T17:58:45.004224] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:58:45.021912] [DEBUG] [LOCAL ] CII: Loaded 15476 existing records from primary storage. [2025-09-25T17:58:45.022046] [INFO ] [MAIN ] CII: Loaded 15476 existing records. [2025-09-25T17:58:45.208872] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:58:45.209301] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-25T17:58:45.209373] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-25T17:58:45.209607] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-25T17:58:45.209707] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-25T17:58:45.493849] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-25T17:58:45.601506] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T17:58:45.622484] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:58:46.288758] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-25T17:58:46.335135] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T17:58:46.431293] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T17:58:47.088686] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-25T17:58:47.385928] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T17:58:47.728306] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T17:58:47.888747] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-25T17:58:48.688752] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-25T17:58:49.236104] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T17:58:49.239173] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T17:58:49.488787] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-25T17:58:50.059283] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T17:58:50.288754] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-25T17:58:51.088756] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-25T17:58:51.898592] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-25T17:58:51.904209] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T17:58:52.595136] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T17:58:52.688695] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-25T17:58:52.839409] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T17:58:53.488796] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-25T17:58:53.984964] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T17:58:54.288719] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-25T17:58:54.476181] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T17:58:55.088722] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-25T17:58:55.888694] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-25T17:58:55.982568] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T17:58:56.037867] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T17:58:56.688734] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-25T17:58:57.433996] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T17:58:57.488699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-25T17:58:57.918672] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T17:58:58.288753] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-25T17:58:59.088780] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-25T17:58:59.335508] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T17:58:59.814698] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T17:58:59.888699] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-25T17:58:59.931002] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T17:59:00.688732] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-25T17:59:01.488698] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-25T17:59:01.550447] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T17:59:01.816283] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T17:59:01.827626] [INFO ] [REMOTE ] CIEN: Full fetch complete (75565 records). [2025-09-25T17:59:01.827862] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-25T17:59:02.236229] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-25T17:59:02.236380] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-25T17:59:02.237262] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-25T17:59:02.237330] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-25T17:59:02.238955] [DEBUG] [LOCAL ] CIEN: Trimmed 75565 records to 52465 (keeping 200 days of data) [2025-09-25T17:59:02.296519] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-25T17:59:02.569153] [DEBUG] [LOCAL ] CIEN: Primary data saved (52465 records). [2025-09-25T17:59:02.569491] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-25T17:59:02.571762] [INFO ] [MAIN ] Update Progress: 447/2372 symbols completed. CIEN took 36.0s. Estimated remaining: 4h 14m 3s. Rate: 7.6 symbols/min [2025-09-25T17:59:02.756834] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:02.800214] [DEBUG] [LOCAL ] CIM: Loaded 37312 existing records from primary storage. [2025-09-25T17:59:02.800384] [INFO ] [MAIN ] CIM: Loaded 37312 existing records. [2025-09-25T17:59:02.995627] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:02.995922] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-25T17:59:02.995968] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-25T17:59:02.996808] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-25T17:59:02.996868] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-25T17:59:03.089274] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-25T17:59:03.219269] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T17:59:03.282885] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T17:59:03.337533] [INFO ] [REMOTE ] CIG: Full fetch complete (60946 records). [2025-09-25T17:59:03.358822] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-25T17:59:03.585517] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:03.890423] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-25T17:59:03.901890] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T17:59:04.040072] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-25T17:59:04.040178] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-25T17:59:04.041083] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-25T17:59:04.041186] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-25T17:59:04.044149] [DEBUG] [LOCAL ] CIG: Trimmed 60946 records to 44114 (keeping 200 days of data) [2025-09-25T17:59:04.450495] [DEBUG] [LOCAL ] CIG: Primary data saved (44114 records). [2025-09-25T17:59:04.450841] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-25T17:59:04.452569] [INFO ] [MAIN ] Update Progress: 448/2372 symbols completed. CIG took 31.9s. Estimated remaining: 4h 13m 29s. Rate: 7.6 symbols/min [2025-09-25T17:59:04.696816] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-25T17:59:04.703253] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:04.715917] [DEBUG] [LOCAL ] CIMN: Loaded 2666 existing records from primary storage. [2025-09-25T17:59:04.716096] [INFO ] [MAIN ] CIMN: Loaded 2666 existing records. [2025-09-25T17:59:04.950303] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:04.950831] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-25T17:59:04.950884] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-25T17:59:04.951203] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-25T17:59:04.951288] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-25T17:59:05.359028] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:05.386600] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T17:59:05.457198] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T17:59:05.459331] [INFO ] [REMOTE ] CIF: Full fetch complete (6600 records). [2025-09-25T17:59:05.459405] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-25T17:59:05.493940] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-25T17:59:05.826521] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-25T17:59:05.826608] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-25T17:59:05.826852] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-25T17:59:05.826930] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-25T17:59:05.827676] [DEBUG] [LOCAL ] CIF: Trimmed 6600 records to 4369 (keeping 200 days of data) [2025-09-25T17:59:05.858071] [DEBUG] [LOCAL ] CIF: Primary data saved (4369 records). [2025-09-25T17:59:05.858190] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-25T17:59:05.858305] [INFO ] [MAIN ] Update Progress: 449/2372 symbols completed. CIF took 35.5s. Estimated remaining: 4h 12m 53s. Rate: 7.6 symbols/min [2025-09-25T17:59:06.034320] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:06.034545] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-25T17:59:06.034586] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-25T17:59:06.034763] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-25T17:59:06.034810] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-25T17:59:06.034853] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-25T17:59:06.034886] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-25T17:59:06.293946] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-25T17:59:06.404414] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:06.774253] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T17:59:07.088692] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-25T17:59:07.244337] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T17:59:07.888687] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-25T17:59:07.988466] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T17:59:08.688733] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-25T17:59:09.188555] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T17:59:09.209801] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T17:59:09.488764] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-25T17:59:10.288716] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-25T17:59:10.729296] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T17:59:11.080280] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T17:59:11.088855] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-25T17:59:11.888780] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-25T17:59:12.433370] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-25T17:59:12.688694] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-25T17:59:12.725554] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T17:59:13.285814] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T17:59:13.488786] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-25T17:59:13.938569] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-25T17:59:14.288739] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-25T17:59:15.088772] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-25T17:59:15.506251] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T17:59:15.509703] [INFO ] [REMOTE ] CII: Full fetch complete (23092 records). [2025-09-25T17:59:15.509779] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-25T17:59:15.899802] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-25T17:59:15.902257] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-25T17:59:15.902318] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-25T17:59:15.902721] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-25T17:59:15.902784] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-25T17:59:15.904493] [DEBUG] [LOCAL ] CII: Trimmed 23092 records to 15570 (keeping 200 days of data) [2025-09-25T17:59:16.010796] [DEBUG] [LOCAL ] CII: Primary data saved (15570 records). [2025-09-25T17:59:16.010950] [INFO ] [MAIN ] CII: Full history saved. [2025-09-25T17:59:16.011070] [INFO ] [MAIN ] Update Progress: 450/2372 symbols completed. CII took 31.2s. Estimated remaining: 4h 12m 55s. Rate: 7.6 symbols/min [2025-09-25T17:59:16.194450] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:16.194698] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-09-25T17:59:16.194754] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-09-25T17:59:16.194912] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-09-25T17:59:16.194963] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-25T17:59:16.195005] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-25T17:59:16.195038] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-09-25T17:59:16.467498] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T17:59:16.593722] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:16.616712] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T17:59:16.688720] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-25T17:59:17.488737] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-25T17:59:18.054819] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T17:59:18.082609] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T17:59:18.288714] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-25T17:59:19.088724] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2024-12. [2025-09-25T17:59:19.388209] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:19.388510] [WARN ] [REMOTE ] CIMP: No data returned for month 2024-12 [2025-09-25T17:59:19.415405] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T17:59:19.888723] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-25T17:59:20.451034] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T17:59:20.688707] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-09-25T17:59:20.906519] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:20.906883] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-09-25T17:59:21.488719] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-25T17:59:22.048877] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T17:59:22.288731] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-25T17:59:22.746818] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T17:59:23.088730] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-02. [2025-09-25T17:59:23.298799] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:23.299178] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-02 [2025-09-25T17:59:23.888780] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-25T17:59:24.688774] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-25T17:59:25.138151] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T17:59:25.321932] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T17:59:25.488721] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-25T17:59:26.028521] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T17:59:26.288716] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-25T17:59:26.813521] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-25T17:59:27.088723] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-25T17:59:27.888730] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-25T17:59:28.298262] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-25T17:59:28.299280] [INFO ] [REMOTE ] CIMN: Full fetch complete (3895 records). [2025-09-25T17:59:28.299352] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-25T17:59:28.690108] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-03. [2025-09-25T17:59:28.699599] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-25T17:59:28.699760] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-25T17:59:28.700021] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-25T17:59:28.700231] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-25T17:59:28.708453] [DEBUG] [LOCAL ] CIMN: Trimmed 3895 records to 2678 (keeping 200 days of data) [2025-09-25T17:59:28.729300] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T17:59:28.746896] [INFO ] [REMOTE ] CIM: Full fetch complete (54645 records). [2025-09-25T17:59:28.749197] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-25T17:59:28.749088] [DEBUG] [LOCAL ] CIMN: Primary data saved (2678 records). [2025-09-25T17:59:28.749527] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-25T17:59:28.749751] [INFO ] [MAIN ] Update Progress: 451/2372 symbols completed. CIMN took 24.3s. Estimated remaining: 4h 13m 8s. Rate: 7.6 symbols/min [2025-09-25T17:59:28.970300] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:28.983572] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-03 [2025-09-25T17:59:29.137828] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:29.377913] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-25T17:59:29.377996] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-25T17:59:29.378868] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-25T17:59:29.378956] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-25T17:59:29.380382] [DEBUG] [LOCAL ] CINT: Loaded 18484 existing records from primary storage. [2025-09-25T17:59:29.380496] [INFO ] [MAIN ] CINT: Loaded 18484 existing records. [2025-09-25T17:59:29.420356] [DEBUG] [LOCAL ] CIM: Trimmed 54645 records to 37567 (keeping 200 days of data) [2025-09-25T17:59:29.493912] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-25T17:59:29.725052] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:29.726273] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-25T17:59:29.726681] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-25T17:59:29.727784] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-25T17:59:29.728368] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-25T17:59:30.127189] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:30.131757] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T17:59:30.246594] [DEBUG] [LOCAL ] CIM: Primary data saved (37567 records). [2025-09-25T17:59:30.246773] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-25T17:59:30.246866] [INFO ] [MAIN ] Update Progress: 452/2372 symbols completed. CIM took 27.7s. Estimated remaining: 4h 12m 33s. Rate: 7.6 symbols/min [2025-09-25T17:59:30.293907] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-04. [2025-09-25T17:59:30.425995] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:30.448469] [DEBUG] [LOCAL ] CIO: Loaded 20031 existing records from primary storage. [2025-09-25T17:59:30.448619] [INFO ] [MAIN ] CIO: Loaded 20031 existing records. [2025-09-25T17:59:30.550549] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:30.551030] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-04 [2025-09-25T17:59:30.628552] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:30.628813] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-25T17:59:30.628862] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-25T17:59:30.629106] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-25T17:59:30.629164] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-25T17:59:30.990619] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:31.088689] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-25T17:59:31.888717] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-05. [2025-09-25T17:59:32.242202] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:32.242526] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-05 [2025-09-25T17:59:32.256748] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T17:59:32.688727] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-25T17:59:33.321444] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T17:59:33.488767] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-25T17:59:34.288748] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-25T17:59:34.477371] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T17:59:35.088736] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-06. [2025-09-25T17:59:35.299415] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:35.299770] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-06 [2025-09-25T17:59:35.371184] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T17:59:35.888755] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-25T17:59:36.688766] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-07. [2025-09-25T17:59:36.901341] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T17:59:36.911887] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:36.912130] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-07 [2025-09-25T17:59:37.488733] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-25T17:59:38.004019] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T17:59:38.288799] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-25T17:59:39.034940] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T17:59:39.088756] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-25T17:59:39.888687] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-08. [2025-09-25T17:59:40.087141] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T17:59:40.091979] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T17:59:40.092443] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-08 [2025-09-25T17:59:40.688762] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-25T17:59:41.488750] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-25T17:59:41.764445] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T17:59:41.910329] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T17:59:42.288809] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-25T17:59:43.049737] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T17:59:43.088662] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-25T17:59:43.852836] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T17:59:43.888669] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-25T17:59:44.688754] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-25T17:59:44.884747] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T17:59:45.488743] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-09. [2025-09-25T17:59:45.780245] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T17:59:46.088212] [INFO ] [REMOTE ] CIMP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T17:59:46.089890] [INFO ] [REMOTE ] CIMP: Full fetch complete (798 records). [2025-09-25T17:59:46.089964] [DEBUG] [VALIDATOR ] CIMP: Validating primary data. [2025-09-25T17:59:46.090372] [FATAL] [VALIDATOR ] CIMP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T17:59:46.090454] [FATAL] [MAIN ] CIMP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:59:46.090517] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:59:46.090587] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-09-25T17:59:46.090677] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-09-25T17:59:46.090733] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-09-25T17:59:46.090792] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-09-25T17:59:46.090868] [INFO ] [MAIN ] Update Progress: 453/2372 symbols completed. CIMP took 30.1s. Estimated remaining: 4h 12m 59s. Rate: 7.6 symbols/min [2025-09-25T17:59:46.269720] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:46.269974] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-09-25T17:59:46.270031] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-09-25T17:59:46.270233] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-25T17:59:46.270297] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-25T17:59:46.270368] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-09-25T17:59:46.270404] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-25T17:59:46.293947] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-25T17:59:46.634838] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:47.088722] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-25T17:59:47.330008] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T17:59:47.888733] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-25T17:59:48.490975] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T17:59:48.506577] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T17:59:48.688713] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-25T17:59:49.488691] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-25T17:59:49.730037] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T17:59:50.128721] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T17:59:50.288749] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-25T17:59:51.037083] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T17:59:51.038821] [INFO ] [REMOTE ] CIMO: Full fetch complete (5460 records). [2025-09-25T17:59:51.038895] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-25T17:59:51.095902] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-25T17:59:51.229613] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T17:59:51.229880] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T17:59:51.229953] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T17:59:51.230036] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-25T17:59:51.230120] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-25T17:59:51.230160] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-25T17:59:51.230203] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-25T17:59:51.230340] [INFO ] [MAIN ] Update Progress: 454/2372 symbols completed. CIMO took 45.4s. Estimated remaining: 4h 12m 39s. Rate: 7.6 symbols/min [2025-09-25T17:59:51.404525] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:51.477147] [DEBUG] [LOCAL ] CIVI: Loaded 52587 existing records from primary storage. [2025-09-25T17:59:51.477341] [INFO ] [MAIN ] CIVI: Loaded 52587 existing records. [2025-09-25T17:59:51.660109] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:51.660373] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-25T17:59:51.660423] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-25T17:59:51.660709] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-25T17:59:51.660768] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-25T17:59:51.859942] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T17:59:51.903051] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-25T17:59:52.053615] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:52.688676] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-25T17:59:52.841997] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T17:59:53.488804] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-25T17:59:53.850438] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T17:59:54.288725] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-25T17:59:54.978987] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T17:59:55.088724] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-25T17:59:55.403436] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T17:59:55.408244] [INFO ] [REMOTE ] CINT: Full fetch complete (26133 records). [2025-09-25T17:59:55.408352] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-25T17:59:55.810607] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-25T17:59:55.810745] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-25T17:59:55.811294] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-25T17:59:55.811362] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-25T17:59:55.812217] [DEBUG] [LOCAL ] CINT: Trimmed 26133 records to 18698 (keeping 200 days of data) [2025-09-25T17:59:55.891071] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-25T17:59:55.925084] [DEBUG] [LOCAL ] CINT: Primary data saved (18698 records). [2025-09-25T17:59:55.925202] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-25T17:59:55.925289] [INFO ] [MAIN ] Update Progress: 455/2372 symbols completed. CINT took 27.2s. Estimated remaining: 4h 12m 18s. Rate: 7.6 symbols/min [2025-09-25T17:59:56.119241] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T17:59:56.182911] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-25T17:59:56.183059] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-25T17:59:56.375606] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T17:59:56.376219] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-25T17:59:56.376334] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-25T17:59:56.376614] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-25T17:59:56.376696] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-25T17:59:56.569395] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T17:59:56.693872] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-25T17:59:56.760573] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T17:59:57.360086] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T17:59:57.488682] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-25T17:59:58.288682] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-25T17:59:58.367345] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T17:59:59.088730] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-25T17:59:59.218000] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T17:59:59.282145] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T17:59:59.888723] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-25T18:00:00.308424] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T18:00:00.688778] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-25T18:00:01.488788] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-25T18:00:01.886515] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T18:00:02.270166] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T18:00:02.288674] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-25T18:00:02.611936] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T18:00:03.088786] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-25T18:00:03.888739] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-25T18:00:04.164840] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:00:04.688723] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-25T18:00:04.729483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T18:00:04.772127] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T18:00:05.488746] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-25T18:00:06.288772] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-25T18:00:06.501958] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T18:00:06.532283] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:00:07.088725] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-25T18:00:07.888746] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-25T18:00:08.413979] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-25T18:00:08.491838] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T18:00:08.688715] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-25T18:00:09.338452] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T18:00:09.343090] [INFO ] [REMOTE ] CIO: Full fetch complete (28893 records). [2025-09-25T18:00:09.343200] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-25T18:00:09.493825] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-25T18:00:09.822634] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-25T18:00:09.822767] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-25T18:00:09.823249] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-25T18:00:09.823317] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-25T18:00:09.824096] [DEBUG] [LOCAL ] CIO: Trimmed 28893 records to 20205 (keeping 200 days of data) [2025-09-25T18:00:09.939333] [DEBUG] [LOCAL ] CIO: Primary data saved (20205 records). [2025-09-25T18:00:09.939465] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-25T18:00:09.939545] [INFO ] [MAIN ] Update Progress: 456/2372 symbols completed. CIO took 39.7s. Estimated remaining: 4h 12m 35s. Rate: 7.6 symbols/min [2025-09-25T18:00:10.121277] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:10.163861] [DEBUG] [LOCAL ] CLB: Loaded 33033 existing records from primary storage. [2025-09-25T18:00:10.164012] [INFO ] [MAIN ] CLB: Loaded 33033 existing records. [2025-09-25T18:00:10.293826] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-25T18:00:10.358116] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:00:10.358631] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-25T18:00:10.358771] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-25T18:00:10.359085] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-25T18:00:10.359167] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-25T18:00:10.535714] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T18:00:10.768701] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:11.088715] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-25T18:00:11.490834] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T18:00:11.888773] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-25T18:00:11.989230] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T18:00:12.478523] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-25T18:00:12.484080] [INFO ] [REMOTE ] CION: Full fetch complete (41235 records). [2025-09-25T18:00:12.484180] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-25T18:00:12.697457] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-25T18:00:12.880704] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-25T18:00:12.880821] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-25T18:00:12.881371] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-25T18:00:12.881434] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-25T18:00:12.883484] [DEBUG] [LOCAL ] CION: Trimmed 41235 records to 29526 (keeping 200 days of data) [2025-09-25T18:00:13.069158] [DEBUG] [LOCAL ] CION: Primary data saved (29526 records). [2025-09-25T18:00:13.069290] [INFO ] [MAIN ] CION: Full history saved. [2025-09-25T18:00:13.069366] [INFO ] [MAIN ] Update Progress: 457/2372 symbols completed. CION took 27.0s. Estimated remaining: 4h 12m 7s. Rate: 7.6 symbols/min [2025-09-25T18:00:13.246708] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:13.262918] [DEBUG] [LOCAL ] CLCO: Loaded 12868 existing records from primary storage. [2025-09-25T18:00:13.263055] [INFO ] [MAIN ] CLCO: Loaded 12868 existing records. [2025-09-25T18:00:13.463469] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:00:13.463900] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-25T18:00:13.464011] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-25T18:00:13.464383] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-25T18:00:13.464472] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-25T18:00:13.498436] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-25T18:00:13.825349] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T18:00:13.891917] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:14.288739] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-25T18:00:14.602069] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T18:00:14.925920] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T18:00:15.088785] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-25T18:00:15.618018] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T18:00:15.888765] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-25T18:00:16.688711] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-25T18:00:16.719915] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T18:00:16.985407] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T18:00:17.488724] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-25T18:00:17.890160] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T18:00:18.288722] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-25T18:00:19.088705] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-25T18:00:19.403343] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T18:00:19.734585] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T18:00:19.888747] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-25T18:00:20.496087] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:00:20.688734] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-25T18:00:21.393009] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T18:00:21.488785] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-25T18:00:22.288707] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-25T18:00:22.516832] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T18:00:22.526128] [INFO ] [REMOTE ] CIVI: Full fetch complete (75162 records). [2025-09-25T18:00:22.526274] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-25T18:00:22.527083] [FATAL] [VALIDATOR ] CIVI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:00:22.527301] [FATAL] [MAIN ] CIVI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:00:22.527370] [WARN ] [MAIN ] CIVI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:00:22.527451] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-25T18:00:22.527536] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-25T18:00:22.527575] [INFO ] [LOCAL ] CIVI: Starting deletion of derivative data. [2025-09-25T18:00:22.528012] [DEBUG] [LOCAL ] CIVI: Deleted derivative data file. [2025-09-25T18:00:22.528127] [INFO ] [MAIN ] Update Progress: 458/2372 symbols completed. CIVI took 31.3s. Estimated remaining: 4h 12m 6s. Rate: 7.6 symbols/min [2025-09-25T18:00:22.705253] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:22.705437] [DEBUG] [LOCAL ] CLDT: No existing data file found in primary storage. [2025-09-25T18:00:22.705476] [WARN ] [MAIN ] CLDT: No existing data found, performing full refresh instead. [2025-09-25T18:00:22.705755] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-25T18:00:22.705807] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-25T18:00:22.705849] [DEBUG] [LOCAL ] CLDT: No primary data file found to delete. [2025-09-25T18:00:22.705882] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-25T18:00:23.071896] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:23.088729] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-25T18:00:23.348061] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T18:00:23.519977] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T18:00:23.888684] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-25T18:00:24.066404] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T18:00:24.688765] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-25T18:00:25.190108] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T18:00:25.488746] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-25T18:00:25.797385] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T18:00:26.288769] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-25T18:00:27.088705] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-25T18:00:27.163049] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T18:00:27.277390] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T18:00:27.888770] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-25T18:00:28.463138] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T18:00:28.688730] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-25T18:00:28.800258] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T18:00:29.488739] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-25T18:00:30.009083] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:00:30.288732] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-25T18:00:30.689274] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T18:00:31.088783] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-25T18:00:31.658638] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T18:00:31.888725] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-25T18:00:32.465150] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T18:00:32.688726] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-25T18:00:32.992020] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T18:00:33.488728] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-25T18:00:34.288788] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-25T18:00:34.714729] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T18:00:34.724851] [INFO ] [REMOTE ] CL: Full fetch complete (77616 records). [2025-09-25T18:00:34.724990] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-25T18:00:35.110739] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-25T18:00:35.166923] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-25T18:00:35.167058] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-25T18:00:35.168106] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-25T18:00:35.170104] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T18:00:35.168943] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-25T18:00:35.177565] [INFO ] [REMOTE ] CLB: Full fetch complete (46202 records). [2025-09-25T18:00:35.177843] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-25T18:00:35.178848] [FATAL] [VALIDATOR ] CLB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:00:35.179140] [FATAL] [MAIN ] CLB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:00:35.179210] [WARN ] [MAIN ] CLB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:00:35.179258] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-25T18:00:35.179387] [DEBUG] [LOCAL ] CL: Trimmed 77616 records to 54034 (keeping 200 days of data) [2025-09-25T18:00:35.179507] [DEBUG] [LOCAL ] CLB: No primary data file found to delete. [2025-09-25T18:00:35.180178] [INFO ] [LOCAL ] CLB: Starting deletion of derivative data. [2025-09-25T18:00:35.180774] [DEBUG] [LOCAL ] CLB: Deleted derivative data file. [2025-09-25T18:00:35.180926] [INFO ] [MAIN ] Update Progress: 459/2372 symbols completed. CLB took 25.2s. Estimated remaining: 4h 12m 18s. Rate: 7.6 symbols/min [2025-09-25T18:00:35.458982] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:35.459341] [DEBUG] [LOCAL ] CLF: No existing data file found in primary storage. [2025-09-25T18:00:35.460503] [WARN ] [MAIN ] CLF: No existing data found, performing full refresh instead. [2025-09-25T18:00:35.462035] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-25T18:00:35.462135] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-25T18:00:35.478068] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-25T18:00:35.481606] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T18:00:35.481079] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-25T18:00:35.889514] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-25T18:00:35.893481] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:36.008495] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T18:00:36.132115] [DEBUG] [LOCAL ] CL: Primary data saved (54034 records). [2025-09-25T18:00:36.132276] [INFO ] [MAIN ] CL: Full history saved. [2025-09-25T18:00:36.133084] [INFO ] [MAIN ] Update Progress: 460/2372 symbols completed. CL took 40.2s. Estimated remaining: 4h 11m 41s. Rate: 7.6 symbols/min [2025-09-25T18:00:36.311128] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:36.342282] [DEBUG] [LOCAL ] CLH: Loaded 28056 existing records from primary storage. [2025-09-25T18:00:36.342418] [INFO ] [MAIN ] CLH: Loaded 28056 existing records. [2025-09-25T18:00:36.530788] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:00:36.531094] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-25T18:00:36.531148] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-25T18:00:36.531423] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-25T18:00:36.531482] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-25T18:00:36.689540] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-25T18:00:36.892816] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:37.217863] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T18:00:37.488770] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-25T18:00:38.288747] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-25T18:00:38.616740] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T18:00:38.850491] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T18:00:38.933984] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-25T18:00:39.088720] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-25T18:00:39.888690] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-25T18:00:39.971049] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T18:00:40.688784] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-25T18:00:41.279936] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T18:00:41.446551] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T18:00:41.488710] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-25T18:00:42.254065] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T18:00:42.288778] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-25T18:00:43.088771] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-25T18:00:43.889883] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-25T18:00:43.892142] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T18:00:44.290816] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T18:00:44.293245] [INFO ] [REMOTE ] CLCO: Full fetch complete (23018 records). [2025-09-25T18:00:44.293326] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-25T18:00:44.680799] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-25T18:00:44.680980] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-25T18:00:44.681376] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-25T18:00:44.681419] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-25T18:00:44.682102] [DEBUG] [LOCAL ] CLCO: Trimmed 23018 records to 13067 (keeping 200 days of data) [2025-09-25T18:00:44.712291] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-25T18:00:44.760589] [DEBUG] [LOCAL ] CLCO: Primary data saved (13067 records). [2025-09-25T18:00:44.760762] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-25T18:00:44.760896] [INFO ] [MAIN ] Update Progress: 461/2372 symbols completed. CLCO took 31.7s. Estimated remaining: 4h 11m 36s. Rate: 7.6 symbols/min [2025-09-25T18:00:44.937179] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:44.950720] [DEBUG] [LOCAL ] CLPR: Loaded 11546 existing records from primary storage. [2025-09-25T18:00:44.950860] [INFO ] [MAIN ] CLPR: Loaded 11546 existing records. [2025-09-25T18:00:45.140467] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:00:45.140942] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-25T18:00:45.140999] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-25T18:00:45.141208] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-25T18:00:45.141267] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-25T18:00:45.311918] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T18:00:45.351265] [INFO ] [REMOTE ] CLDT: Full fetch complete (36961 records). [2025-09-25T18:00:45.398600] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-25T18:00:45.492942] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-25T18:00:45.770183] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:45.984741] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-25T18:00:45.984860] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-25T18:00:45.985450] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-25T18:00:45.985494] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-25T18:00:45.986693] [DEBUG] [LOCAL ] CLDT: Trimmed 36961 records to 25900 (keeping 200 days of data) [2025-09-25T18:00:46.139148] [DEBUG] [LOCAL ] CLDT: Primary data saved (25900 records). [2025-09-25T18:00:46.139291] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-25T18:00:46.139377] [INFO ] [MAIN ] Update Progress: 462/2372 symbols completed. CLDT took 23.6s. Estimated remaining: 4h 11m 1s. Rate: 7.6 symbols/min [2025-09-25T18:00:46.290833] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-25T18:00:46.351383] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:00:46.404516] [DEBUG] [LOCAL ] CLS: Loaded 53636 existing records from primary storage. [2025-09-25T18:00:46.404690] [INFO ] [MAIN ] CLS: Loaded 53636 existing records. [2025-09-25T18:00:46.586771] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:00:46.587742] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-25T18:00:46.587994] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-25T18:00:46.588429] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-25T18:00:46.588587] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-25T18:00:46.825771] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T18:00:47.054277] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:00:47.055876] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T18:00:47.088675] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-25T18:00:47.416367] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T18:00:47.888722] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-25T18:00:48.682521] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T18:00:48.688666] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-25T18:00:49.321349] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T18:00:49.363547] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-25T18:00:49.488721] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-25T18:00:50.288719] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-25T18:00:50.762540] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T18:00:50.967706] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T18:00:51.088723] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-25T18:00:51.888725] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-25T18:00:52.021690] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T18:00:52.688734] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-25T18:00:53.488751] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-25T18:00:53.831029] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T18:00:54.288826] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-25T18:00:54.301027] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:00:54.943795] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-25T18:00:55.088710] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-25T18:00:55.857393] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:00:55.888676] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-25T18:00:56.688705] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-25T18:00:56.957928] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T18:00:57.395244] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-25T18:00:57.488741] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-25T18:00:58.290108] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-25T18:00:58.291397] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T18:00:58.545316] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T18:00:59.088806] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-25T18:00:59.350534] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T18:00:59.888723] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-25T18:01:00.688722] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-25T18:01:01.488693] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-25T18:01:01.748581] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T18:01:01.868569] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T18:01:01.876332] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-09-25T18:01:02.288794] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-25T18:01:02.843871] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:01:03.088751] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-25T18:01:03.888723] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-25T18:01:04.477569] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T18:01:04.554955] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T18:01:04.588418] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-25T18:01:04.688687] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-25T18:01:05.488738] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-25T18:01:06.288688] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-25T18:01:06.356975] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T18:01:07.071006] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T18:01:07.072826] [INFO ] [REMOTE ] CLPR: Full fetch complete (17687 records). [2025-09-25T18:01:07.072899] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-25T18:01:07.094793] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-25T18:01:07.449904] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-25T18:01:07.450027] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-25T18:01:07.450494] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-25T18:01:07.450639] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-25T18:01:07.451441] [DEBUG] [LOCAL ] CLPR: Trimmed 17687 records to 11575 (keeping 200 days of data) [2025-09-25T18:01:07.527153] [DEBUG] [LOCAL ] CLPR: Primary data saved (11575 records). [2025-09-25T18:01:07.527350] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-25T18:01:07.527480] [INFO ] [MAIN ] Update Progress: 463/2372 symbols completed. CLPR took 22.8s. Estimated remaining: 4h 11m 49s. Rate: 7.6 symbols/min [2025-09-25T18:01:07.793238] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:07.863693] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-25T18:01:07.903456] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-25T18:01:07.940771] [DEBUG] [LOCAL ] CLVT: Loaded 51953 existing records from primary storage. [2025-09-25T18:01:07.941056] [INFO ] [MAIN ] CLVT: Loaded 51953 existing records. [2025-09-25T18:01:08.231319] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:08.231723] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-25T18:01:08.231785] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-25T18:01:08.232086] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-25T18:01:08.232161] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-25T18:01:08.692416] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-25T18:01:08.764681] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:01:08.844787] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:08.846105] [INFO ] [REMOTE ] CLH: Full fetch complete (41928 records). [2025-09-25T18:01:08.846288] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-25T18:01:09.248601] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-25T18:01:09.248751] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-25T18:01:09.249306] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-25T18:01:09.249349] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-25T18:01:09.251120] [DEBUG] [LOCAL ] CLH: Trimmed 41928 records to 28304 (keeping 200 days of data) [2025-09-25T18:01:09.429416] [DEBUG] [LOCAL ] CLH: Primary data saved (28304 records). [2025-09-25T18:01:09.429555] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-25T18:01:09.429663] [INFO ] [MAIN ] Update Progress: 464/2372 symbols completed. CLH took 33.3s. Estimated remaining: 4h 11m 17s. Rate: 7.6 symbols/min [2025-09-25T18:01:09.493772] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-25T18:01:09.603731] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:09.626406] [DEBUG] [LOCAL ] CLW: Loaded 21898 existing records from primary storage. [2025-09-25T18:01:09.626544] [INFO ] [MAIN ] CLW: Loaded 21898 existing records. [2025-09-25T18:01:09.817779] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:09.818350] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-25T18:01:09.818576] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-25T18:01:09.819033] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-25T18:01:09.819097] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-25T18:01:10.200622] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-25T18:01:10.232432] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:10.288672] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-25T18:01:10.434746] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T18:01:11.088700] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-25T18:01:11.268124] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T18:01:11.328293] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T18:01:11.888729] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-25T18:01:12.688734] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-25T18:01:13.041250] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T18:01:13.311766] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:01:13.488755] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-25T18:01:14.288780] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-25T18:01:14.877514] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-25T18:01:15.087583] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T18:01:15.097488] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-25T18:01:15.283916] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T18:01:15.888716] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-25T18:01:16.688717] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-25T18:01:17.268275] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T18:01:17.281070] [INFO ] [REMOTE ] CLF: Full fetch complete (77419 records). [2025-09-25T18:01:17.281255] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-25T18:01:17.282139] [FATAL] [VALIDATOR ] CLF: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:01:17.282247] [FATAL] [MAIN ] CLF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:01:17.282293] [WARN ] [MAIN ] CLF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:01:17.282361] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-25T18:01:17.282430] [DEBUG] [LOCAL ] CLF: No primary data file found to delete. [2025-09-25T18:01:17.282469] [INFO ] [LOCAL ] CLF: Starting deletion of derivative data. [2025-09-25T18:01:17.282537] [DEBUG] [LOCAL ] CLF: No derivative data file found to delete. [2025-09-25T18:01:17.282667] [INFO ] [MAIN ] Update Progress: 465/2372 symbols completed. CLF took 42.1s. Estimated remaining: 4h 11m 8s. Rate: 7.6 symbols/min [2025-09-25T18:01:17.471086] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:17.502814] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-25T18:01:17.531831] [DEBUG] [LOCAL ] CLX: Loaded 51425 existing records from primary storage. [2025-09-25T18:01:17.531988] [INFO ] [MAIN ] CLX: Loaded 51425 existing records. [2025-09-25T18:01:17.764594] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:17.765730] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-25T18:01:17.767576] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T18:01:17.767824] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-25T18:01:17.779865] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-25T18:01:17.780127] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-25T18:01:17.899729] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T18:01:18.188796] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:18.288748] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-25T18:01:19.088679] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-25T18:01:19.183176] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:01:19.324417] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T18:01:19.888713] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-25T18:01:20.688732] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-25T18:01:20.731575] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T18:01:21.046041] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T18:01:21.488751] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-25T18:01:22.288684] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-25T18:01:22.665245] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T18:01:23.071423] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-25T18:01:23.088665] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-25T18:01:23.821584] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T18:01:23.888695] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-25T18:01:24.688726] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-25T18:01:25.433289] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:01:25.488685] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-25T18:01:25.529266] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-25T18:01:25.549561] [INFO ] [REMOTE ] CLS: Full fetch complete (77450 records). [2025-09-25T18:01:25.549783] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-25T18:01:25.550863] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T18:01:25.949679] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-25T18:01:25.949771] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-25T18:01:25.950593] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-25T18:01:25.950694] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-25T18:01:25.952260] [DEBUG] [LOCAL ] CLS: Trimmed 77450 records to 54024 (keeping 200 days of data) [2025-09-25T18:01:26.278918] [DEBUG] [LOCAL ] CLS: Primary data saved (54024 records). [2025-09-25T18:01:26.279064] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-25T18:01:26.279148] [INFO ] [MAIN ] Update Progress: 466/2372 symbols completed. CLS took 40.1s. Estimated remaining: 4h 11m 5s. Rate: 7.6 symbols/min [2025-09-25T18:01:26.293946] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-25T18:01:26.460678] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:26.460912] [DEBUG] [LOCAL ] CM: No existing data file found in primary storage. [2025-09-25T18:01:26.460968] [WARN ] [MAIN ] CM: No existing data found, performing full refresh instead. [2025-09-25T18:01:26.461121] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-25T18:01:26.461166] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-25T18:01:26.461207] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-25T18:01:26.461240] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-25T18:01:26.840151] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:27.088715] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-25T18:01:27.210161] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:01:27.888726] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-25T18:01:28.041966] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T18:01:28.367164] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:01:28.688782] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-25T18:01:29.356273] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T18:01:29.488705] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-25T18:01:30.288743] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-25T18:01:30.718408] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T18:01:31.088688] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-25T18:01:31.257041] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-25T18:01:31.625524] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-25T18:01:31.888796] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-25T18:01:32.688702] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-25T18:01:32.761156] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:01:33.488682] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-25T18:01:33.592098] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T18:01:33.628228] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T18:01:34.288755] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-25T18:01:34.848273] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T18:01:35.088796] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-25T18:01:35.888708] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-25T18:01:36.093033] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:01:36.688682] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-25T18:01:36.874738] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T18:01:36.879202] [INFO ] [REMOTE ] CLW: Full fetch complete (35217 records). [2025-09-25T18:01:36.879284] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-25T18:01:37.224179] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-25T18:01:37.315140] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-25T18:01:37.315260] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-25T18:01:37.316479] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-25T18:01:37.316582] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-25T18:01:37.318614] [DEBUG] [LOCAL ] CLW: Trimmed 35217 records to 22067 (keeping 200 days of data) [2025-09-25T18:01:37.449359] [DEBUG] [LOCAL ] CLW: Primary data saved (22067 records). [2025-09-25T18:01:37.449499] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-25T18:01:37.449775] [INFO ] [MAIN ] Update Progress: 467/2372 symbols completed. CLW took 28.0s. Estimated remaining: 4h 11m 10s. Rate: 7.6 symbols/min [2025-09-25T18:01:37.494504] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-25T18:01:37.632483] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:37.688556] [DEBUG] [LOCAL ] CMA: Loaded 50097 existing records from primary storage. [2025-09-25T18:01:37.688720] [INFO ] [MAIN ] CMA: Loaded 50097 existing records. [2025-09-25T18:01:37.870797] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:37.871139] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-25T18:01:37.871195] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-25T18:01:37.871477] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-25T18:01:37.871537] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-25T18:01:38.267044] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:38.288673] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-25T18:01:38.386971] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T18:01:39.088683] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-25T18:01:39.127731] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:01:39.888701] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-25T18:01:40.013243] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T18:01:40.688745] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-25T18:01:40.723184] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T18:01:41.488703] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-25T18:01:41.559880] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:01:41.569860] [INFO ] [REMOTE ] CLVT: Full fetch complete (75229 records). [2025-09-25T18:01:41.570018] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-25T18:01:41.989090] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-25T18:01:41.989174] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-25T18:01:41.989992] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-25T18:01:41.990074] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-25T18:01:41.991551] [DEBUG] [LOCAL ] CLVT: Trimmed 75229 records to 52329 (keeping 200 days of data) [2025-09-25T18:01:42.299870] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-25T18:01:42.324328] [DEBUG] [LOCAL ] CLVT: Primary data saved (52329 records). [2025-09-25T18:01:42.324534] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-25T18:01:42.324700] [INFO ] [MAIN ] Update Progress: 468/2372 symbols completed. CLVT took 34.8s. Estimated remaining: 4h 10m 50s. Rate: 7.6 symbols/min [2025-09-25T18:01:42.531595] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:42.555097] [DEBUG] [LOCAL ] CMBT: Loaded 22204 existing records from primary storage. [2025-09-25T18:01:42.555305] [INFO ] [MAIN ] CMBT: Loaded 22204 existing records. [2025-09-25T18:01:42.742589] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:42.743126] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-25T18:01:42.743265] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-25T18:01:42.743774] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-25T18:01:42.743892] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-25T18:01:42.878439] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T18:01:43.094738] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-25T18:01:43.226705] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:43.258952] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T18:01:43.888689] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-25T18:01:44.010539] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T18:01:44.688745] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-25T18:01:44.927997] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T18:01:45.488711] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-25T18:01:45.545245] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T18:01:46.288692] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-25T18:01:46.396184] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T18:01:46.410064] [INFO ] [REMOTE ] CLX: Full fetch complete (72568 records). [2025-09-25T18:01:46.410286] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-25T18:01:46.411504] [FATAL] [VALIDATOR ] CLX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:01:46.411638] [FATAL] [MAIN ] CLX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:01:46.411772] [WARN ] [MAIN ] CLX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:01:46.411858] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-25T18:01:46.411953] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-09-25T18:01:46.412030] [INFO ] [LOCAL ] CLX: Starting deletion of derivative data. [2025-09-25T18:01:46.412492] [DEBUG] [LOCAL ] CLX: Deleted derivative data file. [2025-09-25T18:01:46.413147] [INFO ] [MAIN ] Update Progress: 469/2372 symbols completed. CLX took 29.1s. Estimated remaining: 4h 10m 27s. Rate: 7.6 symbols/min [2025-09-25T18:01:46.617514] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:46.690486] [DEBUG] [LOCAL ] CMC: Loaded 45646 existing records from primary storage. [2025-09-25T18:01:46.690681] [INFO ] [MAIN ] CMC: Loaded 45646 existing records. [2025-09-25T18:01:46.872296] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:46.872535] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-25T18:01:46.872583] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-25T18:01:46.872885] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-25T18:01:46.872945] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-25T18:01:47.090871] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-25T18:01:47.260409] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:47.296403] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T18:01:47.888723] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-25T18:01:48.068177] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T18:01:48.523595] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T18:01:48.688732] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-25T18:01:49.459424] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:01:49.488700] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-25T18:01:50.186364] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T18:01:50.288736] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-25T18:01:51.088712] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-25T18:01:51.143970] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:01:51.888729] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-25T18:01:51.950305] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T18:01:52.586605] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:01:52.595338] [INFO ] [REMOTE ] CM: Full fetch complete (69037 records). [2025-09-25T18:01:52.595481] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-25T18:01:52.596326] [FATAL] [VALIDATOR ] CM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:01:52.596420] [FATAL] [MAIN ] CM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:01:52.596462] [WARN ] [MAIN ] CM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:01:52.596500] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-25T18:01:52.596558] [DEBUG] [LOCAL ] CM: No primary data file found to delete. [2025-09-25T18:01:52.596592] [INFO ] [LOCAL ] CM: Starting deletion of derivative data. [2025-09-25T18:01:52.596633] [DEBUG] [LOCAL ] CM: No derivative data file found to delete. [2025-09-25T18:01:52.596761] [INFO ] [MAIN ] Update Progress: 470/2372 symbols completed. CM took 26.3s. Estimated remaining: 4h 10m 12s. Rate: 7.6 symbols/min [2025-09-25T18:01:52.698432] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-25T18:01:52.775854] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:01:52.783939] [DEBUG] [LOCAL ] CMCM: Loaded 4756 existing records from primary storage. [2025-09-25T18:01:52.784034] [INFO ] [MAIN ] CMCM: Loaded 4756 existing records. [2025-09-25T18:01:52.968737] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:01:52.968981] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-25T18:01:52.969030] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-25T18:01:52.969211] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-25T18:01:52.969270] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-25T18:01:53.358485] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:01:53.386968] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T18:01:53.442327] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T18:01:53.488703] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-25T18:01:54.288748] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-25T18:01:54.480155] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T18:01:55.088746] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-25T18:01:55.174996] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T18:01:55.888713] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-25T18:01:56.445612] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T18:01:56.688745] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-25T18:01:56.778471] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T18:01:57.086150] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T18:01:57.488752] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-25T18:01:58.288723] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-25T18:01:58.939912] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T18:01:59.088705] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-25T18:01:59.215242] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T18:01:59.556776] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T18:01:59.888772] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-25T18:02:00.688782] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-25T18:02:01.223502] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T18:02:01.488742] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-25T18:02:01.693812] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T18:02:02.288727] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-25T18:02:03.088693] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-25T18:02:03.161315] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T18:02:03.563142] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T18:02:03.717189] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T18:02:03.888714] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-25T18:02:04.688687] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-25T18:02:04.917152] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T18:02:05.488716] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-25T18:02:05.931702] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T18:02:06.155607] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T18:02:06.288675] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-25T18:02:06.800124] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T18:02:07.088727] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-25T18:02:07.888724] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-25T18:02:08.298552] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T18:02:08.688721] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-25T18:02:09.465863] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T18:02:09.488713] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-25T18:02:09.568025] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T18:02:10.288731] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-25T18:02:11.088702] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-25T18:02:11.141321] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T18:02:11.143594] [INFO ] [REMOTE ] CMCM: Full fetch complete (7051 records). [2025-09-25T18:02:11.143702] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-25T18:02:11.565738] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-25T18:02:11.565935] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-25T18:02:11.566395] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-25T18:02:11.566997] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-25T18:02:11.568424] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-25T18:02:11.579237] [DEBUG] [LOCAL ] CMCM: Trimmed 7051 records to 4788 (keeping 200 days of data) [2025-09-25T18:02:11.608396] [DEBUG] [LOCAL ] CMCM: Primary data saved (4788 records). [2025-09-25T18:02:11.608555] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-25T18:02:11.608671] [INFO ] [MAIN ] Update Progress: 471/2372 symbols completed. CMCM took 19.0s. Estimated remaining: 4h 10m 49s. Rate: 7.6 symbols/min [2025-09-25T18:02:11.785431] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:11.785633] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-25T18:02:11.785740] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-25T18:02:11.785895] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-25T18:02:11.785938] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-25T18:02:11.785979] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-25T18:02:11.786010] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-25T18:02:11.890898] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-25T18:02:12.160878] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:12.409080] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T18:02:12.688709] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-25T18:02:13.491348] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-25T18:02:13.497401] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T18:02:14.266506] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:02:14.287877] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T18:02:14.291569] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-25T18:02:15.088728] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-25T18:02:15.888728] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-25T18:02:16.230787] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T18:02:16.239533] [INFO ] [REMOTE ] CMC: Full fetch complete (66966 records). [2025-09-25T18:02:16.239724] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-25T18:02:16.662093] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-25T18:02:16.662260] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-25T18:02:16.663176] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-25T18:02:16.663247] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-25T18:02:16.664915] [DEBUG] [LOCAL ] CMC: Trimmed 66966 records to 45990 (keeping 200 days of data) [2025-09-25T18:02:16.722257] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-25T18:02:16.929115] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T18:02:17.009885] [DEBUG] [LOCAL ] CMC: Primary data saved (45990 records). [2025-09-25T18:02:17.010018] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-25T18:02:17.010584] [INFO ] [MAIN ] Update Progress: 472/2372 symbols completed. CMC took 30.6s. Estimated remaining: 4h 10m 31s. Rate: 7.6 symbols/min [2025-09-25T18:02:17.048814] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:02:17.083554] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-25T18:02:17.196790] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:17.277706] [DEBUG] [LOCAL ] CMG: Loaded 53721 existing records from primary storage. [2025-09-25T18:02:17.280294] [INFO ] [MAIN ] CMG: Loaded 53721 existing records. [2025-09-25T18:02:17.315216] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T18:02:17.483627] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:02:17.483927] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-25T18:02:17.484128] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-25T18:02:17.484426] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-25T18:02:17.484485] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-25T18:02:17.495969] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-25T18:02:17.861521] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:18.288735] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-25T18:02:19.088761] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-25T18:02:19.417134] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T18:02:19.426561] [INFO ] [REMOTE ] CMBT: Full fetch complete (29492 records). [2025-09-25T18:02:19.426745] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-25T18:02:19.838770] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-25T18:02:19.838857] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-25T18:02:19.839314] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-25T18:02:19.839355] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-25T18:02:19.840281] [DEBUG] [LOCAL ] CMBT: Trimmed 29492 records to 22580 (keeping 200 days of data) [2025-09-25T18:02:19.889803] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-25T18:02:19.974494] [DEBUG] [LOCAL ] CMBT: Primary data saved (22580 records). [2025-09-25T18:02:19.974624] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-25T18:02:19.974740] [INFO ] [MAIN ] Update Progress: 473/2372 symbols completed. CMBT took 37.6s. Estimated remaining: 4h 10m 3s. Rate: 7.6 symbols/min [2025-09-25T18:02:20.133335] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:02:20.154099] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:20.154609] [DEBUG] [LOCAL ] CMI: No existing data file found in primary storage. [2025-09-25T18:02:20.154759] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-25T18:02:20.154874] [WARN ] [MAIN ] CMI: No existing data found, performing full refresh instead. [2025-09-25T18:02:20.155782] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-25T18:02:20.155837] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-25T18:02:20.155881] [DEBUG] [LOCAL ] CMI: No primary data file found to delete. [2025-09-25T18:02:20.155914] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-25T18:02:20.526254] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:20.642567] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.35 seconds). [2025-09-25T18:02:20.688677] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-25T18:02:21.059384] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T18:02:21.069070] [INFO ] [REMOTE ] CMA: Full fetch complete (73242 records). [2025-09-25T18:02:21.069209] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-25T18:02:21.470384] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-25T18:02:21.470503] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-25T18:02:21.471314] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-25T18:02:21.471378] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-25T18:02:21.472896] [DEBUG] [LOCAL ] CMA: Trimmed 73242 records to 50401 (keeping 200 days of data) [2025-09-25T18:02:21.534366] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-25T18:02:21.795463] [DEBUG] [LOCAL ] CMA: Primary data saved (50401 records). [2025-09-25T18:02:21.795603] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-25T18:02:21.796935] [INFO ] [MAIN ] Update Progress: 474/2372 symbols completed. CMA took 44.3s. Estimated remaining: 4h 9m 31s. Rate: 7.6 symbols/min [2025-09-25T18:02:21.831213] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:02:21.871399] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-25T18:02:21.978675] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:21.978897] [DEBUG] [LOCAL ] CMP: No existing data file found in primary storage. [2025-09-25T18:02:21.978950] [WARN ] [MAIN ] CMP: No existing data found, performing full refresh instead. [2025-09-25T18:02:21.979132] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-25T18:02:21.979217] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-25T18:02:21.979270] [DEBUG] [LOCAL ] CMP: No primary data file found to delete. [2025-09-25T18:02:21.979320] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-25T18:02:22.293190] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-25T18:02:22.355079] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:22.516725] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T18:02:22.571921] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:02:22.572182] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-25T18:02:23.088719] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-25T18:02:23.888737] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-25T18:02:24.131607] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:02:24.131963] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-25T18:02:24.688694] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-25T18:02:24.767679] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T18:02:25.488684] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-25T18:02:25.728509] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:02:26.288727] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-25T18:02:27.088721] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-25T18:02:27.292527] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T18:02:27.631220] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T18:02:27.888732] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-25T18:02:28.497225] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:02:28.688751] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-25T18:02:29.488728] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-25T18:02:29.830239] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T18:02:30.169359] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T18:02:30.288679] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-25T18:02:30.462751] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T18:02:31.088728] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-25T18:02:31.888710] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-25T18:02:32.482791] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-25T18:02:32.522268] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T18:02:32.539283] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T18:02:32.688711] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-25T18:02:33.488784] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-25T18:02:34.187860] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T18:02:34.288748] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-25T18:02:35.088821] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-25T18:02:35.684754] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-25T18:02:35.837251] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:02:35.888688] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-25T18:02:36.335215] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T18:02:36.688780] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-25T18:02:37.307767] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:02:37.488728] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-25T18:02:38.079903] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T18:02:38.288684] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-25T18:02:38.917501] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:02:38.934717] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T18:02:39.088691] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-25T18:02:39.888710] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-25T18:02:40.643152] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T18:02:40.688672] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-25T18:02:41.253911] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T18:02:41.488730] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-25T18:02:42.220595] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T18:02:42.288797] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-25T18:02:43.088703] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-25T18:02:43.122385] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T18:02:43.888763] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-25T18:02:44.078956] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T18:02:44.081916] [INFO ] [REMOTE ] CMDB: Full fetch complete (10860 records). [2025-09-25T18:02:44.082146] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-25T18:02:44.273182] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 98 unique days, need 200 days [2025-09-25T18:02:44.273497] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:02:44.273568] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:02:44.273614] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-25T18:02:44.273711] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-25T18:02:44.273800] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-25T18:02:44.273881] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-25T18:02:44.273962] [INFO ] [MAIN ] Update Progress: 475/2372 symbols completed. CMDB took 32.7s. Estimated remaining: 4h 10m 21s. Rate: 7.6 symbols/min [2025-09-25T18:02:44.449172] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:44.515041] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-25T18:02:44.540509] [DEBUG] [LOCAL ] CMPO: Loaded 39590 existing records from primary storage. [2025-09-25T18:02:44.540674] [INFO ] [MAIN ] CMPO: Loaded 39590 existing records. [2025-09-25T18:02:44.693696] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-25T18:02:44.721439] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:02:44.722572] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-09-25T18:02:44.722624] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-09-25T18:02:44.722943] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-09-25T18:02:44.723002] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-09-25T18:02:45.089821] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:45.284549] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T18:02:45.488683] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-25T18:02:46.288736] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-25T18:02:46.670833] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T18:02:46.678841] [INFO ] [REMOTE ] CMI: Full fetch complete (59980 records). [2025-09-25T18:02:46.678956] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-25T18:02:47.089199] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2024-12. [2025-09-25T18:02:47.129241] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-25T18:02:47.129451] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-25T18:02:47.130437] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-25T18:02:47.138331] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-25T18:02:47.154923] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T18:02:47.163183] [DEBUG] [LOCAL ] CMI: Trimmed 59980 records to 42204 (keeping 200 days of data) [2025-09-25T18:02:47.426342] [DEBUG] [LOCAL ] CMI: Primary data saved (42204 records). [2025-09-25T18:02:47.426470] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-25T18:02:47.426542] [INFO ] [MAIN ] Update Progress: 476/2372 symbols completed. CMI took 27.5s. Estimated remaining: 4h 9m 54s. Rate: 7.6 symbols/min [2025-09-25T18:02:47.601516] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:02:47.638475] [DEBUG] [LOCAL ] CMRE: Loaded 35469 existing records from primary storage. [2025-09-25T18:02:47.638617] [INFO ] [MAIN ] CMRE: Loaded 35469 existing records. [2025-09-25T18:02:47.817313] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:02:47.817613] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-25T18:02:47.817704] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-25T18:02:47.817993] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-25T18:02:47.818054] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-25T18:02:47.894192] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-25T18:02:48.185212] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:02:48.624089] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-25T18:02:48.688678] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-25T18:02:48.767612] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T18:02:49.005099] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T18:02:49.488825] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-25T18:02:50.288793] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-09-25T18:02:50.805488] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T18:02:50.811145] [INFO ] [REMOTE ] CMP: Full fetch complete (52985 records). [2025-09-25T18:02:50.811254] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-25T18:02:51.089565] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-25T18:02:51.230297] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-25T18:02:51.230428] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-25T18:02:51.231184] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-25T18:02:51.231316] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-25T18:02:51.248618] [DEBUG] [LOCAL ] CMP: Trimmed 52985 records to 36661 (keeping 200 days of data) [2025-09-25T18:02:51.266290] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-25T18:02:51.494772] [DEBUG] [LOCAL ] CMP: Primary data saved (36661 records). [2025-09-25T18:02:51.494915] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-25T18:02:51.495007] [INFO ] [MAIN ] Update Progress: 477/2372 symbols completed. CMP took 29.7s. Estimated remaining: 4h 9m 31s. Rate: 7.6 symbols/min [2025-09-25T18:02:51.823772] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T18:02:51.888667] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-09-25T18:02:52.382928] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:02:52.688713] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-25T18:02:53.230809] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T18:02:53.488744] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-09-25T18:02:54.025629] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T18:02:54.288803] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-25T18:02:55.017577] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T18:02:55.088743] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-09-25T18:02:55.888708] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-25T18:02:56.588754] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T18:02:56.625486] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-25T18:02:56.635477] [INFO ] [REMOTE ] CMG: Full fetch complete (77405 records). [2025-09-25T18:02:56.635689] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-25T18:02:56.636758] [FATAL] [VALIDATOR ] CMG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:02:56.636860] [FATAL] [MAIN ] CMG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:02:56.636906] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:02:56.636946] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-25T18:02:56.637047] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-09-25T18:02:56.637106] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-09-25T18:02:56.637507] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-09-25T18:02:56.638034] [INFO ] [MAIN ] Update Progress: 478/2372 symbols completed. CMG took 39.6s. Estimated remaining: 4h 9m 12s. Rate: 7.6 symbols/min [2025-09-25T18:02:56.688774] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-09-25T18:02:56.758714] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T18:02:57.488769] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-25T18:02:58.018595] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T18:02:58.288771] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-09-25T18:02:58.511189] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T18:02:59.088713] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-25T18:02:59.670126] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T18:02:59.888774] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-09-25T18:03:00.615117] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T18:03:00.688716] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-25T18:03:01.007146] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T18:03:01.488767] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-09-25T18:03:01.867162] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T18:03:02.288751] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-25T18:03:02.949267] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T18:03:03.088704] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-09-25T18:03:03.715392] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:03:03.888738] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-25T18:03:04.647946] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T18:03:04.655500] [INFO ] [REMOTE ] CMPO: Full fetch complete (59019 records). [2025-09-25T18:03:04.655747] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-09-25T18:03:05.060678] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-09-25T18:03:05.060926] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-09-25T18:03:05.061729] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-09-25T18:03:05.061800] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-09-25T18:03:05.063246] [DEBUG] [LOCAL ] CMPO: Trimmed 59019 records to 39856 (keeping 200 days of data) [2025-09-25T18:03:05.315329] [DEBUG] [LOCAL ] CMPO: Primary data saved (39856 records). [2025-09-25T18:03:05.316095] [INFO ] [MAIN ] CMPO: Full history saved. [2025-09-25T18:03:05.316380] [INFO ] [MAIN ] Update Progress: 479/2372 symbols completed. CMPO took 21.0s. Estimated remaining: 4h 9m 8s. Rate: 7.6 symbols/min [2025-09-25T18:03:05.449505] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T18:03:05.460777] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-25T18:03:07.037931] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:03:07.046308] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-25T18:03:08.373405] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:03:08.379738] [INFO ] [REMOTE ] CMRE: Full fetch complete (49659 records). [2025-09-25T18:03:08.379842] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-25T18:03:08.776105] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-25T18:03:08.776247] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-25T18:03:08.778096] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-25T18:03:08.778162] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-25T18:03:08.779215] [DEBUG] [LOCAL ] CMRE: Trimmed 49659 records to 35796 (keeping 200 days of data) [2025-09-25T18:03:08.986000] [DEBUG] [LOCAL ] CMRE: Primary data saved (35796 records). [2025-09-25T18:03:08.986134] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-25T18:03:08.986216] [INFO ] [MAIN ] Update Progress: 480/2372 symbols completed. CMRE took 21.6s. Estimated remaining: 4h 8m 43s. Rate: 7.6 symbols/min [2025-09-25T18:03:09.482024] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:09.642110] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:09.648136] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:09.673398] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-09-25T18:03:09.679371] [DEBUG] [LOCAL ] CMSC: Loaded 5072 existing records from primary storage. [2025-09-25T18:03:09.705760] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:09.706062] [INFO ] [MAIN ] CMSC: Loaded 5072 existing records. [2025-09-25T18:03:09.701414] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-09-25T18:03:09.776138] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-25T18:03:09.781715] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-25T18:03:09.826310] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-09-25T18:03:09.832147] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-25T18:03:09.872838] [DEBUG] [LOCAL ] CMSD: Loaded 8101 existing records from primary storage. [2025-09-25T18:03:09.980487] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:09.994314] [INFO ] [MAIN ] CMSD: Loaded 8101 existing records. [2025-09-25T18:03:10.061240] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-25T18:03:10.062441] [DEBUG] [LOCAL ] CMS: Loaded 52599 existing records from primary storage. [2025-09-25T18:03:10.096801] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-25T18:03:10.116308] [INFO ] [MAIN ] CMS: Loaded 52599 existing records. [2025-09-25T18:03:10.140614] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-25T18:03:10.189910] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-25T18:03:10.582222] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:10.648327] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-25T18:03:10.669423] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-25T18:03:10.681661] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-25T18:03:10.697338] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-25T18:03:10.822827] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:10.874243] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-25T18:03:10.907881] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:10.964218] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-25T18:03:10.992532] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-25T18:03:11.067862] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-25T18:03:11.073134] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-25T18:03:11.506945] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:11.537294] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-25T18:03:11.784978] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:11.804468] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-25T18:03:11.809916] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T18:03:11.827675] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-25T18:03:11.893591] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:11.893898] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-25T18:03:12.441885] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T18:03:12.443938] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-25T18:03:12.476610] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T18:03:12.478252] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-25T18:03:12.575342] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T18:03:12.579514] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-25T18:03:12.928065] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T18:03:12.929402] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-25T18:03:13.080349] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T18:03:13.317865] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T18:03:13.320841] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-25T18:03:13.497789] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-25T18:03:13.517300] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T18:03:14.057297] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-25T18:03:14.288713] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-25T18:03:14.722513] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T18:03:15.088714] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-25T18:03:15.751115] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T18:03:15.888716] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-25T18:03:16.688759] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-25T18:03:17.203090] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T18:03:17.305593] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T18:03:17.488736] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-25T18:03:18.130246] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:03:18.288748] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-25T18:03:18.938870] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T18:03:19.088710] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-25T18:03:19.645223] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-25T18:03:19.888749] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-25T18:03:20.473826] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T18:03:20.688716] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-25T18:03:21.084264] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T18:03:21.488779] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-25T18:03:21.940012] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T18:03:22.288755] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-25T18:03:23.030111] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T18:03:23.088727] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-25T18:03:23.658957] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T18:03:23.888772] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-25T18:03:24.618639] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T18:03:24.620027] [INFO ] [REMOTE ] CMSC: Full fetch complete (7159 records). [2025-09-25T18:03:24.620098] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-25T18:03:24.693805] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-25T18:03:24.985872] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-25T18:03:24.985950] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-25T18:03:24.986126] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-25T18:03:24.986165] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-25T18:03:24.986568] [DEBUG] [LOCAL ] CMSC: Trimmed 7159 records to 5103 (keeping 200 days of data) [2025-09-25T18:03:25.017283] [DEBUG] [LOCAL ] CMSC: Primary data saved (5103 records). [2025-09-25T18:03:25.017385] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-25T18:03:25.017466] [INFO ] [MAIN ] Update Progress: 481/2372 symbols completed. CMSC took 16.0s. Estimated remaining: 4h 9m 7s. Rate: 7.6 symbols/min [2025-09-25T18:03:25.186326] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:25.219494] [DEBUG] [LOCAL ] CMTG: Loaded 37547 existing records from primary storage. [2025-09-25T18:03:25.219631] [INFO ] [MAIN ] CMTG: Loaded 37547 existing records. [2025-09-25T18:03:25.398639] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:25.398921] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-25T18:03:25.398968] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-25T18:03:25.402632] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-25T18:03:25.402859] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-25T18:03:25.402817] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T18:03:25.493977] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-25T18:03:25.774949] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:26.288748] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-25T18:03:26.477170] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T18:03:27.088727] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-25T18:03:27.808082] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T18:03:27.888680] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-25T18:03:28.688766] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-25T18:03:28.888394] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T18:03:29.216137] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-25T18:03:29.249005] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T18:03:29.488755] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-25T18:03:30.284775] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T18:03:30.288671] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-25T18:03:30.908903] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T18:03:31.088728] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-25T18:03:31.888708] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-25T18:03:31.923839] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T18:03:32.609576] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T18:03:32.610818] [INFO ] [REMOTE ] CMSA: Full fetch complete (5044 records). [2025-09-25T18:03:32.610890] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-25T18:03:32.693818] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-25T18:03:32.978788] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-25T18:03:32.978872] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-25T18:03:32.979034] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-25T18:03:32.979071] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-25T18:03:32.979448] [DEBUG] [LOCAL ] CMSA: Trimmed 5044 records to 3406 (keeping 200 days of data) [2025-09-25T18:03:33.001054] [DEBUG] [LOCAL ] CMSA: Primary data saved (3406 records). [2025-09-25T18:03:33.001202] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-25T18:03:33.001286] [INFO ] [MAIN ] Update Progress: 482/2372 symbols completed. CMSA took 24.0s. Estimated remaining: 4h 8m 60s. Rate: 7.6 symbols/min [2025-09-25T18:03:33.179334] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:33.190836] [DEBUG] [LOCAL ] CMU: Loaded 7267 existing records from primary storage. [2025-09-25T18:03:33.190964] [INFO ] [MAIN ] CMU: Loaded 7267 existing records. [2025-09-25T18:03:33.369963] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:33.370335] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-25T18:03:33.370384] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-25T18:03:33.370558] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-25T18:03:33.370616] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-25T18:03:33.480989] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T18:03:33.491867] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-25T18:03:33.751187] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:34.288711] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-25T18:03:34.806983] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:03:34.996630] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T18:03:34.998457] [INFO ] [REMOTE ] CMSD: Full fetch complete (12517 records). [2025-09-25T18:03:34.998536] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-25T18:03:35.093830] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-25T18:03:35.373581] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-25T18:03:35.373692] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-25T18:03:35.374023] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-25T18:03:35.374063] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-25T18:03:35.374604] [DEBUG] [LOCAL ] CMSD: Trimmed 12517 records to 8149 (keeping 200 days of data) [2025-09-25T18:03:35.425776] [DEBUG] [LOCAL ] CMSD: Primary data saved (8149 records). [2025-09-25T18:03:35.425923] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-25T18:03:35.426012] [INFO ] [MAIN ] Update Progress: 483/2372 symbols completed. CMSD took 26.4s. Estimated remaining: 4h 8m 30s. Rate: 7.6 symbols/min [2025-09-25T18:03:35.596212] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:35.628071] [DEBUG] [LOCAL ] CNA: Loaded 32762 existing records from primary storage. [2025-09-25T18:03:35.628217] [INFO ] [MAIN ] CNA: Loaded 32762 existing records. [2025-09-25T18:03:35.804854] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:35.805124] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-25T18:03:35.805171] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-25T18:03:35.805429] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-25T18:03:35.805488] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-25T18:03:35.894733] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-25T18:03:36.166759] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:36.694580] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-25T18:03:36.700968] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T18:03:37.370499] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T18:03:37.488667] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-25T18:03:37.910740] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:03:38.288747] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-25T18:03:38.980335] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T18:03:39.088748] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-25T18:03:39.095117] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:03:39.888703] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-25T18:03:40.282386] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T18:03:40.590433] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T18:03:40.688721] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-25T18:03:41.488730] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-25T18:03:42.094557] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T18:03:42.288765] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-25T18:03:42.758582] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T18:03:43.088777] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-25T18:03:43.737799] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T18:03:43.888731] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-25T18:03:44.688734] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-25T18:03:44.907021] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T18:03:45.204036] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T18:03:45.475796] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T18:03:45.488669] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-25T18:03:46.288724] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-25T18:03:46.803999] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:03:47.088711] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-25T18:03:47.105379] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T18:03:47.888736] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-25T18:03:48.685315] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T18:03:48.692941] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-25T18:03:49.488770] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-25T18:03:49.708754] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T18:03:49.779009] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T18:03:50.288751] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-25T18:03:50.836752] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T18:03:51.021443] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T18:03:51.088718] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-25T18:03:51.560750] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-25T18:03:51.888730] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-25T18:03:52.688758] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-25T18:03:52.849762] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T18:03:53.488744] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-25T18:03:53.526492] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T18:03:54.288748] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-25T18:03:55.088681] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-25T18:03:55.176399] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T18:03:55.628770] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T18:03:55.888727] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-25T18:03:56.515340] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:03:56.688706] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-25T18:03:57.447697] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T18:03:57.488679] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-25T18:03:58.153885] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T18:03:58.160274] [INFO ] [REMOTE ] CMTG: Full fetch complete (53392 records). [2025-09-25T18:03:58.160391] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-25T18:03:58.302181] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-25T18:03:58.559911] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-25T18:03:58.560018] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-25T18:03:58.560702] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-25T18:03:58.560769] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-25T18:03:58.564843] [DEBUG] [LOCAL ] CMTG: Trimmed 53392 records to 37770 (keeping 200 days of data) [2025-09-25T18:03:58.776525] [DEBUG] [LOCAL ] CMTG: Primary data saved (37770 records). [2025-09-25T18:03:58.776737] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-25T18:03:58.776839] [INFO ] [MAIN ] Update Progress: 484/2372 symbols completed. CMTG took 33.8s. Estimated remaining: 4h 9m 23s. Rate: 7.6 symbols/min [2025-09-25T18:03:58.956056] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:03:58.992700] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:03:59.034341] [DEBUG] [LOCAL ] CNC: Loaded 53738 existing records from primary storage. [2025-09-25T18:03:59.034484] [INFO ] [MAIN ] CNC: Loaded 53738 existing records. [2025-09-25T18:03:59.097800] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-25T18:03:59.216526] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:03:59.216829] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-25T18:03:59.216878] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-25T18:03:59.217128] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-25T18:03:59.217187] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-25T18:03:59.576346] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:03:59.755823] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T18:03:59.888749] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-25T18:03:59.989106] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T18:03:59.998952] [INFO ] [REMOTE ] CMS: Full fetch complete (76015 records). [2025-09-25T18:03:59.999155] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-25T18:04:00.407755] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-25T18:04:00.407845] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-25T18:04:00.408760] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-25T18:04:00.408826] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-25T18:04:00.410342] [DEBUG] [LOCAL ] CMS: Trimmed 76015 records to 52986 (keeping 200 days of data) [2025-09-25T18:04:00.693067] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-25T18:04:00.739743] [DEBUG] [LOCAL ] CMS: Primary data saved (52986 records). [2025-09-25T18:04:00.739901] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-25T18:04:00.741691] [INFO ] [MAIN ] Update Progress: 485/2372 symbols completed. CMS took 51.8s. Estimated remaining: 4h 8m 51s. Rate: 7.6 symbols/min [2025-09-25T18:04:00.916634] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:00.930522] [DEBUG] [LOCAL ] CNF: Loaded 10918 existing records from primary storage. [2025-09-25T18:04:00.930674] [INFO ] [MAIN ] CNF: Loaded 10918 existing records. [2025-09-25T18:04:01.117014] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:01.117377] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-25T18:04:01.117438] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-25T18:04:01.117698] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-25T18:04:01.117757] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-25T18:04:01.493808] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-25T18:04:01.502447] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:01.509803] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T18:04:01.511735] [INFO ] [REMOTE ] CMU: Full fetch complete (9653 records). [2025-09-25T18:04:01.512054] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-25T18:04:01.994008] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-25T18:04:01.994136] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-25T18:04:01.994577] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-25T18:04:01.994708] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-25T18:04:01.995718] [DEBUG] [LOCAL ] CMU: Trimmed 9653 records to 7283 (keeping 200 days of data) [2025-09-25T18:04:02.071820] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-25T18:04:02.093112] [DEBUG] [LOCAL ] CMU: Primary data saved (7283 records). [2025-09-25T18:04:02.093276] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-25T18:04:02.093375] [INFO ] [MAIN ] Update Progress: 486/2372 symbols completed. CMU took 29.1s. Estimated remaining: 4h 8m 18s. Rate: 7.6 symbols/min [2025-09-25T18:04:02.266903] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:02.288702] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-25T18:04:02.334185] [DEBUG] [LOCAL ] CNH: Loaded 53559 existing records from primary storage. [2025-09-25T18:04:02.334330] [INFO ] [MAIN ] CNH: Loaded 53559 existing records. [2025-09-25T18:04:02.511621] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:02.511902] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-25T18:04:02.511950] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-25T18:04:02.512180] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-25T18:04:02.512246] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-25T18:04:02.874612] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:03.088708] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-25T18:04:03.122187] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:04:03.598460] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T18:04:03.809156] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T18:04:03.888690] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-25T18:04:04.688738] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-25T18:04:05.291752] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T18:04:05.488782] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-25T18:04:05.939599] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T18:04:06.020668] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-25T18:04:06.288785] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-25T18:04:07.088726] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-25T18:04:07.888697] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-25T18:04:08.092888] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T18:04:08.415516] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:04:08.421930] [INFO ] [REMOTE ] CNA: Full fetch complete (45507 records). [2025-09-25T18:04:08.422022] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-25T18:04:08.698236] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-25T18:04:08.815967] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-25T18:04:08.816064] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-25T18:04:08.816777] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-25T18:04:08.816839] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-25T18:04:08.819078] [DEBUG] [LOCAL ] CNA: Trimmed 45507 records to 32996 (keeping 200 days of data) [2025-09-25T18:04:09.026679] [DEBUG] [LOCAL ] CNA: Primary data saved (32996 records). [2025-09-25T18:04:09.026824] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-25T18:04:09.026931] [INFO ] [MAIN ] Update Progress: 487/2372 symbols completed. CNA took 33.6s. Estimated remaining: 4h 8m 6s. Rate: 7.6 symbols/min [2025-09-25T18:04:09.197084] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:09.264692] [DEBUG] [LOCAL ] CNI: Loaded 51659 existing records from primary storage. [2025-09-25T18:04:09.265430] [INFO ] [MAIN ] CNI: Loaded 51659 existing records. [2025-09-25T18:04:09.455115] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:09.455424] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-25T18:04:09.455486] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-25T18:04:09.455880] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-25T18:04:09.455956] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-25T18:04:09.499482] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-25T18:04:09.835872] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:09.868132] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T18:04:10.216232] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T18:04:10.288701] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-25T18:04:10.371059] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T18:04:11.088728] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-25T18:04:11.704605] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T18:04:11.888714] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-25T18:04:12.033098] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T18:04:12.688717] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-25T18:04:13.488743] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-25T18:04:13.722209] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T18:04:14.288732] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-25T18:04:14.465216] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:04:15.077005] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:04:15.084073] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:04:15.094374] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-25T18:04:15.888707] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-25T18:04:16.111056] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T18:04:16.688748] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-25T18:04:17.426571] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T18:04:17.488712] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-25T18:04:18.288749] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-25T18:04:18.486298] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T18:04:18.967264] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T18:04:19.088726] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-25T18:04:19.149197] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T18:04:19.888793] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-25T18:04:20.688680] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-25T18:04:20.784307] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T18:04:20.899862] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T18:04:21.488752] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-25T18:04:22.288699] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-25T18:04:22.464464] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T18:04:22.486190] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T18:04:22.489813] [INFO ] [REMOTE ] CNF: Full fetch complete (12664 records). [2025-09-25T18:04:22.489916] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-25T18:04:22.490776] [FATAL] [VALIDATOR ] CNF: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:04:22.490867] [FATAL] [MAIN ] CNF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:04:22.490932] [WARN ] [MAIN ] CNF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:04:22.490999] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-25T18:04:22.491074] [DEBUG] [LOCAL ] CNF: No primary data file found to delete. [2025-09-25T18:04:22.491128] [INFO ] [LOCAL ] CNF: Starting deletion of derivative data. [2025-09-25T18:04:22.491514] [DEBUG] [LOCAL ] CNF: Deleted derivative data file. [2025-09-25T18:04:22.491683] [INFO ] [MAIN ] Update Progress: 488/2372 symbols completed. CNF took 21.7s. Estimated remaining: 4h 8m 20s. Rate: 7.6 symbols/min [2025-09-25T18:04:22.676078] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:22.752690] [DEBUG] [LOCAL ] CNK: Loaded 52902 existing records from primary storage. [2025-09-25T18:04:22.752843] [INFO ] [MAIN ] CNK: Loaded 52902 existing records. [2025-09-25T18:04:22.937966] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:22.938230] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-25T18:04:22.938280] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-25T18:04:22.938533] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-25T18:04:22.938593] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-25T18:04:23.094003] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-25T18:04:23.315992] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:23.888755] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-25T18:04:24.128977] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T18:04:24.688713] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-25T18:04:24.997272] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T18:04:25.488764] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-25T18:04:25.642371] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:04:26.222791] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:04:26.288721] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-25T18:04:27.088688] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-25T18:04:27.186211] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T18:04:27.888734] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-25T18:04:28.047332] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T18:04:28.466934] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T18:04:28.688774] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-25T18:04:29.488797] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-25T18:04:29.765316] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:04:30.288736] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-25T18:04:31.088691] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-25T18:04:31.180828] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T18:04:31.306166] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-25T18:04:31.893935] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-25T18:04:31.911918] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:04:32.671456] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T18:04:32.681274] [INFO ] [REMOTE ] CNH: Full fetch complete (77533 records). [2025-09-25T18:04:32.681430] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-25T18:04:32.694085] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-25T18:04:33.081964] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-25T18:04:33.082053] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-25T18:04:33.082882] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-25T18:04:33.082945] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-25T18:04:33.084505] [DEBUG] [LOCAL ] CNH: Trimmed 77533 records to 53949 (keeping 200 days of data) [2025-09-25T18:04:33.431507] [DEBUG] [LOCAL ] CNH: Primary data saved (53949 records). [2025-09-25T18:04:33.431740] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-25T18:04:33.432503] [INFO ] [MAIN ] Update Progress: 489/2372 symbols completed. CNH took 31.3s. Estimated remaining: 4h 8m 24s. Rate: 7.6 symbols/min [2025-09-25T18:04:33.496586] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-25T18:04:33.608627] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:33.665253] [DEBUG] [LOCAL ] CNM: Loaded 50969 existing records from primary storage. [2025-09-25T18:04:33.665399] [INFO ] [MAIN ] CNM: Loaded 50969 existing records. [2025-09-25T18:04:33.849533] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:33.850006] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-25T18:04:33.850109] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-25T18:04:33.850422] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-25T18:04:33.850485] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-25T18:04:33.985577] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-25T18:04:34.264538] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:34.288709] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-25T18:04:34.856235] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T18:04:35.088743] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-25T18:04:35.333339] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:04:35.888757] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-25T18:04:36.147979] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T18:04:36.688728] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-25T18:04:37.386006] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:04:37.496632] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-25T18:04:37.514324] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-25T18:04:37.524478] [INFO ] [REMOTE ] CNC: Full fetch complete (77673 records). [2025-09-25T18:04:37.524597] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-25T18:04:37.927337] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-25T18:04:37.927416] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-25T18:04:37.928277] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-25T18:04:37.928340] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-25T18:04:37.933087] [DEBUG] [LOCAL ] CNC: Trimmed 77673 records to 54128 (keeping 200 days of data) [2025-09-25T18:04:38.268037] [DEBUG] [LOCAL ] CNC: Primary data saved (54128 records). [2025-09-25T18:04:38.268171] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-25T18:04:38.268292] [INFO ] [MAIN ] Update Progress: 490/2372 symbols completed. CNC took 39.5s. Estimated remaining: 4h 8m 4s. Rate: 7.6 symbols/min [2025-09-25T18:04:38.290788] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-25T18:04:38.472605] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:38.474715] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T18:04:38.516339] [DEBUG] [LOCAL ] CNMD: Loaded 32356 existing records from primary storage. [2025-09-25T18:04:38.516476] [INFO ] [MAIN ] CNMD: Loaded 32356 existing records. [2025-09-25T18:04:38.696384] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:38.696718] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-25T18:04:38.696843] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-25T18:04:38.697074] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-25T18:04:38.697131] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-25T18:04:39.071066] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:39.099408] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-25T18:04:39.105418] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T18:04:39.888732] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-25T18:04:40.219900] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T18:04:40.678455] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T18:04:40.688810] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-25T18:04:41.488681] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-25T18:04:41.898318] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T18:04:41.908870] [INFO ] [REMOTE ] CNI: Full fetch complete (74681 records). [2025-09-25T18:04:41.909015] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-25T18:04:42.290903] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-25T18:04:42.356849] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-25T18:04:42.357102] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-25T18:04:42.358133] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-25T18:04:42.358218] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-25T18:04:42.359970] [DEBUG] [LOCAL ] CNI: Trimmed 74681 records to 52046 (keeping 200 days of data) [2025-09-25T18:04:42.489965] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T18:04:42.739099] [DEBUG] [LOCAL ] CNI: Primary data saved (52046 records). [2025-09-25T18:04:42.739252] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-25T18:04:42.739362] [INFO ] [MAIN ] Update Progress: 491/2372 symbols completed. CNI took 33.7s. Estimated remaining: 4h 7m 43s. Rate: 7.6 symbols/min [2025-09-25T18:04:42.928443] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:42.968205] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T18:04:42.989358] [DEBUG] [LOCAL ] CNNE: Loaded 36748 existing records from primary storage. [2025-09-25T18:04:42.989517] [INFO ] [MAIN ] CNNE: Loaded 36748 existing records. [2025-09-25T18:04:43.091580] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-25T18:04:43.174085] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:04:43.174435] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-25T18:04:43.174493] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-25T18:04:43.174787] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-25T18:04:43.174867] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-25T18:04:43.593079] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:04:43.888691] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-25T18:04:44.017857] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:04:44.688749] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-25T18:04:44.922942] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T18:04:45.182541] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:04:45.488727] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-25T18:04:46.217842] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T18:04:46.288742] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-25T18:04:46.967758] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T18:04:47.088727] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-25T18:04:47.888700] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-25T18:04:48.081207] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T18:04:48.339011] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T18:04:48.688728] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-25T18:04:49.356980] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-25T18:04:49.488773] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-25T18:04:49.816928] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-25T18:04:50.288714] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-25T18:04:51.098945] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-25T18:04:51.104533] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T18:04:51.470230] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T18:04:51.888774] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-25T18:04:52.688730] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-25T18:04:53.033335] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T18:04:53.090180] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T18:04:53.488908] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-25T18:04:54.142622] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T18:04:54.288713] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-25T18:04:54.600016] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T18:04:55.088712] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-25T18:04:55.888723] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-25T18:04:55.929398] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T18:04:56.479489] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T18:04:56.688727] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-25T18:04:57.488754] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-25T18:04:57.847419] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T18:04:58.288750] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-25T18:04:58.546625] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T18:04:58.578522] [INFO ] [REMOTE ] CNK: Full fetch complete (75700 records). [2025-09-25T18:04:58.592110] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-25T18:04:58.594399] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T18:04:59.093837] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-25T18:04:59.230101] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-25T18:04:59.230230] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-25T18:04:59.231705] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-25T18:04:59.231812] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-25T18:04:59.233831] [DEBUG] [LOCAL ] CNK: Trimmed 75700 records to 53281 (keeping 200 days of data) [2025-09-25T18:04:59.599828] [DEBUG] [LOCAL ] CNK: Primary data saved (53281 records). [2025-09-25T18:04:59.599980] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-25T18:04:59.600774] [INFO ] [MAIN ] Update Progress: 492/2372 symbols completed. CNK took 37.1s. Estimated remaining: 4h 8m 9s. Rate: 7.6 symbols/min [2025-09-25T18:04:59.807008] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:04:59.855873] [DEBUG] [LOCAL ] CNO: Loaded 41382 existing records from primary storage. [2025-09-25T18:04:59.856053] [INFO ] [MAIN ] CNO: Loaded 41382 existing records. [2025-09-25T18:04:59.893825] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-25T18:05:00.057556] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:00.057922] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-25T18:05:00.058112] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-25T18:05:00.058420] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-25T18:05:00.058485] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-25T18:05:00.288009] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T18:05:00.364735] [INFO ] [REMOTE ] CNM: Full fetch complete (73612 records). [2025-09-25T18:05:00.377490] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-25T18:05:00.649192] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:00.695760] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-25T18:05:00.821101] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:05:00.973738] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-25T18:05:00.973850] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-25T18:05:00.974748] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-25T18:05:00.974814] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-25T18:05:00.976357] [DEBUG] [LOCAL ] CNM: Trimmed 73612 records to 51358 (keeping 200 days of data) [2025-09-25T18:05:01.271903] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T18:05:01.323373] [DEBUG] [LOCAL ] CNM: Primary data saved (51358 records). [2025-09-25T18:05:01.323518] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-25T18:05:01.324354] [INFO ] [MAIN ] Update Progress: 493/2372 symbols completed. CNM took 27.9s. Estimated remaining: 4h 7m 38s. Rate: 7.6 symbols/min [2025-09-25T18:05:01.502512] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:01.498028] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-25T18:05:01.559742] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-25T18:05:01.559910] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-25T18:05:01.780805] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:01.781109] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-25T18:05:01.781163] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-25T18:05:01.781401] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-25T18:05:01.781461] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-25T18:05:02.206902] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:02.249734] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T18:05:02.288709] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-25T18:05:02.879409] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T18:05:03.088721] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-25T18:05:03.745005] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T18:05:03.888685] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-25T18:05:04.688698] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-25T18:05:04.713227] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T18:05:05.488722] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-25T18:05:05.845356] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T18:05:06.288775] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-25T18:05:06.338996] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T18:05:07.088710] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-25T18:05:07.117411] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:05:07.856806] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T18:05:07.888671] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-25T18:05:08.163097] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T18:05:08.688729] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-25T18:05:09.488717] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-25T18:05:09.783223] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T18:05:10.248814] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T18:05:10.256093] [INFO ] [REMOTE ] CNNE: Full fetch complete (49366 records). [2025-09-25T18:05:10.256217] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-25T18:05:10.293836] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-25T18:05:10.660243] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-25T18:05:10.660332] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-25T18:05:10.660996] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-25T18:05:10.661059] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-25T18:05:10.662203] [DEBUG] [LOCAL ] CNNE: Trimmed 49366 records to 37006 (keeping 200 days of data) [2025-09-25T18:05:10.898068] [DEBUG] [LOCAL ] CNNE: Primary data saved (37006 records). [2025-09-25T18:05:10.898214] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-25T18:05:10.898310] [INFO ] [MAIN ] Update Progress: 494/2372 symbols completed. CNNE took 28.2s. Estimated remaining: 4h 7m 36s. Rate: 7.6 symbols/min [2025-09-25T18:05:11.102529] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:11.098558] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-25T18:05:11.131490] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T18:05:11.187072] [DEBUG] [LOCAL ] CNQ: Loaded 53582 existing records from primary storage. [2025-09-25T18:05:11.187222] [INFO ] [MAIN ] CNQ: Loaded 53582 existing records. [2025-09-25T18:05:11.385475] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:11.385749] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-25T18:05:11.385811] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-25T18:05:11.386168] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-25T18:05:11.386226] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-25T18:05:11.747906] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:11.865610] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T18:05:11.888700] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-25T18:05:12.095099] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T18:05:12.101066] [INFO ] [REMOTE ] CNMD: Full fetch complete (47099 records). [2025-09-25T18:05:12.101190] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-25T18:05:12.500463] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-25T18:05:12.500562] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-25T18:05:12.501238] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-25T18:05:12.501306] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-25T18:05:12.502669] [DEBUG] [LOCAL ] CNMD: Trimmed 47099 records to 32633 (keeping 200 days of data) [2025-09-25T18:05:12.690683] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-25T18:05:12.714012] [DEBUG] [LOCAL ] CNMD: Primary data saved (32633 records). [2025-09-25T18:05:12.714176] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-25T18:05:12.714275] [INFO ] [MAIN ] Update Progress: 495/2372 symbols completed. CNMD took 34.4s. Estimated remaining: 4h 7m 5s. Rate: 7.6 symbols/min [2025-09-25T18:05:12.908397] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:12.908568] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-25T18:05:12.908604] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-25T18:05:12.908772] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-25T18:05:12.908816] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-25T18:05:12.908857] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-25T18:05:12.908889] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-25T18:05:13.271265] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:13.390738] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T18:05:13.488673] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-25T18:05:14.288781] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-25T18:05:14.485450] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:05:14.485829] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-25T18:05:14.604551] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T18:05:15.088734] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-25T18:05:15.340031] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T18:05:15.888751] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-25T18:05:16.546183] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T18:05:16.688735] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-25T18:05:17.371285] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T18:05:17.488697] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-25T18:05:18.280084] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T18:05:18.290961] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-25T18:05:19.057858] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:05:19.088672] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-25T18:05:19.805812] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T18:05:19.888709] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-25T18:05:20.254865] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T18:05:20.688734] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-25T18:05:21.360453] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T18:05:21.488743] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-25T18:05:22.288759] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-25T18:05:22.410581] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T18:05:22.798898] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T18:05:23.088826] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-25T18:05:23.531332] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:05:23.888717] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-25T18:05:24.433880] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T18:05:24.688748] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-25T18:05:25.198940] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T18:05:25.488737] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-25T18:05:26.291899] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-25T18:05:26.297523] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T18:05:27.088752] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-25T18:05:27.234936] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:05:27.733689] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T18:05:27.888719] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-25T18:05:28.669806] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:05:28.688676] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-25T18:05:29.488722] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-25T18:05:29.659009] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T18:05:30.288765] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-25T18:05:30.357050] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:05:30.364733] [INFO ] [REMOTE ] CNO: Full fetch complete (60643 records). [2025-09-25T18:05:30.364842] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-25T18:05:30.757029] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-25T18:05:30.757108] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-25T18:05:30.757802] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-25T18:05:30.757864] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-25T18:05:30.759308] [DEBUG] [LOCAL ] CNO: Trimmed 60643 records to 41654 (keeping 200 days of data) [2025-09-25T18:05:31.019417] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T18:05:31.050581] [DEBUG] [LOCAL ] CNO: Primary data saved (41654 records). [2025-09-25T18:05:31.050733] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-25T18:05:31.050820] [INFO ] [MAIN ] Update Progress: 496/2372 symbols completed. CNO took 31.4s. Estimated remaining: 4h 7m 37s. Rate: 7.6 symbols/min [2025-09-25T18:05:31.093816] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-25T18:05:31.225552] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:31.225791] [DEBUG] [LOCAL ] CNS: No existing data file found in primary storage. [2025-09-25T18:05:31.225846] [WARN ] [MAIN ] CNS: No existing data found, performing full refresh instead. [2025-09-25T18:05:31.226056] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-25T18:05:31.226110] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-25T18:05:31.226154] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-09-25T18:05:31.226187] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-25T18:05:31.588251] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:31.888756] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-25T18:05:32.137032] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T18:05:32.688734] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-25T18:05:33.000695] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T18:05:33.061165] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T18:05:33.488731] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-25T18:05:33.976398] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:05:34.288744] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-25T18:05:34.840303] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T18:05:34.848729] [INFO ] [REMOTE ] CNR: Full fetch complete (56537 records). [2025-09-25T18:05:34.848854] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-25T18:05:35.041160] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-25T18:05:35.041901] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:05:35.041978] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:05:35.042028] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-25T18:05:35.042129] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-25T18:05:35.042188] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-25T18:05:35.042232] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-25T18:05:35.042312] [INFO ] [MAIN ] Update Progress: 497/2372 symbols completed. CNR took 22.3s. Estimated remaining: 4h 7m 14s. Rate: 7.6 symbols/min [2025-09-25T18:05:35.099853] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-25T18:05:35.230975] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:35.282032] [DEBUG] [LOCAL ] CNX: Loaded 51382 existing records from primary storage. [2025-09-25T18:05:35.282232] [INFO ] [MAIN ] CNX: Loaded 51382 existing records. [2025-09-25T18:05:35.467152] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:35.467424] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-25T18:05:35.467472] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-25T18:05:35.467805] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-25T18:05:35.467865] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-25T18:05:35.837092] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:35.888673] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-25T18:05:36.064897] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:05:36.133339] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T18:05:36.688806] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-25T18:05:37.488756] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-25T18:05:37.670586] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:05:38.288807] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-25T18:05:38.496910] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T18:05:38.506780] [INFO ] [REMOTE ] CNP: Full fetch complete (77365 records). [2025-09-25T18:05:38.506924] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-25T18:05:38.858005] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T18:05:38.956002] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-25T18:05:38.956086] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-25T18:05:38.956913] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-25T18:05:38.956977] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-25T18:05:38.958438] [DEBUG] [LOCAL ] CNP: Trimmed 77365 records to 53859 (keeping 200 days of data) [2025-09-25T18:05:39.138885] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-25T18:05:39.297922] [DEBUG] [LOCAL ] CNP: Primary data saved (53859 records). [2025-09-25T18:05:39.298063] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-25T18:05:39.299152] [INFO ] [MAIN ] Update Progress: 498/2372 symbols completed. CNP took 38.0s. Estimated remaining: 4h 6m 52s. Rate: 7.6 symbols/min [2025-09-25T18:05:39.472186] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:39.511783] [DEBUG] [LOCAL ] CODI: Loaded 39726 existing records from primary storage. [2025-09-25T18:05:39.511915] [INFO ] [MAIN ] CODI: Loaded 39726 existing records. [2025-09-25T18:05:39.695259] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:39.695636] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-25T18:05:39.695739] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-25T18:05:39.696097] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-25T18:05:39.696156] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-25T18:05:39.894252] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-25T18:05:40.078506] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:40.106835] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T18:05:40.131061] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T18:05:40.688775] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-25T18:05:41.488719] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-25T18:05:41.851809] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T18:05:42.049256] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T18:05:42.288795] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-25T18:05:42.721318] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T18:05:43.088752] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-25T18:05:43.888694] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-25T18:05:44.203055] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T18:05:44.646156] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T18:05:44.681796] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T18:05:44.688665] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-25T18:05:45.488722] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-25T18:05:46.080963] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T18:05:46.288709] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-25T18:05:46.994317] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T18:05:47.088730] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-25T18:05:47.179893] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T18:05:47.888689] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-25T18:05:48.116441] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T18:05:48.688720] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-25T18:05:49.488786] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-25T18:05:49.776426] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T18:05:49.786348] [INFO ] [REMOTE ] CNQ: Full fetch complete (77547 records). [2025-09-25T18:05:49.786561] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-25T18:05:50.167871] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T18:05:50.255042] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-25T18:05:50.255171] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-25T18:05:50.256367] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-25T18:05:50.256447] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-25T18:05:50.258845] [DEBUG] [LOCAL ] CNQ: Trimmed 77547 records to 53971 (keeping 200 days of data) [2025-09-25T18:05:50.315265] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-25T18:05:50.496689] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T18:05:50.620303] [DEBUG] [LOCAL ] CNQ: Primary data saved (53971 records). [2025-09-25T18:05:50.620473] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-25T18:05:50.620560] [INFO ] [MAIN ] Update Progress: 499/2372 symbols completed. CNQ took 39.7s. Estimated remaining: 4h 6m 57s. Rate: 7.6 symbols/min [2025-09-25T18:05:50.792133] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:50.844792] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-25T18:05:50.844939] [INFO ] [MAIN ] COF: Loaded 53610 existing records. [2025-09-25T18:05:51.028567] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:51.028873] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-25T18:05:51.028941] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-25T18:05:51.029377] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-25T18:05:51.029435] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-25T18:05:51.100076] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-25T18:05:51.567754] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:51.605347] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T18:05:51.888784] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-25T18:05:52.256107] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T18:05:52.688761] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-25T18:05:53.488710] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-25T18:05:53.688683] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T18:05:53.831145] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T18:05:54.288748] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-25T18:05:55.088722] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-25T18:05:55.390366] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T18:05:55.418354] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T18:05:55.888734] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-25T18:05:56.688783] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-25T18:05:56.798295] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T18:05:57.225634] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T18:05:57.488799] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-25T18:05:57.857229] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T18:05:57.862044] [INFO ] [REMOTE ] CNS: Full fetch complete (29955 records). [2025-09-25T18:05:57.862248] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-25T18:05:58.269337] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-25T18:05:58.269482] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-25T18:05:58.270223] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-25T18:05:58.270291] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-25T18:05:58.271630] [DEBUG] [LOCAL ] CNS: Trimmed 29955 records to 21094 (keeping 200 days of data) [2025-09-25T18:05:58.326618] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-25T18:05:58.412750] [DEBUG] [LOCAL ] CNS: Primary data saved (21094 records). [2025-09-25T18:05:58.412954] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-25T18:05:58.413055] [INFO ] [MAIN ] Update Progress: 500/2372 symbols completed. CNS took 27.4s. Estimated remaining: 4h 6m 49s. Rate: 7.6 symbols/min [2025-09-25T18:05:58.605607] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:05:58.663797] [DEBUG] [LOCAL ] COHR: Loaded 53364 existing records from primary storage. [2025-09-25T18:05:58.664028] [INFO ] [MAIN ] COHR: Loaded 53364 existing records. [2025-09-25T18:05:58.855609] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:05:58.855986] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-25T18:05:58.856041] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-25T18:05:58.856391] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-25T18:05:58.856452] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-25T18:05:59.093059] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-25T18:05:59.263736] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:05:59.295529] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T18:05:59.722900] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T18:05:59.888723] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-25T18:06:00.512300] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T18:06:00.688749] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-25T18:06:01.488772] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-25T18:06:01.632683] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T18:06:02.144853] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T18:06:02.288718] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-25T18:06:03.088725] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-25T18:06:03.761298] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-25T18:06:03.888684] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-25T18:06:03.964010] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T18:06:03.973427] [INFO ] [REMOTE ] CODI: Full fetch complete (50520 records). [2025-09-25T18:06:03.973558] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-25T18:06:04.366778] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-25T18:06:04.366858] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-25T18:06:04.367476] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-25T18:06:04.367571] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-25T18:06:04.368744] [DEBUG] [LOCAL ] CODI: Trimmed 50520 records to 40015 (keeping 200 days of data) [2025-09-25T18:06:04.610431] [DEBUG] [LOCAL ] CODI: Primary data saved (40015 records). [2025-09-25T18:06:04.610604] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-25T18:06:04.610747] [INFO ] [MAIN ] Update Progress: 501/2372 symbols completed. CODI took 25.3s. Estimated remaining: 4h 6m 35s. Rate: 7.6 symbols/min [2025-09-25T18:06:04.693808] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-25T18:06:04.809791] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:04.810183] [DEBUG] [LOCAL ] COLD: No existing data file found in primary storage. [2025-09-25T18:06:04.810262] [WARN ] [MAIN ] COLD: No existing data found, performing full refresh instead. [2025-09-25T18:06:04.810526] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-25T18:06:04.810590] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-25T18:06:04.810687] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-09-25T18:06:04.810750] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-25T18:06:05.219619] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:05.254997] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-25T18:06:05.488730] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-25T18:06:05.820572] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T18:06:06.288713] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-25T18:06:06.538942] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T18:06:06.809977] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T18:06:07.088732] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-25T18:06:07.888729] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-25T18:06:07.978686] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T18:06:08.666339] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T18:06:08.688664] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-25T18:06:09.488702] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-25T18:06:09.562156] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:06:10.163896] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T18:06:10.288670] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-25T18:06:11.088728] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-25T18:06:11.566930] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T18:06:11.658400] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T18:06:11.668191] [INFO ] [REMOTE ] CNX: Full fetch complete (74778 records). [2025-09-25T18:06:11.668356] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-25T18:06:11.897880] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-25T18:06:12.105129] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-25T18:06:12.105226] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-25T18:06:12.106979] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-25T18:06:12.107076] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-25T18:06:12.114309] [DEBUG] [LOCAL ] CNX: Trimmed 74778 records to 51770 (keeping 200 days of data) [2025-09-25T18:06:12.423975] [DEBUG] [LOCAL ] CNX: Primary data saved (51770 records). [2025-09-25T18:06:12.424121] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-25T18:06:12.424244] [INFO ] [MAIN ] Update Progress: 502/2372 symbols completed. CNX took 37.4s. Estimated remaining: 4h 6m 26s. Rate: 7.6 symbols/min [2025-09-25T18:06:12.597848] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:12.656156] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-25T18:06:12.656324] [INFO ] [MAIN ] COMP: Loaded 53386 existing records. [2025-09-25T18:06:12.712002] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-25T18:06:12.849111] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:12.849677] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-25T18:06:12.849777] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-25T18:06:12.850183] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-25T18:06:12.850320] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-25T18:06:13.219090] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:13.249717] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-25T18:06:13.425736] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T18:06:13.488672] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-25T18:06:14.288722] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-25T18:06:14.888489] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T18:06:15.097879] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-25T18:06:15.118172] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T18:06:15.802269] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T18:06:15.888734] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-25T18:06:16.688745] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-25T18:06:16.970347] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T18:06:17.023805] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T18:06:17.488797] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-25T18:06:18.299142] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-25T18:06:18.326379] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T18:06:19.088792] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-25T18:06:19.471203] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T18:06:19.888785] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-25T18:06:20.175196] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:06:20.688680] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-25T18:06:21.106781] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T18:06:21.488720] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-25T18:06:21.700157] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T18:06:22.288767] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-25T18:06:22.612475] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T18:06:23.088693] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-25T18:06:23.149590] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T18:06:23.887217] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T18:06:23.897472] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-25T18:06:24.688790] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-25T18:06:25.103037] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T18:06:25.488728] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-25T18:06:26.018365] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T18:06:26.288704] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-25T18:06:26.334927] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T18:06:26.345065] [INFO ] [REMOTE ] COLD: Full fetch complete (74149 records). [2025-09-25T18:06:26.345214] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-25T18:06:26.811557] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-25T18:06:26.811679] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-25T18:06:26.812905] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-25T18:06:26.812970] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-25T18:06:26.814907] [DEBUG] [LOCAL ] COLD: Trimmed 74149 records to 52395 (keeping 200 days of data) [2025-09-25T18:06:27.090390] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-25T18:06:27.184699] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:06:27.214528] [DEBUG] [LOCAL ] COLD: Primary data saved (52395 records). [2025-09-25T18:06:27.214708] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-25T18:06:27.214805] [INFO ] [MAIN ] Update Progress: 503/2372 symbols completed. COLD took 22.6s. Estimated remaining: 4h 6m 44s. Rate: 7.6 symbols/min [2025-09-25T18:06:27.383724] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:27.428404] [DEBUG] [LOCAL ] CON: Loaded 38732 existing records from primary storage. [2025-09-25T18:06:27.428552] [INFO ] [MAIN ] CON: Loaded 38732 existing records. [2025-09-25T18:06:27.624130] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:27.624502] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-25T18:06:27.624573] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-25T18:06:27.624881] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-25T18:06:27.624941] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-25T18:06:27.894337] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-25T18:06:28.026572] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:28.084632] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T18:06:28.700524] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-25T18:06:28.706873] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T18:06:29.488680] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-25T18:06:29.629885] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T18:06:29.640111] [INFO ] [REMOTE ] COF: Full fetch complete (77399 records). [2025-09-25T18:06:29.640273] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-25T18:06:30.097142] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-25T18:06:30.097345] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-25T18:06:30.098294] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-25T18:06:30.098443] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-25T18:06:30.100111] [DEBUG] [LOCAL ] COF: Trimmed 77399 records to 54000 (keeping 200 days of data) [2025-09-25T18:06:30.272472] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:06:30.328170] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-25T18:06:30.507814] [DEBUG] [LOCAL ] COF: Primary data saved (54000 records). [2025-09-25T18:06:30.507989] [INFO ] [MAIN ] COF: Full history saved. [2025-09-25T18:06:30.508089] [INFO ] [MAIN ] Update Progress: 504/2372 symbols completed. COF took 39.9s. Estimated remaining: 4h 6m 19s. Rate: 7.6 symbols/min [2025-09-25T18:06:30.689080] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:30.713987] [DEBUG] [LOCAL ] COOK: Loaded 24510 existing records from primary storage. [2025-09-25T18:06:30.714156] [INFO ] [MAIN ] COOK: Loaded 24510 existing records. [2025-09-25T18:06:30.898103] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:30.898350] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-25T18:06:30.898400] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-25T18:06:30.898681] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-25T18:06:30.898742] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-25T18:06:31.116069] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-25T18:06:31.275490] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:31.698259] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T18:06:31.754521] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T18:06:31.888728] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-25T18:06:32.622931] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T18:06:32.688747] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-25T18:06:33.488741] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-25T18:06:33.676546] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T18:06:33.933388] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T18:06:33.944321] [INFO ] [REMOTE ] COHR: Full fetch complete (77107 records). [2025-09-25T18:06:33.944484] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-25T18:06:34.298924] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-25T18:06:34.351490] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-25T18:06:34.351574] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-25T18:06:34.352507] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-25T18:06:34.353149] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-25T18:06:34.354940] [DEBUG] [LOCAL ] COHR: Trimmed 77107 records to 53754 (keeping 200 days of data) [2025-09-25T18:06:34.687807] [DEBUG] [LOCAL ] COHR: Primary data saved (53754 records). [2025-09-25T18:06:34.687997] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-25T18:06:34.688717] [INFO ] [MAIN ] Update Progress: 505/2372 symbols completed. COHR took 36.3s. Estimated remaining: 4h 5m 57s. Rate: 7.6 symbols/min [2025-09-25T18:06:34.881474] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T18:06:34.884586] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:34.950065] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-25T18:06:34.950206] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-25T18:06:35.093871] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-25T18:06:35.132282] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:35.132609] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-25T18:06:35.132703] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-25T18:06:35.132939] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-25T18:06:35.132998] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-25T18:06:35.499252] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:35.888694] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-25T18:06:36.003269] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T18:06:36.041902] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T18:06:36.688716] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-25T18:06:37.234298] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T18:06:37.488713] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-25T18:06:37.665572] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:06:38.288774] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-25T18:06:39.088712] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-25T18:06:39.488253] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T18:06:39.681081] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T18:06:39.888696] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-25T18:06:40.389408] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T18:06:40.688757] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-25T18:06:41.488713] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-25T18:06:41.743537] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T18:06:42.288754] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-25T18:06:42.490015] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T18:06:42.994477] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T18:06:43.088721] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-25T18:06:43.888767] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-25T18:06:44.223195] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T18:06:44.353020] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T18:06:44.688796] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-25T18:06:45.042370] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-25T18:06:45.488751] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-25T18:06:46.150199] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T18:06:46.212345] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T18:06:46.288763] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-25T18:06:47.088780] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-25T18:06:47.487256] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T18:06:47.888777] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-25T18:06:48.688751] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-25T18:06:49.320306] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-25T18:06:49.359801] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:06:49.488724] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-25T18:06:50.288744] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-25T18:06:50.877376] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T18:06:50.887858] [INFO ] [REMOTE ] COMP: Full fetch complete (77084 records). [2025-09-25T18:06:50.888024] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-25T18:06:51.097758] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-25T18:06:51.307080] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-25T18:06:51.307202] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-25T18:06:51.308140] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-25T18:06:51.308306] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-25T18:06:51.310298] [DEBUG] [LOCAL ] COMP: Trimmed 77084 records to 53776 (keeping 200 days of data) [2025-09-25T18:06:51.445486] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-25T18:06:51.512221] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T18:06:51.722321] [DEBUG] [LOCAL ] COMP: Primary data saved (53776 records). [2025-09-25T18:06:51.722485] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-25T18:06:51.722611] [INFO ] [MAIN ] Update Progress: 506/2372 symbols completed. COMP took 39.3s. Estimated remaining: 4h 6m 23s. Rate: 7.6 symbols/min [2025-09-25T18:06:51.896058] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:51.893764] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-25T18:06:51.942877] [DEBUG] [LOCAL ] COR: Loaded 47251 existing records from primary storage. [2025-09-25T18:06:51.943041] [INFO ] [MAIN ] COR: Loaded 47251 existing records. [2025-09-25T18:06:52.124689] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:52.124958] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-25T18:06:52.125016] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-25T18:06:52.125299] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-25T18:06:52.125382] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-25T18:06:52.499175] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:52.516433] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T18:06:52.688682] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-25T18:06:53.488729] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-25T18:06:54.051672] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T18:06:54.288687] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-25T18:06:54.486821] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T18:06:54.498206] [INFO ] [REMOTE ] CON: Full fetch complete (57036 records). [2025-09-25T18:06:54.498410] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-25T18:06:54.707852] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T18:06:54.924092] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-25T18:06:54.924183] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-25T18:06:54.924896] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-25T18:06:54.924975] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-25T18:06:54.926328] [DEBUG] [LOCAL ] CON: Trimmed 57036 records to 39000 (keeping 200 days of data) [2025-09-25T18:06:55.108839] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-25T18:06:55.178181] [DEBUG] [LOCAL ] CON: Primary data saved (39000 records). [2025-09-25T18:06:55.178317] [INFO ] [MAIN ] CON: Full history saved. [2025-09-25T18:06:55.178411] [INFO ] [MAIN ] Update Progress: 507/2372 symbols completed. CON took 28.0s. Estimated remaining: 4h 5m 59s. Rate: 7.6 symbols/min [2025-09-25T18:06:55.353948] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:06:55.413129] [DEBUG] [LOCAL ] COTY: Loaded 53254 existing records from primary storage. [2025-09-25T18:06:55.413279] [INFO ] [MAIN ] COTY: Loaded 53254 existing records. [2025-09-25T18:06:55.590396] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:06:55.590687] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-25T18:06:55.590750] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-25T18:06:55.590996] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-25T18:06:55.591054] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-25T18:06:55.893410] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-25T18:06:55.965015] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:06:56.145156] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T18:06:56.560220] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T18:06:56.688726] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-25T18:06:57.385781] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:06:57.488730] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-25T18:06:58.288725] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-25T18:06:58.585591] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T18:06:59.088693] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-25T18:06:59.217617] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T18:06:59.397532] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T18:06:59.402719] [INFO ] [REMOTE ] COOK: Full fetch complete (32816 records). [2025-09-25T18:06:59.402821] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-25T18:06:59.774635] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-25T18:06:59.774741] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-25T18:06:59.775212] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-25T18:06:59.775251] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-25T18:06:59.776832] [DEBUG] [LOCAL ] COOK: Trimmed 32816 records to 24686 (keeping 200 days of data) [2025-09-25T18:06:59.893435] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-25T18:06:59.922051] [DEBUG] [LOCAL ] COOK: Primary data saved (24686 records). [2025-09-25T18:06:59.922563] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-25T18:06:59.922723] [INFO ] [MAIN ] Update Progress: 508/2372 symbols completed. COOK took 29.4s. Estimated remaining: 4h 5m 39s. Rate: 7.6 symbols/min [2025-09-25T18:07:00.095948] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:00.143666] [DEBUG] [LOCAL ] COUR: Loaded 48958 existing records from primary storage. [2025-09-25T18:07:00.143833] [INFO ] [MAIN ] COUR: Loaded 48958 existing records. [2025-09-25T18:07:00.322364] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:00.322637] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-25T18:07:00.322726] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-25T18:07:00.322973] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-25T18:07:00.323031] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-25T18:07:00.693535] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:00.693714] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-25T18:07:00.835917] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T18:07:01.247453] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:07:01.488723] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-25T18:07:02.288714] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-25T18:07:03.088689] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-25T18:07:03.137779] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-25T18:07:03.309554] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T18:07:03.639883] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:07:03.888723] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-25T18:07:04.688747] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-25T18:07:04.750955] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T18:07:05.488743] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-25T18:07:05.795177] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T18:07:06.288804] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-25T18:07:06.589380] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T18:07:06.599856] [INFO ] [REMOTE ] COP: Full fetch complete (77769 records). [2025-09-25T18:07:06.600029] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-25T18:07:07.010087] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-25T18:07:07.010195] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-25T18:07:07.011072] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-25T18:07:07.011238] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-25T18:07:07.012852] [DEBUG] [LOCAL ] COP: Trimmed 77769 records to 54117 (keeping 200 days of data) [2025-09-25T18:07:07.109695] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-25T18:07:07.365038] [DEBUG] [LOCAL ] COP: Primary data saved (54117 records). [2025-09-25T18:07:07.365210] [INFO ] [MAIN ] COP: Full history saved. [2025-09-25T18:07:07.366970] [INFO ] [MAIN ] Update Progress: 509/2372 symbols completed. COP took 32.7s. Estimated remaining: 4h 5m 30s. Rate: 7.6 symbols/min [2025-09-25T18:07:07.545010] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:07.579967] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T18:07:07.636790] [DEBUG] [LOCAL ] CP: Loaded 53276 existing records from primary storage. [2025-09-25T18:07:07.636984] [INFO ] [MAIN ] CP: Loaded 53276 existing records. [2025-09-25T18:07:07.827321] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:07.827569] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-25T18:07:07.827617] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-25T18:07:07.827979] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-25T18:07:07.828066] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-25T18:07:07.893987] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-25T18:07:08.196499] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:08.316103] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T18:07:08.590068] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T18:07:08.688737] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-25T18:07:09.488770] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-25T18:07:09.975973] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-25T18:07:10.288718] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-25T18:07:10.670063] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-25T18:07:11.088764] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-25T18:07:11.351713] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T18:07:11.496588] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T18:07:11.888802] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-25T18:07:12.628740] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T18:07:12.688689] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-25T18:07:13.488724] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-25T18:07:13.615449] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T18:07:14.015028] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T18:07:14.288725] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-25T18:07:14.834598] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T18:07:15.088731] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-25T18:07:15.796813] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T18:07:15.888799] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-25T18:07:16.688744] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-25T18:07:16.872957] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T18:07:17.488727] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-25T18:07:17.852928] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T18:07:18.095141] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T18:07:18.288717] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-25T18:07:19.089601] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-25T18:07:19.092189] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T18:07:19.888694] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-25T18:07:20.250520] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:07:20.259293] [INFO ] [REMOTE ] COR: Full fetch complete (68937 records). [2025-09-25T18:07:20.259420] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-25T18:07:20.668254] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-25T18:07:20.668360] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-25T18:07:20.669293] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-25T18:07:20.669373] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-25T18:07:20.670852] [DEBUG] [LOCAL ] COR: Trimmed 68937 records to 47618 (keeping 200 days of data) [2025-09-25T18:07:20.727459] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-25T18:07:20.797929] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:07:21.010106] [DEBUG] [LOCAL ] COR: Primary data saved (47618 records). [2025-09-25T18:07:21.010247] [INFO ] [MAIN ] COR: Full history saved. [2025-09-25T18:07:21.011671] [INFO ] [MAIN ] Update Progress: 510/2372 symbols completed. COR took 29.3s. Estimated remaining: 4h 5m 43s. Rate: 7.6 symbols/min [2025-09-25T18:07:21.180772] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:21.213494] [DEBUG] [LOCAL ] CPA: Loaded 28828 existing records from primary storage. [2025-09-25T18:07:21.213625] [INFO ] [MAIN ] CPA: Loaded 28828 existing records. [2025-09-25T18:07:21.394814] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:21.395171] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-25T18:07:21.395279] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-25T18:07:21.395512] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-25T18:07:21.395571] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-25T18:07:21.491339] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-25T18:07:21.766991] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:21.796196] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T18:07:22.288735] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-25T18:07:22.711242] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T18:07:23.079025] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T18:07:23.088739] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-25T18:07:23.888697] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-25T18:07:24.293157] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T18:07:24.303130] [INFO ] [REMOTE ] COTY: Full fetch complete (77087 records). [2025-09-25T18:07:24.303293] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-25T18:07:24.700110] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-25T18:07:24.696451] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-25T18:07:24.700258] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-25T18:07:24.702395] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-25T18:07:24.702462] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-25T18:07:24.704001] [DEBUG] [LOCAL ] COTY: Trimmed 77087 records to 53636 (keeping 200 days of data) [2025-09-25T18:07:25.007661] [DEBUG] [LOCAL ] COTY: Primary data saved (53636 records). [2025-09-25T18:07:25.007812] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-25T18:07:25.008995] [INFO ] [MAIN ] Update Progress: 511/2372 symbols completed. COTY took 29.8s. Estimated remaining: 4h 5m 20s. Rate: 7.6 symbols/min [2025-09-25T18:07:25.213207] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:25.213561] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-25T18:07:25.213797] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-25T18:07:25.215073] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-25T18:07:25.216547] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T18:07:25.216712] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-25T18:07:25.227220] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-25T18:07:25.227708] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-25T18:07:25.493512] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-25T18:07:25.540097] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T18:07:25.635202] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:26.258504] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T18:07:26.288670] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-25T18:07:27.019269] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T18:07:27.088674] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-25T18:07:27.888693] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-25T18:07:28.234737] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T18:07:28.457853] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T18:07:28.688679] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-25T18:07:28.860732] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T18:07:28.870020] [INFO ] [REMOTE ] COUR: Full fetch complete (70940 records). [2025-09-25T18:07:28.870217] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-25T18:07:29.278207] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-25T18:07:29.278289] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-25T18:07:29.279144] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-25T18:07:29.279210] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-25T18:07:29.280677] [DEBUG] [LOCAL ] COUR: Trimmed 70940 records to 49322 (keeping 200 days of data) [2025-09-25T18:07:29.489336] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-25T18:07:29.571943] [DEBUG] [LOCAL ] COUR: Primary data saved (49322 records). [2025-09-25T18:07:29.572080] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-25T18:07:29.572163] [INFO ] [MAIN ] Update Progress: 512/2372 symbols completed. COUR took 29.6s. Estimated remaining: 4h 5m 0s. Rate: 7.6 symbols/min [2025-09-25T18:07:29.769367] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:29.786548] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T18:07:29.819313] [DEBUG] [LOCAL ] CPAY: Loaded 30917 existing records from primary storage. [2025-09-25T18:07:29.819449] [INFO ] [MAIN ] CPAY: Loaded 30917 existing records. [2025-09-25T18:07:30.005277] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:30.005570] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-25T18:07:30.005621] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-25T18:07:30.005968] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-25T18:07:30.006030] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-25T18:07:30.297914] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-25T18:07:30.383555] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:31.088708] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-25T18:07:31.218602] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T18:07:31.566905] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T18:07:31.888724] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-25T18:07:32.322919] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T18:07:32.429553] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T18:07:32.688723] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-25T18:07:33.488745] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-25T18:07:34.126530] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T18:07:34.288728] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-25T18:07:34.636858] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-25T18:07:35.088691] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-25T18:07:35.167839] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:07:35.888713] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-25T18:07:36.688841] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-25T18:07:36.949734] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T18:07:37.289117] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T18:07:37.488717] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-25T18:07:38.213098] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T18:07:38.288800] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-25T18:07:38.459546] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-25T18:07:38.956922] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T18:07:39.088716] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-25T18:07:39.888710] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-25T18:07:40.199600] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-25T18:07:40.507451] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:07:40.688786] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-25T18:07:41.043896] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T18:07:41.488723] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-25T18:07:42.288723] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-25T18:07:43.088714] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-25T18:07:43.419014] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-25T18:07:43.463663] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T18:07:43.473585] [INFO ] [REMOTE ] CP: Full fetch complete (77130 records). [2025-09-25T18:07:43.473779] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-25T18:07:43.780198] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T18:07:43.902980] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-25T18:07:43.906973] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-25T18:07:43.907850] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-25T18:07:43.908904] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-25T18:07:43.909068] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-25T18:07:43.910721] [DEBUG] [LOCAL ] CP: Trimmed 77130 records to 53664 (keeping 200 days of data) [2025-09-25T18:07:44.249013] [DEBUG] [LOCAL ] CP: Primary data saved (53664 records). [2025-09-25T18:07:44.249303] [INFO ] [MAIN ] CP: Full history saved. [2025-09-25T18:07:44.250347] [INFO ] [MAIN ] Update Progress: 513/2372 symbols completed. CP took 36.9s. Estimated remaining: 4h 5m 17s. Rate: 7.6 symbols/min [2025-09-25T18:07:44.430255] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:44.449272] [DEBUG] [LOCAL ] CPF: Loaded 15464 existing records from primary storage. [2025-09-25T18:07:44.449429] [INFO ] [MAIN ] CPF: Loaded 15464 existing records. [2025-09-25T18:07:44.633205] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:44.633626] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-25T18:07:44.633716] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-25T18:07:44.634071] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-25T18:07:44.634129] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-25T18:07:44.698501] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-25T18:07:45.009597] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:45.202791] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T18:07:45.240005] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T18:07:45.488718] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-25T18:07:45.843009] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T18:07:46.288736] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-25T18:07:47.088764] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-25T18:07:47.615212] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:07:47.888718] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-25T18:07:48.408390] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:07:48.688726] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-25T18:07:49.092468] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T18:07:49.488758] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-25T18:07:50.034322] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T18:07:50.039533] [INFO ] [REMOTE ] CPA: Full fetch complete (42163 records). [2025-09-25T18:07:50.039623] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-25T18:07:50.297563] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-25T18:07:50.426508] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-25T18:07:50.426587] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-25T18:07:50.427146] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-25T18:07:50.427208] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-25T18:07:50.428154] [DEBUG] [LOCAL ] CPA: Trimmed 42163 records to 29076 (keeping 200 days of data) [2025-09-25T18:07:50.613893] [DEBUG] [LOCAL ] CPA: Primary data saved (29076 records). [2025-09-25T18:07:50.614063] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-25T18:07:50.614165] [INFO ] [MAIN ] Update Progress: 514/2372 symbols completed. CPA took 29.6s. Estimated remaining: 4h 5m 3s. Rate: 7.6 symbols/min [2025-09-25T18:07:50.791665] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:50.807577] [DEBUG] [LOCAL ] CPK: Loaded 13331 existing records from primary storage. [2025-09-25T18:07:50.807727] [INFO ] [MAIN ] CPK: Loaded 13331 existing records. [2025-09-25T18:07:50.991988] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:50.992401] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-25T18:07:50.992527] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-25T18:07:50.992987] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-25T18:07:50.993051] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-25T18:07:51.090220] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-25T18:07:51.090154] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:07:51.432919] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:51.538390] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T18:07:51.888717] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-25T18:07:52.049156] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T18:07:52.050096] [INFO ] [REMOTE ] CPAC: Full fetch complete (1886 records). [2025-09-25T18:07:52.050176] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-25T18:07:52.230564] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T18:07:52.230793] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:07:52.230864] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:07:52.230931] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-25T18:07:52.230996] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-25T18:07:52.231041] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-25T18:07:52.231079] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-25T18:07:52.231153] [INFO ] [MAIN ] Update Progress: 515/2372 symbols completed. CPAC took 27.2s. Estimated remaining: 4h 4m 33s. Rate: 7.6 symbols/min [2025-09-25T18:07:52.406608] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:07:52.466980] [DEBUG] [LOCAL ] CPNG: Loaded 53670 existing records from primary storage. [2025-09-25T18:07:52.467142] [INFO ] [MAIN ] CPNG: Loaded 53670 existing records. [2025-09-25T18:07:52.654662] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:07:52.655485] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-25T18:07:52.655558] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-25T18:07:52.656280] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-25T18:07:52.656365] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-25T18:07:52.693956] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-25T18:07:53.031472] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:07:53.122566] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T18:07:53.488722] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-25T18:07:53.830940] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T18:07:54.288708] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-25T18:07:55.088711] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-25T18:07:55.664950] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T18:07:55.888708] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-25T18:07:56.172924] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-25T18:07:56.194418] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T18:07:56.686233] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T18:07:56.689042] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-25T18:07:57.488855] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-25T18:07:58.288762] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-25T18:07:58.397586] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T18:07:59.065230] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-25T18:07:59.088675] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-25T18:07:59.554258] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T18:07:59.888711] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-25T18:08:00.688755] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-25T18:08:01.172426] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:08:01.347446] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-25T18:08:01.488705] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-25T18:08:02.112083] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T18:08:02.288716] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-25T18:08:03.088737] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-25T18:08:03.199297] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T18:08:03.717321] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-25T18:08:03.888690] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-25T18:08:04.044469] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T18:08:04.688734] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-25T18:08:05.488700] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-25T18:08:05.842510] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:08:05.864085] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T18:08:06.288747] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-25T18:08:06.402854] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T18:08:07.088766] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-25T18:08:07.680877] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T18:08:07.688189] [INFO ] [REMOTE ] CPAY: Full fetch complete (45138 records). [2025-09-25T18:08:07.688321] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-25T18:08:07.892688] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-25T18:08:08.092027] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-25T18:08:08.092102] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-25T18:08:08.092712] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-25T18:08:08.092792] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-25T18:08:08.093799] [DEBUG] [LOCAL ] CPAY: Trimmed 45138 records to 31115 (keeping 200 days of data) [2025-09-25T18:08:08.200535] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T18:08:08.305987] [DEBUG] [LOCAL ] CPAY: Primary data saved (31115 records). [2025-09-25T18:08:08.306151] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-25T18:08:08.306348] [INFO ] [MAIN ] Update Progress: 516/2372 symbols completed. CPAY took 38.7s. Estimated remaining: 4h 4m 54s. Rate: 7.6 symbols/min [2025-09-25T18:08:08.485764] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:08.542106] [DEBUG] [LOCAL ] CPRI: Loaded 52566 existing records from primary storage. [2025-09-25T18:08:08.542256] [INFO ] [MAIN ] CPRI: Loaded 52566 existing records. [2025-09-25T18:08:08.698163] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-25T18:08:08.731456] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:08:08.731736] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-25T18:08:08.731790] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-25T18:08:08.732023] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-25T18:08:08.732080] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-25T18:08:09.099002] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:09.488776] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-25T18:08:09.634828] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T18:08:09.954776] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T18:08:10.288699] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-25T18:08:10.370448] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T18:08:11.088763] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-25T18:08:11.810710] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T18:08:11.888684] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-25T18:08:12.081575] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T18:08:12.688793] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-25T18:08:13.488726] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-25T18:08:13.687438] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T18:08:13.707210] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T18:08:13.711054] [INFO ] [REMOTE ] CPF: Full fetch complete (24203 records). [2025-09-25T18:08:13.711160] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-25T18:08:14.097350] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-25T18:08:14.097440] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-25T18:08:14.098020] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-25T18:08:14.098083] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-25T18:08:14.098973] [DEBUG] [LOCAL ] CPF: Trimmed 24203 records to 15549 (keeping 200 days of data) [2025-09-25T18:08:14.205190] [DEBUG] [LOCAL ] CPF: Primary data saved (15549 records). [2025-09-25T18:08:14.205354] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-25T18:08:14.205533] [INFO ] [MAIN ] Update Progress: 517/2372 symbols completed. CPF took 30.0s. Estimated remaining: 4h 4m 39s. Rate: 7.6 symbols/min [2025-09-25T18:08:14.288696] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-25T18:08:14.420110] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:08:15.088782] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-25T18:08:15.841796] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-25T18:08:15.888686] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-25T18:08:16.023722] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T18:08:16.502184] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T18:08:16.688713] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-25T18:08:17.488770] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-25T18:08:18.288755] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-25T18:08:18.468450] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T18:08:19.088726] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-25T18:08:19.298468] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T18:08:19.301871] [INFO ] [REMOTE ] CPK: Full fetch complete (17717 records). [2025-09-25T18:08:19.301987] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-25T18:08:19.753847] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-25T18:08:19.764363] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-25T18:08:19.774859] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-25T18:08:19.775470] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-25T18:08:19.775542] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-25T18:08:19.777568] [DEBUG] [LOCAL ] CPK: Trimmed 17717 records to 13470 (keeping 200 days of data) [2025-09-25T18:08:19.869956] [DEBUG] [LOCAL ] CPK: Primary data saved (13470 records). [2025-09-25T18:08:19.870110] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-25T18:08:19.870199] [INFO ] [MAIN ] Update Progress: 518/2372 symbols completed. CPK took 29.3s. Estimated remaining: 4h 4m 23s. Rate: 7.6 symbols/min [2025-09-25T18:08:19.888697] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-25T18:08:20.606422] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T18:08:20.688760] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-25T18:08:22.464826] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-25T18:08:22.477377] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-25T18:08:22.537105] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T18:08:22.553312] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-25T18:08:24.186487] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T18:08:24.197214] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-25T18:08:24.614831] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T18:08:24.626841] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-25T18:08:25.701703] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:08:25.713391] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-25T18:08:26.621007] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T18:08:26.635735] [INFO ] [REMOTE ] CPNG: Full fetch complete (77667 records). [2025-09-25T18:08:26.635987] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-25T18:08:27.073062] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-25T18:08:27.073255] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-25T18:08:27.074607] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-25T18:08:27.074711] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-25T18:08:27.076477] [DEBUG] [LOCAL ] CPNG: Trimmed 77667 records to 54060 (keeping 200 days of data) [2025-09-25T18:08:27.424998] [DEBUG] [LOCAL ] CPNG: Primary data saved (54060 records). [2025-09-25T18:08:27.425162] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-25T18:08:27.425921] [INFO ] [MAIN ] Update Progress: 519/2372 symbols completed. CPNG took 35.2s. Estimated remaining: 4h 4m 14s. Rate: 7.6 symbols/min [2025-09-25T18:08:27.559034] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T18:08:27.570598] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-25T18:08:29.325547] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:08:29.335717] [INFO ] [REMOTE ] CPRI: Full fetch complete (76161 records). [2025-09-25T18:08:29.335895] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-25T18:08:29.741302] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-25T18:08:29.741404] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-25T18:08:29.742670] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-25T18:08:29.742742] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-25T18:08:29.744365] [DEBUG] [LOCAL ] CPRI: Trimmed 76161 records to 52950 (keeping 200 days of data) [2025-09-25T18:08:30.056534] [DEBUG] [LOCAL ] CPRI: Primary data saved (52950 records). [2025-09-25T18:08:30.056710] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-25T18:08:30.056820] [INFO ] [MAIN ] Update Progress: 520/2372 symbols completed. CPRI took 21.8s. Estimated remaining: 4h 3m 47s. Rate: 7.6 symbols/min [2025-09-25T18:08:30.616146] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:30.709169] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:30.801531] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:30.805135] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:30.805554] [DEBUG] [LOCAL ] CR: No existing data file found in primary storage. [2025-09-25T18:08:30.805707] [WARN ] [MAIN ] CR: No existing data found, performing full refresh instead. [2025-09-25T18:08:30.809973] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-25T18:08:30.810738] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-25T18:08:30.810951] [DEBUG] [LOCAL ] CR: No primary data file found to delete. [2025-09-25T18:08:30.811047] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-25T18:08:30.942125] [DEBUG] [LOCAL ] CQP: Loaded 19841 existing records from primary storage. [2025-09-25T18:08:30.946473] [INFO ] [MAIN ] CQP: Loaded 19841 existing records. [2025-09-25T18:08:30.987919] [DEBUG] [LOCAL ] CPS: Loaded 26208 existing records from primary storage. [2025-09-25T18:08:31.018908] [INFO ] [MAIN ] CPS: Loaded 26208 existing records. [2025-09-25T18:08:31.421907] [DEBUG] [LOCAL ] CPT: Loaded 44379 existing records from primary storage. [2025-09-25T18:08:31.458229] [INFO ] [MAIN ] CPT: Loaded 44379 existing records. [2025-09-25T18:08:31.653261] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:31.684772] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-25T18:08:31.732354] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:08:31.809282] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-25T18:08:31.818288] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-25T18:08:31.818443] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:08:31.840030] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-25T18:08:31.824435] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-25T18:08:31.860993] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-25T18:08:31.866544] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-25T18:08:31.878604] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-25T18:08:31.920293] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-25T18:08:31.931069] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:08:31.971926] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-25T18:08:31.983220] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-25T18:08:32.031860] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-25T18:08:32.067171] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-25T18:08:32.985485] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:33.019220] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-25T18:08:33.023035] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:33.046748] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-25T18:08:33.092062] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:33.093851] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-25T18:08:33.123579] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T18:08:33.129087] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-25T18:08:34.127947] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T18:08:34.133054] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-25T18:08:34.179769] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T18:08:34.184667] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-25T18:08:34.297221] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T18:08:34.303218] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-25T18:08:34.464517] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T18:08:34.472378] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-25T18:08:35.227822] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T18:08:35.233039] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-25T18:08:35.256814] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T18:08:35.261419] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-25T18:08:35.318365] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T18:08:35.324921] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-25T18:08:35.816741] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T18:08:35.888666] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-25T18:08:36.323380] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T18:08:36.443273] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T18:08:36.544377] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T18:08:36.688729] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-25T18:08:37.136870] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T18:08:37.488721] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-25T18:08:37.691420] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T18:08:38.288752] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-25T18:08:39.088723] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T18:08:39.088795] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-25T18:08:39.582497] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T18:08:39.888719] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-25T18:08:40.436980] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T18:08:40.688729] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-25T18:08:40.943403] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T18:08:41.488703] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-25T18:08:41.726905] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:08:42.288773] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-25T18:08:42.432610] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T18:08:43.088723] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-25T18:08:43.539050] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T18:08:43.888682] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-25T18:08:44.268229] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T18:08:44.688719] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-25T18:08:45.346730] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T18:08:45.488762] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-25T18:08:45.891153] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T18:08:46.288798] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-25T18:08:47.088741] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-25T18:08:47.242335] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:08:47.529525] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:08:47.888712] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-25T18:08:48.237262] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T18:08:48.688708] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-25T18:08:49.436689] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T18:08:49.488787] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-25T18:08:49.772237] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T18:08:50.288732] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-25T18:08:50.910840] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T18:08:51.088785] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-25T18:08:51.888733] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-25T18:08:51.933540] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T18:08:52.130300] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:08:52.688692] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-25T18:08:53.039779] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T18:08:53.488725] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-25T18:08:53.834413] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T18:08:54.288719] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-25T18:08:54.841860] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T18:08:54.846801] [INFO ] [REMOTE ] CR: Full fetch complete (35024 records). [2025-09-25T18:08:54.846911] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-25T18:08:55.098205] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-25T18:08:55.265598] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-25T18:08:55.265730] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-25T18:08:55.266589] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-25T18:08:55.266762] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-25T18:08:55.267936] [DEBUG] [LOCAL ] CR: Trimmed 35024 records to 24857 (keeping 200 days of data) [2025-09-25T18:08:55.382834] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T18:08:55.389482] [INFO ] [REMOTE ] CPS: Full fetch complete (36306 records). [2025-09-25T18:08:55.390344] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-25T18:08:55.815808] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-25T18:08:55.816186] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-25T18:08:55.817460] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-25T18:08:55.817809] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-25T18:08:55.822802] [DEBUG] [LOCAL ] CPS: Trimmed 36306 records to 26362 (keeping 200 days of data) [2025-09-25T18:08:55.900668] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-25T18:08:55.948128] [DEBUG] [LOCAL ] CR: Primary data saved (24857 records). [2025-09-25T18:08:55.948848] [INFO ] [MAIN ] CR: Full history saved. [2025-09-25T18:08:55.948975] [INFO ] [MAIN ] Update Progress: 521/2372 symbols completed. CR took 25.9s. Estimated remaining: 4h 4m 43s. Rate: 7.6 symbols/min [2025-09-25T18:08:56.138205] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:56.139234] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-25T18:08:56.139545] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-25T18:08:56.140372] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-25T18:08:56.140705] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-25T18:08:56.141097] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-25T18:08:56.141439] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-25T18:08:56.406940] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T18:08:56.605262] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:56.620680] [DEBUG] [LOCAL ] CPS: Primary data saved (26362 records). [2025-09-25T18:08:56.620899] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-25T18:08:56.621065] [INFO ] [MAIN ] Update Progress: 522/2372 symbols completed. CPS took 26.6s. Estimated remaining: 4h 4m 10s. Rate: 7.6 symbols/min [2025-09-25T18:08:56.696228] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-25T18:08:56.816688] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:08:56.873376] [DEBUG] [LOCAL ] CRBG: Loaded 52339 existing records from primary storage. [2025-09-25T18:08:56.873533] [INFO ] [MAIN ] CRBG: Loaded 52339 existing records. [2025-09-25T18:08:57.061194] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:08:57.061530] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-25T18:08:57.061598] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-25T18:08:57.061883] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-25T18:08:57.061942] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-25T18:08:57.434620] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:08:57.476900] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:08:57.488671] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-25T18:08:57.539720] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T18:08:58.288737] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-25T18:08:59.088717] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-25T18:08:59.155421] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:08:59.164292] [INFO ] [REMOTE ] CPT: Full fetch complete (63636 records). [2025-09-25T18:08:59.164487] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-25T18:08:59.274146] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T18:08:59.574296] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-25T18:08:59.574376] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-25T18:08:59.575124] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-25T18:08:59.575191] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-25T18:08:59.576485] [DEBUG] [LOCAL ] CPT: Trimmed 63636 records to 44711 (keeping 200 days of data) [2025-09-25T18:08:59.875724] [DEBUG] [LOCAL ] CPT: Primary data saved (44711 records). [2025-09-25T18:08:59.875984] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-25T18:08:59.876095] [INFO ] [MAIN ] Update Progress: 523/2372 symbols completed. CPT took 29.8s. Estimated remaining: 4h 3m 45s. Rate: 7.6 symbols/min [2025-09-25T18:08:59.897672] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-25T18:09:00.065347] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:00.065882] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T18:09:00.069982] [INFO ] [REMOTE ] CQP: Full fetch complete (30828 records). [2025-09-25T18:09:00.070080] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-25T18:09:00.447411] [DEBUG] [LOCAL ] CRC: Loaded 44323 existing records from primary storage. [2025-09-25T18:09:00.456703] [INFO ] [MAIN ] CRC: Loaded 44323 existing records. [2025-09-25T18:09:00.535146] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-25T18:09:00.569116] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-25T18:09:00.594250] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-25T18:09:00.596841] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-25T18:09:00.624882] [DEBUG] [LOCAL ] CQP: Trimmed 30828 records to 19937 (keeping 200 days of data) [2025-09-25T18:09:00.682877] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:09:00.683432] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-25T18:09:00.683555] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-25T18:09:00.684023] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-25T18:09:00.684136] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-25T18:09:00.757447] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-25T18:09:00.881332] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T18:09:01.178110] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:01.200259] [DEBUG] [LOCAL ] CQP: Primary data saved (19937 records). [2025-09-25T18:09:01.200407] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-25T18:09:01.200499] [INFO ] [MAIN ] Update Progress: 524/2372 symbols completed. CQP took 31.1s. Estimated remaining: 4h 3m 14s. Rate: 7.6 symbols/min [2025-09-25T18:09:01.406837] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:01.407062] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-25T18:09:01.407157] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-25T18:09:01.407272] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-25T18:09:01.407311] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-25T18:09:01.407352] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-25T18:09:01.407384] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-25T18:09:01.493806] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-25T18:09:01.769742] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:02.288731] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-25T18:09:02.591053] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:09:02.730319] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T18:09:02.903717] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T18:09:03.088720] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-25T18:09:03.888730] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-25T18:09:03.945550] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T18:09:04.129081] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:04.129418] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-25T18:09:04.688732] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-25T18:09:05.353324] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T18:09:05.488715] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-25T18:09:05.727844] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:05.728421] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-25T18:09:06.288725] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-25T18:09:07.088733] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-25T18:09:07.744014] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T18:09:07.888714] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-25T18:09:08.688738] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-25T18:09:08.752213] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:09:09.270880] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:09.271202] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-25T18:09:09.297249] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T18:09:09.488732] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-25T18:09:10.288759] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-25T18:09:11.083875] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T18:09:11.094153] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-25T18:09:11.184116] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T18:09:11.888721] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-25T18:09:12.691441] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-25T18:09:12.698717] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T18:09:12.815836] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T18:09:13.488723] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-25T18:09:14.288780] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-25T18:09:14.317193] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T18:09:15.060415] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T18:09:15.088676] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-25T18:09:15.280607] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T18:09:15.888747] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-25T18:09:15.905559] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T18:09:15.907533] [INFO ] [REMOTE ] CRBD: Full fetch complete (15543 records). [2025-09-25T18:09:15.907606] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-25T18:09:16.099147] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:16.150138] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-25T18:09:16.291579] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-09-25T18:09:16.291674] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-09-25T18:09:16.292048] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-09-25T18:09:16.292087] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-09-25T18:09:16.292572] [DEBUG] [LOCAL ] CRBD: Trimmed 15543 records to 9077 (keeping 200 days of data) [2025-09-25T18:09:16.349087] [DEBUG] [LOCAL ] CRBD: Primary data saved (9077 records). [2025-09-25T18:09:16.349218] [INFO ] [MAIN ] CRBD: Full history saved. [2025-09-25T18:09:16.349296] [INFO ] [MAIN ] Update Progress: 525/2372 symbols completed. CRBD took 20.4s. Estimated remaining: 4h 3m 32s. Rate: 7.6 symbols/min [2025-09-25T18:09:16.519529] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:16.572193] [DEBUG] [LOCAL ] CRGY: Loaded 52514 existing records from primary storage. [2025-09-25T18:09:16.572347] [INFO ] [MAIN ] CRGY: Loaded 52514 existing records. [2025-09-25T18:09:16.693790] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-25T18:09:16.755752] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:09:16.756000] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-25T18:09:16.756054] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-25T18:09:16.756330] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-25T18:09:16.756390] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-25T18:09:17.125210] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:17.488758] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-25T18:09:17.721350] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:17.721816] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-25T18:09:18.236871] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:09:18.288681] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-25T18:09:19.088720] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-25T18:09:19.277492] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:09:19.277918] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-25T18:09:19.893965] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-25T18:09:19.910513] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:09:20.688720] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-25T18:09:21.488739] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-25T18:09:22.058208] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:09:22.110473] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-25T18:09:22.288749] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-25T18:09:23.088709] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-25T18:09:23.156260] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T18:09:23.888777] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-25T18:09:24.380847] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T18:09:24.688697] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-25T18:09:25.152377] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.86 seconds). [2025-09-25T18:09:25.390437] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:09:25.488696] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-25T18:09:25.991726] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T18:09:26.288733] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-25T18:09:27.077271] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T18:09:27.088695] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-25T18:09:27.888754] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-25T18:09:28.629232] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T18:09:28.688698] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-25T18:09:29.077442] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.79 seconds). [2025-09-25T18:09:29.400590] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:09:29.488679] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-25T18:09:30.288697] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-25T18:09:30.355096] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T18:09:31.093867] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-25T18:09:31.113759] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:09:31.888790] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-25T18:09:32.647463] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T18:09:32.688674] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-25T18:09:33.303629] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-25T18:09:33.313363] [INFO ] [REMOTE ] CRCL: Full fetch complete (30219 records). [2025-09-25T18:09:33.313507] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-25T18:09:33.488688] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-25T18:09:33.506729] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-25T18:09:33.507240] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:09:33.508283] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:09:33.508675] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-25T18:09:33.508880] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-25T18:09:33.508964] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-25T18:09:33.509263] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-25T18:09:33.509449] [INFO ] [MAIN ] Update Progress: 526/2372 symbols completed. CRCL took 32.3s. Estimated remaining: 4h 3m 56s. Rate: 7.6 symbols/min [2025-09-25T18:09:33.708914] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T18:09:33.712355] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:33.777139] [DEBUG] [LOCAL ] CRH: Loaded 53468 existing records from primary storage. [2025-09-25T18:09:33.777308] [INFO ] [MAIN ] CRH: Loaded 53468 existing records. [2025-09-25T18:09:33.958220] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:09:33.958694] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-25T18:09:33.958833] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-25T18:09:33.959233] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-25T18:09:33.959291] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-25T18:09:34.288725] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-25T18:09:34.333381] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:34.361053] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:09:34.371390] [INFO ] [REMOTE ] CRBG: Full fetch complete (75699 records). [2025-09-25T18:09:34.371525] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-25T18:09:34.818067] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-25T18:09:34.818161] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-25T18:09:34.819102] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-25T18:09:34.819170] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-25T18:09:34.820749] [DEBUG] [LOCAL ] CRBG: Trimmed 75699 records to 52728 (keeping 200 days of data) [2025-09-25T18:09:35.119454] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-25T18:09:35.167493] [DEBUG] [LOCAL ] CRBG: Primary data saved (52728 records). [2025-09-25T18:09:35.167669] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-25T18:09:35.169167] [INFO ] [MAIN ] Update Progress: 527/2372 symbols completed. CRBG took 38.5s. Estimated remaining: 4h 3m 26s. Rate: 7.6 symbols/min [2025-09-25T18:09:35.370163] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:35.370523] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-09-25T18:09:35.370609] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-09-25T18:09:35.371093] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-25T18:09:35.371194] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-25T18:09:35.371313] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-25T18:09:35.371452] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-25T18:09:35.667898] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-25T18:09:35.820826] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:35.888671] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-25T18:09:36.302631] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T18:09:36.311310] [INFO ] [REMOTE ] CRC: Full fetch complete (62291 records). [2025-09-25T18:09:36.311445] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-25T18:09:36.694238] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-25T18:09:36.716269] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-25T18:09:36.716485] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-25T18:09:36.717350] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-25T18:09:36.717524] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-25T18:09:36.718984] [DEBUG] [LOCAL ] CRC: Trimmed 62291 records to 44654 (keeping 200 days of data) [2025-09-25T18:09:36.994932] [DEBUG] [LOCAL ] CRC: Primary data saved (44654 records). [2025-09-25T18:09:36.995063] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-25T18:09:36.995148] [INFO ] [MAIN ] Update Progress: 528/2372 symbols completed. CRC took 37.1s. Estimated remaining: 4h 2m 57s. Rate: 7.6 symbols/min [2025-09-25T18:09:37.177798] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:37.210524] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T18:09:37.265881] [DEBUG] [LOCAL ] CRK: Loaded 52121 existing records from primary storage. [2025-09-25T18:09:37.266024] [INFO ] [MAIN ] CRK: Loaded 52121 existing records. [2025-09-25T18:09:37.453015] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:09:37.453630] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-25T18:09:37.453911] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-25T18:09:37.454221] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-25T18:09:37.454280] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-25T18:09:37.497701] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-25T18:09:37.826792] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T18:09:37.857674] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:38.288690] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-25T18:09:38.477183] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:09:39.088689] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-25T18:09:39.261350] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T18:09:39.898102] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-25T18:09:39.919259] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:09:40.511014] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:09:40.688729] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-25T18:09:41.488741] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-25T18:09:41.823756] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T18:09:42.281549] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T18:09:42.295580] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-25T18:09:43.020414] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T18:09:43.088790] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-25T18:09:43.888884] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-25T18:09:44.135071] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T18:09:44.688692] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-25T18:09:45.045140] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:09:45.055109] [INFO ] [REMOTE ] CRGY: Full fetch complete (75954 records). [2025-09-25T18:09:45.055252] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-25T18:09:45.477856] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-25T18:09:45.477977] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-25T18:09:45.479084] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-25T18:09:45.479204] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-25T18:09:45.481183] [DEBUG] [LOCAL ] CRGY: Trimmed 75954 records to 52903 (keeping 200 days of data) [2025-09-25T18:09:45.549819] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-25T18:09:45.605612] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:09:45.857254] [DEBUG] [LOCAL ] CRGY: Primary data saved (52903 records). [2025-09-25T18:09:45.857408] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-25T18:09:45.857495] [INFO ] [MAIN ] Update Progress: 529/2372 symbols completed. CRGY took 29.5s. Estimated remaining: 4h 2m 53s. Rate: 7.6 symbols/min [2025-09-25T18:09:46.035121] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:09:46.079241] [DEBUG] [LOCAL ] CRL: Loaded 43211 existing records from primary storage. [2025-09-25T18:09:46.079394] [INFO ] [MAIN ] CRL: Loaded 43211 existing records. [2025-09-25T18:09:46.267035] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:09:46.267298] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-25T18:09:46.267350] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-25T18:09:46.267781] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-25T18:09:46.267844] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-25T18:09:46.299202] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-25T18:09:46.665016] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:09:46.789301] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T18:09:47.088781] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-25T18:09:47.141171] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T18:09:47.888687] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-25T18:09:48.008225] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T18:09:48.688765] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-25T18:09:48.729728] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T18:09:49.394578] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T18:09:49.488724] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-25T18:09:50.288763] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-25T18:09:50.341733] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T18:09:50.979833] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:09:51.088719] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-25T18:09:51.888752] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-25T18:09:51.932312] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T18:09:52.688774] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-25T18:09:52.789196] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T18:09:53.493926] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-25T18:09:53.514817] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T18:09:54.288716] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-25T18:09:54.510088] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T18:09:55.088705] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-25T18:09:55.355899] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T18:09:55.875736] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T18:09:55.888668] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-25T18:09:56.392945] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T18:09:56.688741] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-25T18:09:57.488741] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-25T18:09:57.658144] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T18:09:58.288786] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-25T18:09:58.443344] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T18:09:59.088686] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-25T18:09:59.219447] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T18:09:59.888732] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-25T18:09:59.936158] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T18:10:00.688703] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-25T18:10:00.815392] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T18:10:01.488734] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-25T18:10:01.836718] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:10:02.288723] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-25T18:10:02.390270] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T18:10:03.088773] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-25T18:10:03.532513] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-25T18:10:03.888780] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-25T18:10:03.983268] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T18:10:04.556858] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T18:10:04.688807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-25T18:10:05.480670] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T18:10:05.491886] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-25T18:10:06.288696] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-25T18:10:06.344337] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T18:10:06.353519] [INFO ] [REMOTE ] CRI: Full fetch complete (70974 records). [2025-09-25T18:10:06.353729] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-25T18:10:06.773774] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-25T18:10:06.773868] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-25T18:10:06.774672] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-25T18:10:06.774738] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-25T18:10:06.776279] [DEBUG] [LOCAL ] CRI: Trimmed 70974 records to 50361 (keeping 200 days of data) [2025-09-25T18:10:07.092041] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-25T18:10:07.112313] [DEBUG] [LOCAL ] CRI: Primary data saved (50361 records). [2025-09-25T18:10:07.112459] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-25T18:10:07.112682] [INFO ] [MAIN ] Update Progress: 530/2372 symbols completed. CRI took 31.9s. Estimated remaining: 4h 3m 31s. Rate: 7.6 symbols/min [2025-09-25T18:10:07.292106] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:07.354552] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-25T18:10:07.354870] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-25T18:10:07.481557] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T18:10:07.517096] [INFO ] [REMOTE ] CRH: Full fetch complete (77297 records). [2025-09-25T18:10:07.542731] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-25T18:10:07.675087] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:07.716164] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-25T18:10:07.716338] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-25T18:10:07.728163] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-25T18:10:07.738506] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-25T18:10:08.373854] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-25T18:10:08.401179] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-25T18:10:08.420293] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-25T18:10:08.459174] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-25T18:10:08.472014] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:08.500387] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-25T18:10:08.504840] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T18:10:08.513936] [DEBUG] [LOCAL ] CRH: Trimmed 77297 records to 53856 (keeping 200 days of data) [2025-09-25T18:10:08.593307] [INFO ] [REMOTE ] CRK: Full fetch complete (75549 records). [2025-09-25T18:10:08.609832] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-25T18:10:08.650283] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:10:08.730387] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-25T18:10:09.107557] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-25T18:10:09.107984] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-25T18:10:09.109794] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-25T18:10:09.110143] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-25T18:10:09.116173] [DEBUG] [LOCAL ] CRK: Trimmed 75549 records to 52506 (keeping 200 days of data) [2025-09-25T18:10:09.564350] [DEBUG] [LOCAL ] CRK: Primary data saved (52506 records). [2025-09-25T18:10:09.565461] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-25T18:10:09.566033] [INFO ] [MAIN ] Update Progress: 531/2372 symbols completed. CRK took 32.6s. Estimated remaining: 4h 3m 4s. Rate: 7.6 symbols/min [2025-09-25T18:10:09.819498] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:09.855584] [DEBUG] [LOCAL ] CRH: Primary data saved (53856 records). [2025-09-25T18:10:09.855779] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-25T18:10:09.856977] [INFO ] [MAIN ] Update Progress: 532/2372 symbols completed. CRH took 36.3s. Estimated remaining: 4h 2m 30s. Rate: 7.6 symbols/min [2025-09-25T18:10:09.974287] [DEBUG] [LOCAL ] CRS: Loaded 43297 existing records from primary storage. [2025-09-25T18:10:09.980046] [INFO ] [MAIN ] CRS: Loaded 43297 existing records. [2025-09-25T18:10:10.101445] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:10.181899] [DEBUG] [LOCAL ] CRT: Loaded 4954 existing records from primary storage. [2025-09-25T18:10:10.192314] [INFO ] [MAIN ] CRT: Loaded 4954 existing records. [2025-09-25T18:10:10.336909] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:10.368088] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-25T18:10:10.373424] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-25T18:10:10.438569] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-25T18:10:10.444949] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:10.446330] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-25T18:10:10.446112] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-25T18:10:10.447110] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-25T18:10:10.459221] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-25T18:10:10.478441] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-25T18:10:10.867070] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-25T18:10:11.005055] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-25T18:10:11.225348] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:11.310215] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-25T18:10:11.309959] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:11.311315] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-25T18:10:11.317525] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-25T18:10:11.888757] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-25T18:10:12.159233] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T18:10:12.643241] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T18:10:12.688728] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-25T18:10:12.775690] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T18:10:13.488803] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-25T18:10:14.082780] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T18:10:14.181587] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-25T18:10:14.288773] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-25T18:10:14.987091] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:10:14.994444] [INFO ] [REMOTE ] CRL: Full fetch complete (62775 records). [2025-09-25T18:10:14.994564] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-25T18:10:15.096918] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-25T18:10:15.399597] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-25T18:10:15.399772] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-25T18:10:15.400583] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-25T18:10:15.400750] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-25T18:10:15.402518] [DEBUG] [LOCAL ] CRL: Trimmed 62775 records to 43547 (keeping 200 days of data) [2025-09-25T18:10:15.559473] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T18:10:15.710210] [DEBUG] [LOCAL ] CRL: Primary data saved (43547 records). [2025-09-25T18:10:15.710350] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-25T18:10:15.710477] [INFO ] [MAIN ] Update Progress: 533/2372 symbols completed. CRL took 29.9s. Estimated remaining: 4h 2m 15s. Rate: 7.6 symbols/min [2025-09-25T18:10:15.826674] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T18:10:15.897371] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-25T18:10:15.902253] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:15.955739] [DEBUG] [LOCAL ] CSAN: Loaded 42311 existing records from primary storage. [2025-09-25T18:10:15.955950] [INFO ] [MAIN ] CSAN: Loaded 42311 existing records. [2025-09-25T18:10:16.136294] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:16.136570] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-25T18:10:16.136628] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-25T18:10:16.136905] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-25T18:10:16.136963] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-25T18:10:16.506678] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:16.688719] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-25T18:10:17.488703] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-25T18:10:17.545461] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T18:10:18.078422] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-25T18:10:18.288737] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-25T18:10:18.770809] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T18:10:19.088716] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-25T18:10:19.888739] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-25T18:10:20.186549] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T18:10:20.688709] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-25T18:10:20.743599] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T18:10:21.158999] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T18:10:21.488756] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-25T18:10:22.288808] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-25T18:10:23.021047] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-25T18:10:23.056228] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T18:10:23.088662] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-25T18:10:23.814289] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T18:10:23.888698] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-25T18:10:24.688731] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-25T18:10:25.183144] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-25T18:10:25.414677] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T18:10:25.488666] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-25T18:10:25.970167] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:10:26.288748] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-25T18:10:27.088689] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-25T18:10:27.249191] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T18:10:27.639122] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:10:27.888737] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-25T18:10:28.688711] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-25T18:10:29.330760] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:10:29.436946] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-25T18:10:29.498480] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-25T18:10:29.504129] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T18:10:30.219817] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T18:10:30.288745] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-25T18:10:31.088763] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-25T18:10:31.888762] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-25T18:10:32.394508] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T18:10:32.548053] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-25T18:10:32.688735] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-25T18:10:33.493184] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-25T18:10:33.495087] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:10:33.527165] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:10:34.288763] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-25T18:10:35.088776] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-25T18:10:35.206631] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T18:10:35.888720] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-25T18:10:35.982902] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-25T18:10:36.646109] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:10:36.688673] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-25T18:10:37.231598] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T18:10:37.239727] [INFO ] [REMOTE ] CRS: Full fetch complete (62291 records). [2025-09-25T18:10:37.239896] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-25T18:10:37.240756] [FATAL] [VALIDATOR ] CRS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:10:37.240851] [FATAL] [MAIN ] CRS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:10:37.240907] [WARN ] [MAIN ] CRS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:10:37.240988] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-25T18:10:37.241058] [DEBUG] [LOCAL ] CRS: No primary data file found to delete. [2025-09-25T18:10:37.241128] [INFO ] [LOCAL ] CRS: Starting deletion of derivative data. [2025-09-25T18:10:37.241582] [DEBUG] [LOCAL ] CRS: Deleted derivative data file. [2025-09-25T18:10:37.242633] [INFO ] [MAIN ] Update Progress: 534/2372 symbols completed. CRS took 27.7s. Estimated remaining: 4h 2m 54s. Rate: 7.6 symbols/min [2025-09-25T18:10:37.422747] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:37.464893] [DEBUG] [LOCAL ] CSL: Loaded 31600 existing records from primary storage. [2025-09-25T18:10:37.465036] [INFO ] [MAIN ] CSL: Loaded 31600 existing records. [2025-09-25T18:10:37.495342] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-25T18:10:37.659886] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:37.660174] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-25T18:10:37.660230] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-25T18:10:37.660469] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-25T18:10:37.660527] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-25T18:10:38.034365] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:38.288770] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-25T18:10:38.352476] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T18:10:39.088731] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-25T18:10:39.299174] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T18:10:39.750662] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T18:10:39.888693] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-25T18:10:40.224291] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-25T18:10:40.235031] [INFO ] [REMOTE ] CRM: Full fetch complete (77844 records). [2025-09-25T18:10:40.235190] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-25T18:10:40.652289] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-25T18:10:40.652382] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-25T18:10:40.653337] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-25T18:10:40.653407] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-25T18:10:40.655072] [DEBUG] [LOCAL ] CRM: Trimmed 77844 records to 54160 (keeping 200 days of data) [2025-09-25T18:10:40.719696] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-25T18:10:41.033714] [DEBUG] [LOCAL ] CRM: Primary data saved (54160 records). [2025-09-25T18:10:41.033916] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-25T18:10:41.034587] [INFO ] [MAIN ] Update Progress: 535/2372 symbols completed. CRM took 33.9s. Estimated remaining: 4h 2m 32s. Rate: 7.6 symbols/min [2025-09-25T18:10:41.224761] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:41.243681] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T18:10:41.259016] [DEBUG] [LOCAL ] CSR: Loaded 12575 existing records from primary storage. [2025-09-25T18:10:41.259123] [INFO ] [MAIN ] CSR: Loaded 12575 existing records. [2025-09-25T18:10:41.456786] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:41.458850] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T18:10:41.461010] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-25T18:10:41.461510] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-25T18:10:41.461753] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-25T18:10:41.461817] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-25T18:10:41.493783] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-25T18:10:41.880283] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:42.185476] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:10:42.187581] [INFO ] [REMOTE ] CRT: Full fetch complete (7620 records). [2025-09-25T18:10:42.187680] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-25T18:10:42.293874] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-25T18:10:42.561026] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-25T18:10:42.561109] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-25T18:10:42.561351] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-25T18:10:42.561413] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-25T18:10:42.561878] [DEBUG] [LOCAL ] CRT: Trimmed 7620 records to 4974 (keeping 200 days of data) [2025-09-25T18:10:42.593517] [DEBUG] [LOCAL ] CRT: Primary data saved (4974 records). [2025-09-25T18:10:42.593694] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-25T18:10:42.593821] [INFO ] [MAIN ] Update Progress: 536/2372 symbols completed. CRT took 32.7s. Estimated remaining: 4h 2m 2s. Rate: 7.6 symbols/min [2025-09-25T18:10:42.763389] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:42.817677] [DEBUG] [LOCAL ] CSTM: Loaded 47710 existing records from primary storage. [2025-09-25T18:10:42.817850] [INFO ] [MAIN ] CSTM: Loaded 47710 existing records. [2025-09-25T18:10:42.995145] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:42.995398] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-25T18:10:42.995445] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-25T18:10:42.995773] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-25T18:10:42.995866] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-25T18:10:43.093764] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-25T18:10:43.367841] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:43.471672] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T18:10:43.888724] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-25T18:10:44.553047] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T18:10:44.593749] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T18:10:44.688698] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-25T18:10:45.488737] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-25T18:10:46.249826] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T18:10:46.288671] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-25T18:10:46.444898] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T18:10:47.088727] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-25T18:10:47.783701] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T18:10:47.855198] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T18:10:47.888678] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-25T18:10:48.688727] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-25T18:10:49.353574] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T18:10:49.488692] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-25T18:10:49.719721] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T18:10:50.288738] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-25T18:10:51.007539] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T18:10:51.017550] [INFO ] [REMOTE ] CSAN: Full fetch complete (60870 records). [2025-09-25T18:10:51.017731] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-25T18:10:51.095085] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-25T18:10:51.419170] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-25T18:10:51.419286] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-25T18:10:51.420063] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-25T18:10:51.420142] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-25T18:10:51.421821] [DEBUG] [LOCAL ] CSAN: Trimmed 60870 records to 42640 (keeping 200 days of data) [2025-09-25T18:10:51.492813] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T18:10:51.688401] [DEBUG] [LOCAL ] CSAN: Primary data saved (42640 records). [2025-09-25T18:10:51.688544] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-25T18:10:51.688634] [INFO ] [MAIN ] Update Progress: 537/2372 symbols completed. CSAN took 36.0s. Estimated remaining: 4h 1m 58s. Rate: 7.6 symbols/min [2025-09-25T18:10:51.891382] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-25T18:10:51.895328] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:10:51.910071] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:10:51.926217] [DEBUG] [LOCAL ] CSV: Loaded 13045 existing records from primary storage. [2025-09-25T18:10:51.926359] [INFO ] [MAIN ] CSV: Loaded 13045 existing records. [2025-09-25T18:10:52.107694] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:10:52.107998] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-25T18:10:52.108068] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-25T18:10:52.108306] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-25T18:10:52.108363] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-25T18:10:52.471701] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:10:52.688699] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-25T18:10:53.457970] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:10:53.488691] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-25T18:10:53.672916] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T18:10:54.288715] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-25T18:10:54.940099] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:10:55.088774] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-25T18:10:55.448183] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T18:10:55.888742] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-25T18:10:56.058746] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T18:10:56.540894] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T18:10:56.688732] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-25T18:10:57.488723] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-25T18:10:57.993026] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T18:10:58.288704] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-25T18:10:58.385514] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T18:10:59.088733] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-25T18:10:59.107816] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T18:10:59.612166] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-25T18:10:59.888710] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-25T18:11:00.688744] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-25T18:11:00.776599] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T18:11:01.488711] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-25T18:11:01.785787] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T18:11:02.288728] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-25T18:11:02.897765] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T18:11:03.088717] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-25T18:11:03.201012] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T18:11:03.888791] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-25T18:11:04.615921] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T18:11:04.688683] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-25T18:11:05.488685] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-25T18:11:05.661638] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T18:11:06.046355] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T18:11:06.053116] [INFO ] [REMOTE ] CSL: Full fetch complete (44984 records). [2025-09-25T18:11:06.053227] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-25T18:11:06.054090] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:11:06.054190] [FATAL] [MAIN ] CSL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:11:06.054234] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:11:06.054273] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-25T18:11:06.054331] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-09-25T18:11:06.054378] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-09-25T18:11:06.054781] [DEBUG] [LOCAL ] CSL: Deleted derivative data file. [2025-09-25T18:11:06.055232] [INFO ] [MAIN ] Update Progress: 538/2372 symbols completed. CSL took 28.8s. Estimated remaining: 4h 2m 12s. Rate: 7.6 symbols/min [2025-09-25T18:11:06.226037] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:06.226246] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-25T18:11:06.226295] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-25T18:11:06.226440] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-25T18:11:06.226483] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-25T18:11:06.226524] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-25T18:11:06.226567] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-25T18:11:06.290512] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-25T18:11:06.419350] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T18:11:06.493183] [INFO ] [REMOTE ] CSR: Full fetch complete (17493 records). [2025-09-25T18:11:06.520326] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-25T18:11:06.735960] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:07.034032] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-25T18:11:07.034121] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-25T18:11:07.034536] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-25T18:11:07.034576] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-25T18:11:07.035242] [DEBUG] [LOCAL ] CSR: Trimmed 17493 records to 12686 (keeping 200 days of data) [2025-09-25T18:11:07.095986] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-25T18:11:07.126212] [DEBUG] [LOCAL ] CSR: Primary data saved (12686 records). [2025-09-25T18:11:07.126374] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-25T18:11:07.126472] [INFO ] [MAIN ] Update Progress: 539/2372 symbols completed. CSR took 26.1s. Estimated remaining: 4h 1m 41s. Rate: 7.6 symbols/min [2025-09-25T18:11:07.314997] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:07.316487] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T18:11:07.331799] [DEBUG] [LOCAL ] CTBB: Loaded 7061 existing records from primary storage. [2025-09-25T18:11:07.331966] [INFO ] [MAIN ] CTBB: Loaded 7061 existing records. [2025-09-25T18:11:07.510923] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:11:07.511190] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-25T18:11:07.511247] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-25T18:11:07.511474] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-25T18:11:07.511532] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-25T18:11:07.868613] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:07.888668] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-25T18:11:08.672249] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:11:08.688768] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-25T18:11:08.847570] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T18:11:09.209268] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T18:11:09.488727] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-25T18:11:10.288736] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-25T18:11:10.938214] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T18:11:10.975768] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T18:11:11.088757] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-25T18:11:11.307250] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:11.307568] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-25T18:11:11.888707] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-25T18:11:12.684757] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T18:11:12.687792] [INFO ] [REMOTE ] CSV: Full fetch complete (19460 records). [2025-09-25T18:11:12.687866] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-25T18:11:12.693807] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-25T18:11:13.065807] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-25T18:11:13.065915] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-25T18:11:13.066315] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-25T18:11:13.066353] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-25T18:11:13.066951] [DEBUG] [LOCAL ] CSV: Trimmed 19460 records to 13101 (keeping 200 days of data) [2025-09-25T18:11:13.146108] [DEBUG] [LOCAL ] CSV: Primary data saved (13101 records). [2025-09-25T18:11:13.146246] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-25T18:11:13.146333] [INFO ] [MAIN ] Update Progress: 540/2372 symbols completed. CSV took 21.5s. Estimated remaining: 4h 1m 27s. Rate: 7.6 symbols/min [2025-09-25T18:11:13.319583] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:13.328541] [DEBUG] [LOCAL ] CTDD: Loaded 5838 existing records from primary storage. [2025-09-25T18:11:13.328668] [INFO ] [MAIN ] CTDD: Loaded 5838 existing records. [2025-09-25T18:11:13.494347] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-25T18:11:13.522366] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:11:13.523263] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-25T18:11:13.523481] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-25T18:11:13.523820] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-25T18:11:13.523880] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-25T18:11:13.882540] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:14.244393] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T18:11:14.294478] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-25T18:11:14.300975] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T18:11:14.987168] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T18:11:15.088720] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-25T18:11:15.287113] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:15.287437] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-25T18:11:15.888734] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-25T18:11:16.648986] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T18:11:16.688725] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-25T18:11:17.408997] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T18:11:17.488776] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-25T18:11:18.278788] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T18:11:18.288667] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-25T18:11:18.881345] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T18:11:19.088771] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-25T18:11:19.888794] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-25T18:11:20.123265] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:20.123773] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-25T18:11:20.693820] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-25T18:11:20.711370] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T18:11:20.929455] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:20.929826] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-25T18:11:21.488728] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-25T18:11:22.087328] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T18:11:22.288744] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-25T18:11:23.088715] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-25T18:11:23.529418] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T18:11:23.790787] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T18:11:23.888713] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-25T18:11:24.582548] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T18:11:24.688753] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-25T18:11:25.488785] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-25T18:11:25.976082] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T18:11:26.241774] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T18:11:26.250532] [INFO ] [REMOTE ] CSTM: Full fetch complete (69161 records). [2025-09-25T18:11:26.250725] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-25T18:11:26.293988] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-25T18:11:26.650775] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-25T18:11:26.650868] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-25T18:11:26.651833] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-25T18:11:26.651905] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-25T18:11:26.653444] [DEBUG] [LOCAL ] CSTM: Trimmed 69161 records to 48051 (keeping 200 days of data) [2025-09-25T18:11:26.938038] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T18:11:26.952298] [DEBUG] [LOCAL ] CSTM: Primary data saved (48051 records). [2025-09-25T18:11:26.952443] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-25T18:11:26.953048] [INFO ] [MAIN ] Update Progress: 541/2372 symbols completed. CSTM took 44.4s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-25T18:11:27.093200] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-25T18:11:27.124673] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:27.124855] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-25T18:11:27.124909] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-25T18:11:27.125051] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-25T18:11:27.125094] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-25T18:11:27.125135] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-25T18:11:27.125168] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-25T18:11:27.483143] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:27.871203] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T18:11:27.888671] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-25T18:11:28.120413] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:28.120748] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-25T18:11:28.688733] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-25T18:11:29.412366] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-25T18:11:29.488666] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-25T18:11:30.083368] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T18:11:30.288764] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-25T18:11:30.586591] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:30.586953] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-25T18:11:31.088710] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-25T18:11:31.324430] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:31.324760] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-25T18:11:31.888698] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-25T18:11:32.126569] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:32.126919] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-25T18:11:32.688709] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-25T18:11:32.906822] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:32.907129] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-25T18:11:33.488722] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-25T18:11:33.684249] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:33.684570] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-25T18:11:34.288728] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-25T18:11:34.920511] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T18:11:35.088729] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-25T18:11:35.763361] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T18:11:35.765296] [INFO ] [REMOTE ] CTDD: Full fetch complete (8533 records). [2025-09-25T18:11:35.765373] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-25T18:11:35.893861] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-25T18:11:36.155727] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-25T18:11:36.155815] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-25T18:11:36.156086] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-25T18:11:36.156133] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-25T18:11:36.156551] [DEBUG] [LOCAL ] CTDD: Trimmed 8533 records to 5891 (keeping 200 days of data) [2025-09-25T18:11:36.193162] [DEBUG] [LOCAL ] CTDD: Primary data saved (5891 records). [2025-09-25T18:11:36.193292] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-25T18:11:36.193383] [INFO ] [MAIN ] Update Progress: 542/2372 symbols completed. CTDD took 23.0s. Estimated remaining: 4h 1m 35s. Rate: 7.6 symbols/min [2025-09-25T18:11:36.365949] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:36.366158] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-25T18:11:36.366198] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-25T18:11:36.366344] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-25T18:11:36.366386] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-25T18:11:36.366427] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-25T18:11:36.366458] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-25T18:11:36.706765] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-25T18:11:36.755102] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:36.848677] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-25T18:11:36.962849] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:36.963225] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-25T18:11:37.488730] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-25T18:11:37.723618] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:37.724014] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-25T18:11:38.288720] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-25T18:11:39.045820] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-25T18:11:39.088670] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-25T18:11:39.309815] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:39.310130] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-25T18:11:39.888782] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-25T18:11:40.382233] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:11:40.688767] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-25T18:11:41.490628] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-25T18:11:41.493943] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T18:11:42.288707] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-25T18:11:42.331711] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T18:11:43.088700] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-25T18:11:43.294597] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T18:11:43.707712] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T18:11:43.888697] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-25T18:11:44.688684] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-25T18:11:44.721702] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:11:45.444899] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T18:11:45.488705] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-25T18:11:45.859430] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-25T18:11:46.288788] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-25T18:11:47.088789] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-25T18:11:47.306416] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.22 seconds). [2025-09-25T18:11:47.425506] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T18:11:47.430662] [INFO ] [REMOTE ] CSW: Full fetch complete (8139 records). [2025-09-25T18:11:47.430769] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-25T18:11:47.626380] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-25T18:11:47.626673] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:11:47.626761] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:11:47.626851] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-25T18:11:47.626974] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-25T18:11:47.627051] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-25T18:11:47.627128] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-25T18:11:47.627225] [INFO ] [MAIN ] Update Progress: 543/2372 symbols completed. CSW took 41.6s. Estimated remaining: 4h 1m 39s. Rate: 7.6 symbols/min [2025-09-25T18:11:47.803986] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:47.839478] [DEBUG] [LOCAL ] CTO: Loaded 28253 existing records from primary storage. [2025-09-25T18:11:47.839618] [INFO ] [MAIN ] CTO: Loaded 28253 existing records. [2025-09-25T18:11:47.897289] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-25T18:11:48.030326] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:11:48.030606] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-25T18:11:48.030688] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-25T18:11:48.031248] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-25T18:11:48.031310] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-25T18:11:48.396115] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:48.669670] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T18:11:48.688664] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-25T18:11:49.232564] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T18:11:49.488724] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-25T18:11:50.117691] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T18:11:50.119420] [INFO ] [REMOTE ] CTBB: Full fetch complete (10914 records). [2025-09-25T18:11:50.119490] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-25T18:11:50.289053] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-25T18:11:50.497027] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-25T18:11:50.497117] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-25T18:11:50.497377] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-25T18:11:50.497414] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-25T18:11:50.497887] [DEBUG] [LOCAL ] CTBB: Trimmed 10914 records to 7094 (keeping 200 days of data) [2025-09-25T18:11:50.542352] [DEBUG] [LOCAL ] CTBB: Primary data saved (7094 records). [2025-09-25T18:11:50.542476] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-25T18:11:50.542577] [INFO ] [MAIN ] Update Progress: 544/2372 symbols completed. CTBB took 43.4s. Estimated remaining: 4h 1m 15s. Rate: 7.6 symbols/min [2025-09-25T18:11:50.713594] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:50.751548] [DEBUG] [LOCAL ] CTOS: Loaded 36721 existing records from primary storage. [2025-09-25T18:11:50.751708] [INFO ] [MAIN ] CTOS: Loaded 36721 existing records. [2025-09-25T18:11:50.796556] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:50.834808] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-25T18:11:50.935541] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:11:50.935850] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-25T18:11:50.935914] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-25T18:11:50.936173] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-25T18:11:50.936231] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-25T18:11:51.095457] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-25T18:11:51.299698] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:51.524363] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:11:51.524703] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-25T18:11:51.524804] [INFO ] [REMOTE ] CTEST: Full fetch complete (1020 records). [2025-09-25T18:11:51.524917] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-25T18:11:51.525603] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:11:51.525714] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:11:51.525803] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:11:51.525916] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-25T18:11:51.526026] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-25T18:11:51.526098] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-25T18:11:51.526166] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-25T18:11:51.526250] [INFO ] [MAIN ] Update Progress: 545/2372 symbols completed. CTEST took 24.6s. Estimated remaining: 4h 0m 43s. Rate: 7.6 symbols/min [2025-09-25T18:11:51.701683] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:11:51.770556] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-25T18:11:51.770752] [INFO ] [MAIN ] CTRA: Loaded 53649 existing records. [2025-09-25T18:11:51.893875] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-25T18:11:51.953540] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:11:51.953867] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-25T18:11:51.953933] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-25T18:11:51.954347] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-25T18:11:51.954410] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-25T18:11:52.319997] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:11:52.688716] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-25T18:11:53.117148] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:11:53.488725] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-25T18:11:53.860874] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T18:11:54.288721] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-25T18:11:54.663431] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T18:11:54.911100] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T18:11:55.088720] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-25T18:11:55.888715] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-25T18:11:56.688719] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-25T18:11:57.004055] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T18:11:57.095912] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T18:11:57.413441] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T18:11:57.488685] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-25T18:11:58.288737] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-25T18:11:58.574681] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T18:11:59.088710] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-25T18:11:59.274233] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T18:11:59.888724] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-25T18:12:00.264063] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T18:12:00.688708] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-25T18:12:01.488686] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-25T18:12:01.747602] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T18:12:01.750678] [INFO ] [REMOTE ] CTEV: Full fetch complete (13613 records). [2025-09-25T18:12:01.750761] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-25T18:12:01.751405] [FATAL] [VALIDATOR ] CTEV: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:12:01.751493] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:12:01.751537] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:12:01.751576] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-25T18:12:01.751697] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-25T18:12:01.751766] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-25T18:12:01.751826] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-25T18:12:01.751928] [INFO ] [MAIN ] Update Progress: 546/2372 symbols completed. CTEV took 25.6s. Estimated remaining: 4h 0m 43s. Rate: 7.6 symbols/min [2025-09-25T18:12:01.938329] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:01.973834] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T18:12:02.028260] [DEBUG] [LOCAL ] CTRE: Loaded 49225 existing records from primary storage. [2025-09-25T18:12:02.028487] [INFO ] [MAIN ] CTRE: Loaded 49225 existing records. [2025-09-25T18:12:02.214595] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:02.214876] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-25T18:12:02.214926] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-25T18:12:02.215157] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-25T18:12:02.215217] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-25T18:12:02.293786] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-25T18:12:02.586723] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:02.893070] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:12:03.088771] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-25T18:12:03.393966] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T18:12:03.888777] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-25T18:12:04.688683] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-25T18:12:04.753294] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:12:05.056912] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T18:12:05.488762] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-25T18:12:06.288720] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-25T18:12:06.405360] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T18:12:06.705395] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T18:12:07.088775] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-25T18:12:07.888740] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-25T18:12:08.097418] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T18:12:08.542992] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T18:12:08.688731] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-25T18:12:09.117401] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T18:12:09.488719] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-25T18:12:10.288772] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-25T18:12:10.432982] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T18:12:10.840256] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T18:12:11.088773] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-25T18:12:11.304156] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T18:12:11.888819] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-25T18:12:12.545791] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T18:12:12.688716] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-25T18:12:13.488746] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-25T18:12:13.895206] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T18:12:14.013263] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T18:12:14.288790] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-25T18:12:14.726752] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T18:12:15.088731] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-25T18:12:15.850602] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:12:15.888679] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-25T18:12:16.100624] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T18:12:16.688740] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-25T18:12:17.488729] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-25T18:12:17.641757] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T18:12:18.108807] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T18:12:18.288734] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-25T18:12:19.088730] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-25T18:12:19.173307] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T18:12:19.179861] [INFO ] [REMOTE ] CTOS: Full fetch complete (53437 records). [2025-09-25T18:12:19.179974] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-25T18:12:19.566936] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-25T18:12:19.567025] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-25T18:12:19.567771] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-25T18:12:19.567837] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-25T18:12:19.569040] [DEBUG] [LOCAL ] CTOS: Trimmed 53437 records to 36991 (keeping 200 days of data) [2025-09-25T18:12:19.776073] [DEBUG] [LOCAL ] CTOS: Primary data saved (36991 records). [2025-09-25T18:12:19.776222] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-25T18:12:19.776308] [INFO ] [MAIN ] Update Progress: 547/2372 symbols completed. CTOS took 29.2s. Estimated remaining: 4h 1m 9s. Rate: 7.6 symbols/min [2025-09-25T18:12:19.893799] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-25T18:12:19.960764] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:19.996987] [DEBUG] [LOCAL ] CTRI: Loaded 37887 existing records from primary storage. [2025-09-25T18:12:19.997236] [INFO ] [MAIN ] CTRI: Loaded 37887 existing records. [2025-09-25T18:12:20.184526] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:20.184994] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-25T18:12:20.185099] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-25T18:12:20.185405] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-25T18:12:20.185466] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-25T18:12:20.337302] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T18:12:20.636937] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:20.663976] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:12:20.688670] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-25T18:12:20.795109] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T18:12:21.488700] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-25T18:12:21.569072] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T18:12:22.288750] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-25T18:12:23.088687] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-25T18:12:23.125814] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:12:23.588377] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T18:12:23.888735] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-25T18:12:24.688757] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-25T18:12:25.039505] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T18:12:25.049835] [INFO ] [REMOTE ] CTRA: Full fetch complete (77663 records). [2025-09-25T18:12:25.049990] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-25T18:12:25.335935] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T18:12:25.387037] [INFO ] [REMOTE ] CTO: Full fetch complete (41785 records). [2025-09-25T18:12:25.390065] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-25T18:12:25.489207] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-25T18:12:25.606341] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-25T18:12:25.612277] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-25T18:12:25.634271] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-25T18:12:25.647987] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-25T18:12:25.787493] [DEBUG] [LOCAL ] CTRA: Trimmed 77663 records to 54038 (keeping 200 days of data) [2025-09-25T18:12:25.807369] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T18:12:26.031512] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-25T18:12:26.035704] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-25T18:12:26.036699] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-25T18:12:26.039686] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-25T18:12:26.055452] [DEBUG] [LOCAL ] CTO: Trimmed 41785 records to 28465 (keeping 200 days of data) [2025-09-25T18:12:26.289064] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-25T18:12:26.415698] [DEBUG] [LOCAL ] CTRA: Primary data saved (54038 records). [2025-09-25T18:12:26.416414] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-25T18:12:26.417372] [INFO ] [MAIN ] Update Progress: 548/2372 symbols completed. CTRA took 34.9s. Estimated remaining: 4h 0m 57s. Rate: 7.6 symbols/min [2025-09-25T18:12:26.649999] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:26.662842] [DEBUG] [LOCAL ] CTO: Primary data saved (28465 records). [2025-09-25T18:12:26.667406] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-25T18:12:26.667542] [INFO ] [MAIN ] Update Progress: 549/2372 symbols completed. CTO took 39.0s. Estimated remaining: 4h 0m 23s. Rate: 7.6 symbols/min [2025-09-25T18:12:26.747352] [DEBUG] [LOCAL ] CTS: Loaded 19327 existing records from primary storage. [2025-09-25T18:12:26.783081] [INFO ] [MAIN ] CTS: Loaded 19327 existing records. [2025-09-25T18:12:26.939368] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:27.095872] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:27.096493] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-25T18:12:27.096791] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-25T18:12:27.097105] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-25T18:12:27.098120] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-25T18:12:27.325375] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:12:27.425365] [DEBUG] [LOCAL ] CTVA: Loaded 53225 existing records from primary storage. [2025-09-25T18:12:27.441626] [INFO ] [MAIN ] CTVA: Loaded 53225 existing records. [2025-09-25T18:12:27.441502] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-25T18:12:27.603345] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:12:27.689868] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:27.767947] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:27.768190] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-25T18:12:27.768239] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-25T18:12:27.768490] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-25T18:12:27.768548] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-25T18:12:27.893820] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-25T18:12:28.129801] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:28.688685] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-25T18:12:28.720114] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:12:29.020151] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T18:12:29.488714] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-25T18:12:29.734709] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T18:12:30.136267] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T18:12:30.288695] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-25T18:12:31.088720] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-25T18:12:31.888729] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-25T18:12:32.073077] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T18:12:32.239471] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T18:12:32.688700] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-25T18:12:32.714890] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T18:12:33.488795] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-25T18:12:33.991039] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T18:12:34.288724] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-25T18:12:35.034605] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T18:12:35.044047] [INFO ] [REMOTE ] CTRE: Full fetch complete (71089 records). [2025-09-25T18:12:35.044166] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-25T18:12:35.088854] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-25T18:12:35.240693] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T18:12:35.462555] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-25T18:12:35.462634] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-25T18:12:35.463453] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-25T18:12:35.463501] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-25T18:12:35.464999] [DEBUG] [LOCAL ] CTRE: Trimmed 71089 records to 49589 (keeping 200 days of data) [2025-09-25T18:12:35.767133] [DEBUG] [LOCAL ] CTRE: Primary data saved (49589 records). [2025-09-25T18:12:35.767388] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-25T18:12:35.767483] [INFO ] [MAIN ] Update Progress: 550/2372 symbols completed. CTRE took 34.0s. Estimated remaining: 4h 0m 19s. Rate: 7.6 symbols/min [2025-09-25T18:12:35.893887] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-25T18:12:35.941378] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:35.941598] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-25T18:12:35.941683] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-25T18:12:35.941852] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-25T18:12:35.941895] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-25T18:12:35.941937] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-25T18:12:35.941968] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-25T18:12:36.312380] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:36.371621] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:12:36.688698] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-25T18:12:37.364242] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:12:37.488673] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-25T18:12:37.514285] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T18:12:38.288748] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-25T18:12:38.762431] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T18:12:39.088721] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-25T18:12:39.329703] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:12:39.888800] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-25T18:12:40.274286] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-25T18:12:40.684984] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T18:12:40.693987] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-25T18:12:40.696524] [INFO ] [REMOTE ] CTRI: Full fetch complete (51163 records). [2025-09-25T18:12:40.696692] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-25T18:12:41.110003] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-25T18:12:41.110097] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-25T18:12:41.110815] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-25T18:12:41.110879] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-25T18:12:41.112120] [DEBUG] [LOCAL ] CTRI: Trimmed 51163 records to 38243 (keeping 200 days of data) [2025-09-25T18:12:41.344182] [DEBUG] [LOCAL ] CTRI: Primary data saved (38243 records). [2025-09-25T18:12:41.344341] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-25T18:12:41.344431] [INFO ] [MAIN ] Update Progress: 551/2372 symbols completed. CTRI took 21.6s. Estimated remaining: 4h 0m 4s. Rate: 7.6 symbols/min [2025-09-25T18:12:41.495393] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-25T18:12:41.530663] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:41.584947] [DEBUG] [LOCAL ] CUBE: Loaded 50695 existing records from primary storage. [2025-09-25T18:12:41.585127] [INFO ] [MAIN ] CUBE: Loaded 50695 existing records. [2025-09-25T18:12:41.724954] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T18:12:41.785071] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:41.785342] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-25T18:12:41.785389] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-25T18:12:41.785701] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-25T18:12:41.785791] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-25T18:12:41.890256] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T18:12:42.155242] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:42.288722] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-25T18:12:43.088733] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-25T18:12:43.513561] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:12:43.888732] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-25T18:12:43.969560] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T18:12:44.688771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-25T18:12:45.000422] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-25T18:12:45.488695] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-25T18:12:45.636554] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T18:12:46.288711] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-25T18:12:46.551587] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T18:12:46.579432] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-25T18:12:47.088720] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-25T18:12:47.403481] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-25T18:12:47.888700] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-25T18:12:48.688719] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-25T18:12:49.488686] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-25T18:12:49.658421] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T18:12:49.690522] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T18:12:49.696258] [INFO ] [REMOTE ] CTS: Full fetch complete (26604 records). [2025-09-25T18:12:49.696365] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-25T18:12:50.071134] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-25T18:12:50.071218] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-25T18:12:50.071673] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-25T18:12:50.071777] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-25T18:12:50.072459] [DEBUG] [LOCAL ] CTS: Trimmed 26604 records to 19488 (keeping 200 days of data) [2025-09-25T18:12:50.201392] [DEBUG] [LOCAL ] CTS: Primary data saved (19488 records). [2025-09-25T18:12:50.201530] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-25T18:12:50.201670] [INFO ] [MAIN ] Update Progress: 552/2372 symbols completed. CTS took 23.8s. Estimated remaining: 3h 59m 59s. Rate: 7.6 symbols/min [2025-09-25T18:12:50.294824] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-25T18:12:50.380079] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:50.408244] [DEBUG] [LOCAL ] CUBI: Loaded 27343 existing records from primary storage. [2025-09-25T18:12:50.408378] [INFO ] [MAIN ] CUBI: Loaded 27343 existing records. [2025-09-25T18:12:50.585576] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:50.585969] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-25T18:12:50.586058] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-25T18:12:50.586595] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-25T18:12:50.586733] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-25T18:12:50.876984] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T18:12:50.958786] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:50.982776] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T18:12:51.088675] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-25T18:12:51.888750] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-25T18:12:52.007904] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T18:12:52.688729] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-25T18:12:53.420328] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T18:12:53.488673] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-25T18:12:53.661673] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:12:54.288711] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-25T18:12:54.532796] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-25T18:12:55.088724] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-25T18:12:55.221919] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T18:12:55.888683] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-25T18:12:56.170964] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T18:12:56.186627] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-25T18:12:56.688709] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-25T18:12:57.043807] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-25T18:12:57.488695] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-25T18:12:58.288779] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-25T18:12:58.576815] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T18:12:58.809842] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-25T18:12:58.810694] [INFO ] [REMOTE ] CUBB: Full fetch complete (929 records). [2025-09-25T18:12:58.810768] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-25T18:12:59.004067] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-25T18:12:59.004235] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:12:59.004287] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:12:59.004371] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-25T18:12:59.004437] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-25T18:12:59.004472] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-25T18:12:59.004535] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-25T18:12:59.004659] [INFO ] [MAIN ] Update Progress: 553/2372 symbols completed. CUBB took 23.2s. Estimated remaining: 3h 59m 54s. Rate: 7.6 symbols/min [2025-09-25T18:12:59.093879] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-25T18:12:59.182027] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:12:59.238752] [DEBUG] [LOCAL ] CUK: Loaded 50995 existing records from primary storage. [2025-09-25T18:12:59.238892] [INFO ] [MAIN ] CUK: Loaded 50995 existing records. [2025-09-25T18:12:59.420277] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:12:59.420563] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-25T18:12:59.420615] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-25T18:12:59.420911] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-25T18:12:59.420969] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-25T18:12:59.790307] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:12:59.888777] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-25T18:13:00.480323] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T18:13:00.688788] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-25T18:13:01.331778] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T18:13:01.488767] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-25T18:13:02.262351] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T18:13:02.288728] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-25T18:13:02.576486] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T18:13:03.088725] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-25T18:13:03.786108] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T18:13:03.888697] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-25T18:13:04.608877] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T18:13:04.626942] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T18:13:04.688690] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-25T18:13:05.488732] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-25T18:13:06.288760] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-25T18:13:06.548018] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T18:13:06.621788] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T18:13:07.088728] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-25T18:13:07.888706] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-25T18:13:07.980300] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T18:13:08.689316] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-25T18:13:08.689224] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T18:13:08.802866] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:13:09.488724] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-25T18:13:10.247447] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T18:13:10.288726] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-25T18:13:10.892337] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T18:13:11.088750] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-25T18:13:11.729208] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T18:13:11.888708] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-25T18:13:12.340936] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T18:13:12.346727] [INFO ] [REMOTE ] CUBI: Full fetch complete (39129 records). [2025-09-25T18:13:12.346888] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-25T18:13:12.347876] [FATAL] [VALIDATOR ] CUBI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:13:12.348008] [FATAL] [MAIN ] CUBI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:13:12.348093] [WARN ] [MAIN ] CUBI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:13:12.348181] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-25T18:13:12.348280] [DEBUG] [LOCAL ] CUBI: No primary data file found to delete. [2025-09-25T18:13:12.348360] [INFO ] [LOCAL ] CUBI: Starting deletion of derivative data. [2025-09-25T18:13:12.348763] [DEBUG] [LOCAL ] CUBI: Deleted derivative data file. [2025-09-25T18:13:12.348899] [INFO ] [MAIN ] Update Progress: 554/2372 symbols completed. CUBI took 22.1s. Estimated remaining: 4h 0m 4s. Rate: 7.6 symbols/min [2025-09-25T18:13:12.585338] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:12.592470] [DEBUG] [LOCAL ] CULP: Loaded 3045 existing records from primary storage. [2025-09-25T18:13:12.592618] [INFO ] [MAIN ] CULP: Loaded 3045 existing records. [2025-09-25T18:13:12.696905] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-25T18:13:12.791616] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:12.791904] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-25T18:13:12.791953] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-25T18:13:12.792113] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-25T18:13:12.792170] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-25T18:13:13.156253] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:13.488709] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-25T18:13:13.608101] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T18:13:14.289146] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T18:13:14.289374] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-25T18:13:14.559127] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:13:15.088730] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-25T18:13:15.121297] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:13:15.888714] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-25T18:13:16.479499] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T18:13:16.506893] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T18:13:16.688766] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-25T18:13:17.488792] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-25T18:13:18.288722] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-25T18:13:18.589022] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:13:18.700204] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T18:13:18.956799] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T18:13:19.088675] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-25T18:13:19.559015] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-25T18:13:19.888731] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-25T18:13:20.688723] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-25T18:13:21.246323] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-25T18:13:21.488702] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-25T18:13:21.570727] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:13:22.288750] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-25T18:13:22.916161] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T18:13:23.088731] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-25T18:13:23.888707] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-25T18:13:24.448189] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-25T18:13:24.459884] [INFO ] [REMOTE ] CTVA: Full fetch complete (76949 records). [2025-09-25T18:13:24.460033] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-25T18:13:24.695476] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-25T18:13:24.733724] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T18:13:24.913593] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-25T18:13:24.913748] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-25T18:13:24.914862] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-25T18:13:24.914930] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-25T18:13:24.919511] [DEBUG] [LOCAL ] CTVA: Trimmed 76949 records to 53612 (keeping 200 days of data) [2025-09-25T18:13:25.277195] [DEBUG] [LOCAL ] CTVA: Primary data saved (53612 records). [2025-09-25T18:13:25.277355] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-25T18:13:25.277468] [INFO ] [MAIN ] Update Progress: 555/2372 symbols completed. CTVA took 58.6s. Estimated remaining: 4h 0m 12s. Rate: 7.6 symbols/min [2025-09-25T18:13:25.396466] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T18:13:25.460470] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:25.494439] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-25T18:13:25.525460] [DEBUG] [LOCAL ] CURB: Loaded 32949 existing records from primary storage. [2025-09-25T18:13:25.525727] [INFO ] [MAIN ] CURB: Loaded 32949 existing records. [2025-09-25T18:13:25.588774] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:13:25.739534] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:25.739899] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-25T18:13:25.739985] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-25T18:13:25.740295] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-25T18:13:25.740361] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-25T18:13:26.142376] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:26.288747] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-25T18:13:27.088721] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-25T18:13:27.339272] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:13:27.348943] [INFO ] [REMOTE ] CUK: Full fetch complete (73768 records). [2025-09-25T18:13:27.349067] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-25T18:13:27.612853] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T18:13:27.769568] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-25T18:13:27.769814] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-25T18:13:27.771186] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-25T18:13:27.771355] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-25T18:13:27.781954] [DEBUG] [LOCAL ] CUK: Trimmed 73768 records to 51382 (keeping 200 days of data) [2025-09-25T18:13:27.799218] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T18:13:27.898330] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-25T18:13:27.871848] [INFO ] [REMOTE ] CUBE: Full fetch complete (72631 records). [2025-09-25T18:13:27.900595] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-25T18:13:27.903565] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:13:27.905979] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:13:27.907114] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:13:27.908046] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-25T18:13:27.908728] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-09-25T18:13:27.909410] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-09-25T18:13:27.910606] [DEBUG] [LOCAL ] CUBE: Deleted derivative data file. [2025-09-25T18:13:27.911824] [INFO ] [MAIN ] Update Progress: 556/2372 symbols completed. CUBE took 46.6s. Estimated remaining: 3h 59m 47s. Rate: 7.6 symbols/min [2025-09-25T18:13:28.106732] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:28.228623] [DEBUG] [LOCAL ] CURV: Loaded 26594 existing records from primary storage. [2025-09-25T18:13:28.229029] [INFO ] [MAIN ] CURV: Loaded 26594 existing records. [2025-09-25T18:13:28.408369] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T18:13:28.502212] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:28.504418] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-25T18:13:28.512142] [DEBUG] [LOCAL ] CUK: Primary data saved (51382 records). [2025-09-25T18:13:28.509092] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-25T18:13:28.512353] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-25T18:13:28.512479] [INFO ] [MAIN ] Update Progress: 557/2372 symbols completed. CUK took 29.5s. Estimated remaining: 3h 59m 15s. Rate: 7.6 symbols/min [2025-09-25T18:13:28.512612] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-25T18:13:28.512795] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-25T18:13:28.690383] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-25T18:13:28.879941] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:29.488791] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-25T18:13:29.978315] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T18:13:30.288745] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-25T18:13:30.417835] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T18:13:30.843386] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-25T18:13:30.844769] [INFO ] [REMOTE ] CULP: Full fetch complete (4802 records). [2025-09-25T18:13:30.844842] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-25T18:13:31.095022] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-25T18:13:31.213598] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-25T18:13:31.213701] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-25T18:13:31.213885] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-25T18:13:31.213932] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-25T18:13:31.214326] [DEBUG] [LOCAL ] CULP: Trimmed 4802 records to 3087 (keeping 200 days of data) [2025-09-25T18:13:31.231529] [DEBUG] [LOCAL ] CULP: Primary data saved (3087 records). [2025-09-25T18:13:31.231590] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-25T18:13:31.231686] [INFO ] [MAIN ] Update Progress: 558/2372 symbols completed. CULP took 18.9s. Estimated remaining: 3h 58m 51s. Rate: 7.6 symbols/min [2025-09-25T18:13:31.888768] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-25T18:13:32.736938] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T18:13:32.750474] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-25T18:13:33.195938] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T18:13:33.488762] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-25T18:13:33.582582] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T18:13:34.288774] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-25T18:13:34.787639] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T18:13:35.088728] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-25T18:13:35.431787] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T18:13:35.888699] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-25T18:13:36.007791] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T18:13:36.688676] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-25T18:13:36.986888] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T18:13:37.488716] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-25T18:13:37.746271] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T18:13:38.288707] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-25T18:13:38.626570] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T18:13:39.093841] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-25T18:13:39.106169] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T18:13:39.750608] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T18:13:39.888725] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-25T18:13:40.688773] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-25T18:13:41.018714] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T18:13:41.488764] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-25T18:13:41.643811] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:13:42.288771] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-25T18:13:42.522840] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T18:13:43.088776] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-25T18:13:43.796369] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:13:43.888717] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-25T18:13:44.112527] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T18:13:44.688703] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-25T18:13:45.156673] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T18:13:45.488781] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-25T18:13:46.199371] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T18:13:46.205685] [INFO ] [REMOTE ] CURB: Full fetch complete (47226 records). [2025-09-25T18:13:46.205785] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-25T18:13:46.584144] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-25T18:13:46.584226] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-25T18:13:46.584854] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-25T18:13:46.584917] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-25T18:13:46.586081] [DEBUG] [LOCAL ] CURB: Trimmed 47226 records to 33144 (keeping 200 days of data) [2025-09-25T18:13:46.787232] [DEBUG] [LOCAL ] CURB: Primary data saved (33144 records). [2025-09-25T18:13:46.787373] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-25T18:13:46.787473] [INFO ] [MAIN ] Update Progress: 559/2372 symbols completed. CURB took 21.5s. Estimated remaining: 3h 59m 8s. Rate: 7.6 symbols/min [2025-09-25T18:13:46.955124] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T18:13:46.961707] [INFO ] [REMOTE ] CURV: Full fetch complete (39273 records). [2025-09-25T18:13:46.961804] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-25T18:13:46.962409] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:13:46.962495] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:13:46.962538] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:13:46.962598] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-25T18:13:46.962688] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-25T18:13:46.962745] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-09-25T18:13:46.963022] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-09-25T18:13:46.963129] [INFO ] [MAIN ] Update Progress: 560/2372 symbols completed. CURV took 19.1s. Estimated remaining: 3h 58m 35s. Rate: 7.6 symbols/min [2025-09-25T18:13:47.676784] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:47.674106] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:47.675684] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:47.702119] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:13:47.722307] [DEBUG] [LOCAL ] CVEO: Loaded 15263 existing records from primary storage. [2025-09-25T18:13:47.722445] [INFO ] [MAIN ] CVEO: Loaded 15263 existing records. [2025-09-25T18:13:48.003148] [DEBUG] [LOCAL ] CUZ: Loaded 49420 existing records from primary storage. [2025-09-25T18:13:48.003395] [INFO ] [MAIN ] CUZ: Loaded 49420 existing records. [2025-09-25T18:13:48.000154] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:48.001574] [DEBUG] [LOCAL ] CVI: Loaded 46432 existing records from primary storage. [2025-09-25T18:13:48.009273] [INFO ] [MAIN ] CVI: Loaded 46432 existing records. [2025-09-25T18:13:48.036691] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-25T18:13:48.096555] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-25T18:13:48.142308] [DEBUG] [LOCAL ] CVE: Loaded 53556 existing records from primary storage. [2025-09-25T18:13:48.153452] [INFO ] [MAIN ] CVE: Loaded 53556 existing records. [2025-09-25T18:13:48.153243] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-25T18:13:48.175060] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-25T18:13:48.668084] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:48.705209] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-25T18:13:48.722698] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-25T18:13:48.739946] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:48.810753] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-25T18:13:48.789620] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-25T18:13:48.882804] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-25T18:13:48.941260] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:13:48.946766] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-25T18:13:48.970486] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-25T18:13:48.975988] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-25T18:13:48.970063] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-25T18:13:49.011760] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-25T18:13:49.032288] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-25T18:13:49.099095] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-25T18:13:49.468535] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:49.537883] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-25T18:13:50.279985] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:50.310025] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:50.305987] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-25T18:13:50.328440] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-25T18:13:50.400040] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:13:50.400433] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-25T18:13:50.597749] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T18:13:50.600782] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-25T18:13:51.349152] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T18:13:51.351488] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-25T18:13:51.893155] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T18:13:51.898015] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-25T18:13:51.965511] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T18:13:51.976562] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-25T18:13:52.023014] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T18:13:52.312598] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T18:13:52.617860] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T18:13:52.688692] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-25T18:13:53.210705] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T18:13:53.473016] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T18:13:53.488678] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-25T18:13:54.230572] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T18:13:54.288705] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-25T18:13:54.949772] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T18:13:55.088801] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-25T18:13:55.888710] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-25T18:13:56.426048] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T18:13:56.465697] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T18:13:56.688720] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-25T18:13:57.488773] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-25T18:13:57.892256] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T18:13:58.288775] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-25T18:13:58.632493] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T18:13:58.848334] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T18:13:59.088715] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-25T18:13:59.888697] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-25T18:14:00.688730] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-25T18:14:01.330817] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-25T18:14:01.488761] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-25T18:14:01.695260] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T18:14:01.953861] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T18:14:01.956880] [INFO ] [REMOTE ] CVEO: Full fetch complete (20193 records). [2025-09-25T18:14:01.956961] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-25T18:14:01.957402] [FATAL] [VALIDATOR ] CVEO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:14:01.957505] [FATAL] [MAIN ] CVEO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:14:01.957553] [WARN ] [MAIN ] CVEO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:14:01.957669] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-25T18:14:01.957936] [DEBUG] [LOCAL ] CVEO: No primary data file found to delete. [2025-09-25T18:14:01.958010] [INFO ] [LOCAL ] CVEO: Starting deletion of derivative data. [2025-09-25T18:14:01.958356] [DEBUG] [LOCAL ] CVEO: Deleted derivative data file. [2025-09-25T18:14:01.958501] [INFO ] [MAIN ] Update Progress: 561/2372 symbols completed. CVEO took 15.0s. Estimated remaining: 3h 58m 50s. Rate: 7.6 symbols/min [2025-09-25T18:14:02.142687] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:02.161358] [DEBUG] [LOCAL ] CVLG: Loaded 15591 existing records from primary storage. [2025-09-25T18:14:02.161487] [INFO ] [MAIN ] CVLG: Loaded 15591 existing records. [2025-09-25T18:14:02.293787] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-25T18:14:02.348694] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:14:02.348958] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-25T18:14:02.349003] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-25T18:14:02.349200] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-25T18:14:02.349258] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-25T18:14:02.713933] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:03.088736] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-25T18:14:03.255936] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T18:14:03.863937] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T18:14:03.888711] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-25T18:14:03.999933] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:14:04.688732] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-25T18:14:05.488754] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-25T18:14:05.767618] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T18:14:06.288722] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-25T18:14:06.326313] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T18:14:06.845661] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T18:14:07.088741] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-25T18:14:07.600614] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T18:14:07.888724] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-25T18:14:08.688690] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-25T18:14:08.758498] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T18:14:09.493809] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-25T18:14:09.517041] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T18:14:09.956142] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T18:14:10.288728] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-25T18:14:11.088700] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-25T18:14:11.301312] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T18:14:11.842221] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T18:14:11.888788] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-25T18:14:12.454030] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T18:14:12.570104] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T18:14:12.688762] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-25T18:14:13.314100] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T18:14:13.488830] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-25T18:14:14.288782] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-25T18:14:15.042223] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T18:14:15.088813] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-25T18:14:15.888759] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-25T18:14:16.348729] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T18:14:16.402032] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-25T18:14:16.688765] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-25T18:14:17.488757] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-25T18:14:17.565316] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T18:14:18.288743] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-25T18:14:18.432089] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T18:14:18.658893] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T18:14:19.088737] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-25T18:14:19.785844] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T18:14:19.888690] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-25T18:14:20.057566] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T18:14:20.066835] [INFO ] [REMOTE ] CUZ: Full fetch complete (70786 records). [2025-09-25T18:14:20.066996] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-25T18:14:20.464930] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-25T18:14:20.465040] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-25T18:14:20.465906] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-25T18:14:20.465972] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-25T18:14:20.467325] [DEBUG] [LOCAL ] CUZ: Trimmed 70786 records to 49778 (keeping 200 days of data) [2025-09-25T18:14:20.688756] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-25T18:14:20.771633] [DEBUG] [LOCAL ] CUZ: Primary data saved (49778 records). [2025-09-25T18:14:20.771798] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-25T18:14:20.771886] [INFO ] [MAIN ] Update Progress: 562/2372 symbols completed. CUZ took 33.8s. Estimated remaining: 3h 59m 17s. Rate: 7.6 symbols/min [2025-09-25T18:14:20.944063] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:20.995220] [DEBUG] [LOCAL ] CVNA: Loaded 53009 existing records from primary storage. [2025-09-25T18:14:20.995392] [INFO ] [MAIN ] CVNA: Loaded 53009 existing records. [2025-09-25T18:14:21.175222] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:14:21.175464] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-25T18:14:21.175511] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-25T18:14:21.175767] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-25T18:14:21.175837] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-25T18:14:21.493516] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-25T18:14:21.547251] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:21.573283] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T18:14:21.582467] [INFO ] [REMOTE ] CVI: Full fetch complete (67294 records). [2025-09-25T18:14:21.582604] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-25T18:14:21.992263] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-25T18:14:21.992383] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-25T18:14:21.993249] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-25T18:14:21.993475] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-25T18:14:22.008290] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T18:14:22.013438] [DEBUG] [LOCAL ] CVI: Trimmed 67294 records to 46801 (keeping 200 days of data) [2025-09-25T18:14:22.288957] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-25T18:14:22.300534] [DEBUG] [LOCAL ] CVI: Primary data saved (46801 records). [2025-09-25T18:14:22.300619] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-25T18:14:22.300768] [INFO ] [MAIN ] Update Progress: 563/2372 symbols completed. CVI took 35.3s. Estimated remaining: 3h 58m 48s. Rate: 7.6 symbols/min [2025-09-25T18:14:22.476007] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:22.531116] [DEBUG] [LOCAL ] CVS: Loaded 53697 existing records from primary storage. [2025-09-25T18:14:22.531313] [INFO ] [MAIN ] CVS: Loaded 53697 existing records. [2025-09-25T18:14:22.712331] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:14:22.712708] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-25T18:14:22.712781] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-25T18:14:22.713133] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-25T18:14:22.713203] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-25T18:14:23.079004] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:23.088666] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-25T18:14:23.131742] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T18:14:23.141610] [INFO ] [REMOTE ] CVE: Full fetch complete (77544 records). [2025-09-25T18:14:23.141770] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-25T18:14:23.468634] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T18:14:23.573953] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-25T18:14:23.574103] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-25T18:14:23.575031] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-25T18:14:23.575097] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-25T18:14:23.576913] [DEBUG] [LOCAL ] CVE: Trimmed 77544 records to 53946 (keeping 200 days of data) [2025-09-25T18:14:23.888733] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-25T18:14:23.916253] [DEBUG] [LOCAL ] CVE: Primary data saved (53946 records). [2025-09-25T18:14:23.916354] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-25T18:14:23.916444] [INFO ] [MAIN ] Update Progress: 564/2372 symbols completed. CVE took 37.0s. Estimated remaining: 3h 58m 20s. Rate: 7.6 symbols/min [2025-09-25T18:14:24.090030] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:24.149753] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-25T18:14:24.149919] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-25T18:14:24.335686] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:14:24.335992] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-25T18:14:24.336046] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-25T18:14:24.336311] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-25T18:14:24.336370] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-25T18:14:24.693970] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-25T18:14:24.789887] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:24.834814] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T18:14:25.131714] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-25T18:14:25.488792] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-25T18:14:26.149841] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T18:14:26.288741] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-25T18:14:26.482740] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T18:14:27.088734] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-25T18:14:27.888721] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-25T18:14:28.120483] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:14:28.443395] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T18:14:28.688707] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-25T18:14:29.000541] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T18:14:29.488712] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-25T18:14:29.870227] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T18:14:29.873173] [INFO ] [REMOTE ] CVLG: Full fetch complete (20778 records). [2025-09-25T18:14:29.873254] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-25T18:14:30.245903] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-25T18:14:30.245991] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-25T18:14:30.246378] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-25T18:14:30.246417] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-25T18:14:30.247050] [DEBUG] [LOCAL ] CVLG: Trimmed 20778 records to 15677 (keeping 200 days of data) [2025-09-25T18:14:30.297021] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-25T18:14:30.359449] [DEBUG] [LOCAL ] CVLG: Primary data saved (15677 records). [2025-09-25T18:14:30.359600] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-25T18:14:30.359714] [INFO ] [MAIN ] Update Progress: 565/2372 symbols completed. CVLG took 28.4s. Estimated remaining: 3h 58m 8s. Rate: 7.6 symbols/min [2025-09-25T18:14:30.544277] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:30.544446] [DEBUG] [LOCAL ] CW: No existing data file found in primary storage. [2025-09-25T18:14:30.544485] [WARN ] [MAIN ] CW: No existing data found, performing full refresh instead. [2025-09-25T18:14:30.544636] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-25T18:14:30.544718] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-25T18:14:30.544769] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-25T18:14:30.544803] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-25T18:14:30.913087] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:31.088686] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-25T18:14:31.446410] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-25T18:14:31.888712] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-25T18:14:32.478978] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-25T18:14:32.688691] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-25T18:14:32.742800] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T18:14:33.076421] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T18:14:33.488765] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-25T18:14:34.288761] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-25T18:14:34.492459] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T18:14:35.088697] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-25T18:14:35.341563] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T18:14:35.540199] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T18:14:35.888727] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-25T18:14:36.688748] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-25T18:14:36.753816] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T18:14:36.944701] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T18:14:37.488735] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-25T18:14:38.288677] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-25T18:14:38.391676] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T18:14:38.557384] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T18:14:39.088737] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-25T18:14:39.888703] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-25T18:14:40.598417] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-25T18:14:40.694572] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-25T18:14:40.698177] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T18:14:41.225857] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T18:14:41.488735] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-25T18:14:42.288705] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-25T18:14:42.403175] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T18:14:42.543980] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T18:14:43.088723] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-25T18:14:43.888682] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-25T18:14:43.930092] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T18:14:44.551190] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-25T18:14:44.688706] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-25T18:14:45.488724] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-25T18:14:45.636801] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:14:46.288686] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-25T18:14:46.409897] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T18:14:46.410379] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T18:14:47.088769] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-25T18:14:47.888704] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-25T18:14:48.187355] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:14:48.688698] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-25T18:14:49.055584] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T18:14:49.184102] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T18:14:49.488737] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-25T18:14:50.288726] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-25T18:14:51.088752] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-25T18:14:51.288994] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T18:14:51.294357] [INFO ] [REMOTE ] CW: Full fetch complete (33472 records). [2025-09-25T18:14:51.294638] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-25T18:14:51.451628] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.76 seconds). [2025-09-25T18:14:51.790728] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-25T18:14:51.790947] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-25T18:14:51.791767] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-25T18:14:51.791944] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-25T18:14:51.793797] [DEBUG] [LOCAL ] CW: Trimmed 33472 records to 22557 (keeping 200 days of data) [2025-09-25T18:14:51.889842] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-25T18:14:51.936301] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-25T18:14:52.010896] [DEBUG] [LOCAL ] CW: Primary data saved (22557 records). [2025-09-25T18:14:52.011122] [INFO ] [MAIN ] CW: Full history saved. [2025-09-25T18:14:52.011255] [INFO ] [MAIN ] Update Progress: 566/2372 symbols completed. CW took 21.7s. Estimated remaining: 3h 58m 44s. Rate: 7.6 symbols/min [2025-09-25T18:14:52.202802] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:52.203009] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-25T18:14:52.203068] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-25T18:14:52.203228] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-25T18:14:52.203271] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-25T18:14:52.203313] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-25T18:14:52.203347] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-25T18:14:52.568873] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:52.689586] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-25T18:14:52.695136] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T18:14:53.488807] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-25T18:14:53.703846] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T18:14:54.295743] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-25T18:14:54.316505] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T18:14:55.088735] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-25T18:14:55.212316] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T18:14:55.888693] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-25T18:14:55.960335] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T18:14:56.688766] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-25T18:14:57.333353] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-25T18:14:57.488688] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-25T18:14:57.724833] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:14:57.734816] [INFO ] [REMOTE ] CVNA: Full fetch complete (76689 records). [2025-09-25T18:14:57.734980] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-25T18:14:58.143139] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-25T18:14:58.143251] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-25T18:14:58.144198] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-25T18:14:58.144283] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-25T18:14:58.161099] [DEBUG] [LOCAL ] CVNA: Trimmed 76689 records to 53395 (keeping 200 days of data) [2025-09-25T18:14:58.174472] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T18:14:58.289832] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-25T18:14:58.509811] [DEBUG] [LOCAL ] CVNA: Primary data saved (53395 records). [2025-09-25T18:14:58.509952] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-25T18:14:58.510037] [INFO ] [MAIN ] Update Progress: 567/2372 symbols completed. CVNA took 37.7s. Estimated remaining: 3h 58m 31s. Rate: 7.6 symbols/min [2025-09-25T18:14:58.682093] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:14:58.728714] [DEBUG] [LOCAL ] CWEN: Loaded 45039 existing records from primary storage. [2025-09-25T18:14:58.728856] [INFO ] [MAIN ] CWEN: Loaded 45039 existing records. [2025-09-25T18:14:58.934633] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:14:58.935082] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-25T18:14:58.935367] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-25T18:14:58.935923] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-25T18:14:58.935987] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-25T18:14:59.093767] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-25T18:14:59.293854] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T18:14:59.367325] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:14:59.839184] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T18:14:59.888722] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-25T18:15:00.688716] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-25T18:15:01.205198] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-25T18:15:01.216023] [INFO ] [REMOTE ] CVX: Full fetch complete (77845 records). [2025-09-25T18:15:01.216182] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-25T18:15:01.490522] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-25T18:15:01.668299] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-25T18:15:01.668445] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-25T18:15:01.669359] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-25T18:15:01.669469] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-25T18:15:01.671343] [DEBUG] [LOCAL ] CVX: Trimmed 77845 records to 54150 (keeping 200 days of data) [2025-09-25T18:15:01.797609] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T18:15:02.098923] [DEBUG] [LOCAL ] CVX: Primary data saved (54150 records). [2025-09-25T18:15:02.099065] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-25T18:15:02.100351] [INFO ] [MAIN ] Update Progress: 568/2372 symbols completed. CVX took 38.2s. Estimated remaining: 3h 58m 9s. Rate: 7.6 symbols/min [2025-09-25T18:15:02.276516] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:02.288735] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-25T18:15:02.338559] [DEBUG] [LOCAL ] CWH: Loaded 51426 existing records from primary storage. [2025-09-25T18:15:02.338749] [INFO ] [MAIN ] CWH: Loaded 51426 existing records. [2025-09-25T18:15:02.535252] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:02.535548] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-25T18:15:02.535604] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-25T18:15:02.535947] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-25T18:15:02.536051] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-25T18:15:02.915489] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:02.970817] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T18:15:02.981251] [INFO ] [REMOTE ] CVS: Full fetch complete (77813 records). [2025-09-25T18:15:02.981451] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-25T18:15:03.094878] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-25T18:15:03.430164] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-25T18:15:03.430301] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-25T18:15:03.431233] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-25T18:15:03.431322] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-25T18:15:03.461351] [DEBUG] [LOCAL ] CVS: Trimmed 77813 records to 54086 (keeping 200 days of data) [2025-09-25T18:15:03.468614] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T18:15:03.736086] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:15:03.865601] [DEBUG] [LOCAL ] CVS: Primary data saved (54086 records). [2025-09-25T18:15:03.865769] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-25T18:15:03.866944] [INFO ] [MAIN ] Update Progress: 569/2372 symbols completed. CVS took 41.6s. Estimated remaining: 3h 57m 42s. Rate: 7.6 symbols/min [2025-09-25T18:15:03.898400] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-25T18:15:04.042583] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:04.096888] [DEBUG] [LOCAL ] CWK: Loaded 49420 existing records from primary storage. [2025-09-25T18:15:04.097084] [INFO ] [MAIN ] CWK: Loaded 49420 existing records. [2025-09-25T18:15:04.313619] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:04.313930] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-25T18:15:04.314000] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-25T18:15:04.314274] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-25T18:15:04.314334] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-25T18:15:04.692808] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-25T18:15:04.729799] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:04.792125] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T18:15:05.488692] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-25T18:15:05.555995] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T18:15:06.288719] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-25T18:15:06.631511] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T18:15:07.088731] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-25T18:15:07.152347] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:15:07.414266] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-25T18:15:07.888776] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-25T18:15:08.394425] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T18:15:08.688748] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-25T18:15:09.288330] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T18:15:09.488794] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-25T18:15:10.269306] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:15:10.288690] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-25T18:15:11.088704] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-25T18:15:11.222566] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:15:11.635898] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T18:15:11.888725] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-25T18:15:12.290149] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T18:15:12.688718] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-25T18:15:13.047326] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T18:15:13.488724] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-25T18:15:14.038437] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:15:14.288753] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-25T18:15:14.831167] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T18:15:15.088716] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-25T18:15:15.888740] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-25T18:15:15.969895] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:15:16.436606] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:15:16.688755] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-25T18:15:17.144217] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T18:15:17.488755] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-25T18:15:18.208372] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T18:15:18.288694] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-25T18:15:18.666611] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T18:15:19.088733] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-25T18:15:19.888708] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-25T18:15:19.995400] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:15:20.648157] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T18:15:20.688689] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-25T18:15:21.136448] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T18:15:21.488752] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-25T18:15:22.288738] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-25T18:15:22.341514] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T18:15:22.350574] [INFO ] [REMOTE ] CWEN: Full fetch complete (64064 records). [2025-09-25T18:15:22.350801] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-25T18:15:22.351529] [FATAL] [VALIDATOR ] CWEN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:15:22.351623] [FATAL] [MAIN ] CWEN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:15:22.351708] [WARN ] [MAIN ] CWEN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:15:22.351781] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-25T18:15:22.351850] [DEBUG] [LOCAL ] CWEN: No primary data file found to delete. [2025-09-25T18:15:22.351950] [INFO ] [LOCAL ] CWEN: Starting deletion of derivative data. [2025-09-25T18:15:22.352339] [DEBUG] [LOCAL ] CWEN: Deleted derivative data file. [2025-09-25T18:15:22.352439] [INFO ] [MAIN ] Update Progress: 570/2372 symbols completed. CWEN took 23.8s. Estimated remaining: 3h 58m 7s. Rate: 7.6 symbols/min [2025-09-25T18:15:22.523176] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:22.552472] [DEBUG] [LOCAL ] CWT: Loaded 27912 existing records from primary storage. [2025-09-25T18:15:22.552604] [INFO ] [MAIN ] CWT: Loaded 27912 existing records. [2025-09-25T18:15:22.731182] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:22.731431] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-25T18:15:22.731479] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-25T18:15:22.731748] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-25T18:15:22.731808] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-25T18:15:23.090996] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-25T18:15:23.094809] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:23.239605] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T18:15:23.799913] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T18:15:23.888723] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-25T18:15:24.310956] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T18:15:24.688742] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-25T18:15:25.439270] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T18:15:25.488682] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-25T18:15:25.679434] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T18:15:26.288753] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-25T18:15:27.072772] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:15:27.088719] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-25T18:15:27.841316] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T18:15:27.851018] [INFO ] [REMOTE ] CWAN: Full fetch complete (75107 records). [2025-09-25T18:15:27.851155] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-25T18:15:27.895298] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-25T18:15:28.264512] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-25T18:15:28.264692] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-25T18:15:28.265567] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-25T18:15:28.265621] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-25T18:15:28.267315] [DEBUG] [LOCAL ] CWAN: Trimmed 75107 records to 52772 (keeping 200 days of data) [2025-09-25T18:15:28.394899] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T18:15:28.597589] [DEBUG] [LOCAL ] CWAN: Primary data saved (52772 records). [2025-09-25T18:15:28.597772] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-25T18:15:28.597858] [INFO ] [MAIN ] Update Progress: 571/2372 symbols completed. CWAN took 36.6s. Estimated remaining: 3h 57m 54s. Rate: 7.6 symbols/min [2025-09-25T18:15:28.697230] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-25T18:15:28.773204] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:28.773414] [DEBUG] [LOCAL ] CX: No existing data file found in primary storage. [2025-09-25T18:15:28.773465] [WARN ] [MAIN ] CX: No existing data found, performing full refresh instead. [2025-09-25T18:15:28.773633] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-25T18:15:28.773717] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-25T18:15:28.773767] [DEBUG] [LOCAL ] CX: No primary data file found to delete. [2025-09-25T18:15:28.773800] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-25T18:15:29.132424] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:29.498901] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-25T18:15:29.505007] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T18:15:30.295494] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-25T18:15:30.301091] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T18:15:30.311023] [INFO ] [REMOTE ] CWH: Full fetch complete (72799 records). [2025-09-25T18:15:30.311169] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-25T18:15:30.704403] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-25T18:15:30.704485] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-25T18:15:30.705303] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-25T18:15:30.705366] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-25T18:15:30.706884] [DEBUG] [LOCAL ] CWH: Trimmed 72799 records to 51776 (keeping 200 days of data) [2025-09-25T18:15:31.037407] [DEBUG] [LOCAL ] CWH: Primary data saved (51776 records). [2025-09-25T18:15:31.037617] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-25T18:15:31.038476] [INFO ] [MAIN ] Update Progress: 572/2372 symbols completed. CWH took 28.9s. Estimated remaining: 3h 57m 29s. Rate: 7.6 symbols/min [2025-09-25T18:15:31.095548] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-25T18:15:31.268327] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:31.275086] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:15:31.293776] [DEBUG] [LOCAL ] CXE: Loaded 7207 existing records from primary storage. [2025-09-25T18:15:31.293905] [INFO ] [MAIN ] CXE: Loaded 7207 existing records. [2025-09-25T18:15:31.473747] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:31.473994] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-25T18:15:31.474043] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-25T18:15:31.474273] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-25T18:15:31.474332] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-25T18:15:31.849404] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:31.888676] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-25T18:15:32.096255] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T18:15:32.130435] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T18:15:32.688698] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-25T18:15:32.775819] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T18:15:33.488690] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-25T18:15:33.835027] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T18:15:34.288788] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-25T18:15:34.822428] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T18:15:34.847537] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T18:15:35.088717] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-25T18:15:35.583776] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T18:15:35.888711] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-25T18:15:36.688794] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-25T18:15:37.488693] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-25T18:15:37.599543] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:15:37.617912] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T18:15:38.288768] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-25T18:15:39.020792] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T18:15:39.033305] [INFO ] [REMOTE ] CWK: Full fetch complete (70929 records). [2025-09-25T18:15:39.033497] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-25T18:15:39.093792] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-25T18:15:39.532092] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-25T18:15:39.532392] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-25T18:15:39.533232] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-25T18:15:39.533299] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-25T18:15:39.537836] [DEBUG] [LOCAL ] CWK: Trimmed 70929 records to 49795 (keeping 200 days of data) [2025-09-25T18:15:39.882962] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T18:15:39.894139] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-25T18:15:39.909320] [DEBUG] [LOCAL ] CWK: Primary data saved (49795 records). [2025-09-25T18:15:39.909440] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-25T18:15:39.910232] [INFO ] [MAIN ] Update Progress: 573/2372 symbols completed. CWK took 36.0s. Estimated remaining: 3h 57m 24s. Rate: 7.6 symbols/min [2025-09-25T18:15:40.106808] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:40.118433] [DEBUG] [LOCAL ] CXH: Loaded 4414 existing records from primary storage. [2025-09-25T18:15:40.118561] [INFO ] [MAIN ] CXH: Loaded 4414 existing records. [2025-09-25T18:15:40.307131] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:40.307435] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-25T18:15:40.307500] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-25T18:15:40.307808] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-25T18:15:40.307867] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-25T18:15:40.646265] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T18:15:40.693967] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-25T18:15:40.730927] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T18:15:40.729334] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:41.172140] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T18:15:41.488738] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-25T18:15:41.937246] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T18:15:42.288721] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-25T18:15:43.088810] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-25T18:15:43.710288] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T18:15:43.809583] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T18:15:43.888720] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-25T18:15:44.413473] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T18:15:44.688764] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-25T18:15:45.227239] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T18:15:45.488736] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-25T18:15:46.288693] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-25T18:15:46.337135] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T18:15:46.339262] [INFO ] [REMOTE ] CXE: Full fetch complete (11885 records). [2025-09-25T18:15:46.339345] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-25T18:15:46.740184] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-25T18:15:46.740271] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-25T18:15:46.740617] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-25T18:15:46.740712] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-25T18:15:46.741262] [DEBUG] [LOCAL ] CXE: Trimmed 11885 records to 7230 (keeping 200 days of data) [2025-09-25T18:15:46.792520] [DEBUG] [LOCAL ] CXE: Primary data saved (7230 records). [2025-09-25T18:15:46.792693] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-25T18:15:46.792817] [INFO ] [MAIN ] Update Progress: 574/2372 symbols completed. CXE took 15.8s. Estimated remaining: 3h 57m 13s. Rate: 7.6 symbols/min [2025-09-25T18:15:46.977405] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:15:47.042813] [DEBUG] [LOCAL ] CXM: Loaded 47947 existing records from primary storage. [2025-09-25T18:15:47.042963] [INFO ] [MAIN ] CXM: Loaded 47947 existing records. [2025-09-25T18:15:47.098059] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-25T18:15:47.224855] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:15:47.225115] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-25T18:15:47.225162] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-25T18:15:47.225418] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-25T18:15:47.225477] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-25T18:15:47.594122] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:15:47.654989] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T18:15:47.888714] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-25T18:15:48.235134] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T18:15:48.469838] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:15:48.688719] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-25T18:15:49.143549] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T18:15:49.488715] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-25T18:15:49.930330] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T18:15:50.288707] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-25T18:15:51.088762] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-25T18:15:51.628584] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T18:15:51.888736] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-25T18:15:52.299433] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T18:15:52.439369] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T18:15:52.688755] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-25T18:15:53.488738] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-25T18:15:53.627066] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T18:15:54.288734] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-25T18:15:54.666002] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T18:15:54.785421] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-25T18:15:55.088761] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-25T18:15:55.888738] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-25T18:15:56.630024] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T18:15:56.688675] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-25T18:15:56.967089] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T18:15:57.488729] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-25T18:15:58.148931] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T18:15:58.290450] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-25T18:15:58.293299] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T18:15:59.088718] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-25T18:15:59.638261] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T18:15:59.888687] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-25T18:15:59.919317] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T18:16:00.688714] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-25T18:16:01.281305] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T18:16:01.488751] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-25T18:16:02.289407] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-25T18:16:02.296018] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-25T18:16:02.876487] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T18:16:02.917863] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T18:16:02.923744] [INFO ] [REMOTE ] CWT: Full fetch complete (40220 records). [2025-09-25T18:16:02.923857] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-25T18:16:03.100275] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-25T18:16:03.308186] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-25T18:16:03.308273] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-25T18:16:03.308857] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-25T18:16:03.308922] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-25T18:16:03.309964] [DEBUG] [LOCAL ] CWT: Trimmed 40220 records to 28104 (keeping 200 days of data) [2025-09-25T18:16:03.508988] [DEBUG] [LOCAL ] CWT: Primary data saved (28104 records). [2025-09-25T18:16:03.509179] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-25T18:16:03.509353] [INFO ] [MAIN ] Update Progress: 575/2372 symbols completed. CWT took 41.2s. Estimated remaining: 3h 57m 33s. Rate: 7.6 symbols/min [2025-09-25T18:16:03.694446] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:03.735170] [DEBUG] [LOCAL ] CXT: Loaded 31061 existing records from primary storage. [2025-09-25T18:16:03.735312] [INFO ] [MAIN ] CXT: Loaded 31061 existing records. [2025-09-25T18:16:03.893057] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-25T18:16:03.918928] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:03.919194] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-25T18:16:03.919242] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-25T18:16:03.919470] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-25T18:16:03.919529] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-25T18:16:04.284468] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:04.600037] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T18:16:04.688790] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-25T18:16:04.787754] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T18:16:04.789257] [INFO ] [REMOTE ] CXH: Full fetch complete (5472 records). [2025-09-25T18:16:04.789328] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-25T18:16:04.789744] [FATAL] [VALIDATOR ] CXH: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:16:04.789828] [FATAL] [MAIN ] CXH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:16:04.789881] [WARN ] [MAIN ] CXH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:16:04.789954] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-25T18:16:04.790016] [DEBUG] [LOCAL ] CXH: No primary data file found to delete. [2025-09-25T18:16:04.790064] [INFO ] [LOCAL ] CXH: Starting deletion of derivative data. [2025-09-25T18:16:04.790392] [DEBUG] [LOCAL ] CXH: Deleted derivative data file. [2025-09-25T18:16:04.790512] [INFO ] [MAIN ] Update Progress: 576/2372 symbols completed. CXH took 24.9s. Estimated remaining: 3h 57m 4s. Rate: 7.6 symbols/min [2025-09-25T18:16:04.966539] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:05.024971] [DEBUG] [LOCAL ] CXW: Loaded 44300 existing records from primary storage. [2025-09-25T18:16:05.025132] [INFO ] [MAIN ] CXW: Loaded 44300 existing records. [2025-09-25T18:16:05.204961] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:05.205203] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-25T18:16:05.205253] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-25T18:16:05.205476] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-25T18:16:05.205536] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-25T18:16:05.493825] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-25T18:16:05.599313] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:05.645109] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T18:16:06.288727] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-25T18:16:07.088703] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-25T18:16:07.402621] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T18:16:07.413387] [INFO ] [REMOTE ] CX: Full fetch complete (76392 records). [2025-09-25T18:16:07.413612] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-25T18:16:07.815096] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-25T18:16:07.815191] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-25T18:16:07.816330] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-25T18:16:07.816395] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-25T18:16:07.818795] [DEBUG] [LOCAL ] CX: Trimmed 76392 records to 53229 (keeping 200 days of data) [2025-09-25T18:16:07.912422] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-25T18:16:07.966980] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T18:16:08.175933] [DEBUG] [LOCAL ] CX: Primary data saved (53229 records). [2025-09-25T18:16:08.176074] [INFO ] [MAIN ] CX: Full history saved. [2025-09-25T18:16:08.176161] [INFO ] [MAIN ] Update Progress: 577/2372 symbols completed. CX took 39.6s. Estimated remaining: 3h 56m 42s. Rate: 7.6 symbols/min [2025-09-25T18:16:08.349880] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:08.350160] [DEBUG] [LOCAL ] CYD: No existing data file found in primary storage. [2025-09-25T18:16:08.350224] [WARN ] [MAIN ] CYD: No existing data found, performing full refresh instead. [2025-09-25T18:16:08.350667] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-25T18:16:08.350739] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-25T18:16:08.350855] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-09-25T18:16:08.351022] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-25T18:16:08.694734] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-25T18:16:08.711185] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T18:16:08.763671] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:09.254686] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T18:16:09.488742] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-25T18:16:10.288757] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-25T18:16:10.514068] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T18:16:10.581128] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T18:16:11.088722] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-25T18:16:11.706729] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T18:16:11.888697] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-25T18:16:12.346268] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T18:16:12.688773] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-25T18:16:13.144521] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T18:16:13.488738] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-25T18:16:13.535347] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T18:16:14.288730] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-25T18:16:15.084493] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T18:16:15.094124] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-25T18:16:15.452953] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:16:15.865272] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T18:16:15.888687] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-25T18:16:16.688698] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-25T18:16:16.707575] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T18:16:17.488716] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-25T18:16:18.102554] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T18:16:18.288708] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-25T18:16:18.493192] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T18:16:19.088727] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-25T18:16:19.888685] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-25T18:16:19.976041] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T18:16:20.426953] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T18:16:20.688716] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-25T18:16:20.964405] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T18:16:21.488739] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-25T18:16:22.094381] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T18:16:22.106348] [INFO ] [REMOTE ] CXM: Full fetch complete (68658 records). [2025-09-25T18:16:22.106630] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-25T18:16:22.108022] [FATAL] [VALIDATOR ] CXM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:16:22.108312] [FATAL] [MAIN ] CXM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:16:22.108356] [WARN ] [MAIN ] CXM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:16:22.108409] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-25T18:16:22.108495] [DEBUG] [LOCAL ] CXM: No primary data file found to delete. [2025-09-25T18:16:22.108534] [INFO ] [LOCAL ] CXM: Starting deletion of derivative data. [2025-09-25T18:16:22.108824] [DEBUG] [LOCAL ] CXM: Deleted derivative data file. [2025-09-25T18:16:22.109295] [INFO ] [MAIN ] Update Progress: 578/2372 symbols completed. CXM took 35.3s. Estimated remaining: 3h 56m 53s. Rate: 7.6 symbols/min [2025-09-25T18:16:22.286506] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:22.293901] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-25T18:16:22.305631] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T18:16:22.358558] [DEBUG] [LOCAL ] CYH: Loaded 47783 existing records from primary storage. [2025-09-25T18:16:22.358760] [INFO ] [MAIN ] CYH: Loaded 47783 existing records. [2025-09-25T18:16:22.539151] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:22.539454] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-25T18:16:22.539510] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-25T18:16:22.539789] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-25T18:16:22.539847] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-25T18:16:22.898976] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:23.088691] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-25T18:16:23.560053] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T18:16:23.888721] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-25T18:16:24.688721] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-25T18:16:24.783483] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T18:16:25.160729] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T18:16:25.488753] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-25T18:16:25.990149] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T18:16:26.288710] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-25T18:16:26.395931] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T18:16:27.088710] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-25T18:16:27.531631] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:16:27.888721] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-25T18:16:28.032750] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T18:16:28.688724] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-25T18:16:29.169178] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:16:29.488811] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-25T18:16:30.288699] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-25T18:16:30.366263] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:16:30.367542] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T18:16:31.088721] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-25T18:16:31.557055] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T18:16:31.888711] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-25T18:16:32.434691] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T18:16:32.688704] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-25T18:16:33.097022] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T18:16:33.488714] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-25T18:16:34.288711] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-25T18:16:35.088713] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-25T18:16:35.473640] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-25T18:16:35.480175] [INFO ] [REMOTE ] CXT: Full fetch complete (45056 records). [2025-09-25T18:16:35.480278] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-25T18:16:35.869325] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-25T18:16:35.869442] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-25T18:16:35.870112] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-25T18:16:35.870222] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-25T18:16:35.871414] [DEBUG] [LOCAL ] CXT: Trimmed 45056 records to 31343 (keeping 200 days of data) [2025-09-25T18:16:35.893104] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-09-25T18:16:35.955515] [INFO ] [REMOTE ] CYD: Full fetch complete (32535 records). [2025-09-25T18:16:35.955852] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-25T18:16:36.434030] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-25T18:16:36.436633] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-25T18:16:36.440250] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-25T18:16:36.441572] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-25T18:16:36.471449] [DEBUG] [LOCAL ] CYD: Trimmed 32535 records to 26935 (keeping 200 days of data) [2025-09-25T18:16:36.476774] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T18:16:36.552269] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-25T18:16:36.696039] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-25T18:16:36.711632] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-25T18:16:36.725319] [DEBUG] [LOCAL ] CXT: Primary data saved (31343 records). [2025-09-25T18:16:36.731631] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-25T18:16:36.732125] [INFO ] [MAIN ] Update Progress: 579/2372 symbols completed. CXT took 33.2s. Estimated remaining: 3h 57m 5s. Rate: 7.6 symbols/min [2025-09-25T18:16:36.953958] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:36.962841] [DEBUG] [LOCAL ] CYD: Primary data saved (26935 records). [2025-09-25T18:16:36.962975] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-25T18:16:36.963055] [INFO ] [MAIN ] Update Progress: 580/2372 symbols completed. CYD took 28.8s. Estimated remaining: 3h 56m 34s. Rate: 7.6 symbols/min [2025-09-25T18:16:37.159009] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:37.197551] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-25T18:16:37.202382] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-09-25T18:16:37.234836] [DEBUG] [LOCAL ] DAC: Loaded 12600 existing records from primary storage. [2025-09-25T18:16:37.275582] [INFO ] [MAIN ] DAC: Loaded 12600 existing records. [2025-09-25T18:16:37.562172] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:37.571788] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-25T18:16:37.577952] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-25T18:16:37.586770] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-25T18:16:37.586890] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-25T18:16:37.649806] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:37.691537] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-25T18:16:37.712700] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-25T18:16:37.716073] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-25T18:16:37.716402] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-25T18:16:38.324291] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:38.325372] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-25T18:16:38.421117] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:38.438087] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-25T18:16:38.440998] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T18:16:38.479233] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T18:16:39.088710] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-25T18:16:39.340370] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T18:16:39.888725] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-25T18:16:40.098339] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T18:16:40.688694] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-25T18:16:40.702448] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T18:16:40.822524] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T18:16:40.830476] [INFO ] [REMOTE ] CXW: Full fetch complete (65025 records). [2025-09-25T18:16:40.830610] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-25T18:16:41.291032] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-25T18:16:41.291139] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-25T18:16:41.291944] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-25T18:16:41.292010] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-25T18:16:41.293530] [DEBUG] [LOCAL ] CXW: Trimmed 65025 records to 44634 (keeping 200 days of data) [2025-09-25T18:16:41.496865] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-25T18:16:41.559935] [DEBUG] [LOCAL ] CXW: Primary data saved (44634 records). [2025-09-25T18:16:41.560077] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-25T18:16:41.560735] [INFO ] [MAIN ] Update Progress: 581/2372 symbols completed. CXW took 36.8s. Estimated remaining: 3h 56m 16s. Rate: 7.6 symbols/min [2025-09-25T18:16:41.735552] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:41.789237] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-25T18:16:41.789387] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-25T18:16:41.978007] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:16:41.978508] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-25T18:16:41.978728] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-25T18:16:41.978994] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-25T18:16:41.979134] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-25T18:16:42.302426] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-25T18:16:42.388983] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T18:16:42.423777] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:42.492291] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T18:16:43.088744] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-25T18:16:43.554489] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T18:16:43.888714] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-25T18:16:44.688687] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-25T18:16:44.802947] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:16:44.940241] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T18:16:45.332474] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:16:45.488729] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-25T18:16:46.288714] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-25T18:16:47.088737] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-25T18:16:47.130355] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T18:16:47.888728] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-25T18:16:48.688804] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-25T18:16:48.802719] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-25T18:16:48.849619] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T18:16:49.281442] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T18:16:49.488694] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-25T18:16:49.808767] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T18:16:50.288720] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-25T18:16:50.700845] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T18:16:51.088760] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-25T18:16:51.741040] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:16:51.888714] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-25T18:16:52.423367] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:16:52.431360] [INFO ] [REMOTE ] CYH: Full fetch complete (69984 records). [2025-09-25T18:16:52.431502] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-25T18:16:52.432322] [FATAL] [VALIDATOR ] CYH: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:16:52.432407] [FATAL] [MAIN ] CYH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:16:52.432449] [WARN ] [MAIN ] CYH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:16:52.432486] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-25T18:16:52.432545] [DEBUG] [LOCAL ] CYH: No primary data file found to delete. [2025-09-25T18:16:52.432579] [INFO ] [LOCAL ] CYH: Starting deletion of derivative data. [2025-09-25T18:16:52.432873] [DEBUG] [LOCAL ] CYH: Deleted derivative data file. [2025-09-25T18:16:52.433320] [INFO ] [MAIN ] Update Progress: 582/2372 symbols completed. CYH took 30.3s. Estimated remaining: 3h 56m 17s. Rate: 7.6 symbols/min [2025-09-25T18:16:52.607095] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:16:52.607258] [DEBUG] [LOCAL ] DAN: No existing data file found in primary storage. [2025-09-25T18:16:52.607295] [WARN ] [MAIN ] DAN: No existing data found, performing full refresh instead. [2025-09-25T18:16:52.607438] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-25T18:16:52.607480] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-25T18:16:52.607522] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-09-25T18:16:52.607554] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-25T18:16:52.693914] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-25T18:16:53.000432] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:16:53.488737] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-25T18:16:53.780245] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:16:53.804300] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T18:16:54.288721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-25T18:16:54.824003] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T18:16:55.088728] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-25T18:16:55.708146] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T18:16:55.868072] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T18:16:55.888698] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-25T18:16:56.688785] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-25T18:16:57.196981] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T18:16:57.319389] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:16:57.488701] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-25T18:16:58.288772] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-25T18:16:59.088729] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-25T18:16:59.888697] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-25T18:17:00.174513] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-25T18:17:00.202383] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T18:17:00.204756] [INFO ] [REMOTE ] DAC: Full fetch complete (19784 records). [2025-09-25T18:17:00.204830] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-25T18:17:00.594943] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-25T18:17:00.595110] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-25T18:17:00.595597] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-25T18:17:00.595695] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-25T18:17:00.596699] [DEBUG] [LOCAL ] DAC: Trimmed 19784 records to 12696 (keeping 200 days of data) [2025-09-25T18:17:00.687508] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T18:17:00.697066] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-25T18:17:00.716261] [DEBUG] [LOCAL ] DAC: Primary data saved (12696 records). [2025-09-25T18:17:00.716386] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-25T18:17:00.716475] [INFO ] [MAIN ] Update Progress: 583/2372 symbols completed. DAC took 23.8s. Estimated remaining: 3h 56m 10s. Rate: 7.6 symbols/min [2025-09-25T18:17:00.890203] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:00.911193] [DEBUG] [LOCAL ] DAO: Loaded 21138 existing records from primary storage. [2025-09-25T18:17:00.911326] [INFO ] [MAIN ] DAO: Loaded 21138 existing records. [2025-09-25T18:17:01.096265] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:17:01.096554] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-25T18:17:01.096603] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-25T18:17:01.096828] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-25T18:17:01.096889] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-25T18:17:01.499774] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-25T18:17:01.524591] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:01.649821] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T18:17:02.169579] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T18:17:02.288728] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-25T18:17:02.995150] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T18:17:03.088670] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-25T18:17:03.888723] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-25T18:17:04.507356] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-25T18:17:04.578403] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:17:04.688791] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-25T18:17:05.415812] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T18:17:05.425496] [INFO ] [REMOTE ] D: Full fetch complete (77267 records). [2025-09-25T18:17:05.425749] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-25T18:17:05.426766] [FATAL] [VALIDATOR ] D: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:17:05.426903] [FATAL] [MAIN ] D: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:17:05.426957] [WARN ] [MAIN ] D: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:17:05.426998] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-25T18:17:05.427072] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-09-25T18:17:05.427128] [INFO ] [LOCAL ] D: Starting deletion of derivative data. [2025-09-25T18:17:05.427425] [DEBUG] [LOCAL ] D: Deleted derivative data file. [2025-09-25T18:17:05.427527] [INFO ] [MAIN ] Update Progress: 584/2372 symbols completed. D took 28.7s. Estimated remaining: 3h 55m 52s. Rate: 7.6 symbols/min [2025-09-25T18:17:05.498839] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-25T18:17:05.627039] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:05.678693] [DEBUG] [LOCAL ] DAR: Loaded 51838 existing records from primary storage. [2025-09-25T18:17:05.678896] [INFO ] [MAIN ] DAR: Loaded 51838 existing records. [2025-09-25T18:17:05.857714] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:17:05.858060] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-25T18:17:05.858116] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-25T18:17:05.858411] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-25T18:17:05.858469] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-25T18:17:06.223993] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:06.258325] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:17:06.288723] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-25T18:17:06.381895] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T18:17:07.088757] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-25T18:17:07.889312] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-25T18:17:07.895620] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T18:17:08.503310] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T18:17:08.688756] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-25T18:17:08.950725] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T18:17:09.488718] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-25T18:17:09.836431] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T18:17:10.288732] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-25T18:17:10.764089] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:17:11.088735] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-25T18:17:11.838018] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T18:17:11.888673] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-25T18:17:12.562998] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T18:17:12.688687] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-25T18:17:13.488745] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-25T18:17:13.805572] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T18:17:14.016853] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T18:17:14.288729] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-25T18:17:15.088719] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-25T18:17:15.611394] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:17:15.883770] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-25T18:17:15.894300] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-25T18:17:15.936204] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T18:17:16.688776] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-25T18:17:17.438703] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:17:17.488731] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-25T18:17:18.062620] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T18:17:18.288714] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-25T18:17:18.460042] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-25T18:17:19.088723] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-25T18:17:19.793183] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T18:17:19.888716] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-25T18:17:19.989193] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T18:17:19.998491] [INFO ] [REMOTE ] DAN: Full fetch complete (70854 records). [2025-09-25T18:17:19.998699] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-25T18:17:20.392134] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-25T18:17:20.392227] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-25T18:17:20.393036] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-25T18:17:20.393101] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-25T18:17:20.394733] [DEBUG] [LOCAL ] DAN: Trimmed 70854 records to 49394 (keeping 200 days of data) [2025-09-25T18:17:20.688807] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-25T18:17:20.699699] [DEBUG] [LOCAL ] DAN: Primary data saved (49394 records). [2025-09-25T18:17:20.699782] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-25T18:17:20.699881] [INFO ] [MAIN ] Update Progress: 585/2372 symbols completed. DAN took 28.3s. Estimated remaining: 3h 56m 7s. Rate: 7.6 symbols/min [2025-09-25T18:17:20.880095] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:20.924132] [DEBUG] [LOCAL ] DAVA: Loaded 40609 existing records from primary storage. [2025-09-25T18:17:20.924295] [INFO ] [MAIN ] DAVA: Loaded 40609 existing records. [2025-09-25T18:17:21.111375] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:17:21.111613] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-25T18:17:21.111690] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-25T18:17:21.112044] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-25T18:17:21.112102] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-25T18:17:21.466880] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:21.488683] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-25T18:17:21.695713] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T18:17:22.123482] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T18:17:22.288768] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-25T18:17:22.597089] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T18:17:22.845796] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T18:17:23.088781] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-25T18:17:23.888792] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-25T18:17:24.688736] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-25T18:17:25.095182] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T18:17:25.478696] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-25T18:17:25.489979] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-25T18:17:25.510611] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T18:17:26.028043] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T18:17:26.288732] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-25T18:17:27.088720] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-25T18:17:27.581818] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T18:17:27.888709] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-25T18:17:28.211742] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T18:17:28.688736] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-25T18:17:29.430213] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T18:17:29.488750] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-25T18:17:30.058362] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-25T18:17:30.288730] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-25T18:17:30.675618] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T18:17:30.680093] [INFO ] [REMOTE ] DAO: Full fetch complete (32788 records). [2025-09-25T18:17:30.680197] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-25T18:17:31.060388] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-25T18:17:31.060475] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-25T18:17:31.061049] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-25T18:17:31.061111] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-25T18:17:31.061943] [DEBUG] [LOCAL ] DAO: Trimmed 32788 records to 21360 (keeping 200 days of data) [2025-09-25T18:17:31.106564] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-25T18:17:31.181872] [DEBUG] [LOCAL ] DAO: Primary data saved (21360 records). [2025-09-25T18:17:31.182012] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-25T18:17:31.182100] [INFO ] [MAIN ] Update Progress: 586/2372 symbols completed. DAO took 30.5s. Estimated remaining: 3h 56m 7s. Rate: 7.6 symbols/min [2025-09-25T18:17:31.354774] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:31.402770] [DEBUG] [LOCAL ] DAY: Loaded 49845 existing records from primary storage. [2025-09-25T18:17:31.402918] [INFO ] [MAIN ] DAY: Loaded 49845 existing records. [2025-09-25T18:17:31.586120] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:17:31.586382] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-25T18:17:31.586429] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-25T18:17:31.586743] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-25T18:17:31.586803] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-25T18:17:31.893863] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-25T18:17:31.958985] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:32.347678] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T18:17:32.358437] [INFO ] [REMOTE ] DAL: Full fetch complete (77823 records). [2025-09-25T18:17:32.358601] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-25T18:17:32.699481] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-25T18:17:32.803997] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-25T18:17:32.804107] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-25T18:17:32.805329] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-25T18:17:32.805483] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-25T18:17:32.836869] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T18:17:32.835155] [DEBUG] [LOCAL ] DAL: Trimmed 77823 records to 54143 (keeping 200 days of data) [2025-09-25T18:17:32.991232] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T18:17:33.220262] [DEBUG] [LOCAL ] DAL: Primary data saved (54143 records). [2025-09-25T18:17:33.220397] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-25T18:17:33.221306] [INFO ] [MAIN ] Update Progress: 587/2372 symbols completed. DAL took 51.7s. Estimated remaining: 3h 55m 41s. Rate: 7.6 symbols/min [2025-09-25T18:17:33.392575] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:33.392807] [DEBUG] [LOCAL ] DB: No existing data file found in primary storage. [2025-09-25T18:17:33.392864] [WARN ] [MAIN ] DB: No existing data found, performing full refresh instead. [2025-09-25T18:17:33.393038] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-25T18:17:33.393102] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-25T18:17:33.393167] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-25T18:17:33.393230] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-25T18:17:33.495363] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-25T18:17:33.763625] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:34.289154] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-25T18:17:34.289055] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T18:17:34.693501] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T18:17:35.088714] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-25T18:17:35.669495] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T18:17:35.679152] [INFO ] [REMOTE ] DAR: Full fetch complete (74535 records). [2025-09-25T18:17:35.679305] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-25T18:17:35.896086] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-25T18:17:36.072840] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-25T18:17:36.072921] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-25T18:17:36.073766] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-25T18:17:36.073832] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-25T18:17:36.075269] [DEBUG] [LOCAL ] DAR: Trimmed 74535 records to 52219 (keeping 200 days of data) [2025-09-25T18:17:36.306112] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T18:17:36.423617] [DEBUG] [LOCAL ] DAR: Primary data saved (52219 records). [2025-09-25T18:17:36.423799] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-25T18:17:36.423896] [INFO ] [MAIN ] Update Progress: 588/2372 symbols completed. DAR took 31.0s. Estimated remaining: 3h 55m 18s. Rate: 7.6 symbols/min [2025-09-25T18:17:36.594186] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:36.594389] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-25T18:17:36.594443] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-25T18:17:36.594593] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-25T18:17:36.594639] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-25T18:17:36.594739] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-25T18:17:36.594814] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-25T18:17:36.694612] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-25T18:17:36.952387] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:37.488692] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-25T18:17:37.806226] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T18:17:37.842876] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T18:17:38.288785] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-25T18:17:38.837556] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T18:17:39.088739] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-25T18:17:39.331129] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:17:39.888726] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-25T18:17:40.688701] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-25T18:17:40.743679] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T18:17:41.462222] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T18:17:41.488755] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-25T18:17:41.972572] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:17:42.288715] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-25T18:17:42.968917] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T18:17:43.088689] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-25T18:17:43.199839] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T18:17:43.888709] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-25T18:17:44.688682] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-25T18:17:45.047803] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:17:45.056873] [INFO ] [REMOTE ] DAVA: Full fetch complete (55515 records). [2025-09-25T18:17:45.057028] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-25T18:17:45.379151] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T18:17:45.465360] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-25T18:17:45.465528] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-25T18:17:45.466297] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-25T18:17:45.466362] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-25T18:17:45.467490] [DEBUG] [LOCAL ] DAVA: Trimmed 55515 records to 40977 (keeping 200 days of data) [2025-09-25T18:17:45.520453] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-25T18:17:45.586392] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T18:17:45.752888] [DEBUG] [LOCAL ] DAVA: Primary data saved (40977 records). [2025-09-25T18:17:45.753025] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-25T18:17:45.753136] [INFO ] [MAIN ] Update Progress: 589/2372 symbols completed. DAVA took 25.1s. Estimated remaining: 3h 55m 15s. Rate: 7.6 symbols/min [2025-09-25T18:17:45.926815] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:17:45.974367] [DEBUG] [LOCAL ] DBI: Loaded 45023 existing records from primary storage. [2025-09-25T18:17:45.974525] [INFO ] [MAIN ] DBI: Loaded 45023 existing records. [2025-09-25T18:17:46.161399] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:17:46.161683] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-25T18:17:46.161743] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-25T18:17:46.162035] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-25T18:17:46.162097] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-25T18:17:46.305855] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-25T18:17:46.510975] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T18:17:46.577567] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:17:47.088707] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-25T18:17:47.888828] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-25T18:17:48.031536] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T18:17:48.496070] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:17:48.688713] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-25T18:17:49.389144] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T18:17:49.488675] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-25T18:17:49.571096] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T18:17:50.288034] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T18:17:50.293424] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-25T18:17:51.088720] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-25T18:17:51.888688] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-25T18:17:51.920072] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T18:17:52.674803] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T18:17:52.688669] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-25T18:17:53.226931] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T18:17:53.488732] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-25T18:17:54.288684] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-25T18:17:54.327695] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:17:54.783866] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T18:17:55.088730] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-25T18:17:55.352948] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T18:17:55.888746] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-25T18:17:56.147887] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T18:17:56.695401] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-25T18:17:56.699391] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T18:17:57.488753] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-25T18:17:58.011439] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T18:17:58.293836] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-25T18:17:58.305480] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T18:17:59.088778] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-25T18:17:59.888728] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-25T18:18:00.283234] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-25T18:18:00.309376] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T18:18:00.688721] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-25T18:18:01.488731] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-25T18:18:01.907084] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T18:18:02.218901] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T18:18:02.228582] [INFO ] [REMOTE ] DAY: Full fetch complete (71719 records). [2025-09-25T18:18:02.228800] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-25T18:18:02.297371] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-25T18:18:02.697339] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-25T18:18:02.697473] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-25T18:18:02.698611] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-25T18:18:02.698809] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-25T18:18:02.700720] [DEBUG] [LOCAL ] DAY: Trimmed 71719 records to 50193 (keeping 200 days of data) [2025-09-25T18:18:02.829131] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T18:18:03.057320] [DEBUG] [LOCAL ] DAY: Primary data saved (50193 records). [2025-09-25T18:18:03.057487] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-25T18:18:03.057596] [INFO ] [MAIN ] Update Progress: 590/2372 symbols completed. DAY took 31.9s. Estimated remaining: 3h 55m 35s. Rate: 7.6 symbols/min [2025-09-25T18:18:03.089252] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-25T18:18:03.232714] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:03.245765] [DEBUG] [LOCAL ] DBL: Loaded 9131 existing records from primary storage. [2025-09-25T18:18:03.245886] [INFO ] [MAIN ] DBL: Loaded 9131 existing records. [2025-09-25T18:18:03.429794] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:03.430418] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-25T18:18:03.430698] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-25T18:18:03.431104] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-25T18:18:03.431166] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-25T18:18:03.581032] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T18:18:03.622040] [INFO ] [REMOTE ] DBD: Full fetch complete (30545 records). [2025-09-25T18:18:03.623467] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-25T18:18:03.642970] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:18:03.651340] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:18:03.692748] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:18:03.720225] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-25T18:18:03.726848] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-25T18:18:03.732081] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-25T18:18:03.753173] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-09-25T18:18:03.756200] [INFO ] [MAIN ] Update Progress: 591/2372 symbols completed. DBD took 27.3s. Estimated remaining: 3h 55m 6s. Rate: 7.6 symbols/min [2025-09-25T18:18:03.909230] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-25T18:18:03.947636] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:04.021848] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:04.070038] [DEBUG] [LOCAL ] DBRG: Loaded 49812 existing records from primary storage. [2025-09-25T18:18:04.070177] [INFO ] [MAIN ] DBRG: Loaded 49812 existing records. [2025-09-25T18:18:04.261714] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:04.262108] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-25T18:18:04.262188] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-25T18:18:04.262525] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-25T18:18:04.262587] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-25T18:18:04.639708] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:04.673772] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:18:04.688666] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-25T18:18:05.488722] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-25T18:18:05.777014] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T18:18:05.887833] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T18:18:06.006128] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T18:18:06.288749] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-25T18:18:07.088725] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-25T18:18:07.537136] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T18:18:07.618631] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T18:18:07.888727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-25T18:18:08.688714] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-25T18:18:09.493854] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-25T18:18:09.512594] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T18:18:10.023850] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T18:18:10.288729] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-25T18:18:11.032090] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T18:18:11.088720] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-25T18:18:11.815673] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T18:18:11.888705] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-25T18:18:12.624411] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T18:18:12.633468] [INFO ] [REMOTE ] DB: Full fetch complete (73855 records). [2025-09-25T18:18:12.634166] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-25T18:18:12.641231] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:18:12.641393] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:18:12.641448] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:18:12.641506] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-25T18:18:12.641613] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-25T18:18:12.641705] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-25T18:18:12.641774] [DEBUG] [LOCAL ] DB: No derivative data file found to delete. [2025-09-25T18:18:12.641866] [INFO ] [MAIN ] Update Progress: 592/2372 symbols completed. DB took 39.4s. Estimated remaining: 3h 55m 1s. Rate: 7.6 symbols/min [2025-09-25T18:18:12.698530] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-25T18:18:12.817635] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:12.817802] [DEBUG] [LOCAL ] DCI: No existing data file found in primary storage. [2025-09-25T18:18:12.817840] [WARN ] [MAIN ] DCI: No existing data found, performing full refresh instead. [2025-09-25T18:18:12.817978] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-25T18:18:12.818022] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-25T18:18:12.818062] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-25T18:18:12.818093] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-25T18:18:13.178538] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:13.186622] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:18:13.214155] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:18:13.488733] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-25T18:18:14.288712] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-25T18:18:14.998884] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T18:18:15.088714] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-25T18:18:15.609466] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:18:15.888750] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-25T18:18:16.599546] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T18:18:16.688788] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-25T18:18:17.177136] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T18:18:17.190132] [INFO ] [REMOTE ] DBI: Full fetch complete (66332 records). [2025-09-25T18:18:17.190368] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-25T18:18:17.393050] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T18:18:17.493924] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-25T18:18:17.624414] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-25T18:18:17.624493] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-25T18:18:17.625408] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-25T18:18:17.625501] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-25T18:18:17.626909] [DEBUG] [LOCAL ] DBI: Trimmed 66332 records to 45297 (keeping 200 days of data) [2025-09-25T18:18:17.902975] [DEBUG] [LOCAL ] DBI: Primary data saved (45297 records). [2025-09-25T18:18:17.903147] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-25T18:18:17.903827] [INFO ] [MAIN ] Update Progress: 593/2372 symbols completed. DBI took 32.2s. Estimated remaining: 3h 54m 45s. Rate: 7.6 symbols/min [2025-09-25T18:18:18.089418] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:18.110178] [DEBUG] [LOCAL ] DCO: Loaded 13784 existing records from primary storage. [2025-09-25T18:18:18.110332] [INFO ] [MAIN ] DCO: Loaded 13784 existing records. [2025-09-25T18:18:18.294023] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-25T18:18:18.299128] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:18.300293] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-25T18:18:18.300346] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-25T18:18:18.300629] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-25T18:18:18.300718] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-25T18:18:18.660246] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:19.088737] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-25T18:18:19.171855] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:18:19.339030] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T18:18:19.879464] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T18:18:19.888726] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-25T18:18:20.688744] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-25T18:18:21.288474] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T18:18:21.488687] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-25T18:18:21.613491] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T18:18:22.003454] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T18:18:22.288720] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-25T18:18:23.088767] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-25T18:18:23.117484] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T18:18:23.857417] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T18:18:23.888741] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-25T18:18:24.688732] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-25T18:18:25.131682] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T18:18:25.258187] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T18:18:25.488765] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-25T18:18:26.240456] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T18:18:26.288676] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-25T18:18:27.088741] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-25T18:18:27.105386] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T18:18:27.108114] [INFO ] [REMOTE ] DBL: Full fetch complete (12483 records). [2025-09-25T18:18:27.108199] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-25T18:18:27.505738] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-25T18:18:27.505850] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-25T18:18:27.506465] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-25T18:18:27.506527] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-25T18:18:27.507152] [DEBUG] [LOCAL ] DBL: Trimmed 12483 records to 9203 (keeping 200 days of data) [2025-09-25T18:18:27.579399] [DEBUG] [LOCAL ] DBL: Primary data saved (9203 records). [2025-09-25T18:18:27.579671] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-25T18:18:27.579844] [INFO ] [MAIN ] Update Progress: 594/2372 symbols completed. DBL took 24.5s. Estimated remaining: 3h 54m 42s. Rate: 7.6 symbols/min [2025-09-25T18:18:27.766230] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:27.840979] [DEBUG] [LOCAL ] DD: Loaded 52828 existing records from primary storage. [2025-09-25T18:18:27.841259] [INFO ] [MAIN ] DD: Loaded 52828 existing records. [2025-09-25T18:18:27.899752] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-25T18:18:28.035429] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:28.035791] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-25T18:18:28.035849] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-25T18:18:28.036219] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-25T18:18:28.036279] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-25T18:18:28.418348] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:28.703216] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-25T18:18:28.711732] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:18:29.124342] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T18:18:29.488710] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-25T18:18:30.266245] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T18:18:30.288668] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-25T18:18:30.794367] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T18:18:31.088725] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-25T18:18:31.888751] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-25T18:18:31.980917] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T18:18:32.133125] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T18:18:32.688727] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-25T18:18:33.123822] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T18:18:33.488754] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-25T18:18:33.846950] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T18:18:34.288748] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-25T18:18:35.059441] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T18:18:35.088671] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-25T18:18:35.609637] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T18:18:35.888712] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-25T18:18:36.387995] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T18:18:36.688725] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-25T18:18:37.053880] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T18:18:37.060988] [INFO ] [REMOTE ] DCI: Full fetch complete (54194 records). [2025-09-25T18:18:37.061092] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-25T18:18:37.458043] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-25T18:18:37.458256] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-25T18:18:37.459252] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-25T18:18:37.466370] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-25T18:18:37.467298] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T18:18:37.471706] [DEBUG] [LOCAL ] DCI: Trimmed 54194 records to 37809 (keeping 200 days of data) [2025-09-25T18:18:37.528880] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-25T18:18:37.724308] [DEBUG] [LOCAL ] DCI: Primary data saved (37809 records). [2025-09-25T18:18:37.724462] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-25T18:18:37.724562] [INFO ] [MAIN ] Update Progress: 595/2372 symbols completed. DCI took 25.1s. Estimated remaining: 3h 54m 41s. Rate: 7.6 symbols/min [2025-09-25T18:18:37.903395] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:37.953719] [DEBUG] [LOCAL ] DDD: Loaded 50881 existing records from primary storage. [2025-09-25T18:18:37.953878] [INFO ] [MAIN ] DDD: Loaded 50881 existing records. [2025-09-25T18:18:38.147172] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:38.147510] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-25T18:18:38.147579] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-25T18:18:38.147951] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-25T18:18:38.148036] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-25T18:18:38.293798] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-25T18:18:38.459444] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T18:18:38.547402] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:39.088736] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-25T18:18:39.597858] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T18:18:39.888770] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-25T18:18:40.463041] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T18:18:40.688714] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-25T18:18:40.903282] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T18:18:41.488722] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-25T18:18:42.288715] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-25T18:18:42.635067] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T18:18:42.644061] [INFO ] [REMOTE ] DBRG: Full fetch complete (72213 records). [2025-09-25T18:18:42.644191] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-25T18:18:43.004629] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T18:18:43.066842] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-25T18:18:43.066929] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-25T18:18:43.067771] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-25T18:18:43.067839] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-25T18:18:43.070410] [DEBUG] [LOCAL ] DBRG: Trimmed 72213 records to 50157 (keeping 200 days of data) [2025-09-25T18:18:43.134862] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-25T18:18:43.425746] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T18:18:43.440790] [DEBUG] [LOCAL ] DBRG: Primary data saved (50157 records). [2025-09-25T18:18:43.440901] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-25T18:18:43.440997] [INFO ] [MAIN ] Update Progress: 596/2372 symbols completed. DBRG took 39.7s. Estimated remaining: 3h 54m 26s. Rate: 7.6 symbols/min [2025-09-25T18:18:43.618224] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:18:43.658981] [DEBUG] [LOCAL ] DDL: Loaded 36335 existing records from primary storage. [2025-09-25T18:18:43.659188] [INFO ] [MAIN ] DDL: Loaded 36335 existing records. [2025-09-25T18:18:43.843268] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:18:43.843558] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-25T18:18:43.843620] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-25T18:18:43.843936] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-25T18:18:43.843995] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-25T18:18:43.899161] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-25T18:18:44.200220] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:18:44.231572] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:18:44.688718] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-25T18:18:45.482822] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T18:18:45.488686] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-25T18:18:46.055219] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-25T18:18:46.288677] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-25T18:18:46.438773] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T18:18:47.088719] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-25T18:18:47.863158] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:18:47.888666] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-25T18:18:48.617074] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T18:18:48.688671] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-25T18:18:49.170131] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:18:49.488691] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-25T18:18:49.862093] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T18:18:49.866237] [INFO ] [REMOTE ] DCO: Full fetch complete (19357 records). [2025-09-25T18:18:49.866327] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-25T18:18:50.265556] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-25T18:18:50.265695] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-25T18:18:50.266178] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-25T18:18:50.266242] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-25T18:18:50.267003] [DEBUG] [LOCAL ] DCO: Trimmed 19357 records to 13929 (keeping 200 days of data) [2025-09-25T18:18:50.307457] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-25T18:18:50.362376] [DEBUG] [LOCAL ] DCO: Primary data saved (13929 records). [2025-09-25T18:18:50.362500] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-25T18:18:50.362601] [INFO ] [MAIN ] Update Progress: 597/2372 symbols completed. DCO took 32.5s. Estimated remaining: 3h 54m 15s. Rate: 7.6 symbols/min [2025-09-25T18:18:50.958867] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T18:18:51.088706] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-25T18:18:51.671916] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T18:18:51.888711] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-25T18:18:52.355445] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T18:18:52.688764] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-25T18:18:53.062135] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T18:18:53.488730] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-25T18:18:54.288776] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-25T18:18:54.578060] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T18:18:54.804130] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T18:18:55.088755] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-25T18:18:55.335290] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T18:18:55.888721] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-25T18:18:56.429033] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T18:18:56.688755] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-25T18:18:57.160755] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T18:18:57.488723] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-25T18:18:58.051095] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:18:58.288722] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-25T18:18:58.901937] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T18:18:59.088751] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-25T18:18:59.561083] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T18:18:59.888729] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-25T18:19:00.688735] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-25T18:19:00.876947] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T18:19:00.908365] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T18:19:01.488733] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-25T18:19:02.081952] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T18:19:02.288764] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-25T18:19:02.794895] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T18:19:03.088742] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-25T18:19:03.888717] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-25T18:19:03.978065] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T18:19:04.632995] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T18:19:04.641174] [INFO ] [REMOTE ] DDL: Full fetch complete (53349 records). [2025-09-25T18:19:04.641295] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-25T18:19:04.705245] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-25T18:19:05.059309] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-25T18:19:05.059415] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-25T18:19:05.060184] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-25T18:19:05.060254] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-25T18:19:05.061459] [DEBUG] [LOCAL ] DDL: Trimmed 53349 records to 36655 (keeping 200 days of data) [2025-09-25T18:19:05.278110] [DEBUG] [LOCAL ] DDL: Primary data saved (36655 records). [2025-09-25T18:19:05.278337] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-25T18:19:05.278467] [INFO ] [MAIN ] Update Progress: 598/2372 symbols completed. DDL took 21.8s. Estimated remaining: 3h 54m 28s. Rate: 7.6 symbols/min [2025-09-25T18:19:05.637063] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:19:05.647764] [INFO ] [REMOTE ] DD: Full fetch complete (76295 records). [2025-09-25T18:19:05.647975] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-25T18:19:06.045448] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-25T18:19:06.045573] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-25T18:19:06.046599] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-25T18:19:06.046690] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-25T18:19:06.049759] [DEBUG] [LOCAL ] DD: Trimmed 76295 records to 53213 (keeping 200 days of data) [2025-09-25T18:19:06.312194] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T18:19:06.326203] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-25T18:19:06.444427] [DEBUG] [LOCAL ] DD: Primary data saved (53213 records). [2025-09-25T18:19:06.444580] [INFO ] [MAIN ] DD: Full history saved. [2025-09-25T18:19:06.444700] [INFO ] [MAIN ] Update Progress: 599/2372 symbols completed. DD took 38.9s. Estimated remaining: 3h 54m 0s. Rate: 7.6 symbols/min [2025-09-25T18:19:08.470352] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-25T18:19:08.479321] [INFO ] [REMOTE ] DDD: Full fetch complete (73299 records). [2025-09-25T18:19:08.479456] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-25T18:19:08.480328] [FATAL] [VALIDATOR ] DDD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:19:08.480479] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:19:08.480542] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:19:08.480627] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-25T18:19:08.480734] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-25T18:19:08.480798] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-09-25T18:19:08.481194] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-09-25T18:19:08.481897] [INFO ] [MAIN ] Update Progress: 600/2372 symbols completed. DDD took 30.8s. Estimated remaining: 3h 53m 35s. Rate: 7.6 symbols/min [2025-09-25T18:19:09.041114] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:09.132246] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:09.175138] [DEBUG] [LOCAL ] DDT: No existing data file found in primary storage. [2025-09-25T18:19:09.160997] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:09.188527] [WARN ] [MAIN ] DDT: No existing data found, performing full refresh instead. [2025-09-25T18:19:09.198355] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-25T18:19:09.210308] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:09.207051] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-25T18:19:09.210791] [DEBUG] [LOCAL ] DDT: No primary data file found to delete. [2025-09-25T18:19:09.210972] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-25T18:19:09.446973] [DEBUG] [LOCAL ] DDS: Loaded 13202 existing records from primary storage. [2025-09-25T18:19:09.463440] [INFO ] [MAIN ] DDS: Loaded 13202 existing records. [2025-09-25T18:19:09.739904] [DEBUG] [LOCAL ] DEA: Loaded 41343 existing records from primary storage. [2025-09-25T18:19:09.740980] [DEBUG] [LOCAL ] DE: Loaded 47704 existing records from primary storage. [2025-09-25T18:19:09.757058] [INFO ] [MAIN ] DEA: Loaded 41343 existing records. [2025-09-25T18:19:09.772845] [INFO ] [MAIN ] DE: Loaded 47704 existing records. [2025-09-25T18:19:09.982757] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:10.048891] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-25T18:19:10.089501] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:10.168762] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-25T18:19:10.187372] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-25T18:19:10.263639] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-25T18:19:10.263551] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:10.274915] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-25T18:19:10.296116] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-25T18:19:10.296303] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:10.339542] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-25T18:19:10.339452] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-25T18:19:10.339777] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-25T18:19:10.352035] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-25T18:19:10.372582] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-25T18:19:10.366162] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-25T18:19:10.389120] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-25T18:19:10.724037] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T18:19:10.741889] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-25T18:19:11.274484] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-25T18:19:11.381907] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-25T18:19:11.407726] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:11.442933] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-25T18:19:11.469883] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:11.477895] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-25T18:19:11.477505] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:11.479040] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-25T18:19:11.997225] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T18:19:11.998316] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-25T18:19:12.302230] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-25T18:19:12.303432] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-25T18:19:12.613874] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T18:19:12.676511] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-25T18:19:12.688685] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-25T18:19:12.819236] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T18:19:12.870673] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T18:19:13.025952] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-25T18:19:13.488735] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-25T18:19:13.795116] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-25T18:19:14.288723] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-25T18:19:15.088769] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-25T18:19:15.584325] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-25T18:19:15.592635] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T18:19:15.888754] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-25T18:19:16.688757] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-25T18:19:17.256342] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T18:19:17.488722] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-25T18:19:17.549526] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T18:19:18.288717] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-25T18:19:18.790570] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T18:19:18.925406] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T18:19:19.088692] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-25T18:19:19.406870] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-25T18:19:19.888757] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-25T18:19:20.628165] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T18:19:20.688685] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-25T18:19:21.187862] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-25T18:19:21.188825] [INFO ] [REMOTE ] DDT: Full fetch complete (2897 records). [2025-09-25T18:19:21.188900] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-25T18:19:21.493805] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-25T18:19:21.567692] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-25T18:19:21.567781] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-25T18:19:21.567894] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-25T18:19:21.567933] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-25T18:19:21.568307] [DEBUG] [LOCAL ] DDT: Trimmed 2897 records to 2107 (keeping 200 days of data) [2025-09-25T18:19:21.581677] [DEBUG] [LOCAL ] DDT: Primary data saved (2107 records). [2025-09-25T18:19:21.581767] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-25T18:19:21.581839] [INFO ] [MAIN ] Update Progress: 601/2372 symbols completed. DDT took 13.1s. Estimated remaining: 3h 53m 42s. Rate: 7.6 symbols/min [2025-09-25T18:19:21.758916] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:21.791268] [DEBUG] [LOCAL ] DEC: Loaded 30630 existing records from primary storage. [2025-09-25T18:19:21.791429] [INFO ] [MAIN ] DEC: Loaded 30630 existing records. [2025-09-25T18:19:21.978449] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:21.979014] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-25T18:19:21.979071] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-25T18:19:21.979376] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-25T18:19:21.979437] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-25T18:19:22.310934] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-25T18:19:22.343150] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:22.353865] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T18:19:23.088760] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-25T18:19:23.874329] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T18:19:23.874670] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:19:23.888665] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-25T18:19:24.689248] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-25T18:19:24.691291] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T18:19:25.488711] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-25T18:19:26.274554] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T18:19:26.288671] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-25T18:19:26.508052] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T18:19:27.088748] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-25T18:19:27.504024] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:19:27.690163] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T18:19:27.888793] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-25T18:19:28.688881] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-25T18:19:29.198245] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:19:29.402319] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T18:19:29.488764] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-25T18:19:30.288674] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-25T18:19:30.588154] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T18:19:31.088733] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-25T18:19:31.588532] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T18:19:31.888677] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-25T18:19:31.992309] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T18:19:31.994792] [INFO ] [REMOTE ] DDS: Full fetch complete (19133 records). [2025-09-25T18:19:31.994874] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-25T18:19:31.995323] [FATAL] [VALIDATOR ] DDS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:19:31.995405] [FATAL] [MAIN ] DDS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:19:31.995455] [WARN ] [MAIN ] DDS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:19:31.995492] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-25T18:19:31.995547] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-25T18:19:31.995581] [INFO ] [LOCAL ] DDS: Starting deletion of derivative data. [2025-09-25T18:19:31.995978] [DEBUG] [LOCAL ] DDS: Deleted derivative data file. [2025-09-25T18:19:31.996085] [INFO ] [MAIN ] Update Progress: 602/2372 symbols completed. DDS took 23.5s. Estimated remaining: 3h 53m 42s. Rate: 7.6 symbols/min [2025-09-25T18:19:32.167522] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:32.223433] [DEBUG] [LOCAL ] DECK: Loaded 53301 existing records from primary storage. [2025-09-25T18:19:32.223574] [INFO ] [MAIN ] DECK: Loaded 53301 existing records. [2025-09-25T18:19:32.406254] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:32.406523] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-25T18:19:32.406571] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-25T18:19:32.406933] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-25T18:19:32.407032] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-25T18:19:32.693882] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-25T18:19:32.771266] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:32.905992] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T18:19:33.488709] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-25T18:19:34.289284] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-25T18:19:34.291854] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:19:34.905615] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T18:19:35.088687] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-25T18:19:35.847757] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T18:19:35.888666] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-25T18:19:36.222859] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T18:19:36.688713] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-25T18:19:37.488682] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-25T18:19:37.545096] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:19:38.041072] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:19:38.288710] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-25T18:19:39.088684] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-25T18:19:39.140438] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T18:19:39.314565] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T18:19:39.888765] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-25T18:19:40.047492] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T18:19:40.688729] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-25T18:19:41.293559] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T18:19:41.301355] [INFO ] [REMOTE ] DEA: Full fetch complete (62876 records). [2025-09-25T18:19:41.301515] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-25T18:19:41.498626] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-25T18:19:41.734766] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-25T18:19:41.734873] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-25T18:19:41.735626] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-25T18:19:41.735712] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-25T18:19:41.737229] [DEBUG] [LOCAL ] DEA: Trimmed 62876 records to 41610 (keeping 200 days of data) [2025-09-25T18:19:42.000032] [DEBUG] [LOCAL ] DEA: Primary data saved (41610 records). [2025-09-25T18:19:42.000187] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-25T18:19:42.000293] [INFO ] [MAIN ] Update Progress: 603/2372 symbols completed. DEA took 33.5s. Estimated remaining: 3h 53m 40s. Rate: 7.6 symbols/min [2025-09-25T18:19:42.173815] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:42.220596] [DEBUG] [LOCAL ] DEI: Loaded 48491 existing records from primary storage. [2025-09-25T18:19:42.220823] [INFO ] [MAIN ] DEI: Loaded 48491 existing records. [2025-09-25T18:19:42.291590] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-25T18:19:42.437676] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:42.440178] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T18:19:42.451177] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-25T18:19:42.451622] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-25T18:19:42.452230] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-25T18:19:42.452292] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-25T18:19:42.826516] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:42.913602] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:19:43.088696] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-25T18:19:43.229866] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T18:19:43.888724] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-25T18:19:44.688707] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-25T18:19:44.802906] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T18:19:44.883739] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:19:45.488706] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-25T18:19:46.115742] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T18:19:46.288720] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-25T18:19:47.083973] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T18:19:47.093633] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-25T18:19:47.506498] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T18:19:47.888741] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-25T18:19:48.378543] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T18:19:48.688695] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-25T18:19:49.004450] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T18:19:49.488685] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-25T18:19:49.721358] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T18:19:50.288732] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-25T18:19:51.088794] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-25T18:19:51.332295] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T18:19:51.375765] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T18:19:51.381400] [INFO ] [REMOTE ] DEC: Full fetch complete (42862 records). [2025-09-25T18:19:51.381498] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-25T18:19:51.769859] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-25T18:19:51.769943] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-25T18:19:51.770575] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-25T18:19:51.770618] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-25T18:19:51.771666] [DEBUG] [LOCAL ] DEC: Trimmed 42862 records to 30878 (keeping 200 days of data) [2025-09-25T18:19:51.888746] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-25T18:19:51.970259] [DEBUG] [LOCAL ] DEC: Primary data saved (30878 records). [2025-09-25T18:19:51.970418] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-25T18:19:51.970513] [INFO ] [MAIN ] Update Progress: 604/2372 symbols completed. DEC took 30.4s. Estimated remaining: 3h 53m 38s. Rate: 7.6 symbols/min [2025-09-25T18:19:52.149926] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:52.150120] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-25T18:19:52.150159] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-25T18:19:52.150308] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-25T18:19:52.150352] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-25T18:19:52.150393] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-25T18:19:52.150425] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-25T18:19:52.529509] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:52.558818] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T18:19:52.688675] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-25T18:19:53.488749] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-25T18:19:53.894076] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T18:19:53.903381] [INFO ] [REMOTE ] DE: Full fetch complete (69597 records). [2025-09-25T18:19:53.903540] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-25T18:19:54.309909] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-25T18:19:54.314122] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-25T18:19:54.315257] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-25T18:19:54.316157] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-25T18:19:54.316509] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-25T18:19:54.347701] [DEBUG] [LOCAL ] DE: Trimmed 69597 records to 48062 (keeping 200 days of data) [2025-09-25T18:19:54.348787] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:19:54.660313] [DEBUG] [LOCAL ] DE: Primary data saved (48062 records). [2025-09-25T18:19:54.660447] [INFO ] [MAIN ] DE: Full history saved. [2025-09-25T18:19:54.660532] [INFO ] [MAIN ] Update Progress: 605/2372 symbols completed. DE took 46.2s. Estimated remaining: 3h 53m 15s. Rate: 7.6 symbols/min [2025-09-25T18:19:54.834233] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:19:54.884527] [DEBUG] [LOCAL ] DEO: Loaded 49022 existing records from primary storage. [2025-09-25T18:19:54.884720] [INFO ] [MAIN ] DEO: Loaded 49022 existing records. [2025-09-25T18:19:55.065504] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:19:55.065787] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-25T18:19:55.065838] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-25T18:19:55.066136] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-25T18:19:55.066194] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-25T18:19:55.098298] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-25T18:19:55.435356] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:19:55.640336] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-25T18:19:55.850439] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:19:55.888675] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-25T18:19:56.428681] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T18:19:56.688752] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-25T18:19:57.488737] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-25T18:19:57.604762] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T18:19:58.288710] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-25T18:19:58.356698] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T18:19:59.059308] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T18:19:59.088669] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-25T18:19:59.888716] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-25T18:20:00.337017] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T18:20:00.688699] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-25T18:20:00.753579] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T18:20:01.488705] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-25T18:20:01.835258] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-25T18:20:02.288740] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-25T18:20:03.050954] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-25T18:20:03.088718] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-25T18:20:03.553178] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T18:20:03.600638] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-25T18:20:03.888751] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-25T18:20:04.688711] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-25T18:20:05.481757] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-25T18:20:05.492292] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-25T18:20:05.738679] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T18:20:06.288714] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-25T18:20:06.395852] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T18:20:06.406214] [INFO ] [REMOTE ] DEI: Full fetch complete (69222 records). [2025-09-25T18:20:06.406378] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-25T18:20:06.407238] [FATAL] [VALIDATOR ] DEI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:20:06.407367] [FATAL] [MAIN ] DEI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:20:06.407411] [WARN ] [MAIN ] DEI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:20:06.407452] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-25T18:20:06.407539] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-25T18:20:06.407597] [INFO ] [LOCAL ] DEI: Starting deletion of derivative data. [2025-09-25T18:20:06.408029] [DEBUG] [LOCAL ] DEI: Deleted derivative data file. [2025-09-25T18:20:06.409246] [INFO ] [MAIN ] Update Progress: 606/2372 symbols completed. DEI took 24.4s. Estimated remaining: 3h 53m 18s. Rate: 7.6 symbols/min [2025-09-25T18:20:06.590801] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:06.627154] [DEBUG] [LOCAL ] DFH: Loaded 32733 existing records from primary storage. [2025-09-25T18:20:06.627392] [INFO ] [MAIN ] DFH: Loaded 32733 existing records. [2025-09-25T18:20:06.809529] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:06.809806] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-25T18:20:06.809856] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-25T18:20:06.810111] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-25T18:20:06.810168] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-25T18:20:07.088868] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-25T18:20:07.169211] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:07.264819] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T18:20:07.888715] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-25T18:20:08.546087] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-25T18:20:08.688744] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-25T18:20:09.020799] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T18:20:09.488698] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-25T18:20:09.569772] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:20:10.034823] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T18:20:10.288777] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-25T18:20:11.088750] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-25T18:20:11.592735] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T18:20:11.854728] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:20:11.888714] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-25T18:20:12.497171] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T18:20:12.688737] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-25T18:20:13.488712] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-25T18:20:13.890435] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T18:20:14.175025] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-25T18:20:14.288718] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-25T18:20:15.088689] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-25T18:20:15.160502] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T18:20:15.224190] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T18:20:15.233878] [INFO ] [REMOTE ] DECK: Full fetch complete (76606 records). [2025-09-25T18:20:15.234052] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-25T18:20:15.623996] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-25T18:20:15.624079] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-25T18:20:15.624940] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-25T18:20:15.625006] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-25T18:20:15.626523] [DEBUG] [LOCAL ] DECK: Trimmed 76606 records to 53690 (keeping 200 days of data) [2025-09-25T18:20:15.910134] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-25T18:20:15.960154] [DEBUG] [LOCAL ] DECK: Primary data saved (53690 records). [2025-09-25T18:20:15.960270] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-25T18:20:15.961363] [INFO ] [MAIN ] Update Progress: 607/2372 symbols completed. DECK took 44.0s. Estimated remaining: 3h 53m 15s. Rate: 7.6 symbols/min [2025-09-25T18:20:16.159767] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:16.184315] [DEBUG] [LOCAL ] DFIN: Loaded 23295 existing records from primary storage. [2025-09-25T18:20:16.184442] [INFO ] [MAIN ] DFIN: Loaded 23295 existing records. [2025-09-25T18:20:16.373814] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:16.374078] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-25T18:20:16.374128] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-25T18:20:16.374384] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-25T18:20:16.374445] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-25T18:20:16.693908] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-25T18:20:16.749445] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:17.102458] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T18:20:17.488709] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-25T18:20:17.608533] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T18:20:17.762491] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T18:20:18.288712] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-25T18:20:18.352377] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T18:20:19.088720] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-25T18:20:19.813781] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T18:20:19.888739] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-25T18:20:20.408572] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T18:20:20.688720] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-25T18:20:21.488735] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-25T18:20:21.544696] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T18:20:21.895091] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T18:20:22.288772] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-25T18:20:23.088739] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-25T18:20:23.530550] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T18:20:23.653887] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T18:20:23.888727] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-25T18:20:24.274846] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T18:20:24.674371] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T18:20:24.688682] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-25T18:20:25.488738] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-25T18:20:26.288696] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-25T18:20:26.453563] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T18:20:27.088725] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-25T18:20:27.137294] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T18:20:27.327540] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:20:27.336952] [INFO ] [REMOTE ] DELL: Full fetch complete (77430 records). [2025-09-25T18:20:27.337109] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-25T18:20:27.338092] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:20:27.338186] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:20:27.338256] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:20:27.338345] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-25T18:20:27.338441] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-25T18:20:27.338510] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-09-25T18:20:27.338578] [DEBUG] [LOCAL ] DELL: No derivative data file found to delete. [2025-09-25T18:20:27.338693] [INFO ] [MAIN ] Update Progress: 608/2372 symbols completed. DELL took 35.4s. Estimated remaining: 3h 53m 17s. Rate: 7.6 symbols/min [2025-09-25T18:20:27.511340] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:27.525319] [DEBUG] [LOCAL ] DFP: Loaded 11684 existing records from primary storage. [2025-09-25T18:20:27.525437] [INFO ] [MAIN ] DFP: Loaded 11684 existing records. [2025-09-25T18:20:27.721560] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:27.722014] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-25T18:20:27.722091] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-25T18:20:27.722508] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-25T18:20:27.722564] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-25T18:20:27.899507] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-25T18:20:28.097229] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:28.684245] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T18:20:28.693307] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-25T18:20:28.695179] [INFO ] [REMOTE ] DEO: Full fetch complete (71520 records). [2025-09-25T18:20:28.695355] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-25T18:20:29.127880] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-25T18:20:29.128102] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-25T18:20:29.129010] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-25T18:20:29.129086] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-25T18:20:29.132514] [DEBUG] [LOCAL ] DEO: Trimmed 71520 records to 49405 (keeping 200 days of data) [2025-09-25T18:20:29.262771] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T18:20:29.491092] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-25T18:20:29.502161] [DEBUG] [LOCAL ] DEO: Primary data saved (49405 records). [2025-09-25T18:20:29.502376] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-25T18:20:29.502620] [INFO ] [MAIN ] Update Progress: 609/2372 symbols completed. DEO took 34.8s. Estimated remaining: 3h 52m 52s. Rate: 7.6 symbols/min [2025-09-25T18:20:29.682902] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:29.749218] [DEBUG] [LOCAL ] DG: Loaded 53299 existing records from primary storage. [2025-09-25T18:20:29.749431] [INFO ] [MAIN ] DG: Loaded 53299 existing records. [2025-09-25T18:20:29.792565] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T18:20:29.950213] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:29.950494] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-25T18:20:29.950555] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-25T18:20:29.950835] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-25T18:20:29.950895] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-25T18:20:30.302910] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-25T18:20:30.308972] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:30.760615] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T18:20:31.082215] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T18:20:31.088681] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-25T18:20:31.685714] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T18:20:31.888713] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-25T18:20:32.371578] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T18:20:32.688723] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-25T18:20:33.256116] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T18:20:33.488714] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-25T18:20:34.019690] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T18:20:34.288709] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-25T18:20:35.088687] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-25T18:20:35.329192] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:20:35.888724] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-25T18:20:36.422603] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:20:36.428687] [INFO ] [REMOTE ] DFH: Full fetch complete (49085 records). [2025-09-25T18:20:36.428779] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-25T18:20:36.696242] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-25T18:20:36.814214] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-25T18:20:36.814292] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-25T18:20:36.814937] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-25T18:20:36.814999] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-25T18:20:36.816050] [DEBUG] [LOCAL ] DFH: Trimmed 49085 records to 32932 (keeping 200 days of data) [2025-09-25T18:20:37.016853] [DEBUG] [LOCAL ] DFH: Primary data saved (32932 records). [2025-09-25T18:20:37.017014] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-25T18:20:37.017142] [INFO ] [MAIN ] Update Progress: 610/2372 symbols completed. DFH took 30.6s. Estimated remaining: 3h 52m 43s. Rate: 7.6 symbols/min [2025-09-25T18:20:37.190474] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:37.249284] [DEBUG] [LOCAL ] DGX: Loaded 45219 existing records from primary storage. [2025-09-25T18:20:37.249473] [INFO ] [MAIN ] DGX: Loaded 45219 existing records. [2025-09-25T18:20:37.441932] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:37.442184] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-25T18:20:37.442233] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-25T18:20:37.442478] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-25T18:20:37.442550] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-25T18:20:37.506107] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-25T18:20:37.546129] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T18:20:37.839891] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:37.912609] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T18:20:38.288684] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-25T18:20:38.681881] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T18:20:38.763789] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T18:20:39.088720] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-25T18:20:39.888732] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-25T18:20:40.244041] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T18:20:40.688789] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-25T18:20:41.373266] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T18:20:41.488684] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-25T18:20:41.713161] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T18:20:42.288694] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-25T18:20:42.535756] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T18:20:43.088706] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-25T18:20:43.271019] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T18:20:43.273885] [INFO ] [REMOTE ] DFP: Full fetch complete (16211 records). [2025-09-25T18:20:43.273961] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-25T18:20:43.647915] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-25T18:20:43.647998] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-25T18:20:43.648396] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-25T18:20:43.648438] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-25T18:20:43.649036] [DEBUG] [LOCAL ] DFP: Trimmed 16211 records to 11734 (keeping 200 days of data) [2025-09-25T18:20:43.723383] [DEBUG] [LOCAL ] DFP: Primary data saved (11734 records). [2025-09-25T18:20:43.723518] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-25T18:20:43.723601] [INFO ] [MAIN ] Update Progress: 611/2372 symbols completed. DFP took 16.4s. Estimated remaining: 3h 52m 32s. Rate: 7.6 symbols/min [2025-09-25T18:20:43.890261] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-25T18:20:43.914452] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:43.929974] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T18:20:43.952449] [DEBUG] [LOCAL ] DHF: Loaded 20496 existing records from primary storage. [2025-09-25T18:20:43.952573] [INFO ] [MAIN ] DHF: Loaded 20496 existing records. [2025-09-25T18:20:44.134877] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:20:44.135142] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-25T18:20:44.135200] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-25T18:20:44.135439] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-25T18:20:44.135498] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-25T18:20:44.500757] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:44.688714] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-25T18:20:45.488694] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-25T18:20:45.658088] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T18:20:45.684447] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T18:20:46.288705] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-25T18:20:47.031337] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T18:20:47.088687] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-25T18:20:47.117785] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T18:20:47.888721] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-25T18:20:48.470387] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T18:20:48.597492] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T18:20:48.688791] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-25T18:20:49.488709] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-25T18:20:49.597635] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T18:20:49.602054] [INFO ] [REMOTE ] DFIN: Full fetch complete (33568 records). [2025-09-25T18:20:49.602136] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-25T18:20:49.983753] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-25T18:20:49.983852] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-25T18:20:49.984452] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-25T18:20:49.984524] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-25T18:20:49.986686] [DEBUG] [LOCAL ] DFIN: Trimmed 33568 records to 23491 (keeping 200 days of data) [2025-09-25T18:20:50.139567] [DEBUG] [LOCAL ] DFIN: Primary data saved (23491 records). [2025-09-25T18:20:50.139729] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-25T18:20:50.139851] [INFO ] [MAIN ] Update Progress: 612/2372 symbols completed. DFIN took 34.2s. Estimated remaining: 3h 52m 19s. Rate: 7.6 symbols/min [2025-09-25T18:20:50.291142] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-25T18:20:50.313779] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:20:50.313902] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-09-25T18:20:50.313940] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-09-25T18:20:50.314082] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-25T18:20:50.314126] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-25T18:20:50.314169] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-25T18:20:50.314203] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-25T18:20:50.680124] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:20:50.958603] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T18:20:51.088670] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-25T18:20:51.364463] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T18:20:51.888711] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-25T18:20:52.688766] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-25T18:20:52.772897] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:20:53.488692] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-25T18:20:53.771758] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T18:20:54.106344] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:20:54.288719] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-25T18:20:54.505903] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T18:20:55.088724] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-25T18:20:55.789524] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:20:55.888683] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-25T18:20:56.594141] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T18:20:56.688758] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-25T18:20:57.466797] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:20:57.488660] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-25T18:20:58.288736] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-25T18:20:58.400672] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T18:20:59.002089] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T18:20:59.088708] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-25T18:20:59.107859] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T18:20:59.888794] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-25T18:21:00.688736] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-25T18:21:00.826965] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T18:21:00.874283] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T18:21:01.488745] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-25T18:21:02.254118] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T18:21:02.288717] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-25T18:21:02.901405] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:21:03.088716] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-25T18:21:03.682606] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T18:21:03.888760] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-25T18:21:04.152579] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T18:21:04.688720] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-25T18:21:05.173064] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T18:21:05.488742] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-25T18:21:05.973021] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T18:21:06.288740] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-25T18:21:07.088906] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-25T18:21:07.443979] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:21:07.455770] [INFO ] [REMOTE ] DG: Full fetch complete (77216 records). [2025-09-25T18:21:07.456036] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-25T18:21:07.880183] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-25T18:21:07.880336] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-25T18:21:07.881348] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-25T18:21:07.881435] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-25T18:21:07.895343] [DEBUG] [LOCAL ] DG: Trimmed 77216 records to 53678 (keeping 200 days of data) [2025-09-25T18:21:07.895474] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-25T18:21:07.917999] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:21:08.286455] [DEBUG] [LOCAL ] DG: Primary data saved (53678 records). [2025-09-25T18:21:08.286754] [INFO ] [MAIN ] DG: Full history saved. [2025-09-25T18:21:08.286896] [INFO ] [MAIN ] Update Progress: 613/2372 symbols completed. DG took 38.8s. Estimated remaining: 3h 52m 41s. Rate: 7.6 symbols/min [2025-09-25T18:21:08.459053] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:08.518039] [DEBUG] [LOCAL ] DHR: Loaded 53359 existing records from primary storage. [2025-09-25T18:21:08.518228] [INFO ] [MAIN ] DHR: Loaded 53359 existing records. [2025-09-25T18:21:08.698852] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-25T18:21:08.705958] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:08.707950] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-25T18:21:08.708120] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-25T18:21:08.708446] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-25T18:21:08.708611] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-25T18:21:08.842169] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T18:21:08.916068] [INFO ] [REMOTE ] DHF: Full fetch complete (29469 records). [2025-09-25T18:21:08.916338] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-25T18:21:09.267431] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:09.506469] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-25T18:21:09.602693] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-25T18:21:09.602844] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-25T18:21:09.603553] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-25T18:21:09.604081] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-25T18:21:09.607504] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-25T18:21:09.619343] [DEBUG] [LOCAL ] DHF: Trimmed 29469 records to 20665 (keeping 200 days of data) [2025-09-25T18:21:09.754017] [DEBUG] [LOCAL ] DHF: Primary data saved (20665 records). [2025-09-25T18:21:09.754148] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-25T18:21:09.754230] [INFO ] [MAIN ] Update Progress: 614/2372 symbols completed. DHF took 26.0s. Estimated remaining: 3h 52m 14s. Rate: 7.6 symbols/min [2025-09-25T18:21:09.931761] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:09.931934] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-25T18:21:09.931971] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-25T18:21:09.932115] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-25T18:21:09.932178] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-25T18:21:09.932246] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-25T18:21:09.932293] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-25T18:21:10.300541] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-25T18:21:10.323623] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:10.351715] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T18:21:11.088709] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-25T18:21:11.314252] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T18:21:11.888711] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-25T18:21:12.166617] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T18:21:12.583939] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:21:12.592104] [INFO ] [REMOTE ] DGX: Full fetch complete (65159 records). [2025-09-25T18:21:12.592245] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-25T18:21:12.693942] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-25T18:21:12.987986] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-25T18:21:12.988091] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-25T18:21:12.989010] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-25T18:21:12.989077] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-25T18:21:12.990538] [DEBUG] [LOCAL ] DGX: Trimmed 65159 records to 45481 (keeping 200 days of data) [2025-09-25T18:21:13.312747] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:21:13.332176] [DEBUG] [LOCAL ] DGX: Primary data saved (45481 records). [2025-09-25T18:21:13.332339] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-25T18:21:13.333046] [INFO ] [MAIN ] Update Progress: 615/2372 symbols completed. DGX took 36.3s. Estimated remaining: 3h 51m 54s. Rate: 7.6 symbols/min [2025-09-25T18:21:13.490870] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-25T18:21:13.523493] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:13.541000] [DEBUG] [LOCAL ] DHX: Loaded 13224 existing records from primary storage. [2025-09-25T18:21:13.541135] [INFO ] [MAIN ] DHX: Loaded 13224 existing records. [2025-09-25T18:21:13.726031] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:13.726347] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-25T18:21:13.726396] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-25T18:21:13.726600] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-25T18:21:13.726698] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-25T18:21:14.116995] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:14.288820] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-25T18:21:14.370178] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:21:15.088694] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-25T18:21:15.284902] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T18:21:15.717008] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T18:21:15.888717] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-25T18:21:16.587509] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:21:16.688744] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-25T18:21:17.432405] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T18:21:17.488711] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-25T18:21:18.288716] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-25T18:21:18.576640] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T18:21:18.718797] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T18:21:19.088736] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-25T18:21:19.562609] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T18:21:19.888714] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-25T18:21:20.688728] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-25T18:21:21.061013] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T18:21:21.070341] [INFO ] [REMOTE ] DHI: Full fetch complete (76837 records). [2025-09-25T18:21:21.070476] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-25T18:21:21.071217] [FATAL] [VALIDATOR ] DHI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:21:21.071315] [FATAL] [MAIN ] DHI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:21:21.071357] [WARN ] [MAIN ] DHI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:21:21.071396] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-25T18:21:21.071454] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-09-25T18:21:21.071505] [INFO ] [LOCAL ] DHI: Starting deletion of derivative data. [2025-09-25T18:21:21.071572] [DEBUG] [LOCAL ] DHI: No derivative data file found to delete. [2025-09-25T18:21:21.071668] [INFO ] [MAIN ] Update Progress: 616/2372 symbols completed. DHI took 30.9s. Estimated remaining: 3h 51m 46s. Rate: 7.6 symbols/min [2025-09-25T18:21:21.243947] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:21.260001] [DEBUG] [LOCAL ] DIAX: Loaded 12538 existing records from primary storage. [2025-09-25T18:21:21.260142] [INFO ] [MAIN ] DIAX: Loaded 12538 existing records. [2025-09-25T18:21:21.457998] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:21.458579] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-25T18:21:21.458683] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-25T18:21:21.458960] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-25T18:21:21.459025] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-25T18:21:21.503040] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-25T18:21:21.832750] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:21.887901] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T18:21:21.975035] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T18:21:22.102719] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T18:21:22.288767] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-25T18:21:22.886379] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T18:21:23.088780] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-25T18:21:23.888792] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-25T18:21:24.688695] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-25T18:21:25.066220] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T18:21:25.111359] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T18:21:25.338899] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T18:21:25.488727] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-25T18:21:26.288688] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-25T18:21:26.513366] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T18:21:27.088719] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-25T18:21:27.888741] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-25T18:21:27.935386] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T18:21:28.192171] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:21:28.458533] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T18:21:28.688733] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-25T18:21:29.236061] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T18:21:29.488726] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-25T18:21:30.288760] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-25T18:21:30.537762] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T18:21:31.088735] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-25T18:21:31.888676] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-25T18:21:32.264008] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T18:21:32.688789] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-25T18:21:33.315227] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-25T18:21:33.390868] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T18:21:33.488678] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-25T18:21:34.288753] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-25T18:21:34.914371] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T18:21:35.088724] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-25T18:21:35.308357] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-25T18:21:35.351445] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T18:21:35.506542] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T18:21:35.888724] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-25T18:21:36.688783] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-25T18:21:36.865436] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T18:21:37.488747] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-25T18:21:38.289393] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T18:21:38.289463] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-25T18:21:38.335532] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T18:21:38.865905] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T18:21:39.088707] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-25T18:21:39.610145] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T18:21:39.888719] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-25T18:21:40.460463] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T18:21:40.688705] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-25T18:21:41.488737] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-25T18:21:42.288712] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-25T18:21:42.880961] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-25T18:21:43.088692] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-25T18:21:43.147853] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T18:21:43.888709] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-25T18:21:44.206333] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T18:21:44.210070] [INFO ] [REMOTE ] DHX: Full fetch complete (20801 records). [2025-09-25T18:21:44.210160] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-25T18:21:44.599300] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-25T18:21:44.599477] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-25T18:21:44.600022] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-25T18:21:44.600107] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-25T18:21:44.601016] [DEBUG] [LOCAL ] DHX: Trimmed 20801 records to 13311 (keeping 200 days of data) [2025-09-25T18:21:44.681746] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T18:21:44.693133] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-25T18:21:44.697833] [INFO ] [REMOTE ] DHT: Full fetch complete (69615 records). [2025-09-25T18:21:44.698754] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-25T18:21:44.707747] [FATAL] [VALIDATOR ] DHT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:21:44.708982] [FATAL] [MAIN ] DHT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:21:44.709397] [WARN ] [MAIN ] DHT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:21:44.710366] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-25T18:21:44.710789] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-25T18:21:44.711388] [INFO ] [LOCAL ] DHT: Starting deletion of derivative data. [2025-09-25T18:21:44.712085] [DEBUG] [LOCAL ] DHT: No derivative data file found to delete. [2025-09-25T18:21:44.712197] [INFO ] [MAIN ] Update Progress: 617/2372 symbols completed. DHT took 35.0s. Estimated remaining: 3h 52m 22s. Rate: 7.6 symbols/min [2025-09-25T18:21:44.831915] [DEBUG] [LOCAL ] DHX: Primary data saved (13311 records). [2025-09-25T18:21:44.837256] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-25T18:21:44.837379] [INFO ] [MAIN ] Update Progress: 618/2372 symbols completed. DHX took 31.5s. Estimated remaining: 3h 51m 52s. Rate: 7.6 symbols/min [2025-09-25T18:21:44.901925] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:45.028179] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T18:21:45.069407] [INFO ] [REMOTE ] DIAX: Full fetch complete (17278 records). [2025-09-25T18:21:45.094106] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-25T18:21:45.093986] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:45.274199] [DEBUG] [LOCAL ] DIN: Loaded 37275 existing records from primary storage. [2025-09-25T18:21:45.285346] [INFO ] [MAIN ] DIN: Loaded 37275 existing records. [2025-09-25T18:21:45.579269] [DEBUG] [LOCAL ] DINO: Loaded 52958 existing records from primary storage. [2025-09-25T18:21:45.635538] [INFO ] [MAIN ] DINO: Loaded 52958 existing records. [2025-09-25T18:21:45.755313] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:45.820251] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-25T18:21:45.838814] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-25T18:21:45.839183] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-25T18:21:45.838929] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-25T18:21:45.839912] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-25T18:21:45.847569] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-25T18:21:45.856638] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-25T18:21:45.861241] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-25T18:21:46.019864] [DEBUG] [LOCAL ] DIAX: Trimmed 17278 records to 12627 (keeping 200 days of data) [2025-09-25T18:21:46.029037] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:46.052884] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-25T18:21:46.052992] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-25T18:21:46.053725] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-25T18:21:46.090763] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-25T18:21:46.675289] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:46.692329] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-25T18:21:46.801103] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:46.802985] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-25T18:21:46.811000] [DEBUG] [LOCAL ] DIAX: Primary data saved (12627 records). [2025-09-25T18:21:46.811187] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-25T18:21:46.811348] [INFO ] [MAIN ] Update Progress: 619/2372 symbols completed. DIAX took 25.7s. Estimated remaining: 3h 51m 27s. Rate: 7.6 symbols/min [2025-09-25T18:21:47.000438] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:47.033519] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-25T18:21:47.091790] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-25T18:21:47.093974] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-25T18:21:47.094156] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-25T18:21:47.279773] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:21:47.280034] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-25T18:21:47.280081] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-25T18:21:47.280318] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-25T18:21:47.280376] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-25T18:21:47.660681] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:47.888750] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-25T18:21:48.184635] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:21:48.227878] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:21:48.532951] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T18:21:48.542403] [INFO ] [REMOTE ] DHR: Full fetch complete (76877 records). [2025-09-25T18:21:48.542544] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-25T18:21:48.543327] [FATAL] [VALIDATOR ] DHR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:21:48.543436] [FATAL] [MAIN ] DHR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:21:48.543482] [WARN ] [MAIN ] DHR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:21:48.543522] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-25T18:21:48.543605] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-25T18:21:48.543664] [INFO ] [LOCAL ] DHR: Starting deletion of derivative data. [2025-09-25T18:21:48.544905] [DEBUG] [LOCAL ] DHR: Deleted derivative data file. [2025-09-25T18:21:48.546392] [INFO ] [MAIN ] Update Progress: 620/2372 symbols completed. DHR took 40.3s. Estimated remaining: 3h 51m 2s. Rate: 7.6 symbols/min [2025-09-25T18:21:48.693914] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-25T18:21:48.723603] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:21:48.723921] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-25T18:21:48.723977] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-25T18:21:48.724124] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-25T18:21:48.724166] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-25T18:21:48.724208] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-25T18:21:48.724240] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-25T18:21:49.078791] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:21:49.488774] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-25T18:21:49.886910] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T18:21:50.113989] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:21:50.288800] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-25T18:21:50.294204] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-25T18:21:50.719726] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T18:21:51.088719] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-25T18:21:51.437720] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-25T18:21:51.888731] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-25T18:21:52.312628] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-25T18:21:52.688722] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-25T18:21:53.488729] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-25T18:21:54.288752] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-25T18:21:55.088693] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-25T18:21:55.477664] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T18:21:55.536900] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-25T18:21:55.581550] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-25T18:21:55.885505] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T18:21:55.893858] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-25T18:21:56.688766] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-25T18:21:56.964077] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-25T18:21:57.252983] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T18:21:57.488735] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-25T18:21:57.818814] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-25T18:21:58.288809] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-25T18:21:58.573471] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-25T18:21:59.088698] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-25T18:21:59.456744] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-25T18:21:59.888740] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-25T18:22:00.688785] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-25T18:22:01.488702] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-25T18:22:01.732325] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T18:22:01.885881] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T18:22:02.288729] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-25T18:22:02.820029] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T18:22:02.821135] [INFO ] [REMOTE ] DIVY: Full fetch complete (1723 records). [2025-09-25T18:22:02.821227] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-25T18:22:03.015364] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T18:22:03.015574] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:22:03.015664] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:22:03.015739] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-25T18:22:03.015816] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-25T18:22:03.015870] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-25T18:22:03.015947] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-25T18:22:03.016043] [INFO ] [MAIN ] Update Progress: 621/2372 symbols completed. DIVY took 14.5s. Estimated remaining: 3h 51m 13s. Rate: 7.6 symbols/min [2025-09-25T18:22:03.093894] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-25T18:22:03.191855] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:03.247864] [DEBUG] [LOCAL ] DK: Loaded 49380 existing records from primary storage. [2025-09-25T18:22:03.248034] [INFO ] [MAIN ] DK: Loaded 49380 existing records. [2025-09-25T18:22:03.430109] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:22:03.430366] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-25T18:22:03.430533] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-25T18:22:03.431000] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-25T18:22:03.431125] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-25T18:22:03.824025] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:03.826426] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-25T18:22:03.888670] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-25T18:22:04.688763] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-25T18:22:04.865639] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T18:22:05.488733] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-25T18:22:05.860074] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T18:22:06.038500] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:22:06.288711] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-25T18:22:06.923149] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:22:07.088676] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-25T18:22:07.839154] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:22:07.888805] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-25T18:22:08.537505] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T18:22:08.688841] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-25T18:22:09.488817] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-25T18:22:10.073139] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-25T18:22:10.288760] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-25T18:22:10.626954] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T18:22:11.088733] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-25T18:22:11.176750] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T18:22:11.888710] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-25T18:22:12.688726] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-25T18:22:12.855428] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-25T18:22:12.871211] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T18:22:12.881821] [INFO ] [REMOTE ] DINO: Full fetch complete (76675 records). [2025-09-25T18:22:12.881957] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-25T18:22:13.294032] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-25T18:22:13.294155] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-25T18:22:13.295090] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-25T18:22:13.295224] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-25T18:22:13.297093] [DEBUG] [LOCAL ] DINO: Trimmed 76675 records to 53341 (keeping 200 days of data) [2025-09-25T18:22:13.425090] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T18:22:13.522374] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-25T18:22:13.685506] [DEBUG] [LOCAL ] DINO: Primary data saved (53341 records). [2025-09-25T18:22:13.685685] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-25T18:22:13.685796] [INFO ] [MAIN ] Update Progress: 622/2372 symbols completed. DINO took 28.8s. Estimated remaining: 3h 51m 12s. Rate: 7.6 symbols/min [2025-09-25T18:22:13.869940] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:13.870384] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-09-25T18:22:13.870526] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-09-25T18:22:13.870981] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-25T18:22:13.871043] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-25T18:22:13.871093] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-09-25T18:22:13.871136] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-25T18:22:14.183696] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T18:22:14.284540] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:14.288668] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-25T18:22:15.088685] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-25T18:22:15.156906] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T18:22:15.231660] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T18:22:15.888724] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-25T18:22:16.688754] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-25T18:22:17.243569] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:22:17.425313] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T18:22:17.488694] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-25T18:22:17.555365] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-25T18:22:18.288680] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-25T18:22:18.593482] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T18:22:19.088751] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-25T18:22:19.888744] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-25T18:22:19.947801] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:22:19.973468] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T18:22:20.688767] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-25T18:22:20.809152] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T18:22:21.488765] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-25T18:22:22.093735] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T18:22:22.288709] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-25T18:22:22.691941] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T18:22:23.088723] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-25T18:22:23.888746] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-25T18:22:24.216307] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T18:22:24.587368] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T18:22:24.688716] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-25T18:22:25.488778] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-25T18:22:26.251852] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-25T18:22:26.282672] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T18:22:26.290063] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-25T18:22:26.291310] [INFO ] [REMOTE ] DIN: Full fetch complete (55162 records). [2025-09-25T18:22:26.291400] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-25T18:22:26.713072] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-25T18:22:26.713292] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-25T18:22:26.714165] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-25T18:22:26.714291] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-25T18:22:26.715988] [DEBUG] [LOCAL ] DIN: Trimmed 55162 records to 37533 (keeping 200 days of data) [2025-09-25T18:22:26.849535] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:22:26.995815] [DEBUG] [LOCAL ] DIN: Primary data saved (37533 records). [2025-09-25T18:22:26.995993] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-25T18:22:26.996097] [INFO ] [MAIN ] Update Progress: 623/2372 symbols completed. DIN took 42.3s. Estimated remaining: 3h 51m 20s. Rate: 7.6 symbols/min [2025-09-25T18:22:27.095157] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-25T18:22:27.172028] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:27.221585] [DEBUG] [LOCAL ] DKS: Loaded 49904 existing records from primary storage. [2025-09-25T18:22:27.221757] [INFO ] [MAIN ] DKS: Loaded 49904 existing records. [2025-09-25T18:22:27.400464] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:22:27.400773] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-25T18:22:27.400826] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-25T18:22:27.401159] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-25T18:22:27.401218] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-25T18:22:27.756832] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:27.888683] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-25T18:22:28.205776] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T18:22:28.584493] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-25T18:22:28.688786] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-25T18:22:29.488743] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-25T18:22:29.669841] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:22:29.833359] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T18:22:30.288734] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-25T18:22:30.877134] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T18:22:31.088734] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-25T18:22:31.888755] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-25T18:22:32.396164] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-25T18:22:32.406446] [INFO ] [REMOTE ] DIS: Full fetch complete (77944 records). [2025-09-25T18:22:32.406697] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-25T18:22:32.694395] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-25T18:22:32.842525] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-25T18:22:32.842713] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-25T18:22:32.844064] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-25T18:22:32.844261] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-25T18:22:32.868614] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T18:22:32.877546] [DEBUG] [LOCAL ] DIS: Trimmed 77944 records to 54178 (keeping 200 days of data) [2025-09-25T18:22:32.878220] [INFO ] [REMOTE ] DK: Full fetch complete (70354 records). [2025-09-25T18:22:32.878314] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-25T18:22:32.879249] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:22:32.879339] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:22:32.879382] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:22:32.879418] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-25T18:22:32.879481] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-25T18:22:32.879538] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-09-25T18:22:32.879817] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-09-25T18:22:32.879923] [INFO ] [MAIN ] Update Progress: 624/2372 symbols completed. DK took 29.9s. Estimated remaining: 3h 51m 6s. Rate: 7.6 symbols/min [2025-09-25T18:22:33.097430] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T18:22:33.172034] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:33.320526] [DEBUG] [LOCAL ] DLB: Loaded 32152 existing records from primary storage. [2025-09-25T18:22:33.324292] [INFO ] [MAIN ] DLB: Loaded 32152 existing records. [2025-09-25T18:22:33.501003] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-25T18:22:33.533816] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:22:33.536957] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-25T18:22:33.538066] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-25T18:22:33.539087] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-25T18:22:33.539402] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-25T18:22:34.016196] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:34.035354] [DEBUG] [LOCAL ] DIS: Primary data saved (54178 records). [2025-09-25T18:22:34.035480] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-25T18:22:34.036540] [INFO ] [MAIN ] Update Progress: 625/2372 symbols completed. DIS took 47.2s. Estimated remaining: 3h 50m 39s. Rate: 7.6 symbols/min [2025-09-25T18:22:34.196331] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-25T18:22:34.235814] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:34.247054] [DEBUG] [LOCAL ] DLNG: Loaded 6175 existing records from primary storage. [2025-09-25T18:22:34.247196] [INFO ] [MAIN ] DLNG: Loaded 6175 existing records. [2025-09-25T18:22:34.293902] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-25T18:22:34.449342] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:22:34.474194] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-25T18:22:34.474679] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-25T18:22:34.476072] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T18:22:34.476173] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-25T18:22:34.486145] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-25T18:22:34.877032] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:35.088709] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-25T18:22:35.454965] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T18:22:35.888706] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-25T18:22:35.910850] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T18:22:36.688714] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-25T18:22:37.242720] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T18:22:37.488713] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-25T18:22:37.901606] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T18:22:38.288706] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-25T18:22:38.765412] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:22:38.918277] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:22:39.088693] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-25T18:22:39.888717] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-25T18:22:40.690669] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-25T18:22:40.692403] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T18:22:41.113773] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-25T18:22:41.235224] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T18:22:41.488713] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-25T18:22:42.220675] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T18:22:42.223577] [INFO ] [REMOTE ] DKL: Full fetch complete (29228 records). [2025-09-25T18:22:42.223674] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-25T18:22:42.293877] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-25T18:22:42.613546] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-25T18:22:42.613666] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-25T18:22:42.614190] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-25T18:22:42.614270] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-25T18:22:42.616403] [DEBUG] [LOCAL ] DKL: Trimmed 29228 records to 19153 (keeping 200 days of data) [2025-09-25T18:22:42.734565] [DEBUG] [LOCAL ] DKL: Primary data saved (19153 records). [2025-09-25T18:22:42.734741] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-25T18:22:42.734884] [INFO ] [MAIN ] Update Progress: 626/2372 symbols completed. DKL took 29.0s. Estimated remaining: 3h 50m 33s. Rate: 7.6 symbols/min [2025-09-25T18:22:42.911841] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:22:42.970369] [DEBUG] [LOCAL ] DLR: Loaded 51149 existing records from primary storage. [2025-09-25T18:22:42.970508] [INFO ] [MAIN ] DLR: Loaded 51149 existing records. [2025-09-25T18:22:43.084270] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T18:22:43.089484] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-25T18:22:43.171634] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:22:43.172513] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-25T18:22:43.172587] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-25T18:22:43.173271] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-25T18:22:43.173338] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-25T18:22:43.535383] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:22:43.888720] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-25T18:22:44.523769] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T18:22:44.688738] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-25T18:22:45.405604] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T18:22:45.488757] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-25T18:22:46.267440] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:22:46.288673] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-25T18:22:46.925623] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T18:22:47.088703] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-25T18:22:47.373926] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T18:22:47.888716] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-25T18:22:48.259829] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T18:22:48.587898] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T18:22:48.688748] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-25T18:22:49.057251] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-25T18:22:49.488739] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-25T18:22:49.895750] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-25T18:22:50.288722] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-25T18:22:51.088729] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-25T18:22:51.787295] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T18:22:51.888699] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-25T18:22:52.688765] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-25T18:22:53.488775] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-25T18:23:04.670359] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (13.58 seconds). [2025-09-25T18:23:04.672271] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-25T18:23:06.041318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (12.55 seconds). [2025-09-25T18:23:06.048348] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-25T18:23:06.194573] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T18:23:06.196193] [INFO ] [REMOTE ] DLNG: Full fetch complete (11917 records). [2025-09-25T18:23:06.196268] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-25T18:23:06.196747] [FATAL] [VALIDATOR ] DLNG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:23:06.196830] [FATAL] [MAIN ] DLNG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:23:06.196874] [WARN ] [MAIN ] DLNG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:23:06.196912] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-25T18:23:06.196969] [DEBUG] [LOCAL ] DLNG: No primary data file found to delete. [2025-09-25T18:23:06.197005] [INFO ] [LOCAL ] DLNG: Starting deletion of derivative data. [2025-09-25T18:23:06.197312] [DEBUG] [LOCAL ] DLNG: Deleted derivative data file. [2025-09-25T18:23:06.197430] [INFO ] [MAIN ] Update Progress: 627/2372 symbols completed. DLNG took 32.2s. Estimated remaining: 3h 51m 9s. Rate: 7.5 symbols/min [2025-09-25T18:23:06.380474] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:06.421726] [DEBUG] [LOCAL ] DLX: Loaded 28990 existing records from primary storage. [2025-09-25T18:23:06.421899] [INFO ] [MAIN ] DLX: Loaded 28990 existing records. [2025-09-25T18:23:06.621002] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:06.621321] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-25T18:23:06.621491] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-25T18:23:06.621800] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-25T18:23:06.621860] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-25T18:23:06.954802] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (15.07 seconds). [2025-09-25T18:23:06.983454] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-25T18:23:07.072738] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:07.073207] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-25T18:23:07.106414] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (14.42 seconds). [2025-09-25T18:23:07.117588] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-25T18:23:08.660193] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T18:23:08.665465] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-25T18:23:08.769553] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-25T18:23:08.776871] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-25T18:23:08.964046] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T18:23:08.975705] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-25T18:23:09.003492] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-25T18:23:09.014142] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-25T18:23:09.756693] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T18:23:09.761902] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-25T18:23:10.202874] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T18:23:10.210117] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-25T18:23:10.511341] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T18:23:10.532886] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-25T18:23:10.760843] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:23:10.772828] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-25T18:23:11.188008] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T18:23:11.194850] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-25T18:23:11.327443] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T18:23:11.335580] [INFO ] [REMOTE ] DLB: Full fetch complete (46889 records). [2025-09-25T18:23:11.335740] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-25T18:23:11.726022] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-25T18:23:11.726119] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-25T18:23:11.726829] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-25T18:23:11.726909] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-25T18:23:11.728711] [DEBUG] [LOCAL ] DLB: Trimmed 46889 records to 32368 (keeping 200 days of data) [2025-09-25T18:23:11.941107] [DEBUG] [LOCAL ] DLB: Primary data saved (32368 records). [2025-09-25T18:23:11.941248] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-25T18:23:11.941385] [INFO ] [MAIN ] Update Progress: 628/2372 symbols completed. DLB took 39.1s. Estimated remaining: 3h 50m 55s. Rate: 7.6 symbols/min [2025-09-25T18:23:12.123979] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:12.144215] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T18:23:12.151917] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-25T18:23:12.187766] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T18:23:12.203786] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-25T18:23:12.216178] [DEBUG] [LOCAL ] DLY: Loaded 19433 existing records from primary storage. [2025-09-25T18:23:12.216326] [INFO ] [MAIN ] DLY: Loaded 19433 existing records. [2025-09-25T18:23:12.421142] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:12.421853] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-25T18:23:12.422070] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-25T18:23:12.422316] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-25T18:23:12.422374] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-25T18:23:12.799114] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-25T18:23:12.819293] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:12.828075] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-25T18:23:12.829597] [INFO ] [REMOTE ] DKS: Full fetch complete (71259 records). [2025-09-25T18:23:12.829713] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-25T18:23:12.830549] [FATAL] [VALIDATOR ] DKS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:23:12.830664] [FATAL] [MAIN ] DKS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:23:12.830747] [WARN ] [MAIN ] DKS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:23:12.830825] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-25T18:23:12.830890] [DEBUG] [LOCAL ] DKS: No primary data file found to delete. [2025-09-25T18:23:12.830940] [INFO ] [LOCAL ] DKS: Starting deletion of derivative data. [2025-09-25T18:23:12.831245] [DEBUG] [LOCAL ] DKS: Deleted derivative data file. [2025-09-25T18:23:12.831397] [INFO ] [MAIN ] Update Progress: 629/2372 symbols completed. DKS took 45.8s. Estimated remaining: 3h 50m 27s. Rate: 7.6 symbols/min [2025-09-25T18:23:13.012160] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:13.021102] [DEBUG] [LOCAL ] DMA: Loaded 4525 existing records from primary storage. [2025-09-25T18:23:13.021231] [INFO ] [MAIN ] DMA: Loaded 4525 existing records. [2025-09-25T18:23:13.259874] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:13.260459] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-25T18:23:13.260722] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-25T18:23:13.261045] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-25T18:23:13.261119] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-25T18:23:13.413067] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T18:23:13.456174] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-25T18:23:13.678676] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:13.678990] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-25T18:23:13.752615] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T18:23:13.758098] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-25T18:23:14.003936] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T18:23:14.015344] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-25T18:23:14.064816] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-25T18:23:14.066348] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-25T18:23:14.370588] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T18:23:14.377621] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-25T18:23:14.506639] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T18:23:14.508258] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-25T18:23:14.736320] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T18:23:14.740738] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-25T18:23:15.016635] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T18:23:15.018394] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-25T18:23:15.412687] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T18:23:15.422957] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T18:23:15.425216] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-25T18:23:15.607405] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T18:23:15.700015] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T18:23:15.888766] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-25T18:23:16.688687] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-25T18:23:16.919925] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T18:23:16.938949] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T18:23:17.488733] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-25T18:23:18.288683] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-25T18:23:18.600261] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T18:23:18.731811] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T18:23:18.750980] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T18:23:19.088730] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-25T18:23:19.854701] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T18:23:19.888839] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-25T18:23:20.688743] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-25T18:23:21.419005] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T18:23:21.425506] [INFO ] [REMOTE ] DLX: Full fetch complete (41275 records). [2025-09-25T18:23:21.425813] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-25T18:23:21.504560] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T18:23:21.497694] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-25T18:23:21.844078] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-25T18:23:21.844163] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-25T18:23:21.844768] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-25T18:23:21.844830] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-25T18:23:21.846569] [DEBUG] [LOCAL ] DLX: Trimmed 41275 records to 29145 (keeping 200 days of data) [2025-09-25T18:23:22.038147] [DEBUG] [LOCAL ] DLX: Primary data saved (29145 records). [2025-09-25T18:23:22.038294] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-25T18:23:22.038382] [INFO ] [MAIN ] Update Progress: 630/2372 symbols completed. DLX took 15.8s. Estimated remaining: 3h 50m 23s. Rate: 7.6 symbols/min [2025-09-25T18:23:22.210199] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:22.227745] [DEBUG] [LOCAL ] DMB: Loaded 10136 existing records from primary storage. [2025-09-25T18:23:22.227974] [INFO ] [MAIN ] DMB: Loaded 10136 existing records. [2025-09-25T18:23:22.293482] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-25T18:23:22.420541] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:22.431297] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T18:23:22.430936] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-25T18:23:22.431533] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-25T18:23:22.435784] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-25T18:23:22.435864] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-25T18:23:22.799014] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:23.088716] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-25T18:23:23.888719] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-25T18:23:24.064163] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T18:23:24.108841] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T18:23:24.559951] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T18:23:24.688794] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-25T18:23:25.488728] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-25T18:23:25.729153] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:23:26.288717] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-25T18:23:27.088693] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-25T18:23:27.237773] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:23:27.248783] [INFO ] [REMOTE ] DLR: Full fetch complete (74210 records). [2025-09-25T18:23:27.248938] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-25T18:23:27.398396] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T18:23:27.524137] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T18:23:27.703214] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-25T18:23:27.703306] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-25T18:23:27.704157] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-25T18:23:27.704224] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-25T18:23:27.705717] [DEBUG] [LOCAL ] DLR: Trimmed 74210 records to 51508 (keeping 200 days of data) [2025-09-25T18:23:27.901344] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-25T18:23:28.054067] [DEBUG] [LOCAL ] DLR: Primary data saved (51508 records). [2025-09-25T18:23:28.054214] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-25T18:23:28.055460] [INFO ] [MAIN ] Update Progress: 631/2372 symbols completed. DLR took 45.3s. Estimated remaining: 3h 50m 9s. Rate: 7.6 symbols/min [2025-09-25T18:23:28.236746] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:28.254340] [DEBUG] [LOCAL ] DMO: Loaded 9841 existing records from primary storage. [2025-09-25T18:23:28.254488] [INFO ] [MAIN ] DMO: Loaded 9841 existing records. [2025-09-25T18:23:28.435823] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:28.436095] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-25T18:23:28.436155] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-25T18:23:28.436384] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-25T18:23:28.436441] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-25T18:23:28.693901] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-25T18:23:28.811923] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:28.867615] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T18:23:28.872355] [INFO ] [REMOTE ] DLY: Full fetch complete (28141 records). [2025-09-25T18:23:28.872434] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-25T18:23:29.247537] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-25T18:23:29.247702] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-25T18:23:29.248188] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-25T18:23:29.248232] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-25T18:23:29.249019] [DEBUG] [LOCAL ] DLY: Trimmed 28141 records to 19619 (keeping 200 days of data) [2025-09-25T18:23:29.369094] [DEBUG] [LOCAL ] DLY: Primary data saved (19619 records). [2025-09-25T18:23:29.369240] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-25T18:23:29.369328] [INFO ] [MAIN ] Update Progress: 632/2372 symbols completed. DLY took 17.4s. Estimated remaining: 3h 49m 43s. Rate: 7.6 symbols/min [2025-09-25T18:23:29.493797] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-25T18:23:29.546165] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:29.546512] [DEBUG] [LOCAL ] DNA: No existing data file found in primary storage. [2025-09-25T18:23:29.546570] [WARN ] [MAIN ] DNA: No existing data found, performing full refresh instead. [2025-09-25T18:23:29.546879] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-25T18:23:29.546932] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-25T18:23:29.546977] [DEBUG] [LOCAL ] DNA: No primary data file found to delete. [2025-09-25T18:23:29.547012] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-25T18:23:29.661420] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:23:29.930786] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:30.288680] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-25T18:23:30.475824] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T18:23:30.695760] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-25T18:23:31.088723] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-25T18:23:31.885723] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T18:23:31.889063] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-25T18:23:32.649922] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T18:23:32.688676] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-25T18:23:33.284262] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T18:23:33.285997] [INFO ] [REMOTE ] DMA: Full fetch complete (6589 records). [2025-09-25T18:23:33.286069] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-25T18:23:33.493788] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-25T18:23:33.666290] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-25T18:23:33.666372] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-25T18:23:33.666547] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-25T18:23:33.666585] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-25T18:23:33.667005] [DEBUG] [LOCAL ] DMA: Trimmed 6589 records to 4570 (keeping 200 days of data) [2025-09-25T18:23:33.695134] [DEBUG] [LOCAL ] DMA: Primary data saved (4570 records). [2025-09-25T18:23:33.695247] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-25T18:23:33.695372] [INFO ] [MAIN ] Update Progress: 633/2372 symbols completed. DMA took 20.9s. Estimated remaining: 3h 49m 25s. Rate: 7.6 symbols/min [2025-09-25T18:23:33.869922] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:33.926308] [DEBUG] [LOCAL ] DNOW: Loaded 43493 existing records from primary storage. [2025-09-25T18:23:33.926457] [INFO ] [MAIN ] DNOW: Loaded 43493 existing records. [2025-09-25T18:23:34.105696] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:34.109615] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-25T18:23:34.109805] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-25T18:23:34.110120] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-25T18:23:34.110202] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-25T18:23:34.296331] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-25T18:23:34.487593] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:35.014358] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T18:23:35.088701] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-25T18:23:35.194155] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T18:23:35.888712] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-25T18:23:36.420729] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T18:23:36.517431] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T18:23:36.688710] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-25T18:23:37.488722] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-25T18:23:38.236712] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T18:23:38.288728] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-25T18:23:39.088688] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-25T18:23:39.125542] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T18:23:39.147272] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T18:23:39.841711] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T18:23:39.888728] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-25T18:23:40.688767] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-25T18:23:41.316781] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T18:23:41.450143] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T18:23:41.488669] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-25T18:23:42.234130] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T18:23:42.288698] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-25T18:23:42.996874] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T18:23:43.088712] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-25T18:23:43.888735] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-25T18:23:44.688705] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-25T18:23:44.812030] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:23:44.853165] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T18:23:45.488716] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-25T18:23:46.205087] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T18:23:46.233400] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:23:46.288666] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-25T18:23:47.088719] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-25T18:23:47.795219] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T18:23:47.888757] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-25T18:23:48.628672] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:23:48.677695] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T18:23:48.688670] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-25T18:23:49.146925] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T18:23:49.488752] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-25T18:23:50.288771] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-25T18:23:51.088740] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-25T18:23:51.133708] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T18:23:51.195631] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T18:23:51.779039] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:23:51.782599] [INFO ] [REMOTE ] DMB: Full fetch complete (15076 records). [2025-09-25T18:23:51.782701] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-25T18:23:51.893873] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-25T18:23:52.160305] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-25T18:23:52.160385] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-25T18:23:52.160733] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-25T18:23:52.160794] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-25T18:23:52.161363] [DEBUG] [LOCAL ] DMB: Trimmed 15076 records to 10216 (keeping 200 days of data) [2025-09-25T18:23:52.223484] [DEBUG] [LOCAL ] DMB: Primary data saved (10216 records). [2025-09-25T18:23:52.223606] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-25T18:23:52.223715] [INFO ] [MAIN ] Update Progress: 634/2372 symbols completed. DMB took 30.2s. Estimated remaining: 3h 49m 47s. Rate: 7.6 symbols/min [2025-09-25T18:23:52.395198] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:23:52.440793] [DEBUG] [LOCAL ] DNP: Loaded 33331 existing records from primary storage. [2025-09-25T18:23:52.440967] [INFO ] [MAIN ] DNP: Loaded 33331 existing records. [2025-09-25T18:23:52.638311] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:23:52.638716] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-25T18:23:52.638794] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-25T18:23:52.639050] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-25T18:23:52.639109] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-25T18:23:52.694209] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-25T18:23:53.005139] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:23:53.264959] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T18:23:53.496545] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-25T18:23:53.513342] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:23:54.288742] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-25T18:23:54.597721] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T18:23:55.088725] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-25T18:23:55.379415] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T18:23:55.888755] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-25T18:23:56.688739] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-25T18:23:56.818080] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T18:23:56.817827] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:23:57.488720] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-25T18:23:58.163024] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:23:58.288710] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-25T18:23:59.093828] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-25T18:23:59.111275] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T18:23:59.724024] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T18:23:59.888690] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-25T18:23:59.969593] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T18:23:59.972024] [INFO ] [REMOTE ] DMO: Full fetch complete (14595 records). [2025-09-25T18:23:59.972104] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-25T18:24:00.341795] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-25T18:24:00.341895] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-25T18:24:00.342216] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-25T18:24:00.342254] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-25T18:24:00.342802] [DEBUG] [LOCAL ] DMO: Trimmed 14595 records to 9919 (keeping 200 days of data) [2025-09-25T18:24:00.408052] [DEBUG] [LOCAL ] DMO: Primary data saved (9919 records). [2025-09-25T18:24:00.408191] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-25T18:24:00.408291] [INFO ] [MAIN ] Update Progress: 635/2372 symbols completed. DMO took 32.4s. Estimated remaining: 3h 49m 39s. Rate: 7.6 symbols/min [2025-09-25T18:24:00.579028] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:00.579216] [DEBUG] [LOCAL ] DOC: No existing data file found in primary storage. [2025-09-25T18:24:00.579252] [WARN ] [MAIN ] DOC: No existing data found, performing full refresh instead. [2025-09-25T18:24:00.579413] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-25T18:24:00.579455] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-25T18:24:00.579495] [DEBUG] [LOCAL ] DOC: No primary data file found to delete. [2025-09-25T18:24:00.579526] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-25T18:24:00.693793] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-25T18:24:00.946477] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:01.005004] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T18:24:01.488726] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-25T18:24:02.136935] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T18:24:02.288714] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-25T18:24:02.912403] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:24:03.088731] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-25T18:24:03.888704] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-25T18:24:03.912255] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:24:03.920253] [INFO ] [REMOTE ] DNOW: Full fetch complete (62524 records). [2025-09-25T18:24:03.920357] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-25T18:24:04.323760] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-25T18:24:04.323885] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-25T18:24:04.324666] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-25T18:24:04.324742] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-25T18:24:04.326066] [DEBUG] [LOCAL ] DNOW: Trimmed 62524 records to 43851 (keeping 200 days of data) [2025-09-25T18:24:04.593717] [DEBUG] [LOCAL ] DNOW: Primary data saved (43851 records). [2025-09-25T18:24:04.593851] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-25T18:24:04.593937] [INFO ] [MAIN ] Update Progress: 636/2372 symbols completed. DNOW took 30.9s. Estimated remaining: 3h 49m 21s. Rate: 7.6 symbols/min [2025-09-25T18:24:04.699421] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-25T18:24:04.794450] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:04.855494] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T18:24:04.885434] [DEBUG] [LOCAL ] DOCN: Loaded 50513 existing records from primary storage. [2025-09-25T18:24:04.885590] [INFO ] [MAIN ] DOCN: Loaded 50513 existing records. [2025-09-25T18:24:05.074079] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:05.074670] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-25T18:24:05.074826] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-25T18:24:05.075165] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-25T18:24:05.075234] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-25T18:24:05.152524] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T18:24:05.465674] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:05.488667] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-25T18:24:06.288777] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-25T18:24:06.442692] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T18:24:06.769962] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:24:07.088768] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-25T18:24:07.822556] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T18:24:07.888729] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-25T18:24:08.612890] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T18:24:08.688709] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-25T18:24:09.488762] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-25T18:24:09.771742] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:24:10.288687] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-25T18:24:10.444923] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T18:24:10.505971] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T18:24:11.088792] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-25T18:24:11.888690] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-25T18:24:12.236235] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T18:24:12.248788] [INFO ] [REMOTE ] DNA: Full fetch complete (70925 records). [2025-09-25T18:24:12.249025] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-25T18:24:12.689074] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-25T18:24:12.837140] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-25T18:24:12.837315] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-25T18:24:12.838421] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-25T18:24:12.838563] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-25T18:24:12.862857] [DEBUG] [LOCAL ] DNA: Trimmed 70925 records to 48681 (keeping 200 days of data) [2025-09-25T18:24:12.893152] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T18:24:13.343337] [DEBUG] [LOCAL ] DNA: Primary data saved (48681 records). [2025-09-25T18:24:13.343514] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-25T18:24:13.343626] [INFO ] [MAIN ] Update Progress: 637/2372 symbols completed. DNA took 44.0s. Estimated remaining: 3h 49m 16s. Rate: 7.6 symbols/min [2025-09-25T18:24:13.488778] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-25T18:24:14.144074] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-25T18:24:14.288682] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-25T18:24:14.544915] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T18:24:14.975136] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T18:24:15.088745] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-25T18:24:15.854490] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:24:15.888712] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-25T18:24:16.641394] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T18:24:16.688753] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-25T18:24:17.488739] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-25T18:24:17.813469] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T18:24:17.890291] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-25T18:24:18.288706] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-25T18:24:19.088718] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-25T18:24:19.325040] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:24:19.888685] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-25T18:24:20.129396] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:24:20.241970] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T18:24:20.688710] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-25T18:24:21.488721] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-25T18:24:21.671980] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T18:24:21.794007] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T18:24:22.288764] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-25T18:24:23.012060] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T18:24:23.088711] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-25T18:24:23.888762] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-25T18:24:23.975843] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T18:24:24.688732] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-25T18:24:24.913953] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T18:24:24.921546] [INFO ] [REMOTE ] DNP: Full fetch complete (49426 records). [2025-09-25T18:24:24.921733] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-25T18:24:25.297204] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T18:24:25.403251] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-25T18:24:25.403351] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-25T18:24:25.404112] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-25T18:24:25.404176] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-25T18:24:25.405251] [DEBUG] [LOCAL ] DNP: Trimmed 49426 records to 33558 (keeping 200 days of data) [2025-09-25T18:24:25.497524] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-25T18:24:25.614843] [DEBUG] [LOCAL ] DNP: Primary data saved (33558 records). [2025-09-25T18:24:25.614993] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-25T18:24:25.615083] [INFO ] [MAIN ] Update Progress: 638/2372 symbols completed. DNP took 33.4s. Estimated remaining: 3h 49m 19s. Rate: 7.6 symbols/min [2025-09-25T18:24:26.849386] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-25T18:24:26.859474] [INFO ] [REMOTE ] DOCN: Full fetch complete (71354 records). [2025-09-25T18:24:26.859614] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-25T18:24:27.288504] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-25T18:24:27.288620] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-25T18:24:27.289700] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-25T18:24:27.289787] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-25T18:24:27.291444] [DEBUG] [LOCAL ] DOCN: Trimmed 71354 records to 50889 (keeping 200 days of data) [2025-09-25T18:24:27.603911] [DEBUG] [LOCAL ] DOCN: Primary data saved (50889 records). [2025-09-25T18:24:27.604049] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-25T18:24:27.604134] [INFO ] [MAIN ] Update Progress: 639/2372 symbols completed. DOCN took 23.0s. Estimated remaining: 3h 48m 55s. Rate: 7.6 symbols/min [2025-09-25T18:24:27.673106] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-25T18:24:27.683075] [INFO ] [REMOTE ] DOC: Full fetch complete (77376 records). [2025-09-25T18:24:27.683218] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-25T18:24:28.078891] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-25T18:24:28.078977] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-25T18:24:28.079871] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-25T18:24:28.079938] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-25T18:24:28.081450] [DEBUG] [LOCAL ] DOC: Trimmed 77376 records to 53927 (keeping 200 days of data) [2025-09-25T18:24:28.434569] [DEBUG] [LOCAL ] DOC: Primary data saved (53927 records). [2025-09-25T18:24:28.434744] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-25T18:24:28.434882] [INFO ] [MAIN ] Update Progress: 640/2372 symbols completed. DOC took 28.0s. Estimated remaining: 3h 48m 28s. Rate: 7.6 symbols/min [2025-09-25T18:24:29.199276] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:29.195481] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:29.177567] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:29.201433] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:29.271794] [DEBUG] [LOCAL ] DOUG: Loaded 34747 existing records from primary storage. [2025-09-25T18:24:29.272078] [INFO ] [MAIN ] DOUG: Loaded 34747 existing records. [2025-09-25T18:24:29.420580] [DEBUG] [LOCAL ] DOCS: Loaded 51247 existing records from primary storage. [2025-09-25T18:24:29.441670] [INFO ] [MAIN ] DOCS: Loaded 51247 existing records. [2025-09-25T18:24:29.435158] [DEBUG] [LOCAL ] DOLE: Loaded 37919 existing records from primary storage. [2025-09-25T18:24:29.462670] [INFO ] [MAIN ] DOLE: Loaded 37919 existing records. [2025-09-25T18:24:29.498896] [DEBUG] [LOCAL ] DOV: Loaded 45676 existing records from primary storage. [2025-09-25T18:24:29.514544] [INFO ] [MAIN ] DOV: Loaded 45676 existing records. [2025-09-25T18:24:29.788028] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:29.840005] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-25T18:24:29.855730] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-25T18:24:29.927051] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-25T18:24:29.937063] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-25T18:24:30.117768] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:30.219125] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:30.238297] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-25T18:24:30.247268] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-25T18:24:30.247509] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-25T18:24:30.247433] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-25T18:24:30.258181] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-25T18:24:30.247073] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:30.262407] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-25T18:24:30.262860] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-25T18:24:30.262993] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-25T18:24:30.392993] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-25T18:24:30.463323] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-25T18:24:30.514180] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-25T18:24:30.540443] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-25T18:24:31.456162] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:31.495119] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-25T18:24:31.474570] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:31.568754] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-25T18:24:31.734418] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:31.744957] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-25T18:24:31.767889] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:31.768502] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-25T18:24:32.959370] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T18:24:32.966515] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-25T18:24:33.022905] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:24:33.031368] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-25T18:24:33.345315] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T18:24:33.353928] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-25T18:24:33.499840] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T18:24:33.511142] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-25T18:24:33.928948] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T18:24:33.936617] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-25T18:24:34.001234] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:24:34.008929] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-25T18:24:34.862219] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T18:24:34.872562] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-25T18:24:34.932042] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T18:24:34.964298] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T18:24:35.088728] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-25T18:24:35.196382] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T18:24:35.888734] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-25T18:24:36.514238] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T18:24:36.623899] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T18:24:36.688686] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-25T18:24:36.990791] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T18:24:37.488717] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-25T18:24:38.146254] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T18:24:38.288728] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-25T18:24:39.088750] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-25T18:24:39.144890] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T18:24:39.612687] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:24:39.888709] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-25T18:24:40.121509] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T18:24:40.688727] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-25T18:24:41.271135] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:24:41.488700] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-25T18:24:42.253489] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T18:24:42.288678] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-25T18:24:42.624795] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T18:24:43.088715] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-25T18:24:43.888700] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-25T18:24:44.318815] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T18:24:44.524004] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T18:24:44.688772] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-25T18:24:45.420792] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T18:24:45.488709] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-25T18:24:46.024138] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T18:24:46.288722] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-25T18:24:46.707824] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T18:24:47.088716] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-25T18:24:47.893886] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-25T18:24:47.919862] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:24:48.688720] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-25T18:24:48.692111] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:24:48.930211] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:24:49.488752] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-25T18:24:49.719812] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T18:24:50.288730] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-25T18:24:50.852100] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T18:24:51.088750] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-25T18:24:51.839460] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T18:24:51.888666] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-25T18:24:52.688743] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-25T18:24:52.782155] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T18:24:53.488807] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-25T18:24:53.773196] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T18:24:53.782003] [INFO ] [REMOTE ] DOLE: Full fetch complete (53318 records). [2025-09-25T18:24:53.782195] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-25T18:24:54.242266] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-25T18:24:54.242437] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-25T18:24:54.243424] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-25T18:24:54.243747] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-25T18:24:54.268411] [DEBUG] [LOCAL ] DOLE: Trimmed 53318 records to 38240 (keeping 200 days of data) [2025-09-25T18:24:54.270217] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T18:24:54.336926] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-25T18:24:54.543545] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T18:24:54.555528] [DEBUG] [LOCAL ] DOLE: Primary data saved (38240 records). [2025-09-25T18:24:54.555719] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-25T18:24:54.555860] [INFO ] [MAIN ] Update Progress: 641/2372 symbols completed. DOLE took 26.1s. Estimated remaining: 3h 49m 10s. Rate: 7.6 symbols/min [2025-09-25T18:24:54.735187] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:54.801189] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-25T18:24:54.801440] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-09-25T18:24:54.980929] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:54.981213] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-25T18:24:54.981260] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-25T18:24:54.981975] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-25T18:24:54.982046] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-25T18:24:55.093888] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-25T18:24:55.352946] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:55.888775] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-25T18:24:56.118739] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T18:24:56.688711] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-25T18:24:56.716184] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:24:56.722394] [INFO ] [REMOTE ] DOUG: Full fetch complete (51560 records). [2025-09-25T18:24:56.722496] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-25T18:24:57.124834] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-25T18:24:57.124942] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-25T18:24:57.125662] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-25T18:24:57.125748] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-25T18:24:57.129740] [DEBUG] [LOCAL ] DOUG: Trimmed 51560 records to 35046 (keeping 200 days of data) [2025-09-25T18:24:57.335206] [DEBUG] [LOCAL ] DOUG: Primary data saved (35046 records). [2025-09-25T18:24:57.335337] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-25T18:24:57.335476] [INFO ] [MAIN ] Update Progress: 642/2372 symbols completed. DOUG took 28.9s. Estimated remaining: 3h 48m 48s. Rate: 7.6 symbols/min [2025-09-25T18:24:57.494484] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-25T18:24:57.516922] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:24:57.535616] [DEBUG] [LOCAL ] DPG: Loaded 13420 existing records from primary storage. [2025-09-25T18:24:57.535768] [INFO ] [MAIN ] DPG: Loaded 13420 existing records. [2025-09-25T18:24:57.726957] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:24:57.727318] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-25T18:24:57.727667] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-25T18:24:57.727943] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-25T18:24:57.728002] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-25T18:24:58.103263] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:24:58.138972] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-25T18:24:58.181752] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T18:24:58.288684] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-25T18:24:59.088698] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-25T18:24:59.463461] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T18:24:59.477224] [INFO ] [REMOTE ] DOCS: Full fetch complete (74204 records). [2025-09-25T18:24:59.477361] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-25T18:24:59.661394] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T18:24:59.892555] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-25T18:24:59.917565] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-25T18:24:59.917784] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-25T18:24:59.918998] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-25T18:24:59.919166] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-25T18:24:59.921261] [DEBUG] [LOCAL ] DOCS: Trimmed 74204 records to 51598 (keeping 200 days of data) [2025-09-25T18:25:00.291808] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T18:25:00.321012] [DEBUG] [LOCAL ] DOCS: Primary data saved (51598 records). [2025-09-25T18:25:00.321175] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-25T18:25:00.321303] [INFO ] [MAIN ] Update Progress: 643/2372 symbols completed. DOCS took 31.9s. Estimated remaining: 3h 48m 26s. Rate: 7.6 symbols/min [2025-09-25T18:25:00.498150] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:00.543949] [DEBUG] [LOCAL ] DQ: Loaded 43139 existing records from primary storage. [2025-09-25T18:25:00.544098] [INFO ] [MAIN ] DQ: Loaded 43139 existing records. [2025-09-25T18:25:00.691292] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-25T18:25:00.729068] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:00.729310] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-25T18:25:00.729357] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-25T18:25:00.729586] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-25T18:25:00.729680] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-25T18:25:01.096587] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:01.488795] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-25T18:25:01.816192] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T18:25:01.826939] [INFO ] [REMOTE ] DOV: Full fetch complete (65070 records). [2025-09-25T18:25:01.827124] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-25T18:25:02.303029] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-25T18:25:02.329781] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-25T18:25:02.329882] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-25T18:25:02.330903] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-25T18:25:02.330984] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-25T18:25:02.334022] [DEBUG] [LOCAL ] DOV: Trimmed 65070 records to 46044 (keeping 200 days of data) [2025-09-25T18:25:02.732824] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-25T18:25:02.751145] [DEBUG] [LOCAL ] DOV: Primary data saved (46044 records). [2025-09-25T18:25:02.751325] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-25T18:25:02.752259] [INFO ] [MAIN ] Update Progress: 644/2372 symbols completed. DOV took 34.3s. Estimated remaining: 3h 48m 4s. Rate: 7.6 symbols/min [2025-09-25T18:25:02.938177] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:02.982094] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:25:03.038971] [DEBUG] [LOCAL ] DRD: Loaded 36744 existing records from primary storage. [2025-09-25T18:25:03.039134] [INFO ] [MAIN ] DRD: Loaded 36744 existing records. [2025-09-25T18:25:03.093834] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-25T18:25:03.240929] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:03.241173] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-25T18:25:03.241227] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-25T18:25:03.241493] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-25T18:25:03.241552] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-25T18:25:03.734083] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:03.744252] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T18:25:03.888716] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-25T18:25:04.279566] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T18:25:04.380958] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:25:04.688793] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-25T18:25:05.488921] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-25T18:25:06.288688] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-25T18:25:06.587159] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T18:25:06.649406] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:25:07.088678] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-25T18:25:07.381844] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T18:25:07.657342] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T18:25:07.888722] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-25T18:25:08.688776] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-25T18:25:09.422016] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T18:25:09.488735] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-25T18:25:10.288727] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-25T18:25:10.774255] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T18:25:10.820455] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-25T18:25:11.088758] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-25T18:25:11.280827] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T18:25:11.888736] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-25T18:25:12.231512] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T18:25:12.688739] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-25T18:25:12.810231] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T18:25:13.488783] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-25T18:25:13.839437] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T18:25:14.288758] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-25T18:25:14.759199] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T18:25:15.088729] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-25T18:25:15.888795] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-25T18:25:16.456706] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-25T18:25:16.503459] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:25:16.688695] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-25T18:25:16.793338] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T18:25:17.488748] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-25T18:25:18.288718] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-25T18:25:18.673122] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-25T18:25:18.958683] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T18:25:19.088685] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-25T18:25:19.682564] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T18:25:19.888721] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-25T18:25:20.636492] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:25:20.688719] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-25T18:25:21.488730] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-25T18:25:21.727954] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:25:21.942059] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T18:25:22.065301] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-25T18:25:22.288748] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-25T18:25:23.088718] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-25T18:25:23.888729] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-25T18:25:24.088913] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T18:25:24.338692] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T18:25:24.688773] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-25T18:25:25.488707] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-25T18:25:25.611714] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T18:25:26.068548] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T18:25:26.288718] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-25T18:25:26.943600] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-25T18:25:26.953862] [INFO ] [REMOTE ] DOW: Full fetch complete (77791 records). [2025-09-25T18:25:26.954077] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-25T18:25:27.105569] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-25T18:25:27.371681] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-25T18:25:27.371782] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-25T18:25:27.372622] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-25T18:25:27.372701] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-25T18:25:27.374245] [DEBUG] [LOCAL ] DOW: Trimmed 77791 records to 54123 (keeping 200 days of data) [2025-09-25T18:25:27.745807] [DEBUG] [LOCAL ] DOW: Primary data saved (54123 records). [2025-09-25T18:25:27.746058] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-25T18:25:27.746925] [INFO ] [MAIN ] Update Progress: 645/2372 symbols completed. DOW took 33.2s. Estimated remaining: 3h 48m 42s. Rate: 7.6 symbols/min [2025-09-25T18:25:27.852840] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T18:25:27.893818] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-25T18:25:27.957343] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:28.009661] [DEBUG] [LOCAL ] DRH: Loaded 50463 existing records from primary storage. [2025-09-25T18:25:28.009812] [INFO ] [MAIN ] DRH: Loaded 50463 existing records. [2025-09-25T18:25:28.190918] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:28.191211] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-25T18:25:28.191272] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-25T18:25:28.191532] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-25T18:25:28.191601] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-25T18:25:28.321695] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T18:25:28.365132] [INFO ] [REMOTE ] DPG: Full fetch complete (18927 records). [2025-09-25T18:25:28.374939] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-25T18:25:28.394752] [FATAL] [VALIDATOR ] DPG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:25:28.430237] [FATAL] [MAIN ] DPG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:25:28.463058] [WARN ] [MAIN ] DPG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:25:28.474570] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-25T18:25:28.490894] [DEBUG] [LOCAL ] DPG: No primary data file found to delete. [2025-09-25T18:25:28.501594] [INFO ] [LOCAL ] DPG: Starting deletion of derivative data. [2025-09-25T18:25:28.517954] [DEBUG] [LOCAL ] DPG: Deleted derivative data file. [2025-09-25T18:25:28.518145] [INFO ] [MAIN ] Update Progress: 646/2372 symbols completed. DPG took 31.2s. Estimated remaining: 3h 48m 14s. Rate: 7.6 symbols/min [2025-09-25T18:25:28.691612] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-25T18:25:28.691531] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:28.765320] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:28.817949] [DEBUG] [LOCAL ] DRI: Loaded 47861 existing records from primary storage. [2025-09-25T18:25:28.818097] [INFO ] [MAIN ] DRI: Loaded 47861 existing records. [2025-09-25T18:25:28.996227] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:28.996490] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-25T18:25:28.996563] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-25T18:25:28.996826] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-25T18:25:28.996889] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-25T18:25:29.373436] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:29.436794] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T18:25:29.488668] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-25T18:25:30.288789] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-25T18:25:30.646895] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:25:30.656039] [INFO ] [REMOTE ] DQ: Full fetch complete (62988 records). [2025-09-25T18:25:30.656191] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-25T18:25:31.081774] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-25T18:25:31.081877] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-25T18:25:31.082736] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-25T18:25:31.082817] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-25T18:25:31.084230] [DEBUG] [LOCAL ] DQ: Trimmed 62988 records to 43526 (keeping 200 days of data) [2025-09-25T18:25:31.088747] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-25T18:25:31.369571] [DEBUG] [LOCAL ] DQ: Primary data saved (43526 records). [2025-09-25T18:25:31.369730] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-25T18:25:31.369821] [INFO ] [MAIN ] Update Progress: 647/2372 symbols completed. DQ took 31.0s. Estimated remaining: 3h 47m 53s. Rate: 7.6 symbols/min [2025-09-25T18:25:31.574091] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:31.602322] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-25T18:25:31.619499] [DEBUG] [LOCAL ] DRLL: Loaded 9645 existing records from primary storage. [2025-09-25T18:25:31.619601] [INFO ] [MAIN ] DRLL: Loaded 9645 existing records. [2025-09-25T18:25:31.813324] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:31.813714] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-25T18:25:31.813787] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-25T18:25:31.814021] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-25T18:25:31.814079] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-25T18:25:31.894887] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-25T18:25:32.194473] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:32.222510] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T18:25:32.630695] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T18:25:32.639404] [INFO ] [REMOTE ] DRD: Full fetch complete (48872 records). [2025-09-25T18:25:32.639508] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-25T18:25:32.640210] [FATAL] [VALIDATOR ] DRD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:25:32.640294] [FATAL] [MAIN ] DRD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:25:32.640336] [WARN ] [MAIN ] DRD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:25:32.640399] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-25T18:25:32.640463] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-25T18:25:32.640499] [INFO ] [LOCAL ] DRD: Starting deletion of derivative data. [2025-09-25T18:25:32.640831] [DEBUG] [LOCAL ] DRD: Deleted derivative data file. [2025-09-25T18:25:32.640957] [INFO ] [MAIN ] Update Progress: 648/2372 symbols completed. DRD took 29.9s. Estimated remaining: 3h 47m 27s. Rate: 7.6 symbols/min [2025-09-25T18:25:32.695815] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-25T18:25:32.814519] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:32.853144] [DEBUG] [LOCAL ] DSL: Loaded 28220 existing records from primary storage. [2025-09-25T18:25:32.853324] [INFO ] [MAIN ] DSL: Loaded 28220 existing records. [2025-09-25T18:25:33.036768] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:33.037062] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-25T18:25:33.037119] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-25T18:25:33.037351] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-25T18:25:33.037410] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-25T18:25:33.410245] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:33.478004] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T18:25:33.488673] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-25T18:25:33.951606] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T18:25:34.288734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-25T18:25:35.088788] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-25T18:25:35.133156] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T18:25:35.699350] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:25:35.888703] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-25T18:25:36.443172] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T18:25:36.688693] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-25T18:25:37.100953] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T18:25:37.438668] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T18:25:37.488728] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-25T18:25:38.288730] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-25T18:25:39.028584] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:25:39.088693] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-25T18:25:39.608501] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:25:39.888713] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-25T18:25:40.689520] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T18:25:40.689737] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-25T18:25:41.280550] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T18:25:41.488725] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-25T18:25:42.288737] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-25T18:25:42.675466] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T18:25:42.923349] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T18:25:43.072729] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:25:43.088663] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-25T18:25:43.888734] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-25T18:25:44.619636] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T18:25:44.688776] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-25T18:25:45.401966] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T18:25:45.488735] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-25T18:25:45.704031] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T18:25:46.288735] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-25T18:25:46.929262] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T18:25:46.985308] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T18:25:47.088831] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-25T18:25:47.888773] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-25T18:25:48.688734] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-25T18:25:48.775711] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T18:25:49.488693] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-25T18:25:49.515047] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:25:49.610065] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T18:25:50.288695] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-25T18:25:50.395347] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T18:25:51.088761] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-25T18:25:51.251995] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:25:51.888725] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-25T18:25:52.688757] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-25T18:25:52.786909] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:25:52.816534] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T18:25:53.488753] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-25T18:25:54.288696] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-25T18:25:54.486873] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T18:25:55.088767] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-25T18:25:55.300817] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T18:25:55.311541] [INFO ] [REMOTE ] DRH: Full fetch complete (71821 records). [2025-09-25T18:25:55.311837] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-25T18:25:55.703889] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T18:25:55.761677] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-25T18:25:55.762321] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-25T18:25:55.763481] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-25T18:25:55.763980] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-25T18:25:55.772183] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T18:25:55.775848] [DEBUG] [LOCAL ] DRH: Trimmed 71821 records to 50835 (keeping 200 days of data) [2025-09-25T18:25:55.888913] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-25T18:25:56.092909] [DEBUG] [LOCAL ] DRH: Primary data saved (50835 records). [2025-09-25T18:25:56.093060] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-25T18:25:56.093149] [INFO ] [MAIN ] Update Progress: 649/2372 symbols completed. DRH took 28.3s. Estimated remaining: 3h 48m 1s. Rate: 7.6 symbols/min [2025-09-25T18:25:56.269288] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:25:56.286965] [DEBUG] [LOCAL ] DSM: Loaded 15676 existing records from primary storage. [2025-09-25T18:25:56.287088] [INFO ] [MAIN ] DSM: Loaded 15676 existing records. [2025-09-25T18:25:56.476393] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:25:56.476970] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-25T18:25:56.477028] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-25T18:25:56.477307] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-25T18:25:56.477367] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-25T18:25:56.693923] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-25T18:25:56.845030] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:25:57.139894] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T18:25:57.488790] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-25T18:25:58.052881] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:25:58.288785] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-25T18:25:58.545538] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T18:25:59.088754] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-25T18:25:59.748172] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T18:25:59.754767] [INFO ] [REMOTE ] DSL: Full fetch complete (41347 records). [2025-09-25T18:25:59.754888] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-25T18:25:59.903007] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-25T18:26:00.191174] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-25T18:26:00.192204] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-25T18:26:00.192106] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T18:26:00.192876] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-25T18:26:00.199937] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-25T18:26:00.201408] [DEBUG] [LOCAL ] DSL: Trimmed 41347 records to 28428 (keeping 200 days of data) [2025-09-25T18:26:00.373804] [DEBUG] [LOCAL ] DSL: Primary data saved (28428 records). [2025-09-25T18:26:00.373937] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-25T18:26:00.374045] [INFO ] [MAIN ] Update Progress: 650/2372 symbols completed. DSL took 27.7s. Estimated remaining: 3h 47m 43s. Rate: 7.6 symbols/min [2025-09-25T18:26:00.548293] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:00.553050] [DEBUG] [LOCAL ] DSMC: Loaded 1947 existing records from primary storage. [2025-09-25T18:26:00.553136] [INFO ] [MAIN ] DSMC: Loaded 1947 existing records. [2025-09-25T18:26:00.690719] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-25T18:26:00.691838] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T18:26:00.751448] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:26:00.752488] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-25T18:26:00.752950] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-25T18:26:00.753159] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-25T18:26:00.753219] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-25T18:26:01.120091] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:01.488768] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-25T18:26:01.890669] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T18:26:02.288800] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-25T18:26:02.465731] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T18:26:03.039061] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T18:26:03.088795] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-25T18:26:03.888768] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-25T18:26:04.025904] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T18:26:04.028882] [INFO ] [REMOTE ] DRLL: Full fetch complete (15854 records). [2025-09-25T18:26:04.029036] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-25T18:26:04.379218] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T18:26:04.449264] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-25T18:26:04.449384] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-25T18:26:04.450064] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-25T18:26:04.450129] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-25T18:26:04.450829] [DEBUG] [LOCAL ] DRLL: Trimmed 15854 records to 9694 (keeping 200 days of data) [2025-09-25T18:26:04.518959] [DEBUG] [LOCAL ] DRLL: Primary data saved (9694 records). [2025-09-25T18:26:04.519175] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-25T18:26:04.519314] [INFO ] [MAIN ] Update Progress: 651/2372 symbols completed. DRLL took 33.1s. Estimated remaining: 3h 47m 25s. Rate: 7.6 symbols/min [2025-09-25T18:26:04.694050] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-25T18:26:04.708429] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:04.736510] [DEBUG] [LOCAL ] DSU: Loaded 22116 existing records from primary storage. [2025-09-25T18:26:04.736748] [INFO ] [MAIN ] DSU: Loaded 22116 existing records. [2025-09-25T18:26:04.931452] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:26:04.931879] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-25T18:26:04.931934] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-25T18:26:04.932256] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-25T18:26:04.932316] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-25T18:26:05.344516] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:05.488730] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-25T18:26:05.631515] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T18:26:06.288757] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-25T18:26:07.088731] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-25T18:26:07.517433] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T18:26:07.528524] [INFO ] [REMOTE ] DRI: Full fetch complete (69608 records). [2025-09-25T18:26:07.528830] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-25T18:26:07.729918] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T18:26:07.894149] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-25T18:26:08.081040] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-25T18:26:08.081391] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-25T18:26:08.082497] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-25T18:26:08.082612] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-25T18:26:08.084904] [DEBUG] [LOCAL ] DRI: Trimmed 69608 records to 48216 (keeping 200 days of data) [2025-09-25T18:26:08.200778] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T18:26:08.448269] [DEBUG] [LOCAL ] DRI: Primary data saved (48216 records). [2025-09-25T18:26:08.448479] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-25T18:26:08.448590] [INFO ] [MAIN ] Update Progress: 652/2372 symbols completed. DRI took 39.9s. Estimated remaining: 3h 47m 7s. Rate: 7.6 symbols/min [2025-09-25T18:26:08.644863] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:08.673577] [DEBUG] [LOCAL ] DSX: Loaded 24351 existing records from primary storage. [2025-09-25T18:26:08.673818] [INFO ] [MAIN ] DSX: Loaded 24351 existing records. [2025-09-25T18:26:08.697621] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-25T18:26:08.893116] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:26:08.893548] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-25T18:26:08.893606] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-25T18:26:08.893890] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-25T18:26:08.893952] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-25T18:26:09.222791] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T18:26:09.223981] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T18:26:09.328316] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:09.488765] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-25T18:26:10.288721] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-25T18:26:10.317021] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:26:11.088766] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-25T18:26:11.570860] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:26:11.888702] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-25T18:26:12.169383] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T18:26:12.688734] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-25T18:26:12.822271] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T18:26:13.233846] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T18:26:13.488748] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-25T18:26:14.284944] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T18:26:14.288826] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-25T18:26:14.824921] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T18:26:15.088726] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-25T18:26:15.868108] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T18:26:15.888693] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-25T18:26:16.688743] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-25T18:26:16.794989] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T18:26:16.798157] [INFO ] [REMOTE ] DSM: Full fetch complete (24658 records). [2025-09-25T18:26:16.798239] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-25T18:26:16.798773] [FATAL] [VALIDATOR ] DSM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:26:16.798856] [FATAL] [MAIN ] DSM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:26:16.798900] [WARN ] [MAIN ] DSM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:26:16.798937] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-25T18:26:16.798997] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-09-25T18:26:16.799032] [INFO ] [LOCAL ] DSM: Starting deletion of derivative data. [2025-09-25T18:26:16.799498] [DEBUG] [LOCAL ] DSM: Deleted derivative data file. [2025-09-25T18:26:16.799593] [INFO ] [MAIN ] Update Progress: 653/2372 symbols completed. DSM took 20.7s. Estimated remaining: 3h 46m 60s. Rate: 7.6 symbols/min [2025-09-25T18:26:16.982321] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:17.038556] [DEBUG] [LOCAL ] DT: Loaded 52944 existing records from primary storage. [2025-09-25T18:26:17.038750] [INFO ] [MAIN ] DT: Loaded 52944 existing records. [2025-09-25T18:26:17.241037] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:26:17.241470] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-25T18:26:17.241523] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-25T18:26:17.241877] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-25T18:26:17.241939] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-25T18:26:17.493912] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-25T18:26:17.650217] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:18.218329] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T18:26:18.288745] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-25T18:26:18.322884] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T18:26:19.088703] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-25T18:26:19.463379] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T18:26:19.541728] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T18:26:19.888726] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-25T18:26:20.688718] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-25T18:26:21.468521] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T18:26:21.488669] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-25T18:26:21.762153] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T18:26:22.288753] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-25T18:26:22.444175] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T18:26:23.093784] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-25T18:26:23.097145] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:26:23.888745] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-25T18:26:24.381012] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T18:26:24.404340] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T18:26:24.688750] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-25T18:26:25.488738] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-25T18:26:25.901095] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-25T18:26:26.288781] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-25T18:26:26.512558] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T18:26:27.088803] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-25T18:26:27.222585] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T18:26:27.578213] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T18:26:27.888785] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-25T18:26:28.688747] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-25T18:26:28.889473] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T18:26:29.488734] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-25T18:26:29.973170] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:26:30.288722] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-25T18:26:31.060319] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T18:26:31.088673] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-25T18:26:31.640116] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T18:26:31.888714] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-25T18:26:32.688791] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-25T18:26:33.141165] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T18:26:33.488687] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-25T18:26:33.729580] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:26:34.288801] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-25T18:26:35.088840] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-25T18:26:35.518437] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-25T18:26:35.639018] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T18:26:35.695085] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-25T18:26:35.696371] [INFO ] [REMOTE ] DSMC: Full fetch complete (2878 records). [2025-09-25T18:26:35.696460] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-25T18:26:35.899088] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-25T18:26:36.081492] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-25T18:26:36.081580] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-25T18:26:36.081743] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-25T18:26:36.081827] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-25T18:26:36.096453] [DEBUG] [LOCAL ] DSMC: Trimmed 2878 records to 1956 (keeping 200 days of data) [2025-09-25T18:26:36.134697] [DEBUG] [LOCAL ] DSMC: Primary data saved (1956 records). [2025-09-25T18:26:36.134850] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-25T18:26:36.134563] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-25T18:26:36.146217] [INFO ] [MAIN ] Update Progress: 654/2372 symbols completed. DSMC took 35.8s. Estimated remaining: 3h 47m 22s. Rate: 7.6 symbols/min [2025-09-25T18:26:36.320516] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:36.320750] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-09-25T18:26:36.320797] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-09-25T18:26:36.320943] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-25T18:26:36.320984] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-25T18:26:36.321024] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-09-25T18:26:36.321057] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-25T18:26:36.677308] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:36.688664] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-25T18:26:37.176561] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T18:26:37.182078] [INFO ] [REMOTE ] DSU: Full fetch complete (32482 records). [2025-09-25T18:26:37.182202] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-25T18:26:37.488719] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-25T18:26:37.581799] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-25T18:26:37.581883] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-25T18:26:37.582413] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-25T18:26:37.582453] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-25T18:26:37.583368] [DEBUG] [LOCAL ] DSU: Trimmed 32482 records to 22429 (keeping 200 days of data) [2025-09-25T18:26:37.682483] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T18:26:37.741307] [DEBUG] [LOCAL ] DSU: Primary data saved (22429 records). [2025-09-25T18:26:37.741479] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-25T18:26:37.741586] [INFO ] [MAIN ] Update Progress: 655/2372 symbols completed. DSU took 33.2s. Estimated remaining: 3h 46m 57s. Rate: 7.6 symbols/min [2025-09-25T18:26:37.924202] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:37.924404] [DEBUG] [LOCAL ] DTE: No existing data file found in primary storage. [2025-09-25T18:26:37.924487] [WARN ] [MAIN ] DTE: No existing data found, performing full refresh instead. [2025-09-25T18:26:37.924638] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-25T18:26:37.924719] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-25T18:26:37.924766] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-25T18:26:37.924799] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-25T18:26:38.309944] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:38.302995] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-25T18:26:38.545906] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T18:26:39.088743] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-25T18:26:39.888691] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-25T18:26:39.994698] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T18:26:40.688690] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-25T18:26:40.864040] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:26:40.987078] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T18:26:40.994414] [INFO ] [REMOTE ] DSX: Full fetch complete (37074 records). [2025-09-25T18:26:40.994504] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-25T18:26:41.294541] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T18:26:41.384526] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-25T18:26:41.384603] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-25T18:26:41.385147] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-25T18:26:41.385209] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-25T18:26:41.386111] [DEBUG] [LOCAL ] DSX: Trimmed 37074 records to 24488 (keeping 200 days of data) [2025-09-25T18:26:41.489710] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-25T18:26:41.530335] [DEBUG] [LOCAL ] DSX: Primary data saved (24488 records). [2025-09-25T18:26:41.530456] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-25T18:26:41.530546] [INFO ] [MAIN ] Update Progress: 656/2372 symbols completed. DSX took 33.1s. Estimated remaining: 3h 46m 39s. Rate: 7.6 symbols/min [2025-09-25T18:26:41.702184] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:41.702361] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-25T18:26:41.702414] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-25T18:26:41.702581] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-25T18:26:41.702623] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-25T18:26:41.702701] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-25T18:26:41.702761] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-25T18:26:42.067900] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:42.288715] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-25T18:26:43.088715] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-25T18:26:43.275450] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T18:26:43.676631] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T18:26:43.887138] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T18:26:43.895837] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-25T18:26:44.270192] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-25T18:26:44.688749] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-25T18:26:45.090778] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-25T18:26:45.488735] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-25T18:26:46.050934] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:26:46.288732] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-25T18:26:47.088719] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-25T18:26:47.888712] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-25T18:26:48.170924] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T18:26:48.171466] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T18:26:48.688728] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-25T18:26:49.488745] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-25T18:26:49.776409] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T18:26:50.253885] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T18:26:50.288743] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-25T18:26:50.577762] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T18:26:50.718590] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T18:26:51.088745] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-25T18:26:51.709360] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T18:26:51.888708] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-25T18:26:52.501709] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T18:26:52.688708] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-25T18:26:53.480564] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T18:26:53.482404] [INFO ] [REMOTE ] DTB: Full fetch complete (6869 records). [2025-09-25T18:26:53.482482] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-25T18:26:53.493947] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-25T18:26:53.859391] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-25T18:26:53.859469] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-25T18:26:53.859680] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-25T18:26:53.859779] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-25T18:26:53.860238] [DEBUG] [LOCAL ] DTB: Trimmed 6869 records to 4784 (keeping 200 days of data) [2025-09-25T18:26:53.897833] [DEBUG] [LOCAL ] DTB: Primary data saved (4784 records). [2025-09-25T18:26:53.898227] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-25T18:26:53.898358] [INFO ] [MAIN ] Update Progress: 657/2372 symbols completed. DTB took 17.8s. Estimated remaining: 3h 46m 42s. Rate: 7.6 symbols/min [2025-09-25T18:26:54.078994] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:54.079462] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-09-25T18:26:54.079518] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-09-25T18:26:54.079731] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-25T18:26:54.079785] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-25T18:26:54.079834] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-25T18:26:54.079877] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-25T18:26:54.293841] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-25T18:26:54.447817] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:54.706436] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T18:26:55.088740] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-25T18:26:55.553917] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T18:26:55.888801] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-25T18:26:56.688709] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-25T18:26:56.838732] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T18:26:57.053690] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T18:26:57.065208] [INFO ] [REMOTE ] DT: Full fetch complete (76635 records). [2025-09-25T18:26:57.065384] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-25T18:26:57.476861] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-25T18:26:57.476974] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-25T18:26:57.477914] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-25T18:26:57.478025] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-25T18:26:57.483409] [DEBUG] [LOCAL ] DT: Trimmed 76635 records to 53323 (keeping 200 days of data) [2025-09-25T18:26:57.488786] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-25T18:26:57.813522] [DEBUG] [LOCAL ] DT: Primary data saved (53323 records). [2025-09-25T18:26:57.813700] [INFO ] [MAIN ] DT: Full history saved. [2025-09-25T18:26:57.815120] [INFO ] [MAIN ] Update Progress: 658/2372 symbols completed. DT took 41.0s. Estimated remaining: 3h 46m 24s. Rate: 7.6 symbols/min [2025-09-25T18:26:57.991835] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:26:57.991985] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-09-25T18:26:57.992023] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-09-25T18:26:57.992161] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-09-25T18:26:57.992203] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-25T18:26:57.992245] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-25T18:26:57.992277] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-09-25T18:26:58.278998] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T18:26:58.290328] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-25T18:26:58.376207] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:26:58.420316] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T18:26:58.913254] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T18:26:59.088727] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-25T18:26:59.773976] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T18:26:59.888727] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-25T18:27:00.359611] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T18:27:00.688723] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-25T18:27:01.184754] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-25T18:27:01.488720] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-25T18:27:01.872749] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T18:27:02.288734] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-25T18:27:03.088734] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-25T18:27:03.461076] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T18:27:03.888739] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-25T18:27:04.064515] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T18:27:04.249712] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-25T18:27:04.688778] [INFO ] [REMOTE ] DTK: Fetching primary data for 2024-12. [2025-09-25T18:27:04.909479] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:04.909823] [WARN ] [REMOTE ] DTK: No data returned for month 2024-12 [2025-09-25T18:27:05.488738] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-09-25T18:27:05.746445] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:05.746829] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-09-25T18:27:06.288739] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-25T18:27:07.088689] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-25T18:27:07.147973] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T18:27:07.531852] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-25T18:27:07.532714] [INFO ] [REMOTE ] DTF: Full fetch complete (2125 records). [2025-09-25T18:27:07.533322] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-25T18:27:07.534458] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:27:07.534548] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:27:07.534628] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:27:07.534728] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-25T18:27:07.534809] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-25T18:27:07.535087] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-25T18:27:07.535175] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-25T18:27:07.535294] [INFO ] [MAIN ] Update Progress: 659/2372 symbols completed. DTF took 26.0s. Estimated remaining: 3h 46m 21s. Rate: 7.6 symbols/min [2025-09-25T18:27:07.726621] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:07.791237] [DEBUG] [LOCAL ] DTM: Loaded 44408 existing records from primary storage. [2025-09-25T18:27:07.791439] [INFO ] [MAIN ] DTM: Loaded 44408 existing records. [2025-09-25T18:27:07.896195] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-25T18:27:07.986415] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:07.986726] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-25T18:27:07.986785] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-25T18:27:07.987124] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-25T18:27:07.987185] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-25T18:27:08.362003] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:08.541628] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T18:27:08.688738] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-25T18:27:09.488724] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-02. [2025-09-25T18:27:09.685427] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:09.685792] [WARN ] [REMOTE ] DTK: No data returned for month 2025-02 [2025-09-25T18:27:10.288767] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-03. [2025-09-25T18:27:10.341524] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T18:27:10.501335] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:10.501700] [WARN ] [REMOTE ] DTK: No data returned for month 2025-03 [2025-09-25T18:27:11.088718] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-04. [2025-09-25T18:27:11.291234] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:11.291542] [WARN ] [REMOTE ] DTK: No data returned for month 2025-04 [2025-09-25T18:27:11.888789] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-25T18:27:12.688721] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-05. [2025-09-25T18:27:12.889498] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:12.889889] [WARN ] [REMOTE ] DTK: No data returned for month 2025-05 [2025-09-25T18:27:13.443564] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T18:27:13.488704] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-25T18:27:14.288743] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-06. [2025-09-25T18:27:14.498361] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:14.498684] [WARN ] [REMOTE ] DTK: No data returned for month 2025-06 [2025-09-25T18:27:14.909424] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T18:27:15.088733] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-25T18:27:15.877991] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:27:15.888677] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-25T18:27:16.688783] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-25T18:27:17.479784] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T18:27:17.488699] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-25T18:27:17.771836] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T18:27:18.081479] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T18:27:18.288786] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-25T18:27:19.088769] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-25T18:27:19.777299] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T18:27:19.889526] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-25T18:27:19.892685] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:27:20.688730] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-25T18:27:21.411835] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T18:27:21.488711] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-25T18:27:22.257063] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T18:27:22.288669] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-25T18:27:23.088726] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-07. [2025-09-25T18:27:23.230284] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T18:27:23.323933] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:23.324240] [WARN ] [REMOTE ] DTK: No data returned for month 2025-07 [2025-09-25T18:27:23.888691] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-25T18:27:23.953074] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T18:27:24.688727] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-25T18:27:25.488687] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-25T18:27:25.611289] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T18:27:26.132224] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T18:27:26.251492] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T18:27:26.253508] [INFO ] [REMOTE ] DTG: Full fetch complete (9015 records). [2025-09-25T18:27:26.253602] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-25T18:27:26.293839] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-25T18:27:26.639923] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-25T18:27:26.640038] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-25T18:27:26.640299] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-25T18:27:26.640361] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-25T18:27:26.640915] [DEBUG] [LOCAL ] DTG: Trimmed 9015 records to 5918 (keeping 200 days of data) [2025-09-25T18:27:26.682258] [DEBUG] [LOCAL ] DTG: Primary data saved (5918 records). [2025-09-25T18:27:26.682401] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-25T18:27:26.682556] [INFO ] [MAIN ] Update Progress: 660/2372 symbols completed. DTG took 32.8s. Estimated remaining: 3h 46m 42s. Rate: 7.6 symbols/min [2025-09-25T18:27:26.860597] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:26.873661] [DEBUG] [LOCAL ] DTW: Loaded 4875 existing records from primary storage. [2025-09-25T18:27:26.873801] [INFO ] [MAIN ] DTW: Loaded 4875 existing records. [2025-09-25T18:27:27.055549] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:27.055889] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-25T18:27:27.055939] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-25T18:27:27.056154] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-25T18:27:27.056214] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-25T18:27:27.093843] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-08. [2025-09-25T18:27:27.374369] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:27:27.401325] [WARN ] [REMOTE ] DTK: No data returned for month 2025-08 [2025-09-25T18:27:27.440164] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:27.888735] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-25T18:27:28.031466] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T18:27:28.688715] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-09. [2025-09-25T18:27:28.772987] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T18:27:29.432777] [INFO ] [REMOTE ] DTK: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T18:27:29.434349] [INFO ] [REMOTE ] DTK: Full fetch complete (758 records). [2025-09-25T18:27:29.434422] [DEBUG] [VALIDATOR ] DTK: Validating primary data. [2025-09-25T18:27:29.499117] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-25T18:27:29.624550] [WARN ] [VALIDATOR ] DTK: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-25T18:27:29.624771] [FATAL] [MAIN ] DTK: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:27:29.624840] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:27:29.624911] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-09-25T18:27:29.624981] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-09-25T18:27:29.625018] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-09-25T18:27:29.625083] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-09-25T18:27:29.625168] [INFO ] [MAIN ] Update Progress: 661/2372 symbols completed. DTK took 31.8s. Estimated remaining: 3h 46m 21s. Rate: 7.6 symbols/min [2025-09-25T18:27:29.801234] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:29.871849] [DEBUG] [LOCAL ] DUK: Loaded 53459 existing records from primary storage. [2025-09-25T18:27:29.872016] [INFO ] [MAIN ] DUK: Loaded 53459 existing records. [2025-09-25T18:27:30.116001] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:30.116284] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-25T18:27:30.116427] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-25T18:27:30.117015] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-25T18:27:30.117079] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-25T18:27:30.233910] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T18:27:30.306527] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-25T18:27:30.494747] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:31.007683] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T18:27:31.088682] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-25T18:27:31.888761] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-25T18:27:32.688755] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-25T18:27:32.843926] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T18:27:32.852186] [INFO ] [REMOTE ] DTM: Full fetch complete (64766 records). [2025-09-25T18:27:32.852306] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-25T18:27:33.250304] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-25T18:27:33.251169] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-25T18:27:33.252012] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-25T18:27:33.252085] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-25T18:27:33.254287] [DEBUG] [LOCAL ] DTM: Trimmed 64766 records to 44667 (keeping 200 days of data) [2025-09-25T18:27:33.488710] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-25T18:27:33.554832] [DEBUG] [LOCAL ] DTM: Primary data saved (44667 records). [2025-09-25T18:27:33.554993] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-25T18:27:33.555082] [INFO ] [MAIN ] Update Progress: 662/2372 symbols completed. DTM took 26.0s. Estimated remaining: 3h 46m 3s. Rate: 7.6 symbols/min [2025-09-25T18:27:33.750928] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:33.760194] [DEBUG] [LOCAL ] DUKB: Loaded 6341 existing records from primary storage. [2025-09-25T18:27:33.760298] [INFO ] [MAIN ] DUKB: Loaded 6341 existing records. [2025-09-25T18:27:33.908077] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T18:27:34.014041] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:34.014706] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-25T18:27:34.014833] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-25T18:27:34.015006] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-25T18:27:34.015067] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-25T18:27:34.138179] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T18:27:34.293916] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-25T18:27:34.395699] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:34.656603] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T18:27:34.664702] [INFO ] [REMOTE ] DTE: Full fetch complete (68797 records). [2025-09-25T18:27:34.664825] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-25T18:27:34.665880] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:27:34.665990] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:27:34.666056] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:27:34.666118] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-25T18:27:34.666184] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-09-25T18:27:34.666219] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-09-25T18:27:34.666273] [DEBUG] [LOCAL ] DTE: No derivative data file found to delete. [2025-09-25T18:27:34.666353] [INFO ] [MAIN ] Update Progress: 663/2372 symbols completed. DTE took 56.9s. Estimated remaining: 3h 45m 37s. Rate: 7.6 symbols/min [2025-09-25T18:27:34.844635] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:34.911694] [DEBUG] [LOCAL ] DV: Loaded 51274 existing records from primary storage. [2025-09-25T18:27:34.911848] [INFO ] [MAIN ] DV: Loaded 51274 existing records. [2025-09-25T18:27:35.093847] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-25T18:27:35.098365] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:35.099366] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-25T18:27:35.099419] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-25T18:27:35.099703] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-25T18:27:35.099765] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-25T18:27:35.487930] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:35.888783] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-25T18:27:36.014367] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T18:27:36.154977] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T18:27:36.688721] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-25T18:27:37.161636] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T18:27:37.493837] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-25T18:27:37.511963] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T18:27:38.195495] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T18:27:38.288761] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-25T18:27:38.993586] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-25T18:27:39.088734] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-25T18:27:39.888800] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-25T18:27:40.475558] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T18:27:40.699559] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-25T18:27:40.702940] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T18:27:41.321044] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T18:27:41.488766] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-25T18:27:42.288728] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-25T18:27:43.088698] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-25T18:27:43.425759] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T18:27:43.628597] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T18:27:43.799222] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T18:27:43.888699] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-25T18:27:44.642927] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T18:27:44.688669] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-25T18:27:45.247590] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:27:45.488706] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-25T18:27:46.288712] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-25T18:27:46.363029] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T18:27:46.925077] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T18:27:47.088717] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-25T18:27:47.656787] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T18:27:47.888744] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-25T18:27:48.604381] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T18:27:48.688757] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-25T18:27:49.488734] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-25T18:27:50.288769] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-25T18:27:50.468991] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T18:27:51.028153] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T18:27:51.088692] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-25T18:27:51.163881] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T18:27:51.165544] [INFO ] [REMOTE ] DTW: Full fetch complete (7725 records). [2025-09-25T18:27:51.165690] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-25T18:27:51.566212] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-25T18:27:51.566322] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-25T18:27:51.566575] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-25T18:27:51.566617] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-25T18:27:51.567073] [DEBUG] [LOCAL ] DTW: Trimmed 7725 records to 4905 (keeping 200 days of data) [2025-09-25T18:27:51.602686] [DEBUG] [LOCAL ] DTW: Primary data saved (4905 records). [2025-09-25T18:27:51.602818] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-25T18:27:51.602944] [INFO ] [MAIN ] Update Progress: 664/2372 symbols completed. DTW took 24.9s. Estimated remaining: 3h 45m 52s. Rate: 7.6 symbols/min [2025-09-25T18:27:51.789064] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:51.848862] [DEBUG] [LOCAL ] DVA: Loaded 41348 existing records from primary storage. [2025-09-25T18:27:51.849004] [INFO ] [MAIN ] DVA: Loaded 41348 existing records. [2025-09-25T18:27:51.893801] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-25T18:27:52.037664] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:52.038035] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-25T18:27:52.038091] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-25T18:27:52.038353] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-25T18:27:52.038421] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-25T18:27:52.397985] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:52.688699] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-25T18:27:52.974077] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:27:53.326908] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T18:27:53.488711] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-25T18:27:53.783312] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:27:54.161357] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T18:27:54.163029] [INFO ] [REMOTE ] DUKB: Full fetch complete (9532 records). [2025-09-25T18:27:54.163107] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-25T18:27:54.293827] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-25T18:27:54.560945] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-25T18:27:54.561047] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-25T18:27:54.561506] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-25T18:27:54.561585] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-25T18:27:54.562106] [DEBUG] [LOCAL ] DUKB: Trimmed 9532 records to 6389 (keeping 200 days of data) [2025-09-25T18:27:54.602031] [DEBUG] [LOCAL ] DUKB: Primary data saved (6389 records). [2025-09-25T18:27:54.602154] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-25T18:27:54.602255] [INFO ] [MAIN ] Update Progress: 665/2372 symbols completed. DUKB took 21.0s. Estimated remaining: 3h 45m 32s. Rate: 7.6 symbols/min [2025-09-25T18:27:54.773297] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:27:54.826738] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-25T18:27:54.826881] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-25T18:27:55.006993] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:27:55.007308] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-25T18:27:55.007378] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-25T18:27:55.007630] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-25T18:27:55.007727] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-25T18:27:55.093790] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-25T18:27:55.375303] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:27:55.888806] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-25T18:27:56.361046] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T18:27:56.688716] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-25T18:27:56.931245] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T18:27:57.149050] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T18:27:57.488762] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-25T18:27:58.288778] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-25T18:27:58.421014] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T18:27:59.088154] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T18:27:59.097773] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-25T18:27:59.525110] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T18:27:59.888812] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-25T18:28:00.688754] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-25T18:28:01.353412] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-25T18:28:01.455201] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T18:28:01.488703] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-25T18:28:02.288709] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-25T18:28:02.582588] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T18:28:02.720864] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T18:28:03.088755] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-25T18:28:03.888744] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-25T18:28:04.341380] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T18:28:04.618638] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T18:28:04.688716] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-25T18:28:05.488793] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-25T18:28:05.693587] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T18:28:06.249560] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T18:28:06.288718] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-25T18:28:07.088758] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-25T18:28:07.601393] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T18:28:07.888757] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-25T18:28:07.962369] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T18:28:08.688692] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-25T18:28:08.787369] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T18:28:08.797804] [INFO ] [REMOTE ] DV: Full fetch complete (73293 records). [2025-09-25T18:28:08.797993] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-25T18:28:09.297351] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-25T18:28:09.297467] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-25T18:28:09.298805] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-25T18:28:09.298914] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-25T18:28:09.303793] [DEBUG] [LOCAL ] DV: Trimmed 73293 records to 51659 (keeping 200 days of data) [2025-09-25T18:28:09.527799] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-25T18:28:09.692294] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T18:28:09.811181] [DEBUG] [LOCAL ] DV: Primary data saved (51659 records). [2025-09-25T18:28:09.811385] [INFO ] [MAIN ] DV: Full history saved. [2025-09-25T18:28:09.811525] [INFO ] [MAIN ] Update Progress: 666/2372 symbols completed. DV took 35.1s. Estimated remaining: 3h 45m 42s. Rate: 7.6 symbols/min [2025-09-25T18:28:10.060946] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:10.119687] [DEBUG] [LOCAL ] DX: Loaded 52476 existing records from primary storage. [2025-09-25T18:28:10.119900] [INFO ] [MAIN ] DX: Loaded 52476 existing records. [2025-09-25T18:28:10.293936] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-25T18:28:10.338498] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:10.339100] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-25T18:28:10.339240] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-25T18:28:10.339674] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-25T18:28:10.339737] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-25T18:28:10.734367] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:10.766739] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-25T18:28:11.088759] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-25T18:28:11.229724] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T18:28:11.888758] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-25T18:28:12.351819] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T18:28:12.688781] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-25T18:28:13.311358] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T18:28:13.321312] [INFO ] [REMOTE ] DUK: Full fetch complete (77405 records). [2025-09-25T18:28:13.321490] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-25T18:28:13.512190] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-25T18:28:13.747692] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-25T18:28:13.747836] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-25T18:28:13.748841] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-25T18:28:13.749026] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-25T18:28:13.750875] [DEBUG] [LOCAL ] DUK: Trimmed 77405 records to 53849 (keeping 200 days of data) [2025-09-25T18:28:13.875499] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T18:28:14.135085] [DEBUG] [LOCAL ] DUK: Primary data saved (53849 records). [2025-09-25T18:28:14.135234] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-25T18:28:14.136296] [INFO ] [MAIN ] Update Progress: 667/2372 symbols completed. DUK took 44.5s. Estimated remaining: 3h 45m 25s. Rate: 7.6 symbols/min [2025-09-25T18:28:14.291573] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-25T18:28:14.314077] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:14.365550] [DEBUG] [LOCAL ] DXC: Loaded 49682 existing records from primary storage. [2025-09-25T18:28:14.365744] [INFO ] [MAIN ] DXC: Loaded 49682 existing records. [2025-09-25T18:28:14.547508] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:14.547776] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-25T18:28:14.547828] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-25T18:28:14.548137] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-25T18:28:14.548196] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-25T18:28:14.932702] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:14.965630] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-25T18:28:15.088687] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-25T18:28:15.182951] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T18:28:15.701163] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T18:28:15.888698] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-25T18:28:16.688726] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-25T18:28:17.130537] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T18:28:17.488683] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-25T18:28:17.667102] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T18:28:18.288682] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-25T18:28:18.443311] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:28:18.451051] [INFO ] [REMOTE ] DVA: Full fetch complete (59731 records). [2025-09-25T18:28:18.451171] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-25T18:28:18.861599] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-25T18:28:18.861732] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-25T18:28:18.862533] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-25T18:28:18.862696] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-25T18:28:18.864259] [DEBUG] [LOCAL ] DVA: Trimmed 59731 records to 41631 (keeping 200 days of data) [2025-09-25T18:28:18.976821] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:28:19.109004] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-25T18:28:19.159518] [DEBUG] [LOCAL ] DVA: Primary data saved (41631 records). [2025-09-25T18:28:19.159677] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-25T18:28:19.159783] [INFO ] [MAIN ] Update Progress: 668/2372 symbols completed. DVA took 27.6s. Estimated remaining: 3h 45m 10s. Rate: 7.6 symbols/min [2025-09-25T18:28:19.332806] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:19.376832] [DEBUG] [LOCAL ] DXYZ: Loaded 36652 existing records from primary storage. [2025-09-25T18:28:19.376968] [INFO ] [MAIN ] DXYZ: Loaded 36652 existing records. [2025-09-25T18:28:19.556535] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:19.556849] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-25T18:28:19.556896] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-25T18:28:19.557189] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-25T18:28:19.557247] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-25T18:28:19.890997] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-25T18:28:19.937713] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:20.025094] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T18:28:20.325141] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T18:28:20.688717] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-25T18:28:21.488745] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-25T18:28:21.957918] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-25T18:28:22.280440] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T18:28:22.289086] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-25T18:28:23.088712] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-25T18:28:23.230284] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T18:28:23.888766] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-25T18:28:24.688782] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-25T18:28:25.094983] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.81 seconds). [2025-09-25T18:28:25.421073] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-25T18:28:25.464052] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T18:28:25.488736] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-25T18:28:26.288722] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-25T18:28:26.752386] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T18:28:27.088763] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-25T18:28:27.147089] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:28:27.888680] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-25T18:28:28.290107] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T18:28:28.688695] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-25T18:28:28.888576] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T18:28:29.488698] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-25T18:28:29.524013] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:28:30.288697] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-25T18:28:30.701618] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T18:28:30.711917] [INFO ] [REMOTE ] DVN: Full fetch complete (77376 records). [2025-09-25T18:28:30.712106] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-25T18:28:30.713317] [FATAL] [VALIDATOR ] DVN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:28:30.713423] [FATAL] [MAIN ] DVN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:28:30.713467] [WARN ] [MAIN ] DVN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:28:30.713510] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-25T18:28:30.713582] [DEBUG] [LOCAL ] DVN: No primary data file found to delete. [2025-09-25T18:28:30.713620] [INFO ] [LOCAL ] DVN: Starting deletion of derivative data. [2025-09-25T18:28:30.714446] [DEBUG] [LOCAL ] DVN: Deleted derivative data file. [2025-09-25T18:28:30.714867] [INFO ] [MAIN ] Update Progress: 669/2372 symbols completed. DVN took 36.1s. Estimated remaining: 3h 45m 11s. Rate: 7.6 symbols/min [2025-09-25T18:28:30.884019] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:30.920355] [DEBUG] [LOCAL ] DY: Loaded 29758 existing records from primary storage. [2025-09-25T18:28:30.920573] [INFO ] [MAIN ] DY: Loaded 29758 existing records. [2025-09-25T18:28:31.090784] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-25T18:28:31.125088] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:31.125383] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-25T18:28:31.125437] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-25T18:28:31.125890] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-25T18:28:31.125956] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-25T18:28:31.517031] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:31.810699] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-25T18:28:31.888671] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-25T18:28:31.968006] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:28:32.688765] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-25T18:28:33.100635] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T18:28:33.488686] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-25T18:28:33.978112] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-25T18:28:34.288731] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-25T18:28:34.780328] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T18:28:34.839728] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T18:28:35.088729] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-25T18:28:35.858796] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T18:28:35.888691] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-25T18:28:36.694623] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-25T18:28:36.715907] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:28:37.488701] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-25T18:28:37.974541] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T18:28:37.984475] [INFO ] [REMOTE ] DX: Full fetch complete (74968 records). [2025-09-25T18:28:37.984678] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-25T18:28:37.985582] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:28:37.985729] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:28:37.985804] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:28:37.985890] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-25T18:28:37.986045] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-09-25T18:28:37.986118] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-09-25T18:28:37.986469] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-09-25T18:28:37.986602] [INFO ] [MAIN ] Update Progress: 670/2372 symbols completed. DX took 28.2s. Estimated remaining: 3h 45m 2s. Rate: 7.6 symbols/min [2025-09-25T18:28:38.174810] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:38.192834] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:28:38.231284] [DEBUG] [LOCAL ] E: Loaded 33384 existing records from primary storage. [2025-09-25T18:28:38.231439] [INFO ] [MAIN ] E: Loaded 33384 existing records. [2025-09-25T18:28:38.297296] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-25T18:28:38.418846] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:38.419120] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-25T18:28:38.419169] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-25T18:28:38.419428] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-25T18:28:38.419488] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-25T18:28:38.846569] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:39.081841] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T18:28:39.091044] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-25T18:28:39.092936] [INFO ] [REMOTE ] DXC: Full fetch complete (68811 records). [2025-09-25T18:28:39.093041] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-25T18:28:39.500398] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-25T18:28:39.500503] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-25T18:28:39.501355] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-25T18:28:39.501420] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-25T18:28:39.502928] [DEBUG] [LOCAL ] DXC: Trimmed 68811 records to 50066 (keeping 200 days of data) [2025-09-25T18:28:39.802778] [DEBUG] [LOCAL ] DXC: Primary data saved (50066 records). [2025-09-25T18:28:39.802935] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-25T18:28:39.803506] [INFO ] [MAIN ] Update Progress: 671/2372 symbols completed. DXC took 25.7s. Estimated remaining: 3h 44m 38s. Rate: 7.6 symbols/min [2025-09-25T18:28:39.896371] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-25T18:28:39.981691] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:28:40.001692] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T18:28:40.045101] [DEBUG] [LOCAL ] EAF: Loaded 43750 existing records from primary storage. [2025-09-25T18:28:40.045258] [INFO ] [MAIN ] EAF: Loaded 43750 existing records. [2025-09-25T18:28:40.224676] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:28:40.224910] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-25T18:28:40.224966] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-25T18:28:40.225305] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-25T18:28:40.225364] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-25T18:28:40.593710] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:28:40.655580] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T18:28:40.688662] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-25T18:28:41.488772] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-25T18:28:42.051374] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-25T18:28:42.164010] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T18:28:42.288749] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-25T18:28:42.498956] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T18:28:43.088778] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-25T18:28:43.700242] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T18:28:43.888765] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-25T18:28:43.945132] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T18:28:44.688811] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-25T18:28:45.488831] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-25T18:28:45.836241] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:28:45.919872] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T18:28:46.288790] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-25T18:28:46.452936] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T18:28:47.088786] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-25T18:28:47.883065] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T18:28:47.891203] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-25T18:28:48.627241] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T18:28:48.688708] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-25T18:28:49.246325] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T18:28:49.488819] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-25T18:28:49.964914] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:28:50.288795] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-25T18:28:51.088829] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-25T18:28:51.226143] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T18:28:51.888770] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-25T18:28:52.297962] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T18:28:52.403998] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T18:28:52.688772] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-25T18:28:53.488704] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-25T18:28:53.724074] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T18:28:53.852234] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T18:28:54.288804] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-25T18:28:55.088762] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-25T18:28:55.145682] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T18:28:55.761921] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T18:28:55.888667] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-25T18:28:56.496235] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:28:56.688694] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-25T18:28:57.317221] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T18:28:57.488753] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-25T18:28:58.285067] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T18:28:58.294595] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-25T18:28:58.811975] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T18:28:59.088733] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-25T18:28:59.655029] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T18:28:59.888775] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-25T18:29:00.688753] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-25T18:29:00.713937] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:29:01.002364] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T18:29:01.008355] [INFO ] [REMOTE ] E: Full fetch complete (48399 records). [2025-09-25T18:29:01.008490] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-25T18:29:01.397325] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-25T18:29:01.397478] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-25T18:29:01.398157] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-25T18:29:01.398222] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-25T18:29:01.399306] [DEBUG] [LOCAL ] E: Trimmed 48399 records to 33635 (keeping 200 days of data) [2025-09-25T18:29:01.496720] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-25T18:29:01.630392] [DEBUG] [LOCAL ] E: Primary data saved (33635 records). [2025-09-25T18:29:01.630553] [INFO ] [MAIN ] E: Full history saved. [2025-09-25T18:29:01.630670] [INFO ] [MAIN ] Update Progress: 672/2372 symbols completed. E took 23.6s. Estimated remaining: 3h 45m 5s. Rate: 7.6 symbols/min [2025-09-25T18:29:01.821744] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:01.830971] [DEBUG] [LOCAL ] EAI: Loaded 3961 existing records from primary storage. [2025-09-25T18:29:01.831147] [INFO ] [MAIN ] EAI: Loaded 3961 existing records. [2025-09-25T18:29:02.097573] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:02.098039] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-25T18:29:02.098117] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-25T18:29:02.098455] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-25T18:29:02.098535] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-25T18:29:02.305865] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-25T18:29:02.672626] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:02.801824] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T18:29:02.844046] [INFO ] [REMOTE ] EAF: Full fetch complete (64570 records). [2025-09-25T18:29:02.846531] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T18:29:02.846756] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-25T18:29:03.096919] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-25T18:29:03.332316] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-25T18:29:03.332463] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-25T18:29:03.333390] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-25T18:29:03.333460] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-25T18:29:03.335125] [DEBUG] [LOCAL ] EAF: Trimmed 64570 records to 43973 (keeping 200 days of data) [2025-09-25T18:29:03.446245] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T18:29:03.607517] [DEBUG] [LOCAL ] EAF: Primary data saved (43973 records). [2025-09-25T18:29:03.607674] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-25T18:29:03.608387] [INFO ] [MAIN ] Update Progress: 673/2372 symbols completed. EAF took 23.8s. Estimated remaining: 3h 44m 42s. Rate: 7.6 symbols/min [2025-09-25T18:29:03.784207] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:03.818266] [DEBUG] [LOCAL ] EARN: Loaded 30263 existing records from primary storage. [2025-09-25T18:29:03.818409] [INFO ] [MAIN ] EARN: Loaded 30263 existing records. [2025-09-25T18:29:03.889431] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-25T18:29:03.929842] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:29:04.015824] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:04.016114] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-25T18:29:04.016171] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-25T18:29:04.016410] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-25T18:29:04.016468] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-25T18:29:04.384220] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:04.688727] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-25T18:29:05.362053] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T18:29:05.499045] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-25T18:29:05.501634] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T18:29:06.125943] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T18:29:06.288761] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-25T18:29:07.088785] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-25T18:29:07.888740] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-25T18:29:08.007490] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T18:29:08.524390] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T18:29:08.688734] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-25T18:29:09.097995] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T18:29:09.104114] [INFO ] [REMOTE ] DY: Full fetch complete (44873 records). [2025-09-25T18:29:09.104275] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-25T18:29:09.489728] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-25T18:29:09.489374] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-25T18:29:09.491182] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-25T18:29:09.491893] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-25T18:29:09.491979] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-25T18:29:09.493302] [DEBUG] [LOCAL ] DY: Trimmed 44873 records to 29924 (keeping 200 days of data) [2025-09-25T18:29:09.680804] [DEBUG] [LOCAL ] DY: Primary data saved (29924 records). [2025-09-25T18:29:09.680952] [INFO ] [MAIN ] DY: Full history saved. [2025-09-25T18:29:09.681075] [INFO ] [MAIN ] Update Progress: 674/2372 symbols completed. DY took 39.0s. Estimated remaining: 3h 44m 30s. Rate: 7.6 symbols/min [2025-09-25T18:29:09.863864] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:09.919279] [DEBUG] [LOCAL ] EAT: Loaded 49810 existing records from primary storage. [2025-09-25T18:29:09.919564] [INFO ] [MAIN ] EAT: Loaded 49810 existing records. [2025-09-25T18:29:10.114893] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:10.138523] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:29:10.137606] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-25T18:29:10.146737] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-25T18:29:10.147425] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-25T18:29:10.147516] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-25T18:29:10.302584] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-25T18:29:10.551263] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:10.963370] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T18:29:11.088712] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-25T18:29:11.548813] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T18:29:11.556343] [INFO ] [REMOTE ] DXYZ: Full fetch complete (57922 records). [2025-09-25T18:29:11.556497] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-25T18:29:11.893964] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-25T18:29:11.982291] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-25T18:29:11.982419] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-25T18:29:11.983338] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-25T18:29:11.983403] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-25T18:29:11.987502] [DEBUG] [LOCAL ] DXYZ: Trimmed 57922 records to 36924 (keeping 200 days of data) [2025-09-25T18:29:12.228839] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36924 records). [2025-09-25T18:29:12.228986] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-25T18:29:12.229114] [INFO ] [MAIN ] Update Progress: 675/2372 symbols completed. DXYZ took 53.1s. Estimated remaining: 3h 44m 8s. Rate: 7.6 symbols/min [2025-09-25T18:29:12.406456] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:12.413417] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-25T18:29:12.461713] [DEBUG] [LOCAL ] EB: Loaded 37674 existing records from primary storage. [2025-09-25T18:29:12.462230] [INFO ] [MAIN ] EB: Loaded 37674 existing records. [2025-09-25T18:29:12.573606] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T18:29:12.691456] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-25T18:29:12.691727] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:12.693015] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-25T18:29:12.693079] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-25T18:29:12.693333] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-25T18:29:12.693396] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-25T18:29:13.110586] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:13.340272] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T18:29:13.488715] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-25T18:29:14.288725] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-25T18:29:15.094753] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-25T18:29:15.097660] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T18:29:15.549285] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T18:29:15.888722] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-25T18:29:16.688725] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-25T18:29:17.004700] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T18:29:17.383407] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T18:29:17.384427] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T18:29:17.488759] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-25T18:29:18.288716] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-25T18:29:18.893090] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T18:29:19.088714] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-25T18:29:19.889279] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-25T18:29:19.892335] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:29:20.581818] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:29:20.688728] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-25T18:29:21.488747] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-25T18:29:21.592176] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T18:29:21.839176] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T18:29:22.288704] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-25T18:29:22.484999] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T18:29:23.088699] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-25T18:29:23.678400] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T18:29:23.888716] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-25T18:29:24.210557] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T18:29:24.688719] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-25T18:29:25.306724] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T18:29:25.488698] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-25T18:29:25.571174] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T18:29:26.288713] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-25T18:29:26.707602] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T18:29:27.088699] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-25T18:29:27.649995] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T18:29:27.880502] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T18:29:27.888689] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-25T18:29:28.688720] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-25T18:29:29.149368] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T18:29:29.155764] [INFO ] [REMOTE ] EARN: Full fetch complete (46280 records). [2025-09-25T18:29:29.155875] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-25T18:29:29.493911] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-25T18:29:29.572404] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-25T18:29:29.572525] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-25T18:29:29.574001] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-25T18:29:29.574115] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-25T18:29:29.575508] [DEBUG] [LOCAL ] EARN: Trimmed 46280 records to 30444 (keeping 200 days of data) [2025-09-25T18:29:29.784087] [DEBUG] [LOCAL ] EARN: Primary data saved (30444 records). [2025-09-25T18:29:29.784276] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-25T18:29:29.784430] [INFO ] [MAIN ] Update Progress: 676/2372 symbols completed. EARN took 26.2s. Estimated remaining: 3h 44m 25s. Rate: 7.6 symbols/min [2025-09-25T18:29:29.972878] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:29.973108] [DEBUG] [LOCAL ] EBF: No existing data file found in primary storage. [2025-09-25T18:29:29.973160] [WARN ] [MAIN ] EBF: No existing data found, performing full refresh instead. [2025-09-25T18:29:29.973468] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-25T18:29:29.973614] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-25T18:29:29.973831] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-09-25T18:29:29.973884] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-25T18:29:30.094249] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T18:29:30.290163] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-25T18:29:30.312566] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-25T18:29:30.389829] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:31.088717] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-25T18:29:31.766160] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T18:29:31.767903] [INFO ] [REMOTE ] EAI: Full fetch complete (6124 records). [2025-09-25T18:29:31.767976] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-25T18:29:31.768731] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:29:31.768813] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:29:31.768866] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:29:31.768927] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-25T18:29:31.768986] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-09-25T18:29:31.769033] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-09-25T18:29:31.769343] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-09-25T18:29:31.769501] [INFO ] [MAIN ] Update Progress: 677/2372 symbols completed. EAI took 30.1s. Estimated remaining: 3h 44m 2s. Rate: 7.6 symbols/min [2025-09-25T18:29:31.888724] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-25T18:29:32.239069] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T18:29:32.688801] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-25T18:29:33.133684] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T18:29:33.488769] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-25T18:29:33.895228] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T18:29:34.288757] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-25T18:29:34.489134] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T18:29:35.088736] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-25T18:29:35.404126] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T18:29:35.410388] [INFO ] [REMOTE ] EB: Full fetch complete (56657 records). [2025-09-25T18:29:35.410497] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-25T18:29:35.855255] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-25T18:29:35.855422] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-25T18:29:35.856173] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-25T18:29:35.856240] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-25T18:29:35.857449] [DEBUG] [LOCAL ] EB: Trimmed 56657 records to 37828 (keeping 200 days of data) [2025-09-25T18:29:35.910853] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-25T18:29:36.086095] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T18:29:36.102182] [DEBUG] [LOCAL ] EB: Primary data saved (37828 records). [2025-09-25T18:29:36.102310] [INFO ] [MAIN ] EB: Full history saved. [2025-09-25T18:29:36.102438] [INFO ] [MAIN ] Update Progress: 678/2372 symbols completed. EB took 23.9s. Estimated remaining: 3h 43m 45s. Rate: 7.6 symbols/min [2025-09-25T18:29:36.688713] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-25T18:29:37.547800] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T18:29:37.559000] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-25T18:29:37.884763] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T18:29:38.288771] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-25T18:29:39.404246] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T18:29:39.415325] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-25T18:29:39.454214] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T18:29:39.888774] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-25T18:29:40.890014] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T18:29:40.894881] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-25T18:29:41.177568] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T18:29:41.488765] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-25T18:29:41.525252] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T18:29:42.288770] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-25T18:29:43.006001] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T18:29:43.088753] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-25T18:29:43.463171] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T18:29:43.888826] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-25T18:29:44.784308] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:29:44.794785] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-25T18:29:45.046967] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T18:29:45.488775] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-25T18:29:46.551569] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T18:29:46.561012] [INFO ] [REMOTE ] EAT: Full fetch complete (71784 records). [2025-09-25T18:29:46.561139] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-25T18:29:46.707704] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T18:29:46.774137] [INFO ] [REMOTE ] EBF: Full fetch complete (27341 records). [2025-09-25T18:29:46.794942] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-25T18:29:47.259153] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-25T18:29:47.285759] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-25T18:29:47.298479] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-25T18:29:47.317727] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-25T18:29:47.378503] [DEBUG] [LOCAL ] EAT: Trimmed 71784 records to 50179 (keeping 200 days of data) [2025-09-25T18:29:47.407978] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-25T18:29:47.408068] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-25T18:29:47.408346] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-25T18:29:47.408385] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-25T18:29:47.409192] [DEBUG] [LOCAL ] EBF: Trimmed 27341 records to 19533 (keeping 200 days of data) [2025-09-25T18:29:47.639530] [DEBUG] [LOCAL ] EBF: Primary data saved (19533 records). [2025-09-25T18:29:47.641610] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-25T18:29:47.642234] [INFO ] [MAIN ] Update Progress: 679/2372 symbols completed. EBF took 17.9s. Estimated remaining: 3h 43m 46s. Rate: 7.6 symbols/min [2025-09-25T18:29:47.838715] [DEBUG] [LOCAL ] EAT: Primary data saved (50179 records). [2025-09-25T18:29:47.838868] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-25T18:29:47.838959] [INFO ] [MAIN ] Update Progress: 680/2372 symbols completed. EAT took 38.2s. Estimated remaining: 3h 43m 19s. Rate: 7.6 symbols/min [2025-09-25T18:29:48.400491] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:48.435818] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:48.520796] [DEBUG] [LOCAL ] EBS: No existing data file found in primary storage. [2025-09-25T18:29:48.557019] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:48.560667] [WARN ] [MAIN ] EBS: No existing data found, performing full refresh instead. [2025-09-25T18:29:48.580297] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-25T18:29:48.579013] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:29:48.580677] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-25T18:29:48.584845] [DEBUG] [LOCAL ] EBS: No primary data file found to delete. [2025-09-25T18:29:48.584951] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-25T18:29:48.762980] [DEBUG] [LOCAL ] EBR: Loaded 43088 existing records from primary storage. [2025-09-25T18:29:48.825283] [INFO ] [MAIN ] EBR: Loaded 43088 existing records. [2025-09-25T18:29:48.839913] [DEBUG] [LOCAL ] ECAT: Loaded 29712 existing records from primary storage. [2025-09-25T18:29:48.931601] [DEBUG] [LOCAL ] EC: Loaded 49335 existing records from primary storage. [2025-09-25T18:29:48.953228] [INFO ] [MAIN ] EC: Loaded 49335 existing records. [2025-09-25T18:29:48.916680] [INFO ] [MAIN ] ECAT: Loaded 29712 existing records. [2025-09-25T18:29:49.340437] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:49.354774] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-25T18:29:49.534560] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:49.625714] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-25T18:29:49.625286] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:49.625887] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-25T18:29:49.625475] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:29:49.626363] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-25T18:29:49.626331] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-25T18:29:49.626973] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-25T18:29:49.627109] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-25T18:29:49.626910] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-25T18:29:49.638992] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-25T18:29:49.639172] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-25T18:29:49.664205] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-25T18:29:49.671338] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-25T18:29:49.707688] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-25T18:29:50.587105] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:50.616615] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-25T18:29:50.653842] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:50.654556] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-25T18:29:50.738181] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:29:50.738447] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-25T18:29:51.179466] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T18:29:51.188980] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-25T18:29:52.033324] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:29:52.039264] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-25T18:29:52.484008] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:29:52.494815] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-25T18:29:52.602384] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T18:29:52.613366] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-25T18:29:52.717875] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T18:29:52.727594] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-25T18:29:52.917115] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T18:29:53.488766] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-25T18:29:54.195155] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T18:29:54.288804] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-25T18:29:54.420338] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T18:29:54.465077] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-25T18:29:54.836463] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:29:55.088771] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-25T18:29:55.888795] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-25T18:29:56.078597] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T18:29:56.442252] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:29:56.688772] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-25T18:29:57.308107] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T18:29:57.488805] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-25T18:29:58.069042] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:29:58.288769] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-25T18:29:59.088730] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-25T18:29:59.606770] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-25T18:29:59.675163] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T18:29:59.888712] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-25T18:30:00.688721] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-25T18:30:01.113091] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T18:30:01.488735] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-25T18:30:02.288771] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-25T18:30:03.333689] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (3.44 seconds). [2025-09-25T18:30:03.340016] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-25T18:30:05.376579] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (3.09 seconds). [2025-09-25T18:30:05.388110] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-25T18:30:05.456176] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T18:30:05.466442] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-25T18:30:05.499153] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (4.81 seconds). [2025-09-25T18:30:05.510590] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-25T18:30:05.541455] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (4.05 seconds). [2025-09-25T18:30:06.288943] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-25T18:30:06.748899] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T18:30:07.088825] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-25T18:30:07.291370] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:30:07.530271] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T18:30:07.884894] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T18:30:07.893622] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-25T18:30:08.084534] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-25T18:30:08.688740] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-25T18:30:09.488791] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-25T18:30:09.701935] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T18:30:10.065855] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T18:30:10.288721] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-25T18:30:10.992319] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:30:11.000451] [INFO ] [REMOTE ] ECAT: Full fetch complete (42489 records). [2025-09-25T18:30:11.000797] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-25T18:30:11.002073] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:30:11.002175] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:30:11.002262] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:30:11.002345] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-25T18:30:11.002439] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-09-25T18:30:11.002524] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-09-25T18:30:11.002868] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-09-25T18:30:11.003002] [INFO ] [MAIN ] Update Progress: 681/2372 symbols completed. ECAT took 23.2s. Estimated remaining: 3h 43m 49s. Rate: 7.6 symbols/min [2025-09-25T18:30:11.098003] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-25T18:30:11.201249] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:11.249627] [DEBUG] [LOCAL ] ECC: Loaded 43428 existing records from primary storage. [2025-09-25T18:30:11.249810] [INFO ] [MAIN ] ECC: Loaded 43428 existing records. [2025-09-25T18:30:11.429228] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:30:11.429490] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-25T18:30:11.429539] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-25T18:30:11.429819] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-25T18:30:11.429888] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-25T18:30:11.808806] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:11.888755] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-25T18:30:11.973456] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:30:12.688693] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-25T18:30:12.854669] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T18:30:13.488698] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-25T18:30:13.716045] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T18:30:14.288727] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-25T18:30:15.088764] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-25T18:30:15.138549] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-25T18:30:15.753520] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-25T18:30:15.888753] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-25T18:30:16.688711] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-25T18:30:16.803997] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T18:30:16.813736] [INFO ] [REMOTE ] EBS: Full fetch complete (67355 records). [2025-09-25T18:30:16.813877] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-25T18:30:17.170393] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-25T18:30:17.296989] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-25T18:30:17.297199] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-25T18:30:17.298363] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-25T18:30:17.298475] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-25T18:30:17.300267] [DEBUG] [LOCAL ] EBS: Trimmed 67355 records to 47102 (keeping 200 days of data) [2025-09-25T18:30:17.450166] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T18:30:17.493836] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-25T18:30:17.615846] [DEBUG] [LOCAL ] EBS: Primary data saved (47102 records). [2025-09-25T18:30:17.616020] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-25T18:30:17.616120] [INFO ] [MAIN ] Update Progress: 682/2372 symbols completed. EBS took 29.8s. Estimated remaining: 3h 43m 37s. Rate: 7.6 symbols/min [2025-09-25T18:30:17.793215] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:17.793386] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-25T18:30:17.793428] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-25T18:30:17.793623] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-25T18:30:17.793713] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-25T18:30:17.793784] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-25T18:30:17.793818] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-25T18:30:18.184004] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:18.294056] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-25T18:30:18.300081] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T18:30:18.718128] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-25T18:30:18.798010] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T18:30:19.088709] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-25T18:30:19.888740] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-25T18:30:20.604747] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T18:30:20.688753] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-25T18:30:21.488698] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-25T18:30:21.589614] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T18:30:21.598775] [INFO ] [REMOTE ] EC: Full fetch complete (71984 records). [2025-09-25T18:30:21.598920] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-25T18:30:22.012261] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-25T18:30:22.012497] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-25T18:30:22.013611] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-25T18:30:22.013813] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-25T18:30:22.015815] [DEBUG] [LOCAL ] EC: Trimmed 71984 records to 49689 (keeping 200 days of data) [2025-09-25T18:30:22.148938] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T18:30:22.164816] [INFO ] [REMOTE ] EBR: Full fetch complete (62813 records). [2025-09-25T18:30:22.167497] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-25T18:30:22.293468] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-25T18:30:22.632412] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-25T18:30:22.632850] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-25T18:30:22.633948] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-25T18:30:22.636816] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-25T18:30:22.700387] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-25T18:30:22.700233] [DEBUG] [LOCAL ] EBR: Trimmed 62813 records to 43438 (keeping 200 days of data) [2025-09-25T18:30:23.020142] [DEBUG] [LOCAL ] EC: Primary data saved (49689 records). [2025-09-25T18:30:23.021007] [INFO ] [MAIN ] EC: Full history saved. [2025-09-25T18:30:23.021921] [INFO ] [MAIN ] Update Progress: 683/2372 symbols completed. EC took 35.2s. Estimated remaining: 3h 43m 23s. Rate: 7.6 symbols/min [2025-09-25T18:30:23.092272] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-25T18:30:23.231264] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:23.232336] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-25T18:30:23.232482] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-25T18:30:23.234533] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-25T18:30:23.235009] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-25T18:30:23.236206] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-25T18:30:23.236354] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-25T18:30:23.375752] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T18:30:23.512030] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-25T18:30:23.703346] [DEBUG] [LOCAL ] EBR: Primary data saved (43438 records). [2025-09-25T18:30:23.703470] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-25T18:30:23.703257] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:23.703608] [INFO ] [MAIN ] Update Progress: 684/2372 symbols completed. EBR took 35.9s. Estimated remaining: 3h 42m 57s. Rate: 7.6 symbols/min [2025-09-25T18:30:23.896530] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:23.893795] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-25T18:30:23.896887] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-25T18:30:23.897124] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-25T18:30:23.897982] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-25T18:30:23.898037] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-25T18:30:23.898082] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-25T18:30:23.898115] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-25T18:30:24.311375] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:24.600679] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T18:30:24.688727] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-25T18:30:25.488763] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-25T18:30:26.288752] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-25T18:30:26.587973] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T18:30:27.088741] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-25T18:30:27.645745] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (2.96 seconds). [2025-09-25T18:30:27.709446] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T18:30:27.825599] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T18:30:27.888739] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-25T18:30:28.688721] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-25T18:30:29.003518] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-25T18:30:29.495596] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-25T18:30:29.513919] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T18:30:29.851954] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T18:30:30.288728] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-25T18:30:30.709728] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-25T18:30:31.088698] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-25T18:30:31.676578] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T18:30:31.888708] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-25T18:30:32.490290] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T18:30:32.688718] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-25T18:30:33.166189] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-25T18:30:33.488715] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-25T18:30:33.836218] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-25T18:30:34.288734] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-25T18:30:34.714060] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T18:30:35.088727] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-25T18:30:35.888718] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-25T18:30:36.576818] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T18:30:36.652222] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:30:36.688677] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-25T18:30:37.035182] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T18:30:37.488700] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-25T18:30:37.910801] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T18:30:38.288694] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-25T18:30:38.654942] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-25T18:30:39.088704] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-25T18:30:39.888720] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-25T18:30:40.223886] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-25T18:30:40.597330] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:30:40.688748] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-25T18:30:41.488726] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-25T18:30:42.004745] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-25T18:30:42.252395] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T18:30:42.288681] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-25T18:30:43.088715] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-25T18:30:43.444012] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T18:30:43.859016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T18:30:43.868040] [INFO ] [REMOTE ] ECC: Full fetch complete (60961 records). [2025-09-25T18:30:43.868217] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-25T18:30:43.893887] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-25T18:30:44.273343] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-25T18:30:44.273601] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-25T18:30:44.274720] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-25T18:30:44.274793] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-25T18:30:44.276429] [DEBUG] [LOCAL ] ECC: Trimmed 60961 records to 43726 (keeping 200 days of data) [2025-09-25T18:30:44.468404] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T18:30:44.554576] [DEBUG] [LOCAL ] ECC: Primary data saved (43726 records). [2025-09-25T18:30:44.554731] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-25T18:30:44.554832] [INFO ] [MAIN ] Update Progress: 685/2372 symbols completed. ECC took 33.6s. Estimated remaining: 3h 43m 21s. Rate: 7.6 symbols/min [2025-09-25T18:30:44.697176] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-25T18:30:44.730833] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:44.730987] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-25T18:30:44.731037] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-25T18:30:44.731183] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-25T18:30:44.731228] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-25T18:30:44.731269] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-25T18:30:44.731300] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-25T18:30:45.097352] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:45.182789] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T18:30:45.488718] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-25T18:30:45.977164] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T18:30:45.977979] [INFO ] [REMOTE ] ECCC: Full fetch complete (1278 records). [2025-09-25T18:30:45.978050] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-25T18:30:46.163029] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-25T18:30:46.163243] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:30:46.163322] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:30:46.163370] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-25T18:30:46.163439] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-25T18:30:46.163503] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-25T18:30:46.163561] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-25T18:30:46.163673] [INFO ] [MAIN ] Update Progress: 686/2372 symbols completed. ECCC took 28.5s. Estimated remaining: 3h 42m 58s. Rate: 7.6 symbols/min [2025-09-25T18:30:46.293825] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-25T18:30:46.345490] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:46.381685] [DEBUG] [LOCAL ] ECG: Loaded 34236 existing records from primary storage. [2025-09-25T18:30:46.381828] [INFO ] [MAIN ] ECG: Loaded 34236 existing records. [2025-09-25T18:30:46.573628] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:30:46.573939] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-25T18:30:46.573992] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-25T18:30:46.574269] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-25T18:30:46.574334] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-25T18:30:46.845368] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T18:30:46.955489] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:47.088704] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-25T18:30:47.888735] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-25T18:30:48.295067] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-25T18:30:48.688697] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-25T18:30:48.719762] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T18:30:49.390280] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-25T18:30:49.488758] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-25T18:30:49.779864] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-25T18:30:50.288732] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-25T18:30:50.733682] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T18:30:51.088815] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-25T18:30:51.415028] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-25T18:30:51.888753] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-25T18:30:52.296604] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-25T18:30:52.297556] [INFO ] [REMOTE ] ECCW: Full fetch complete (1423 records). [2025-09-25T18:30:52.297664] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-25T18:30:52.499203] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-25T18:30:52.499403] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:30:52.499451] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:30:52.499494] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-25T18:30:52.499555] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-25T18:30:52.499591] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-25T18:30:52.499631] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-25T18:30:52.499730] [INFO ] [MAIN ] Update Progress: 687/2372 symbols completed. ECCW took 28.8s. Estimated remaining: 3h 42m 46s. Rate: 7.6 symbols/min [2025-09-25T18:30:52.719693] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-25T18:30:52.723587] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:52.775358] [DEBUG] [LOCAL ] ECL: Loaded 46760 existing records from primary storage. [2025-09-25T18:30:52.775590] [INFO ] [MAIN ] ECL: Loaded 46760 existing records. [2025-09-25T18:30:52.970146] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:30:52.970437] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-25T18:30:52.970489] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-25T18:30:52.970871] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-25T18:30:52.970929] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-25T18:30:53.348376] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:53.488709] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-25T18:30:54.151959] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T18:30:54.288737] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-25T18:30:55.088740] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-25T18:30:55.320998] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:30:55.481140] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-25T18:30:55.482198] [INFO ] [REMOTE ] ECCU: Full fetch complete (4445 records). [2025-09-25T18:30:55.482309] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-25T18:30:55.674700] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-25T18:30:55.687520] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:30:55.688820] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T18:30:55.688126] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:30:55.696378] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-25T18:30:55.697196] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-25T18:30:55.697259] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-25T18:30:55.697306] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-25T18:30:55.697366] [INFO ] [MAIN ] Update Progress: 688/2372 symbols completed. ECCU took 32.7s. Estimated remaining: 3h 42m 26s. Rate: 7.6 symbols/min [2025-09-25T18:30:55.878714] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:30:55.893237] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-25T18:30:55.903410] [DEBUG] [LOCAL ] ECO: Loaded 18536 existing records from primary storage. [2025-09-25T18:30:55.903552] [INFO ] [MAIN ] ECO: Loaded 18536 existing records. [2025-09-25T18:30:56.089089] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:30:56.089364] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-25T18:30:56.089419] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-25T18:30:56.089748] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-25T18:30:56.089811] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-25T18:30:56.462789] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:30:56.688680] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-25T18:30:57.412311] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T18:30:57.488719] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-25T18:30:57.633629] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T18:30:58.288744] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-25T18:30:59.088727] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-25T18:30:59.151818] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:30:59.686936] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T18:30:59.698604] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T18:30:59.888696] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-25T18:31:00.318304] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-25T18:31:00.688712] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-25T18:31:01.055165] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-25T18:31:01.488725] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-25T18:31:02.288704] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-25T18:31:02.672779] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T18:31:03.088744] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-25T18:31:03.888691] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-25T18:31:04.025618] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T18:31:04.281175] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T18:31:04.688828] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-25T18:31:05.367242] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T18:31:05.488738] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-25T18:31:06.288712] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-25T18:31:06.555276] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T18:31:06.602221] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-25T18:31:06.631381] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T18:31:07.088763] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-25T18:31:07.888758] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-25T18:31:08.205852] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T18:31:08.688801] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-25T18:31:09.488701] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-25T18:31:09.718806] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T18:31:09.884729] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T18:31:10.288751] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-25T18:31:10.414006] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:31:11.088743] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-25T18:31:11.283167] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T18:31:11.888723] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-25T18:31:12.354030] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T18:31:12.688723] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-25T18:31:13.488759] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-25T18:31:13.765095] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T18:31:13.813263] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T18:31:14.288760] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-25T18:31:14.317678] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T18:31:15.088729] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-25T18:31:15.888705] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-25T18:31:16.080617] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T18:31:16.413509] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T18:31:16.491608] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T18:31:16.497047] [INFO ] [REMOTE ] ECG: Full fetch complete (51261 records). [2025-09-25T18:31:16.497159] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-25T18:31:16.497899] [FATAL] [VALIDATOR ] ECG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:31:16.497991] [FATAL] [MAIN ] ECG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:31:16.498034] [WARN ] [MAIN ] ECG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:31:16.498072] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-25T18:31:16.498131] [DEBUG] [LOCAL ] ECG: No primary data file found to delete. [2025-09-25T18:31:16.498166] [INFO ] [LOCAL ] ECG: Starting deletion of derivative data. [2025-09-25T18:31:16.498509] [DEBUG] [LOCAL ] ECG: Deleted derivative data file. [2025-09-25T18:31:16.498610] [INFO ] [MAIN ] Update Progress: 689/2372 symbols completed. ECG took 30.3s. Estimated remaining: 3h 42m 50s. Rate: 7.6 symbols/min [2025-09-25T18:31:16.668744] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:16.694561] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-25T18:31:16.712559] [DEBUG] [LOCAL ] ECVT: Loaded 42992 existing records from primary storage. [2025-09-25T18:31:16.712713] [INFO ] [MAIN ] ECVT: Loaded 42992 existing records. [2025-09-25T18:31:16.893980] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:31:16.894231] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-25T18:31:16.894279] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-25T18:31:16.894545] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-25T18:31:16.894603] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-25T18:31:17.253056] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:17.488706] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-25T18:31:18.288735] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-25T18:31:18.471727] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T18:31:18.598062] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-25T18:31:19.008987] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T18:31:19.088765] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-25T18:31:19.692749] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T18:31:19.693592] [INFO ] [REMOTE ] ECCX: Full fetch complete (1500 records). [2025-09-25T18:31:19.693686] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-25T18:31:19.874575] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-25T18:31:19.874792] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:31:19.874859] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:31:19.874925] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-25T18:31:19.874989] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-25T18:31:19.875025] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-25T18:31:19.875065] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-25T18:31:19.875122] [INFO ] [MAIN ] Update Progress: 690/2372 symbols completed. ECCX took 35.3s. Estimated remaining: 3h 42m 31s. Rate: 7.6 symbols/min [2025-09-25T18:31:19.893897] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-25T18:31:20.056809] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:20.057024] [DEBUG] [LOCAL ] ED: No existing data file found in primary storage. [2025-09-25T18:31:20.057081] [WARN ] [MAIN ] ED: No existing data found, performing full refresh instead. [2025-09-25T18:31:20.057238] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-25T18:31:20.057284] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-25T18:31:20.057326] [DEBUG] [LOCAL ] ED: No primary data file found to delete. [2025-09-25T18:31:20.057360] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-25T18:31:20.428040] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:20.688711] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-25T18:31:21.315624] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:31:21.488709] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-25T18:31:22.288737] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-25T18:31:22.439077] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T18:31:22.645853] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:31:23.088701] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-25T18:31:23.874718] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T18:31:23.888670] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-25T18:31:24.582983] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:31:24.688712] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-25T18:31:25.199839] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T18:31:25.488766] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-25T18:31:26.239768] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:31:26.288703] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-25T18:31:26.422929] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T18:31:26.428785] [INFO ] [REMOTE ] ECO: Full fetch complete (29306 records). [2025-09-25T18:31:26.428911] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-25T18:31:26.840381] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-25T18:31:26.840462] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-25T18:31:26.841016] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-25T18:31:26.841080] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-25T18:31:26.841878] [DEBUG] [LOCAL ] ECO: Trimmed 29306 records to 18686 (keeping 200 days of data) [2025-09-25T18:31:26.961440] [DEBUG] [LOCAL ] ECO: Primary data saved (18686 records). [2025-09-25T18:31:26.961581] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-25T18:31:26.961687] [INFO ] [MAIN ] Update Progress: 691/2372 symbols completed. ECO took 31.3s. Estimated remaining: 3h 42m 21s. Rate: 7.6 symbols/min [2025-09-25T18:31:27.103782] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-25T18:31:27.136529] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:27.163190] [DEBUG] [LOCAL ] EDD: Loaded 27081 existing records from primary storage. [2025-09-25T18:31:27.163325] [INFO ] [MAIN ] EDD: Loaded 27081 existing records. [2025-09-25T18:31:27.346474] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:31:27.346756] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-25T18:31:27.346814] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-25T18:31:27.347050] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-25T18:31:27.347133] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-25T18:31:27.706440] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:27.888686] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-25T18:31:28.126262] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:31:28.134783] [INFO ] [REMOTE ] ECL: Full fetch complete (67397 records). [2025-09-25T18:31:28.134912] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-25T18:31:28.135681] [FATAL] [VALIDATOR ] ECL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:31:28.135769] [FATAL] [MAIN ] ECL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:31:28.135813] [WARN ] [MAIN ] ECL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:31:28.135935] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-25T18:31:28.136034] [DEBUG] [LOCAL ] ECL: No primary data file found to delete. [2025-09-25T18:31:28.136089] [INFO ] [LOCAL ] ECL: Starting deletion of derivative data. [2025-09-25T18:31:28.136352] [DEBUG] [LOCAL ] ECL: Deleted derivative data file. [2025-09-25T18:31:28.137616] [INFO ] [MAIN ] Update Progress: 692/2372 symbols completed. ECL took 35.6s. Estimated remaining: 3h 41m 56s. Rate: 7.6 symbols/min [2025-09-25T18:31:28.309628] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:28.330803] [DEBUG] [LOCAL ] EDF: Loaded 13507 existing records from primary storage. [2025-09-25T18:31:28.330955] [INFO ] [MAIN ] EDF: Loaded 13507 existing records. [2025-09-25T18:31:28.509508] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:31:28.509766] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-25T18:31:28.509817] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-25T18:31:28.510128] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-25T18:31:28.510187] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-25T18:31:28.723176] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-25T18:31:28.878370] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:28.954837] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T18:31:29.007609] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T18:31:29.488725] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-25T18:31:30.012986] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T18:31:30.288682] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-25T18:31:30.492220] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T18:31:31.088729] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-25T18:31:31.888740] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-25T18:31:31.996853] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:31:32.276397] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T18:31:32.688712] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-25T18:31:33.302016] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:31:33.351831] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T18:31:33.488783] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-25T18:31:34.288759] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-25T18:31:35.088688] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-25T18:31:35.449016] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:31:35.449109] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T18:31:35.888793] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-25T18:31:36.600821] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:31:36.688776] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-25T18:31:36.967237] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T18:31:37.488720] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-25T18:31:38.288750] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-25T18:31:38.485055] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T18:31:38.674273] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T18:31:39.088804] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-25T18:31:39.601075] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:31:39.888763] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-25T18:31:40.688703] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-25T18:31:40.974305] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T18:31:41.014048] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T18:31:41.488765] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-25T18:31:42.288770] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-25T18:31:42.559045] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T18:31:42.598982] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T18:31:43.088753] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-25T18:31:43.637815] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T18:31:43.646263] [INFO ] [REMOTE ] ECVT: Full fetch complete (59964 records). [2025-09-25T18:31:43.646383] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-25T18:31:43.893926] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-25T18:31:44.065286] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-25T18:31:44.066177] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-25T18:31:44.067206] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-25T18:31:44.066070] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T18:31:44.067410] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-25T18:31:44.073255] [DEBUG] [LOCAL ] ECVT: Trimmed 59964 records to 43297 (keeping 200 days of data) [2025-09-25T18:31:44.319745] [DEBUG] [LOCAL ] ECVT: Primary data saved (43297 records). [2025-09-25T18:31:44.319907] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-25T18:31:44.320002] [INFO ] [MAIN ] Update Progress: 693/2372 symbols completed. ECVT took 27.8s. Estimated remaining: 3h 42m 9s. Rate: 7.6 symbols/min [2025-09-25T18:31:44.493211] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:44.512024] [DEBUG] [LOCAL ] EDN: Loaded 18143 existing records from primary storage. [2025-09-25T18:31:44.512149] [INFO ] [MAIN ] EDN: Loaded 18143 existing records. [2025-09-25T18:31:44.691383] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-25T18:31:44.691252] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:31:44.693811] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-25T18:31:44.693955] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-25T18:31:44.694241] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-25T18:31:44.694302] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-25T18:31:45.072725] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:45.488775] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-25T18:31:45.620127] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:31:45.843116] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T18:31:46.288718] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-25T18:31:46.566577] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T18:31:47.088715] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-25T18:31:47.888739] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-25T18:31:48.177784] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T18:31:48.208086] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T18:31:48.481156] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T18:31:48.688715] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-25T18:31:49.488771] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-25T18:31:50.293979] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-25T18:31:50.295195] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T18:31:50.427353] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T18:31:51.088704] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-25T18:31:51.396574] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T18:31:51.888725] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-25T18:31:52.688724] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-25T18:31:52.962087] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T18:31:52.962634] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T18:31:52.976962] [INFO ] [REMOTE ] ED: Full fetch complete (76355 records). [2025-09-25T18:31:52.977149] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-25T18:31:53.374551] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-25T18:31:53.374661] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-25T18:31:53.375570] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-25T18:31:53.375683] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-25T18:31:53.378013] [DEBUG] [LOCAL ] ED: Trimmed 76355 records to 53169 (keeping 200 days of data) [2025-09-25T18:31:53.490128] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-25T18:31:53.739051] [DEBUG] [LOCAL ] ED: Primary data saved (53169 records). [2025-09-25T18:31:53.739203] [INFO ] [MAIN ] ED: Full history saved. [2025-09-25T18:31:53.739297] [INFO ] [MAIN ] Update Progress: 694/2372 symbols completed. ED took 33.9s. Estimated remaining: 3h 42m 4s. Rate: 7.6 symbols/min [2025-09-25T18:31:53.935131] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:53.936028] [DEBUG] [LOCAL ] EDU: No existing data file found in primary storage. [2025-09-25T18:31:53.936090] [WARN ] [MAIN ] EDU: No existing data found, performing full refresh instead. [2025-09-25T18:31:53.936350] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-25T18:31:53.936403] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-25T18:31:53.936447] [DEBUG] [LOCAL ] EDU: No primary data file found to delete. [2025-09-25T18:31:53.936490] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-25T18:31:54.103799] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:31:54.293906] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-25T18:31:54.372794] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:54.769858] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T18:31:54.774349] [INFO ] [REMOTE ] EDF: Full fetch complete (21042 records). [2025-09-25T18:31:54.774471] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-25T18:31:55.093870] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-25T18:31:55.169592] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-25T18:31:55.169934] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-25T18:31:55.170543] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-25T18:31:55.170609] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-25T18:31:55.172079] [DEBUG] [LOCAL ] EDF: Trimmed 21042 records to 13569 (keeping 200 days of data) [2025-09-25T18:31:55.259838] [DEBUG] [LOCAL ] EDF: Primary data saved (13569 records). [2025-09-25T18:31:55.259977] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-25T18:31:55.260123] [INFO ] [MAIN ] Update Progress: 695/2372 symbols completed. EDF took 27.1s. Estimated remaining: 3h 41m 41s. Rate: 7.6 symbols/min [2025-09-25T18:31:55.436923] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:31:55.437092] [DEBUG] [LOCAL ] EE: No existing data file found in primary storage. [2025-09-25T18:31:55.437146] [WARN ] [MAIN ] EE: No existing data found, performing full refresh instead. [2025-09-25T18:31:55.437286] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-25T18:31:55.437328] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-25T18:31:55.437369] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-25T18:31:55.437400] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-25T18:31:55.613742] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T18:31:55.848785] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:31:55.888719] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-25T18:31:56.427160] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T18:31:56.688761] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-25T18:31:57.185620] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T18:31:57.488818] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-25T18:31:57.905715] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:31:58.288758] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-25T18:31:58.794121] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T18:31:59.088732] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-25T18:31:59.452413] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T18:31:59.888767] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-25T18:32:00.688732] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-25T18:32:00.855862] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T18:32:00.908560] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T18:32:01.488795] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-25T18:32:01.588917] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T18:32:02.288808] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-25T18:32:03.088748] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-25T18:32:03.178193] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T18:32:03.327729] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T18:32:03.888686] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-25T18:32:04.024756] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T18:32:04.688717] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-25T18:32:05.051589] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T18:32:05.488731] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-25T18:32:06.207099] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T18:32:06.212861] [INFO ] [REMOTE ] EDD: Full fetch complete (38875 records). [2025-09-25T18:32:06.212957] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-25T18:32:06.293757] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-25T18:32:06.516884] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T18:32:06.646569] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-25T18:32:06.646680] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-25T18:32:06.647343] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-25T18:32:06.647425] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-25T18:32:06.649119] [DEBUG] [LOCAL ] EDD: Trimmed 38875 records to 27227 (keeping 200 days of data) [2025-09-25T18:32:06.828122] [DEBUG] [LOCAL ] EDD: Primary data saved (27227 records). [2025-09-25T18:32:06.828269] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-25T18:32:06.828403] [INFO ] [MAIN ] Update Progress: 696/2372 symbols completed. EDD took 39.9s. Estimated remaining: 3h 41m 42s. Rate: 7.6 symbols/min [2025-09-25T18:32:07.027769] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:07.035688] [DEBUG] [LOCAL ] EEA: Loaded 2702 existing records from primary storage. [2025-09-25T18:32:07.035797] [INFO ] [MAIN ] EEA: Loaded 2702 existing records. [2025-09-25T18:32:07.101385] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-25T18:32:07.244054] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:07.244364] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-25T18:32:07.244424] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-25T18:32:07.244622] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-25T18:32:07.244719] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-25T18:32:07.643761] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:07.888731] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-25T18:32:08.375587] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T18:32:08.490845] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T18:32:08.695204] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-25T18:32:08.710965] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:32:09.270270] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T18:32:09.488721] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-25T18:32:10.288731] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-25T18:32:10.734831] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T18:32:11.088696] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-25T18:32:11.454083] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T18:32:11.888733] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-25T18:32:12.393422] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T18:32:12.688714] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-25T18:32:13.146909] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T18:32:13.382734] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T18:32:13.488718] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-25T18:32:14.288729] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-25T18:32:14.755289] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T18:32:14.764694] [INFO ] [REMOTE ] EDN: Full fetch complete (30346 records). [2025-09-25T18:32:14.764913] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-25T18:32:14.766430] [FATAL] [VALIDATOR ] EDN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:32:14.766521] [FATAL] [MAIN ] EDN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:32:14.766565] [WARN ] [MAIN ] EDN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:32:14.766667] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-25T18:32:14.766769] [DEBUG] [LOCAL ] EDN: No primary data file found to delete. [2025-09-25T18:32:14.766834] [INFO ] [LOCAL ] EDN: Starting deletion of derivative data. [2025-09-25T18:32:14.767117] [DEBUG] [LOCAL ] EDN: Deleted derivative data file. [2025-09-25T18:32:14.767247] [INFO ] [MAIN ] Update Progress: 697/2372 symbols completed. EDN took 30.4s. Estimated remaining: 3h 41m 34s. Rate: 7.6 symbols/min [2025-09-25T18:32:14.947389] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:14.958721] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T18:32:14.976409] [DEBUG] [LOCAL ] EEX: Loaded 11999 existing records from primary storage. [2025-09-25T18:32:14.976571] [INFO ] [MAIN ] EEX: Loaded 11999 existing records. [2025-09-25T18:32:15.095071] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-25T18:32:15.189914] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:15.190168] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-25T18:32:15.190218] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-25T18:32:15.190431] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-25T18:32:15.190492] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-25T18:32:15.550045] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:15.725550] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T18:32:15.888741] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-25T18:32:16.390721] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-25T18:32:16.688738] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-25T18:32:17.488790] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-25T18:32:17.899840] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T18:32:18.288695] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-25T18:32:18.678791] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T18:32:19.088776] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-25T18:32:19.627512] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T18:32:19.829484] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T18:32:19.888695] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-25T18:32:20.450051] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-25T18:32:20.688714] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-25T18:32:21.273940] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T18:32:21.488712] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-25T18:32:22.069942] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T18:32:22.288758] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-25T18:32:22.865756] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T18:32:22.866783] [INFO ] [REMOTE ] EEA: Full fetch complete (3969 records). [2025-09-25T18:32:22.866855] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-25T18:32:22.867344] [FATAL] [VALIDATOR ] EEA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:32:22.867451] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:32:22.867504] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:32:22.867571] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-25T18:32:22.867639] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-09-25T18:32:22.867720] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-09-25T18:32:22.867980] [DEBUG] [LOCAL ] EEA: Deleted derivative data file. [2025-09-25T18:32:22.868091] [INFO ] [MAIN ] Update Progress: 698/2372 symbols completed. EEA took 16.0s. Estimated remaining: 3h 41m 26s. Rate: 7.6 symbols/min [2025-09-25T18:32:23.046473] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:23.088698] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-25T18:32:23.111820] [DEBUG] [LOCAL ] EFC: Loaded 46236 existing records from primary storage. [2025-09-25T18:32:23.112021] [INFO ] [MAIN ] EFC: Loaded 46236 existing records. [2025-09-25T18:32:23.295556] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:23.295848] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-25T18:32:23.295907] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-25T18:32:23.296196] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-25T18:32:23.296253] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-25T18:32:23.654917] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:23.888721] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-25T18:32:24.042986] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T18:32:24.688778] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-25T18:32:25.224380] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T18:32:25.488744] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-25T18:32:26.292876] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-25T18:32:26.297735] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T18:32:26.736457] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T18:32:26.745376] [INFO ] [REMOTE ] EE: Full fetch complete (43451 records). [2025-09-25T18:32:26.745573] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-25T18:32:26.746612] [FATAL] [VALIDATOR ] EE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:32:26.746737] [FATAL] [MAIN ] EE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:32:26.746844] [WARN ] [MAIN ] EE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:32:26.746923] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-25T18:32:26.747002] [DEBUG] [LOCAL ] EE: No primary data file found to delete. [2025-09-25T18:32:26.747056] [INFO ] [LOCAL ] EE: Starting deletion of derivative data. [2025-09-25T18:32:26.747127] [DEBUG] [LOCAL ] EE: No derivative data file found to delete. [2025-09-25T18:32:26.747202] [INFO ] [MAIN ] Update Progress: 699/2372 symbols completed. EE took 31.5s. Estimated remaining: 3h 41m 8s. Rate: 7.6 symbols/min [2025-09-25T18:32:26.951349] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:26.978021] [DEBUG] [LOCAL ] EFR: Loaded 14270 existing records from primary storage. [2025-09-25T18:32:26.978275] [INFO ] [MAIN ] EFR: Loaded 14270 existing records. [2025-09-25T18:32:27.095851] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-25T18:32:27.196845] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:27.197267] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-25T18:32:27.197329] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-25T18:32:27.197635] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-25T18:32:27.197739] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-25T18:32:27.411315] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T18:32:27.617615] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:27.888749] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-25T18:32:28.688851] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-25T18:32:28.790774] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T18:32:29.464697] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T18:32:29.488672] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-25T18:32:29.737346] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T18:32:30.288710] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-25T18:32:31.088695] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-25T18:32:31.099719] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:32:31.163488] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:32:31.888736] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-25T18:32:32.163445] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T18:32:32.688751] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-25T18:32:32.716192] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T18:32:33.459731] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T18:32:33.488661] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-25T18:32:34.288773] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-25T18:32:34.534119] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T18:32:35.088725] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-25T18:32:35.888720] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-25T18:32:36.039624] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T18:32:36.688747] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-25T18:32:37.053101] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T18:32:37.488781] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-25T18:32:37.527204] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T18:32:38.288716] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-25T18:32:38.595903] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T18:32:38.754039] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (2.87 seconds). [2025-09-25T18:32:39.088712] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-25T18:32:39.888686] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-25T18:32:39.920252] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:32:40.471939] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T18:32:40.550788] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T18:32:40.688747] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-25T18:32:41.488704] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-25T18:32:41.763172] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T18:32:41.765419] [INFO ] [REMOTE ] EEX: Full fetch complete (19763 records). [2025-09-25T18:32:41.765520] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-25T18:32:41.766073] [FATAL] [VALIDATOR ] EEX: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:32:41.766178] [FATAL] [MAIN ] EEX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:32:41.766220] [WARN ] [MAIN ] EEX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:32:41.766257] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-25T18:32:41.766327] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-09-25T18:32:41.766381] [INFO ] [LOCAL ] EEX: Starting deletion of derivative data. [2025-09-25T18:32:41.766670] [DEBUG] [LOCAL ] EEX: Deleted derivative data file. [2025-09-25T18:32:41.766793] [INFO ] [MAIN ] Update Progress: 700/2372 symbols completed. EEX took 27.0s. Estimated remaining: 3h 41m 17s. Rate: 7.6 symbols/min [2025-09-25T18:32:41.947129] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:41.947314] [DEBUG] [LOCAL ] EFT: No existing data file found in primary storage. [2025-09-25T18:32:41.947369] [WARN ] [MAIN ] EFT: No existing data found, performing full refresh instead. [2025-09-25T18:32:41.947519] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-25T18:32:41.947563] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-25T18:32:41.947604] [DEBUG] [LOCAL ] EFT: No primary data file found to delete. [2025-09-25T18:32:41.947636] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-25T18:32:42.298428] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-25T18:32:42.314585] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:42.521876] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T18:32:43.088724] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-25T18:32:43.888700] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-25T18:32:43.999105] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T18:32:44.201324] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T18:32:44.688740] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-25T18:32:45.488816] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-25T18:32:45.731025] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:32:45.740132] [INFO ] [REMOTE ] EDU: Full fetch complete (66433 records). [2025-09-25T18:32:45.740321] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-25T18:32:46.143684] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-25T18:32:46.143783] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-25T18:32:46.144597] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-25T18:32:46.144687] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-25T18:32:46.146250] [DEBUG] [LOCAL ] EDU: Trimmed 66433 records to 45333 (keeping 200 days of data) [2025-09-25T18:32:46.328734] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-25T18:32:46.380495] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T18:32:46.428347] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T18:32:46.493400] [DEBUG] [LOCAL ] EDU: Primary data saved (45333 records). [2025-09-25T18:32:46.493539] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-25T18:32:46.493618] [INFO ] [MAIN ] Update Progress: 701/2372 symbols completed. EDU took 52.8s. Estimated remaining: 3h 41m 2s. Rate: 7.6 symbols/min [2025-09-25T18:32:46.669869] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:46.716237] [DEBUG] [LOCAL ] EFX: Loaded 44808 existing records from primary storage. [2025-09-25T18:32:46.716392] [INFO ] [MAIN ] EFX: Loaded 44808 existing records. [2025-09-25T18:32:46.895193] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:46.895456] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-25T18:32:46.895516] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-25T18:32:46.895773] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-25T18:32:46.895843] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-25T18:32:47.094809] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-25T18:32:47.254382] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:47.459517] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T18:32:47.888780] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-25T18:32:48.500061] [DEBUG] [REMOTE ] EFR: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-09-25T18:32:48.500211] [WARN ] [REMOTE ] EFR: No data returned for month 2025-08 [2025-09-25T18:32:48.688732] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-25T18:32:48.834242] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T18:32:49.381742] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:32:49.385347] [INFO ] [REMOTE ] EFR: Full fetch complete (15836 records). [2025-09-25T18:32:49.385465] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-25T18:32:49.386050] [FATAL] [VALIDATOR ] EFR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:32:49.386144] [FATAL] [MAIN ] EFR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:32:49.386226] [WARN ] [MAIN ] EFR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:32:49.386317] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-25T18:32:49.386422] [DEBUG] [LOCAL ] EFR: No primary data file found to delete. [2025-09-25T18:32:49.386514] [INFO ] [LOCAL ] EFR: Starting deletion of derivative data. [2025-09-25T18:32:49.386866] [DEBUG] [LOCAL ] EFR: Deleted derivative data file. [2025-09-25T18:32:49.387001] [INFO ] [MAIN ] Update Progress: 702/2372 symbols completed. EFR took 22.6s. Estimated remaining: 3h 40m 42s. Rate: 7.6 symbols/min [2025-09-25T18:32:49.493938] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-25T18:32:49.573471] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:32:49.604218] [DEBUG] [LOCAL ] EFXT: Loaded 29316 existing records from primary storage. [2025-09-25T18:32:49.604385] [INFO ] [MAIN ] EFXT: Loaded 29316 existing records. [2025-09-25T18:32:49.786942] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:32:49.787221] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-25T18:32:49.787276] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-25T18:32:49.787513] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-25T18:32:49.787571] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-25T18:32:50.134728] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T18:32:50.211659] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:32:50.288735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-25T18:32:51.088792] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-25T18:32:51.569142] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:32:51.850453] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T18:32:51.888691] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-25T18:32:52.625493] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T18:32:52.688715] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-25T18:32:53.488781] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-25T18:32:54.288789] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-25T18:32:54.432916] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T18:32:54.464804] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T18:32:55.088774] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-25T18:32:55.586774] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T18:32:55.888748] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-25T18:32:56.688785] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-25T18:32:56.755521] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:32:57.095418] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T18:32:57.488695] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-25T18:32:57.805040] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T18:32:58.288765] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-25T18:32:58.891135] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:32:59.088795] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-25T18:32:59.888735] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-25T18:33:00.092896] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:33:00.688723] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-25T18:33:00.730842] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T18:33:01.094058] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T18:33:01.488683] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-25T18:33:01.596931] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T18:33:02.288736] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-25T18:33:02.969200] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T18:33:03.088698] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-25T18:33:03.214903] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T18:33:03.743134] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T18:33:03.745871] [INFO ] [REMOTE ] EFT: Full fetch complete (17415 records). [2025-09-25T18:33:03.746014] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-25T18:33:03.893754] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-25T18:33:04.122791] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-25T18:33:04.122872] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-25T18:33:04.123232] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-25T18:33:04.123270] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-25T18:33:04.123841] [DEBUG] [LOCAL ] EFT: Trimmed 17415 records to 12767 (keeping 200 days of data) [2025-09-25T18:33:04.207897] [DEBUG] [LOCAL ] EFT: Primary data saved (12767 records). [2025-09-25T18:33:04.208032] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-25T18:33:04.208131] [INFO ] [MAIN ] Update Progress: 703/2372 symbols completed. EFT took 22.4s. Estimated remaining: 3h 40m 50s. Rate: 7.6 symbols/min [2025-09-25T18:33:04.382876] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:04.413599] [DEBUG] [LOCAL ] EG: Loaded 28623 existing records from primary storage. [2025-09-25T18:33:04.413751] [INFO ] [MAIN ] EG: Loaded 28623 existing records. [2025-09-25T18:33:04.592318] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:04.592584] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-25T18:33:04.592676] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-25T18:33:04.592942] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-25T18:33:04.593003] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-25T18:33:04.694803] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-25T18:33:04.952876] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:05.488688] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-25T18:33:05.829031] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T18:33:06.095850] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T18:33:06.288709] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-25T18:33:06.857806] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:33:07.088735] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-25T18:33:07.888732] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-25T18:33:07.945273] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T18:33:08.085415] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T18:33:08.688767] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-25T18:33:09.488758] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-25T18:33:09.699763] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T18:33:09.708060] [INFO ] [REMOTE ] EFC: Full fetch complete (65906 records). [2025-09-25T18:33:09.708176] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-25T18:33:09.708985] [FATAL] [VALIDATOR ] EFC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:33:09.709075] [FATAL] [MAIN ] EFC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:33:09.709117] [WARN ] [MAIN ] EFC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:33:09.709155] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-25T18:33:09.709212] [DEBUG] [LOCAL ] EFC: No primary data file found to delete. [2025-09-25T18:33:09.709246] [INFO ] [LOCAL ] EFC: Starting deletion of derivative data. [2025-09-25T18:33:09.709522] [DEBUG] [LOCAL ] EFC: Deleted derivative data file. [2025-09-25T18:33:09.710352] [INFO ] [MAIN ] Update Progress: 704/2372 symbols completed. EFC took 46.8s. Estimated remaining: 3h 40m 37s. Rate: 7.6 symbols/min [2025-09-25T18:33:09.884816] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:09.884991] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-09-25T18:33:09.885027] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-09-25T18:33:09.885283] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-25T18:33:09.885402] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-25T18:33:09.885537] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-09-25T18:33:09.885673] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-25T18:33:10.256639] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:10.277049] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T18:33:10.288665] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-25T18:33:10.661958] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T18:33:11.088709] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-25T18:33:11.822828] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:33:11.888710] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-25T18:33:12.441061] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T18:33:12.688713] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-25T18:33:13.488727] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-25T18:33:13.531096] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T18:33:14.288738] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-25T18:33:14.320859] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T18:33:14.815695] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:33:15.088717] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-25T18:33:15.888699] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-25T18:33:16.075712] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T18:33:16.688761] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-25T18:33:16.917102] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T18:33:17.488734] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-25T18:33:18.083465] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T18:33:18.090473] [INFO ] [REMOTE ] EFXT: Full fetch complete (44277 records). [2025-09-25T18:33:18.090690] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-25T18:33:18.291063] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-25T18:33:18.521521] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-25T18:33:18.521638] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-25T18:33:18.522572] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-25T18:33:18.522750] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-25T18:33:18.554817] [DEBUG] [LOCAL ] EFXT: Trimmed 44277 records to 29578 (keeping 200 days of data) [2025-09-25T18:33:18.557016] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T18:33:18.763175] [DEBUG] [LOCAL ] EFXT: Primary data saved (29578 records). [2025-09-25T18:33:18.763702] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-25T18:33:18.763868] [INFO ] [MAIN ] Update Progress: 705/2372 symbols completed. EFXT took 29.4s. Estimated remaining: 3h 40m 31s. Rate: 7.6 symbols/min [2025-09-25T18:33:18.957136] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:18.996720] [DEBUG] [LOCAL ] EGP: Loaded 31184 existing records from primary storage. [2025-09-25T18:33:18.996908] [INFO ] [MAIN ] EGP: Loaded 31184 existing records. [2025-09-25T18:33:19.094053] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-25T18:33:19.180630] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:19.181125] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-25T18:33:19.181196] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-25T18:33:19.181458] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-25T18:33:19.181522] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-25T18:33:19.364348] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:33:19.595445] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:19.718041] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T18:33:19.888732] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-25T18:33:20.688707] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-25T18:33:20.917123] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T18:33:21.488700] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-25T18:33:21.732340] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T18:33:21.740718] [INFO ] [REMOTE ] EFX: Full fetch complete (64487 records). [2025-09-25T18:33:21.740846] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-25T18:33:22.159682] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-25T18:33:22.159380] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T18:33:22.159867] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-25T18:33:22.166687] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-25T18:33:22.166755] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-25T18:33:22.168031] [DEBUG] [LOCAL ] EFX: Trimmed 64487 records to 45166 (keeping 200 days of data) [2025-09-25T18:33:22.288872] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-25T18:33:22.457846] [DEBUG] [LOCAL ] EFX: Primary data saved (45166 records). [2025-09-25T18:33:22.458048] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-25T18:33:22.458154] [INFO ] [MAIN ] Update Progress: 706/2372 symbols completed. EFX took 36.0s. Estimated remaining: 3h 40m 13s. Rate: 7.6 symbols/min [2025-09-25T18:33:22.629883] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:22.668466] [DEBUG] [LOCAL ] EGY: Loaded 42252 existing records from primary storage. [2025-09-25T18:33:22.668603] [INFO ] [MAIN ] EGY: Loaded 42252 existing records. [2025-09-25T18:33:22.847208] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:22.847438] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-25T18:33:22.847485] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-25T18:33:22.847807] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-25T18:33:22.847866] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-25T18:33:23.103128] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-25T18:33:23.211508] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:23.446792] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-25T18:33:23.603569] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T18:33:23.888715] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-25T18:33:24.555580] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T18:33:24.688750] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-25T18:33:25.246530] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T18:33:25.488754] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-25T18:33:26.288694] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-25T18:33:26.447348] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T18:33:27.088700] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-25T18:33:27.260124] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T18:33:27.351573] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T18:33:27.888733] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-25T18:33:28.688697] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-25T18:33:28.898277] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T18:33:29.404604] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T18:33:29.488787] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-25T18:33:30.233612] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:33:30.288673] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-25T18:33:30.877767] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T18:33:31.088718] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-25T18:33:31.708237] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:33:31.888723] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-25T18:33:32.688755] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-25T18:33:32.775598] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T18:33:33.203441] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T18:33:33.488814] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-25T18:33:34.284517] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T18:33:34.294778] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-25T18:33:35.093863] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-25T18:33:35.104931] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:33:35.122239] [INFO ] [REMOTE ] EGO: Full fetch complete (73428 records). [2025-09-25T18:33:35.122588] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-25T18:33:35.560330] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-25T18:33:35.560450] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-25T18:33:35.561705] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-25T18:33:35.561778] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-25T18:33:35.563854] [DEBUG] [LOCAL ] EGO: Trimmed 73428 records to 51905 (keeping 200 days of data) [2025-09-25T18:33:35.819533] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T18:33:35.889291] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-25T18:33:35.939926] [DEBUG] [LOCAL ] EGO: Primary data saved (51905 records). [2025-09-25T18:33:35.940169] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-25T18:33:35.940284] [INFO ] [MAIN ] Update Progress: 707/2372 symbols completed. EGO took 26.2s. Estimated remaining: 3h 40m 19s. Rate: 7.6 symbols/min [2025-09-25T18:33:36.132319] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:36.165276] [DEBUG] [LOCAL ] EHAB: Loaded 29959 existing records from primary storage. [2025-09-25T18:33:36.165489] [INFO ] [MAIN ] EHAB: Loaded 29959 existing records. [2025-09-25T18:33:36.352440] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:36.352896] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-25T18:33:36.352956] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-25T18:33:36.353255] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-25T18:33:36.353369] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-25T18:33:36.701270] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-25T18:33:36.806713] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:36.839207] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T18:33:36.869981] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T18:33:37.488844] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-25T18:33:38.254382] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:33:38.288707] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-25T18:33:39.036542] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T18:33:39.088726] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-25T18:33:39.844071] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T18:33:39.888742] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-25T18:33:40.323627] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T18:33:40.688771] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-25T18:33:41.163534] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T18:33:41.488735] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-25T18:33:41.979328] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T18:33:42.296996] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-25T18:33:42.301011] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T18:33:43.088748] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-25T18:33:43.473352] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T18:33:43.888832] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-25T18:33:44.673473] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T18:33:44.688673] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-25T18:33:45.488794] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-25T18:33:45.875273] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T18:33:45.881580] [INFO ] [REMOTE ] EGP: Full fetch complete (45146 records). [2025-09-25T18:33:45.881801] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-25T18:33:45.882497] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:33:45.882595] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:33:45.882671] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:33:45.882736] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-25T18:33:45.883014] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-25T18:33:45.883334] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-09-25T18:33:45.883838] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-09-25T18:33:45.885237] [INFO ] [MAIN ] Update Progress: 708/2372 symbols completed. EGP took 27.1s. Estimated remaining: 3h 40m 15s. Rate: 7.6 symbols/min [2025-09-25T18:33:46.071867] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:46.121092] [DEBUG] [LOCAL ] EHC: Loaded 41408 existing records from primary storage. [2025-09-25T18:33:46.121307] [INFO ] [MAIN ] EHC: Loaded 41408 existing records. [2025-09-25T18:33:46.293923] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-25T18:33:46.332377] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:46.333239] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-25T18:33:46.333357] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-25T18:33:46.333800] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-25T18:33:46.333868] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-25T18:33:46.820574] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T18:33:46.829105] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T18:33:46.971893] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:47.088801] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-25T18:33:47.796174] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:33:47.802842] [INFO ] [REMOTE ] EG: Full fetch complete (43811 records). [2025-09-25T18:33:47.803093] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-25T18:33:47.893880] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-25T18:33:48.216881] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-25T18:33:48.216977] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-25T18:33:48.217833] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-25T18:33:48.217953] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-25T18:33:48.219205] [DEBUG] [LOCAL ] EG: Trimmed 43811 records to 28829 (keeping 200 days of data) [2025-09-25T18:33:48.424231] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T18:33:48.455014] [DEBUG] [LOCAL ] EG: Primary data saved (28829 records). [2025-09-25T18:33:48.455250] [INFO ] [MAIN ] EG: Full history saved. [2025-09-25T18:33:48.455372] [INFO ] [MAIN ] Update Progress: 709/2372 symbols completed. EG took 44.2s. Estimated remaining: 3h 39m 55s. Rate: 7.6 symbols/min [2025-09-25T18:33:48.650278] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:48.650530] [DEBUG] [LOCAL ] EHI: No existing data file found in primary storage. [2025-09-25T18:33:48.650568] [WARN ] [MAIN ] EHI: No existing data found, performing full refresh instead. [2025-09-25T18:33:48.650754] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-25T18:33:48.650810] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-25T18:33:48.650855] [DEBUG] [LOCAL ] EHI: No primary data file found to delete. [2025-09-25T18:33:48.650908] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-25T18:33:48.695964] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-25T18:33:49.074856] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:49.488818] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-25T18:33:49.621828] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T18:33:50.051025] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T18:33:50.288806] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-25T18:33:50.471300] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T18:33:51.088809] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-25T18:33:51.888768] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-25T18:33:51.956040] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T18:33:51.963822] [INFO ] [REMOTE ] EGY: Full fetch complete (61381 records). [2025-09-25T18:33:51.963987] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-25T18:33:51.964747] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:33:51.964841] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:33:51.964886] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:33:51.964925] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-25T18:33:51.965002] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-09-25T18:33:51.965061] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-09-25T18:33:51.965347] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-09-25T18:33:51.965455] [INFO ] [MAIN ] Update Progress: 710/2372 symbols completed. EGY took 29.5s. Estimated remaining: 3h 39m 36s. Rate: 7.6 symbols/min [2025-09-25T18:33:52.140537] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:33:52.164868] [DEBUG] [LOCAL ] EIC: Loaded 24078 existing records from primary storage. [2025-09-25T18:33:52.165033] [INFO ] [MAIN ] EIC: Loaded 24078 existing records. [2025-09-25T18:33:52.348918] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:33:52.349432] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-25T18:33:52.349763] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-25T18:33:52.357512] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-25T18:33:52.369504] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-25T18:33:52.370523] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:33:52.515578] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:33:52.693955] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-25T18:33:52.766934] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:33:53.488783] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-25T18:33:54.288729] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-25T18:33:54.389175] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T18:33:54.630433] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T18:33:55.088755] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-25T18:33:55.126636] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T18:33:55.888734] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-25T18:33:56.491993] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T18:33:56.688735] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-25T18:33:57.004129] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T18:33:57.434152] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T18:33:57.488715] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-25T18:33:58.288717] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-25T18:33:58.611512] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T18:33:59.088729] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-25T18:33:59.530422] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:33:59.888763] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-25T18:34:00.272347] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T18:34:00.688738] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-25T18:34:01.232254] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T18:34:01.488706] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-25T18:34:01.745980] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T18:34:02.288728] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-25T18:34:03.088699] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-25T18:34:03.170346] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:34:03.236994] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T18:34:03.888753] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-25T18:34:04.534240] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T18:34:04.688758] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-25T18:34:04.742795] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T18:34:05.488719] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-25T18:34:06.288761] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-25T18:34:06.567848] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T18:34:06.906988] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T18:34:06.924968] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T18:34:07.088732] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-25T18:34:07.893601] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-25T18:34:07.896283] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T18:34:08.688740] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-25T18:34:09.496900] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-25T18:34:09.501181] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T18:34:09.735049] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T18:34:09.737960] [INFO ] [REMOTE ] EHI: Full fetch complete (16325 records). [2025-09-25T18:34:09.738044] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-25T18:34:10.124836] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-25T18:34:10.124932] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-25T18:34:10.125298] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-25T18:34:10.125342] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-25T18:34:10.126194] [DEBUG] [LOCAL ] EHI: Trimmed 16325 records to 10411 (keeping 200 days of data) [2025-09-25T18:34:10.190126] [DEBUG] [LOCAL ] EHI: Primary data saved (10411 records). [2025-09-25T18:34:10.190286] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-25T18:34:10.190384] [INFO ] [MAIN ] Update Progress: 711/2372 symbols completed. EHI took 21.7s. Estimated remaining: 3h 39m 53s. Rate: 7.6 symbols/min [2025-09-25T18:34:10.293937] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-25T18:34:10.394891] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:10.395145] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-25T18:34:10.395194] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-25T18:34:10.395427] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-25T18:34:10.395483] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-25T18:34:10.395566] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-25T18:34:10.395614] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-25T18:34:10.761052] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:10.780177] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T18:34:10.785266] [INFO ] [REMOTE ] EHAB: Full fetch complete (41453 records). [2025-09-25T18:34:10.785379] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-25T18:34:11.093952] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-25T18:34:11.185256] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-25T18:34:11.185349] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-25T18:34:11.186216] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-25T18:34:11.186293] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-25T18:34:11.187353] [DEBUG] [LOCAL ] EHAB: Trimmed 41453 records to 30109 (keeping 200 days of data) [2025-09-25T18:34:11.371702] [DEBUG] [LOCAL ] EHAB: Primary data saved (30109 records). [2025-09-25T18:34:11.371875] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-25T18:34:11.371969] [INFO ] [MAIN ] Update Progress: 712/2372 symbols completed. EHAB took 35.4s. Estimated remaining: 3h 39m 29s. Rate: 7.6 symbols/min [2025-09-25T18:34:11.543130] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:11.543426] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-25T18:34:11.543548] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-25T18:34:11.543715] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-25T18:34:11.543766] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-25T18:34:11.543809] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-25T18:34:11.543841] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-25T18:34:11.670725] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T18:34:11.891765] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-25T18:34:11.920762] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:11.944124] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T18:34:12.688715] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-25T18:34:12.922182] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T18:34:13.066487] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-25T18:34:13.488711] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-25T18:34:13.765843] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-25T18:34:14.288722] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-25T18:34:14.572452] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-25T18:34:15.088737] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-25T18:34:15.473217] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-25T18:34:15.888720] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-25T18:34:16.688769] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-25T18:34:17.021489] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-25T18:34:17.193135] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T18:34:17.488735] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-25T18:34:18.031428] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T18:34:18.288763] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-25T18:34:18.599003] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-25T18:34:19.088692] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-25T18:34:19.484045] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-25T18:34:19.888817] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-25T18:34:20.335230] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T18:34:20.688765] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-25T18:34:21.488742] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-25T18:34:21.861951] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T18:34:22.059475] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T18:34:22.288721] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-25T18:34:23.088719] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-25T18:34:23.782048] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T18:34:23.888679] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-25T18:34:24.392547] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-25T18:34:24.393397] [INFO ] [REMOTE ] EICA: Full fetch complete (1269 records). [2025-09-25T18:34:24.393466] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-25T18:34:24.578606] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-25T18:34:24.578861] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:34:24.579021] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:34:24.579272] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-25T18:34:24.579412] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-25T18:34:24.579481] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-25T18:34:24.579715] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-25T18:34:24.579915] [INFO ] [MAIN ] Update Progress: 713/2372 symbols completed. EICA took 14.4s. Estimated remaining: 3h 39m 33s. Rate: 7.6 symbols/min [2025-09-25T18:34:24.695288] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-25T18:34:24.771789] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:24.783412] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-25T18:34:24.785069] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T18:34:24.784058] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-25T18:34:24.801024] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-25T18:34:24.801247] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-25T18:34:24.801758] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-25T18:34:24.802280] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-25T18:34:25.166144] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:25.488768] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-25T18:34:25.936336] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T18:34:25.951169] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T18:34:26.288766] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-25T18:34:26.920336] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T18:34:27.088743] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-25T18:34:27.516393] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T18:34:27.888779] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-25T18:34:28.408229] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-25T18:34:28.688738] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-25T18:34:29.110308] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T18:34:29.488771] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-25T18:34:30.288701] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-25T18:34:30.713516] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-25T18:34:30.945714] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T18:34:30.949623] [INFO ] [REMOTE ] EIC: Full fetch complete (35234 records). [2025-09-25T18:34:30.949741] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-25T18:34:31.093914] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-25T18:34:31.342220] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-25T18:34:31.342823] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-25T18:34:31.344088] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-25T18:34:31.344199] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-25T18:34:31.345488] [DEBUG] [LOCAL ] EIC: Trimmed 35234 records to 24164 (keeping 200 days of data) [2025-09-25T18:34:31.499667] [DEBUG] [LOCAL ] EIC: Primary data saved (24164 records). [2025-09-25T18:34:31.499800] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-25T18:34:31.499942] [INFO ] [MAIN ] Update Progress: 714/2372 symbols completed. EIC took 39.5s. Estimated remaining: 3h 39m 23s. Rate: 7.6 symbols/min [2025-09-25T18:34:31.672431] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:31.696664] [DEBUG] [LOCAL ] EIG: Loaded 20314 existing records from primary storage. [2025-09-25T18:34:31.696792] [INFO ] [MAIN ] EIG: Loaded 20314 existing records. [2025-09-25T18:34:31.874797] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:34:31.875019] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-25T18:34:31.875073] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-25T18:34:31.875521] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-25T18:34:31.875589] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-25T18:34:31.896312] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-25T18:34:32.244927] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:32.529490] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:34:32.656086] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T18:34:32.688667] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-25T18:34:33.153415] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T18:34:33.488776] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-25T18:34:34.056201] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T18:34:34.288740] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-25T18:34:34.923874] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:34:35.088721] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-25T18:34:35.547162] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T18:34:35.888716] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-25T18:34:36.563092] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T18:34:36.564216] [INFO ] [REMOTE ] EICB: Full fetch complete (2688 records). [2025-09-25T18:34:36.564291] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-25T18:34:36.693922] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-25T18:34:36.764107] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T18:34:36.764314] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:34:36.764384] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:34:36.764459] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-25T18:34:36.764545] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-25T18:34:36.764601] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-25T18:34:36.764672] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-25T18:34:36.764796] [INFO ] [MAIN ] Update Progress: 715/2372 symbols completed. EICB took 25.4s. Estimated remaining: 3h 39m 9s. Rate: 7.6 symbols/min [2025-09-25T18:34:36.955359] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:37.032991] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-09-25T18:34:37.033165] [INFO ] [MAIN ] EIX: Loaded 53339 existing records. [2025-09-25T18:34:37.222305] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:34:37.222671] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-25T18:34:37.222748] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-25T18:34:37.223084] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-25T18:34:37.223162] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-25T18:34:37.497811] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-25T18:34:37.582306] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:37.979842] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:34:38.032103] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-25T18:34:38.288808] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-25T18:34:39.088717] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-25T18:34:39.651494] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:34:39.894565] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-25T18:34:39.903837] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:34:39.913573] [INFO ] [REMOTE ] EHC: Full fetch complete (58919 records). [2025-09-25T18:34:39.913720] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-25T18:34:40.304901] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-25T18:34:40.304999] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-25T18:34:40.305929] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-25T18:34:40.305995] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-25T18:34:40.309254] [DEBUG] [LOCAL ] EHC: Trimmed 58919 records to 41649 (keeping 200 days of data) [2025-09-25T18:34:40.554476] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T18:34:40.600243] [DEBUG] [LOCAL ] EHC: Primary data saved (41649 records). [2025-09-25T18:34:40.600370] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-25T18:34:40.601055] [INFO ] [MAIN ] Update Progress: 716/2372 symbols completed. EHC took 54.7s. Estimated remaining: 3h 38m 51s. Rate: 7.6 symbols/min [2025-09-25T18:34:40.693837] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-25T18:34:40.782048] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:34:40.840094] [DEBUG] [LOCAL ] EL: Loaded 53403 existing records from primary storage. [2025-09-25T18:34:40.840260] [INFO ] [MAIN ] EL: Loaded 53403 existing records. [2025-09-25T18:34:41.026582] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:34:41.026962] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-25T18:34:41.027019] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-25T18:34:41.027275] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-25T18:34:41.027335] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-25T18:34:41.399530] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:34:41.488675] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-25T18:34:41.661277] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:34:42.208248] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T18:34:42.288694] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-25T18:34:42.848905] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T18:34:43.088719] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-25T18:34:43.888693] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-25T18:34:44.058041] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T18:34:44.688739] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-25T18:34:45.381151] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:34:45.383813] [INFO ] [REMOTE ] EICC: Full fetch complete (8006 records). [2025-09-25T18:34:45.384288] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-25T18:34:45.385506] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:34:45.385614] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:34:45.385724] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:34:45.385808] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-25T18:34:45.385884] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-25T18:34:45.385940] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-25T18:34:45.386041] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-09-25T18:34:45.386172] [INFO ] [MAIN ] Update Progress: 717/2372 symbols completed. EICC took 20.8s. Estimated remaining: 3h 38m 36s. Rate: 7.6 symbols/min [2025-09-25T18:34:45.488732] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-25T18:34:45.639770] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T18:34:46.288724] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-25T18:34:46.504317] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T18:34:47.088751] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-25T18:34:47.888735] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-25T18:34:48.737396] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-25T18:34:48.748358] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-25T18:34:48.972579] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T18:34:49.035891] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-25T18:34:49.488792] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-25T18:34:50.288838] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-25T18:34:50.492444] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T18:34:50.532011] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:34:51.088794] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-25T18:34:51.888790] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-25T18:34:52.046178] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:34:52.179522] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T18:34:52.688746] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-25T18:34:53.488767] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-25T18:34:53.750315] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T18:34:54.024353] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-25T18:34:54.288725] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-25T18:34:55.088688] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-25T18:34:55.304806] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T18:34:55.392824] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T18:34:55.888722] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-25T18:34:56.688740] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-25T18:34:57.581120] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-25T18:34:57.593298] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-25T18:34:57.853782] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T18:34:57.860234] [INFO ] [REMOTE ] EIG: Full fetch complete (27013 records). [2025-09-25T18:34:57.860457] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-25T18:34:58.314423] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-25T18:34:58.362036] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-25T18:34:58.519266] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-25T18:34:58.519408] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-25T18:34:58.520575] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-25T18:34:58.520861] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-25T18:34:58.522420] [DEBUG] [LOCAL ] EIG: Trimmed 27013 records to 20438 (keeping 200 days of data) [2025-09-25T18:34:58.679356] [DEBUG] [LOCAL ] EIG: Primary data saved (20438 records). [2025-09-25T18:34:58.679495] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-25T18:34:58.679606] [INFO ] [MAIN ] Update Progress: 718/2372 symbols completed. EIG took 27.2s. Estimated remaining: 3h 38m 41s. Rate: 7.6 symbols/min [2025-09-25T18:34:59.595813] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T18:34:59.608494] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-25T18:35:00.280425] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T18:35:00.291936] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-25T18:35:02.075405] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-25T18:35:02.087569] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-25T18:35:02.138974] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T18:35:02.150318] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-25T18:35:04.247005] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T18:35:04.297987] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T18:35:04.296137] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-25T18:35:04.315076] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-25T18:35:06.311149] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T18:35:06.328974] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-25T18:35:06.910914] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-25T18:35:06.924550] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-25T18:35:08.543953] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-25T18:35:08.556862] [INFO ] [REMOTE ] EIX: Full fetch complete (76956 records). [2025-09-25T18:35:08.557038] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-25T18:35:08.972628] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-25T18:35:08.973015] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-25T18:35:08.974064] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-25T18:35:08.974143] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-25T18:35:08.975943] [DEBUG] [LOCAL ] EIX: Trimmed 76956 records to 53725 (keeping 200 days of data) [2025-09-25T18:35:09.107870] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-25T18:35:09.126806] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-25T18:35:09.367627] [DEBUG] [LOCAL ] EIX: Primary data saved (53725 records). [2025-09-25T18:35:09.367803] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-25T18:35:09.368692] [INFO ] [MAIN ] Update Progress: 719/2372 symbols completed. EIX took 32.6s. Estimated remaining: 3h 38m 39s. Rate: 7.6 symbols/min [2025-09-25T18:35:11.119581] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T18:35:11.133513] [INFO ] [REMOTE ] EL: Full fetch complete (77331 records). [2025-09-25T18:35:11.133811] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-25T18:35:11.542327] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-25T18:35:11.542412] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-25T18:35:11.543338] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-25T18:35:11.543406] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-25T18:35:11.544997] [DEBUG] [LOCAL ] EL: Trimmed 77331 records to 53791 (keeping 200 days of data) [2025-09-25T18:35:11.898940] [DEBUG] [LOCAL ] EL: Primary data saved (53791 records). [2025-09-25T18:35:11.899115] [INFO ] [MAIN ] EL: Full history saved. [2025-09-25T18:35:11.899251] [INFO ] [MAIN ] Update Progress: 720/2372 symbols completed. EL took 31.3s. Estimated remaining: 3h 38m 19s. Rate: 7.6 symbols/min [2025-09-25T18:35:12.523389] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:12.499470] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:12.605595] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:12.660253] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:12.696299] [DEBUG] [LOCAL ] ELC: Loaded 3493 existing records from primary storage. [2025-09-25T18:35:12.706195] [INFO ] [MAIN ] ELC: Loaded 3493 existing records. [2025-09-25T18:35:12.863965] [DEBUG] [LOCAL ] ELME: Loaded 39255 existing records from primary storage. [2025-09-25T18:35:12.919725] [INFO ] [MAIN ] ELME: Loaded 39255 existing records. [2025-09-25T18:35:12.962818] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:12.968612] [DEBUG] [LOCAL ] ELF: Loaded 52280 existing records from primary storage. [2025-09-25T18:35:13.042024] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-25T18:35:13.047335] [INFO ] [MAIN ] ELF: Loaded 52280 existing records. [2025-09-25T18:35:13.052633] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-25T18:35:13.063293] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-25T18:35:13.103746] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-25T18:35:13.080132] [DEBUG] [LOCAL ] ELAN: Loaded 53207 existing records from primary storage. [2025-09-25T18:35:13.171808] [INFO ] [MAIN ] ELAN: Loaded 53207 existing records. [2025-09-25T18:35:13.424890] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:13.499110] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-25T18:35:13.531361] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-25T18:35:13.557553] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-25T18:35:13.616501] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-25T18:35:13.705043] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:13.835946] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-25T18:35:13.769719] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:13.866041] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-25T18:35:13.865966] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-25T18:35:13.891915] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-25T18:35:13.925200] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-25T18:35:13.908546] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-25T18:35:13.946508] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-25T18:35:13.925359] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-25T18:35:14.406201] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:14.436792] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-25T18:35:14.935284] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:14.961961] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-25T18:35:15.078758] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:15.100054] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-25T18:35:15.099816] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:15.101052] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-25T18:35:15.410013] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T18:35:15.411610] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-25T18:35:16.009248] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T18:35:16.010975] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-25T18:35:16.502952] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:35:16.504869] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-25T18:35:16.755997] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T18:35:16.764551] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-25T18:35:16.906616] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T18:35:16.917216] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-25T18:35:16.940135] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T18:35:16.942584] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-25T18:35:16.985371] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T18:35:16.996835] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-25T18:35:17.544339] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T18:35:17.546280] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-25T18:35:17.815418] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T18:35:17.822332] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-25T18:35:18.159125] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T18:35:18.161164] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-25T18:35:18.494369] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:35:18.507956] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-25T18:35:18.513516] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T18:35:18.516863] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-25T18:35:18.561454] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T18:35:19.088693] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-25T18:35:19.094832] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-25T18:35:19.294690] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T18:35:19.791830] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:35:19.888674] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-25T18:35:20.688735] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-25T18:35:21.133190] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T18:35:21.171863] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T18:35:21.488758] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-25T18:35:21.842021] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T18:35:21.969428] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T18:35:21.970634] [INFO ] [REMOTE ] ELC: Full fetch complete (5131 records). [2025-09-25T18:35:21.970732] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-25T18:35:22.293939] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-25T18:35:22.361736] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-25T18:35:22.361836] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-25T18:35:22.362009] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-25T18:35:22.362048] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-25T18:35:22.362436] [DEBUG] [LOCAL ] ELC: Trimmed 5131 records to 3504 (keeping 200 days of data) [2025-09-25T18:35:22.384703] [DEBUG] [LOCAL ] ELC: Primary data saved (3504 records). [2025-09-25T18:35:22.384801] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-25T18:35:22.384900] [INFO ] [MAIN ] Update Progress: 721/2372 symbols completed. ELC took 10.5s. Estimated remaining: 3h 38m 17s. Rate: 7.6 symbols/min [2025-09-25T18:35:22.595306] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:22.623406] [DEBUG] [LOCAL ] ELP: Loaded 25783 existing records from primary storage. [2025-09-25T18:35:22.623549] [INFO ] [MAIN ] ELP: Loaded 25783 existing records. [2025-09-25T18:35:22.819278] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:22.819638] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-25T18:35:22.819749] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-25T18:35:22.820010] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-25T18:35:22.820081] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-25T18:35:23.093838] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-25T18:35:23.189256] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:23.873155] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T18:35:23.888671] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-25T18:35:24.535534] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T18:35:24.688769] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-25T18:35:25.488727] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-25T18:35:26.133770] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-25T18:35:26.266537] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:35:26.288680] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-25T18:35:27.088759] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-25T18:35:27.461024] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T18:35:27.773721] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T18:35:27.888815] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-25T18:35:28.397514] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T18:35:28.688717] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-25T18:35:29.488824] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-25T18:35:29.746702] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T18:35:29.957551] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T18:35:30.288749] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-25T18:35:30.554752] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:35:31.088730] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-25T18:35:31.888681] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-25T18:35:32.039458] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T18:35:32.227429] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T18:35:32.688726] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-25T18:35:33.488726] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-25T18:35:34.033026] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T18:35:34.107432] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T18:35:34.288772] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-25T18:35:34.714753] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T18:35:35.088780] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-25T18:35:35.888687] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-25T18:35:36.120055] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T18:35:36.130016] [INFO ] [REMOTE ] ELAN: Full fetch complete (76856 records). [2025-09-25T18:35:36.130141] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-25T18:35:36.529943] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-25T18:35:36.530036] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-25T18:35:36.530947] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-25T18:35:36.531021] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-25T18:35:36.532700] [DEBUG] [LOCAL ] ELAN: Trimmed 76856 records to 53595 (keeping 200 days of data) [2025-09-25T18:35:36.711337] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-25T18:35:36.867314] [DEBUG] [LOCAL ] ELAN: Primary data saved (53595 records). [2025-09-25T18:35:36.867484] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-25T18:35:36.867609] [INFO ] [MAIN ] Update Progress: 722/2372 symbols completed. ELAN took 25.0s. Estimated remaining: 3h 38m 24s. Rate: 7.6 symbols/min [2025-09-25T18:35:37.065583] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:37.065903] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-25T18:35:37.066004] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-25T18:35:37.066250] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-25T18:35:37.066297] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-25T18:35:37.066338] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-25T18:35:37.066370] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-25T18:35:37.488627] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:37.489355] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-25T18:35:37.520323] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-25T18:35:37.587585] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T18:35:37.620388] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T18:35:38.112715] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T18:35:38.288773] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-25T18:35:38.775018] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T18:35:39.088776] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-25T18:35:39.888719] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-25T18:35:40.460490] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:35:40.506896] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T18:35:40.688743] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-25T18:35:41.488722] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-25T18:35:41.893406] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T18:35:42.288776] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-25T18:35:42.629997] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-25T18:35:43.088730] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-25T18:35:43.544205] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T18:35:43.680474] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-25T18:35:43.888723] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-25T18:35:44.234817] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T18:35:44.688757] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-25T18:35:45.488727] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-25T18:35:45.769770] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-25T18:35:46.002030] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T18:35:46.288736] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-25T18:35:47.088698] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-25T18:35:47.415193] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T18:35:47.888743] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-25T18:35:48.688740] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-25T18:35:48.858500] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T18:35:49.059435] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T18:35:49.063778] [INFO ] [REMOTE ] ELP: Full fetch complete (37602 records). [2025-09-25T18:35:49.063873] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-25T18:35:49.215264] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-25T18:35:49.446060] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-25T18:35:49.446179] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-25T18:35:49.446764] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-25T18:35:49.446825] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-25T18:35:49.447665] [DEBUG] [LOCAL ] ELP: Trimmed 37602 records to 25971 (keeping 200 days of data) [2025-09-25T18:35:49.496443] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-25T18:35:49.602085] [DEBUG] [LOCAL ] ELP: Primary data saved (25971 records). [2025-09-25T18:35:49.602242] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-25T18:35:49.602346] [INFO ] [MAIN ] Update Progress: 723/2372 symbols completed. ELP took 27.2s. Estimated remaining: 3h 38m 27s. Rate: 7.5 symbols/min [2025-09-25T18:35:49.772743] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:49.821588] [DEBUG] [LOCAL ] ELS: Loaded 49387 existing records from primary storage. [2025-09-25T18:35:49.821790] [INFO ] [MAIN ] ELS: Loaded 49387 existing records. [2025-09-25T18:35:49.999983] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:50.000268] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-25T18:35:50.000316] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-25T18:35:50.000701] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-25T18:35:50.000760] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-25T18:35:50.293892] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-25T18:35:50.361233] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:50.697812] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-25T18:35:51.088768] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-25T18:35:51.894070] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-25T18:35:51.929920] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-25T18:35:52.302298] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-25T18:35:52.303505] [INFO ] [REMOTE ] ELPC: Full fetch complete (1485 records). [2025-09-25T18:35:52.303588] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-25T18:35:52.514867] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-25T18:35:52.530758] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:35:52.531720] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:35:52.531803] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-25T18:35:52.531921] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-25T18:35:52.533406] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-25T18:35:52.533280] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T18:35:52.533601] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-25T18:35:52.533903] [INFO ] [MAIN ] Update Progress: 724/2372 symbols completed. ELPC took 15.7s. Estimated remaining: 3h 38m 7s. Rate: 7.6 symbols/min [2025-09-25T18:35:52.607208] [INFO ] [REMOTE ] ELME: Full fetch complete (55792 records). [2025-09-25T18:35:52.618849] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-25T18:35:52.693937] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-25T18:35:52.803693] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:53.151342] [DEBUG] [LOCAL ] ELV: Loaded 50586 existing records from primary storage. [2025-09-25T18:35:53.154349] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-25T18:35:53.154471] [INFO ] [MAIN ] ELV: Loaded 50586 existing records. [2025-09-25T18:35:53.198083] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-25T18:35:53.225760] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-25T18:35:53.236767] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-25T18:35:53.270402] [DEBUG] [LOCAL ] ELME: Trimmed 55792 records to 39528 (keeping 200 days of data) [2025-09-25T18:35:53.465107] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:53.466773] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-25T18:35:53.467095] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-25T18:35:53.468007] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-25T18:35:53.468087] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-25T18:35:53.499948] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-25T18:35:53.860559] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:54.018913] [DEBUG] [LOCAL ] ELME: Primary data saved (39528 records). [2025-09-25T18:35:54.019083] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-25T18:35:54.020532] [INFO ] [MAIN ] Update Progress: 725/2372 symbols completed. ELME took 42.1s. Estimated remaining: 3h 37m 45s. Rate: 7.6 symbols/min [2025-09-25T18:35:54.205005] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:54.205200] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-25T18:35:54.205257] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-25T18:35:54.205402] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-25T18:35:54.205446] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-25T18:35:54.205489] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-25T18:35:54.205522] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-25T18:35:54.291946] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-25T18:35:54.595165] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:54.625308] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T18:35:55.088758] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-25T18:35:55.527803] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T18:35:55.888759] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-25T18:35:56.280309] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T18:35:56.638977] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T18:35:56.688763] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-25T18:35:56.897848] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:35:56.898170] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-25T18:35:57.488730] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-25T18:35:57.682302] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:35:57.682786] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-25T18:35:57.768387] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T18:35:57.778213] [INFO ] [REMOTE ] ELF: Full fetch complete (75387 records). [2025-09-25T18:35:57.778382] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-25T18:35:58.181611] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-25T18:35:58.181721] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-25T18:35:58.182578] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-25T18:35:58.182621] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-25T18:35:58.184109] [DEBUG] [LOCAL ] ELF: Trimmed 75387 records to 52663 (keeping 200 days of data) [2025-09-25T18:35:58.288704] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-25T18:35:58.509955] [DEBUG] [LOCAL ] ELF: Primary data saved (52663 records). [2025-09-25T18:35:58.510096] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-25T18:35:58.510185] [INFO ] [MAIN ] Update Progress: 726/2372 symbols completed. ELF took 46.6s. Estimated remaining: 3h 37m 29s. Rate: 7.6 symbols/min [2025-09-25T18:35:58.684537] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:35:58.707275] [DEBUG] [LOCAL ] EMD: Loaded 21032 existing records from primary storage. [2025-09-25T18:35:58.707413] [INFO ] [MAIN ] EMD: Loaded 21032 existing records. [2025-09-25T18:35:58.894717] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:35:58.894957] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-25T18:35:58.895004] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-25T18:35:58.895270] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-25T18:35:58.895330] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-25T18:35:59.097589] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-25T18:35:59.261292] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:35:59.800619] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:35:59.801002] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-25T18:35:59.836535] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T18:35:59.888682] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-25T18:36:00.688710] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-25T18:36:01.351813] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T18:36:01.488735] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-25T18:36:02.288821] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-25T18:36:02.492370] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:36:02.492780] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-25T18:36:02.818124] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-25T18:36:03.088707] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-25T18:36:03.281474] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T18:36:03.888725] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-25T18:36:03.941092] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T18:36:04.688723] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-25T18:36:05.488729] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-25T18:36:05.576165] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T18:36:05.792250] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T18:36:06.288733] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-25T18:36:07.088725] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-25T18:36:07.364307] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T18:36:07.844816] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T18:36:07.888735] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-25T18:36:08.235814] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:36:08.236309] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-25T18:36:08.265226] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T18:36:08.688722] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-25T18:36:09.488718] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-25T18:36:10.288727] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-25T18:36:10.373391] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T18:36:10.571152] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T18:36:10.844393] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:36:11.088688] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-25T18:36:11.888732] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-25T18:36:12.688740] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-25T18:36:13.033154] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T18:36:13.105055] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T18:36:13.205627] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T18:36:13.488675] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-25T18:36:14.288715] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-25T18:36:14.339008] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T18:36:15.088719] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-25T18:36:15.888738] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-25T18:36:16.274254] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T18:36:16.688756] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-25T18:36:16.853232] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T18:36:17.373437] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-25T18:36:17.488706] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-25T18:36:17.715963] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T18:36:18.288766] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-25T18:36:19.088705] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-25T18:36:19.280914] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T18:36:19.393626] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T18:36:19.777784] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:36:19.781356] [INFO ] [REMOTE ] EMA: Full fetch complete (8166 records). [2025-09-25T18:36:19.781439] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-25T18:36:19.893794] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-25T18:36:19.968182] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 84 unique days, need 200 days [2025-09-25T18:36:19.968516] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:36:19.968583] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:36:19.968678] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-25T18:36:19.968772] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-25T18:36:19.968827] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-25T18:36:19.968870] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-25T18:36:19.968930] [INFO ] [MAIN ] Update Progress: 727/2372 symbols completed. EMA took 25.9s. Estimated remaining: 3h 37m 52s. Rate: 7.6 symbols/min [2025-09-25T18:36:20.144457] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:20.185535] [DEBUG] [LOCAL ] EME: Loaded 31647 existing records from primary storage. [2025-09-25T18:36:20.185724] [INFO ] [MAIN ] EME: Loaded 31647 existing records. [2025-09-25T18:36:20.367720] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:20.367964] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-25T18:36:20.368012] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-25T18:36:20.368271] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-25T18:36:20.368333] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-25T18:36:20.694760] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-25T18:36:20.739249] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:21.047809] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T18:36:21.488743] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-25T18:36:22.288684] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-25T18:36:22.667467] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T18:36:22.671525] [INFO ] [REMOTE ] EMD: Full fetch complete (32217 records). [2025-09-25T18:36:22.671603] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-25T18:36:23.058991] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-25T18:36:23.059085] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-25T18:36:23.059745] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-25T18:36:23.059806] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-25T18:36:23.060564] [DEBUG] [LOCAL ] EMD: Trimmed 32217 records to 21179 (keeping 200 days of data) [2025-09-25T18:36:23.124346] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-25T18:36:23.197049] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-25T18:36:23.251742] [DEBUG] [LOCAL ] EMD: Primary data saved (21179 records). [2025-09-25T18:36:23.251928] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-25T18:36:23.252027] [INFO ] [MAIN ] Update Progress: 728/2372 symbols completed. EMD took 24.7s. Estimated remaining: 3h 37m 33s. Rate: 7.6 symbols/min [2025-09-25T18:36:23.422829] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:23.429247] [DEBUG] [LOCAL ] EMF: Loaded 3547 existing records from primary storage. [2025-09-25T18:36:23.429351] [INFO ] [MAIN ] EMF: Loaded 3547 existing records. [2025-09-25T18:36:23.676683] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:23.676952] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-25T18:36:23.677002] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-25T18:36:23.677206] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-25T18:36:23.677266] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-25T18:36:23.899381] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-25T18:36:24.055564] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:24.090336] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:36:24.656638] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:36:24.688721] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-25T18:36:25.488694] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-25T18:36:25.906621] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T18:36:25.971971] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:36:26.288698] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-25T18:36:26.329597] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T18:36:27.088718] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-25T18:36:27.888740] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-25T18:36:28.161795] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T18:36:28.644729] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T18:36:28.688675] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-25T18:36:29.407743] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T18:36:29.488699] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-25T18:36:30.073327] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-25T18:36:30.083113] [INFO ] [REMOTE ] ELV: Full fetch complete (73235 records). [2025-09-25T18:36:30.083266] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-25T18:36:30.294965] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-25T18:36:30.483273] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-25T18:36:30.483355] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-25T18:36:30.484252] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-25T18:36:30.484317] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-25T18:36:30.485774] [DEBUG] [LOCAL ] ELV: Trimmed 73235 records to 50969 (keeping 200 days of data) [2025-09-25T18:36:30.812617] [DEBUG] [LOCAL ] ELV: Primary data saved (50969 records). [2025-09-25T18:36:30.812773] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-25T18:36:30.812896] [INFO ] [MAIN ] Update Progress: 729/2372 symbols completed. ELV took 38.3s. Estimated remaining: 3h 37m 24s. Rate: 7.6 symbols/min [2025-09-25T18:36:30.856386] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T18:36:30.957441] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T18:36:31.039898] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:31.086237] [DEBUG] [LOCAL ] EMN: Loaded 50362 existing records from primary storage. [2025-09-25T18:36:31.086392] [INFO ] [MAIN ] EMN: Loaded 50362 existing records. [2025-09-25T18:36:31.097302] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-25T18:36:31.270925] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:31.271181] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-25T18:36:31.271230] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-25T18:36:31.271466] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-25T18:36:31.271525] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-25T18:36:31.632097] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:31.888778] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-25T18:36:32.688735] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-25T18:36:32.808960] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T18:36:33.465594] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T18:36:33.488714] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-25T18:36:33.684458] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T18:36:34.095433] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T18:36:34.288752] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-25T18:36:34.833137] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-25T18:36:35.088731] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-25T18:36:35.888775] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-25T18:36:36.688749] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-25T18:36:36.956431] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T18:36:36.966937] [INFO ] [REMOTE ] ELS: Full fetch complete (70566 records). [2025-09-25T18:36:36.967083] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-25T18:36:37.092159] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T18:36:37.419850] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-25T18:36:37.419973] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-25T18:36:37.421048] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-25T18:36:37.421220] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-25T18:36:37.423186] [DEBUG] [LOCAL ] ELS: Trimmed 70566 records to 49758 (keeping 200 days of data) [2025-09-25T18:36:37.488886] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-25T18:36:37.559798] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:36:37.783398] [DEBUG] [LOCAL ] ELS: Primary data saved (49758 records). [2025-09-25T18:36:37.783566] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-25T18:36:37.783686] [INFO ] [MAIN ] Update Progress: 730/2372 symbols completed. ELS took 48.2s. Estimated remaining: 3h 37m 14s. Rate: 7.6 symbols/min [2025-09-25T18:36:37.954365] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:37.968603] [DEBUG] [LOCAL ] EMO: Loaded 12415 existing records from primary storage. [2025-09-25T18:36:37.968761] [INFO ] [MAIN ] EMO: Loaded 12415 existing records. [2025-09-25T18:36:38.144912] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T18:36:38.160387] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:38.161151] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-25T18:36:38.161201] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-25T18:36:38.161486] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-25T18:36:38.161545] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-25T18:36:38.300195] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-25T18:36:38.542927] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:39.088723] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-25T18:36:39.896460] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-25T18:36:39.899226] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T18:36:40.276518] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T18:36:40.441783] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T18:36:40.688734] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-25T18:36:41.488710] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-25T18:36:41.523543] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T18:36:42.288781] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-25T18:36:42.859820] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T18:36:42.860930] [INFO ] [REMOTE ] EMF: Full fetch complete (7305 records). [2025-09-25T18:36:42.861001] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-25T18:36:43.091793] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-25T18:36:43.236513] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-25T18:36:43.236683] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-25T18:36:43.237053] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-25T18:36:43.237132] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-25T18:36:43.255152] [DEBUG] [LOCAL ] EMF: Trimmed 7305 records to 3558 (keeping 200 days of data) [2025-09-25T18:36:43.256629] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T18:36:43.285678] [DEBUG] [LOCAL ] EMF: Primary data saved (3558 records). [2025-09-25T18:36:43.285779] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-25T18:36:43.285855] [INFO ] [MAIN ] Update Progress: 731/2372 symbols completed. EMF took 20.0s. Estimated remaining: 3h 37m 1s. Rate: 7.6 symbols/min [2025-09-25T18:36:43.457175] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:43.462434] [DEBUG] [LOCAL ] EMP: Loaded 3041 existing records from primary storage. [2025-09-25T18:36:43.462520] [INFO ] [MAIN ] EMP: Loaded 3041 existing records. [2025-09-25T18:36:43.651460] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:43.651886] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-25T18:36:43.651965] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-25T18:36:43.652281] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-25T18:36:43.652388] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-25T18:36:43.901304] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-25T18:36:44.025743] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T18:36:44.029400] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:44.688770] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-25T18:36:45.488703] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-25T18:36:45.565875] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T18:36:45.780786] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T18:36:46.288745] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-25T18:36:46.932146] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T18:36:47.088715] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-25T18:36:47.114811] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:36:47.888762] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-25T18:36:47.969287] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T18:36:48.688740] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-25T18:36:49.260751] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T18:36:49.293208] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T18:36:49.488719] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-25T18:36:49.898932] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T18:36:50.288754] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-25T18:36:51.088712] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-25T18:36:51.155573] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T18:36:51.888712] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-25T18:36:52.358469] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T18:36:52.413323] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T18:36:52.688741] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-25T18:36:53.488761] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-25T18:36:53.671505] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T18:36:53.940071] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-25T18:36:54.288737] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-25T18:36:55.088721] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-25T18:36:55.712501] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T18:36:55.888689] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-25T18:36:56.184704] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T18:36:56.610630] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T18:36:56.688721] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-25T18:36:57.488773] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-25T18:36:58.288701] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-25T18:36:58.402840] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T18:36:58.410257] [INFO ] [REMOTE ] EME: Full fetch complete (46778 records). [2025-09-25T18:36:58.410384] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-25T18:36:58.411124] [FATAL] [VALIDATOR ] EME: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:36:58.411211] [FATAL] [MAIN ] EME: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:36:58.411253] [WARN ] [MAIN ] EME: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:36:58.411291] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-25T18:36:58.411348] [DEBUG] [LOCAL ] EME: No primary data file found to delete. [2025-09-25T18:36:58.411383] [INFO ] [LOCAL ] EME: Starting deletion of derivative data. [2025-09-25T18:36:58.411811] [DEBUG] [LOCAL ] EME: Deleted derivative data file. [2025-09-25T18:36:58.412254] [INFO ] [MAIN ] Update Progress: 732/2372 symbols completed. EME took 38.4s. Estimated remaining: 3h 37m 9s. Rate: 7.6 symbols/min [2025-09-25T18:36:58.585090] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:58.646621] [DEBUG] [LOCAL ] EMR: Loaded 53249 existing records from primary storage. [2025-09-25T18:36:58.646814] [INFO ] [MAIN ] EMR: Loaded 53249 existing records. [2025-09-25T18:36:58.760613] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T18:36:58.820539] [INFO ] [REMOTE ] EMO: Full fetch complete (17147 records). [2025-09-25T18:36:58.842307] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-25T18:36:58.904768] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:36:58.949396] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-25T18:36:58.954593] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-25T18:36:58.976892] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-25T18:36:58.976967] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-25T18:36:59.092303] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-25T18:36:59.517783] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-25T18:36:59.537153] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-25T18:36:59.541081] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-25T18:36:59.541485] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-25T18:36:59.633220] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:36:59.622034] [DEBUG] [LOCAL ] EMO: Trimmed 17147 records to 12593 (keeping 200 days of data) [2025-09-25T18:36:59.737633] [DEBUG] [LOCAL ] EMO: Primary data saved (12593 records). [2025-09-25T18:36:59.738037] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-25T18:36:59.738265] [INFO ] [MAIN ] Update Progress: 733/2372 symbols completed. EMO took 22.0s. Estimated remaining: 3h 36m 46s. Rate: 7.6 symbols/min [2025-09-25T18:36:59.900868] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-25T18:36:59.943843] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:36:59.983598] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T18:37:00.035228] [DEBUG] [LOCAL ] ENB: Loaded 53516 existing records from primary storage. [2025-09-25T18:37:00.035432] [INFO ] [MAIN ] ENB: Loaded 53516 existing records. [2025-09-25T18:37:00.102126] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T18:37:00.228855] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:37:00.229123] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-25T18:37:00.229207] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-25T18:37:00.229685] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-25T18:37:00.229756] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-25T18:37:00.581741] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:00.688698] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-25T18:37:01.488724] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-25T18:37:02.014423] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T18:37:02.041828] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-25T18:37:02.288771] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-25T18:37:02.599544] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T18:37:03.088745] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-25T18:37:03.629466] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T18:37:03.888750] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-25T18:37:04.212988] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T18:37:04.688716] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-25T18:37:05.488773] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-25T18:37:05.569633] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:37:06.288684] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-25T18:37:06.593677] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T18:37:07.088712] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-25T18:37:07.137745] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T18:37:07.888754] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-25T18:37:08.131559] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T18:37:08.688706] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-25T18:37:09.001565] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T18:37:09.488699] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-25T18:37:09.752637] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T18:37:10.014031] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:37:10.089844] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T18:37:10.288705] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-25T18:37:11.088784] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-25T18:37:11.617393] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T18:37:11.618613] [INFO ] [REMOTE ] EMP: Full fetch complete (4282 records). [2025-09-25T18:37:11.618735] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-25T18:37:11.893959] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-25T18:37:11.998314] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-25T18:37:11.998433] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-25T18:37:11.998766] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-25T18:37:11.998851] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-25T18:37:11.999581] [DEBUG] [LOCAL ] EMP: Trimmed 4282 records to 3055 (keeping 200 days of data) [2025-09-25T18:37:12.021955] [DEBUG] [LOCAL ] EMP: Primary data saved (3055 records). [2025-09-25T18:37:12.022079] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-25T18:37:12.022253] [INFO ] [MAIN ] Update Progress: 734/2372 symbols completed. EMP took 28.7s. Estimated remaining: 3h 36m 48s. Rate: 7.6 symbols/min [2025-09-25T18:37:12.198433] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:12.198806] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-09-25T18:37:12.198990] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-09-25T18:37:12.199247] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-25T18:37:12.199301] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-25T18:37:12.199347] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-25T18:37:12.199407] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-25T18:37:12.614148] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:12.616610] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-25T18:37:12.688707] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-25T18:37:13.489178] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-25T18:37:13.982038] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T18:37:13.995937] [INFO ] [REMOTE ] EMN: Full fetch complete (71967 records). [2025-09-25T18:37:13.996101] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-25T18:37:14.294733] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-25T18:37:14.395537] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-25T18:37:14.395628] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-25T18:37:14.396555] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-25T18:37:14.396623] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-25T18:37:14.400610] [DEBUG] [LOCAL ] EMN: Trimmed 71967 records to 50743 (keeping 200 days of data) [2025-09-25T18:37:14.681752] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T18:37:14.794293] [DEBUG] [LOCAL ] EMN: Primary data saved (50743 records). [2025-09-25T18:37:14.794448] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-25T18:37:14.794554] [INFO ] [MAIN ] Update Progress: 735/2372 symbols completed. EMN took 44.0s. Estimated remaining: 3h 36m 29s. Rate: 7.6 symbols/min [2025-09-25T18:37:14.966464] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:15.011015] [DEBUG] [LOCAL ] ENIC: Loaded 36528 existing records from primary storage. [2025-09-25T18:37:15.011155] [INFO ] [MAIN ] ENIC: Loaded 36528 existing records. [2025-09-25T18:37:15.101991] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-25T18:37:15.194234] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:37:15.194471] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-25T18:37:15.194517] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-25T18:37:15.194959] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-25T18:37:15.195020] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-25T18:37:15.474255] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T18:37:15.608007] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:15.642801] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-25T18:37:15.888707] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-25T18:37:16.688706] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-25T18:37:17.010053] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T18:37:17.292584] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T18:37:17.488735] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-25T18:37:18.288792] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-25T18:37:18.711588] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T18:37:19.049120] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T18:37:19.088672] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-25T18:37:19.454843] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T18:37:19.888710] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-25T18:37:20.485096] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T18:37:20.544281] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T18:37:20.688706] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-25T18:37:21.488757] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-25T18:37:21.845018] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:37:22.288733] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-25T18:37:22.720968] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T18:37:23.088683] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-25T18:37:23.377042] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T18:37:23.491076] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-25T18:37:23.888748] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-25T18:37:24.362749] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T18:37:24.688770] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-25T18:37:25.488781] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-25T18:37:26.243828] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T18:37:26.288685] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-25T18:37:26.698216] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T18:37:26.912321] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T18:37:27.088708] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-25T18:37:27.888728] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-25T18:37:28.376090] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T18:37:28.688768] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-25T18:37:28.984561] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T18:37:28.994597] [INFO ] [REMOTE ] EMR: Full fetch complete (77104 records). [2025-09-25T18:37:28.994765] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-25T18:37:29.399857] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-25T18:37:29.399506] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T18:37:29.401412] [INFO ] [REMOTE ] ENFY: Full fetch complete (5590 records). [2025-09-25T18:37:29.400071] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-25T18:37:29.402591] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-25T18:37:29.401592] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-25T18:37:29.402752] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-25T18:37:29.492907] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-25T18:37:29.526390] [DEBUG] [LOCAL ] EMR: Trimmed 77104 records to 53639 (keeping 200 days of data) [2025-09-25T18:37:29.908780] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-25T18:37:29.909342] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-25T18:37:29.909859] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-25T18:37:29.909939] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-25T18:37:29.912179] [DEBUG] [LOCAL ] ENFY: Trimmed 5590 records to 3060 (keeping 200 days of data) [2025-09-25T18:37:29.936917] [DEBUG] [LOCAL ] ENFY: Primary data saved (3060 records). [2025-09-25T18:37:29.937552] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-25T18:37:29.937939] [INFO ] [MAIN ] Update Progress: 736/2372 symbols completed. ENFY took 17.9s. Estimated remaining: 3h 36m 37s. Rate: 7.6 symbols/min [2025-09-25T18:37:30.141840] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:30.152400] [DEBUG] [LOCAL ] ENO: Loaded 1940 existing records from primary storage. [2025-09-25T18:37:30.155123] [INFO ] [MAIN ] ENO: Loaded 1940 existing records. [2025-09-25T18:37:30.347025] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-25T18:37:30.443952] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:37:30.444832] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-25T18:37:30.445529] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-25T18:37:30.447375] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-25T18:37:30.447694] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-25T18:37:30.796391] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T18:37:30.906929] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:30.997759] [DEBUG] [LOCAL ] EMR: Primary data saved (53639 records). [2025-09-25T18:37:30.997906] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-25T18:37:30.998357] [INFO ] [MAIN ] Update Progress: 737/2372 symbols completed. EMR took 32.6s. Estimated remaining: 3h 36m 13s. Rate: 7.6 symbols/min [2025-09-25T18:37:31.093829] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-25T18:37:31.178522] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:31.225981] [DEBUG] [LOCAL ] ENOV: Loaded 45200 existing records from primary storage. [2025-09-25T18:37:31.226120] [INFO ] [MAIN ] ENOV: Loaded 45200 existing records. [2025-09-25T18:37:31.410634] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:37:31.410926] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-25T18:37:31.410980] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-25T18:37:31.411184] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-25T18:37:31.411243] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-25T18:37:31.768069] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:31.889747] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T18:37:31.889529] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-25T18:37:32.267288] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T18:37:32.688730] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-25T18:37:33.402028] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T18:37:33.488679] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-25T18:37:33.875230] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T18:37:34.288718] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-25T18:37:34.622268] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T18:37:34.748280] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T18:37:35.088725] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-25T18:37:35.888721] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-25T18:37:36.688801] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-25T18:37:37.103184] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T18:37:37.355610] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T18:37:37.488788] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-25T18:37:38.213111] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T18:37:38.288791] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-25T18:37:38.838168] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T18:37:39.088785] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-25T18:37:39.705739] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T18:37:39.888714] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-25T18:37:40.688696] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-25T18:37:40.939238] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T18:37:41.074029] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-25T18:37:41.344170] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T18:37:41.488718] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-25T18:37:42.288781] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-25T18:37:42.700809] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T18:37:43.088735] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-25T18:37:43.888751] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-25T18:37:44.206722] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T18:37:44.217007] [INFO ] [REMOTE ] ENB: Full fetch complete (77490 records). [2025-09-25T18:37:44.217153] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-25T18:37:44.446129] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-25T18:37:44.662265] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-25T18:37:44.662507] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-25T18:37:44.663495] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-25T18:37:44.663574] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-25T18:37:44.668270] [DEBUG] [LOCAL ] ENB: Trimmed 77490 records to 53906 (keeping 200 days of data) [2025-09-25T18:37:44.734991] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-25T18:37:44.790614] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T18:37:44.804884] [INFO ] [REMOTE ] ENIC: Full fetch complete (51336 records). [2025-09-25T18:37:44.805776] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-25T18:37:45.363779] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-25T18:37:45.364138] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-25T18:37:45.365263] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-25T18:37:45.365352] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-25T18:37:45.373201] [DEBUG] [LOCAL ] ENIC: Trimmed 51336 records to 36725 (keeping 200 days of data) [2025-09-25T18:37:45.489463] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-25T18:37:45.598611] [DEBUG] [LOCAL ] ENB: Primary data saved (53906 records). [2025-09-25T18:37:45.599322] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-25T18:37:45.599777] [INFO ] [MAIN ] Update Progress: 738/2372 symbols completed. ENB took 45.9s. Estimated remaining: 3h 36m 20s. Rate: 7.6 symbols/min [2025-09-25T18:37:45.852403] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:45.856326] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-25T18:37:45.856693] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-25T18:37:45.857760] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-25T18:37:45.858127] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-25T18:37:45.858507] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-25T18:37:45.858848] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-25T18:37:46.121360] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T18:37:46.271413] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:46.274812] [DEBUG] [LOCAL ] ENIC: Primary data saved (36725 records). [2025-09-25T18:37:46.274951] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-25T18:37:46.275051] [INFO ] [MAIN ] Update Progress: 739/2372 symbols completed. ENIC took 31.5s. Estimated remaining: 3h 35m 56s. Rate: 7.6 symbols/min [2025-09-25T18:37:46.296536] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-25T18:37:46.459688] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:46.459943] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-09-25T18:37:46.459998] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-09-25T18:37:46.460257] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-25T18:37:46.460312] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-25T18:37:46.460355] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-25T18:37:46.460398] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-25T18:37:46.831260] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T18:37:46.865103] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:47.088719] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-25T18:37:47.527045] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T18:37:47.888798] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-25T18:37:48.688724] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-25T18:37:49.488798] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-25T18:37:49.603239] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T18:37:49.938825] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T18:37:49.940173] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T18:37:50.288728] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-25T18:37:51.088677] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-25T18:37:51.241472] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (6.51 seconds). [2025-09-25T18:37:51.533248] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T18:37:51.649145] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T18:37:51.888699] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-25T18:37:52.688758] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-25T18:37:53.210777] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:37:53.254307] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T18:37:53.255164] [INFO ] [REMOTE ] ENO: Full fetch complete (3121 records). [2025-09-25T18:37:53.255234] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-25T18:37:53.496408] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-25T18:37:53.619140] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-25T18:37:53.619224] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-25T18:37:53.619343] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-25T18:37:53.619378] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-25T18:37:53.619749] [DEBUG] [LOCAL ] ENO: Trimmed 3121 records to 1948 (keeping 200 days of data) [2025-09-25T18:37:53.633054] [DEBUG] [LOCAL ] ENO: Primary data saved (1948 records). [2025-09-25T18:37:53.633114] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-25T18:37:53.633219] [INFO ] [MAIN ] Update Progress: 740/2372 symbols completed. ENO took 23.7s. Estimated remaining: 3h 35m 47s. Rate: 7.6 symbols/min [2025-09-25T18:37:53.841831] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:37:53.882257] [DEBUG] [LOCAL ] ENVA: Loaded 25656 existing records from primary storage. [2025-09-25T18:37:53.882430] [INFO ] [MAIN ] ENVA: Loaded 25656 existing records. [2025-09-25T18:37:54.061309] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:37:54.061584] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-25T18:37:54.061664] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-25T18:37:54.061919] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-25T18:37:54.061986] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-25T18:37:54.299959] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-25T18:37:54.418943] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:37:55.068626] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T18:37:55.088682] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-25T18:37:55.675773] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T18:37:55.888720] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-25T18:37:56.651296] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:37:56.688689] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-25T18:37:57.309398] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:37:57.488730] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-25T18:37:58.288758] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-25T18:37:58.391282] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T18:37:58.535590] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T18:37:59.088723] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-25T18:37:59.193234] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T18:37:59.888754] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-25T18:38:00.494152] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T18:38:00.688716] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-25T18:38:01.488696] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-25T18:38:01.671517] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T18:38:02.173390] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T18:38:02.288701] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-25T18:38:03.088703] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-25T18:38:03.283485] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T18:38:03.565479] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:38:03.888706] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-25T18:38:04.438846] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:38:04.688721] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-25T18:38:05.275004] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T18:38:05.488711] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-25T18:38:06.204193] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T18:38:06.212618] [INFO ] [REMOTE ] ENOV: Full fetch complete (63202 records). [2025-09-25T18:38:06.212804] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-25T18:38:06.290386] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-25T18:38:06.670175] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-25T18:38:06.670350] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-25T18:38:06.671222] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-25T18:38:06.671300] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-25T18:38:06.686451] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T18:38:06.692206] [DEBUG] [LOCAL ] ENOV: Trimmed 63202 records to 45531 (keeping 200 days of data) [2025-09-25T18:38:06.959027] [DEBUG] [LOCAL ] ENOV: Primary data saved (45531 records). [2025-09-25T18:38:06.959212] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-25T18:38:06.959353] [INFO ] [MAIN ] Update Progress: 741/2372 symbols completed. ENOV took 36.0s. Estimated remaining: 3h 35m 51s. Rate: 7.6 symbols/min [2025-09-25T18:38:07.101273] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-25T18:38:07.134557] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:07.150962] [DEBUG] [LOCAL ] EOD: Loaded 13998 existing records from primary storage. [2025-09-25T18:38:07.151080] [INFO ] [MAIN ] EOD: Loaded 13998 existing records. [2025-09-25T18:38:07.332872] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:07.333179] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-25T18:38:07.333260] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-25T18:38:07.333564] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-25T18:38:07.333691] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-25T18:38:07.711876] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:07.888682] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-25T18:38:08.184622] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T18:38:08.474589] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T18:38:08.670858] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T18:38:08.688662] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-25T18:38:09.488716] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-25T18:38:10.185463] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:38:10.288738] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-25T18:38:10.394992] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T18:38:11.088748] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-25T18:38:11.779176] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T18:38:11.888717] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-25T18:38:12.484348] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T18:38:12.688728] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-25T18:38:13.221788] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:38:13.227830] [INFO ] [REMOTE ] ENS: Full fetch complete (42057 records). [2025-09-25T18:38:13.227987] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-25T18:38:13.495245] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-25T18:38:13.613407] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-25T18:38:13.613499] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-25T18:38:13.614122] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-25T18:38:13.614186] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-25T18:38:13.615258] [DEBUG] [LOCAL ] ENS: Trimmed 42057 records to 29684 (keeping 200 days of data) [2025-09-25T18:38:13.800293] [DEBUG] [LOCAL ] ENS: Primary data saved (29684 records). [2025-09-25T18:38:13.800426] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-25T18:38:13.800513] [INFO ] [MAIN ] Update Progress: 742/2372 symbols completed. ENS took 27.5s. Estimated remaining: 3h 35m 41s. Rate: 7.6 symbols/min [2025-09-25T18:38:13.975349] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:14.038012] [DEBUG] [LOCAL ] EOG: Loaded 53341 existing records from primary storage. [2025-09-25T18:38:14.038206] [INFO ] [MAIN ] EOG: Loaded 53341 existing records. [2025-09-25T18:38:14.234894] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:14.235381] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-25T18:38:14.235529] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-25T18:38:14.235891] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-25T18:38:14.235954] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-25T18:38:14.296436] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-25T18:38:14.488289] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T18:38:14.680977] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:14.733534] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T18:38:14.891205] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T18:38:15.088722] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-25T18:38:15.888751] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-25T18:38:16.337243] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T18:38:16.688755] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-25T18:38:17.488703] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-25T18:38:17.719321] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:38:17.943299] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T18:38:18.288758] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-25T18:38:18.893457] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T18:38:19.088733] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-25T18:38:19.412157] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T18:38:19.888756] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-25T18:38:20.688714] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-25T18:38:20.951608] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T18:38:21.488701] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-25T18:38:21.593725] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:38:22.018728] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:38:22.024236] [INFO ] [REMOTE ] ENVA: Full fetch complete (36584 records). [2025-09-25T18:38:22.024395] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-25T18:38:22.298129] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-25T18:38:22.427557] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-25T18:38:22.427639] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-25T18:38:22.428247] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-25T18:38:22.428291] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-25T18:38:22.429934] [DEBUG] [LOCAL ] ENVA: Trimmed 36584 records to 25782 (keeping 200 days of data) [2025-09-25T18:38:22.600800] [DEBUG] [LOCAL ] ENVA: Primary data saved (25782 records). [2025-09-25T18:38:22.601007] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-25T18:38:22.601143] [INFO ] [MAIN ] Update Progress: 743/2372 symbols completed. ENVA took 29.0s. Estimated remaining: 3h 35m 35s. Rate: 7.6 symbols/min [2025-09-25T18:38:22.774833] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:22.789806] [DEBUG] [LOCAL ] EOI: Loaded 10569 existing records from primary storage. [2025-09-25T18:38:22.789965] [INFO ] [MAIN ] EOI: Loaded 10569 existing records. [2025-09-25T18:38:22.973486] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:22.973934] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-25T18:38:22.973996] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-25T18:38:22.974250] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-25T18:38:22.974309] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-25T18:38:23.093794] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-25T18:38:23.341450] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:23.372941] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:38:23.888683] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-25T18:38:23.921216] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:38:23.929796] [INFO ] [REMOTE ] ENR: Full fetch complete (57931 records). [2025-09-25T18:38:23.929993] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-25T18:38:23.930829] [FATAL] [VALIDATOR ] ENR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:38:23.930924] [FATAL] [MAIN ] ENR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:38:23.930968] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:38:23.931036] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-25T18:38:23.931109] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-25T18:38:23.931146] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-09-25T18:38:23.931219] [DEBUG] [LOCAL ] ENR: No derivative data file found to delete. [2025-09-25T18:38:23.931307] [INFO ] [MAIN ] Update Progress: 744/2372 symbols completed. ENR took 38.3s. Estimated remaining: 3h 35m 12s. Rate: 7.6 symbols/min [2025-09-25T18:38:24.121599] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:24.141572] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T18:38:24.151538] [DEBUG] [LOCAL ] EOS: Loaded 15341 existing records from primary storage. [2025-09-25T18:38:24.151671] [INFO ] [MAIN ] EOS: Loaded 15341 existing records. [2025-09-25T18:38:24.335698] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:24.335963] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-25T18:38:24.336012] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-25T18:38:24.336290] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-25T18:38:24.336358] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-25T18:38:24.703117] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-25T18:38:24.717447] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:25.488733] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-25T18:38:25.697484] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T18:38:25.717232] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T18:38:26.288761] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-25T18:38:26.555495] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T18:38:27.088736] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-25T18:38:27.120099] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:38:27.775389] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T18:38:27.888747] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-25T18:38:28.688784] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-25T18:38:28.876880] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T18:38:29.488748] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-25T18:38:30.263740] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T18:38:30.288673] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-25T18:38:30.636512] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:38:30.862196] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T18:38:31.088736] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-25T18:38:31.705517] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T18:38:31.888720] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-25T18:38:32.688768] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-25T18:38:33.488687] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-25T18:38:33.638977] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T18:38:33.909601] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T18:38:34.288705] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-25T18:38:34.308823] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T18:38:35.088771] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-25T18:38:35.401424] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T18:38:35.888730] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-25T18:38:36.457697] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T18:38:36.688721] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-25T18:38:37.488729] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-25T18:38:37.770521] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T18:38:37.973400] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:38:38.096317] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T18:38:38.288727] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-25T18:38:39.088757] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-25T18:38:39.888760] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-25T18:38:40.188311] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T18:38:40.264240] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T18:38:40.553790] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T18:38:40.556622] [INFO ] [REMOTE ] EOD: Full fetch complete (19981 records). [2025-09-25T18:38:40.556722] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-25T18:38:40.701354] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-25T18:38:40.938522] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-25T18:38:40.938627] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-25T18:38:40.939171] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-25T18:38:40.939221] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-25T18:38:40.939831] [DEBUG] [LOCAL ] EOD: Trimmed 19981 records to 14137 (keeping 200 days of data) [2025-09-25T18:38:41.025085] [DEBUG] [LOCAL ] EOD: Primary data saved (14137 records). [2025-09-25T18:38:41.025238] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-25T18:38:41.025337] [INFO ] [MAIN ] Update Progress: 745/2372 symbols completed. EOD took 34.1s. Estimated remaining: 3h 35m 24s. Rate: 7.6 symbols/min [2025-09-25T18:38:41.198047] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:41.207296] [DEBUG] [LOCAL ] EOT: Loaded 6858 existing records from primary storage. [2025-09-25T18:38:41.207393] [INFO ] [MAIN ] EOT: Loaded 6858 existing records. [2025-09-25T18:38:41.393844] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:41.394134] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-25T18:38:41.394183] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-25T18:38:41.394417] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-25T18:38:41.394490] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-25T18:38:41.494358] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-25T18:38:41.762117] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:41.770683] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T18:38:42.288846] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-25T18:38:42.299198] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T18:38:43.088771] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-25T18:38:43.229409] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T18:38:43.691693] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T18:38:43.888729] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-25T18:38:44.645299] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T18:38:44.688687] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-25T18:38:45.488753] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-25T18:38:45.501179] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T18:38:46.288702] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-25T18:38:46.624836] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T18:38:47.088714] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-25T18:38:47.888676] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-25T18:38:48.024575] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T18:38:48.027034] [INFO ] [REMOTE ] EOI: Full fetch complete (15974 records). [2025-09-25T18:38:48.027108] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-25T18:38:48.475930] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-25T18:38:48.476329] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-25T18:38:48.476961] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-25T18:38:48.477268] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-25T18:38:48.489867] [DEBUG] [LOCAL ] EOI: Trimmed 15974 records to 10652 (keeping 200 days of data) [2025-09-25T18:38:48.511959] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-25T18:38:48.598553] [DEBUG] [LOCAL ] EOI: Primary data saved (10652 records). [2025-09-25T18:38:48.598725] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-25T18:38:48.598838] [INFO ] [MAIN ] Update Progress: 746/2372 symbols completed. EOI took 26.0s. Estimated remaining: 3h 35m 16s. Rate: 7.6 symbols/min [2025-09-25T18:38:48.694484] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-25T18:38:48.817124] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:48.857632] [DEBUG] [LOCAL ] EPAC: Loaded 27063 existing records from primary storage. [2025-09-25T18:38:48.857853] [INFO ] [MAIN ] EPAC: Loaded 27063 existing records. [2025-09-25T18:38:49.079431] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T18:38:49.192015] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:49.192399] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-25T18:38:49.192464] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-25T18:38:49.192988] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-25T18:38:49.193066] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-25T18:38:49.493980] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-25T18:38:49.664353] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:50.288678] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-25T18:38:50.400264] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T18:38:50.770167] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T18:38:50.780126] [INFO ] [REMOTE ] EOG: Full fetch complete (77272 records). [2025-09-25T18:38:50.780265] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-25T18:38:51.093901] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-25T18:38:51.192831] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-25T18:38:51.192915] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-25T18:38:51.193809] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-25T18:38:51.193873] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-25T18:38:51.195385] [DEBUG] [LOCAL ] EOG: Trimmed 77272 records to 53731 (keeping 200 days of data) [2025-09-25T18:38:51.323299] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T18:38:51.578014] [DEBUG] [LOCAL ] EOG: Primary data saved (53731 records). [2025-09-25T18:38:51.578158] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-25T18:38:51.579510] [INFO ] [MAIN ] Update Progress: 747/2372 symbols completed. EOG took 37.8s. Estimated remaining: 3h 34m 57s. Rate: 7.6 symbols/min [2025-09-25T18:38:51.780461] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:51.827966] [DEBUG] [LOCAL ] EPAM: Loaded 39772 existing records from primary storage. [2025-09-25T18:38:51.828120] [INFO ] [MAIN ] EPAM: Loaded 39772 existing records. [2025-09-25T18:38:51.893854] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-25T18:38:51.946993] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T18:38:52.037495] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:52.037797] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-25T18:38:52.037851] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-25T18:38:52.038688] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-25T18:38:52.038751] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-25T18:38:52.453758] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:52.688723] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-25T18:38:52.929005] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T18:38:52.933363] [INFO ] [REMOTE ] EOS: Full fetch complete (23050 records). [2025-09-25T18:38:52.933459] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-25T18:38:53.324269] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-25T18:38:53.324352] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-25T18:38:53.324930] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-25T18:38:53.324995] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-25T18:38:53.325627] [DEBUG] [LOCAL ] EOS: Trimmed 23050 records to 15445 (keeping 200 days of data) [2025-09-25T18:38:53.422059] [DEBUG] [LOCAL ] EOS: Primary data saved (15445 records). [2025-09-25T18:38:53.422201] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-25T18:38:53.422285] [INFO ] [MAIN ] Update Progress: 748/2372 symbols completed. EOS took 29.5s. Estimated remaining: 3h 34m 36s. Rate: 7.6 symbols/min [2025-09-25T18:38:53.493238] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-25T18:38:53.612476] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:38:53.656179] [DEBUG] [LOCAL ] EPC: Loaded 39852 existing records from primary storage. [2025-09-25T18:38:53.656406] [INFO ] [MAIN ] EPC: Loaded 39852 existing records. [2025-09-25T18:38:53.867274] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:38:53.877757] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T18:38:53.877884] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-25T18:38:53.883853] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-25T18:38:53.884434] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-25T18:38:53.884495] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-25T18:38:54.244954] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:38:54.288664] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-25T18:38:54.380360] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T18:38:55.088775] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-25T18:38:55.809366] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T18:38:55.888749] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-25T18:38:56.104772] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T18:38:56.688685] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-25T18:38:56.742329] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T18:38:57.488781] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-25T18:38:58.239897] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T18:38:58.288807] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-25T18:38:58.613050] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T18:38:59.088767] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-25T18:38:59.430479] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T18:38:59.888743] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-25T18:39:00.508695] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:39:00.688717] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-25T18:39:01.203139] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:39:01.488710] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-25T18:39:01.965853] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:39:02.128524] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T18:39:02.288706] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-25T18:39:03.088714] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-25T18:39:03.888774] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-25T18:39:03.984957] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T18:39:04.572315] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T18:39:04.631199] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T18:39:04.688688] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-25T18:39:05.410306] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T18:39:05.488677] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-25T18:39:06.218772] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T18:39:06.288768] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-25T18:39:07.088676] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-25T18:39:07.292133] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T18:39:07.294044] [INFO ] [REMOTE ] EOT: Full fetch complete (10790 records). [2025-09-25T18:39:07.294116] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-25T18:39:07.681578] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-25T18:39:07.681699] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-25T18:39:07.682009] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-25T18:39:07.682053] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-25T18:39:07.682811] [DEBUG] [LOCAL ] EOT: Trimmed 10790 records to 6891 (keeping 200 days of data) [2025-09-25T18:39:07.726422] [DEBUG] [LOCAL ] EOT: Primary data saved (6891 records). [2025-09-25T18:39:07.726558] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-25T18:39:07.726668] [INFO ] [MAIN ] Update Progress: 749/2372 symbols completed. EOT took 26.7s. Estimated remaining: 3h 34m 42s. Rate: 7.6 symbols/min [2025-09-25T18:39:07.900272] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-25T18:39:07.904184] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:07.956108] [DEBUG] [LOCAL ] EPD: Loaded 53615 existing records from primary storage. [2025-09-25T18:39:07.956282] [INFO ] [MAIN ] EPD: Loaded 53615 existing records. [2025-09-25T18:39:08.137987] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:08.138209] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-25T18:39:08.138267] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-25T18:39:08.138604] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-25T18:39:08.138705] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-25T18:39:08.500174] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:08.688743] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-25T18:39:08.945388] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T18:39:08.999351] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T18:39:09.488774] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-25T18:39:10.288734] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-25T18:39:10.417612] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T18:39:11.088696] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-25T18:39:11.154161] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:39:11.405580] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T18:39:11.888777] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-25T18:39:12.688717] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-25T18:39:13.100372] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T18:39:13.132276] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T18:39:13.488810] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-25T18:39:14.132574] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T18:39:14.288711] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-25T18:39:14.894322] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T18:39:15.088729] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-25T18:39:15.736353] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T18:39:15.888724] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-25T18:39:16.334461] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T18:39:16.340003] [INFO ] [REMOTE ] EPAC: Full fetch complete (39123 records). [2025-09-25T18:39:16.340093] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-25T18:39:16.697785] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-25T18:39:16.738851] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-25T18:39:16.738934] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-25T18:39:16.739562] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-25T18:39:16.739601] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-25T18:39:16.740461] [DEBUG] [LOCAL ] EPAC: Trimmed 39123 records to 27252 (keeping 200 days of data) [2025-09-25T18:39:16.898801] [DEBUG] [LOCAL ] EPAC: Primary data saved (27252 records). [2025-09-25T18:39:16.898958] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-25T18:39:16.899052] [INFO ] [MAIN ] Update Progress: 750/2372 symbols completed. EPAC took 28.3s. Estimated remaining: 3h 34m 36s. Rate: 7.6 symbols/min [2025-09-25T18:39:17.096683] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:17.148377] [DEBUG] [LOCAL ] EPR: Loaded 44181 existing records from primary storage. [2025-09-25T18:39:17.148533] [INFO ] [MAIN ] EPR: Loaded 44181 existing records. [2025-09-25T18:39:17.366437] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:17.366925] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-25T18:39:17.367164] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-25T18:39:17.367687] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-25T18:39:17.367755] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-25T18:39:17.455791] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T18:39:17.503067] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-25T18:39:17.813425] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:18.288752] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-25T18:39:18.478541] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T18:39:19.088795] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-25T18:39:19.192204] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T18:39:19.557170] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T18:39:19.888758] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-25T18:39:20.688704] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-25T18:39:20.999276] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T18:39:21.099492] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T18:39:21.488724] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-25T18:39:22.234129] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T18:39:22.288689] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-25T18:39:23.061398] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T18:39:23.088664] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-25T18:39:23.888690] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-25T18:39:23.978216] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T18:39:23.989429] [INFO ] [REMOTE ] EPAM: Full fetch complete (56247 records). [2025-09-25T18:39:23.989568] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-25T18:39:24.400623] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-25T18:39:24.400940] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-25T18:39:24.401764] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-25T18:39:24.401864] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-25T18:39:24.403306] [DEBUG] [LOCAL ] EPAM: Trimmed 56247 records to 40102 (keeping 200 days of data) [2025-09-25T18:39:24.542520] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T18:39:24.688870] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-25T18:39:24.697627] [DEBUG] [LOCAL ] EPAM: Primary data saved (40102 records). [2025-09-25T18:39:24.697763] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-25T18:39:24.697860] [INFO ] [MAIN ] Update Progress: 751/2372 symbols completed. EPAM took 33.1s. Estimated remaining: 3h 34m 28s. Rate: 7.6 symbols/min [2025-09-25T18:39:24.879185] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:24.935391] [DEBUG] [LOCAL ] EPRT: Loaded 48677 existing records from primary storage. [2025-09-25T18:39:24.935562] [INFO ] [MAIN ] EPRT: Loaded 48677 existing records. [2025-09-25T18:39:25.145977] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:25.146573] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-25T18:39:25.146707] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-25T18:39:25.147256] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-25T18:39:25.147347] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-25T18:39:25.348997] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T18:39:25.493797] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-25T18:39:25.571051] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:26.092750] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:39:26.288735] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-25T18:39:26.878355] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T18:39:27.088748] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-25T18:39:27.888755] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-25T18:39:28.389994] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-25T18:39:28.686078] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T18:39:28.694788] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-25T18:39:29.488692] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-25T18:39:29.715381] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:39:30.288735] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-25T18:39:30.638943] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T18:39:30.970624] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T18:39:31.088727] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-25T18:39:31.503420] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T18:39:31.888728] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-25T18:39:32.688700] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-25T18:39:33.110679] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T18:39:33.355335] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T18:39:33.488736] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-25T18:39:34.288703] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-25T18:39:34.433900] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:39:34.441790] [INFO ] [REMOTE ] EPC: Full fetch complete (56436 records). [2025-09-25T18:39:34.441942] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-25T18:39:34.442836] [FATAL] [VALIDATOR ] EPC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:39:34.442966] [FATAL] [MAIN ] EPC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:39:34.443054] [WARN ] [MAIN ] EPC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:39:34.443144] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-25T18:39:34.443243] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-25T18:39:34.443293] [INFO ] [LOCAL ] EPC: Starting deletion of derivative data. [2025-09-25T18:39:34.443724] [DEBUG] [LOCAL ] EPC: Deleted derivative data file. [2025-09-25T18:39:34.443867] [INFO ] [MAIN ] Update Progress: 752/2372 symbols completed. EPC took 41.0s. Estimated remaining: 3h 34m 24s. Rate: 7.6 symbols/min [2025-09-25T18:39:34.654394] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:34.670324] [DEBUG] [LOCAL ] EQBK: Loaded 10952 existing records from primary storage. [2025-09-25T18:39:34.670506] [INFO ] [MAIN ] EQBK: Loaded 10952 existing records. [2025-09-25T18:39:34.895814] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:34.896140] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-25T18:39:34.896219] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-25T18:39:34.896462] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-25T18:39:34.896531] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-25T18:39:35.103497] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-25T18:39:35.328124] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:35.392318] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T18:39:35.888714] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-25T18:39:36.010992] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:39:36.688767] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-25T18:39:36.994111] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:39:37.488709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-25T18:39:37.556060] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T18:39:38.065469] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:39:38.288705] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-25T18:39:38.453005] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T18:39:39.088722] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-25T18:39:39.888737] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-25T18:39:40.419297] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-25T18:39:40.432939] [INFO ] [REMOTE ] EPD: Full fetch complete (77643 records). [2025-09-25T18:39:40.433086] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-25T18:39:40.696967] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-25T18:39:40.893966] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-25T18:39:40.894463] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-25T18:39:40.896021] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-25T18:39:40.896591] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-25T18:39:40.898982] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T18:39:40.911802] [DEBUG] [LOCAL ] EPD: Trimmed 77643 records to 54001 (keeping 200 days of data) [2025-09-25T18:39:41.305690] [DEBUG] [LOCAL ] EPD: Primary data saved (54001 records). [2025-09-25T18:39:41.305885] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-25T18:39:41.306038] [INFO ] [MAIN ] Update Progress: 753/2372 symbols completed. EPD took 33.6s. Estimated remaining: 3h 34m 14s. Rate: 7.6 symbols/min [2025-09-25T18:39:41.483035] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T18:39:41.495308] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-25T18:39:41.569767] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T18:39:41.683125] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:41.775376] [DEBUG] [LOCAL ] EQH: Loaded 52662 existing records from primary storage. [2025-09-25T18:39:41.775634] [INFO ] [MAIN ] EQH: Loaded 52662 existing records. [2025-09-25T18:39:42.053416] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:42.053764] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-25T18:39:42.053823] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-25T18:39:42.054128] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-25T18:39:42.054189] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-25T18:39:42.295873] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-25T18:39:42.422453] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:43.088720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-25T18:39:43.183546] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T18:39:43.201165] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T18:39:43.888751] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-25T18:39:44.688696] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-25T18:39:44.964884] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T18:39:45.493948] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-25T18:39:45.505119] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T18:39:46.288775] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-25T18:39:47.088761] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-25T18:39:47.119038] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T18:39:47.286862] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T18:39:47.888728] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-25T18:39:48.700376] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-25T18:39:48.728280] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T18:39:49.488738] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-25T18:39:49.627316] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T18:39:49.763555] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T18:39:50.288720] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-25T18:39:51.088784] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-25T18:39:51.145315] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T18:39:51.692900] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:39:51.750103] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T18:39:51.888724] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-25T18:39:52.688777] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-25T18:39:53.488717] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-25T18:39:53.724844] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T18:39:54.255864] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T18:39:54.288687] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-25T18:39:54.439296] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T18:39:54.451103] [INFO ] [REMOTE ] EPR: Full fetch complete (62817 records). [2025-09-25T18:39:54.451376] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-25T18:39:54.845096] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-25T18:39:54.845182] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-25T18:39:54.845950] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-25T18:39:54.846014] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-25T18:39:54.847307] [DEBUG] [LOCAL ] EPR: Trimmed 62817 records to 44449 (keeping 200 days of data) [2025-09-25T18:39:55.090608] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-25T18:39:55.135108] [DEBUG] [LOCAL ] EPR: Primary data saved (44449 records). [2025-09-25T18:39:55.135236] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-25T18:39:55.136512] [INFO ] [MAIN ] Update Progress: 754/2372 symbols completed. EPR took 38.2s. Estimated remaining: 3h 34m 18s. Rate: 7.5 symbols/min [2025-09-25T18:39:55.247756] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T18:39:55.319301] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:55.376091] [DEBUG] [LOCAL ] EQNR: Loaded 53036 existing records from primary storage. [2025-09-25T18:39:55.376233] [INFO ] [MAIN ] EQNR: Loaded 53036 existing records. [2025-09-25T18:39:55.554013] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:55.554269] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-25T18:39:55.554317] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-25T18:39:55.554623] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-25T18:39:55.554716] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-25T18:39:55.895938] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-25T18:39:55.918072] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:56.582406] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T18:39:56.688681] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-25T18:39:56.959735] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T18:39:57.488709] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-25T18:39:58.288745] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-25T18:39:58.462717] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T18:39:58.465565] [INFO ] [REMOTE ] EQBK: Full fetch complete (15346 records). [2025-09-25T18:39:58.465667] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-25T18:39:58.848377] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-25T18:39:58.848478] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-25T18:39:58.848881] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-25T18:39:58.849024] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-25T18:39:58.859790] [DEBUG] [LOCAL ] EQBK: Trimmed 15346 records to 10987 (keeping 200 days of data) [2025-09-25T18:39:58.878939] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T18:39:58.953776] [DEBUG] [LOCAL ] EQBK: Primary data saved (10987 records). [2025-09-25T18:39:58.953891] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-25T18:39:58.953966] [INFO ] [MAIN ] Update Progress: 755/2372 symbols completed. EQBK took 24.5s. Estimated remaining: 3h 34m 2s. Rate: 7.6 symbols/min [2025-09-25T18:39:59.094881] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-25T18:39:59.128498] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:39:59.182521] [DEBUG] [LOCAL ] EQR: Loaded 51420 existing records from primary storage. [2025-09-25T18:39:59.182700] [INFO ] [MAIN ] EQR: Loaded 51420 existing records. [2025-09-25T18:39:59.365158] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:39:59.365435] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-25T18:39:59.365499] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-25T18:39:59.365812] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-25T18:39:59.365870] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-25T18:39:59.725598] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:39:59.806554] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T18:39:59.888673] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-25T18:40:00.688692] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-25T18:40:00.778306] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (16.09 seconds). [2025-09-25T18:40:01.190210] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-25T18:40:01.488720] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-25T18:40:01.837720] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T18:40:02.288812] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-25T18:40:02.338585] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T18:40:03.088695] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-25T18:40:03.359889] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T18:40:03.511205] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T18:40:03.888697] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-25T18:40:04.649377] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T18:40:04.688761] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-25T18:40:05.488760] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-25T18:40:05.938587] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T18:40:06.288745] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-25T18:40:06.395616] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T18:40:07.088771] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-25T18:40:07.275987] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T18:40:07.284859] [INFO ] [REMOTE ] EPRT: Full fetch complete (68777 records). [2025-09-25T18:40:07.285000] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-25T18:40:07.698079] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-25T18:40:07.698226] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-25T18:40:07.699412] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-25T18:40:07.699507] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-25T18:40:07.701526] [DEBUG] [LOCAL ] EPRT: Trimmed 68777 records to 48991 (keeping 200 days of data) [2025-09-25T18:40:07.902540] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-25T18:40:08.030383] [DEBUG] [LOCAL ] EPRT: Primary data saved (48991 records). [2025-09-25T18:40:08.030576] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-25T18:40:08.031188] [INFO ] [MAIN ] Update Progress: 756/2372 symbols completed. EPRT took 43.3s. Estimated remaining: 3h 33m 56s. Rate: 7.6 symbols/min [2025-09-25T18:40:08.221369] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:08.221593] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-25T18:40:08.221824] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-25T18:40:08.222094] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-25T18:40:08.222198] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-25T18:40:08.222355] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-25T18:40:08.222529] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-25T18:40:08.550928] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-25T18:40:08.640959] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:08.688668] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-25T18:40:09.071891] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T18:40:09.084895] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T18:40:09.086564] [INFO ] [REMOTE ] EQH: Full fetch complete (75951 records). [2025-09-25T18:40:09.086757] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-25T18:40:09.087690] [FATAL] [VALIDATOR ] EQH: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:40:09.087813] [FATAL] [MAIN ] EQH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:40:09.087901] [WARN ] [MAIN ] EQH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:40:09.087995] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-25T18:40:09.088088] [DEBUG] [LOCAL ] EQH: No primary data file found to delete. [2025-09-25T18:40:09.088207] [INFO ] [LOCAL ] EQH: Starting deletion of derivative data. [2025-09-25T18:40:09.088548] [DEBUG] [LOCAL ] EQH: Deleted derivative data file. [2025-09-25T18:40:09.088689] [INFO ] [MAIN ] Update Progress: 757/2372 symbols completed. EQH took 27.8s. Estimated remaining: 3h 33m 33s. Rate: 7.6 symbols/min [2025-09-25T18:40:09.488711] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-25T18:40:09.781154] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:40:09.872932] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-25T18:40:10.288752] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-25T18:40:10.641467] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-25T18:40:11.088714] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-25T18:40:11.513900] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T18:40:11.888714] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-25T18:40:12.194170] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-25T18:40:12.688739] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-25T18:40:13.488722] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-25T18:40:13.843357] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T18:40:14.288746] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-25T18:40:14.530564] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T18:40:15.088725] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-25T18:40:15.558957] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-25T18:40:15.888727] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-25T18:40:16.349358] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T18:40:16.450131] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-25T18:40:16.688771] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-25T18:40:17.302511] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T18:40:17.488771] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-25T18:40:18.288758] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-25T18:40:18.911747] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T18:40:18.913128] [INFO ] [REMOTE ] EQS: Full fetch complete (2544 records). [2025-09-25T18:40:18.913197] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-25T18:40:19.096202] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-25T18:40:19.102423] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-25T18:40:19.104054] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:40:19.104389] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:40:19.104467] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-25T18:40:19.104534] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-25T18:40:19.104574] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-25T18:40:19.104615] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-25T18:40:19.104732] [INFO ] [MAIN ] Update Progress: 758/2372 symbols completed. EQS took 11.1s. Estimated remaining: 3h 33m 30s. Rate: 7.6 symbols/min [2025-09-25T18:40:19.420961] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T18:40:19.888711] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-25T18:40:20.964162] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T18:40:20.975396] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-25T18:40:21.512820] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:40:21.523867] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-25T18:40:22.939822] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T18:40:22.951680] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-25T18:40:23.255916] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T18:40:23.266783] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-25T18:40:25.361318] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-25T18:40:25.373054] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-25T18:40:25.595241] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-25T18:40:25.608260] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-25T18:40:27.347449] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T18:40:27.360098] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-25T18:40:27.577076] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-25T18:40:27.587214] [INFO ] [REMOTE ] EQNR: Full fetch complete (76387 records). [2025-09-25T18:40:27.587410] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-25T18:40:27.588726] [FATAL] [VALIDATOR ] EQNR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:40:27.588854] [FATAL] [MAIN ] EQNR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:40:27.588901] [WARN ] [MAIN ] EQNR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:40:27.588943] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-25T18:40:27.589006] [DEBUG] [LOCAL ] EQNR: No primary data file found to delete. [2025-09-25T18:40:27.589042] [INFO ] [LOCAL ] EQNR: Starting deletion of derivative data. [2025-09-25T18:40:27.589320] [DEBUG] [LOCAL ] EQNR: Deleted derivative data file. [2025-09-25T18:40:27.589468] [INFO ] [MAIN ] Update Progress: 759/2372 symbols completed. EQNR took 32.5s. Estimated remaining: 3h 33m 23s. Rate: 7.6 symbols/min [2025-09-25T18:40:29.256396] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T18:40:29.266814] [INFO ] [REMOTE ] EQR: Full fetch complete (73791 records). [2025-09-25T18:40:29.266959] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-25T18:40:29.678365] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-25T18:40:29.678470] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-25T18:40:29.679440] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-25T18:40:29.679520] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-25T18:40:29.681143] [DEBUG] [LOCAL ] EQR: Trimmed 73791 records to 51810 (keeping 200 days of data) [2025-09-25T18:40:30.024954] [DEBUG] [LOCAL ] EQR: Primary data saved (51810 records). [2025-09-25T18:40:30.025099] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-25T18:40:30.025221] [INFO ] [MAIN ] Update Progress: 760/2372 symbols completed. EQR took 31.1s. Estimated remaining: 3h 33m 4s. Rate: 7.6 symbols/min [2025-09-25T18:40:30.590622] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:30.761487] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:30.765530] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:30.789330] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:30.803208] [DEBUG] [LOCAL ] EQV: Loaded 2824 existing records from primary storage. [2025-09-25T18:40:30.803588] [INFO ] [MAIN ] EQV: Loaded 2824 existing records. [2025-09-25T18:40:30.970270] [DEBUG] [LOCAL ] ERJ: Loaded 50732 existing records from primary storage. [2025-09-25T18:40:31.007014] [INFO ] [MAIN ] ERJ: Loaded 50732 existing records. [2025-09-25T18:40:31.139828] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:40:31.156556] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-25T18:40:31.161898] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-25T18:40:31.150932] [DEBUG] [LOCAL ] ERO: Loaded 41197 existing records from primary storage. [2025-09-25T18:40:31.162113] [INFO ] [MAIN ] ERO: Loaded 41197 existing records. [2025-09-25T18:40:31.168039] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-25T18:40:31.168169] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-25T18:40:31.504473] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-25T18:40:31.542555] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-25T18:40:31.551383] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:40:31.593013] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-25T18:40:31.623007] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-25T18:40:31.654724] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-25T18:40:31.694688] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-25T18:40:31.924513] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:40:32.119975] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-25T18:40:32.139192] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-25T18:40:32.227895] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-25T18:40:32.234751] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:40:32.268937] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-25T18:40:32.263577] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-25T18:40:32.277208] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-25T18:40:32.357437] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-25T18:40:32.400767] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-25T18:40:32.521529] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:32.605447] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-25T18:40:32.764328] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:32.781163] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-25T18:40:33.291314] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:33.306081] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-25T18:40:33.330788] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:33.331426] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-25T18:40:33.557210] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T18:40:33.559405] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-25T18:40:34.572536] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T18:40:34.584156] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-25T18:40:34.924199] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T18:40:34.948362] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-25T18:40:34.950341] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T18:40:34.956442] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-25T18:40:35.354936] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-25T18:40:35.366335] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-25T18:40:35.565765] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T18:40:35.567416] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-25T18:40:36.018181] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T18:40:36.031451] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-25T18:40:36.118410] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T18:40:36.120286] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-25T18:40:36.371150] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:40:36.379111] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-25T18:40:36.448961] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-25T18:40:36.688718] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-25T18:40:37.149466] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T18:40:37.246384] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:40:37.488739] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-25T18:40:37.779820] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T18:40:37.914461] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:40:38.288740] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-25T18:40:39.088701] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-25T18:40:39.406441] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T18:40:39.648221] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T18:40:39.888801] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-25T18:40:40.197100] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T18:40:40.217987] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-25T18:40:40.688724] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-25T18:40:41.488714] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-25T18:40:42.106443] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T18:40:42.293863] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-25T18:40:42.317464] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T18:40:43.088764] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-25T18:40:43.888729] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-25T18:40:44.208579] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T18:40:44.634097] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T18:40:44.635110] [INFO ] [REMOTE ] EQV: Full fetch complete (5748 records). [2025-09-25T18:40:44.635182] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-25T18:40:44.694691] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-25T18:40:44.832750] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T18:40:45.075950] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-25T18:40:45.076038] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-25T18:40:45.076202] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-25T18:40:45.076241] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-25T18:40:45.076748] [DEBUG] [LOCAL ] EQV: Trimmed 5748 records to 2830 (keeping 200 days of data) [2025-09-25T18:40:45.094263] [DEBUG] [LOCAL ] EQV: Primary data saved (2830 records). [2025-09-25T18:40:45.094411] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-25T18:40:45.094529] [INFO ] [MAIN ] Update Progress: 761/2372 symbols completed. EQV took 15.1s. Estimated remaining: 3h 33m 11s. Rate: 7.6 symbols/min [2025-09-25T18:40:45.275990] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:40:45.341357] [DEBUG] [LOCAL ] ES: Loaded 52529 existing records from primary storage. [2025-09-25T18:40:45.341544] [INFO ] [MAIN ] ES: Loaded 52529 existing records. [2025-09-25T18:40:45.496725] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-25T18:40:45.542752] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:40:45.543074] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-25T18:40:45.543126] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-25T18:40:45.543381] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-25T18:40:45.543442] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-25T18:40:45.915489] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:40:46.288699] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-25T18:40:46.791000] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-25T18:40:47.088733] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-25T18:40:47.608424] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-25T18:40:47.888721] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-25T18:40:48.275869] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T18:40:48.688714] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-25T18:40:48.739920] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T18:40:49.307119] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:40:49.488713] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-25T18:40:50.288756] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-25T18:40:50.371705] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:40:51.088753] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-25T18:40:51.403215] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T18:40:51.832511] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T18:40:51.888757] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-25T18:40:52.564472] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T18:40:52.688787] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-25T18:40:53.488746] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-25T18:40:54.118910] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-25T18:40:54.288862] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-25T18:40:54.466617] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T18:40:55.088702] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-25T18:40:55.196012] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T18:40:55.888677] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-25T18:40:56.250116] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T18:40:56.688723] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-25T18:40:56.877524] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T18:40:57.505116] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-25T18:40:57.515209] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T18:40:58.288777] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-25T18:40:58.528698] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T18:40:58.628045] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T18:40:59.088741] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-25T18:40:59.888770] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-25T18:41:00.365732] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T18:41:00.377513] [INFO ] [REMOTE ] EQT: Full fetch complete (77692 records). [2025-09-25T18:41:00.377762] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-25T18:41:00.693541] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-25T18:41:00.812447] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-25T18:41:00.812606] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-25T18:41:00.814115] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-25T18:41:00.814193] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-25T18:41:00.815838] [DEBUG] [LOCAL ] EQT: Trimmed 77692 records to 54072 (keeping 200 days of data) [2025-09-25T18:41:00.940801] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T18:41:00.952631] [INFO ] [REMOTE ] ERO: Full fetch complete (59238 records). [2025-09-25T18:41:00.953581] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-25T18:41:01.420520] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-25T18:41:01.421085] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-25T18:41:01.422886] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-25T18:41:01.423444] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-25T18:41:01.430286] [DEBUG] [LOCAL ] ERO: Trimmed 59238 records to 41546 (keeping 200 days of data) [2025-09-25T18:41:01.821089] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T18:41:01.837764] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-25T18:41:01.966356] [DEBUG] [LOCAL ] EQT: Primary data saved (54072 records). [2025-09-25T18:41:01.966769] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-25T18:41:01.966926] [INFO ] [MAIN ] Update Progress: 762/2372 symbols completed. EQT took 31.9s. Estimated remaining: 3h 33m 22s. Rate: 7.5 symbols/min [2025-09-25T18:41:01.966585] [DEBUG] [LOCAL ] ERO: Primary data saved (41546 records). [2025-09-25T18:41:01.967148] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-25T18:41:02.000906] [INFO ] [MAIN ] Update Progress: 763/2372 symbols completed. ERO took 31.9s. Estimated remaining: 3h 32m 57s. Rate: 7.6 symbols/min [2025-09-25T18:41:02.325823] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:02.347216] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:02.376223] [DEBUG] [LOCAL ] ESE: Loaded 16588 existing records from primary storage. [2025-09-25T18:41:02.376424] [INFO ] [MAIN ] ESE: Loaded 16588 existing records. [2025-09-25T18:41:02.492215] [DEBUG] [LOCAL ] ESAB: Loaded 26219 existing records from primary storage. [2025-09-25T18:41:02.498120] [INFO ] [MAIN ] ESAB: Loaded 26219 existing records. [2025-09-25T18:41:02.647457] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:02.689599] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-25T18:41:02.690161] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-25T18:41:02.735737] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-25T18:41:02.741498] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-25T18:41:02.810864] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:02.859156] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-25T18:41:02.878340] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-25T18:41:02.887637] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-25T18:41:02.898235] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-25T18:41:03.128093] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-25T18:41:03.308534] [INFO ] [REMOTE ] ERJ: Full fetch complete (72216 records). [2025-09-25T18:41:03.383878] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-25T18:41:03.504829] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:03.539338] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-25T18:41:03.729035] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:03.745189] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-25T18:41:04.049959] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-25T18:41:04.050079] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-25T18:41:04.051106] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-25T18:41:04.051192] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-25T18:41:04.082100] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T18:41:04.093034] [DEBUG] [LOCAL ] ERJ: Trimmed 72216 records to 51109 (keeping 200 days of data) [2025-09-25T18:41:04.094444] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-25T18:41:04.399237] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T18:41:04.419773] [DEBUG] [LOCAL ] ERJ: Primary data saved (51109 records). [2025-09-25T18:41:04.419916] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-25T18:41:04.420004] [INFO ] [MAIN ] Update Progress: 764/2372 symbols completed. ERJ took 34.4s. Estimated remaining: 3h 32m 37s. Rate: 7.6 symbols/min [2025-09-25T18:41:04.594876] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:04.660184] [DEBUG] [LOCAL ] ESI: Loaded 50831 existing records from primary storage. [2025-09-25T18:41:04.660348] [INFO ] [MAIN ] ESI: Loaded 50831 existing records. [2025-09-25T18:41:04.702484] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-25T18:41:04.859222] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:04.859457] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-25T18:41:04.859504] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-25T18:41:04.860212] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-25T18:41:04.860272] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-25T18:41:05.171945] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T18:41:05.247000] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:05.488765] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-25T18:41:05.589752] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T18:41:06.088863] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T18:41:06.244754] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T18:41:06.288673] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-25T18:41:07.088726] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-25T18:41:07.263826] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T18:41:07.888782] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-25T18:41:08.688689] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-25T18:41:08.970887] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T18:41:08.991544] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T18:41:09.488704] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-25T18:41:10.248629] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:41:10.288663] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-25T18:41:11.040177] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T18:41:11.088679] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-25T18:41:11.888686] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-25T18:41:12.207111] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T18:41:12.688730] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-25T18:41:12.916922] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T18:41:13.051333] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:41:13.465660] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T18:41:13.488698] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-25T18:41:14.287338] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T18:41:14.291200] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-25T18:41:15.088782] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-25T18:41:15.403573] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T18:41:15.888789] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-25T18:41:16.688839] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-25T18:41:17.050757] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T18:41:17.146230] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T18:41:17.488835] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-25T18:41:17.768902] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T18:41:18.288804] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-25T18:41:19.088774] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-25T18:41:19.217042] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T18:41:19.228033] [INFO ] [REMOTE ] ES: Full fetch complete (76170 records). [2025-09-25T18:41:19.228289] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-25T18:41:19.652365] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T18:41:19.723588] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-25T18:41:19.723762] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-25T18:41:19.725433] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-25T18:41:19.725507] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-25T18:41:19.727847] [DEBUG] [LOCAL ] ES: Trimmed 76170 records to 52919 (keeping 200 days of data) [2025-09-25T18:41:19.917740] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-25T18:41:20.088496] [DEBUG] [LOCAL ] ES: Primary data saved (52919 records). [2025-09-25T18:41:20.088777] [INFO ] [MAIN ] ES: Full history saved. [2025-09-25T18:41:20.089953] [INFO ] [MAIN ] Update Progress: 765/2372 symbols completed. ES took 35.0s. Estimated remaining: 3h 32m 46s. Rate: 7.6 symbols/min [2025-09-25T18:41:20.288551] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:20.335732] [DEBUG] [LOCAL ] ESNT: Loaded 38568 existing records from primary storage. [2025-09-25T18:41:20.335967] [INFO ] [MAIN ] ESNT: Loaded 38568 existing records. [2025-09-25T18:41:20.530514] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:20.530972] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-25T18:41:20.531030] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-25T18:41:20.531579] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-25T18:41:20.531682] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-25T18:41:20.692701] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-25T18:41:20.921425] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:20.959155] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T18:41:21.029135] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T18:41:21.488730] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-25T18:41:21.770593] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T18:41:22.288800] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-25T18:41:23.061192] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:41:23.088674] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-25T18:41:23.578705] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T18:41:23.888853] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-25T18:41:24.653196] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T18:41:24.688775] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-25T18:41:24.910234] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T18:41:25.488710] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-25T18:41:25.882884] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T18:41:26.288801] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-25T18:41:26.419314] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T18:41:26.423890] [INFO ] [REMOTE ] ESE: Full fetch complete (22097 records). [2025-09-25T18:41:26.424065] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-25T18:41:26.882197] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-25T18:41:26.882304] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-25T18:41:26.883142] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-25T18:41:26.883232] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-25T18:41:26.884139] [DEBUG] [LOCAL ] ESE: Trimmed 22097 records to 16748 (keeping 200 days of data) [2025-09-25T18:41:27.002082] [DEBUG] [LOCAL ] ESE: Primary data saved (16748 records). [2025-09-25T18:41:27.002299] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-25T18:41:27.002408] [INFO ] [MAIN ] Update Progress: 766/2372 symbols completed. ESE took 24.9s. Estimated remaining: 3h 32m 36s. Rate: 7.6 symbols/min [2025-09-25T18:41:27.093940] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-25T18:41:27.209223] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:27.261161] [DEBUG] [LOCAL ] ESRT: Loaded 46377 existing records from primary storage. [2025-09-25T18:41:27.261406] [INFO ] [MAIN ] ESRT: Loaded 46377 existing records. [2025-09-25T18:41:27.520978] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:27.521851] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-25T18:41:27.521932] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-25T18:41:27.522423] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-25T18:41:27.522600] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-25T18:41:27.749574] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T18:41:27.894178] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-25T18:41:28.144301] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:28.688697] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-25T18:41:28.718936] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T18:41:29.311084] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T18:41:29.317025] [INFO ] [REMOTE ] ESAB: Full fetch complete (35604 records). [2025-09-25T18:41:29.317118] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-25T18:41:29.490726] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-25T18:41:29.701540] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-25T18:41:29.701620] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-25T18:41:29.702288] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-25T18:41:29.702342] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-25T18:41:29.703190] [DEBUG] [LOCAL ] ESAB: Trimmed 35604 records to 26482 (keeping 200 days of data) [2025-09-25T18:41:29.862477] [DEBUG] [LOCAL ] ESAB: Primary data saved (26482 records). [2025-09-25T18:41:29.862614] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-25T18:41:29.862733] [INFO ] [MAIN ] Update Progress: 767/2372 symbols completed. ESAB took 27.9s. Estimated remaining: 3h 32m 17s. Rate: 7.6 symbols/min [2025-09-25T18:41:30.034913] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:30.064699] [DEBUG] [LOCAL ] ESS: Loaded 30038 existing records from primary storage. [2025-09-25T18:41:30.064883] [INFO ] [MAIN ] ESS: Loaded 30038 existing records. [2025-09-25T18:41:30.245638] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:30.246055] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-25T18:41:30.246204] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-25T18:41:30.246479] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-25T18:41:30.246546] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-25T18:41:30.309816] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-25T18:41:30.619036] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:30.651664] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-25T18:41:31.068784] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T18:41:31.088683] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-25T18:41:31.888750] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-25T18:41:32.045588] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T18:41:32.686819] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T18:41:32.690047] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-25T18:41:33.042066] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T18:41:33.488729] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-25T18:41:34.135010] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T18:41:34.288671] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-25T18:41:35.088741] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-25T18:41:35.161093] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T18:41:35.856376] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T18:41:35.888686] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-25T18:41:36.688742] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-25T18:41:36.743897] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T18:41:37.493840] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-25T18:41:37.510698] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T18:41:38.184997] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:41:38.288670] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-25T18:41:39.088749] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-25T18:41:39.252865] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T18:41:39.282855] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T18:41:39.888727] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-25T18:41:40.511903] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T18:41:40.688717] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-25T18:41:41.491415] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-25T18:41:41.497301] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:41:42.288751] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-25T18:41:42.512240] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T18:41:42.599745] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T18:41:43.088715] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-25T18:41:43.888712] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-25T18:41:43.940259] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T18:41:44.468380] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T18:41:44.688750] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-25T18:41:45.400729] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T18:41:45.488692] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-25T18:41:45.951980] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T18:41:46.288737] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-25T18:41:46.969942] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T18:41:47.088700] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-25T18:41:47.888694] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-25T18:41:47.931834] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T18:41:48.069953] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T18:41:48.688770] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-25T18:41:49.488732] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-25T18:41:49.778179] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T18:41:49.790752] [INFO ] [REMOTE ] ESI: Full fetch complete (72407 records). [2025-09-25T18:41:49.790923] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-25T18:41:50.196541] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T18:41:50.224816] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-25T18:41:50.225238] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-25T18:41:50.226166] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-25T18:41:50.226441] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-25T18:41:50.226357] [INFO ] [REMOTE ] ESNT: Full fetch complete (57173 records). [2025-09-25T18:41:50.226767] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-25T18:41:50.294575] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-25T18:41:50.294439] [DEBUG] [LOCAL ] ESI: Trimmed 72407 records to 51196 (keeping 200 days of data) [2025-09-25T18:41:50.751842] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-25T18:41:50.753596] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-25T18:41:50.754574] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-25T18:41:50.755306] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-25T18:41:50.763146] [DEBUG] [LOCAL ] ESNT: Trimmed 57173 records to 38813 (keeping 200 days of data) [2025-09-25T18:41:50.954016] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T18:41:51.099723] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-25T18:41:51.227391] [DEBUG] [LOCAL ] ESI: Primary data saved (51196 records). [2025-09-25T18:41:51.228337] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-25T18:41:51.228730] [INFO ] [MAIN ] Update Progress: 768/2372 symbols completed. ESI took 46.8s. Estimated remaining: 3h 32m 37s. Rate: 7.5 symbols/min [2025-09-25T18:41:51.414623] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:51.422719] [DEBUG] [LOCAL ] ESNT: Primary data saved (38813 records). [2025-09-25T18:41:51.422907] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-25T18:41:51.423007] [INFO ] [MAIN ] Update Progress: 769/2372 symbols completed. ESNT took 31.3s. Estimated remaining: 3h 32m 13s. Rate: 7.6 symbols/min [2025-09-25T18:41:51.616108] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:41:51.635677] [DEBUG] [LOCAL ] ESTC: Loaded 50067 existing records from primary storage. [2025-09-25T18:41:51.635835] [INFO ] [MAIN ] ESTC: Loaded 50067 existing records. [2025-09-25T18:41:51.845038] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:51.845286] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-25T18:41:51.845334] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-25T18:41:51.845688] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-25T18:41:51.845748] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-25T18:41:51.969829] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-25T18:41:51.980829] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-09-25T18:41:52.368970] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:41:52.379604] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-25T18:41:52.394751] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-25T18:41:52.413518] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-25T18:41:52.413619] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-25T18:41:52.510782] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:52.522830] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-25T18:41:52.815808] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:41:52.816169] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-25T18:41:56.813992] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (6.52 seconds). [2025-09-25T18:41:56.826969] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-25T18:41:59.444170] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (6.63 seconds). [2025-09-25T18:41:59.455528] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-25T18:42:00.035165] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (8.94 seconds). [2025-09-25T18:42:00.045153] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-25T18:42:00.706214] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (8.18 seconds). [2025-09-25T18:42:00.716701] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-25T18:42:00.914110] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (4.09 seconds). [2025-09-25T18:42:00.922804] [INFO ] [REMOTE ] ESRT: Full fetch complete (66509 records). [2025-09-25T18:42:00.922934] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-25T18:42:01.291849] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T18:42:01.366405] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-25T18:42:01.367167] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-25T18:42:01.368857] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-25T18:42:01.368990] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-25T18:42:01.367051] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-25T18:42:01.371582] [DEBUG] [LOCAL ] ESRT: Trimmed 66509 records to 46733 (keeping 200 days of data) [2025-09-25T18:42:01.653936] [DEBUG] [LOCAL ] ESRT: Primary data saved (46733 records). [2025-09-25T18:42:01.654166] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-25T18:42:01.654307] [INFO ] [MAIN ] Update Progress: 770/2372 symbols completed. ESRT took 34.7s. Estimated remaining: 3h 32m 10s. Rate: 7.6 symbols/min [2025-09-25T18:42:01.839426] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:01.870570] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-25T18:42:01.886901] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-25T18:42:01.893710] [DEBUG] [LOCAL ] ETB: Loaded 11967 existing records from primary storage. [2025-09-25T18:42:01.893856] [INFO ] [MAIN ] ETB: Loaded 11967 existing records. [2025-09-25T18:42:02.093884] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:02.094409] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-25T18:42:02.094491] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-25T18:42:02.094947] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-25T18:42:02.095035] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-25T18:42:02.451691] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T18:42:02.499187] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-25T18:42:02.555178] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:02.555524] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-25T18:42:03.070371] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T18:42:03.076991] [INFO ] [REMOTE ] ESS: Full fetch complete (43326 records). [2025-09-25T18:42:03.077179] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-25T18:42:03.498210] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-25T18:42:03.498362] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-25T18:42:03.500251] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-25T18:42:03.500366] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-25T18:42:03.506585] [DEBUG] [LOCAL ] ESS: Trimmed 43326 records to 30254 (keeping 200 days of data) [2025-09-25T18:42:03.726341] [DEBUG] [LOCAL ] ESS: Primary data saved (30254 records). [2025-09-25T18:42:03.726589] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-25T18:42:03.726886] [INFO ] [MAIN ] Update Progress: 771/2372 symbols completed. ESS took 33.9s. Estimated remaining: 3h 31m 50s. Rate: 7.6 symbols/min [2025-09-25T18:42:03.922437] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:03.958142] [DEBUG] [LOCAL ] ETD: Loaded 27360 existing records from primary storage. [2025-09-25T18:42:03.958348] [INFO ] [MAIN ] ETD: Loaded 27360 existing records. [2025-09-25T18:42:04.143063] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T18:42:04.173968] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-25T18:42:04.174177] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:04.175893] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-25T18:42:04.175949] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-25T18:42:04.176238] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-25T18:42:04.176300] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-25T18:42:04.601627] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:04.602109] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-25T18:42:05.151416] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (2.65 seconds). [2025-09-25T18:42:05.162596] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-25T18:42:05.242898] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (3.36 seconds). [2025-09-25T18:42:05.255257] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-25T18:42:06.677494] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-25T18:42:06.680165] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-25T18:42:07.651669] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T18:42:07.672569] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-25T18:42:07.674344] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (3.07 seconds). [2025-09-25T18:42:07.681638] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-25T18:42:07.920975] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-25T18:42:07.932684] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-25T18:42:08.037751] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-09-25T18:42:08.049422] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-25T18:42:08.460555] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T18:42:08.466282] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-25T18:42:08.635613] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T18:42:08.639696] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-25T18:42:09.428283] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T18:42:09.432251] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-25T18:42:09.572043] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T18:42:09.577688] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-25T18:42:09.805599] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T18:42:10.288855] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-25T18:42:10.363228] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-09-25T18:42:10.386948] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T18:42:10.869693] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T18:42:11.088745] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-25T18:42:11.888850] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-25T18:42:12.206534] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T18:42:12.499996] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T18:42:12.688783] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-25T18:42:13.488761] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-25T18:42:13.541625] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T18:42:14.109778] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T18:42:14.288749] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-25T18:42:15.088744] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-25T18:42:15.701072] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-25T18:42:15.888784] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-25T18:42:16.295950] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T18:42:16.503147] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-25T18:42:16.688716] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-25T18:42:17.028459] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T18:42:17.488734] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-25T18:42:18.288786] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-25T18:42:18.943804] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T18:42:19.009961] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-25T18:42:19.088676] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-25T18:42:19.767793] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T18:42:19.888717] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-25T18:42:20.688812] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-25T18:42:21.500703] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-25T18:42:21.535041] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T18:42:21.543547] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-25T18:42:21.688123] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T18:42:22.288840] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-25T18:42:22.931807] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T18:42:23.088704] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-25T18:42:23.130141] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T18:42:23.133826] [INFO ] [REMOTE ] ETB: Full fetch complete (17711 records). [2025-09-25T18:42:23.133934] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-25T18:42:23.134768] [FATAL] [VALIDATOR ] ETB: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:42:23.134878] [FATAL] [MAIN ] ETB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:42:23.134954] [WARN ] [MAIN ] ETB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:42:23.135057] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-25T18:42:23.135157] [DEBUG] [LOCAL ] ETB: No primary data file found to delete. [2025-09-25T18:42:23.135228] [INFO ] [LOCAL ] ETB: Starting deletion of derivative data. [2025-09-25T18:42:23.135773] [DEBUG] [LOCAL ] ETB: Deleted derivative data file. [2025-09-25T18:42:23.135956] [INFO ] [MAIN ] Update Progress: 772/2372 symbols completed. ETB took 21.5s. Estimated remaining: 3h 32m 6s. Rate: 7.5 symbols/min [2025-09-25T18:42:23.361696] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:23.386675] [DEBUG] [LOCAL ] ETG: Loaded 16563 existing records from primary storage. [2025-09-25T18:42:23.386904] [INFO ] [MAIN ] ETG: Loaded 16563 existing records. [2025-09-25T18:42:23.592284] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:23.592726] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-25T18:42:23.592800] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-25T18:42:23.593066] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-25T18:42:23.593133] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-25T18:42:23.898018] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-25T18:42:24.002126] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:24.120966] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T18:42:24.688776] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-25T18:42:25.488816] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-25T18:42:25.910259] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:42:26.148132] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-25T18:42:26.163683] [INFO ] [REMOTE ] ET: Full fetch complete (77955 records). [2025-09-25T18:42:26.163930] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-25T18:42:26.293846] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-25T18:42:26.594865] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-25T18:42:26.594984] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-25T18:42:26.596251] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-25T18:42:26.596326] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-25T18:42:26.598469] [DEBUG] [LOCAL ] ET: Trimmed 77955 records to 54179 (keeping 200 days of data) [2025-09-25T18:42:26.978522] [DEBUG] [LOCAL ] ET: Primary data saved (54179 records). [2025-09-25T18:42:26.978783] [INFO ] [MAIN ] ET: Full history saved. [2025-09-25T18:42:26.979994] [INFO ] [MAIN ] Update Progress: 773/2372 symbols completed. ET took 35.6s. Estimated remaining: 3h 31m 49s. Rate: 7.5 symbols/min [2025-09-25T18:42:27.099293] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-25T18:42:27.189485] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:27.218235] [DEBUG] [LOCAL ] ETJ: Loaded 16647 existing records from primary storage. [2025-09-25T18:42:27.218592] [INFO ] [MAIN ] ETJ: Loaded 16647 existing records. [2025-09-25T18:42:27.423336] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:27.423954] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-25T18:42:27.424017] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-25T18:42:27.424340] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-25T18:42:27.424408] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-25T18:42:27.849567] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T18:42:27.915030] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-25T18:42:27.939175] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:27.945276] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-25T18:42:27.957454] [INFO ] [REMOTE ] ESTC: Full fetch complete (72033 records). [2025-09-25T18:42:27.957805] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-25T18:42:28.401026] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-25T18:42:28.401216] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-25T18:42:28.402816] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-25T18:42:28.402950] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-25T18:42:28.421495] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T18:42:28.427919] [INFO ] [REMOTE ] ETD: Full fetch complete (38039 records). [2025-09-25T18:42:28.428305] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-25T18:42:28.428786] [DEBUG] [LOCAL ] ESTC: Trimmed 72033 records to 50398 (keeping 200 days of data) [2025-09-25T18:42:28.689751] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-25T18:42:28.986900] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T18:42:29.146153] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-25T18:42:29.146837] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-25T18:42:29.148140] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-25T18:42:29.148519] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-25T18:42:29.151947] [DEBUG] [LOCAL ] ETD: Trimmed 38039 records to 27502 (keeping 200 days of data) [2025-09-25T18:42:29.409377] [DEBUG] [LOCAL ] ESTC: Primary data saved (50398 records). [2025-09-25T18:42:29.410478] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-25T18:42:29.410683] [INFO ] [MAIN ] Update Progress: 774/2372 symbols completed. ESTC took 38.2s. Estimated remaining: 3h 31m 30s. Rate: 7.6 symbols/min [2025-09-25T18:42:29.489687] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-25T18:42:29.567141] [DEBUG] [LOCAL ] ETD: Primary data saved (27502 records). [2025-09-25T18:42:29.598373] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-25T18:42:29.603026] [INFO ] [MAIN ] Update Progress: 775/2372 symbols completed. ETD took 25.9s. Estimated remaining: 3h 31m 6s. Rate: 7.6 symbols/min [2025-09-25T18:42:29.602218] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:29.811548] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:29.838342] [DEBUG] [LOCAL ] ETO: Loaded 6493 existing records from primary storage. [2025-09-25T18:42:29.838549] [INFO ] [MAIN ] ETO: Loaded 6493 existing records. [2025-09-25T18:42:29.961467] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T18:42:29.960310] [DEBUG] [LOCAL ] ETN: Loaded 52834 existing records from primary storage. [2025-09-25T18:42:29.982087] [INFO ] [MAIN ] ETN: Loaded 52834 existing records. [2025-09-25T18:42:30.204895] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:30.248025] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-25T18:42:30.281782] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-25T18:42:30.288691] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-25T18:42:30.288478] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:30.295747] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-25T18:42:30.290112] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-25T18:42:30.302239] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T18:42:30.306673] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-25T18:42:30.302461] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-25T18:42:30.313333] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-25T18:42:30.357447] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-25T18:42:31.115731] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-25T18:42:31.170192] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:31.176387] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:31.322577] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T18:42:31.888711] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-25T18:42:32.298430] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T18:42:32.609725] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T18:42:32.688731] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-25T18:42:33.488766] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-25T18:42:34.269109] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T18:42:34.288721] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-25T18:42:34.614139] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T18:42:34.898597] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T18:42:35.088721] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-25T18:42:35.888689] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-25T18:42:36.153319] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T18:42:36.688771] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-25T18:42:37.314922] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T18:42:37.488687] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-25T18:42:37.923330] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T18:42:38.288765] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-25T18:42:38.721689] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T18:42:39.088918] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-25T18:42:39.413143] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T18:42:39.888756] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-25T18:42:40.688823] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-25T18:42:40.989360] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T18:42:41.146952] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T18:42:41.323337] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T18:42:41.488775] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-25T18:42:42.288749] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-25T18:42:42.317841] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:42:43.088734] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-25T18:42:43.888848] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-25T18:42:44.123945] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:42:44.348146] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T18:42:44.566229] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T18:42:44.688801] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-25T18:42:45.488742] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-25T18:42:46.288787] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-25T18:42:46.769038] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T18:42:46.795392] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T18:42:47.088707] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-25T18:42:47.328254] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:42:47.888763] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-25T18:42:48.192448] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T18:42:48.688754] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-25T18:42:48.869785] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T18:42:49.489070] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T18:42:49.489160] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-25T18:42:50.288752] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-25T18:42:51.089503] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-25T18:42:51.090599] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T18:42:51.527433] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T18:42:51.888732] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-25T18:42:52.027870] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T18:42:52.030961] [INFO ] [REMOTE ] ETG: Full fetch complete (24830 records). [2025-09-25T18:42:52.031084] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-25T18:42:52.427247] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-25T18:42:52.427332] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-25T18:42:52.427852] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-25T18:42:52.427913] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-25T18:42:52.428539] [DEBUG] [LOCAL ] ETG: Trimmed 24830 records to 16639 (keeping 200 days of data) [2025-09-25T18:42:52.539465] [DEBUG] [LOCAL ] ETG: Primary data saved (16639 records). [2025-09-25T18:42:52.539608] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-25T18:42:52.539724] [INFO ] [MAIN ] Update Progress: 776/2372 symbols completed. ETG took 29.4s. Estimated remaining: 3h 31m 29s. Rate: 7.5 symbols/min [2025-09-25T18:42:52.693949] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-25T18:42:52.719595] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:52.780710] [DEBUG] [LOCAL ] ETR: Loaded 53223 existing records from primary storage. [2025-09-25T18:42:52.780866] [INFO ] [MAIN ] ETR: Loaded 53223 existing records. [2025-09-25T18:42:52.974434] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:52.974807] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-25T18:42:52.974864] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-25T18:42:52.975147] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-25T18:42:52.975213] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-25T18:42:53.352964] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:53.428025] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T18:42:53.488746] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-25T18:42:53.676429] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T18:42:54.288743] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-25T18:42:55.088765] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-25T18:42:55.353188] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T18:42:55.418240] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T18:42:55.422566] [INFO ] [REMOTE ] ETJ: Full fetch complete (24947 records). [2025-09-25T18:42:55.422728] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-25T18:42:55.842431] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-25T18:42:55.842539] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-25T18:42:55.843336] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-25T18:42:55.843401] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-25T18:42:55.845154] [DEBUG] [LOCAL ] ETJ: Trimmed 24947 records to 16755 (keeping 200 days of data) [2025-09-25T18:42:55.894476] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-25T18:42:55.968054] [DEBUG] [LOCAL ] ETJ: Primary data saved (16755 records). [2025-09-25T18:42:55.968327] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-25T18:42:55.968482] [INFO ] [MAIN ] Update Progress: 777/2372 symbols completed. ETJ took 29.0s. Estimated remaining: 3h 31m 12s. Rate: 7.6 symbols/min [2025-09-25T18:42:56.154004] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:56.180616] [DEBUG] [LOCAL ] ETV: Loaded 21358 existing records from primary storage. [2025-09-25T18:42:56.180843] [INFO ] [MAIN ] ETV: Loaded 21358 existing records. [2025-09-25T18:42:56.372584] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:56.373002] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-25T18:42:56.373057] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-25T18:42:56.373366] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-25T18:42:56.373439] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-25T18:42:56.701015] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-25T18:42:56.751869] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:57.189788] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T18:42:57.439561] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T18:42:57.488701] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-25T18:42:57.775554] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T18:42:58.000088] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T18:42:58.001713] [INFO ] [REMOTE ] ETO: Full fetch complete (9287 records). [2025-09-25T18:42:58.001807] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-25T18:42:58.293821] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-25T18:42:58.374141] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-25T18:42:58.374245] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-25T18:42:58.374588] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-25T18:42:58.374679] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-25T18:42:58.375172] [DEBUG] [LOCAL ] ETO: Trimmed 9287 records to 6531 (keeping 200 days of data) [2025-09-25T18:42:58.416185] [DEBUG] [LOCAL ] ETO: Primary data saved (6531 records). [2025-09-25T18:42:58.416312] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-25T18:42:58.416426] [INFO ] [MAIN ] Update Progress: 778/2372 symbols completed. ETO took 28.8s. Estimated remaining: 3h 30m 52s. Rate: 7.6 symbols/min [2025-09-25T18:42:58.590808] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:42:58.617596] [DEBUG] [LOCAL ] ETW: Loaded 25028 existing records from primary storage. [2025-09-25T18:42:58.617756] [INFO ] [MAIN ] ETW: Loaded 25028 existing records. [2025-09-25T18:42:58.800119] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:42:58.800358] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-25T18:42:58.800406] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-25T18:42:58.800703] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-25T18:42:58.800764] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-25T18:42:59.093926] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-25T18:42:59.169705] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:42:59.888698] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-25T18:42:59.890067] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T18:43:00.688721] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-25T18:43:01.026881] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T18:43:01.488693] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-25T18:43:01.944237] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T18:43:02.295015] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-25T18:43:02.316525] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-25T18:43:03.088686] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-25T18:43:03.421412] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T18:43:03.446513] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T18:43:03.888700] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-25T18:43:04.080389] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T18:43:04.688721] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-25T18:43:05.488702] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-25T18:43:05.777994] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T18:43:06.005696] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-25T18:43:06.288760] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-25T18:43:07.088717] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-25T18:43:07.565239] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:43:07.689337] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-25T18:43:07.700041] [INFO ] [REMOTE ] ETN: Full fetch complete (76588 records). [2025-09-25T18:43:07.700209] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-25T18:43:07.894617] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-25T18:43:08.102058] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-25T18:43:08.102153] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-25T18:43:08.103109] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-25T18:43:08.103176] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-25T18:43:08.104785] [DEBUG] [LOCAL ] ETN: Trimmed 76588 records to 53221 (keeping 200 days of data) [2025-09-25T18:43:08.252877] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T18:43:08.471917] [DEBUG] [LOCAL ] ETN: Primary data saved (53221 records). [2025-09-25T18:43:08.472168] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-25T18:43:08.473087] [INFO ] [MAIN ] Update Progress: 779/2372 symbols completed. ETN took 39.1s. Estimated remaining: 3h 30m 49s. Rate: 7.6 symbols/min [2025-09-25T18:43:08.644261] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:08.652625] [DEBUG] [LOCAL ] ETX: Loaded 4965 existing records from primary storage. [2025-09-25T18:43:08.652766] [INFO ] [MAIN ] ETX: Loaded 4965 existing records. [2025-09-25T18:43:08.695313] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-25T18:43:08.838966] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:43:08.839280] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-25T18:43:08.839347] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-25T18:43:08.839547] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-25T18:43:08.839605] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-25T18:43:09.221689] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T18:43:09.225932] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:09.488686] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-25T18:43:09.789406] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T18:43:10.008822] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T18:43:10.288703] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-25T18:43:11.088711] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-25T18:43:11.671202] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T18:43:11.888687] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-25T18:43:11.997026] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:43:12.688754] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-25T18:43:13.165714] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T18:43:13.488729] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-25T18:43:14.288689] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-25T18:43:14.340362] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T18:43:14.587705] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T18:43:14.631294] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-25T18:43:15.088774] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-25T18:43:15.589061] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T18:43:15.888753] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-25T18:43:16.688733] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-25T18:43:16.953449] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T18:43:17.306508] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T18:43:17.488728] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-25T18:43:18.288764] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-25T18:43:18.618511] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T18:43:18.622801] [INFO ] [REMOTE ] ETV: Full fetch complete (31521 records). [2025-09-25T18:43:18.622883] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-25T18:43:18.623437] [FATAL] [VALIDATOR ] ETV: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:43:18.623532] [FATAL] [MAIN ] ETV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:43:18.623575] [WARN ] [MAIN ] ETV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:43:18.623615] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-25T18:43:18.623724] [DEBUG] [LOCAL ] ETV: No primary data file found to delete. [2025-09-25T18:43:18.623785] [INFO ] [LOCAL ] ETV: Starting deletion of derivative data. [2025-09-25T18:43:18.624115] [DEBUG] [LOCAL ] ETV: Deleted derivative data file. [2025-09-25T18:43:18.624207] [INFO ] [MAIN ] Update Progress: 780/2372 symbols completed. ETV took 22.7s. Estimated remaining: 3h 30m 45s. Rate: 7.6 symbols/min [2025-09-25T18:43:18.804406] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:18.804589] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-09-25T18:43:18.804664] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-09-25T18:43:18.804819] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-25T18:43:18.804863] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-25T18:43:18.804906] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-09-25T18:43:18.804939] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-25T18:43:19.093853] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-25T18:43:19.207984] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:19.717931] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T18:43:19.888763] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-25T18:43:20.413411] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T18:43:20.688776] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-25T18:43:21.121057] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T18:43:21.488689] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-25T18:43:21.513268] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T18:43:22.288737] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-25T18:43:22.581829] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T18:43:23.088770] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-25T18:43:23.888831] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-25T18:43:24.107894] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T18:43:24.252408] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T18:43:24.688762] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-25T18:43:25.332076] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T18:43:25.488680] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-25T18:43:25.830078] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T18:43:26.288779] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-25T18:43:26.873138] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:43:27.088741] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-25T18:43:27.572259] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:43:27.888746] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-25T18:43:28.688749] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-25T18:43:28.752556] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T18:43:28.761988] [INFO ] [REMOTE ] ETR: Full fetch complete (76596 records). [2025-09-25T18:43:28.762119] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-25T18:43:28.763202] [FATAL] [VALIDATOR ] ETR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:43:28.763311] [FATAL] [MAIN ] ETR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:43:28.763354] [WARN ] [MAIN ] ETR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:43:28.763394] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-25T18:43:28.763525] [DEBUG] [LOCAL ] ETR: No primary data file found to delete. [2025-09-25T18:43:28.763596] [INFO ] [LOCAL ] ETR: Starting deletion of derivative data. [2025-09-25T18:43:28.764041] [DEBUG] [LOCAL ] ETR: Deleted derivative data file. [2025-09-25T18:43:28.764196] [INFO ] [MAIN ] Update Progress: 781/2372 symbols completed. ETR took 36.2s. Estimated remaining: 3h 30m 42s. Rate: 7.6 symbols/min [2025-09-25T18:43:28.941763] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:28.956611] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T18:43:28.980091] [DEBUG] [LOCAL ] EVC: Loaded 19293 existing records from primary storage. [2025-09-25T18:43:28.980223] [INFO ] [MAIN ] EVC: Loaded 19293 existing records. [2025-09-25T18:43:29.161223] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:43:29.161444] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-25T18:43:29.161490] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-25T18:43:29.161823] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-25T18:43:29.161882] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-25T18:43:29.345590] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T18:43:29.498029] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-25T18:43:29.541584] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:30.288683] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-25T18:43:30.671483] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T18:43:31.088725] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-25T18:43:31.857242] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T18:43:31.863037] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:43:31.888765] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-25T18:43:32.688812] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-25T18:43:32.788261] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T18:43:32.790575] [INFO ] [REMOTE ] ETX: Full fetch complete (7042 records). [2025-09-25T18:43:32.790777] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-25T18:43:33.153450] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-25T18:43:33.153538] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-25T18:43:33.153783] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-25T18:43:33.153843] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-25T18:43:33.154242] [DEBUG] [LOCAL ] ETX: Trimmed 7042 records to 5002 (keeping 200 days of data) [2025-09-25T18:43:33.185276] [DEBUG] [LOCAL ] ETX: Primary data saved (5002 records). [2025-09-25T18:43:33.185375] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-25T18:43:33.185453] [INFO ] [MAIN ] Update Progress: 782/2372 symbols completed. ETX took 24.7s. Estimated remaining: 3h 30m 27s. Rate: 7.6 symbols/min [2025-09-25T18:43:33.358180] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:33.393344] [DEBUG] [LOCAL ] EVEX: Loaded 29987 existing records from primary storage. [2025-09-25T18:43:33.393494] [INFO ] [MAIN ] EVEX: Loaded 29987 existing records. [2025-09-25T18:43:33.494102] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-25T18:43:33.581898] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:43:33.582193] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-25T18:43:33.582248] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-25T18:43:33.582527] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-25T18:43:33.582585] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-25T18:43:33.893622] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T18:43:33.995255] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:34.288776] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-25T18:43:34.950613] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T18:43:35.088754] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-25T18:43:35.503982] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T18:43:35.888762] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-25T18:43:36.241208] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T18:43:36.688729] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-25T18:43:37.379346] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:43:37.488673] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-25T18:43:37.774810] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T18:43:38.288709] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-25T18:43:38.632959] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T18:43:39.088731] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-25T18:43:39.436075] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T18:43:39.441995] [INFO ] [REMOTE ] ETY: Full fetch complete (34078 records). [2025-09-25T18:43:39.442120] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-25T18:43:39.826798] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-25T18:43:39.826881] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-25T18:43:39.827439] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-25T18:43:39.827478] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-25T18:43:39.828295] [DEBUG] [LOCAL ] ETY: Trimmed 34078 records to 22913 (keeping 200 days of data) [2025-09-25T18:43:39.889998] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-25T18:43:39.969689] [DEBUG] [LOCAL ] ETY: Primary data saved (22913 records). [2025-09-25T18:43:39.969828] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-25T18:43:39.969909] [INFO ] [MAIN ] Update Progress: 783/2372 symbols completed. ETY took 21.3s. Estimated remaining: 3h 30m 17s. Rate: 7.6 symbols/min [2025-09-25T18:43:40.145027] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:40.156054] [DEBUG] [LOCAL ] EVF: Loaded 9239 existing records from primary storage. [2025-09-25T18:43:40.156176] [INFO ] [MAIN ] EVF: Loaded 9239 existing records. [2025-09-25T18:43:40.341981] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:43:40.342218] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-25T18:43:40.342264] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-25T18:43:40.342491] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-25T18:43:40.342549] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-25T18:43:40.507810] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T18:43:40.693884] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-25T18:43:40.754685] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:40.768149] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T18:43:41.488697] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-25T18:43:41.811062] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T18:43:42.288674] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-25T18:43:42.686725] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T18:43:43.088694] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-25T18:43:43.190380] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T18:43:43.888682] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-25T18:43:44.274030] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T18:43:44.688700] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-25T18:43:45.064532] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T18:43:45.069226] [INFO ] [REMOTE ] ETW: Full fetch complete (36298 records). [2025-09-25T18:43:45.069316] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-25T18:43:45.371906] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T18:43:45.464493] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-25T18:43:45.464575] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-25T18:43:45.465224] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-25T18:43:45.465287] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-25T18:43:45.466156] [DEBUG] [LOCAL ] ETW: Trimmed 36298 records to 25236 (keeping 200 days of data) [2025-09-25T18:43:45.520827] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-25T18:43:45.623867] [DEBUG] [LOCAL ] ETW: Primary data saved (25236 records). [2025-09-25T18:43:45.624009] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-25T18:43:45.624096] [INFO ] [MAIN ] Update Progress: 784/2372 symbols completed. ETW took 47.2s. Estimated remaining: 3h 30m 4s. Rate: 7.6 symbols/min [2025-09-25T18:43:45.803308] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:43:45.815279] [DEBUG] [LOCAL ] EVG: Loaded 5816 existing records from primary storage. [2025-09-25T18:43:45.815423] [INFO ] [MAIN ] EVG: Loaded 5816 existing records. [2025-09-25T18:43:45.997626] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:43:45.997994] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-25T18:43:45.998064] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-25T18:43:45.998278] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-25T18:43:45.998347] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-25T18:43:46.293891] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-25T18:43:46.379170] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:43:46.843842] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:43:47.088731] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-25T18:43:47.219477] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T18:43:47.888706] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-25T18:43:48.146689] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T18:43:48.553952] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T18:43:48.688726] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-25T18:43:49.488761] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-25T18:43:49.789477] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T18:43:50.288723] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-25T18:43:50.514558] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T18:43:51.088733] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-25T18:43:51.127636] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T18:43:51.888724] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-25T18:43:52.237248] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T18:43:52.688754] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-25T18:43:53.434978] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T18:43:53.488756] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-25T18:43:53.860203] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T18:43:54.288706] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-25T18:43:54.426001] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T18:43:55.088713] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-25T18:43:55.533026] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T18:43:55.884612] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T18:43:55.888680] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-25T18:43:56.497298] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T18:43:56.688784] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-25T18:43:57.488775] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-25T18:43:57.916001] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T18:43:58.288721] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-25T18:43:58.861458] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T18:43:59.088771] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-25T18:43:59.148575] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T18:43:59.729028] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T18:43:59.888739] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-25T18:44:00.688744] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-25T18:44:01.313554] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T18:44:01.488705] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-25T18:44:01.823404] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T18:44:01.832410] [INFO ] [REMOTE ] EVEX: Full fetch complete (41655 records). [2025-09-25T18:44:01.832517] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-25T18:44:02.220144] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-25T18:44:02.220224] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-25T18:44:02.220891] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-25T18:44:02.220955] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-25T18:44:02.221894] [DEBUG] [LOCAL ] EVEX: Trimmed 41655 records to 30253 (keeping 200 days of data) [2025-09-25T18:44:02.284973] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T18:44:02.315560] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-25T18:44:02.419471] [DEBUG] [LOCAL ] EVEX: Primary data saved (30253 records). [2025-09-25T18:44:02.419735] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-25T18:44:02.419889] [INFO ] [MAIN ] Update Progress: 785/2372 symbols completed. EVEX took 29.2s. Estimated remaining: 3h 30m 14s. Rate: 7.5 symbols/min [2025-09-25T18:44:02.624407] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:02.674188] [DEBUG] [LOCAL ] EVH: Loaded 49356 existing records from primary storage. [2025-09-25T18:44:02.674331] [INFO ] [MAIN ] EVH: Loaded 49356 existing records. [2025-09-25T18:44:02.886791] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:02.887068] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-25T18:44:02.887117] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-25T18:44:02.887489] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-25T18:44:02.887563] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-25T18:44:03.094929] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-25T18:44:03.284491] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:03.278960] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T18:44:03.888716] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-25T18:44:04.298822] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T18:44:04.303662] [INFO ] [REMOTE ] EVC: Full fetch complete (30909 records). [2025-09-25T18:44:04.303770] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-25T18:44:04.687220] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-25T18:44:04.687370] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-25T18:44:04.687978] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-25T18:44:04.688041] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-25T18:44:04.688896] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-25T18:44:04.689091] [DEBUG] [LOCAL ] EVC: Trimmed 30909 records to 19345 (keeping 200 days of data) [2025-09-25T18:44:04.812362] [DEBUG] [LOCAL ] EVC: Primary data saved (19345 records). [2025-09-25T18:44:04.812547] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-25T18:44:04.812665] [INFO ] [MAIN ] Update Progress: 786/2372 symbols completed. EVC took 36.0s. Estimated remaining: 3h 29m 55s. Rate: 7.6 symbols/min [2025-09-25T18:44:05.018788] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:05.031609] [DEBUG] [LOCAL ] EVN: Loaded 11052 existing records from primary storage. [2025-09-25T18:44:05.031750] [INFO ] [MAIN ] EVN: Loaded 11052 existing records. [2025-09-25T18:44:05.210569] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:05.210906] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-25T18:44:05.210954] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-25T18:44:05.211170] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-25T18:44:05.211228] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-25T18:44:05.489443] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-25T18:44:05.584626] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:05.625184] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T18:44:05.725698] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:44:06.288764] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-25T18:44:06.380454] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T18:44:07.088743] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-25T18:44:07.177458] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T18:44:07.179944] [INFO ] [REMOTE ] EVF: Full fetch complete (11988 records). [2025-09-25T18:44:07.180018] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-25T18:44:07.564557] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-25T18:44:07.564686] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-25T18:44:07.565016] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-25T18:44:07.565058] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-25T18:44:07.565582] [DEBUG] [LOCAL ] EVF: Trimmed 11988 records to 9349 (keeping 200 days of data) [2025-09-25T18:44:07.619807] [DEBUG] [LOCAL ] EVF: Primary data saved (9349 records). [2025-09-25T18:44:07.619942] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-25T18:44:07.620032] [INFO ] [MAIN ] Update Progress: 787/2372 symbols completed. EVF took 27.7s. Estimated remaining: 3h 29m 36s. Rate: 7.6 symbols/min [2025-09-25T18:44:07.806578] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:07.807434] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T18:44:07.848559] [DEBUG] [LOCAL ] EVR: Loaded 35549 existing records from primary storage. [2025-09-25T18:44:07.848915] [INFO ] [MAIN ] EVR: Loaded 35549 existing records. [2025-09-25T18:44:07.893798] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-25T18:44:08.041848] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:08.042099] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-25T18:44:08.042148] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-25T18:44:08.042904] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-25T18:44:08.042965] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-25T18:44:08.429154] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:08.688690] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-25T18:44:08.991458] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T18:44:09.488751] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-25T18:44:09.958067] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-25T18:44:09.983401] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T18:44:10.288724] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-25T18:44:11.088740] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-25T18:44:11.259177] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:44:11.888743] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-25T18:44:12.688729] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-25T18:44:12.735730] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T18:44:13.068376] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T18:44:13.488722] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-25T18:44:14.132621] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T18:44:14.288727] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-25T18:44:15.029988] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:44:15.088771] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-25T18:44:15.896955] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-25T18:44:15.900152] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T18:44:15.987519] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T18:44:16.688751] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-25T18:44:17.488741] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-25T18:44:17.636542] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T18:44:18.005469] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T18:44:18.288754] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-25T18:44:18.368729] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T18:44:19.088742] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-25T18:44:19.888707] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-25T18:44:19.968637] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T18:44:19.978282] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T18:44:20.577951] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T18:44:20.688723] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-25T18:44:21.492404] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-25T18:44:21.494342] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T18:44:22.288744] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-25T18:44:23.088748] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-25T18:44:23.199672] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T18:44:23.505359] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-25T18:44:23.888717] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-25T18:44:23.925482] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:44:24.688782] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-25T18:44:25.488723] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-25T18:44:25.598625] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:44:26.096961] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:44:26.260608] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T18:44:26.262244] [INFO ] [REMOTE ] EVG: Full fetch complete (8044 records). [2025-09-25T18:44:26.262343] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-25T18:44:26.293976] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-25T18:44:26.656203] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-25T18:44:26.656288] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-25T18:44:26.656529] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-25T18:44:26.656628] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-25T18:44:26.657139] [DEBUG] [LOCAL ] EVG: Trimmed 8044 records to 5833 (keeping 200 days of data) [2025-09-25T18:44:26.702748] [DEBUG] [LOCAL ] EVG: Primary data saved (5833 records). [2025-09-25T18:44:26.703059] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-25T18:44:26.703274] [INFO ] [MAIN ] Update Progress: 788/2372 symbols completed. EVG took 41.1s. Estimated remaining: 3h 29m 51s. Rate: 7.5 symbols/min [2025-09-25T18:44:26.878859] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:26.899681] [DEBUG] [LOCAL ] EVT: Loaded 17104 existing records from primary storage. [2025-09-25T18:44:26.899866] [INFO ] [MAIN ] EVT: Loaded 17104 existing records. [2025-09-25T18:44:27.087135] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:27.087433] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-25T18:44:27.087483] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-25T18:44:27.087827] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-25T18:44:27.087899] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-25T18:44:27.099714] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-25T18:44:27.500977] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:27.555170] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T18:44:27.888736] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-25T18:44:28.688763] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-25T18:44:28.850087] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T18:44:29.488685] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-25T18:44:29.553027] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T18:44:29.625025] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T18:44:30.288720] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-25T18:44:31.088759] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-25T18:44:31.120425] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:44:31.273179] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T18:44:31.275995] [INFO ] [REMOTE ] EVN: Full fetch complete (17431 records). [2025-09-25T18:44:31.276098] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-25T18:44:31.277985] [FATAL] [VALIDATOR ] EVN: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:44:31.278079] [FATAL] [MAIN ] EVN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:44:31.278179] [WARN ] [MAIN ] EVN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:44:31.278312] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-25T18:44:31.278411] [DEBUG] [LOCAL ] EVN: No primary data file found to delete. [2025-09-25T18:44:31.278487] [INFO ] [LOCAL ] EVN: Starting deletion of derivative data. [2025-09-25T18:44:31.278991] [DEBUG] [LOCAL ] EVN: Deleted derivative data file. [2025-09-25T18:44:31.279194] [INFO ] [MAIN ] Update Progress: 789/2372 symbols completed. EVN took 26.5s. Estimated remaining: 3h 29m 36s. Rate: 7.6 symbols/min [2025-09-25T18:44:31.467238] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:31.467532] [DEBUG] [LOCAL ] EVTC: No existing data file found in primary storage. [2025-09-25T18:44:31.467588] [WARN ] [MAIN ] EVTC: No existing data found, performing full refresh instead. [2025-09-25T18:44:31.467780] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-25T18:44:31.467876] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-25T18:44:31.467939] [DEBUG] [LOCAL ] EVTC: No primary data file found to delete. [2025-09-25T18:44:31.467976] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-25T18:44:31.882962] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:31.888715] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-25T18:44:32.229498] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T18:44:32.688774] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-25T18:44:33.352227] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T18:44:33.488745] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-25T18:44:33.764172] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T18:44:34.288745] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-25T18:44:34.883557] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T18:44:35.088717] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-25T18:44:35.888733] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-25T18:44:35.942838] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T18:44:36.484938] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T18:44:36.491035] [INFO ] [REMOTE ] EVR: Full fetch complete (50772 records). [2025-09-25T18:44:36.491192] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-25T18:44:36.693925] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-25T18:44:36.892064] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-25T18:44:36.892151] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-25T18:44:36.892925] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-25T18:44:36.892991] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-25T18:44:36.894209] [DEBUG] [LOCAL ] EVR: Trimmed 50772 records to 35727 (keeping 200 days of data) [2025-09-25T18:44:37.135743] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T18:44:37.169187] [DEBUG] [LOCAL ] EVR: Primary data saved (35727 records). [2025-09-25T18:44:37.169344] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-25T18:44:37.169464] [INFO ] [MAIN ] Update Progress: 790/2372 symbols completed. EVR took 29.5s. Estimated remaining: 3h 29m 24s. Rate: 7.6 symbols/min [2025-09-25T18:44:37.344973] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:37.392364] [DEBUG] [LOCAL ] EVTL: Loaded 37386 existing records from primary storage. [2025-09-25T18:44:37.392513] [INFO ] [MAIN ] EVTL: Loaded 37386 existing records. [2025-09-25T18:44:37.493901] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-25T18:44:37.581022] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:37.581311] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-25T18:44:37.581368] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-25T18:44:37.581907] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-25T18:44:37.581969] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-25T18:44:37.939909] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:38.288755] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-25T18:44:38.602673] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T18:44:38.613248] [INFO ] [REMOTE ] EVH: Full fetch complete (71764 records). [2025-09-25T18:44:38.613414] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-25T18:44:38.822206] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T18:44:39.096294] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-25T18:44:39.115629] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-25T18:44:39.115748] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-25T18:44:39.116739] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-25T18:44:39.116804] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-25T18:44:39.118317] [DEBUG] [LOCAL ] EVH: Trimmed 71764 records to 49734 (keeping 200 days of data) [2025-09-25T18:44:39.421899] [DEBUG] [LOCAL ] EVH: Primary data saved (49734 records). [2025-09-25T18:44:39.422039] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-25T18:44:39.422144] [INFO ] [MAIN ] Update Progress: 791/2372 symbols completed. EVH took 37.0s. Estimated remaining: 3h 29m 5s. Rate: 7.6 symbols/min [2025-09-25T18:44:39.604773] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:39.621522] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T18:44:39.646180] [DEBUG] [LOCAL ] EVTR: Loaded 23269 existing records from primary storage. [2025-09-25T18:44:39.646325] [INFO ] [MAIN ] EVTR: Loaded 23269 existing records. [2025-09-25T18:44:39.828884] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:39.829167] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-25T18:44:39.829222] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-25T18:44:39.829479] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-25T18:44:39.829537] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-25T18:44:39.893874] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-25T18:44:40.191781] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:40.482082] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T18:44:40.688753] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-25T18:44:41.109418] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T18:44:41.488722] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-25T18:44:41.908389] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:44:42.288745] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-25T18:44:42.718120] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T18:44:43.088717] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-25T18:44:43.592270] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T18:44:43.888734] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-25T18:44:44.055888] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:44:44.688689] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-25T18:44:44.996468] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T18:44:45.488725] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-25T18:44:46.288753] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-25T18:44:46.350683] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:44:46.574519] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T18:44:47.088728] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-25T18:44:47.871035] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:44:47.888682] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-25T18:44:48.543673] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T18:44:48.688725] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-25T18:44:48.709180] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T18:44:49.488704] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-25T18:44:49.727687] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T18:44:50.288705] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-25T18:44:50.587050] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T18:44:51.088713] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-25T18:44:51.352961] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T18:44:51.888715] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-25T18:44:52.123317] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T18:44:52.688747] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-25T18:44:53.345372] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T18:44:53.488699] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-25T18:44:53.881576] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T18:44:54.288755] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-25T18:44:54.619327] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T18:44:55.088730] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-25T18:44:55.638899] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T18:44:55.645171] [INFO ] [REMOTE ] EVTC: Full fetch complete (37938 records). [2025-09-25T18:44:55.645343] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-25T18:44:55.893818] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-25T18:44:56.050286] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-25T18:44:56.050405] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-25T18:44:56.051287] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-25T18:44:56.051362] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-25T18:44:56.053736] [DEBUG] [LOCAL ] EVTC: Trimmed 37938 records to 26605 (keeping 200 days of data) [2025-09-25T18:44:56.234495] [DEBUG] [LOCAL ] EVTC: Primary data saved (26605 records). [2025-09-25T18:44:56.234707] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-25T18:44:56.234820] [INFO ] [MAIN ] Update Progress: 792/2372 symbols completed. EVTC took 25.0s. Estimated remaining: 3h 29m 15s. Rate: 7.6 symbols/min [2025-09-25T18:44:56.379384] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T18:44:56.430697] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:44:56.488238] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-25T18:44:56.488392] [INFO ] [MAIN ] EW: Loaded 53396 existing records. [2025-09-25T18:44:56.672250] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:44:56.672552] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-25T18:44:56.672616] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-25T18:44:56.673144] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-25T18:44:56.673211] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-25T18:44:56.693824] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-25T18:44:56.819744] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:44:57.074026] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:44:57.488736] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-25T18:44:57.595443] [DEBUG] [REMOTE ] EW: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-25T18:44:57.595811] [WARN ] [REMOTE ] EW: No data returned for month 2024-12 [2025-09-25T18:44:58.288687] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-25T18:44:58.340690] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T18:44:59.088697] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-25T18:44:59.327158] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T18:44:59.888697] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-25T18:45:00.058458] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-25T18:45:00.688703] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-25T18:45:00.850571] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T18:45:01.488733] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-25T18:45:01.943178] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T18:45:02.288742] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-25T18:45:03.088691] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-25T18:45:03.255200] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T18:45:03.255988] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T18:45:03.267382] [INFO ] [REMOTE ] EVT: Full fetch complete (25159 records). [2025-09-25T18:45:03.267625] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-25T18:45:03.268576] [FATAL] [VALIDATOR ] EVT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:45:03.268684] [FATAL] [MAIN ] EVT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:45:03.268738] [WARN ] [MAIN ] EVT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:45:03.268779] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-25T18:45:03.268841] [DEBUG] [LOCAL ] EVT: No primary data file found to delete. [2025-09-25T18:45:03.268878] [INFO ] [LOCAL ] EVT: Starting deletion of derivative data. [2025-09-25T18:45:03.269218] [DEBUG] [LOCAL ] EVT: Deleted derivative data file. [2025-09-25T18:45:03.269312] [INFO ] [MAIN ] Update Progress: 793/2372 symbols completed. EVT took 36.6s. Estimated remaining: 3h 29m 5s. Rate: 7.6 symbols/min [2025-09-25T18:45:03.443475] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:03.493682] [DEBUG] [LOCAL ] EXG: Loaded 34232 existing records from primary storage. [2025-09-25T18:45:03.493832] [INFO ] [MAIN ] EXG: Loaded 34232 existing records. [2025-09-25T18:45:03.683867] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:03.684235] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-25T18:45:03.684299] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-25T18:45:03.684596] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-25T18:45:03.684689] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-25T18:45:03.894061] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-25T18:45:04.053790] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:04.688706] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-25T18:45:05.091181] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T18:45:05.488759] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-25T18:45:05.838620] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T18:45:05.929108] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T18:45:06.288702] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-25T18:45:06.876839] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T18:45:07.088694] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-25T18:45:07.888696] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-25T18:45:08.127161] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T18:45:08.688736] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-25T18:45:08.774180] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T18:45:08.780581] [INFO ] [REMOTE ] EVTR: Full fetch complete (31969 records). [2025-09-25T18:45:08.780695] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-25T18:45:09.158388] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-25T18:45:09.158493] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-25T18:45:09.159196] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-25T18:45:09.159258] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-25T18:45:09.160137] [DEBUG] [LOCAL ] EVTR: Trimmed 31969 records to 23468 (keeping 200 days of data) [2025-09-25T18:45:09.305569] [DEBUG] [LOCAL ] EVTR: Primary data saved (23468 records). [2025-09-25T18:45:09.305736] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-25T18:45:09.305833] [INFO ] [MAIN ] Update Progress: 794/2372 symbols completed. EVTR took 29.9s. Estimated remaining: 3h 28m 53s. Rate: 7.6 symbols/min [2025-09-25T18:45:09.477795] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:09.488700] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-25T18:45:09.534025] [DEBUG] [LOCAL ] EXK: Loaded 53125 existing records from primary storage. [2025-09-25T18:45:09.534183] [INFO ] [MAIN ] EXK: Loaded 53125 existing records. [2025-09-25T18:45:09.718135] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:09.718778] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-25T18:45:09.718855] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-25T18:45:09.719325] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-25T18:45:09.719398] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-25T18:45:09.893964] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T18:45:10.133687] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:10.272305] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T18:45:10.288678] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-25T18:45:11.088711] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-25T18:45:11.488478] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T18:45:11.497271] [INFO ] [REMOTE ] EVTL: Full fetch complete (50832 records). [2025-09-25T18:45:11.497390] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-25T18:45:11.902341] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-25T18:45:11.928495] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-25T18:45:11.928845] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-25T18:45:11.930189] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-25T18:45:11.930481] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-25T18:45:11.932806] [DEBUG] [LOCAL ] EVTL: Trimmed 50832 records to 37759 (keeping 200 days of data) [2025-09-25T18:45:12.162864] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T18:45:12.206129] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T18:45:12.250907] [DEBUG] [LOCAL ] EVTL: Primary data saved (37759 records). [2025-09-25T18:45:12.251118] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-25T18:45:12.251273] [INFO ] [MAIN ] Update Progress: 795/2372 symbols completed. EVTL took 35.1s. Estimated remaining: 3h 28m 35s. Rate: 7.6 symbols/min [2025-09-25T18:45:12.432259] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:12.467984] [DEBUG] [LOCAL ] EXP: Loaded 29985 existing records from primary storage. [2025-09-25T18:45:12.468157] [INFO ] [MAIN ] EXP: Loaded 29985 existing records. [2025-09-25T18:45:12.673684] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:12.673966] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-25T18:45:12.674027] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-25T18:45:12.674347] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-25T18:45:12.674418] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-25T18:45:12.696031] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-25T18:45:13.042968] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:13.488710] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-25T18:45:13.654144] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T18:45:14.288757] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-25T18:45:14.646512] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T18:45:14.827751] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T18:45:15.088722] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-25T18:45:15.888712] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-25T18:45:16.136071] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T18:45:16.688771] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-25T18:45:17.032157] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T18:45:17.085928] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T18:45:17.488890] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-25T18:45:18.167290] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T18:45:18.288732] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-25T18:45:19.088705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-25T18:45:19.416965] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T18:45:19.685990] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T18:45:19.888753] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-25T18:45:20.313868] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T18:45:20.688786] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-25T18:45:21.488697] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-25T18:45:21.674546] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T18:45:22.288732] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-25T18:45:22.580370] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T18:45:22.640830] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-25T18:45:23.088740] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-25T18:45:23.715489] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T18:45:23.888695] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-25T18:45:24.358037] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T18:45:24.688730] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-25T18:45:25.252260] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T18:45:25.488730] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-25T18:45:26.288741] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-25T18:45:26.606625] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T18:45:26.616533] [INFO ] [REMOTE ] EW: Full fetch complete (70909 records). [2025-09-25T18:45:26.616681] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-25T18:45:26.828974] [WARN ] [VALIDATOR ] EW: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T18:45:26.829820] [FATAL] [MAIN ] EW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:45:26.830013] [WARN ] [MAIN ] EW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:45:26.836758] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-25T18:45:26.848614] [DEBUG] [LOCAL ] EW: No primary data file found to delete. [2025-09-25T18:45:26.848731] [INFO ] [LOCAL ] EW: Starting deletion of derivative data. [2025-09-25T18:45:26.849309] [DEBUG] [LOCAL ] EW: Deleted derivative data file. [2025-09-25T18:45:26.849424] [INFO ] [MAIN ] Update Progress: 796/2372 symbols completed. EW took 30.6s. Estimated remaining: 3h 28m 41s. Rate: 7.6 symbols/min [2025-09-25T18:45:26.850090] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:45:27.033077] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:27.082941] [DEBUG] [LOCAL ] EXPD: Loaded 48123 existing records from primary storage. [2025-09-25T18:45:27.083084] [INFO ] [MAIN ] EXPD: Loaded 48123 existing records. [2025-09-25T18:45:27.094377] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-25T18:45:27.264863] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:27.265111] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-25T18:45:27.265168] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-25T18:45:27.265444] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-25T18:45:27.265502] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-25T18:45:27.627906] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:27.685537] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:45:27.888726] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-25T18:45:28.164144] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T18:45:28.688708] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-25T18:45:29.456629] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:45:29.488759] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-25T18:45:29.619427] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T18:45:29.627340] [INFO ] [REMOTE ] EXG: Full fetch complete (49885 records). [2025-09-25T18:45:29.627476] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-25T18:45:30.013340] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-25T18:45:30.013425] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-25T18:45:30.014192] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-25T18:45:30.014258] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-25T18:45:30.015430] [DEBUG] [LOCAL ] EXG: Trimmed 49885 records to 34473 (keeping 200 days of data) [2025-09-25T18:45:30.230061] [DEBUG] [LOCAL ] EXG: Primary data saved (34473 records). [2025-09-25T18:45:30.230203] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-25T18:45:30.230287] [INFO ] [MAIN ] Update Progress: 797/2372 symbols completed. EXG took 27.0s. Estimated remaining: 3h 28m 24s. Rate: 7.6 symbols/min [2025-09-25T18:45:30.288771] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-25T18:45:31.088739] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-25T18:45:31.579773] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T18:45:31.888774] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-25T18:45:31.945908] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T18:45:32.213763] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T18:45:32.688718] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-25T18:45:33.488686] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-25T18:45:33.676029] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T18:45:34.281825] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T18:45:34.288821] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-25T18:45:35.088705] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-25T18:45:35.270842] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T18:45:35.600678] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T18:45:35.888751] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-25T18:45:36.688717] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-25T18:45:36.879416] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T18:45:37.488748] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-25T18:45:37.671119] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T18:45:37.706707] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T18:45:38.288711] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-25T18:45:39.088686] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-25T18:45:39.312208] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T18:45:39.888733] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-25T18:45:40.007265] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T18:45:40.198216] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T18:45:40.688724] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-25T18:45:41.488731] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-25T18:45:41.965898] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T18:45:41.971177] [INFO ] [REMOTE ] EXP: Full fetch complete (42964 records). [2025-09-25T18:45:41.971281] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-25T18:45:41.972203] [FATAL] [VALIDATOR ] EXP: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:45:41.972381] [FATAL] [MAIN ] EXP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:45:41.972470] [WARN ] [MAIN ] EXP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:45:41.972587] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-25T18:45:41.972709] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-25T18:45:41.972765] [INFO ] [LOCAL ] EXP: Starting deletion of derivative data. [2025-09-25T18:45:41.973074] [DEBUG] [LOCAL ] EXP: Deleted derivative data file. [2025-09-25T18:45:41.973180] [INFO ] [MAIN ] Update Progress: 798/2372 symbols completed. EXP took 29.7s. Estimated remaining: 3h 28m 23s. Rate: 7.6 symbols/min [2025-09-25T18:45:42.081797] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-25T18:45:42.288775] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-25T18:45:43.216423] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:45:43.228026] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-25T18:45:44.381787] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T18:45:44.393536] [INFO ] [REMOTE ] EXK: Full fetch complete (76474 records). [2025-09-25T18:45:44.393818] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-25T18:45:44.826839] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-25T18:45:44.827007] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-25T18:45:44.828366] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-25T18:45:44.828438] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-25T18:45:44.830667] [DEBUG] [LOCAL ] EXK: Trimmed 76474 records to 53514 (keeping 200 days of data) [2025-09-25T18:45:44.953011] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T18:45:44.985147] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-25T18:45:45.215719] [DEBUG] [LOCAL ] EXK: Primary data saved (53514 records). [2025-09-25T18:45:45.215948] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-25T18:45:45.216074] [INFO ] [MAIN ] Update Progress: 799/2372 symbols completed. EXK took 35.9s. Estimated remaining: 3h 28m 6s. Rate: 7.6 symbols/min [2025-09-25T18:45:46.814919] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T18:45:46.826688] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-25T18:45:50.985322] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (4.16 seconds). [2025-09-25T18:45:50.995955] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-25T18:45:52.613791] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:45:52.622473] [INFO ] [REMOTE ] EXPD: Full fetch complete (68865 records). [2025-09-25T18:45:52.622629] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-25T18:45:52.623503] [FATAL] [VALIDATOR ] EXPD: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:45:52.623683] [FATAL] [MAIN ] EXPD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:45:52.623741] [WARN ] [MAIN ] EXPD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:45:52.623783] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-25T18:45:52.623842] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-09-25T18:45:52.623878] [INFO ] [LOCAL ] EXPD: Starting deletion of derivative data. [2025-09-25T18:45:52.624210] [DEBUG] [LOCAL ] EXPD: Deleted derivative data file. [2025-09-25T18:45:52.624311] [INFO ] [MAIN ] Update Progress: 800/2372 symbols completed. EXPD took 25.8s. Estimated remaining: 3h 27m 57s. Rate: 7.6 symbols/min [2025-09-25T18:45:53.235854] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:53.281331] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:53.369809] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:53.341162] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:45:53.429748] [DEBUG] [LOCAL ] FBIN: Loaded 50395 existing records from primary storage. [2025-09-25T18:45:53.430036] [INFO ] [MAIN ] FBIN: Loaded 50395 existing records. [2025-09-25T18:45:53.607240] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-25T18:45:53.644851] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-25T18:45:53.699767] [DEBUG] [LOCAL ] EXR: Loaded 45492 existing records from primary storage. [2025-09-25T18:45:53.714628] [INFO ] [MAIN ] EXR: Loaded 45492 existing records. [2025-09-25T18:45:53.709066] [DEBUG] [LOCAL ] FAF: Loaded 41902 existing records from primary storage. [2025-09-25T18:45:53.767487] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:53.767674] [INFO ] [MAIN ] FAF: Loaded 41902 existing records. [2025-09-25T18:45:53.830112] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-25T18:45:53.880766] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-25T18:45:54.041547] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-25T18:45:54.055405] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-25T18:45:54.078254] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:54.169422] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-25T18:45:54.169626] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-25T18:45:54.234856] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-25T18:45:54.235037] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-25T18:45:54.409919] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:54.421397] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:45:54.450970] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-25T18:45:54.451478] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-25T18:45:54.477334] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-25T18:45:54.507087] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-25T18:45:54.548722] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-25T18:45:54.548677] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-25T18:45:54.584867] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-25T18:45:54.577825] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-25T18:45:55.178600] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:55.317055] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-25T18:45:55.357628] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:55.459434] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-25T18:45:55.801496] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:55.817199] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-25T18:45:55.816873] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:45:55.817530] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-25T18:45:57.273393] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T18:45:57.300298] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-25T18:45:57.303081] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:45:57.310686] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-25T18:45:57.516359] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T18:45:57.525320] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-25T18:45:57.886499] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-25T18:45:57.897586] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-25T18:45:59.199342] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T18:45:59.206743] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-25T18:45:59.769612] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-25T18:45:59.780934] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-25T18:46:00.358173] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-25T18:46:00.367982] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-25T18:46:00.449031] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-25T18:46:00.459805] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-25T18:46:01.087567] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:46:01.094572] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-25T18:46:01.950543] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T18:46:01.962617] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-25T18:46:01.998138] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-25T18:46:02.013919] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-25T18:46:02.280932] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T18:46:02.289796] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-25T18:46:02.909196] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-25T18:46:02.919498] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-25T18:46:03.734780] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:46:03.747310] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-25T18:46:03.781450] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T18:46:03.792546] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-25T18:46:03.827136] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T18:46:03.837391] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-25T18:46:05.399240] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T18:46:05.409837] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-25T18:46:05.546697] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-25T18:46:05.548861] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T18:46:05.572376] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-25T18:46:05.572926] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-25T18:46:05.616599] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T18:46:05.627967] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-25T18:46:06.976505] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T18:46:06.986279] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-25T18:46:07.280736] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T18:46:07.292411] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-25T18:46:07.320488] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T18:46:07.331243] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-25T18:46:08.272018] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-25T18:46:08.283779] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-25T18:46:08.605853] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T18:46:08.695787] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-25T18:46:08.701300] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T18:46:09.003142] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T18:46:09.488787] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-25T18:46:10.206139] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T18:46:10.288692] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-25T18:46:11.063990] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-25T18:46:11.088683] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-25T18:46:11.537316] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T18:46:11.888733] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-25T18:46:12.201074] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T18:46:12.210337] [INFO ] [REMOTE ] FAF: Full fetch complete (57528 records). [2025-09-25T18:46:12.210471] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-25T18:46:12.602392] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-25T18:46:12.602472] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-25T18:46:12.603225] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-25T18:46:12.603288] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-25T18:46:12.604508] [DEBUG] [LOCAL ] FAF: Trimmed 57528 records to 42198 (keeping 200 days of data) [2025-09-25T18:46:12.693087] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-25T18:46:12.865748] [DEBUG] [LOCAL ] FAF: Primary data saved (42198 records). [2025-09-25T18:46:12.865882] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-25T18:46:12.865968] [INFO ] [MAIN ] Update Progress: 801/2372 symbols completed. FAF took 20.2s. Estimated remaining: 3h 28m 13s. Rate: 7.5 symbols/min [2025-09-25T18:46:13.038006] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:13.064527] [DEBUG] [LOCAL ] FBK: Loaded 25657 existing records from primary storage. [2025-09-25T18:46:13.064833] [INFO ] [MAIN ] FBK: Loaded 25657 existing records. [2025-09-25T18:46:13.251190] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:13.252330] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-25T18:46:13.252630] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-25T18:46:13.253007] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-25T18:46:13.253083] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-25T18:46:13.753480] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:13.757592] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-25T18:46:13.759853] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-25T18:46:13.773289] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:46:14.021496] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T18:46:14.288772] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-25T18:46:14.899492] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T18:46:15.088821] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-25T18:46:15.888743] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-25T18:46:15.949599] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T18:46:15.959156] [INFO ] [REMOTE ] FBIN: Full fetch complete (72612 records). [2025-09-25T18:46:15.959295] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-25T18:46:16.307002] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T18:46:16.391425] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-25T18:46:16.391509] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-25T18:46:16.392505] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-25T18:46:16.392576] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-25T18:46:16.394226] [DEBUG] [LOCAL ] FBIN: Trimmed 72612 records to 50757 (keeping 200 days of data) [2025-09-25T18:46:16.694822] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-25T18:46:16.715388] [DEBUG] [LOCAL ] FBIN: Primary data saved (50757 records). [2025-09-25T18:46:16.715552] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-25T18:46:16.715681] [INFO ] [MAIN ] Update Progress: 802/2372 symbols completed. FBIN took 24.1s. Estimated remaining: 3h 27m 57s. Rate: 7.5 symbols/min [2025-09-25T18:46:16.888340] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:16.931852] [DEBUG] [LOCAL ] FBP: Loaded 46232 existing records from primary storage. [2025-09-25T18:46:16.932021] [INFO ] [MAIN ] FBP: Loaded 46232 existing records. [2025-09-25T18:46:17.133701] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:17.134090] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-25T18:46:17.134154] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-25T18:46:17.134586] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-25T18:46:17.134686] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-25T18:46:17.489743] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-25T18:46:17.515838] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:17.617053] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T18:46:18.279904] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-25T18:46:18.291348] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-25T18:46:19.088707] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-25T18:46:19.203407] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T18:46:19.501989] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T18:46:19.888710] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-25T18:46:20.667847] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T18:46:20.688662] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-25T18:46:21.488708] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-25T18:46:21.780517] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T18:46:21.789236] [INFO ] [REMOTE ] EXR: Full fetch complete (65877 records). [2025-09-25T18:46:21.789363] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-25T18:46:22.209750] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-25T18:46:22.209885] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-25T18:46:22.210890] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-25T18:46:22.210989] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-25T18:46:22.215421] [DEBUG] [LOCAL ] EXR: Trimmed 65877 records to 45800 (keeping 200 days of data) [2025-09-25T18:46:22.312189] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-25T18:46:22.382078] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T18:46:22.555380] [DEBUG] [LOCAL ] EXR: Primary data saved (45800 records). [2025-09-25T18:46:22.555559] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-25T18:46:22.555727] [INFO ] [MAIN ] Update Progress: 803/2372 symbols completed. EXR took 29.9s. Estimated remaining: 3h 27m 45s. Rate: 7.6 symbols/min [2025-09-25T18:46:22.742088] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:22.762006] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T18:46:22.802021] [DEBUG] [LOCAL ] FBRT: Loaded 34469 existing records from primary storage. [2025-09-25T18:46:22.802168] [INFO ] [MAIN ] FBRT: Loaded 34469 existing records. [2025-09-25T18:46:22.985870] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:22.986151] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-25T18:46:22.986210] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-25T18:46:22.986501] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-25T18:46:22.986569] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-25T18:46:23.091906] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-25T18:46:23.350965] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:23.888730] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-25T18:46:24.149905] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T18:46:24.691520] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-25T18:46:24.695507] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.38 seconds). [2025-09-25T18:46:25.439205] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T18:46:25.488678] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-25T18:46:25.761588] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:46:26.288721] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-25T18:46:27.088759] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-25T18:46:27.888798] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-25T18:46:28.086066] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-25T18:46:28.097207] [INFO ] [REMOTE ] F: Full fetch complete (77999 records). [2025-09-25T18:46:28.097459] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-25T18:46:28.597997] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-25T18:46:28.619546] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-25T18:46:28.633858] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-25T18:46:28.633984] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-25T18:46:28.649863] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-25T18:46:28.678822] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T18:46:28.687160] [DEBUG] [LOCAL ] F: Trimmed 77999 records to 54210 (keeping 200 days of data) [2025-09-25T18:46:28.688805] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-25T18:46:28.978277] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T18:46:29.091302] [DEBUG] [LOCAL ] F: Primary data saved (54210 records). [2025-09-25T18:46:29.091483] [INFO ] [MAIN ] F: Full history saved. [2025-09-25T18:46:29.091599] [INFO ] [MAIN ] Update Progress: 804/2372 symbols completed. F took 36.5s. Estimated remaining: 3h 27m 34s. Rate: 7.6 symbols/min [2025-09-25T18:46:29.275875] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:29.294457] [DEBUG] [LOCAL ] FC: Loaded 15339 existing records from primary storage. [2025-09-25T18:46:29.294616] [INFO ] [MAIN ] FC: Loaded 15339 existing records. [2025-09-25T18:46:29.483886] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:29.484210] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-25T18:46:29.484261] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-25T18:46:29.484728] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-25T18:46:29.484792] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-25T18:46:29.497166] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-25T18:46:30.011335] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:30.252006] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T18:46:30.288784] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-25T18:46:30.514835] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T18:46:31.088739] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-25T18:46:31.153743] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T18:46:31.888721] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-25T18:46:32.182748] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T18:46:32.688754] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-25T18:46:33.145912] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T18:46:33.488717] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-25T18:46:33.644708] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T18:46:34.288703] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-25T18:46:34.999090] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T18:46:35.088668] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-25T18:46:35.597404] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:46:35.888719] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-25T18:46:36.688711] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-25T18:46:36.770058] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:46:36.851758] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T18:46:37.488680] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-25T18:46:37.555826] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T18:46:37.561407] [INFO ] [REMOTE ] FBK: Full fetch complete (33105 records). [2025-09-25T18:46:37.561501] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-25T18:46:37.931967] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-25T18:46:37.932059] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-25T18:46:37.932758] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-25T18:46:37.932821] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-25T18:46:37.933665] [DEBUG] [LOCAL ] FBK: Trimmed 33105 records to 25859 (keeping 200 days of data) [2025-09-25T18:46:38.104696] [DEBUG] [LOCAL ] FBK: Primary data saved (25859 records). [2025-09-25T18:46:38.104917] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-25T18:46:38.105116] [INFO ] [MAIN ] Update Progress: 805/2372 symbols completed. FBK took 25.2s. Estimated remaining: 3h 27m 29s. Rate: 7.6 symbols/min [2025-09-25T18:46:38.289353] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-25T18:46:38.289216] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:38.339607] [DEBUG] [LOCAL ] FCF: Loaded 39725 existing records from primary storage. [2025-09-25T18:46:38.339782] [INFO ] [MAIN ] FCF: Loaded 39725 existing records. [2025-09-25T18:46:38.464955] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T18:46:38.561430] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:38.561766] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-25T18:46:38.561825] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-25T18:46:38.562125] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-25T18:46:38.562211] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-25T18:46:38.937524] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:39.088711] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-25T18:46:39.889521] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-25T18:46:39.895118] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:46:40.688704] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-25T18:46:40.879443] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T18:46:40.924906] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T18:46:41.488786] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-25T18:46:42.242013] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T18:46:42.288713] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-25T18:46:42.308531] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T18:46:43.088720] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-25T18:46:43.861832] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T18:46:43.888670] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-25T18:46:44.010400] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T18:46:44.019970] [INFO ] [REMOTE ] FBP: Full fetch complete (66330 records). [2025-09-25T18:46:44.020087] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-25T18:46:44.413089] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-25T18:46:44.413199] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-25T18:46:44.414036] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-25T18:46:44.414101] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-25T18:46:44.418154] [DEBUG] [LOCAL ] FBP: Trimmed 66330 records to 46592 (keeping 200 days of data) [2025-09-25T18:46:44.688882] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-25T18:46:44.710440] [DEBUG] [LOCAL ] FBP: Primary data saved (46592 records). [2025-09-25T18:46:44.710537] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-25T18:46:44.710665] [INFO ] [MAIN ] Update Progress: 806/2372 symbols completed. FBP took 28.0s. Estimated remaining: 3h 27m 18s. Rate: 7.6 symbols/min [2025-09-25T18:46:44.850856] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:46:44.903890] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:44.936018] [DEBUG] [LOCAL ] FCN: Loaded 26239 existing records from primary storage. [2025-09-25T18:46:44.936159] [INFO ] [MAIN ] FCN: Loaded 26239 existing records. [2025-09-25T18:46:45.113380] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:45.113638] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-25T18:46:45.113722] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-25T18:46:45.113978] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-25T18:46:45.114036] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-25T18:46:45.465092] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:45.488670] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-25T18:46:46.121097] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T18:46:46.288713] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-25T18:46:46.663671] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T18:46:47.088748] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-25T18:46:47.619739] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T18:46:47.888754] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-25T18:46:48.585862] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:46:48.688683] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-25T18:46:49.046970] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T18:46:49.488806] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-25T18:46:50.157307] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:46:50.288732] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-25T18:46:50.901740] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T18:46:51.088764] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-25T18:46:51.587700] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T18:46:51.794575] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T18:46:51.888685] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-25T18:46:52.688742] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-25T18:46:53.494021] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-25T18:46:53.515042] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T18:46:53.748530] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T18:46:54.288755] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-25T18:46:54.868308] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T18:46:54.874840] [INFO ] [REMOTE ] FBRT: Full fetch complete (48513 records). [2025-09-25T18:46:54.874964] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-25T18:46:55.097701] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-25T18:46:55.267947] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-25T18:46:55.268067] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-25T18:46:55.269098] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-25T18:46:55.269169] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-25T18:46:55.270552] [DEBUG] [LOCAL ] FBRT: Trimmed 48513 records to 34745 (keeping 200 days of data) [2025-09-25T18:46:55.494515] [DEBUG] [LOCAL ] FBRT: Primary data saved (34745 records). [2025-09-25T18:46:55.494696] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-25T18:46:55.494853] [INFO ] [MAIN ] Update Progress: 807/2372 symbols completed. FBRT took 32.9s. Estimated remaining: 3h 27m 16s. Rate: 7.6 symbols/min [2025-09-25T18:46:55.672235] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:46:55.711558] [DEBUG] [LOCAL ] FCPT: Loaded 37377 existing records from primary storage. [2025-09-25T18:46:55.711732] [INFO ] [MAIN ] FCPT: Loaded 37377 existing records. [2025-09-25T18:46:55.897899] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-25T18:46:55.904002] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:46:55.904478] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-25T18:46:55.904667] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-25T18:46:55.905181] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-25T18:46:55.905483] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-25T18:46:56.042090] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T18:46:56.126887] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T18:46:56.345240] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:46:56.688795] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-25T18:46:57.211588] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:46:57.488755] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-25T18:46:58.092438] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T18:46:58.288751] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-25T18:46:58.994617] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T18:46:59.088786] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-25T18:46:59.734116] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T18:46:59.888725] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-25T18:47:00.015751] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T18:47:00.018759] [INFO ] [REMOTE ] FC: Full fetch complete (21510 records). [2025-09-25T18:47:00.018835] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-25T18:47:00.389087] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-25T18:47:00.389182] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-25T18:47:00.389704] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-25T18:47:00.389767] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-25T18:47:00.390383] [DEBUG] [LOCAL ] FC: Trimmed 21510 records to 15445 (keeping 200 days of data) [2025-09-25T18:47:00.479060] [DEBUG] [LOCAL ] FC: Primary data saved (15445 records). [2025-09-25T18:47:00.479193] [INFO ] [MAIN ] FC: Full history saved. [2025-09-25T18:47:00.479299] [INFO ] [MAIN ] Update Progress: 808/2372 symbols completed. FC took 31.4s. Estimated remaining: 3h 27m 2s. Rate: 7.6 symbols/min [2025-09-25T18:47:00.648157] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:00.648331] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-25T18:47:00.648387] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-25T18:47:00.648527] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-25T18:47:00.648571] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-25T18:47:00.648614] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-25T18:47:00.648673] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-25T18:47:00.693977] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-25T18:47:01.004061] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:01.488733] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-25T18:47:01.547134] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T18:47:01.668300] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T18:47:01.944968] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T18:47:02.288751] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-25T18:47:03.088719] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-25T18:47:03.606327] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T18:47:03.888783] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-25T18:47:04.318806] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T18:47:04.407056] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T18:47:04.688768] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-25T18:47:05.488762] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-25T18:47:06.071257] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T18:47:06.288685] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-25T18:47:06.466373] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T18:47:07.088718] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-25T18:47:07.809596] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T18:47:07.888709] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-25T18:47:08.314946] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T18:47:08.414823] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:47:08.688728] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-25T18:47:09.488809] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-25T18:47:09.994990] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T18:47:10.288704] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-25T18:47:10.998663] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T18:47:11.006270] [INFO ] [REMOTE ] FCF: Full fetch complete (58109 records). [2025-09-25T18:47:11.006480] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-25T18:47:11.089409] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-25T18:47:11.106694] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-25T18:47:11.456236] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-25T18:47:11.456355] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-25T18:47:11.457372] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-25T18:47:11.457439] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-25T18:47:11.460895] [DEBUG] [LOCAL ] FCF: Trimmed 58109 records to 39973 (keeping 200 days of data) [2025-09-25T18:47:11.564430] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-25T18:47:11.733020] [DEBUG] [LOCAL ] FCF: Primary data saved (39973 records). [2025-09-25T18:47:11.733197] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-25T18:47:11.733335] [INFO ] [MAIN ] Update Progress: 809/2372 symbols completed. FCF took 33.6s. Estimated remaining: 3h 27m 0s. Rate: 7.6 symbols/min [2025-09-25T18:47:11.899069] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-25T18:47:11.929012] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:11.947009] [DEBUG] [LOCAL ] FCT: Loaded 14369 existing records from primary storage. [2025-09-25T18:47:11.947167] [INFO ] [MAIN ] FCT: Loaded 14369 existing records. [2025-09-25T18:47:12.148359] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:12.148735] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-25T18:47:12.148809] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-25T18:47:12.149078] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-25T18:47:12.149140] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-25T18:47:12.517036] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:12.688728] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-25T18:47:13.123446] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T18:47:13.128168] [INFO ] [REMOTE ] FCN: Full fetch complete (35694 records). [2025-09-25T18:47:13.128257] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-25T18:47:13.496948] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-25T18:47:13.513513] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-25T18:47:13.513891] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-25T18:47:13.514505] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-25T18:47:13.514567] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-25T18:47:13.515515] [DEBUG] [LOCAL ] FCN: Trimmed 35694 records to 26414 (keeping 200 days of data) [2025-09-25T18:47:13.689520] [DEBUG] [LOCAL ] FCN: Primary data saved (26414 records). [2025-09-25T18:47:13.689681] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-25T18:47:13.689799] [INFO ] [MAIN ] Update Progress: 810/2372 symbols completed. FCN took 29.0s. Estimated remaining: 3h 26m 41s. Rate: 7.6 symbols/min [2025-09-25T18:47:13.805230] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T18:47:13.877790] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:13.932479] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-25T18:47:13.932704] [INFO ] [MAIN ] FCX: Loaded 53700 existing records. [2025-09-25T18:47:14.129385] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:14.129816] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-25T18:47:14.129880] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-25T18:47:14.130270] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-25T18:47:14.130349] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-25T18:47:14.302297] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-25T18:47:14.520663] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:14.827450] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-25T18:47:15.088764] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-25T18:47:15.170446] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T18:47:15.888698] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-25T18:47:16.050275] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T18:47:16.351549] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T18:47:16.688710] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-25T18:47:17.100278] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-25T18:47:17.488785] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-25T18:47:18.288734] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-25T18:47:18.891126] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T18:47:18.907597] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T18:47:19.088729] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-25T18:47:19.351479] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-25T18:47:19.888736] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-25T18:47:20.688709] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-25T18:47:20.803892] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T18:47:21.488728] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-25T18:47:22.288725] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-25T18:47:22.432687] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T18:47:22.714968] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T18:47:23.088783] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-25T18:47:23.713998] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T18:47:23.888714] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-25T18:47:23.940674] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T18:47:24.688778] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-25T18:47:25.033544] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-25T18:47:25.488695] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-25T18:47:25.902809] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T18:47:26.288702] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-25T18:47:26.416222] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:47:27.010316] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T18:47:27.011338] [INFO ] [REMOTE ] FCRX: Full fetch complete (1677 records). [2025-09-25T18:47:27.011411] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-25T18:47:27.093910] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-25T18:47:27.204432] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-25T18:47:27.204622] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:47:27.204728] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:47:27.204801] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-25T18:47:27.204866] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-25T18:47:27.204912] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-25T18:47:27.204978] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-25T18:47:27.205042] [INFO ] [MAIN ] Update Progress: 811/2372 symbols completed. FCRX took 26.7s. Estimated remaining: 3h 26m 44s. Rate: 7.6 symbols/min [2025-09-25T18:47:27.372566] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:27.411197] [DEBUG] [LOCAL ] FDP: Loaded 30413 existing records from primary storage. [2025-09-25T18:47:27.411333] [INFO ] [MAIN ] FDP: Loaded 30413 existing records. [2025-09-25T18:47:27.590852] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:27.591116] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-25T18:47:27.591163] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-25T18:47:27.591763] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-25T18:47:27.591822] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-25T18:47:27.893902] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-25T18:47:27.960246] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:28.688788] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-25T18:47:29.005441] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T18:47:29.428312] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T18:47:29.488749] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-25T18:47:29.913426] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T18:47:30.288733] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-25T18:47:30.885128] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T18:47:30.903523] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T18:47:31.088725] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-25T18:47:31.888719] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-25T18:47:32.000556] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T18:47:32.688722] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-25T18:47:33.488704] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-25T18:47:33.890970] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T18:47:34.071153] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T18:47:34.288694] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-25T18:47:34.527381] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T18:47:34.531171] [INFO ] [REMOTE ] FCT: Full fetch complete (21138 records). [2025-09-25T18:47:34.531256] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-25T18:47:34.922333] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-25T18:47:34.922415] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-25T18:47:34.922943] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-25T18:47:34.923006] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-25T18:47:34.923681] [DEBUG] [LOCAL ] FCT: Trimmed 21138 records to 14502 (keeping 200 days of data) [2025-09-25T18:47:35.018059] [DEBUG] [LOCAL ] FCT: Primary data saved (14502 records). [2025-09-25T18:47:35.018221] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-25T18:47:35.018333] [INFO ] [MAIN ] Update Progress: 812/2372 symbols completed. FCT took 23.3s. Estimated remaining: 3h 26m 35s. Rate: 7.6 symbols/min [2025-09-25T18:47:35.093823] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-25T18:47:35.203408] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:35.231375] [DEBUG] [LOCAL ] FDS: Loaded 26227 existing records from primary storage. [2025-09-25T18:47:35.231532] [INFO ] [MAIN ] FDS: Loaded 26227 existing records. [2025-09-25T18:47:35.423074] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:35.423357] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-25T18:47:35.423417] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-25T18:47:35.423634] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-25T18:47:35.423729] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-25T18:47:35.794519] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:35.888669] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-25T18:47:36.380953] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T18:47:36.409826] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T18:47:36.688727] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-25T18:47:37.080491] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T18:47:37.488753] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-25T18:47:37.619928] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T18:47:38.288761] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-25T18:47:38.988148] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:47:38.995502] [INFO ] [REMOTE ] FCPT: Full fetch complete (53332 records). [2025-09-25T18:47:38.995618] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-25T18:47:39.093921] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-25T18:47:39.409443] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-25T18:47:39.409767] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-25T18:47:39.410713] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-25T18:47:39.410796] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-25T18:47:39.412814] [DEBUG] [LOCAL ] FCPT: Trimmed 53332 records to 37647 (keeping 200 days of data) [2025-09-25T18:47:39.500400] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T18:47:39.674737] [DEBUG] [LOCAL ] FCPT: Primary data saved (37647 records). [2025-09-25T18:47:39.674910] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-25T18:47:39.674999] [INFO ] [MAIN ] Update Progress: 813/2372 symbols completed. FCPT took 44.2s. Estimated remaining: 3h 26m 21s. Rate: 7.6 symbols/min [2025-09-25T18:47:39.865691] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:39.900216] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-25T18:47:39.922127] [DEBUG] [LOCAL ] FDX: Loaded 51612 existing records from primary storage. [2025-09-25T18:47:39.922284] [INFO ] [MAIN ] FDX: Loaded 51612 existing records. [2025-09-25T18:47:40.175840] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:40.176158] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-25T18:47:40.176212] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-25T18:47:40.176530] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-25T18:47:40.176593] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-25T18:47:40.530734] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:40.688708] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-25T18:47:40.732732] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T18:47:40.815412] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T18:47:41.488753] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-25T18:47:42.034878] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T18:47:42.288721] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-25T18:47:42.372774] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T18:47:43.088682] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-25T18:47:43.521419] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T18:47:43.888728] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-25T18:47:44.294247] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T18:47:44.688733] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-25T18:47:45.231022] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T18:47:45.488727] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-25T18:47:46.288730] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-25T18:47:46.693269] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T18:47:46.761114] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T18:47:47.088754] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-25T18:47:47.506095] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T18:47:47.888782] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-25T18:47:48.688797] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-25T18:47:49.417752] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-25T18:47:49.486250] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T18:47:49.496532] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-25T18:47:49.612580] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T18:47:49.621050] [INFO ] [REMOTE ] FDP: Full fetch complete (42765 records). [2025-09-25T18:47:49.621297] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-25T18:47:50.027286] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-25T18:47:50.027407] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-25T18:47:50.028589] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-25T18:47:50.028680] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-25T18:47:50.030179] [DEBUG] [LOCAL ] FDP: Trimmed 42765 records to 30588 (keeping 200 days of data) [2025-09-25T18:47:50.238120] [DEBUG] [LOCAL ] FDP: Primary data saved (30588 records). [2025-09-25T18:47:50.238332] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-25T18:47:50.238469] [INFO ] [MAIN ] Update Progress: 814/2372 symbols completed. FDP took 23.0s. Estimated remaining: 3h 26m 18s. Rate: 7.6 symbols/min [2025-09-25T18:47:50.295005] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-25T18:47:50.420725] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:50.481068] [DEBUG] [LOCAL ] FE: Loaded 53428 existing records from primary storage. [2025-09-25T18:47:50.481272] [INFO ] [MAIN ] FE: Loaded 53428 existing records. [2025-09-25T18:47:50.680065] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:47:50.680416] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-25T18:47:50.680475] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-25T18:47:50.680773] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-25T18:47:50.680834] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-25T18:47:51.064308] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:51.088676] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-25T18:47:51.380367] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:47:51.563753] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T18:47:51.888740] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-25T18:47:52.625366] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T18:47:52.688771] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-25T18:47:53.488777] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-25T18:47:54.259791] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-25T18:47:54.270364] [INFO ] [REMOTE ] FCX: Full fetch complete (77740 records). [2025-09-25T18:47:54.270736] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-25T18:47:54.311191] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-25T18:47:54.701783] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-25T18:47:54.702198] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-25T18:47:54.703299] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-25T18:47:54.703685] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-25T18:47:54.723939] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:47:54.731134] [DEBUG] [LOCAL ] FCX: Trimmed 77740 records to 54090 (keeping 200 days of data) [2025-09-25T18:47:54.761221] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T18:47:55.088835] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-25T18:47:55.100581] [DEBUG] [LOCAL ] FCX: Primary data saved (54090 records). [2025-09-25T18:47:55.100791] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-25T18:47:55.100891] [INFO ] [MAIN ] Update Progress: 815/2372 symbols completed. FCX took 41.4s. Estimated remaining: 3h 26m 4s. Rate: 7.6 symbols/min [2025-09-25T18:47:55.272399] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:47:55.272637] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-25T18:47:55.272714] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-25T18:47:55.272857] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-25T18:47:55.272899] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-25T18:47:55.272940] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-25T18:47:55.272976] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-25T18:47:55.634211] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:47:55.888729] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-25T18:47:56.064046] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T18:47:56.249879] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T18:47:56.250010] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T18:47:56.688775] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-25T18:47:57.488739] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-25T18:47:57.907464] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T18:47:58.288757] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-25T18:47:59.088780] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-25T18:47:59.391050] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T18:47:59.524272] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T18:47:59.888692] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-25T18:47:59.987082] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T18:48:00.688774] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-25T18:48:01.488765] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-25T18:48:01.567473] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T18:48:01.574903] [INFO ] [REMOTE ] FDS: Full fetch complete (37094 records). [2025-09-25T18:48:01.575064] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-25T18:48:01.970586] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-25T18:48:01.970739] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-25T18:48:01.971512] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-25T18:48:01.971560] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-25T18:48:01.972964] [DEBUG] [LOCAL ] FDS: Trimmed 37094 records to 26520 (keeping 200 days of data) [2025-09-25T18:48:02.148734] [DEBUG] [LOCAL ] FDS: Primary data saved (26520 records). [2025-09-25T18:48:02.148945] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-25T18:48:02.149070] [INFO ] [MAIN ] Update Progress: 816/2372 symbols completed. FDS took 27.1s. Estimated remaining: 3h 25m 55s. Rate: 7.6 symbols/min [2025-09-25T18:48:02.296053] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-25T18:48:02.329688] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:02.366584] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T18:48:02.418186] [DEBUG] [LOCAL ] FERG: Loaded 48996 existing records from primary storage. [2025-09-25T18:48:02.418368] [INFO ] [MAIN ] FERG: Loaded 48996 existing records. [2025-09-25T18:48:02.600508] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:02.600823] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-25T18:48:02.600878] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-25T18:48:02.601240] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-25T18:48:02.601301] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-25T18:48:02.763679] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T18:48:02.991176] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:03.026314] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T18:48:03.088677] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-25T18:48:03.888732] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-25T18:48:04.366775] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T18:48:04.688701] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-25T18:48:04.763096] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T18:48:05.488741] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-25T18:48:06.288711] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-25T18:48:06.745383] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T18:48:07.088723] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-25T18:48:07.226488] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T18:48:07.888831] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-25T18:48:08.019313] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T18:48:08.688720] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-25T18:48:08.791433] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T18:48:09.160269] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T18:48:09.274228] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T18:48:09.488734] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-25T18:48:10.288738] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-25T18:48:11.088804] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-25T18:48:11.181934] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T18:48:11.805366] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T18:48:11.888691] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-25T18:48:12.688750] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-25T18:48:12.976479] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-25T18:48:13.146745] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T18:48:13.488749] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-25T18:48:13.634066] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:48:13.832967] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-25T18:48:14.288736] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-25T18:48:14.661835] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T18:48:15.088782] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-25T18:48:15.888790] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-25T18:48:16.688722] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-25T18:48:17.114053] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-25T18:48:17.120324] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T18:48:17.488692] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-25T18:48:17.750844] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T18:48:18.288705] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-25T18:48:18.906213] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T18:48:18.907464] [INFO ] [REMOTE ] FENG: Full fetch complete (2241 records). [2025-09-25T18:48:18.907540] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-25T18:48:19.105344] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-25T18:48:19.112956] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T18:48:19.114457] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:48:19.114550] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:48:19.114777] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-25T18:48:19.114976] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-25T18:48:19.115043] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-25T18:48:19.115211] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-25T18:48:19.115344] [INFO ] [MAIN ] Update Progress: 817/2372 symbols completed. FENG took 24.0s. Estimated remaining: 3h 26m 4s. Rate: 7.5 symbols/min [2025-09-25T18:48:19.295057] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:19.330601] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T18:48:19.346736] [DEBUG] [LOCAL ] FET: Loaded 12711 existing records from primary storage. [2025-09-25T18:48:19.347267] [INFO ] [MAIN ] FET: Loaded 12711 existing records. [2025-09-25T18:48:19.530469] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:19.530758] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-25T18:48:19.530816] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-25T18:48:19.531037] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-25T18:48:19.531096] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-25T18:48:19.895450] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-25T18:48:19.895306] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:20.688792] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-25T18:48:20.952756] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T18:48:21.272263] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:48:21.488749] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-25T18:48:22.288726] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-25T18:48:22.845329] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-25T18:48:22.855280] [INFO ] [REMOTE ] FDX: Full fetch complete (74403 records). [2025-09-25T18:48:22.855421] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-25T18:48:23.104603] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-25T18:48:23.193792] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T18:48:23.296515] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-25T18:48:23.296779] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-25T18:48:23.298151] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-25T18:48:23.298246] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-25T18:48:23.300274] [DEBUG] [LOCAL ] FDX: Trimmed 74403 records to 51985 (keeping 200 days of data) [2025-09-25T18:48:23.429509] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T18:48:23.441822] [INFO ] [REMOTE ] FE: Full fetch complete (77207 records). [2025-09-25T18:48:23.442753] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-25T18:48:23.901466] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-25T18:48:23.897482] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-25T18:48:23.903329] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-25T18:48:23.905829] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-25T18:48:23.906472] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-25T18:48:23.915830] [DEBUG] [LOCAL ] FE: Trimmed 77207 records to 53818 (keeping 200 days of data) [2025-09-25T18:48:24.366551] [DEBUG] [LOCAL ] FDX: Primary data saved (51985 records). [2025-09-25T18:48:24.367276] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-25T18:48:24.371799] [INFO ] [MAIN ] Update Progress: 818/2372 symbols completed. FDX took 44.7s. Estimated remaining: 3h 25m 51s. Rate: 7.5 symbols/min [2025-09-25T18:48:24.585789] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:24.682695] [DEBUG] [LOCAL ] FF: Loaded 25504 existing records from primary storage. [2025-09-25T18:48:24.684025] [INFO ] [MAIN ] FF: Loaded 25504 existing records. [2025-09-25T18:48:24.856052] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T18:48:24.926851] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-25T18:48:24.934517] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:24.937201] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-25T18:48:24.938459] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-25T18:48:24.939830] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-25T18:48:24.940431] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-25T18:48:24.948487] [DEBUG] [LOCAL ] FE: Primary data saved (53818 records). [2025-09-25T18:48:24.976113] [INFO ] [MAIN ] FE: Full history saved. [2025-09-25T18:48:24.989433] [INFO ] [MAIN ] Update Progress: 819/2372 symbols completed. FE took 34.8s. Estimated remaining: 3h 25m 29s. Rate: 7.6 symbols/min [2025-09-25T18:48:25.278321] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-25T18:48:25.488665] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-25T18:48:25.488506] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:25.577634] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:25.581227] [DEBUG] [LOCAL ] FFA: Loaded 5680 existing records from primary storage. [2025-09-25T18:48:25.581302] [INFO ] [MAIN ] FFA: Loaded 5680 existing records. [2025-09-25T18:48:25.773914] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T18:48:25.779776] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:25.784444] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-25T18:48:25.784506] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-25T18:48:25.784783] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-25T18:48:25.784845] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-25T18:48:26.147967] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:26.288667] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-25T18:48:26.814123] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-25T18:48:27.088770] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-25T18:48:27.188964] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T18:48:27.888756] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-25T18:48:28.163277] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T18:48:28.688710] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-25T18:48:29.279160] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T18:48:29.488678] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-25T18:48:29.573848] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T18:48:30.288710] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-25T18:48:30.747147] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T18:48:31.088728] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-25T18:48:31.673234] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T18:48:31.888756] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-25T18:48:31.978081] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T18:48:32.534195] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T18:48:32.688742] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-25T18:48:33.488686] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-25T18:48:33.634523] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T18:48:34.288736] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-25T18:48:35.088750] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-25T18:48:35.307267] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T18:48:35.317363] [INFO ] [REMOTE ] FERG: Full fetch complete (71053 records). [2025-09-25T18:48:35.317546] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-25T18:48:35.573425] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:48:35.746382] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-25T18:48:35.746596] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-25T18:48:35.747588] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-25T18:48:35.747680] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-25T18:48:35.749321] [DEBUG] [LOCAL ] FERG: Trimmed 71053 records to 49361 (keeping 200 days of data) [2025-09-25T18:48:35.928689] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-25T18:48:35.977170] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T18:48:36.072939] [DEBUG] [LOCAL ] FERG: Primary data saved (49361 records). [2025-09-25T18:48:36.073120] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-25T18:48:36.074338] [INFO ] [MAIN ] Update Progress: 820/2372 symbols completed. FERG took 33.9s. Estimated remaining: 3h 25m 27s. Rate: 7.6 symbols/min [2025-09-25T18:48:36.242154] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:36.261535] [DEBUG] [LOCAL ] FFC: Loaded 16629 existing records from primary storage. [2025-09-25T18:48:36.261707] [INFO ] [MAIN ] FFC: Loaded 16629 existing records. [2025-09-25T18:48:36.439019] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:36.439280] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-25T18:48:36.439329] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-25T18:48:36.439577] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-25T18:48:36.439635] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-25T18:48:36.690176] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-25T18:48:36.800124] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T18:48:36.820374] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:37.488758] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-25T18:48:37.795792] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T18:48:38.288725] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-25T18:48:38.766354] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:48:39.088733] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-25T18:48:39.106584] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T18:48:39.888721] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-25T18:48:40.456170] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T18:48:40.688683] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-25T18:48:40.923586] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T18:48:41.488684] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-25T18:48:41.611790] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T18:48:42.288722] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-25T18:48:42.656769] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T18:48:42.844528] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T18:48:43.088724] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-25T18:48:43.888747] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-25T18:48:44.150171] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T18:48:44.153864] [INFO ] [REMOTE ] FET: Full fetch complete (18223 records). [2025-09-25T18:48:44.153947] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-25T18:48:44.517670] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-25T18:48:44.517761] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-25T18:48:44.518170] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-25T18:48:44.518213] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-25T18:48:44.518809] [DEBUG] [LOCAL ] FET: Trimmed 18223 records to 12838 (keeping 200 days of data) [2025-09-25T18:48:44.594341] [DEBUG] [LOCAL ] FET: Primary data saved (12838 records). [2025-09-25T18:48:44.594512] [INFO ] [MAIN ] FET: Full history saved. [2025-09-25T18:48:44.594676] [INFO ] [MAIN ] Update Progress: 821/2372 symbols completed. FET took 25.5s. Estimated remaining: 3h 25m 20s. Rate: 7.6 symbols/min [2025-09-25T18:48:44.698913] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-25T18:48:44.774823] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:44.811962] [DEBUG] [LOCAL ] FFWM: Loaded 36155 existing records from primary storage. [2025-09-25T18:48:44.812111] [INFO ] [MAIN ] FFWM: Loaded 36155 existing records. [2025-09-25T18:48:44.993587] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:44.993968] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-25T18:48:44.994021] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-25T18:48:44.994406] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-25T18:48:44.994466] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-25T18:48:45.180057] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T18:48:45.419803] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T18:48:45.472076] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:45.488682] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-25T18:48:46.288747] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-25T18:48:46.771489] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T18:48:47.088779] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-25T18:48:47.204992] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T18:48:47.674013] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T18:48:47.888767] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-25T18:48:48.602054] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T18:48:48.688705] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-25T18:48:49.488707] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-25T18:48:49.845515] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T18:48:50.288775] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-25T18:48:50.638013] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T18:48:51.088725] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-25T18:48:51.500680] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T18:48:51.505101] [INFO ] [REMOTE ] FF: Full fetch complete (37088 records). [2025-09-25T18:48:51.505195] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-25T18:48:51.888844] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-25T18:48:51.921097] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-25T18:48:51.922218] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-25T18:48:51.923311] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-25T18:48:51.923429] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-25T18:48:51.924671] [DEBUG] [LOCAL ] FF: Trimmed 37088 records to 25640 (keeping 200 days of data) [2025-09-25T18:48:52.034751] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T18:48:52.099265] [DEBUG] [LOCAL ] FF: Primary data saved (25640 records). [2025-09-25T18:48:52.099428] [INFO ] [MAIN ] FF: Full history saved. [2025-09-25T18:48:52.099540] [INFO ] [MAIN ] Update Progress: 822/2372 symbols completed. FF took 27.7s. Estimated remaining: 3h 25m 12s. Rate: 7.6 symbols/min [2025-09-25T18:48:52.281099] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:48:52.304502] [DEBUG] [LOCAL ] FG: Loaded 22540 existing records from primary storage. [2025-09-25T18:48:52.304688] [INFO ] [MAIN ] FG: Loaded 22540 existing records. [2025-09-25T18:48:52.497260] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:48:52.497770] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-25T18:48:52.497857] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-25T18:48:52.498477] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-25T18:48:52.498574] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-25T18:48:52.697811] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-25T18:48:52.869972] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:48:53.252131] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T18:48:53.488732] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-25T18:48:53.813528] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T18:48:54.099637] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T18:48:54.288769] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-25T18:48:55.088703] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-25T18:48:55.279733] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T18:48:55.888756] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-25T18:48:56.439603] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:48:56.546066] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T18:48:56.688747] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-25T18:48:57.488735] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-25T18:48:57.670430] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T18:48:58.241707] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T18:48:58.288698] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-25T18:48:59.088742] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-25T18:48:59.648170] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T18:48:59.669638] [INFO ] [REMOTE ] FFA: Full fetch complete (8265 records). [2025-09-25T18:48:59.669896] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-25T18:48:59.671890] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T18:48:59.893890] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-25T18:49:00.102684] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-25T18:49:00.102805] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-25T18:49:00.103192] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-25T18:49:00.103291] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-25T18:49:00.104203] [DEBUG] [LOCAL ] FFA: Trimmed 8265 records to 5730 (keeping 200 days of data) [2025-09-25T18:49:00.146332] [DEBUG] [LOCAL ] FFA: Primary data saved (5730 records). [2025-09-25T18:49:00.146470] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-25T18:49:00.146713] [INFO ] [MAIN ] Update Progress: 823/2372 symbols completed. FFA took 35.1s. Estimated remaining: 3h 25m 4s. Rate: 7.6 symbols/min [2025-09-25T18:49:00.343530] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:00.360079] [DEBUG] [LOCAL ] FGN: Loaded 3883 existing records from primary storage. [2025-09-25T18:49:00.360222] [INFO ] [MAIN ] FGN: Loaded 3883 existing records. [2025-09-25T18:49:00.542756] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:49:00.543027] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-25T18:49:00.543076] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-25T18:49:00.543267] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-25T18:49:00.543325] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-25T18:49:00.693298] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-25T18:49:00.869545] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T18:49:00.936802] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:01.488740] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-25T18:49:01.819832] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T18:49:02.241786] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T18:49:02.288817] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-25T18:49:03.088739] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-25T18:49:03.161032] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T18:49:03.888767] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-25T18:49:04.591939] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T18:49:04.688676] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-25T18:49:04.993407] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T18:49:05.488791] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-25T18:49:06.097669] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T18:49:06.115880] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:49:06.288730] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-25T18:49:06.778659] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:49:07.088752] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-25T18:49:07.888784] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-25T18:49:08.119405] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T18:49:08.688780] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-25T18:49:09.127961] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T18:49:09.488741] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-25T18:49:09.877307] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T18:49:09.880955] [INFO ] [REMOTE ] FFC: Full fetch complete (24710 records). [2025-09-25T18:49:09.881042] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-25T18:49:10.253818] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-25T18:49:10.253963] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-25T18:49:10.254602] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-25T18:49:10.254687] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-25T18:49:10.256160] [DEBUG] [LOCAL ] FFC: Trimmed 24710 records to 16760 (keeping 200 days of data) [2025-09-25T18:49:10.311399] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-25T18:49:10.376134] [DEBUG] [LOCAL ] FFC: Primary data saved (16760 records). [2025-09-25T18:49:10.376318] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-25T18:49:10.376493] [INFO ] [MAIN ] Update Progress: 824/2372 symbols completed. FFC took 34.3s. Estimated remaining: 3h 25m 0s. Rate: 7.6 symbols/min [2025-09-25T18:49:10.548928] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:10.549132] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-25T18:49:10.549170] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-25T18:49:10.549538] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-25T18:49:10.549608] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-25T18:49:10.549812] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-25T18:49:10.549866] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-25T18:49:10.929144] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:10.957031] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:49:11.088694] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-25T18:49:11.639622] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T18:49:11.888726] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-25T18:49:12.490762] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T18:49:12.688692] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-25T18:49:12.859279] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-25T18:49:13.488753] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-25T18:49:14.269982] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T18:49:14.281613] [INFO ] [REMOTE ] FFWM: Full fetch complete (51684 records). [2025-09-25T18:49:14.281875] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-25T18:49:14.296739] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-25T18:49:14.653731] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T18:49:14.735367] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-25T18:49:14.735458] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-25T18:49:14.736257] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-25T18:49:14.736339] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-25T18:49:14.737503] [DEBUG] [LOCAL ] FFWM: Trimmed 51684 records to 36348 (keeping 200 days of data) [2025-09-25T18:49:14.951638] [DEBUG] [LOCAL ] FFWM: Primary data saved (36348 records). [2025-09-25T18:49:14.951820] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-25T18:49:14.951941] [INFO ] [MAIN ] Update Progress: 825/2372 symbols completed. FFWM took 30.4s. Estimated remaining: 3h 24m 46s. Rate: 7.6 symbols/min [2025-09-25T18:49:15.063836] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T18:49:15.093838] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-25T18:49:15.141801] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:15.189921] [DEBUG] [LOCAL ] FHI: Loaded 40739 existing records from primary storage. [2025-09-25T18:49:15.190082] [INFO ] [MAIN ] FHI: Loaded 40739 existing records. [2025-09-25T18:49:15.371680] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:49:15.371952] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-25T18:49:15.372024] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-25T18:49:15.372321] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-25T18:49:15.372380] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-25T18:49:15.739635] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:15.803367] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T18:49:15.888738] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-25T18:49:16.688690] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-25T18:49:16.978310] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T18:49:17.012796] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-25T18:49:17.488734] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-25T18:49:18.106232] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T18:49:18.288696] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-25T18:49:18.764886] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T18:49:19.088731] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-25T18:49:19.292245] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:49:19.292720] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-25T18:49:19.888734] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-25T18:49:20.688794] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-25T18:49:20.735681] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T18:49:21.488749] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-25T18:49:22.216159] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:49:22.239602] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T18:49:22.288750] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-25T18:49:23.088735] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-25T18:49:23.634305] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T18:49:23.880182] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T18:49:23.888665] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-25T18:49:24.688685] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-25T18:49:24.996050] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T18:49:25.000344] [INFO ] [REMOTE ] FG: Full fetch complete (27285 records). [2025-09-25T18:49:25.000439] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-25T18:49:25.114907] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T18:49:25.397227] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-25T18:49:25.397331] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-25T18:49:25.398023] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-25T18:49:25.398110] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-25T18:49:25.398871] [DEBUG] [LOCAL ] FG: Trimmed 27285 records to 22680 (keeping 200 days of data) [2025-09-25T18:49:25.499910] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-25T18:49:25.552777] [DEBUG] [LOCAL ] FG: Primary data saved (22680 records). [2025-09-25T18:49:25.552938] [INFO ] [MAIN ] FG: Full history saved. [2025-09-25T18:49:25.553028] [INFO ] [MAIN ] Update Progress: 826/2372 symbols completed. FG took 33.5s. Estimated remaining: 3h 24m 43s. Rate: 7.6 symbols/min [2025-09-25T18:49:25.723979] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:25.785447] [DEBUG] [LOCAL ] FHN: Loaded 53369 existing records from primary storage. [2025-09-25T18:49:25.785613] [INFO ] [MAIN ] FHN: Loaded 53369 existing records. [2025-09-25T18:49:25.965332] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:49:25.965613] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-25T18:49:25.965690] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-25T18:49:25.965967] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-25T18:49:25.966024] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-25T18:49:26.298799] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-25T18:49:26.344519] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:26.871068] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T18:49:26.907970] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T18:49:27.088746] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-25T18:49:27.803175] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T18:49:27.888748] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-25T18:49:28.447853] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T18:49:28.688742] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-25T18:49:29.488744] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-25T18:49:30.065058] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T18:49:30.066357] [INFO ] [REMOTE ] FGN: Full fetch complete (5750 records). [2025-09-25T18:49:30.066430] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-25T18:49:30.296067] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-25T18:49:30.529164] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-25T18:49:30.529400] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-25T18:49:30.528846] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T18:49:30.529898] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-25T18:49:30.541471] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-25T18:49:30.543286] [DEBUG] [LOCAL ] FGN: Trimmed 5750 records to 3905 (keeping 200 days of data) [2025-09-25T18:49:30.569666] [DEBUG] [LOCAL ] FGN: Primary data saved (3905 records). [2025-09-25T18:49:30.569800] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-25T18:49:30.569917] [INFO ] [MAIN ] Update Progress: 827/2372 symbols completed. FGN took 30.4s. Estimated remaining: 3h 24m 29s. Rate: 7.6 symbols/min [2025-09-25T18:49:30.754516] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:30.826143] [DEBUG] [LOCAL ] FI: Loaded 53505 existing records from primary storage. [2025-09-25T18:49:30.826314] [INFO ] [MAIN ] FI: Loaded 53505 existing records. [2025-09-25T18:49:31.011159] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-25T18:49:31.028493] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:49:31.029216] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-25T18:49:31.029311] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-25T18:49:31.029582] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-25T18:49:31.029680] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-25T18:49:31.098080] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-25T18:49:31.432230] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:31.754137] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T18:49:31.888727] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-25T18:49:32.480469] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T18:49:32.688750] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-25T18:49:33.488743] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-25T18:49:34.288761] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-25T18:49:34.553624] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T18:49:34.751529] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-25T18:49:34.753394] [INFO ] [REMOTE ] FGSN: Full fetch complete (7568 records). [2025-09-25T18:49:34.753469] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-25T18:49:34.938862] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-25T18:49:34.939123] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:49:34.939181] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:49:34.939246] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-25T18:49:34.939331] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-25T18:49:34.939405] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-25T18:49:34.939486] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-25T18:49:34.939581] [INFO ] [MAIN ] Update Progress: 828/2372 symbols completed. FGSN took 24.6s. Estimated remaining: 3h 24m 15s. Rate: 7.6 symbols/min [2025-09-25T18:49:35.089790] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-25T18:49:35.127329] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:35.154824] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T18:49:35.180967] [DEBUG] [LOCAL ] FICO: Loaded 20416 existing records from primary storage. [2025-09-25T18:49:35.181138] [INFO ] [MAIN ] FICO: Loaded 20416 existing records. [2025-09-25T18:49:35.357885] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:49:35.358170] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-25T18:49:35.358218] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-25T18:49:35.358469] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-25T18:49:35.358537] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-25T18:49:35.718326] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:35.888729] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-25T18:49:36.688787] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-25T18:49:36.731288] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T18:49:37.488750] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-25T18:49:37.718227] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T18:49:38.238528] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T18:49:38.271718] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T18:49:38.288667] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-25T18:49:39.088724] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-25T18:49:39.888695] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-25T18:49:40.159684] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T18:49:40.303173] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T18:49:40.688685] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-25T18:49:40.978488] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T18:49:41.488730] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-25T18:49:42.261017] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T18:49:42.285088] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T18:49:42.289261] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-25T18:49:43.088736] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-25T18:49:43.758601] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T18:49:43.888687] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-25T18:49:44.589146] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T18:49:44.688741] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-25T18:49:45.463358] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T18:49:45.488686] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-25T18:49:45.824916] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T18:49:46.288805] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-25T18:49:47.041692] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T18:49:47.088671] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-25T18:49:47.473768] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T18:49:47.888725] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-25T18:49:48.641340] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T18:49:48.648632] [INFO ] [REMOTE ] FHI: Full fetch complete (57842 records). [2025-09-25T18:49:48.648802] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-25T18:49:48.693946] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-25T18:49:49.050774] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-25T18:49:49.050895] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-25T18:49:49.051733] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-25T18:49:49.051796] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-25T18:49:49.053101] [DEBUG] [LOCAL ] FHI: Trimmed 57842 records to 40977 (keeping 200 days of data) [2025-09-25T18:49:49.308009] [DEBUG] [LOCAL ] FHI: Primary data saved (40977 records). [2025-09-25T18:49:49.308158] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-25T18:49:49.308290] [INFO ] [MAIN ] Update Progress: 829/2372 symbols completed. FHI took 34.4s. Estimated remaining: 3h 24m 19s. Rate: 7.6 symbols/min [2025-09-25T18:49:49.485154] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:49:49.485425] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-25T18:49:49.485497] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-25T18:49:49.485738] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-25T18:49:49.485825] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-25T18:49:49.485907] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-25T18:49:49.485961] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-25T18:49:49.519326] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-25T18:49:49.919428] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T18:49:49.915406] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:49:49.972080] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:49:50.288796] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-25T18:49:51.088756] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-25T18:49:51.317786] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T18:49:51.402234] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-25T18:49:51.888705] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-25T18:49:52.157685] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T18:49:52.688784] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-25T18:49:52.921454] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-25T18:49:53.488712] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-25T18:49:53.880480] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T18:49:54.288793] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-25T18:49:55.088739] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-25T18:49:55.198356] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T18:49:55.247215] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:49:55.888768] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-25T18:49:56.688764] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-25T18:49:57.007471] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-25T18:49:57.012988] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T18:49:57.402795] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:49:57.488800] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-25T18:49:58.288765] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-25T18:49:58.541042] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-25T18:49:58.885045] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T18:49:59.088746] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-25T18:49:59.888749] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-25T18:50:00.210913] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T18:50:00.214979] [INFO ] [REMOTE ] FICO: Full fetch complete (28387 records). [2025-09-25T18:50:00.215058] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-25T18:50:00.285398] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-25T18:50:00.648549] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-25T18:50:00.648719] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-25T18:50:00.649581] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-25T18:50:00.649665] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-25T18:50:00.650839] [DEBUG] [LOCAL ] FICO: Trimmed 28387 records to 20525 (keeping 200 days of data) [2025-09-25T18:50:00.712666] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-25T18:50:00.802738] [DEBUG] [LOCAL ] FICO: Primary data saved (20525 records). [2025-09-25T18:50:00.802924] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-25T18:50:00.803071] [INFO ] [MAIN ] Update Progress: 830/2372 symbols completed. FICO took 25.9s. Estimated remaining: 3h 24m 18s. Rate: 7.5 symbols/min [2025-09-25T18:50:00.986688] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:01.050566] [DEBUG] [LOCAL ] FIGS: Loaded 48918 existing records from primary storage. [2025-09-25T18:50:01.050798] [INFO ] [MAIN ] FIGS: Loaded 48918 existing records. [2025-09-25T18:50:01.130500] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T18:50:01.253917] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:01.254196] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-25T18:50:01.254265] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-25T18:50:01.254556] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-25T18:50:01.254614] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-25T18:50:01.494096] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-25T18:50:01.661691] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:01.795574] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:01.796071] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-25T18:50:02.288763] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-25T18:50:03.088802] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-25T18:50:03.888777] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-25T18:50:04.239842] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T18:50:04.454419] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T18:50:04.661934] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T18:50:04.688806] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-25T18:50:05.488715] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-25T18:50:06.288755] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-25T18:50:06.667417] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T18:50:06.680603] [INFO ] [REMOTE ] FHN: Full fetch complete (77283 records). [2025-09-25T18:50:06.680844] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-25T18:50:07.083312] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-25T18:50:07.083489] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-25T18:50:07.084452] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-25T18:50:07.084517] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-25T18:50:07.086049] [DEBUG] [LOCAL ] FHN: Trimmed 77283 records to 53759 (keeping 200 days of data) [2025-09-25T18:50:07.088732] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-25T18:50:07.426742] [DEBUG] [LOCAL ] FHN: Primary data saved (53759 records). [2025-09-25T18:50:07.426910] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-25T18:50:07.427017] [INFO ] [MAIN ] Update Progress: 831/2372 symbols completed. FHN took 41.9s. Estimated remaining: 3h 24m 7s. Rate: 7.5 symbols/min [2025-09-25T18:50:07.561342] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-25T18:50:07.641592] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:07.683821] [DEBUG] [LOCAL ] FIHL: Loaded 40300 existing records from primary storage. [2025-09-25T18:50:07.683972] [INFO ] [MAIN ] FIHL: Loaded 40300 existing records. [2025-09-25T18:50:07.867983] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:07.868314] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-25T18:50:07.868368] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-25T18:50:07.868715] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-25T18:50:07.868774] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-25T18:50:07.899901] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-25T18:50:08.264738] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:08.296803] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T18:50:08.688739] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-25T18:50:09.488792] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-25T18:50:09.573024] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:50:09.914312] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-25T18:50:10.288739] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-25T18:50:10.834733] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T18:50:10.903964] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-25T18:50:11.088780] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-25T18:50:11.807058] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T18:50:11.888696] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-25T18:50:12.688728] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-25T18:50:13.084089] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T18:50:13.488700] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-25T18:50:13.610504] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T18:50:14.288750] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-25T18:50:15.088832] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-25T18:50:15.444617] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-25T18:50:15.454675] [INFO ] [REMOTE ] FIG: Full fetch complete (15798 records). [2025-09-25T18:50:15.454787] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-25T18:50:15.661081] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-25T18:50:15.661921] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:50:15.662236] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:50:15.662327] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-25T18:50:15.662596] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-25T18:50:15.662706] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-25T18:50:15.662979] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-25T18:50:15.663089] [INFO ] [MAIN ] Update Progress: 832/2372 symbols completed. FIG took 26.4s. Estimated remaining: 3h 23m 60s. Rate: 7.5 symbols/min [2025-09-25T18:50:15.730549] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-25T18:50:15.797271] [INFO ] [REMOTE ] FI: Full fetch complete (77166 records). [2025-09-25T18:50:15.819326] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-25T18:50:16.029541] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:16.220376] [DEBUG] [LOCAL ] FINS: Loaded 8240 existing records from primary storage. [2025-09-25T18:50:16.209851] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T18:50:16.268236] [INFO ] [MAIN ] FINS: Loaded 8240 existing records. [2025-09-25T18:50:16.370338] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-25T18:50:16.364801] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:50:16.583563] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-25T18:50:16.589512] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-25T18:50:16.590791] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-25T18:50:16.590887] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-25T18:50:16.663375] [DEBUG] [LOCAL ] FI: Trimmed 77166 records to 53894 (keeping 200 days of data) [2025-09-25T18:50:16.678701] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:16.680055] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-25T18:50:16.680120] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-25T18:50:16.680430] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-25T18:50:16.680493] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-25T18:50:16.694186] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-25T18:50:17.273509] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:17.488975] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-25T18:50:17.514952] [DEBUG] [LOCAL ] FI: Primary data saved (53894 records). [2025-09-25T18:50:17.515112] [INFO ] [MAIN ] FI: Full history saved. [2025-09-25T18:50:17.515694] [INFO ] [MAIN ] Update Progress: 833/2372 symbols completed. FI took 46.9s. Estimated remaining: 3h 23m 41s. Rate: 7.6 symbols/min [2025-09-25T18:50:17.700153] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:17.746406] [DEBUG] [LOCAL ] FINV: Loaded 45148 existing records from primary storage. [2025-09-25T18:50:17.746612] [INFO ] [MAIN ] FINV: Loaded 45148 existing records. [2025-09-25T18:50:17.932493] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:17.932822] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-25T18:50:17.932877] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-25T18:50:17.933242] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-25T18:50:17.933300] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-25T18:50:18.351777] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:18.357162] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-25T18:50:18.356811] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T18:50:18.377232] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T18:50:18.383486] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T18:50:19.088805] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-25T18:50:19.797901] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T18:50:19.888757] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-25T18:50:20.688702] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-25T18:50:20.796900] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T18:50:21.176095] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T18:50:21.488688] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-25T18:50:21.522751] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T18:50:22.102464] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T18:50:22.288779] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-25T18:50:23.088751] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-25T18:50:23.802542] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T18:50:23.888713] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-25T18:50:24.590502] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T18:50:24.688714] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-25T18:50:25.238617] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T18:50:25.488721] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-25T18:50:26.288733] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-25T18:50:26.459737] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T18:50:26.927776] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:50:26.952466] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T18:50:27.088745] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-25T18:50:27.888734] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-25T18:50:28.612423] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T18:50:28.688733] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-25T18:50:29.240065] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T18:50:29.269637] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T18:50:29.279835] [INFO ] [REMOTE ] FIGS: Full fetch complete (71096 records). [2025-09-25T18:50:29.280022] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-25T18:50:29.495862] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-25T18:50:29.673372] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-25T18:50:29.673468] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-25T18:50:29.674624] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-25T18:50:29.674716] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-25T18:50:29.676214] [DEBUG] [LOCAL ] FIGS: Trimmed 71096 records to 49285 (keeping 200 days of data) [2025-09-25T18:50:29.956067] [DEBUG] [LOCAL ] FIGS: Primary data saved (49285 records). [2025-09-25T18:50:29.956223] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-25T18:50:29.956314] [INFO ] [MAIN ] Update Progress: 834/2372 symbols completed. FIGS took 29.2s. Estimated remaining: 3h 23m 41s. Rate: 7.6 symbols/min [2025-09-25T18:50:30.129399] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:30.179427] [DEBUG] [LOCAL ] FIS: Loaded 53365 existing records from primary storage. [2025-09-25T18:50:30.179610] [INFO ] [MAIN ] FIS: Loaded 53365 existing records. [2025-09-25T18:50:30.293896] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-25T18:50:30.366973] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:30.367219] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-25T18:50:30.367267] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-25T18:50:30.367602] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-25T18:50:30.367694] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-25T18:50:30.724915] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:31.088685] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-25T18:50:31.119973] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T18:50:31.890765] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-25T18:50:31.895501] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T18:50:32.688705] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-25T18:50:32.882485] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T18:50:33.488707] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-25T18:50:33.517584] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T18:50:34.188725] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T18:50:34.288726] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-25T18:50:34.775291] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T18:50:35.088691] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-25T18:50:35.122188] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:50:35.888758] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-25T18:50:36.663305] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T18:50:36.688676] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-25T18:50:36.896694] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T18:50:37.448678] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T18:50:37.488785] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-25T18:50:38.288754] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-25T18:50:38.897929] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T18:50:39.088690] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-25T18:50:39.305467] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T18:50:39.888695] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-25T18:50:39.895823] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T18:50:39.898356] [INFO ] [REMOTE ] FINS: Full fetch complete (12551 records). [2025-09-25T18:50:39.898435] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-25T18:50:40.264322] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-25T18:50:40.264407] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-25T18:50:40.264727] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-25T18:50:40.264801] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-25T18:50:40.265276] [DEBUG] [LOCAL ] FINS: Trimmed 12551 records to 8280 (keeping 200 days of data) [2025-09-25T18:50:40.315407] [DEBUG] [LOCAL ] FINS: Primary data saved (8280 records). [2025-09-25T18:50:40.315555] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-25T18:50:40.315678] [INFO ] [MAIN ] Update Progress: 835/2372 symbols completed. FINS took 24.6s. Estimated remaining: 3h 23m 37s. Rate: 7.5 symbols/min [2025-09-25T18:50:40.489953] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:40.525120] [DEBUG] [LOCAL ] FIX: Loaded 30410 existing records from primary storage. [2025-09-25T18:50:40.525268] [INFO ] [MAIN ] FIX: Loaded 30410 existing records. [2025-09-25T18:50:40.706006] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-25T18:50:40.712181] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:50:40.713443] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-25T18:50:40.713494] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-25T18:50:40.713836] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-25T18:50:40.713898] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-25T18:50:41.079232] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:41.488774] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-25T18:50:42.061551] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-25T18:50:42.288713] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-25T18:50:42.555805] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T18:50:42.729705] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T18:50:42.737629] [INFO ] [REMOTE ] FIHL: Full fetch complete (55857 records). [2025-09-25T18:50:42.737785] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-25T18:50:43.111550] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-25T18:50:43.131566] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-25T18:50:43.131635] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-25T18:50:43.132420] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-25T18:50:43.132466] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-25T18:50:43.133861] [DEBUG] [LOCAL ] FIHL: Trimmed 55857 records to 40582 (keeping 200 days of data) [2025-09-25T18:50:43.363297] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T18:50:43.407712] [DEBUG] [LOCAL ] FIHL: Primary data saved (40582 records). [2025-09-25T18:50:43.407857] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-25T18:50:43.407942] [INFO ] [MAIN ] Update Progress: 836/2372 symbols completed. FIHL took 36.0s. Estimated remaining: 3h 23m 21s. Rate: 7.6 symbols/min [2025-09-25T18:50:43.579254] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:50:43.579458] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-25T18:50:43.579494] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-25T18:50:43.579639] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-25T18:50:43.579715] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-25T18:50:43.579762] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-25T18:50:43.579795] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-25T18:50:43.903501] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-25T18:50:43.946220] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:50:44.477391] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:50:44.688755] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-25T18:50:45.380753] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T18:50:45.488760] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-25T18:50:45.714366] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:45.714726] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-25T18:50:46.288771] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-25T18:50:46.437613] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:50:47.088728] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-25T18:50:47.677395] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T18:50:47.888735] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-25T18:50:48.613956] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T18:50:48.688750] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-25T18:50:49.071955] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:49.072312] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-25T18:50:49.488709] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-25T18:50:49.843276] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T18:50:50.288723] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-25T18:50:50.517986] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:50.518542] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-25T18:50:51.050955] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T18:50:51.088670] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-25T18:50:51.286053] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:51.286400] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-25T18:50:51.888738] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-25T18:50:52.688745] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-25T18:50:53.035276] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:53.035621] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-25T18:50:53.501021] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-25T18:50:53.503604] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:50:54.288725] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-25T18:50:55.088751] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-25T18:50:55.357470] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:50:55.357825] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-25T18:50:55.392423] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T18:50:55.667597] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T18:50:55.888724] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-25T18:50:56.688777] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-25T18:50:57.205340] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T18:50:57.347926] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T18:50:57.488704] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-25T18:50:58.288783] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-25T18:50:59.088833] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-25T18:50:59.276581] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T18:50:59.346470] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T18:50:59.888752] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-25T18:51:00.688715] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-25T18:51:01.165018] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T18:51:01.209157] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T18:51:01.287939] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T18:51:01.488731] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-25T18:51:02.288823] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-25T18:51:02.886327] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T18:51:02.892639] [INFO ] [REMOTE ] FIX: Full fetch complete (45678 records). [2025-09-25T18:51:02.892836] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-25T18:51:03.094187] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-25T18:51:03.290525] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-25T18:51:03.290637] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-25T18:51:03.291393] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-25T18:51:03.291441] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-25T18:51:03.292734] [DEBUG] [LOCAL ] FIX: Trimmed 45678 records to 30594 (keeping 200 days of data) [2025-09-25T18:51:03.489861] [DEBUG] [LOCAL ] FIX: Primary data saved (30594 records). [2025-09-25T18:51:03.490019] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-25T18:51:03.490105] [INFO ] [MAIN ] Update Progress: 837/2372 symbols completed. FIX took 23.2s. Estimated remaining: 3h 23m 35s. Rate: 7.5 symbols/min [2025-09-25T18:51:03.888796] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-25T18:51:04.080177] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T18:51:04.090154] [INFO ] [REMOTE ] FINV: Full fetch complete (63529 records). [2025-09-25T18:51:04.090299] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-25T18:51:04.202994] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-25T18:51:04.528599] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-25T18:51:04.528751] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-25T18:51:04.529706] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-25T18:51:04.529776] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-25T18:51:04.531274] [DEBUG] [LOCAL ] FINV: Trimmed 63529 records to 45475 (keeping 200 days of data) [2025-09-25T18:51:04.709167] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-25T18:51:04.817195] [DEBUG] [LOCAL ] FINV: Primary data saved (45475 records). [2025-09-25T18:51:04.817391] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-25T18:51:04.818063] [INFO ] [MAIN ] Update Progress: 838/2372 symbols completed. FINV took 47.3s. Estimated remaining: 3h 23m 15s. Rate: 7.5 symbols/min [2025-09-25T18:51:05.012818] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T18:51:05.429469] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T18:51:05.430552] [INFO ] [REMOTE ] FIXT: Full fetch complete (1742 records). [2025-09-25T18:51:05.430622] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-25T18:51:05.496915] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-25T18:51:05.618368] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-25T18:51:05.618606] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:51:05.618685] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:51:05.618742] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-25T18:51:05.618803] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-25T18:51:05.618839] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-25T18:51:05.618880] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-25T18:51:05.618942] [INFO ] [MAIN ] Update Progress: 839/2372 symbols completed. FIXT took 22.2s. Estimated remaining: 3h 22m 54s. Rate: 7.6 symbols/min [2025-09-25T18:51:07.474713] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T18:51:07.484853] [INFO ] [REMOTE ] FIS: Full fetch complete (77173 records). [2025-09-25T18:51:07.484981] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-25T18:51:07.886984] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-25T18:51:07.887109] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-25T18:51:07.888088] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-25T18:51:07.888166] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-25T18:51:07.889852] [DEBUG] [LOCAL ] FIS: Trimmed 77173 records to 53754 (keeping 200 days of data) [2025-09-25T18:51:08.220440] [DEBUG] [LOCAL ] FIS: Primary data saved (53754 records). [2025-09-25T18:51:08.220596] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-25T18:51:08.220827] [INFO ] [MAIN ] Update Progress: 840/2372 symbols completed. FIS took 38.3s. Estimated remaining: 3h 22m 36s. Rate: 7.6 symbols/min [2025-09-25T18:51:08.812868] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:08.974122] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:08.975278] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:08.998133] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:09.021846] [DEBUG] [LOCAL ] FLC: Loaded 5497 existing records from primary storage. [2025-09-25T18:51:09.022033] [INFO ] [MAIN ] FLC: Loaded 5497 existing records. [2025-09-25T18:51:09.255791] [DEBUG] [LOCAL ] FLNG: Loaded 33996 existing records from primary storage. [2025-09-25T18:51:09.275796] [INFO ] [MAIN ] FLNG: Loaded 33996 existing records. [2025-09-25T18:51:09.307252] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:09.317707] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-25T18:51:09.334331] [DEBUG] [LOCAL ] FLO: Loaded 51884 existing records from primary storage. [2025-09-25T18:51:09.339966] [INFO ] [MAIN ] FLO: Loaded 51884 existing records. [2025-09-25T18:51:09.339871] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-25T18:51:09.386511] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-25T18:51:09.406705] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-25T18:51:09.575565] [DEBUG] [LOCAL ] FLG: Loaded 53329 existing records from primary storage. [2025-09-25T18:51:09.656766] [INFO ] [MAIN ] FLG: Loaded 53329 existing records. [2025-09-25T18:51:09.740825] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:09.872589] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-25T18:51:09.874863] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-25T18:51:10.001451] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-25T18:51:10.001596] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:10.038365] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-25T18:51:10.108337] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-25T18:51:10.133094] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-25T18:51:10.188929] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-25T18:51:10.258816] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-25T18:51:10.330837] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:10.404140] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-25T18:51:10.436407] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-25T18:51:10.447880] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-25T18:51:10.520198] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-25T18:51:10.514900] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:10.602881] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-25T18:51:11.281397] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:11.306338] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-25T18:51:11.350296] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:11.350748] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-25T18:51:11.425184] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:11.425508] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-25T18:51:11.450800] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T18:51:11.452807] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-25T18:51:12.067003] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T18:51:12.070253] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-25T18:51:12.562583] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:51:12.564570] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-25T18:51:12.839862] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:51:12.852455] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-25T18:51:13.092932] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T18:51:13.104142] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-25T18:51:13.187569] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T18:51:13.204091] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T18:51:13.488731] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-25T18:51:14.084927] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T18:51:14.288780] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-25T18:51:14.818474] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T18:51:15.005266] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T18:51:15.088716] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-25T18:51:15.376072] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T18:51:15.888781] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-25T18:51:16.688766] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-25T18:51:16.742874] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T18:51:17.256686] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T18:51:17.488718] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-25T18:51:17.778486] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T18:51:18.065625] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T18:51:18.288762] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-25T18:51:19.088738] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-25T18:51:19.719663] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T18:51:19.888747] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-25T18:51:20.055180] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T18:51:20.688776] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-25T18:51:21.253052] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T18:51:21.488743] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-25T18:51:22.203956] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T18:51:22.288740] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-25T18:51:22.890211] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T18:51:23.063472] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T18:51:23.088672] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-25T18:51:23.841378] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T18:51:23.844200] [INFO ] [REMOTE ] FLC: Full fetch complete (8035 records). [2025-09-25T18:51:23.844322] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-25T18:51:23.893782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-25T18:51:24.289556] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-25T18:51:24.289667] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-25T18:51:24.289931] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-25T18:51:24.289992] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-25T18:51:24.290403] [DEBUG] [LOCAL ] FLC: Trimmed 8035 records to 5533 (keeping 200 days of data) [2025-09-25T18:51:24.327032] [DEBUG] [LOCAL ] FLC: Primary data saved (5533 records). [2025-09-25T18:51:24.327147] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-25T18:51:24.327265] [INFO ] [MAIN ] Update Progress: 841/2372 symbols completed. FLC took 16.1s. Estimated remaining: 3h 22m 43s. Rate: 7.6 symbols/min [2025-09-25T18:51:24.505403] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:24.505607] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-25T18:51:24.505692] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-25T18:51:24.505850] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-25T18:51:24.505894] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-25T18:51:24.505936] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-25T18:51:24.505971] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-25T18:51:24.694588] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-25T18:51:24.876898] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:25.488685] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-25T18:51:25.781621] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:51:26.288723] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-25T18:51:26.503339] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T18:51:26.542180] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T18:51:27.088730] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-25T18:51:27.888712] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-25T18:51:27.891914] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T18:51:28.099393] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T18:51:28.099766] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-25T18:51:28.688724] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-25T18:51:28.960051] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T18:51:29.488754] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-25T18:51:29.731674] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T18:51:30.288754] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-25T18:51:31.088687] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-25T18:51:31.333236] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T18:51:31.512596] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T18:51:31.888734] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-25T18:51:32.370079] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:51:32.688738] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-25T18:51:33.407505] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T18:51:33.488757] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-25T18:51:34.099360] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T18:51:34.288847] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-25T18:51:35.088719] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-25T18:51:35.198497] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T18:51:35.691757] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T18:51:35.888815] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-25T18:51:36.545958] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T18:51:36.688757] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-25T18:51:37.488783] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-25T18:51:37.702153] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T18:51:38.288825] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-25T18:51:38.540375] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T18:51:38.552680] [INFO ] [REMOTE ] FLG: Full fetch complete (77295 records). [2025-09-25T18:51:38.552893] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-25T18:51:38.987876] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-25T18:51:38.988035] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-25T18:51:38.989542] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-25T18:51:38.989926] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-25T18:51:39.018500] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T18:51:39.018773] [DEBUG] [LOCAL ] FLG: Trimmed 77295 records to 53717 (keeping 200 days of data) [2025-09-25T18:51:39.100393] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-25T18:51:39.429229] [DEBUG] [LOCAL ] FLG: Primary data saved (53717 records). [2025-09-25T18:51:39.429490] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-25T18:51:39.429672] [INFO ] [MAIN ] Update Progress: 842/2372 symbols completed. FLG took 31.2s. Estimated remaining: 3h 22m 48s. Rate: 7.5 symbols/min [2025-09-25T18:51:39.624716] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:39.685547] [DEBUG] [LOCAL ] FLR: Loaded 53117 existing records from primary storage. [2025-09-25T18:51:39.685828] [INFO ] [MAIN ] FLR: Loaded 53117 existing records. [2025-09-25T18:51:39.899951] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-25T18:51:39.912555] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:39.912262] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T18:51:39.923886] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-25T18:51:39.924072] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-25T18:51:39.924514] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-25T18:51:39.924587] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-25T18:51:40.316579] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:40.372761] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T18:51:40.688785] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-25T18:51:41.488715] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-25T18:51:41.566189] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T18:51:41.999820] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T18:51:42.288780] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-25T18:51:42.989091] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T18:51:43.002280] [INFO ] [REMOTE ] FLNG: Full fetch complete (50854 records). [2025-09-25T18:51:43.002602] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-25T18:51:43.093966] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-25T18:51:43.432258] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-25T18:51:43.432401] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-25T18:51:43.433406] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-25T18:51:43.433476] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-25T18:51:43.437329] [DEBUG] [LOCAL ] FLNG: Trimmed 50854 records to 34205 (keeping 200 days of data) [2025-09-25T18:51:43.685679] [DEBUG] [LOCAL ] FLNG: Primary data saved (34205 records). [2025-09-25T18:51:43.685937] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-25T18:51:43.687534] [INFO ] [MAIN ] Update Progress: 843/2372 symbols completed. FLNG took 35.5s. Estimated remaining: 3h 22m 33s. Rate: 7.5 symbols/min [2025-09-25T18:51:43.884987] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:43.888708] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-25T18:51:43.955185] [DEBUG] [LOCAL ] FLS: Loaded 50170 existing records from primary storage. [2025-09-25T18:51:43.955420] [INFO ] [MAIN ] FLS: Loaded 50170 existing records. [2025-09-25T18:51:44.156873] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:44.157308] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-25T18:51:44.157369] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-25T18:51:44.157716] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-25T18:51:44.157778] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-25T18:51:44.579389] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:44.589375] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T18:51:44.626048] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-25T18:51:44.637025] [INFO ] [REMOTE ] FLO: Full fetch complete (74907 records). [2025-09-25T18:51:44.637239] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-25T18:51:44.694036] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-25T18:51:45.065369] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-25T18:51:45.065487] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-25T18:51:45.067053] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-25T18:51:45.067132] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-25T18:51:45.072242] [DEBUG] [LOCAL ] FLO: Trimmed 74907 records to 52270 (keeping 200 days of data) [2025-09-25T18:51:45.376541] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:51:45.488925] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-25T18:51:45.498516] [DEBUG] [LOCAL ] FLO: Primary data saved (52270 records). [2025-09-25T18:51:45.498760] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-25T18:51:45.499996] [INFO ] [MAIN ] Update Progress: 844/2372 symbols completed. FLO took 37.3s. Estimated remaining: 3h 22m 14s. Rate: 7.6 symbols/min [2025-09-25T18:51:45.683856] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:45.757283] [DEBUG] [LOCAL ] FLUT: Loaded 50862 existing records from primary storage. [2025-09-25T18:51:45.757496] [INFO ] [MAIN ] FLUT: Loaded 50862 existing records. [2025-09-25T18:51:45.956886] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:45.957490] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-25T18:51:45.957578] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-25T18:51:45.958162] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-25T18:51:45.958229] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-25T18:51:46.237696] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T18:51:46.293873] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-25T18:51:46.400312] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:47.088797] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-25T18:51:47.364631] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T18:51:47.885160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T18:51:47.895085] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-25T18:51:47.915923] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T18:51:48.688749] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-25T18:51:49.488754] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-25T18:51:49.658401] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T18:51:49.725807] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:51:50.288774] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-25T18:51:51.076025] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T18:51:51.088675] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-25T18:51:51.888685] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-25T18:51:52.039003] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:51:52.688765] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-25T18:51:52.837436] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:51:52.882143] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T18:51:52.887845] [INFO ] [REMOTE ] FLOC: Full fetch complete (37379 records). [2025-09-25T18:51:52.888063] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-25T18:51:53.096117] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-25T18:51:53.096753] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:51:53.096836] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:51:53.096893] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-25T18:51:53.096968] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-25T18:51:53.097023] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-25T18:51:53.097066] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-25T18:51:53.097142] [INFO ] [MAIN ] Update Progress: 845/2372 symbols completed. FLOC took 28.8s. Estimated remaining: 3h 22m 6s. Rate: 7.6 symbols/min [2025-09-25T18:51:53.268121] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:51:53.290294] [DEBUG] [LOCAL ] FLXR: Loaded 19909 existing records from primary storage. [2025-09-25T18:51:53.290473] [INFO ] [MAIN ] FLXR: Loaded 19909 existing records. [2025-09-25T18:51:53.470812] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:51:53.471087] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-25T18:51:53.471134] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-25T18:51:53.471337] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-25T18:51:53.471395] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-25T18:51:53.493977] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-25T18:51:53.845298] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:51:54.295770] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-25T18:51:54.305683] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T18:51:55.073890] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T18:51:55.088677] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-25T18:51:55.295601] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T18:51:55.888766] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-25T18:51:56.035660] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T18:51:56.688773] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-25T18:51:57.488716] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-25T18:51:57.582426] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T18:51:58.288695] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-25T18:51:58.308268] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T18:51:58.417168] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T18:51:59.088760] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-25T18:51:59.888762] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-25T18:51:59.954620] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:52:00.055627] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T18:52:00.688754] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-25T18:52:01.488714] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-25T18:52:01.817585] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T18:52:02.288745] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-25T18:52:02.560953] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T18:52:02.590318] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T18:52:03.088767] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-25T18:52:03.888770] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-25T18:52:04.041078] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:52:04.087348] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T18:52:04.688792] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-25T18:52:05.488814] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-25T18:52:05.908758] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T18:52:06.288768] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-25T18:52:06.356715] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T18:52:06.399769] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T18:52:07.088754] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-25T18:52:07.888763] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-25T18:52:08.093880] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T18:52:08.688723] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-25T18:52:08.869164] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T18:52:09.209891] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T18:52:09.488730] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-25T18:52:10.288709] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-25T18:52:10.587817] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:52:11.093314] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-25T18:52:11.113360] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T18:52:11.331854] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:52:11.888763] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-25T18:52:12.688693] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-25T18:52:12.945765] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T18:52:13.488691] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-25T18:52:13.905344] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T18:52:13.915213] [INFO ] [REMOTE ] FLS: Full fetch complete (71427 records). [2025-09-25T18:52:13.915349] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-25T18:52:14.297363] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-25T18:52:14.352122] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-25T18:52:14.352305] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-25T18:52:14.353721] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-25T18:52:14.353965] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-25T18:52:14.355699] [DEBUG] [LOCAL ] FLS: Trimmed 71427 records to 50555 (keeping 200 days of data) [2025-09-25T18:52:14.654174] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T18:52:14.739088] [DEBUG] [LOCAL ] FLS: Primary data saved (50555 records). [2025-09-25T18:52:14.739318] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-25T18:52:14.739434] [INFO ] [MAIN ] Update Progress: 846/2372 symbols completed. FLS took 31.1s. Estimated remaining: 3h 22m 23s. Rate: 7.5 symbols/min [2025-09-25T18:52:14.918149] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:14.952743] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T18:52:15.010390] [DEBUG] [LOCAL ] FMC: Loaded 51787 existing records from primary storage. [2025-09-25T18:52:15.010600] [INFO ] [MAIN ] FMC: Loaded 51787 existing records. [2025-09-25T18:52:15.094084] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-25T18:52:15.213389] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:15.214110] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-25T18:52:15.220185] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-25T18:52:15.229635] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-25T18:52:15.229768] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-25T18:52:15.230584] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T18:52:15.625884] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:15.888712] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-25T18:52:16.688762] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-25T18:52:17.125087] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T18:52:17.488732] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-25T18:52:17.691161] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T18:52:17.903637] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T18:52:17.909125] [INFO ] [REMOTE ] FLXR: Full fetch complete (25038 records). [2025-09-25T18:52:17.909264] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-25T18:52:18.292884] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-25T18:52:18.294204] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-25T18:52:18.294260] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-25T18:52:18.294890] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-25T18:52:18.294970] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-25T18:52:18.296060] [DEBUG] [LOCAL ] FLXR: Trimmed 25038 records to 20150 (keeping 200 days of data) [2025-09-25T18:52:18.434677] [DEBUG] [LOCAL ] FLXR: Primary data saved (20150 records). [2025-09-25T18:52:18.434825] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-25T18:52:18.434925] [INFO ] [MAIN ] Update Progress: 847/2372 symbols completed. FLXR took 25.3s. Estimated remaining: 3h 22m 7s. Rate: 7.5 symbols/min [2025-09-25T18:52:18.611596] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:18.620622] [DEBUG] [LOCAL ] FMN: Loaded 6054 existing records from primary storage. [2025-09-25T18:52:18.620780] [INFO ] [MAIN ] FMN: Loaded 6054 existing records. [2025-09-25T18:52:18.811686] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:18.811976] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-25T18:52:18.812064] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-25T18:52:18.812251] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-25T18:52:18.812309] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-25T18:52:19.095518] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-25T18:52:19.192706] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:19.306542] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T18:52:19.316919] [INFO ] [REMOTE ] FLR: Full fetch complete (76308 records). [2025-09-25T18:52:19.317092] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-25T18:52:19.720086] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-25T18:52:19.720213] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-25T18:52:19.721223] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-25T18:52:19.721332] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-25T18:52:19.723065] [DEBUG] [LOCAL ] FLR: Trimmed 76308 records to 53507 (keeping 200 days of data) [2025-09-25T18:52:19.834183] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T18:52:19.845425] [INFO ] [REMOTE ] FLUT: Full fetch complete (72804 records). [2025-09-25T18:52:19.846074] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-25T18:52:19.904459] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-25T18:52:20.280118] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-25T18:52:20.280450] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-25T18:52:20.281798] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-25T18:52:20.282117] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-25T18:52:20.286205] [DEBUG] [LOCAL ] FLUT: Trimmed 72804 records to 51237 (keeping 200 days of data) [2025-09-25T18:52:20.482333] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T18:52:20.550599] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T18:52:20.714232] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-25T18:52:20.786839] [DEBUG] [LOCAL ] FLR: Primary data saved (53507 records). [2025-09-25T18:52:20.787929] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-25T18:52:20.788886] [INFO ] [MAIN ] Update Progress: 848/2372 symbols completed. FLR took 41.4s. Estimated remaining: 3h 21m 49s. Rate: 7.6 symbols/min [2025-09-25T18:52:21.023468] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:21.066870] [DEBUG] [LOCAL ] FLUT: Primary data saved (51237 records). [2025-09-25T18:52:21.067022] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-25T18:52:21.067166] [INFO ] [MAIN ] Update Progress: 849/2372 symbols completed. FLUT took 35.6s. Estimated remaining: 3h 21m 27s. Rate: 7.6 symbols/min [2025-09-25T18:52:21.067682] [DEBUG] [LOCAL ] FMS: Loaded 30407 existing records from primary storage. [2025-09-25T18:52:21.067919] [INFO ] [MAIN ] FMS: Loaded 30407 existing records. [2025-09-25T18:52:21.443762] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:21.471056] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:21.472005] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-25T18:52:21.472286] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-25T18:52:21.472750] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-25T18:52:21.472813] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-25T18:52:21.494744] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-25T18:52:21.615792] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T18:52:21.854440] [DEBUG] [LOCAL ] FMX: Loaded 40728 existing records from primary storage. [2025-09-25T18:52:21.864962] [INFO ] [MAIN ] FMX: Loaded 40728 existing records. [2025-09-25T18:52:22.024961] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:22.113865] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:22.114120] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-25T18:52:22.114176] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-25T18:52:22.114451] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-25T18:52:22.114509] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-25T18:52:22.294563] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-25T18:52:22.488502] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:23.088731] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-25T18:52:23.363531] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T18:52:23.454799] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T18:52:23.888737] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-25T18:52:24.583340] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T18:52:24.688675] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-25T18:52:25.488758] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-25T18:52:25.839705] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T18:52:26.104778] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:52:26.288713] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-25T18:52:26.316427] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T18:52:27.088747] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-25T18:52:27.881760] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T18:52:27.888674] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-25T18:52:28.138984] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T18:52:28.605850] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T18:52:28.688767] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-25T18:52:29.260590] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T18:52:29.488772] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-25T18:52:30.288815] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-25T18:52:31.088827] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-25T18:52:31.272413] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T18:52:31.689247] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T18:52:31.888715] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-25T18:52:31.951522] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T18:52:32.530129] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T18:52:32.688751] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-25T18:52:33.488811] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-25T18:52:34.175511] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:52:34.288766] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-25T18:52:34.732844] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T18:52:35.088783] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-25T18:52:35.888745] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-25T18:52:35.969238] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:52:36.310937] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T18:52:36.476666] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T18:52:36.688752] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-25T18:52:37.383677] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T18:52:37.385492] [INFO ] [REMOTE ] FMN: Full fetch complete (10114 records). [2025-09-25T18:52:37.385572] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-25T18:52:37.496743] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-25T18:52:37.801057] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-25T18:52:37.801183] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-25T18:52:37.801747] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-25T18:52:37.801814] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-25T18:52:37.802333] [DEBUG] [LOCAL ] FMN: Trimmed 10114 records to 6073 (keeping 200 days of data) [2025-09-25T18:52:37.845930] [DEBUG] [LOCAL ] FMN: Primary data saved (6073 records). [2025-09-25T18:52:37.846152] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-25T18:52:37.846295] [INFO ] [MAIN ] Update Progress: 850/2372 symbols completed. FMN took 19.4s. Estimated remaining: 3h 21m 35s. Rate: 7.6 symbols/min [2025-09-25T18:52:38.030738] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:38.036166] [DEBUG] [LOCAL ] FMY: Loaded 1387 existing records from primary storage. [2025-09-25T18:52:38.036320] [INFO ] [MAIN ] FMY: Loaded 1387 existing records. [2025-09-25T18:52:38.221008] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:38.221506] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-25T18:52:38.221563] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-25T18:52:38.221871] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-25T18:52:38.221933] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-25T18:52:38.293930] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-25T18:52:38.599115] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:39.088762] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-25T18:52:39.159552] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:52:39.730227] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T18:52:39.888779] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-25T18:52:40.602707] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:52:40.688749] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-25T18:52:41.316788] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T18:52:41.488769] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-25T18:52:42.120170] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T18:52:42.288825] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-25T18:52:42.652768] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T18:52:43.088714] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-25T18:52:43.484900] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T18:52:43.888754] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-25T18:52:44.484095] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T18:52:44.688752] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-25T18:52:45.259695] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T18:52:45.488763] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-25T18:52:45.843783] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-25T18:52:46.288776] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-25T18:52:46.470104] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T18:52:46.480039] [INFO ] [REMOTE ] FMC: Full fetch complete (74967 records). [2025-09-25T18:52:46.480176] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-25T18:52:46.591113] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-25T18:52:46.889776] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-25T18:52:46.889873] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-25T18:52:46.890863] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-25T18:52:46.890931] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-25T18:52:46.892497] [DEBUG] [LOCAL ] FMC: Trimmed 74967 records to 52176 (keeping 200 days of data) [2025-09-25T18:52:47.112886] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-25T18:52:47.226130] [DEBUG] [LOCAL ] FMC: Primary data saved (52176 records). [2025-09-25T18:52:47.226328] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-25T18:52:47.226464] [INFO ] [MAIN ] Update Progress: 851/2372 symbols completed. FMC took 32.5s. Estimated remaining: 3h 21m 30s. Rate: 7.5 symbols/min [2025-09-25T18:52:47.398955] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:47.440493] [DEBUG] [LOCAL ] FN: Loaded 39355 existing records from primary storage. [2025-09-25T18:52:47.440683] [INFO ] [MAIN ] FN: Loaded 39355 existing records. [2025-09-25T18:52:47.546467] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T18:52:47.656740] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:47.657029] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-25T18:52:47.657079] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-25T18:52:47.657449] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-25T18:52:47.657509] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-25T18:52:47.897276] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-25T18:52:48.028622] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:48.688733] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-25T18:52:49.217509] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T18:52:49.488732] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-25T18:52:50.288707] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-25T18:52:50.336848] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T18:52:50.725674] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T18:52:50.726825] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T18:52:51.088720] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-25T18:52:51.449476] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T18:52:51.888725] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-25T18:52:52.261340] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-25T18:52:52.688731] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-25T18:52:53.120884] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T18:52:53.488757] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-25T18:52:54.288738] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-25T18:52:54.970718] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T18:52:55.088733] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-25T18:52:55.665603] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T18:52:55.888732] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-25T18:52:56.341537] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-25T18:52:56.688753] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-25T18:52:56.895024] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T18:52:56.908590] [INFO ] [REMOTE ] FMX: Full fetch complete (57698 records). [2025-09-25T18:52:56.908895] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-25T18:52:57.447347] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-25T18:52:57.447457] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-25T18:52:57.448468] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-25T18:52:57.448541] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-25T18:52:57.450530] [DEBUG] [LOCAL ] FMX: Trimmed 57698 records to 41039 (keeping 200 days of data) [2025-09-25T18:52:57.528257] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-25T18:52:57.839336] [DEBUG] [LOCAL ] FMX: Primary data saved (41039 records). [2025-09-25T18:52:57.839538] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-25T18:52:57.839681] [INFO ] [MAIN ] Update Progress: 852/2372 symbols completed. FMX took 36.8s. Estimated remaining: 3h 21m 27s. Rate: 7.5 symbols/min [2025-09-25T18:52:58.070759] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:58.128070] [DEBUG] [LOCAL ] FNB: Loaded 52450 existing records from primary storage. [2025-09-25T18:52:58.128240] [INFO ] [MAIN ] FNB: Loaded 52450 existing records. [2025-09-25T18:52:58.286162] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T18:52:58.291409] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-25T18:52:58.361898] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:58.362209] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-25T18:52:58.362260] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-25T18:52:58.362611] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-25T18:52:58.362726] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-25T18:52:58.567443] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:52:58.767015] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:52:58.849180] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T18:52:58.850419] [INFO ] [REMOTE ] FMY: Full fetch complete (1965 records). [2025-09-25T18:52:58.850505] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-25T18:52:59.097322] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-25T18:52:59.251886] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-25T18:52:59.251978] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-25T18:52:59.252090] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-25T18:52:59.252129] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-25T18:52:59.252466] [DEBUG] [LOCAL ] FMY: Trimmed 1965 records to 1394 (keeping 200 days of data) [2025-09-25T18:52:59.261662] [DEBUG] [LOCAL ] FMY: Primary data saved (1394 records). [2025-09-25T18:52:59.261732] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-25T18:52:59.261808] [INFO ] [MAIN ] Update Progress: 853/2372 symbols completed. FMY took 21.4s. Estimated remaining: 3h 21m 7s. Rate: 7.6 symbols/min [2025-09-25T18:52:59.432698] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:52:59.489334] [DEBUG] [LOCAL ] FND: Loaded 52143 existing records from primary storage. [2025-09-25T18:52:59.489488] [INFO ] [MAIN ] FND: Loaded 52143 existing records. [2025-09-25T18:52:59.669099] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:52:59.669367] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-25T18:52:59.669415] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-25T18:52:59.669699] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-25T18:52:59.669759] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-25T18:52:59.893793] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-25T18:53:00.033338] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:00.688844] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-25T18:53:00.968211] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T18:53:01.211265] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T18:53:01.488734] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-25T18:53:01.601822] [DEBUG] [REMOTE ] FNB: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-25T18:53:01.602194] [WARN ] [REMOTE ] FNB: No data returned for month 2025-01 [2025-09-25T18:53:02.084979] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T18:53:02.091914] [INFO ] [REMOTE ] FMS: Full fetch complete (42383 records). [2025-09-25T18:53:02.092087] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-25T18:53:02.295062] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-25T18:53:02.510784] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-25T18:53:02.510910] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-25T18:53:02.511825] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-25T18:53:02.511893] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-25T18:53:02.513440] [DEBUG] [LOCAL ] FMS: Trimmed 42383 records to 30619 (keeping 200 days of data) [2025-09-25T18:53:02.752344] [DEBUG] [LOCAL ] FMS: Primary data saved (30619 records). [2025-09-25T18:53:02.752597] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-25T18:53:02.752784] [INFO ] [MAIN ] Update Progress: 854/2372 symbols completed. FMS took 42.0s. Estimated remaining: 3h 20m 51s. Rate: 7.6 symbols/min [2025-09-25T18:53:02.946355] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:03.004096] [DEBUG] [LOCAL ] FNF: Loaded 49184 existing records from primary storage. [2025-09-25T18:53:03.004330] [INFO ] [MAIN ] FNF: Loaded 49184 existing records. [2025-09-25T18:53:03.093896] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-25T18:53:03.202691] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:53:03.203028] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-25T18:53:03.203084] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-25T18:53:03.203508] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-25T18:53:03.203571] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-25T18:53:03.595090] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:03.888804] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-25T18:53:04.073031] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T18:53:04.447731] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T18:53:04.688757] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-25T18:53:05.488755] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-25T18:53:05.578875] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T18:53:06.288773] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-25T18:53:06.366156] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T18:53:07.064145] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T18:53:07.088789] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-25T18:53:07.888736] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-25T18:53:08.110510] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T18:53:08.688736] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-25T18:53:08.797861] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:53:09.488744] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-25T18:53:09.568177] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T18:53:10.288743] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-25T18:53:10.356226] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T18:53:11.088708] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-25T18:53:11.123405] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T18:53:11.572807] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:53:11.888761] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-25T18:53:12.688743] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-25T18:53:12.884575] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T18:53:13.490249] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-25T18:53:13.494076] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T18:53:14.056065] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T18:53:14.288767] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-25T18:53:14.906851] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T18:53:15.088768] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-25T18:53:15.888749] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-25T18:53:15.992363] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T18:53:16.688761] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-25T18:53:16.873231] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T18:53:17.488767] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-25T18:53:17.638676] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:53:18.159002] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T18:53:18.288708] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-25T18:53:19.088806] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-25T18:53:19.175917] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T18:53:19.393169] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T18:53:19.888766] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-25T18:53:20.688716] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-25T18:53:20.730922] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T18:53:21.488744] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-25T18:53:21.742394] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T18:53:22.293801] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-25T18:53:22.309331] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T18:53:23.088690] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-25T18:53:23.287967] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:53:23.888728] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-25T18:53:23.971384] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T18:53:24.688706] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-25T18:53:24.922984] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T18:53:25.294084] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T18:53:25.488741] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-25T18:53:26.288698] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-25T18:53:26.489822] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T18:53:27.093820] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-25T18:53:27.106179] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T18:53:27.120767] [INFO ] [REMOTE ] FN: Full fetch complete (56502 records). [2025-09-25T18:53:27.120959] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-25T18:53:27.528078] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-25T18:53:27.528171] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-25T18:53:27.529054] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-25T18:53:27.529125] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-25T18:53:27.530434] [DEBUG] [LOCAL ] FN: Trimmed 56502 records to 39626 (keeping 200 days of data) [2025-09-25T18:53:27.776687] [DEBUG] [LOCAL ] FN: Primary data saved (39626 records). [2025-09-25T18:53:27.776851] [INFO ] [MAIN ] FN: Full history saved. [2025-09-25T18:53:27.776945] [INFO ] [MAIN ] Update Progress: 855/2372 symbols completed. FN took 40.6s. Estimated remaining: 3h 21m 13s. Rate: 7.5 symbols/min [2025-09-25T18:53:27.889557] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-25T18:53:27.967842] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:28.021987] [DEBUG] [LOCAL ] FNV: Loaded 46378 existing records from primary storage. [2025-09-25T18:53:28.022156] [INFO ] [MAIN ] FNV: Loaded 46378 existing records. [2025-09-25T18:53:28.223759] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:53:28.240056] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-25T18:53:28.240878] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-25T18:53:28.242192] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-25T18:53:28.242117] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T18:53:28.242392] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-25T18:53:28.309765] [INFO ] [REMOTE ] FND: Full fetch complete (74459 records). [2025-09-25T18:53:28.331174] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-25T18:53:28.948823] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:28.961564] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-25T18:53:29.099546] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-25T18:53:29.127444] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-25T18:53:29.128529] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-25T18:53:29.128634] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-25T18:53:29.132188] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-25T18:53:29.143399] [DEBUG] [LOCAL ] FND: Trimmed 74459 records to 52511 (keeping 200 days of data) [2025-09-25T18:53:29.469701] [DEBUG] [LOCAL ] FND: Primary data saved (52511 records). [2025-09-25T18:53:29.470105] [INFO ] [MAIN ] FND: Full history saved. [2025-09-25T18:53:29.470261] [INFO ] [MAIN ] Update Progress: 856/2372 symbols completed. FND took 30.2s. Estimated remaining: 3h 20m 54s. Rate: 7.5 symbols/min [2025-09-25T18:53:29.504081] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-25T18:53:29.653978] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:29.654399] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-09-25T18:53:29.654507] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-09-25T18:53:29.654873] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-25T18:53:29.654981] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-25T18:53:29.655092] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-25T18:53:29.655291] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-25T18:53:30.052903] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-25T18:53:30.077805] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:30.288771] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-25T18:53:30.381268] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:53:31.088728] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-25T18:53:31.288828] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T18:53:31.297997] [INFO ] [REMOTE ] FNF: Full fetch complete (69532 records). [2025-09-25T18:53:31.298158] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-25T18:53:31.696536] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-25T18:53:31.696786] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-25T18:53:31.697801] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-25T18:53:31.697889] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-25T18:53:31.699504] [DEBUG] [LOCAL ] FNF: Trimmed 69532 records to 49513 (keeping 200 days of data) [2025-09-25T18:53:31.916223] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-25T18:53:32.025298] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T18:53:32.080175] [INFO ] [REMOTE ] FNB: Full fetch complete (68043 records). [2025-09-25T18:53:32.080903] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-25T18:53:32.298955] [WARN ] [VALIDATOR ] FNB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-25T18:53:32.303339] [FATAL] [MAIN ] FNB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:53:32.304823] [WARN ] [MAIN ] FNB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:53:32.305502] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-25T18:53:32.311342] [DEBUG] [LOCAL ] FNB: No primary data file found to delete. [2025-09-25T18:53:32.320254] [INFO ] [LOCAL ] FNB: Starting deletion of derivative data. [2025-09-25T18:53:32.322266] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T18:53:32.325086] [DEBUG] [LOCAL ] FNF: Primary data saved (49513 records). [2025-09-25T18:53:32.330724] [DEBUG] [LOCAL ] FNB: Deleted derivative data file. [2025-09-25T18:53:32.325298] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-25T18:53:32.332326] [INFO ] [MAIN ] Update Progress: 857/2372 symbols completed. FNF took 29.6s. Estimated remaining: 3h 20m 37s. Rate: 7.6 symbols/min [2025-09-25T18:53:32.332943] [INFO ] [MAIN ] Update Progress: 858/2372 symbols completed. FNB took 34.5s. Estimated remaining: 3h 20m 15s. Rate: 7.6 symbols/min [2025-09-25T18:53:32.710051] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:32.728256] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:32.710192] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-25T18:53:32.756788] [DEBUG] [LOCAL ] FOF: Loaded 8388 existing records from primary storage. [2025-09-25T18:53:32.756973] [INFO ] [MAIN ] FOF: Loaded 8388 existing records. [2025-09-25T18:53:32.896800] [DEBUG] [LOCAL ] FOR: Loaded 20132 existing records from primary storage. [2025-09-25T18:53:32.897369] [INFO ] [MAIN ] FOR: Loaded 20132 existing records. [2025-09-25T18:53:33.085500] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:53:33.127046] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-25T18:53:33.154473] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-25T18:53:33.198529] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-25T18:53:33.198959] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-25T18:53:33.199211] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:53:33.232993] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-25T18:53:33.258541] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-25T18:53:33.273216] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-25T18:53:33.285248] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-25T18:53:33.770479] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T18:53:33.903551] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:33.899428] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-25T18:53:34.042889] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:34.045499] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T18:53:34.288716] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-25T18:53:35.088694] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-25T18:53:35.126383] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T18:53:35.567032] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:53:35.888706] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-25T18:53:36.242500] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T18:53:36.688706] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-25T18:53:36.862961] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T18:53:37.488712] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-25T18:53:37.788960] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T18:53:38.288765] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-25T18:53:39.007294] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T18:53:39.088687] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-25T18:53:39.258145] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T18:53:39.813225] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T18:53:39.888715] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-25T18:53:40.639484] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T18:53:40.688743] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-25T18:53:41.488755] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-25T18:53:41.510131] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T18:53:42.288768] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-25T18:53:42.557691] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T18:53:43.088745] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-25T18:53:43.878824] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:53:43.888676] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-25T18:53:44.201616] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T18:53:44.688787] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-25T18:53:44.944226] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T18:53:45.488760] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-25T18:53:46.288757] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-25T18:53:46.383302] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T18:53:46.424526] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T18:53:47.051729] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T18:53:47.088664] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-25T18:53:47.888762] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-25T18:53:48.077679] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T18:53:48.688788] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-25T18:53:49.488734] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-25T18:53:49.543916] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T18:53:49.577477] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T18:53:50.288681] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-25T18:53:50.437337] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T18:53:50.917453] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T18:53:51.088741] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-25T18:53:51.888689] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-25T18:53:52.125027] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:53:52.688733] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-25T18:53:53.488695] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-25T18:53:53.553171] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T18:53:53.555832] [INFO ] [REMOTE ] FOF: Full fetch complete (11871 records). [2025-09-25T18:53:53.555908] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-25T18:53:53.967759] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-25T18:53:53.978605] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-25T18:53:53.979269] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-25T18:53:53.979351] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-25T18:53:53.981802] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T18:53:53.982191] [DEBUG] [LOCAL ] FOF: Trimmed 11871 records to 8438 (keeping 200 days of data) [2025-09-25T18:53:54.051578] [DEBUG] [LOCAL ] FOF: Primary data saved (8438 records). [2025-09-25T18:53:54.051777] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-25T18:53:54.051916] [INFO ] [MAIN ] Update Progress: 859/2372 symbols completed. FOF took 21.7s. Estimated remaining: 3h 20m 32s. Rate: 7.5 symbols/min [2025-09-25T18:53:54.234031] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:53:54.287392] [DEBUG] [LOCAL ] FOUR: Loaded 49527 existing records from primary storage. [2025-09-25T18:53:54.287705] [INFO ] [MAIN ] FOUR: Loaded 49527 existing records. [2025-09-25T18:53:54.299152] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-25T18:53:54.421212] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T18:53:54.497751] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:53:54.498039] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-25T18:53:54.498090] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-25T18:53:54.498304] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-25T18:53:54.498364] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-25T18:53:54.876604] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:53:55.088791] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-25T18:53:55.888704] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-25T18:53:55.983567] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T18:53:56.502287] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:53:56.688700] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-25T18:53:56.929828] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T18:53:57.488750] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-25T18:53:58.288732] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-25T18:53:58.362222] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:53:58.396326] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T18:53:59.088747] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-25T18:53:59.888758] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-25T18:54:00.055684] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T18:54:00.069772] [INFO ] [REMOTE ] FNV: Full fetch complete (66077 records). [2025-09-25T18:54:00.070054] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-25T18:54:00.499768] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-25T18:54:00.499886] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-25T18:54:00.501027] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-25T18:54:00.501091] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-25T18:54:00.502460] [DEBUG] [LOCAL ] FNV: Trimmed 66077 records to 46719 (keeping 200 days of data) [2025-09-25T18:54:00.699798] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-25T18:54:00.816578] [DEBUG] [LOCAL ] FNV: Primary data saved (46719 records). [2025-09-25T18:54:00.816761] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-25T18:54:00.818119] [INFO ] [MAIN ] Update Progress: 860/2372 symbols completed. FNV took 33.0s. Estimated remaining: 3h 20m 22s. Rate: 7.5 symbols/min [2025-09-25T18:54:00.961135] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T18:54:01.019903] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:01.051447] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T18:54:01.076203] [DEBUG] [LOCAL ] FPF: Loaded 17660 existing records from primary storage. [2025-09-25T18:54:01.076348] [INFO ] [MAIN ] FPF: Loaded 17660 existing records. [2025-09-25T18:54:01.270453] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:01.271084] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-25T18:54:01.279574] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-25T18:54:01.279923] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T18:54:01.283238] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-25T18:54:01.283316] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-25T18:54:01.493982] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-25T18:54:01.679813] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:02.288757] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-25T18:54:02.398692] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T18:54:03.088744] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-25T18:54:03.382467] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T18:54:03.387243] [INFO ] [REMOTE ] FOR: Full fetch complete (29934 records). [2025-09-25T18:54:03.387531] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-25T18:54:03.769550] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-25T18:54:03.778887] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-25T18:54:03.779577] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-25T18:54:03.779724] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-25T18:54:03.780940] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T18:54:03.785449] [DEBUG] [LOCAL ] FOR: Trimmed 29934 records to 20256 (keeping 200 days of data) [2025-09-25T18:54:03.888875] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-25T18:54:03.918177] [DEBUG] [LOCAL ] FOR: Primary data saved (20256 records). [2025-09-25T18:54:03.918319] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-25T18:54:03.918404] [INFO ] [MAIN ] Update Progress: 861/2372 symbols completed. FOR took 31.6s. Estimated remaining: 3h 20m 5s. Rate: 7.6 symbols/min [2025-09-25T18:54:04.088084] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:04.107502] [DEBUG] [LOCAL ] FPH: Loaded 19649 existing records from primary storage. [2025-09-25T18:54:04.107625] [INFO ] [MAIN ] FPH: Loaded 19649 existing records. [2025-09-25T18:54:04.290361] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:04.290757] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-25T18:54:04.290827] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-25T18:54:04.291113] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-25T18:54:04.291172] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-25T18:54:04.673138] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:04.688680] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-25T18:54:04.953459] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T18:54:04.957349] [INFO ] [REMOTE ] FOA: Full fetch complete (22461 records). [2025-09-25T18:54:04.957436] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-25T18:54:05.338731] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-25T18:54:05.338845] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-25T18:54:05.339392] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-25T18:54:05.339435] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-25T18:54:05.340504] [DEBUG] [LOCAL ] FOA: Trimmed 22461 records to 13368 (keeping 200 days of data) [2025-09-25T18:54:05.428761] [DEBUG] [LOCAL ] FOA: Primary data saved (13368 records). [2025-09-25T18:54:05.428981] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-25T18:54:05.429100] [INFO ] [MAIN ] Update Progress: 862/2372 symbols completed. FOA took 36.0s. Estimated remaining: 3h 19m 46s. Rate: 7.6 symbols/min [2025-09-25T18:54:05.496172] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-25T18:54:05.612114] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:05.652447] [DEBUG] [LOCAL ] FPI: Loaded 31139 existing records from primary storage. [2025-09-25T18:54:05.652589] [INFO ] [MAIN ] FPI: Loaded 31139 existing records. [2025-09-25T18:54:05.860922] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T18:54:05.861074] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:05.867096] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-25T18:54:05.867154] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-25T18:54:05.867425] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-25T18:54:05.867494] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-25T18:54:06.232913] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:06.288732] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-25T18:54:07.088740] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-25T18:54:07.310121] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T18:54:07.687569] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T18:54:07.888698] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-25T18:54:08.352325] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T18:54:08.688708] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-25T18:54:09.014017] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T18:54:09.488887] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-25T18:54:09.550164] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T18:54:10.288762] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-25T18:54:11.088770] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-25T18:54:11.324207] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T18:54:11.440876] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:54:11.888754] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-25T18:54:12.266094] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T18:54:12.688708] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-25T18:54:12.963405] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T18:54:13.488690] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-25T18:54:13.509256] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T18:54:14.288742] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-25T18:54:14.530205] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T18:54:15.088729] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-25T18:54:15.644593] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T18:54:15.805910] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-25T18:54:15.888680] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-25T18:54:16.688727] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-25T18:54:17.096689] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T18:54:17.488705] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-25T18:54:17.719364] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T18:54:18.288731] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-25T18:54:18.867958] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T18:54:18.897364] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T18:54:19.088758] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-25T18:54:19.888692] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-25T18:54:20.115182] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T18:54:20.688693] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-25T18:54:20.846050] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T18:54:21.488728] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-25T18:54:21.975393] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T18:54:21.979840] [INFO ] [REMOTE ] FPH: Full fetch complete (31475 records). [2025-09-25T18:54:21.979940] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-25T18:54:22.293825] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-25T18:54:22.417717] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-25T18:54:22.417809] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-25T18:54:22.418435] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-25T18:54:22.418475] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-25T18:54:22.419252] [DEBUG] [LOCAL ] FPH: Trimmed 31475 records to 19773 (keeping 200 days of data) [2025-09-25T18:54:22.535120] [DEBUG] [LOCAL ] FPH: Primary data saved (19773 records). [2025-09-25T18:54:22.535354] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-25T18:54:22.535495] [INFO ] [MAIN ] Update Progress: 863/2372 symbols completed. FPH took 18.6s. Estimated remaining: 3h 19m 54s. Rate: 7.5 symbols/min [2025-09-25T18:54:22.725055] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:22.776532] [DEBUG] [LOCAL ] FR: Loaded 46558 existing records from primary storage. [2025-09-25T18:54:22.776764] [INFO ] [MAIN ] FR: Loaded 46558 existing records. [2025-09-25T18:54:22.969026] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:22.969832] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-25T18:54:22.970037] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-25T18:54:22.970406] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-25T18:54:22.970469] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-25T18:54:23.095569] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-25T18:54:23.274893] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T18:54:23.417112] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:23.888695] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-25T18:54:24.089120] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T18:54:24.187500] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T18:54:24.688743] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-25T18:54:25.417010] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T18:54:25.488731] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-25T18:54:26.289057] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-25T18:54:26.294447] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T18:54:27.088755] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-25T18:54:27.130058] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T18:54:27.642221] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T18:54:27.888751] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-25T18:54:28.225812] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T18:54:28.688757] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-25T18:54:29.430457] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T18:54:29.488682] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-25T18:54:29.819711] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T18:54:30.288761] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-25T18:54:31.070883] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T18:54:31.088673] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-25T18:54:31.648078] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T18:54:31.888743] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-25T18:54:32.674195] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T18:54:32.688669] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-25T18:54:33.488821] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-25T18:54:33.712719] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T18:54:34.288710] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-25T18:54:34.421578] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T18:54:34.507535] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T18:54:35.088740] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-25T18:54:35.562612] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T18:54:35.888765] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-25T18:54:36.693823] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-25T18:54:36.709820] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T18:54:37.407258] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T18:54:37.413345] [INFO ] [REMOTE ] FPI: Full fetch complete (44063 records). [2025-09-25T18:54:37.413469] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-25T18:54:37.489827] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-25T18:54:37.847864] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-25T18:54:37.847984] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-25T18:54:37.849455] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-25T18:54:37.850354] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-25T18:54:37.850255] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T18:54:37.856472] [DEBUG] [LOCAL ] FPI: Trimmed 44063 records to 31331 (keeping 200 days of data) [2025-09-25T18:54:38.054289] [DEBUG] [LOCAL ] FPI: Primary data saved (31331 records). [2025-09-25T18:54:38.054497] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-25T18:54:38.054635] [INFO ] [MAIN ] Update Progress: 864/2372 symbols completed. FPI took 32.6s. Estimated remaining: 3h 19m 59s. Rate: 7.5 symbols/min [2025-09-25T18:54:38.238090] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:38.255237] [DEBUG] [LOCAL ] FRA: Loaded 14534 existing records from primary storage. [2025-09-25T18:54:38.255374] [INFO ] [MAIN ] FRA: Loaded 14534 existing records. [2025-09-25T18:54:38.293990] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-25T18:54:38.452734] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:38.453013] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-25T18:54:38.453084] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-25T18:54:38.453305] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-25T18:54:38.453363] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-25T18:54:38.820806] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:39.088746] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-25T18:54:39.404560] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T18:54:39.408279] [INFO ] [REMOTE ] FPF: Full fetch complete (26257 records). [2025-09-25T18:54:39.408363] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-25T18:54:39.728006] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-25T18:54:39.758770] [INFO ] [REMOTE ] FOUR: Full fetch complete (71938 records). [2025-09-25T18:54:39.769132] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-25T18:54:39.912077] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-25T18:54:39.911809] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-25T18:54:39.930009] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-25T18:54:39.946982] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-25T18:54:39.951799] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-25T18:54:39.985638] [DEBUG] [LOCAL ] FPF: Trimmed 26257 records to 17789 (keeping 200 days of data) [2025-09-25T18:54:40.392876] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-25T18:54:40.393573] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-25T18:54:40.395173] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-25T18:54:40.395579] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-25T18:54:40.400289] [DEBUG] [LOCAL ] FOUR: Trimmed 71938 records to 49917 (keeping 200 days of data) [2025-09-25T18:54:40.514158] [DEBUG] [LOCAL ] FPF: Primary data saved (17789 records). [2025-09-25T18:54:40.515018] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-25T18:54:40.515214] [INFO ] [MAIN ] Update Progress: 865/2372 symbols completed. FPF took 39.7s. Estimated remaining: 3h 19m 42s. Rate: 7.5 symbols/min [2025-09-25T18:54:40.705209] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:40.735544] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T18:54:40.763620] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-25T18:54:40.774723] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T18:54:40.783227] [DEBUG] [LOCAL ] FRGE: Loaded 18432 existing records from primary storage. [2025-09-25T18:54:40.792840] [INFO ] [MAIN ] FRGE: Loaded 18432 existing records. [2025-09-25T18:54:41.090939] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:41.094895] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-25T18:54:41.095258] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-25T18:54:41.096117] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-25T18:54:41.097827] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-25T18:54:41.499197] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-25T18:54:41.505894] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:41.576941] [DEBUG] [LOCAL ] FOUR: Primary data saved (49917 records). [2025-09-25T18:54:41.577128] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-25T18:54:41.577804] [INFO ] [MAIN ] Update Progress: 866/2372 symbols completed. FOUR took 47.5s. Estimated remaining: 3h 19m 22s. Rate: 7.6 symbols/min [2025-09-25T18:54:41.756526] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:41.822173] [DEBUG] [LOCAL ] FRO: Loaded 51855 existing records from primary storage. [2025-09-25T18:54:41.822341] [INFO ] [MAIN ] FRO: Loaded 51855 existing records. [2025-09-25T18:54:42.007054] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:42.007379] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-25T18:54:42.007449] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-25T18:54:42.007829] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-25T18:54:42.007890] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-25T18:54:42.290446] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-25T18:54:42.389296] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:42.422064] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T18:54:42.467189] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T18:54:43.088750] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-25T18:54:43.864915] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T18:54:43.888668] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-25T18:54:44.688743] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-25T18:54:45.100723] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T18:54:45.170240] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T18:54:45.488751] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-25T18:54:45.710405] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T18:54:46.288735] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-25T18:54:47.097093] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-25T18:54:47.098313] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T18:54:47.285686] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T18:54:47.888729] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-25T18:54:48.693931] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-25T18:54:48.708392] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T18:54:49.345979] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T18:54:49.488767] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-25T18:54:49.789417] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T18:54:50.288757] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-25T18:54:50.770038] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:54:51.088775] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-25T18:54:51.888719] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-25T18:54:52.205824] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T18:54:52.519760] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T18:54:52.688734] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-25T18:54:53.399542] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T18:54:53.408090] [INFO ] [REMOTE ] FR: Full fetch complete (66548 records). [2025-09-25T18:54:53.408252] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-25T18:54:53.493936] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-25T18:54:53.812125] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-25T18:54:53.812221] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-25T18:54:53.813151] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-25T18:54:53.813216] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-25T18:54:53.814823] [DEBUG] [LOCAL ] FR: Trimmed 66548 records to 46867 (keeping 200 days of data) [2025-09-25T18:54:54.097435] [DEBUG] [LOCAL ] FR: Primary data saved (46867 records). [2025-09-25T18:54:54.097589] [INFO ] [MAIN ] FR: Full history saved. [2025-09-25T18:54:54.097701] [INFO ] [MAIN ] Update Progress: 867/2372 symbols completed. FR took 31.6s. Estimated remaining: 3h 19m 22s. Rate: 7.5 symbols/min [2025-09-25T18:54:54.275518] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:54:54.288773] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-25T18:54:54.318634] [DEBUG] [LOCAL ] FRT: Loaded 42294 existing records from primary storage. [2025-09-25T18:54:54.318830] [INFO ] [MAIN ] FRT: Loaded 42294 existing records. [2025-09-25T18:54:54.516695] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:54:54.517192] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-25T18:54:54.517293] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-25T18:54:54.517826] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-25T18:54:54.517889] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-25T18:54:54.864696] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-25T18:54:54.950460] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:54:54.970947] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T18:54:55.088794] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-25T18:54:55.179395] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T18:54:55.888776] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-25T18:54:56.688764] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-25T18:54:56.955057] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T18:54:56.955874] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:54:57.488752] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-25T18:54:57.677860] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T18:54:58.288750] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-25T18:54:58.439254] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-25T18:54:59.088756] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-25T18:54:59.888687] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-25T18:54:59.962144] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T18:55:00.185131] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T18:55:00.688701] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-25T18:55:00.959396] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T18:55:01.488802] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-25T18:55:02.020893] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T18:55:02.288822] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-25T18:55:02.622115] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T18:55:02.627252] [INFO ] [REMOTE ] FRA: Full fetch complete (24166 records). [2025-09-25T18:55:02.627457] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-25T18:55:03.068428] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-25T18:55:03.068546] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-25T18:55:03.069326] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-25T18:55:03.069396] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-25T18:55:03.070451] [DEBUG] [LOCAL ] FRA: Trimmed 24166 records to 14610 (keeping 200 days of data) [2025-09-25T18:55:03.109863] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-25T18:55:03.171595] [DEBUG] [LOCAL ] FRA: Primary data saved (14610 records). [2025-09-25T18:55:03.171847] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-25T18:55:03.172006] [INFO ] [MAIN ] Update Progress: 868/2372 symbols completed. FRA took 25.1s. Estimated remaining: 3h 19m 16s. Rate: 7.5 symbols/min [2025-09-25T18:55:03.356844] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:03.401336] [DEBUG] [LOCAL ] FSCO: Loaded 36964 existing records from primary storage. [2025-09-25T18:55:03.401806] [INFO ] [MAIN ] FSCO: Loaded 36964 existing records. [2025-09-25T18:55:03.600013] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:03.600881] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-25T18:55:03.601008] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-25T18:55:03.601774] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-25T18:55:03.602085] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-25T18:55:03.892731] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-25T18:55:03.967063] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T18:55:04.054883] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:04.688798] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-25T18:55:04.979857] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T18:55:05.059964] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T18:55:05.488770] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-25T18:55:06.097394] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:55:06.137892] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T18:55:06.141816] [INFO ] [REMOTE ] FRGE: Full fetch complete (33773 records). [2025-09-25T18:55:06.142521] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-25T18:55:06.301544] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-25T18:55:06.570581] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-25T18:55:06.570718] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-25T18:55:06.571547] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-25T18:55:06.571593] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-25T18:55:06.572532] [DEBUG] [LOCAL ] FRGE: Trimmed 33773 records to 18502 (keeping 200 days of data) [2025-09-25T18:55:06.681185] [DEBUG] [LOCAL ] FRGE: Primary data saved (18502 records). [2025-09-25T18:55:06.681346] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-25T18:55:06.681438] [INFO ] [MAIN ] Update Progress: 869/2372 symbols completed. FRGE took 26.2s. Estimated remaining: 3h 19m 0s. Rate: 7.6 symbols/min [2025-09-25T18:55:06.852457] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:06.910908] [DEBUG] [LOCAL ] FSK: Loaded 49410 existing records from primary storage. [2025-09-25T18:55:06.911070] [INFO ] [MAIN ] FSK: Loaded 49410 existing records. [2025-09-25T18:55:07.090397] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-25T18:55:07.090694] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:07.092119] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-25T18:55:07.092183] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-25T18:55:07.092527] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-25T18:55:07.092589] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-25T18:55:07.492852] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:07.888726] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-25T18:55:07.969921] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:55:08.688720] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-25T18:55:08.774994] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T18:55:09.488709] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-25T18:55:09.923111] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T18:55:10.288733] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-25T18:55:10.443148] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T18:55:10.581474] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T18:55:11.088729] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-25T18:55:11.888696] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-25T18:55:11.974435] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T18:55:12.473312] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T18:55:12.688740] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-25T18:55:13.069993] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T18:55:13.488751] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-25T18:55:14.288763] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-25T18:55:14.915200] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-25T18:55:14.925949] [INFO ] [REMOTE ] FRO: Full fetch complete (75388 records). [2025-09-25T18:55:14.926166] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-25T18:55:15.104431] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-25T18:55:15.430311] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T18:55:15.427794] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-25T18:55:15.439519] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-25T18:55:15.442093] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-25T18:55:15.442670] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-25T18:55:15.444610] [DEBUG] [LOCAL ] FRO: Trimmed 75388 records to 52243 (keeping 200 days of data) [2025-09-25T18:55:15.591788] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T18:55:15.846773] [DEBUG] [LOCAL ] FRO: Primary data saved (52243 records). [2025-09-25T18:55:15.847016] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-25T18:55:15.848299] [INFO ] [MAIN ] Update Progress: 870/2372 symbols completed. FRO took 34.3s. Estimated remaining: 3h 18m 55s. Rate: 7.6 symbols/min [2025-09-25T18:55:15.893876] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-25T18:55:16.042338] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:16.097579] [DEBUG] [LOCAL ] FSLY: Loaded 51254 existing records from primary storage. [2025-09-25T18:55:16.097793] [INFO ] [MAIN ] FSLY: Loaded 51254 existing records. [2025-09-25T18:55:16.283822] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:16.284107] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-25T18:55:16.284156] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-25T18:55:16.284438] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-25T18:55:16.284498] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-25T18:55:16.658124] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:16.688672] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-25T18:55:16.883156] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T18:55:17.488712] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-25T18:55:17.681210] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T18:55:18.234046] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T18:55:18.288747] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-25T18:55:18.989275] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T18:55:19.088761] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-25T18:55:19.888746] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-25T18:55:20.216363] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T18:55:20.267357] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T18:55:20.688749] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-25T18:55:21.488781] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-25T18:55:21.555919] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T18:55:22.204783] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T18:55:22.288724] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-25T18:55:23.088698] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-25T18:55:23.340710] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T18:55:23.875113] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T18:55:23.888665] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-25T18:55:24.676305] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T18:55:24.688729] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-25T18:55:25.488734] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-25T18:55:25.524675] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T18:55:25.533034] [INFO ] [REMOTE ] FSCO: Full fetch complete (54143 records). [2025-09-25T18:55:25.533220] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-25T18:55:25.924869] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-25T18:55:25.924987] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-25T18:55:25.925823] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-25T18:55:25.925887] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-25T18:55:25.927141] [DEBUG] [LOCAL ] FSCO: Trimmed 54143 records to 37342 (keeping 200 days of data) [2025-09-25T18:55:26.143270] [DEBUG] [LOCAL ] FSCO: Primary data saved (37342 records). [2025-09-25T18:55:26.143431] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-25T18:55:26.143523] [INFO ] [MAIN ] Update Progress: 871/2372 symbols completed. FSCO took 23.0s. Estimated remaining: 3h 18m 51s. Rate: 7.5 symbols/min [2025-09-25T18:55:26.290352] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-25T18:55:26.359292] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:26.414761] [DEBUG] [LOCAL ] FSM: Loaded 53287 existing records from primary storage. [2025-09-25T18:55:26.414950] [INFO ] [MAIN ] FSM: Loaded 53287 existing records. [2025-09-25T18:55:26.636536] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:26.637721] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-25T18:55:26.639493] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T18:55:26.650416] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-25T18:55:26.651270] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-25T18:55:26.651332] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-25T18:55:27.019293] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:27.088722] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-25T18:55:27.240967] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T18:55:27.852258] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T18:55:27.888674] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-25T18:55:28.562917] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T18:55:28.688681] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-25T18:55:29.488700] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-25T18:55:29.564090] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:55:30.288703] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-25T18:55:30.336351] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T18:55:31.088704] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-25T18:55:31.322911] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T18:55:31.865580] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T18:55:31.888681] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-25T18:55:32.485172] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T18:55:32.688782] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-25T18:55:33.488773] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-25T18:55:33.683390] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T18:55:34.288707] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-25T18:55:34.518189] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T18:55:34.772573] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T18:55:35.088788] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-25T18:55:35.560906] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T18:55:35.569122] [INFO ] [REMOTE ] FRT: Full fetch complete (60248 records). [2025-09-25T18:55:35.569266] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-25T18:55:35.893966] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-25T18:55:35.972464] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-25T18:55:35.972550] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-25T18:55:35.973367] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-25T18:55:35.973433] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-25T18:55:35.975173] [DEBUG] [LOCAL ] FRT: Trimmed 60248 records to 42561 (keeping 200 days of data) [2025-09-25T18:55:36.232764] [DEBUG] [LOCAL ] FRT: Primary data saved (42561 records). [2025-09-25T18:55:36.232915] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-25T18:55:36.233007] [INFO ] [MAIN ] Update Progress: 872/2372 symbols completed. FRT took 42.1s. Estimated remaining: 3h 18m 46s. Rate: 7.5 symbols/min [2025-09-25T18:55:36.404007] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:36.458912] [DEBUG] [LOCAL ] FSS: Loaded 34449 existing records from primary storage. [2025-09-25T18:55:36.459113] [INFO ] [MAIN ] FSS: Loaded 34449 existing records. [2025-09-25T18:55:36.667803] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:36.668433] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-25T18:55:36.668590] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-25T18:55:36.669130] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-25T18:55:36.669195] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-25T18:55:36.706599] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-25T18:55:37.051636] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T18:55:37.128186] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:37.488733] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-25T18:55:37.844858] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T18:55:38.288696] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-25T18:55:38.479996] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T18:55:38.653544] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T18:55:39.088737] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-25T18:55:39.888695] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-25T18:55:40.177603] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T18:55:40.322264] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T18:55:40.688742] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-25T18:55:41.488809] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-25T18:55:41.658264] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T18:55:42.288718] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-25T18:55:42.566877] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T18:55:42.788967] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T18:55:43.088711] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-25T18:55:43.812578] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T18:55:43.888759] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-25T18:55:44.659252] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T18:55:44.688763] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-25T18:55:45.488727] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-25T18:55:45.649981] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T18:55:46.208121] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T18:55:46.288736] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-25T18:55:47.088735] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-25T18:55:47.554710] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-25T18:55:47.566957] [INFO ] [REMOTE ] FSK: Full fetch complete (71436 records). [2025-09-25T18:55:47.567200] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-25T18:55:47.891838] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-25T18:55:48.024721] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-25T18:55:48.024840] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-25T18:55:48.025934] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-25T18:55:48.026046] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-25T18:55:48.028633] [DEBUG] [LOCAL ] FSK: Trimmed 71436 records to 49795 (keeping 200 days of data) [2025-09-25T18:55:48.165265] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T18:55:48.177920] [INFO ] [REMOTE ] FSLY: Full fetch complete (74948 records). [2025-09-25T18:55:48.179197] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-25T18:55:48.495127] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T18:55:48.653454] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-25T18:55:48.657233] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-25T18:55:48.659748] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-25T18:55:48.662349] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-25T18:55:48.723351] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-25T18:55:48.737075] [DEBUG] [LOCAL ] FSLY: Trimmed 74948 records to 51629 (keeping 200 days of data) [2025-09-25T18:55:49.067575] [DEBUG] [LOCAL ] FSK: Primary data saved (49795 records). [2025-09-25T18:55:49.072274] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-25T18:55:49.073028] [INFO ] [MAIN ] Update Progress: 873/2372 symbols completed. FSK took 42.4s. Estimated remaining: 3h 18m 47s. Rate: 7.5 symbols/min [2025-09-25T18:55:49.269785] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:49.285042] [DEBUG] [LOCAL ] FT: Loaded 6313 existing records from primary storage. [2025-09-25T18:55:49.286002] [INFO ] [MAIN ] FT: Loaded 6313 existing records. [2025-09-25T18:55:49.554242] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:49.558379] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-25T18:55:49.558492] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-25T18:55:49.559244] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-25T18:55:49.559987] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-25T18:55:49.866418] [DEBUG] [LOCAL ] FSLY: Primary data saved (51629 records). [2025-09-25T18:55:49.878313] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-25T18:55:49.879606] [INFO ] [MAIN ] Update Progress: 874/2372 symbols completed. FSLY took 34.0s. Estimated remaining: 3h 18m 27s. Rate: 7.5 symbols/min [2025-09-25T18:55:50.090374] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:50.120144] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-25T18:55:50.126989] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-25T18:55:50.220009] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:50.245742] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T18:55:50.266052] [DEBUG] [LOCAL ] FTHY: Loaded 11752 existing records from primary storage. [2025-09-25T18:55:50.266225] [INFO ] [MAIN ] FTHY: Loaded 11752 existing records. [2025-09-25T18:55:50.297244] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-25T18:55:50.455385] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:50.455764] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-25T18:55:50.455826] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-25T18:55:50.456080] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-25T18:55:50.456141] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-25T18:55:50.859988] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:50.888837] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T18:55:51.088810] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-25T18:55:51.781186] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T18:55:51.888820] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-25T18:55:52.072207] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T18:55:52.688722] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-25T18:55:52.994218] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T18:55:53.316635] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:55:53.488760] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-25T18:55:54.288735] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-25T18:55:54.956449] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T18:55:54.964600] [INFO ] [REMOTE ] FSS: Full fetch complete (48228 records). [2025-09-25T18:55:54.965013] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-25T18:55:55.097990] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-25T18:55:55.326332] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T18:55:55.667312] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-25T18:55:55.667436] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-25T18:55:55.668974] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-25T18:55:55.669051] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-25T18:55:55.672905] [DEBUG] [LOCAL ] FSS: Trimmed 48228 records to 34689 (keeping 200 days of data) [2025-09-25T18:55:55.890204] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-25T18:55:55.923493] [DEBUG] [LOCAL ] FSS: Primary data saved (34689 records). [2025-09-25T18:55:55.923722] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-25T18:55:55.923877] [INFO ] [MAIN ] Update Progress: 875/2372 symbols completed. FSS took 19.7s. Estimated remaining: 3h 18m 15s. Rate: 7.6 symbols/min [2025-09-25T18:55:56.104011] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:55:56.166180] [DEBUG] [LOCAL ] FTI: Loaded 53304 existing records from primary storage. [2025-09-25T18:55:56.166380] [INFO ] [MAIN ] FTI: Loaded 53304 existing records. [2025-09-25T18:55:56.349335] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:55:56.349665] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-25T18:55:56.349727] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-25T18:55:56.350029] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-25T18:55:56.350088] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-25T18:55:56.693537] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-25T18:55:56.725266] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:55:56.815769] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T18:55:57.106317] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T18:55:57.109143] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T18:55:57.488767] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-25T18:55:58.288767] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-25T18:55:59.088754] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-25T18:55:59.101186] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T18:55:59.300998] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T18:55:59.888734] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-25T18:56:00.688748] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-25T18:56:01.294351] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-25T18:56:01.315071] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T18:56:01.488753] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-25T18:56:01.817375] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T18:56:01.828428] [INFO ] [REMOTE ] FSM: Full fetch complete (76707 records). [2025-09-25T18:56:01.828627] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-25T18:56:02.046800] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-25T18:56:02.293916] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-25T18:56:02.356333] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-25T18:56:02.356463] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-25T18:56:02.357576] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-25T18:56:02.357669] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-25T18:56:02.359355] [DEBUG] [LOCAL ] FSM: Trimmed 76707 records to 53675 (keeping 200 days of data) [2025-09-25T18:56:02.691883] [DEBUG] [LOCAL ] FSM: Primary data saved (53675 records). [2025-09-25T18:56:02.692107] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-25T18:56:02.692242] [INFO ] [MAIN ] Update Progress: 876/2372 symbols completed. FSM took 36.5s. Estimated remaining: 3h 18m 5s. Rate: 7.6 symbols/min [2025-09-25T18:56:02.897369] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:02.933713] [DEBUG] [LOCAL ] FTK: Loaded 32203 existing records from primary storage. [2025-09-25T18:56:02.933904] [INFO ] [MAIN ] FTK: Loaded 32203 existing records. [2025-09-25T18:56:03.093924] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-25T18:56:03.140700] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:03.142846] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-25T18:56:03.142929] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-25T18:56:03.143268] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-25T18:56:03.143340] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-25T18:56:03.473482] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T18:56:03.578865] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:03.888778] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-25T18:56:03.928104] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T18:56:04.680337] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:56:04.688689] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-25T18:56:05.488688] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-25T18:56:05.575800] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T18:56:06.288782] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-25T18:56:07.099972] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-25T18:56:07.108217] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T18:56:07.136757] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T18:56:07.888712] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-25T18:56:07.972738] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T18:56:08.635348] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T18:56:08.688691] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-25T18:56:09.488768] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-25T18:56:09.901914] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T18:56:10.288756] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-25T18:56:11.088732] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-25T18:56:11.366743] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T18:56:11.495627] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T18:56:11.888778] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-25T18:56:11.942031] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T18:56:12.688745] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-25T18:56:13.110711] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T18:56:13.488832] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-25T18:56:13.919890] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T18:56:14.177639] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T18:56:14.288719] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-25T18:56:15.088758] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-25T18:56:15.888777] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-25T18:56:16.148445] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T18:56:16.154500] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T18:56:16.164578] [INFO ] [REMOTE ] FTHY: Full fetch complete (17601 records). [2025-09-25T18:56:16.164684] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-25T18:56:16.600154] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-25T18:56:16.600380] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-25T18:56:16.600869] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-25T18:56:16.600943] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-25T18:56:16.601825] [DEBUG] [LOCAL ] FTHY: Trimmed 17601 records to 11807 (keeping 200 days of data) [2025-09-25T18:56:16.654245] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T18:56:16.689349] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-25T18:56:16.713979] [DEBUG] [LOCAL ] FTHY: Primary data saved (11807 records). [2025-09-25T18:56:16.714157] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-25T18:56:16.714267] [INFO ] [MAIN ] Update Progress: 877/2372 symbols completed. FTHY took 26.8s. Estimated remaining: 3h 18m 8s. Rate: 7.5 symbols/min [2025-09-25T18:56:17.488750] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-25T18:56:18.181229] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T18:56:18.288745] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-25T18:56:19.088855] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-25T18:56:19.468212] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T18:56:19.801716] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T18:56:19.818763] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T18:56:19.888776] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-25T18:56:20.688740] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-25T18:56:20.721129] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T18:56:20.723207] [INFO ] [REMOTE ] FT: Full fetch complete (9030 records). [2025-09-25T18:56:20.723282] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-25T18:56:21.159603] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-25T18:56:21.159759] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-25T18:56:21.160084] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-25T18:56:21.160136] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-25T18:56:21.160739] [DEBUG] [LOCAL ] FT: Trimmed 9030 records to 6371 (keeping 200 days of data) [2025-09-25T18:56:21.203370] [DEBUG] [LOCAL ] FT: Primary data saved (6371 records). [2025-09-25T18:56:21.203545] [INFO ] [MAIN ] FT: Full history saved. [2025-09-25T18:56:21.203692] [INFO ] [MAIN ] Update Progress: 878/2372 symbols completed. FT took 32.1s. Estimated remaining: 3h 17m 54s. Rate: 7.5 symbols/min [2025-09-25T18:56:21.488797] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-25T18:56:22.379813] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T18:56:22.392709] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-25T18:56:23.067206] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T18:56:23.088696] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-25T18:56:24.174679] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T18:56:24.187692] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-25T18:56:24.423039] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T18:56:24.688813] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-25T18:56:25.658687] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T18:56:25.670485] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-25T18:56:26.322496] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T18:56:26.329500] [INFO ] [REMOTE ] FTK: Full fetch complete (42650 records). [2025-09-25T18:56:26.329624] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-25T18:56:26.749371] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-25T18:56:26.749498] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-25T18:56:26.750442] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-25T18:56:26.750515] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-25T18:56:26.752146] [DEBUG] [LOCAL ] FTK: Trimmed 42650 records to 32527 (keeping 200 days of data) [2025-09-25T18:56:26.968241] [DEBUG] [LOCAL ] FTK: Primary data saved (32527 records). [2025-09-25T18:56:26.968462] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-25T18:56:26.968593] [INFO ] [MAIN ] Update Progress: 879/2372 symbols completed. FTK took 24.3s. Estimated remaining: 3h 17m 42s. Rate: 7.6 symbols/min [2025-09-25T18:56:27.152960] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T18:56:27.163783] [INFO ] [REMOTE ] FTI: Full fetch complete (76740 records). [2025-09-25T18:56:27.163980] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-25T18:56:27.165309] [FATAL] [VALIDATOR ] FTI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:56:27.165409] [FATAL] [MAIN ] FTI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:56:27.165478] [WARN ] [MAIN ] FTI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:56:27.165575] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-25T18:56:27.165709] [DEBUG] [LOCAL ] FTI: No primary data file found to delete. [2025-09-25T18:56:27.165782] [INFO ] [LOCAL ] FTI: Starting deletion of derivative data. [2025-09-25T18:56:27.166439] [DEBUG] [LOCAL ] FTI: Deleted derivative data file. [2025-09-25T18:56:27.166593] [INFO ] [MAIN ] Update Progress: 880/2372 symbols completed. FTI took 31.2s. Estimated remaining: 3h 17m 21s. Rate: 7.6 symbols/min [2025-09-25T18:56:27.997538] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:28.031748] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:28.004084] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:28.057462] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:28.065967] [DEBUG] [LOCAL ] FTWO: Loaded 1778 existing records from primary storage. [2025-09-25T18:56:28.066360] [INFO ] [MAIN ] FTWO: Loaded 1778 existing records. [2025-09-25T18:56:28.283269] [DEBUG] [LOCAL ] FTS: Loaded 42103 existing records from primary storage. [2025-09-25T18:56:28.324721] [INFO ] [MAIN ] FTS: Loaded 42103 existing records. [2025-09-25T18:56:28.338304] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:28.408548] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-25T18:56:28.423980] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-25T18:56:28.445852] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-25T18:56:28.446051] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-25T18:56:28.533987] [DEBUG] [LOCAL ] FTV: Loaded 52913 existing records from primary storage. [2025-09-25T18:56:28.535395] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-25T18:56:28.536529] [INFO ] [MAIN ] FTV: Loaded 52913 existing records. [2025-09-25T18:56:28.547135] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-09-25T18:56:28.814742] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:28.901443] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-25T18:56:28.926060] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-25T18:56:28.993890] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-25T18:56:29.060194] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-25T18:56:29.228072] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:29.323133] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-25T18:56:29.369276] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-25T18:56:29.412682] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:29.427696] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-25T18:56:29.458628] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-25T18:56:29.468297] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-25T18:56:29.506157] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-25T18:56:29.622295] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-25T18:56:29.643378] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-25T18:56:29.792191] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:29.880964] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-25T18:56:30.433535] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:30.473057] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-25T18:56:30.629368] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:30.658270] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T18:56:30.657498] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-25T18:56:30.665932] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:30.670419] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-25T18:56:30.671023] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-25T18:56:31.242837] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T18:56:31.244982] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-25T18:56:31.712719] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T18:56:31.714571] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-25T18:56:32.035834] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T18:56:32.044693] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-25T18:56:32.157173] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T18:56:32.249954] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T18:56:32.545086] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T18:56:32.688750] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-25T18:56:33.113584] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-25T18:56:33.460495] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T18:56:33.488736] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-25T18:56:33.846111] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T18:56:34.288837] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-25T18:56:35.088800] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-25T18:56:35.888830] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-25T18:56:35.962009] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T18:56:36.182402] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-25T18:56:36.688765] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-25T18:56:37.406547] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-25T18:56:37.488852] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-25T18:56:37.860046] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T18:56:38.288733] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-25T18:56:38.599314] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T18:56:38.735283] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-25T18:56:39.088738] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-25T18:56:39.888735] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-25T18:56:40.688749] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-25T18:56:40.961259] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T18:56:40.964381] [INFO ] [REMOTE ] FTWO: Full fetch complete (3484 records). [2025-09-25T18:56:40.964571] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-25T18:56:40.962844] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T18:56:41.355237] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-25T18:56:41.355342] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-25T18:56:41.355487] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-25T18:56:41.355525] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-25T18:56:41.355961] [DEBUG] [LOCAL ] FTWO: Trimmed 3484 records to 1806 (keeping 200 days of data) [2025-09-25T18:56:41.368272] [DEBUG] [LOCAL ] FTWO: Primary data saved (1806 records). [2025-09-25T18:56:41.368401] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-25T18:56:41.368504] [INFO ] [MAIN ] Update Progress: 881/2372 symbols completed. FTWO took 14.2s. Estimated remaining: 3h 17m 24s. Rate: 7.6 symbols/min [2025-09-25T18:56:41.493888] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-25T18:56:41.553218] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:56:41.598833] [DEBUG] [LOCAL ] FUL: Loaded 32962 existing records from primary storage. [2025-09-25T18:56:41.599047] [INFO ] [MAIN ] FUL: Loaded 32962 existing records. [2025-09-25T18:56:41.801092] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:56:41.801396] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-25T18:56:41.801445] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-25T18:56:41.801751] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-25T18:56:41.801811] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-25T18:56:42.176425] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:56:42.200190] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T18:56:42.288690] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-25T18:56:43.088733] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-25T18:56:43.484528] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T18:56:43.812136] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-25T18:56:43.888730] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-25T18:56:44.688758] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-25T18:56:44.916607] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T18:56:45.488759] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-25T18:56:46.008286] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T18:56:46.293875] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-25T18:56:46.308184] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T18:56:46.934068] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:56:47.088761] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-25T18:56:47.888805] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-25T18:56:48.149922] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T18:56:48.402295] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T18:56:48.688759] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-25T18:56:49.437288] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T18:56:49.488682] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-25T18:56:50.288810] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-25T18:56:50.619343] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T18:56:51.087093] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T18:56:51.095960] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-25T18:56:51.680156] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T18:56:51.888728] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-25T18:56:52.688730] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-25T18:56:52.739970] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T18:56:53.166987] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T18:56:53.488736] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-25T18:56:54.159386] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T18:56:54.288728] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-25T18:56:55.091330] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-25T18:56:55.094012] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T18:56:55.888736] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-25T18:56:56.113256] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T18:56:56.693852] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-25T18:56:56.722008] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T18:56:56.977047] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T18:56:57.488772] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-25T18:56:58.288751] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-25T18:56:59.026286] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-25T18:56:59.088690] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-25T18:56:59.275741] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T18:56:59.287015] [INFO ] [REMOTE ] FTV: Full fetch complete (76287 records). [2025-09-25T18:56:59.287249] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-25T18:56:59.372512] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T18:56:59.734552] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-25T18:56:59.734705] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-25T18:56:59.736548] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-25T18:56:59.740319] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-25T18:56:59.743114] [DEBUG] [LOCAL ] FTV: Trimmed 76287 records to 53303 (keeping 200 days of data) [2025-09-25T18:56:59.923254] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-25T18:57:00.095394] [DEBUG] [LOCAL ] FTV: Primary data saved (53303 records). [2025-09-25T18:57:00.095601] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-25T18:57:00.095754] [INFO ] [MAIN ] Update Progress: 882/2372 symbols completed. FTV took 32.9s. Estimated remaining: 3h 17m 34s. Rate: 7.5 symbols/min [2025-09-25T18:57:00.288107] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:00.340499] [DEBUG] [LOCAL ] FUN: Loaded 51571 existing records from primary storage. [2025-09-25T18:57:00.340707] [INFO ] [MAIN ] FUN: Loaded 51571 existing records. [2025-09-25T18:57:00.543598] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:00.543955] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-25T18:57:00.544010] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-25T18:57:00.544420] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-25T18:57:00.544481] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-25T18:57:00.703451] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-25T18:57:00.953744] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:01.249394] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T18:57:01.251025] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T18:57:01.488739] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-25T18:57:01.966430] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T18:57:01.974782] [INFO ] [REMOTE ] FTS: Full fetch complete (60092 records). [2025-09-25T18:57:01.974965] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-25T18:57:02.295116] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-25T18:57:02.397765] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-25T18:57:02.397923] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-25T18:57:02.398753] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-25T18:57:02.398818] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-25T18:57:02.400125] [DEBUG] [LOCAL ] FTS: Trimmed 60092 records to 42414 (keeping 200 days of data) [2025-09-25T18:57:02.649365] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T18:57:02.709293] [DEBUG] [LOCAL ] FTS: Primary data saved (42414 records). [2025-09-25T18:57:02.709486] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-25T18:57:02.709611] [INFO ] [MAIN ] Update Progress: 883/2372 symbols completed. FTS took 35.5s. Estimated remaining: 3h 17m 17s. Rate: 7.5 symbols/min [2025-09-25T18:57:02.894532] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:02.918923] [DEBUG] [LOCAL ] FVR: Loaded 22164 existing records from primary storage. [2025-09-25T18:57:02.919064] [INFO ] [MAIN ] FVR: Loaded 22164 existing records. [2025-09-25T18:57:03.095792] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-25T18:57:03.101707] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:03.102882] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-25T18:57:03.102935] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-25T18:57:03.103203] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-25T18:57:03.103261] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-25T18:57:03.477845] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:03.888707] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-25T18:57:03.991724] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T18:57:04.688739] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-25T18:57:05.172877] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T18:57:05.418397] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-25T18:57:05.488742] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-25T18:57:05.876684] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T18:57:06.288738] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-25T18:57:07.088755] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-25T18:57:07.888718] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-25T18:57:08.043770] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-25T18:57:08.265584] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T18:57:08.406062] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T18:57:08.688733] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-25T18:57:09.374951] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T18:57:09.381832] [INFO ] [REMOTE ] FUL: Full fetch complete (47036 records). [2025-09-25T18:57:09.381950] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-25T18:57:09.493936] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-25T18:57:09.775668] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-25T18:57:09.775769] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-25T18:57:09.776486] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-25T18:57:09.776528] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-25T18:57:09.777574] [DEBUG] [LOCAL ] FUL: Trimmed 47036 records to 33285 (keeping 200 days of data) [2025-09-25T18:57:09.983495] [DEBUG] [LOCAL ] FUL: Primary data saved (33285 records). [2025-09-25T18:57:09.983689] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-25T18:57:09.983799] [INFO ] [MAIN ] Update Progress: 884/2372 symbols completed. FUL took 28.6s. Estimated remaining: 3h 17m 8s. Rate: 7.5 symbols/min [2025-09-25T18:57:10.155966] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:10.194354] [DEBUG] [LOCAL ] FVRR: Loaded 40192 existing records from primary storage. [2025-09-25T18:57:10.194525] [INFO ] [MAIN ] FVRR: Loaded 40192 existing records. [2025-09-25T18:57:10.298964] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-25T18:57:10.385190] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:10.385557] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-25T18:57:10.385611] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-25T18:57:10.385962] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-25T18:57:10.386023] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-25T18:57:10.691127] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T18:57:10.774476] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:11.088759] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-25T18:57:11.319709] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-25T18:57:11.330222] [INFO ] [REMOTE ] FUBO: Full fetch complete (77753 records). [2025-09-25T18:57:11.330380] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-25T18:57:11.783009] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-25T18:57:11.783172] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-25T18:57:11.784194] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-25T18:57:11.784450] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-25T18:57:11.786042] [DEBUG] [LOCAL ] FUBO: Trimmed 77753 records to 54088 (keeping 200 days of data) [2025-09-25T18:57:11.888784] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-25T18:57:12.024436] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T18:57:12.128849] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T18:57:12.160459] [DEBUG] [LOCAL ] FUBO: Primary data saved (54088 records). [2025-09-25T18:57:12.160619] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-25T18:57:12.160744] [INFO ] [MAIN ] Update Progress: 885/2372 symbols completed. FUBO took 45.0s. Estimated remaining: 3h 16m 51s. Rate: 7.6 symbols/min [2025-09-25T18:57:12.331808] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:12.335788] [DEBUG] [LOCAL ] FXED: Loaded 1228 existing records from primary storage. [2025-09-25T18:57:12.335866] [INFO ] [MAIN ] FXED: Loaded 1228 existing records. [2025-09-25T18:57:12.522536] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:12.522804] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-25T18:57:12.522854] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-25T18:57:12.523077] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-25T18:57:12.523138] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-25T18:57:12.696737] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-25T18:57:12.919314] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:13.488700] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-25T18:57:13.527722] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T18:57:13.863585] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-25T18:57:14.288718] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-25T18:57:14.395682] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T18:57:15.088790] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-25T18:57:15.891830] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-25T18:57:15.896372] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T18:57:16.688688] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-25T18:57:16.817311] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T18:57:17.054575] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T18:57:17.488704] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-25T18:57:17.922831] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T18:57:18.288730] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-25T18:57:18.400757] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T18:57:18.627282] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-25T18:57:19.088740] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-25T18:57:19.429198] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-25T18:57:19.888732] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-25T18:57:20.688732] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-25T18:57:21.488732] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-25T18:57:21.556197] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T18:57:21.993157] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T18:57:22.242766] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T18:57:22.288664] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-25T18:57:23.088757] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-25T18:57:23.540412] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T18:57:23.570095] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T18:57:23.888719] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-25T18:57:24.688791] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-25T18:57:25.128880] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T18:57:25.410223] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T18:57:25.488723] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-25T18:57:26.288759] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-25T18:57:26.755102] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T18:57:26.909337] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T18:57:27.088674] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-25T18:57:27.888748] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-25T18:57:28.688694] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-25T18:57:28.763872] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T18:57:28.820303] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T18:57:29.488727] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-25T18:57:29.923898] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T18:57:30.288692] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-25T18:57:30.332922] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T18:57:30.715347] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-25T18:57:30.716267] [INFO ] [REMOTE ] FXED: Full fetch complete (1776 records). [2025-09-25T18:57:30.716340] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-25T18:57:30.716802] [FATAL] [VALIDATOR ] FXED: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T18:57:30.716896] [FATAL] [MAIN ] FXED: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:57:30.716965] [WARN ] [MAIN ] FXED: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:57:30.717012] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-25T18:57:30.717071] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-25T18:57:30.717107] [INFO ] [LOCAL ] FXED: Starting deletion of derivative data. [2025-09-25T18:57:30.717434] [DEBUG] [LOCAL ] FXED: Deleted derivative data file. [2025-09-25T18:57:30.717563] [INFO ] [MAIN ] Update Progress: 886/2372 symbols completed. FXED took 18.6s. Estimated remaining: 3h 17m 0s. Rate: 7.5 symbols/min [2025-09-25T18:57:30.895104] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:30.965799] [DEBUG] [LOCAL ] G: Loaded 49791 existing records from primary storage. [2025-09-25T18:57:30.966063] [INFO ] [MAIN ] G: Loaded 49791 existing records. [2025-09-25T18:57:31.094030] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-25T18:57:31.171254] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:31.171585] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-25T18:57:31.171637] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-25T18:57:31.172047] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-25T18:57:31.172106] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-25T18:57:31.572507] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:31.888754] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-25T18:57:32.688767] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-25T18:57:32.963118] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T18:57:33.468155] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T18:57:33.488676] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-25T18:57:33.527694] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T18:57:34.288775] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-25T18:57:35.088799] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-25T18:57:35.171753] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T18:57:35.651942] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T18:57:35.660250] [INFO ] [REMOTE ] FVRR: Full fetch complete (58773 records). [2025-09-25T18:57:35.660465] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-25T18:57:35.901064] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-25T18:57:36.052620] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T18:57:36.135307] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-25T18:57:36.135429] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-25T18:57:36.136333] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-25T18:57:36.136433] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-25T18:57:36.138049] [DEBUG] [LOCAL ] FVRR: Trimmed 58773 records to 40472 (keeping 200 days of data) [2025-09-25T18:57:36.388733] [DEBUG] [LOCAL ] FVRR: Primary data saved (40472 records). [2025-09-25T18:57:36.388971] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-25T18:57:36.389240] [INFO ] [MAIN ] Update Progress: 887/2372 symbols completed. FVRR took 26.4s. Estimated remaining: 3h 16m 49s. Rate: 7.5 symbols/min [2025-09-25T18:57:36.616112] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:36.648558] [DEBUG] [LOCAL ] GAB: Loaded 27984 existing records from primary storage. [2025-09-25T18:57:36.648733] [INFO ] [MAIN ] GAB: Loaded 27984 existing records. [2025-09-25T18:57:36.693931] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-25T18:57:36.847561] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:36.847897] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-25T18:57:36.847974] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-25T18:57:36.848306] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-25T18:57:36.848386] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-25T18:57:37.240086] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:37.488781] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-25T18:57:37.799685] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T18:57:37.836614] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T18:57:38.288768] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-25T18:57:38.887835] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T18:57:39.088733] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-25T18:57:39.892256] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-25T18:57:39.900346] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T18:57:39.913356] [INFO ] [REMOTE ] FUN: Full fetch complete (72533 records). [2025-09-25T18:57:39.913535] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-25T18:57:40.321068] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T18:57:40.351805] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-25T18:57:40.351868] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-25T18:57:40.352786] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-25T18:57:40.352852] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-25T18:57:40.357119] [DEBUG] [LOCAL ] FUN: Trimmed 72533 records to 51960 (keeping 200 days of data) [2025-09-25T18:57:40.672683] [DEBUG] [LOCAL ] FUN: Primary data saved (51960 records). [2025-09-25T18:57:40.672848] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-25T18:57:40.672940] [INFO ] [MAIN ] Update Progress: 888/2372 symbols completed. FUN took 40.6s. Estimated remaining: 3h 16m 35s. Rate: 7.5 symbols/min [2025-09-25T18:57:40.694471] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-25T18:57:40.850141] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:40.856497] [DEBUG] [LOCAL ] GAM: Loaded 4119 existing records from primary storage. [2025-09-25T18:57:40.856611] [INFO ] [MAIN ] GAM: Loaded 4119 existing records. [2025-09-25T18:57:41.044209] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:41.044496] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-25T18:57:41.044553] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-25T18:57:41.044740] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-25T18:57:41.044801] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-25T18:57:41.431488] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:41.479836] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T18:57:41.489356] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-25T18:57:41.894101] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-25T18:57:42.281468] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T18:57:42.288670] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-25T18:57:42.727325] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T18:57:43.088731] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-25T18:57:43.752198] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T18:57:43.888710] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-25T18:57:44.688720] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-25T18:57:45.269710] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T18:57:45.488787] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-25T18:57:46.288708] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-25T18:57:46.425309] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T18:57:46.925182] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T18:57:47.088800] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-25T18:57:47.439942] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T18:57:47.447078] [INFO ] [REMOTE ] FVR: Full fetch complete (30586 records). [2025-09-25T18:57:47.447353] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-25T18:57:47.889131] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-25T18:57:47.899950] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-25T18:57:47.900137] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-25T18:57:47.901306] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-25T18:57:47.901518] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-25T18:57:47.903151] [DEBUG] [LOCAL ] FVR: Trimmed 30586 records to 22268 (keeping 200 days of data) [2025-09-25T18:57:48.032310] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T18:57:48.086996] [DEBUG] [LOCAL ] FVR: Primary data saved (22268 records). [2025-09-25T18:57:48.087178] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-25T18:57:48.087331] [INFO ] [MAIN ] Update Progress: 889/2372 symbols completed. FVR took 45.4s. Estimated remaining: 3h 16m 26s. Rate: 7.5 symbols/min [2025-09-25T18:57:48.263119] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:57:48.328444] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-25T18:57:48.328702] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-25T18:57:48.519071] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:57:48.519399] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-25T18:57:48.519457] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-25T18:57:48.519793] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-25T18:57:48.519854] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-25T18:57:48.637960] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T18:57:48.693860] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-25T18:57:48.910877] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:57:49.488743] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-25T18:57:50.091159] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T18:57:50.288749] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-25T18:57:51.097219] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-25T18:57:51.102985] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T18:57:51.888703] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-25T18:57:51.934144] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T18:57:52.062402] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T18:57:52.688757] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-25T18:57:53.308994] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T18:57:53.488728] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-25T18:57:54.135808] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T18:57:54.288755] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-25T18:57:55.094519] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-25T18:57:55.107937] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T18:57:55.888733] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-25T18:57:55.963173] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T18:57:56.264783] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T18:57:56.688764] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-25T18:57:57.319256] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T18:57:57.461908] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T18:57:57.488691] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-25T18:57:58.288765] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-25T18:57:58.934861] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T18:57:59.088767] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-25T18:57:59.567344] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T18:57:59.888799] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-25T18:58:00.494374] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T18:58:00.688701] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-25T18:58:00.784839] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T18:58:01.332410] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T18:58:01.488724] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-25T18:58:02.288729] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-25T18:58:03.088737] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-25T18:58:03.349288] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T18:58:03.360067] [INFO ] [REMOTE ] G: Full fetch complete (71585 records). [2025-09-25T18:58:03.360221] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-25T18:58:03.778229] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-25T18:58:03.778356] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-25T18:58:03.779407] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-25T18:58:03.779474] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-25T18:58:03.781877] [DEBUG] [LOCAL ] G: Trimmed 71585 records to 50170 (keeping 200 days of data) [2025-09-25T18:58:03.889193] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-25T18:58:04.109546] [DEBUG] [LOCAL ] G: Primary data saved (50170 records). [2025-09-25T18:58:04.109735] [INFO ] [MAIN ] G: Full history saved. [2025-09-25T18:58:04.110954] [INFO ] [MAIN ] Update Progress: 890/2372 symbols completed. G took 33.4s. Estimated remaining: 3h 16m 31s. Rate: 7.5 symbols/min [2025-09-25T18:58:04.289985] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:04.308137] [DEBUG] [LOCAL ] GATX: No existing data file found in primary storage. [2025-09-25T18:58:04.308460] [WARN ] [MAIN ] GATX: No existing data found, performing full refresh instead. [2025-09-25T18:58:04.308957] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-25T18:58:04.309206] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-25T18:58:04.309354] [DEBUG] [LOCAL ] GATX: No primary data file found to delete. [2025-09-25T18:58:04.309430] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-25T18:58:04.352064] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T18:58:04.519113] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T18:58:04.709862] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-25T18:58:04.715379] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-25T18:58:04.765218] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:05.316093] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T18:58:05.317279] [INFO ] [REMOTE ] GAM: Full fetch complete (6854 records). [2025-09-25T18:58:05.317350] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-25T18:58:05.498847] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-25T18:58:05.694211] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-25T18:58:05.694302] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-25T18:58:05.694496] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-25T18:58:05.694535] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-25T18:58:05.694987] [DEBUG] [LOCAL ] GAM: Trimmed 6854 records to 4142 (keeping 200 days of data) [2025-09-25T18:58:05.719347] [DEBUG] [LOCAL ] GAM: Primary data saved (4142 records). [2025-09-25T18:58:05.719434] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-25T18:58:05.719525] [INFO ] [MAIN ] Update Progress: 891/2372 symbols completed. GAM took 25.0s. Estimated remaining: 3h 16m 13s. Rate: 7.5 symbols/min [2025-09-25T18:58:05.896424] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:05.912773] [DEBUG] [LOCAL ] GBAB: Loaded 12998 existing records from primary storage. [2025-09-25T18:58:05.912950] [INFO ] [MAIN ] GBAB: Loaded 12998 existing records. [2025-09-25T18:58:06.102131] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:58:06.102422] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-25T18:58:06.102472] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-25T18:58:06.102738] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-25T18:58:06.102815] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-25T18:58:06.294270] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-25T18:58:06.497088] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:07.080543] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T18:58:07.088214] [INFO ] [REMOTE ] GAB: Full fetch complete (39492 records). [2025-09-25T18:58:07.088512] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-25T18:58:07.088716] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-25T18:58:07.217150] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T18:58:07.507553] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-25T18:58:07.507673] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-25T18:58:07.508423] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-25T18:58:07.508468] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-25T18:58:07.510174] [DEBUG] [LOCAL ] GAB: Trimmed 39492 records to 28167 (keeping 200 days of data) [2025-09-25T18:58:07.698063] [DEBUG] [LOCAL ] GAB: Primary data saved (28167 records). [2025-09-25T18:58:07.698284] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-25T18:58:07.698434] [INFO ] [MAIN ] Update Progress: 892/2372 symbols completed. GAB took 31.3s. Estimated remaining: 3h 15m 55s. Rate: 7.6 symbols/min [2025-09-25T18:58:07.873439] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:07.888741] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-25T18:58:07.920195] [DEBUG] [LOCAL ] GBCI: Loaded 40080 existing records from primary storage. [2025-09-25T18:58:07.920358] [INFO ] [MAIN ] GBCI: Loaded 40080 existing records. [2025-09-25T18:58:08.108003] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:58:08.108354] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-25T18:58:08.108425] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-25T18:58:08.108772] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-25T18:58:08.108848] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-25T18:58:08.425041] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T18:58:08.522315] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:08.688777] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-25T18:58:08.890337] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T18:58:09.488719] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-25T18:58:10.288743] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-25T18:58:10.334008] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T18:58:10.591155] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T18:58:11.088734] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-25T18:58:11.723164] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T18:58:11.888751] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-25T18:58:12.105555] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T18:58:12.688730] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-25T18:58:13.383328] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T18:58:13.488674] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-25T18:58:13.898940] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T18:58:14.288758] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-25T18:58:15.008040] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T18:58:15.088714] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-25T18:58:15.888699] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-25T18:58:16.168164] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T18:58:16.605493] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T18:58:16.693880] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-25T18:58:16.701138] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T18:58:17.488772] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-25T18:58:18.253075] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T18:58:18.288705] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-25T18:58:18.561090] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T18:58:19.088737] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-25T18:58:19.888734] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-25T18:58:20.124553] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T18:58:20.600790] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T18:58:20.656214] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T18:58:20.688661] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-25T18:58:21.488738] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-25T18:58:21.618508] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T18:58:22.247823] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T18:58:22.288728] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-25T18:58:22.979272] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T18:58:23.088740] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-25T18:58:23.894976] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-25T18:58:23.896716] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T18:58:24.688758] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-25T18:58:25.202937] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T18:58:25.207925] [INFO ] [REMOTE ] GATX: Full fetch complete (25398 records). [2025-09-25T18:58:25.208017] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-25T18:58:25.493920] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-25T18:58:25.656082] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-25T18:58:25.656177] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-25T18:58:25.657007] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-25T18:58:25.657116] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-25T18:58:25.658057] [DEBUG] [LOCAL ] GATX: Trimmed 25398 records to 18290 (keeping 200 days of data) [2025-09-25T18:58:25.731554] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T18:58:25.798150] [DEBUG] [LOCAL ] GATX: Primary data saved (18290 records). [2025-09-25T18:58:25.798327] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-25T18:58:25.798414] [INFO ] [MAIN ] Update Progress: 893/2372 symbols completed. GATX took 21.7s. Estimated remaining: 3h 16m 4s. Rate: 7.5 symbols/min [2025-09-25T18:58:25.977184] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:25.977416] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-25T18:58:25.977471] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-25T18:58:25.977616] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-25T18:58:25.977702] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-25T18:58:25.977771] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-25T18:58:25.977806] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-25T18:58:26.293878] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-25T18:58:26.356922] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:27.088702] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-25T18:58:27.177227] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T18:58:27.371391] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T18:58:27.553113] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T18:58:27.888749] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-25T18:58:28.688805] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-25T18:58:29.332681] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T18:58:29.373909] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T18:58:29.488708] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-25T18:58:30.288783] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-25T18:58:30.571144] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-25T18:58:31.003255] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T18:58:31.088752] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-25T18:58:31.332256] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-25T18:58:31.888732] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-25T18:58:32.245491] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-25T18:58:32.688770] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-25T18:58:33.075709] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T18:58:33.488767] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-25T18:58:34.288727] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-25T18:58:34.445345] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T18:58:35.088733] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-25T18:58:35.888733] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-25T18:58:36.235825] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T18:58:36.247955] [INFO ] [REMOTE ] GAP: Full fetch complete (77634 records). [2025-09-25T18:58:36.248158] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-25T18:58:36.603510] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T18:58:36.602089] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T18:58:36.691015] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-25T18:58:36.715866] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-25T18:58:36.715986] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-25T18:58:36.717093] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-25T18:58:36.717164] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-25T18:58:36.719521] [DEBUG] [LOCAL ] GAP: Trimmed 77634 records to 54045 (keeping 200 days of data) [2025-09-25T18:58:37.024297] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-25T18:58:37.071353] [DEBUG] [LOCAL ] GAP: Primary data saved (54045 records). [2025-09-25T18:58:37.071522] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-25T18:58:37.073004] [INFO ] [MAIN ] Update Progress: 894/2372 symbols completed. GAP took 49.0s. Estimated remaining: 3h 16m 1s. Rate: 7.5 symbols/min [2025-09-25T18:58:37.259577] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:37.308356] [DEBUG] [LOCAL ] GBTG: Loaded 40267 existing records from primary storage. [2025-09-25T18:58:37.308513] [INFO ] [MAIN ] GBTG: Loaded 40267 existing records. [2025-09-25T18:58:37.493851] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-25T18:58:37.500808] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:58:37.501065] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-25T18:58:37.501116] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-25T18:58:37.501432] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-25T18:58:37.501493] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-25T18:58:37.902062] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:38.288735] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-25T18:58:39.088742] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-25T18:58:39.212365] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T18:58:39.220082] [INFO ] [REMOTE ] GBCI: Full fetch complete (57904 records). [2025-09-25T18:58:39.220208] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-25T18:58:39.437101] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-25T18:58:39.645353] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-25T18:58:39.645557] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-25T18:58:39.646498] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-25T18:58:39.646699] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-25T18:58:39.648382] [DEBUG] [LOCAL ] GBCI: Trimmed 57904 records to 40385 (keeping 200 days of data) [2025-09-25T18:58:39.673292] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T18:58:39.890884] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-25T18:58:39.927902] [DEBUG] [LOCAL ] GBCI: Primary data saved (40385 records). [2025-09-25T18:58:39.928053] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-25T18:58:39.928149] [INFO ] [MAIN ] Update Progress: 895/2372 symbols completed. GBCI took 32.2s. Estimated remaining: 3h 15m 45s. Rate: 7.5 symbols/min [2025-09-25T18:58:40.115966] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:40.149176] [DEBUG] [LOCAL ] GBX: Loaded 29165 existing records from primary storage. [2025-09-25T18:58:40.149373] [INFO ] [MAIN ] GBX: Loaded 29165 existing records. [2025-09-25T18:58:40.334005] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:58:40.334404] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-25T18:58:40.334467] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-25T18:58:40.334852] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-25T18:58:40.334913] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-25T18:58:40.701986] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-25T18:58:40.707883] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:40.774310] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T18:58:41.488709] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-25T18:58:42.100364] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T18:58:42.288716] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-25T18:58:42.553550] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T18:58:43.088728] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-25T18:58:43.780889] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T18:58:43.888694] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-25T18:58:44.450917] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T18:58:44.688755] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-25T18:58:45.106050] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T18:58:45.488768] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-25T18:58:45.604151] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T18:58:45.607012] [INFO ] [REMOTE ] GBAB: Full fetch complete (20161 records). [2025-09-25T18:58:45.607087] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-25T18:58:45.987180] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-25T18:58:45.987274] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-25T18:58:45.987747] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-25T18:58:45.987810] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-25T18:58:45.988386] [DEBUG] [LOCAL ] GBAB: Trimmed 20161 records to 13056 (keeping 200 days of data) [2025-09-25T18:58:46.070392] [DEBUG] [LOCAL ] GBAB: Primary data saved (13056 records). [2025-09-25T18:58:46.070541] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-25T18:58:46.070666] [INFO ] [MAIN ] Update Progress: 896/2372 symbols completed. GBAB took 40.4s. Estimated remaining: 3h 15m 34s. Rate: 7.5 symbols/min [2025-09-25T18:58:46.249205] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:46.249423] [DEBUG] [LOCAL ] GCI: No existing data file found in primary storage. [2025-09-25T18:58:46.249479] [WARN ] [MAIN ] GCI: No existing data found, performing full refresh instead. [2025-09-25T18:58:46.249687] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-25T18:58:46.249755] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-25T18:58:46.249837] [DEBUG] [LOCAL ] GCI: No primary data file found to delete. [2025-09-25T18:58:46.249884] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-25T18:58:46.293849] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-25T18:58:46.666325] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:46.819603] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-25T18:58:47.045011] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T18:58:47.088669] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-25T18:58:47.888788] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-25T18:58:48.549618] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T18:58:48.688771] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-25T18:58:49.228354] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T18:58:49.230439] [INFO ] [REMOTE ] GBLI: Full fetch complete (1364 records). [2025-09-25T18:58:49.231497] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T18:58:49.231733] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-25T18:58:49.443920] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-25T18:58:49.444194] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T18:58:49.444320] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T18:58:49.444782] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-25T18:58:49.444960] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-25T18:58:49.445054] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-25T18:58:49.445132] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-25T18:58:49.445282] [INFO ] [MAIN ] Update Progress: 897/2372 symbols completed. GBLI took 23.6s. Estimated remaining: 3h 15m 18s. Rate: 7.6 symbols/min [2025-09-25T18:58:49.494050] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-25T18:58:49.640492] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:58:49.668746] [DEBUG] [LOCAL ] GCO: Loaded 25438 existing records from primary storage. [2025-09-25T18:58:49.668926] [INFO ] [MAIN ] GCO: Loaded 25438 existing records. [2025-09-25T18:58:49.850722] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:58:49.851011] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-25T18:58:49.851060] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-25T18:58:49.851418] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-25T18:58:49.851477] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-25T18:58:50.210357] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:58:50.288725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-25T18:58:51.085009] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T18:58:51.095171] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-25T18:58:51.427707] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T18:58:51.888775] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-25T18:58:52.688787] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-25T18:58:52.759964] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T18:58:53.293874] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T18:58:53.488746] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-25T18:58:54.213193] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T18:58:54.288714] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-25T18:58:54.700342] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T18:58:55.088733] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-25T18:58:55.397874] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T18:58:55.888715] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-25T18:58:56.117629] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T18:58:56.688725] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-25T18:58:57.244619] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T18:58:57.488750] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-25T18:58:57.997470] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T18:58:58.288755] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-25T18:58:58.677447] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T18:58:59.088731] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-25T18:58:59.654239] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T18:58:59.888761] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-25T18:59:00.481278] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T18:59:00.688726] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-25T18:59:01.168778] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T18:59:01.488700] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-25T18:59:01.818135] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T18:59:02.288722] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-25T18:59:02.853839] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T18:59:03.088734] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-25T18:59:03.498886] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T18:59:03.888738] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-25T18:59:04.688794] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-25T18:59:04.729458] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T18:59:04.908670] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T18:59:04.917139] [INFO ] [REMOTE ] GBTG: Full fetch complete (56607 records). [2025-09-25T18:59:04.917305] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-25T18:59:05.329189] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-25T18:59:05.329316] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-25T18:59:05.330347] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-25T18:59:05.330420] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-25T18:59:05.332163] [DEBUG] [LOCAL ] GBTG: Trimmed 56607 records to 40531 (keeping 200 days of data) [2025-09-25T18:59:05.501041] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-25T18:59:05.584097] [DEBUG] [LOCAL ] GBTG: Primary data saved (40531 records). [2025-09-25T18:59:05.584248] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-25T18:59:05.584337] [INFO ] [MAIN ] Update Progress: 898/2372 symbols completed. GBTG took 28.5s. Estimated remaining: 3h 15m 24s. Rate: 7.5 symbols/min [2025-09-25T18:59:05.768093] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:05.790136] [DEBUG] [LOCAL ] GCTS: Loaded 19844 existing records from primary storage. [2025-09-25T18:59:05.790278] [INFO ] [MAIN ] GCTS: Loaded 19844 existing records. [2025-09-25T18:59:05.975702] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:05.975993] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-25T18:59:05.976046] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-25T18:59:05.976295] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-25T18:59:05.976354] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-25T18:59:06.289680] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-25T18:59:06.356005] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:06.388362] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T18:59:06.691462] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T18:59:07.088724] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-25T18:59:07.833944] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T18:59:07.888687] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-25T18:59:08.133200] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T18:59:08.688763] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-25T18:59:09.408738] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T18:59:09.488678] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-25T18:59:09.987254] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T18:59:09.992583] [INFO ] [REMOTE ] GCO: Full fetch complete (35855 records). [2025-09-25T18:59:09.992742] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-25T18:59:10.293837] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-25T18:59:10.408573] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-25T18:59:10.408685] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-25T18:59:10.409446] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-25T18:59:10.409488] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-25T18:59:10.410377] [DEBUG] [LOCAL ] GCO: Trimmed 35855 records to 25567 (keeping 200 days of data) [2025-09-25T18:59:10.557149] [DEBUG] [LOCAL ] GCO: Primary data saved (25567 records). [2025-09-25T18:59:10.557306] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-25T18:59:10.557395] [INFO ] [MAIN ] Update Progress: 899/2372 symbols completed. GCO took 21.1s. Estimated remaining: 3h 15m 11s. Rate: 7.5 symbols/min [2025-09-25T18:59:10.735091] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:10.744605] [DEBUG] [LOCAL ] GCV: Loaded 7177 existing records from primary storage. [2025-09-25T18:59:10.744747] [INFO ] [MAIN ] GCV: Loaded 7177 existing records. [2025-09-25T18:59:10.939335] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:10.939820] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-25T18:59:10.939918] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-25T18:59:10.940348] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-25T18:59:10.940438] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-25T18:59:11.064799] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T18:59:11.092548] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-25T18:59:11.364965] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:11.493207] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T18:59:11.888740] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-25T18:59:12.074290] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T18:59:12.688726] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-25T18:59:12.791299] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T18:59:13.488720] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-25T18:59:14.288688] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-25T18:59:14.321066] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T18:59:14.570396] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T18:59:15.088720] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-25T18:59:15.619092] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T18:59:15.624007] [INFO ] [REMOTE ] GBX: Full fetch complete (42683 records). [2025-09-25T18:59:15.624104] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-25T18:59:15.893849] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-25T18:59:16.011608] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-25T18:59:16.011723] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-25T18:59:16.012413] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-25T18:59:16.012455] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-25T18:59:16.013468] [DEBUG] [LOCAL ] GBX: Trimmed 42683 records to 29340 (keeping 200 days of data) [2025-09-25T18:59:16.192711] [DEBUG] [LOCAL ] GBX: Primary data saved (29340 records). [2025-09-25T18:59:16.192867] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-25T18:59:16.192962] [INFO ] [MAIN ] Update Progress: 900/2372 symbols completed. GBX took 36.3s. Estimated remaining: 3h 14m 59s. Rate: 7.5 symbols/min [2025-09-25T18:59:16.482989] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:16.543061] [DEBUG] [LOCAL ] GD: Loaded 47267 existing records from primary storage. [2025-09-25T18:59:16.543386] [INFO ] [MAIN ] GD: Loaded 47267 existing records. [2025-09-25T18:59:16.634581] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T18:59:16.693903] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-25T18:59:16.766620] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:16.767057] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-25T18:59:16.767200] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-25T18:59:16.768070] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-25T18:59:16.768349] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-25T18:59:16.978772] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T18:59:17.203552] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:17.311003] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T18:59:17.488785] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-25T18:59:18.288791] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-25T18:59:19.088793] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-25T18:59:19.401242] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T18:59:19.888731] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-25T18:59:20.042634] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T18:59:20.233616] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T18:59:20.242002] [INFO ] [REMOTE ] GCI: Full fetch complete (63048 records). [2025-09-25T18:59:20.242133] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-25T18:59:20.378810] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T18:59:20.649500] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-25T18:59:20.649629] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-25T18:59:20.650502] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-25T18:59:20.650553] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-25T18:59:20.651849] [DEBUG] [LOCAL ] GCI: Trimmed 63048 records to 44530 (keeping 200 days of data) [2025-09-25T18:59:20.699919] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-25T18:59:20.910267] [DEBUG] [LOCAL ] GCI: Primary data saved (44530 records). [2025-09-25T18:59:20.910432] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-25T18:59:20.910526] [INFO ] [MAIN ] Update Progress: 901/2372 symbols completed. GCI took 34.8s. Estimated remaining: 3h 14m 46s. Rate: 7.6 symbols/min [2025-09-25T18:59:21.086973] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:21.133630] [DEBUG] [LOCAL ] GDDY: Loaded 49705 existing records from primary storage. [2025-09-25T18:59:21.133807] [INFO ] [MAIN ] GDDY: Loaded 49705 existing records. [2025-09-25T18:59:21.319797] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:21.320195] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-25T18:59:21.320256] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-25T18:59:21.320535] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-25T18:59:21.320597] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-25T18:59:21.420613] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T18:59:21.492011] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-25T18:59:21.698176] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:22.288770] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-25T18:59:22.638723] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T18:59:22.850996] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-25T18:59:23.088720] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-25T18:59:23.888787] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-25T18:59:24.333598] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T18:59:24.674715] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T18:59:24.688725] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-25T18:59:25.488718] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-25T18:59:26.058575] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T18:59:26.110776] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T18:59:26.288800] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-25T18:59:27.088712] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-25T18:59:27.179701] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T18:59:27.888729] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-25T18:59:28.688683] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-25T18:59:28.912278] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T18:59:28.943107] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T18:59:29.488709] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-25T18:59:30.106681] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T18:59:30.288766] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-25T18:59:30.721972] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T18:59:30.726890] [INFO ] [REMOTE ] GCTS: Full fetch complete (27008 records). [2025-09-25T18:59:30.727062] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-25T18:59:31.042618] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-25T18:59:31.093954] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-25T18:59:31.132269] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-25T18:59:31.132363] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-25T18:59:31.133001] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-25T18:59:31.133063] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-25T18:59:31.133841] [DEBUG] [LOCAL ] GCTS: Trimmed 27008 records to 19961 (keeping 200 days of data) [2025-09-25T18:59:31.244871] [DEBUG] [LOCAL ] GCTS: Primary data saved (19961 records). [2025-09-25T18:59:31.245039] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-25T18:59:31.245133] [INFO ] [MAIN ] Update Progress: 902/2372 symbols completed. GCTS took 25.7s. Estimated remaining: 3h 14m 42s. Rate: 7.5 symbols/min [2025-09-25T18:59:31.415868] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:31.422761] [DEBUG] [LOCAL ] GDIV: Loaded 3686 existing records from primary storage. [2025-09-25T18:59:31.422887] [INFO ] [MAIN ] GDIV: Loaded 3686 existing records. [2025-09-25T18:59:31.612182] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:31.612543] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-25T18:59:31.612613] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-25T18:59:31.612855] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-25T18:59:31.612913] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-25T18:59:31.891544] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-25T18:59:31.973132] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:32.688725] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-25T18:59:32.903952] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T18:59:33.416677] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T18:59:33.488739] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-25T18:59:33.677407] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T18:59:34.288735] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-25T18:59:34.960499] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T18:59:35.089270] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-25T18:59:35.103109] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T18:59:35.888708] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-25T18:59:36.008214] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T18:59:36.010591] [INFO ] [REMOTE ] GCV: Full fetch complete (9290 records). [2025-09-25T18:59:36.010907] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-25T18:59:36.384451] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-25T18:59:36.384532] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-25T18:59:36.384783] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-25T18:59:36.384876] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-25T18:59:36.385350] [DEBUG] [LOCAL ] GCV: Trimmed 9290 records to 7245 (keeping 200 days of data) [2025-09-25T18:59:36.432878] [DEBUG] [LOCAL ] GCV: Primary data saved (7245 records). [2025-09-25T18:59:36.433031] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-25T18:59:36.433162] [INFO ] [MAIN ] Update Progress: 903/2372 symbols completed. GCV took 25.9s. Estimated remaining: 3h 14m 30s. Rate: 7.6 symbols/min [2025-09-25T18:59:36.603417] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:36.609295] [DEBUG] [LOCAL ] GDL: Loaded 2521 existing records from primary storage. [2025-09-25T18:59:36.609390] [INFO ] [MAIN ] GDL: Loaded 2521 existing records. [2025-09-25T18:59:36.694061] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-25T18:59:36.800610] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:36.800924] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-25T18:59:36.800987] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-25T18:59:36.801278] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-09-25T18:59:36.801347] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-25T18:59:37.163735] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:37.325410] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T18:59:37.488719] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-25T18:59:37.609608] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T18:59:38.062705] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T18:59:38.288777] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-25T18:59:39.088732] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-25T18:59:39.657056] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T18:59:39.888696] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-25T18:59:39.983314] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T18:59:40.342779] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-25T18:59:40.688787] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-25T18:59:41.180766] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-25T18:59:41.488759] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-25T18:59:42.288778] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-25T18:59:42.778310] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T18:59:43.088753] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-25T18:59:43.528365] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T18:59:43.610615] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T18:59:43.888773] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-25T18:59:44.688754] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-25T18:59:45.239111] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-25T18:59:45.488738] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-25T18:59:45.648139] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T18:59:45.930263] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T18:59:46.288742] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-25T18:59:47.088736] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-25T18:59:47.495146] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-25T18:59:47.888720] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-25T18:59:48.037633] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T18:59:48.239425] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T18:59:48.688748] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-25T18:59:49.240236] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T18:59:49.488741] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-25T18:59:50.288729] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-25T18:59:50.721136] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T18:59:51.088730] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-25T18:59:51.311685] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T18:59:51.559696] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T18:59:51.888742] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-25T18:59:52.446228] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T18:59:52.447733] [INFO ] [REMOTE ] GDIV: Full fetch complete (5453 records). [2025-09-25T18:59:52.447810] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-25T18:59:52.693912] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-25T18:59:52.841097] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-25T18:59:52.841183] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-25T18:59:52.841368] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-25T18:59:52.841452] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-25T18:59:52.842349] [DEBUG] [LOCAL ] GDIV: Trimmed 5453 records to 3707 (keeping 200 days of data) [2025-09-25T18:59:52.868381] [DEBUG] [LOCAL ] GDIV: Primary data saved (3707 records). [2025-09-25T18:59:52.868459] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-25T18:59:52.868673] [INFO ] [MAIN ] Update Progress: 904/2372 symbols completed. GDIV took 21.6s. Estimated remaining: 3h 14m 36s. Rate: 7.5 symbols/min [2025-09-25T18:59:53.044514] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T18:59:53.058277] [DEBUG] [LOCAL ] GDO: Loaded 6037 existing records from primary storage. [2025-09-25T18:59:53.058418] [INFO ] [MAIN ] GDO: Loaded 6037 existing records. [2025-09-25T18:59:53.244333] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T18:59:53.244611] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-25T18:59:53.244690] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-25T18:59:53.244914] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-25T18:59:53.244987] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-25T18:59:53.493892] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-25T18:59:53.643080] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T18:59:54.004340] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T18:59:54.288695] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-25T18:59:54.655738] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T18:59:55.088764] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-25T18:59:55.888725] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-25T18:59:55.944259] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T18:59:56.049497] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T18:59:56.688751] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-25T18:59:57.402286] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T18:59:57.478596] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T18:59:57.488761] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-25T18:59:57.967731] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T18:59:58.288737] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-25T18:59:59.088749] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-25T18:59:59.888723] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-25T19:00:00.182904] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T19:00:00.193384] [INFO ] [REMOTE ] GD: Full fetch complete (70503 records). [2025-09-25T19:00:00.193577] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-25T19:00:00.404435] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-25T19:00:00.650544] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-25T19:00:00.650701] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-25T19:00:00.652307] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-25T19:00:00.652409] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-25T19:00:00.683709] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:00:00.693833] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-25T19:00:00.694170] [DEBUG] [LOCAL ] GD: Trimmed 70503 records to 47620 (keeping 200 days of data) [2025-09-25T19:00:01.008126] [DEBUG] [LOCAL ] GD: Primary data saved (47620 records). [2025-09-25T19:00:01.008288] [INFO ] [MAIN ] GD: Full history saved. [2025-09-25T19:00:01.008408] [INFO ] [MAIN ] Update Progress: 905/2372 symbols completed. GD took 44.8s. Estimated remaining: 3h 14m 28s. Rate: 7.5 symbols/min [2025-09-25T19:00:01.188931] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:01.236701] [DEBUG] [LOCAL ] GDOT: Loaded 38669 existing records from primary storage. [2025-09-25T19:00:01.236870] [INFO ] [MAIN ] GDOT: Loaded 38669 existing records. [2025-09-25T19:00:01.446528] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:01.446982] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-25T19:00:01.447044] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-25T19:00:01.447323] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-25T19:00:01.447384] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-25T19:00:01.495308] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-25T19:00:01.795673] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T19:00:01.836383] [INFO ] [REMOTE ] GDL: Full fetch complete (3675 records). [2025-09-25T19:00:01.837996] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-25T19:00:01.862936] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:02.230970] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T19:00:02.297806] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-25T19:00:02.328536] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-09-25T19:00:02.328679] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-09-25T19:00:02.328897] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-09-25T19:00:02.328961] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-09-25T19:00:02.329518] [DEBUG] [LOCAL ] GDL: Trimmed 3675 records to 2556 (keeping 200 days of data) [2025-09-25T19:00:02.348091] [DEBUG] [LOCAL ] GDL: Primary data saved (2556 records). [2025-09-25T19:00:02.348271] [INFO ] [MAIN ] GDL: Full history saved. [2025-09-25T19:00:02.348395] [INFO ] [MAIN ] Update Progress: 906/2372 symbols completed. GDL took 25.9s. Estimated remaining: 3h 14m 9s. Rate: 7.6 symbols/min [2025-09-25T19:00:02.547152] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:02.587213] [DEBUG] [LOCAL ] GDV: Loaded 19752 existing records from primary storage. [2025-09-25T19:00:02.587436] [INFO ] [MAIN ] GDV: Loaded 19752 existing records. [2025-09-25T19:00:02.790980] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:02.791312] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-25T19:00:02.791366] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-25T19:00:02.791635] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-25T19:00:02.791739] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-25T19:00:03.099725] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-25T19:00:03.250128] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:03.888776] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-25T19:00:04.133760] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T19:00:04.154538] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T19:00:04.609941] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T19:00:04.688772] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-25T19:00:05.488826] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-25T19:00:05.761126] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T19:00:06.288778] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-25T19:00:06.380042] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T19:00:07.088762] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-25T19:00:07.888708] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-25T19:00:08.130420] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T19:00:08.154178] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T19:00:08.688745] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-25T19:00:09.336881] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T19:00:09.488689] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-25T19:00:09.815926] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-25T19:00:10.288757] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-25T19:00:11.088733] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-25T19:00:11.423002] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:00:11.433415] [INFO ] [REMOTE ] GDDY: Full fetch complete (71217 records). [2025-09-25T19:00:11.433613] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-25T19:00:11.590167] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T19:00:11.810742] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T19:00:11.902388] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-25T19:00:11.898393] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-25T19:00:11.902664] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-25T19:00:11.903900] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-25T19:00:11.903996] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-25T19:00:11.909736] [DEBUG] [LOCAL ] GDDY: Trimmed 71217 records to 50073 (keeping 200 days of data) [2025-09-25T19:00:12.253248] [DEBUG] [LOCAL ] GDDY: Primary data saved (50073 records). [2025-09-25T19:00:12.253458] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-25T19:00:12.253624] [INFO ] [MAIN ] Update Progress: 907/2372 symbols completed. GDDY took 51.3s. Estimated remaining: 3h 14m 4s. Rate: 7.5 symbols/min [2025-09-25T19:00:12.426154] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:12.484985] [DEBUG] [LOCAL ] GE: Loaded 53713 existing records from primary storage. [2025-09-25T19:00:12.485177] [INFO ] [MAIN ] GE: Loaded 53713 existing records. [2025-09-25T19:00:12.692292] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-25T19:00:12.692745] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:12.694559] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-25T19:00:12.694760] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-25T19:00:12.695202] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-25T19:00:12.695274] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-25T19:00:13.108632] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:13.323072] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:00:13.405223] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T19:00:13.488687] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-25T19:00:14.288793] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-25T19:00:14.536030] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T19:00:15.088734] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-25T19:00:15.521679] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:00:15.888749] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-25T19:00:16.499085] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T19:00:16.688801] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-25T19:00:17.341925] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-25T19:00:17.488737] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-25T19:00:18.288749] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-25T19:00:18.374203] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T19:00:18.630912] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T19:00:18.912077] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T19:00:19.088733] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-25T19:00:19.888739] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-25T19:00:20.688790] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-25T19:00:21.209614] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T19:00:21.321920] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T19:00:21.488751] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-25T19:00:21.678144] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T19:00:22.288750] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-25T19:00:23.088755] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-25T19:00:23.197187] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T19:00:23.201149] [INFO ] [REMOTE ] GDV: Full fetch complete (28836 records). [2025-09-25T19:00:23.216054] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-25T19:00:23.228509] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T19:00:23.625160] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-25T19:00:23.625289] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-25T19:00:23.626139] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-25T19:00:23.626203] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-25T19:00:23.627028] [DEBUG] [LOCAL ] GDV: Trimmed 28836 records to 19887 (keeping 200 days of data) [2025-09-25T19:00:23.765704] [DEBUG] [LOCAL ] GDV: Primary data saved (19887 records). [2025-09-25T19:00:23.765877] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-25T19:00:23.765975] [INFO ] [MAIN ] Update Progress: 908/2372 symbols completed. GDV took 21.4s. Estimated remaining: 3h 14m 2s. Rate: 7.5 symbols/min [2025-09-25T19:00:23.893961] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-25T19:00:23.947047] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:23.969892] [DEBUG] [LOCAL ] GEF: Loaded 20704 existing records from primary storage. [2025-09-25T19:00:23.970052] [INFO ] [MAIN ] GEF: Loaded 20704 existing records. [2025-09-25T19:00:24.155893] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:24.156253] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-25T19:00:24.156326] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-25T19:00:24.156628] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-25T19:00:24.156714] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-25T19:00:24.525224] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:24.585731] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T19:00:24.688752] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-25T19:00:25.488721] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-25T19:00:26.093300] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T19:00:26.094685] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T19:00:26.138474] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-25T19:00:26.288725] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-25T19:00:27.088706] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-25T19:00:27.146221] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T19:00:27.148354] [INFO ] [REMOTE ] GDO: Full fetch complete (9416 records). [2025-09-25T19:00:27.148432] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-25T19:00:27.642395] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-25T19:00:27.642514] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-25T19:00:27.642840] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-25T19:00:27.642905] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-25T19:00:27.643395] [DEBUG] [LOCAL ] GDO: Trimmed 9416 records to 6055 (keeping 200 days of data) [2025-09-25T19:00:27.687477] [DEBUG] [LOCAL ] GDO: Primary data saved (6055 records). [2025-09-25T19:00:27.687684] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-25T19:00:27.687823] [INFO ] [MAIN ] Update Progress: 909/2372 symbols completed. GDO took 34.8s. Estimated remaining: 3h 13m 48s. Rate: 7.5 symbols/min [2025-09-25T19:00:27.887807] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:27.888682] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-25T19:00:27.941665] [DEBUG] [LOCAL ] GEL: Loaded 33914 existing records from primary storage. [2025-09-25T19:00:27.941812] [INFO ] [MAIN ] GEL: Loaded 33914 existing records. [2025-09-25T19:00:28.124414] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:28.124765] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-25T19:00:28.124821] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-25T19:00:28.125293] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-25T19:00:28.125352] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-25T19:00:28.499708] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:28.688701] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-25T19:00:29.302946] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T19:00:29.397496] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T19:00:29.488734] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-25T19:00:29.982091] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T19:00:30.288794] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-25T19:00:30.772446] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T19:00:31.088763] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-25T19:00:31.888740] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-25T19:00:32.580741] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-25T19:00:32.595958] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T19:00:32.688710] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-25T19:00:33.488790] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-25T19:00:33.538812] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T19:00:33.547011] [INFO ] [REMOTE ] GDOT: Full fetch complete (52807 records). [2025-09-25T19:00:33.547227] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-25T19:00:33.948491] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-25T19:00:33.948635] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-25T19:00:33.949520] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-25T19:00:33.949586] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-25T19:00:33.951179] [DEBUG] [LOCAL ] GDOT: Trimmed 52807 records to 38946 (keeping 200 days of data) [2025-09-25T19:00:34.183858] [DEBUG] [LOCAL ] GDOT: Primary data saved (38946 records). [2025-09-25T19:00:34.184029] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-25T19:00:34.184120] [INFO ] [MAIN ] Update Progress: 910/2372 symbols completed. GDOT took 33.2s. Estimated remaining: 3h 13m 38s. Rate: 7.6 symbols/min [2025-09-25T19:00:34.296705] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-25T19:00:34.379633] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:34.437219] [DEBUG] [LOCAL ] GENI: Loaded 52912 existing records from primary storage. [2025-09-25T19:00:34.437413] [INFO ] [MAIN ] GENI: Loaded 52912 existing records. [2025-09-25T19:00:34.641992] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:34.642274] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-25T19:00:34.642323] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-25T19:00:34.642565] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-25T19:00:34.642636] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-25T19:00:35.056531] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:35.066994] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:00:35.093178] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-25T19:00:35.110848] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-25T19:00:35.403853] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:00:35.888771] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-25T19:00:36.448337] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T19:00:36.688785] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-25T19:00:36.974671] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T19:00:37.488778] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-25T19:00:37.970142] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T19:00:38.288750] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-25T19:00:39.088753] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-25T19:00:39.656364] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:00:39.783112] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-25T19:00:39.888732] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-25T19:00:40.688696] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-25T19:00:40.854005] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T19:00:41.334276] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:00:41.488731] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-25T19:00:42.288747] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-25T19:00:42.900348] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T19:00:43.088701] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-25T19:00:43.306423] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T19:00:43.366045] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T19:00:43.888757] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-25T19:00:44.688811] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-25T19:00:45.366267] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T19:00:45.421568] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T19:00:45.462940] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-25T19:00:45.473907] [INFO ] [REMOTE ] GE: Full fetch complete (77780 records). [2025-09-25T19:00:45.474096] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-25T19:00:45.497113] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-25T19:00:45.927697] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-25T19:00:45.927836] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-25T19:00:45.929203] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-25T19:00:45.929279] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-25T19:00:45.931762] [DEBUG] [LOCAL ] GE: Trimmed 77780 records to 54103 (keeping 200 days of data) [2025-09-25T19:00:46.288834] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-25T19:00:46.320543] [DEBUG] [LOCAL ] GE: Primary data saved (54103 records). [2025-09-25T19:00:46.320805] [INFO ] [MAIN ] GE: Full history saved. [2025-09-25T19:00:46.322282] [INFO ] [MAIN ] Update Progress: 911/2372 symbols completed. GE took 34.1s. Estimated remaining: 3h 13m 36s. Rate: 7.5 symbols/min [2025-09-25T19:00:46.512426] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:46.574547] [DEBUG] [LOCAL ] GEO: Loaded 52106 existing records from primary storage. [2025-09-25T19:00:46.574782] [INFO ] [MAIN ] GEO: Loaded 52106 existing records. [2025-09-25T19:00:46.776793] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:46.792070] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:00:46.791249] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-25T19:00:46.797523] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-25T19:00:46.798358] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-25T19:00:46.798433] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-25T19:00:47.093941] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-25T19:00:47.197052] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:47.888806] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-25T19:00:47.929461] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:00:47.969550] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T19:00:48.688723] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-25T19:00:49.381790] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:00:49.488738] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-25T19:00:50.288779] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-25T19:00:50.583862] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T19:00:50.712404] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T19:00:50.717624] [INFO ] [REMOTE ] GEL: Full fetch complete (48674 records). [2025-09-25T19:00:50.717790] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-25T19:00:51.088924] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-25T19:00:51.101254] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-25T19:00:51.102239] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-25T19:00:51.103104] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-25T19:00:51.103268] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-25T19:00:51.104458] [DEBUG] [LOCAL ] GEL: Trimmed 48674 records to 34035 (keeping 200 days of data) [2025-09-25T19:00:51.321803] [DEBUG] [LOCAL ] GEL: Primary data saved (34035 records). [2025-09-25T19:00:51.321971] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-25T19:00:51.322085] [INFO ] [MAIN ] Update Progress: 912/2372 symbols completed. GEL took 23.6s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-25T19:00:51.505106] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:00:51.553296] [DEBUG] [LOCAL ] GES: Loaded 39989 existing records from primary storage. [2025-09-25T19:00:51.553460] [INFO ] [MAIN ] GES: Loaded 39989 existing records. [2025-09-25T19:00:51.739341] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:00:51.739789] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-25T19:00:51.739859] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-25T19:00:51.740290] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-25T19:00:51.740383] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-25T19:00:51.895126] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-25T19:00:52.042207] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T19:00:52.159710] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:00:52.688701] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-25T19:00:53.123969] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-25T19:00:53.154937] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T19:00:53.488742] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-25T19:00:54.288729] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-25T19:00:54.345473] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T19:00:55.088700] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-25T19:00:55.241073] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T19:00:55.888753] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-25T19:00:56.070217] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T19:00:56.214099] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T19:00:56.688727] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-25T19:00:57.488699] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-25T19:00:57.732566] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T19:00:58.202513] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:00:58.288694] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-25T19:00:59.088728] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-25T19:00:59.405447] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T19:00:59.586239] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T19:00:59.888721] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-25T19:01:00.209724] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T19:01:00.688769] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-25T19:01:01.414005] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T19:01:01.488699] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-25T19:01:01.747617] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T19:01:02.288772] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-25T19:01:03.088739] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-25T19:01:03.269094] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T19:01:03.678768] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:01:03.683634] [INFO ] [REMOTE ] GEF: Full fetch complete (29425 records). [2025-09-25T19:01:03.683758] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-25T19:01:03.900133] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-25T19:01:04.061219] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-25T19:01:04.061311] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-25T19:01:04.061913] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-25T19:01:04.061975] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-25T19:01:04.062745] [DEBUG] [LOCAL ] GEF: Trimmed 29425 records to 20843 (keeping 200 days of data) [2025-09-25T19:01:04.191147] [DEBUG] [LOCAL ] GEF: Primary data saved (20843 records). [2025-09-25T19:01:04.191285] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-25T19:01:04.191384] [INFO ] [MAIN ] Update Progress: 913/2372 symbols completed. GEF took 40.4s. Estimated remaining: 3h 13m 24s. Rate: 7.5 symbols/min [2025-09-25T19:01:04.362157] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:04.362324] [DEBUG] [LOCAL ] GETY: No existing data file found in primary storage. [2025-09-25T19:01:04.362362] [WARN ] [MAIN ] GETY: No existing data found, performing full refresh instead. [2025-09-25T19:01:04.362504] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-25T19:01:04.362546] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-25T19:01:04.362587] [DEBUG] [LOCAL ] GETY: No primary data file found to delete. [2025-09-25T19:01:04.362619] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-25T19:01:04.702560] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-25T19:01:04.749952] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:04.797534] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T19:01:05.436181] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T19:01:05.488681] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-25T19:01:06.198625] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T19:01:06.288741] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-25T19:01:07.094870] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-25T19:01:07.116620] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T19:01:07.378307] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T19:01:07.888720] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-25T19:01:08.570507] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T19:01:08.688747] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-25T19:01:09.488683] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-25T19:01:09.764575] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T19:01:10.288718] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-25T19:01:10.327275] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:01:11.088799] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-25T19:01:11.315143] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T19:01:11.503347] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T19:01:11.888782] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-25T19:01:12.688708] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-25T19:01:12.762114] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:01:13.416044] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T19:01:13.488810] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-25T19:01:14.288698] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-25T19:01:14.631315] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T19:01:14.642153] [INFO ] [REMOTE ] GENI: Full fetch complete (75450 records). [2025-09-25T19:01:14.642347] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-25T19:01:15.086667] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-25T19:01:15.086829] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-25T19:01:15.088212] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-25T19:01:15.088288] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-25T19:01:15.088719] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-25T19:01:15.091600] [DEBUG] [LOCAL ] GENI: Trimmed 75450 records to 53298 (keeping 200 days of data) [2025-09-25T19:01:15.446235] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:01:15.462580] [INFO ] [REMOTE ] GEO: Full fetch complete (75533 records). [2025-09-25T19:01:15.463455] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-25T19:01:15.809901] [DEBUG] [LOCAL ] GENI: Primary data saved (53298 records). [2025-09-25T19:01:15.839328] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-25T19:01:15.864599] [INFO ] [MAIN ] Update Progress: 914/2372 symbols completed. GENI took 41.7s. Estimated remaining: 3h 13m 22s. Rate: 7.5 symbols/min [2025-09-25T19:01:16.071762] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-25T19:01:16.090493] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-25T19:01:16.096394] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-25T19:01:16.096828] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-25T19:01:16.176357] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:16.176746] [DEBUG] [LOCAL ] GEO: Trimmed 75533 records to 52453 (keeping 200 days of data) [2025-09-25T19:01:16.290671] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T19:01:16.307013] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-25T19:01:16.366051] [DEBUG] [LOCAL ] GEV: Loaded 53114 existing records from primary storage. [2025-09-25T19:01:16.367108] [INFO ] [MAIN ] GEV: Loaded 53114 existing records. [2025-09-25T19:01:16.582148] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:16.584524] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-25T19:01:16.584616] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-25T19:01:16.585082] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-25T19:01:16.585153] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-25T19:01:17.091040] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:17.098433] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-25T19:01:17.180501] [DEBUG] [LOCAL ] GEO: Primary data saved (52453 records). [2025-09-25T19:01:17.180698] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-25T19:01:17.181852] [INFO ] [MAIN ] Update Progress: 915/2372 symbols completed. GEO took 30.9s. Estimated remaining: 3h 13m 3s. Rate: 7.5 symbols/min [2025-09-25T19:01:17.377083] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-25T19:01:17.406798] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:17.414104] [DEBUG] [LOCAL ] GF: Loaded 3202 existing records from primary storage. [2025-09-25T19:01:17.414211] [INFO ] [MAIN ] GF: Loaded 3202 existing records. [2025-09-25T19:01:17.495425] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-25T19:01:17.609538] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:17.610208] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-25T19:01:17.610385] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-25T19:01:17.610801] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-25T19:01:17.610868] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-25T19:01:17.993625] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:18.185324] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T19:01:18.288737] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-25T19:01:19.088794] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-25T19:01:19.262912] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T19:01:19.271708] [INFO ] [REMOTE ] GES: Full fetch complete (59895 records). [2025-09-25T19:01:19.272046] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-25T19:01:19.566857] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-25T19:01:19.748177] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-25T19:01:19.748383] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-25T19:01:19.749795] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-25T19:01:19.749891] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-25T19:01:19.751807] [DEBUG] [LOCAL ] GES: Trimmed 59895 records to 40204 (keeping 200 days of data) [2025-09-25T19:01:19.863189] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T19:01:19.890500] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T19:01:19.889390] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-25T19:01:20.068615] [DEBUG] [LOCAL ] GES: Primary data saved (40204 records). [2025-09-25T19:01:20.068814] [INFO ] [MAIN ] GES: Full history saved. [2025-09-25T19:01:20.068922] [INFO ] [MAIN ] Update Progress: 916/2372 symbols completed. GES took 28.7s. Estimated remaining: 3h 12m 47s. Rate: 7.6 symbols/min [2025-09-25T19:01:20.323664] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:20.360317] [DEBUG] [LOCAL ] GFF: Loaded 30830 existing records from primary storage. [2025-09-25T19:01:20.360590] [INFO ] [MAIN ] GFF: Loaded 30830 existing records. [2025-09-25T19:01:20.487162] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T19:01:20.559795] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:20.560137] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-25T19:01:20.560199] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-25T19:01:20.560554] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-25T19:01:20.560618] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-25T19:01:20.693914] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-25T19:01:20.947374] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:21.488733] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-25T19:01:22.288746] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-25T19:01:22.720521] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T19:01:22.884584] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T19:01:23.088694] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-25T19:01:23.226179] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-25T19:01:23.888728] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-25T19:01:24.429624] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T19:01:24.688762] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-25T19:01:25.132202] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T19:01:25.419109] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T19:01:25.488693] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-25T19:01:26.054973] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:01:26.288721] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-25T19:01:26.897197] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T19:01:27.088746] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-25T19:01:27.888722] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-25T19:01:28.366966] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T19:01:28.688748] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-25T19:01:29.488783] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-25T19:01:29.976704] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T19:01:30.175406] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-25T19:01:30.288806] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-25T19:01:30.768974] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T19:01:31.088763] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-25T19:01:31.708279] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T19:01:31.888727] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-25T19:01:32.688784] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-25T19:01:33.324691] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T19:01:33.434229] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-25T19:01:33.488670] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-25T19:01:33.680287] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T19:01:33.687405] [INFO ] [REMOTE ] GETY: Full fetch complete (55733 records). [2025-09-25T19:01:33.687582] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-25T19:01:34.091806] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-25T19:01:34.091906] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-25T19:01:34.092920] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-25T19:01:34.092989] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-25T19:01:34.094390] [DEBUG] [LOCAL ] GETY: Trimmed 55733 records to 36145 (keeping 200 days of data) [2025-09-25T19:01:34.288942] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-25T19:01:34.303021] [DEBUG] [LOCAL ] GETY: Primary data saved (36145 records). [2025-09-25T19:01:34.303250] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-25T19:01:34.303347] [INFO ] [MAIN ] Update Progress: 917/2372 symbols completed. GETY took 30.1s. Estimated remaining: 3h 12m 49s. Rate: 7.5 symbols/min [2025-09-25T19:01:35.088732] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-25T19:01:35.611401] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-25T19:01:35.668970] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T19:01:35.888337] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T19:01:35.896301] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-25T19:01:36.353896] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T19:01:36.688734] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-25T19:01:37.159803] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T19:01:37.488725] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-25T19:01:38.288755] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-25T19:01:38.986868] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T19:01:39.088754] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-25T19:01:39.888830] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-25T19:01:40.207109] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T19:01:40.508518] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T19:01:40.509693] [INFO ] [REMOTE ] GF: Full fetch complete (5314 records). [2025-09-25T19:01:40.509776] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-25T19:01:40.690370] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-25T19:01:40.872296] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-25T19:01:40.971141] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-25T19:01:40.971251] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-25T19:01:40.971504] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-25T19:01:40.971545] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-25T19:01:40.972001] [DEBUG] [LOCAL ] GF: Trimmed 5314 records to 3206 (keeping 200 days of data) [2025-09-25T19:01:40.992310] [DEBUG] [LOCAL ] GF: Primary data saved (3206 records). [2025-09-25T19:01:40.992389] [INFO ] [MAIN ] GF: Full history saved. [2025-09-25T19:01:40.992484] [INFO ] [MAIN ] Update Progress: 918/2372 symbols completed. GF took 23.8s. Estimated remaining: 3h 12m 39s. Rate: 7.5 symbols/min [2025-09-25T19:01:41.488763] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-25T19:01:42.016323] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T19:01:42.288766] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-25T19:01:43.561264] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-25T19:01:43.572785] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-25T19:01:43.719823] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T19:01:43.888782] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-25T19:01:45.173711] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T19:01:45.179468] [INFO ] [REMOTE ] GFF: Full fetch complete (44251 records). [2025-09-25T19:01:45.179576] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-25T19:01:45.578841] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-25T19:01:45.578928] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-25T19:01:45.579686] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-25T19:01:45.579750] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-25T19:01:45.580854] [DEBUG] [LOCAL ] GFF: Trimmed 44251 records to 30968 (keeping 200 days of data) [2025-09-25T19:01:45.780571] [DEBUG] [LOCAL ] GFF: Primary data saved (30968 records). [2025-09-25T19:01:45.780760] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-25T19:01:45.780862] [INFO ] [MAIN ] Update Progress: 919/2372 symbols completed. GFF took 25.7s. Estimated remaining: 3h 12m 26s. Rate: 7.6 symbols/min [2025-09-25T19:01:46.100596] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-25T19:01:46.113263] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-25T19:01:48.386724] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-25T19:01:48.405780] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-25T19:01:51.083093] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-25T19:01:51.093608] [INFO ] [REMOTE ] GEV: Full fetch complete (76970 records). [2025-09-25T19:01:51.093829] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-25T19:01:51.505396] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-25T19:01:51.505500] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-25T19:01:51.506528] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-25T19:01:51.506663] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-25T19:01:51.512531] [DEBUG] [LOCAL ] GEV: Trimmed 76970 records to 53499 (keeping 200 days of data) [2025-09-25T19:01:51.853846] [DEBUG] [LOCAL ] GEV: Primary data saved (53499 records). [2025-09-25T19:01:51.853999] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-25T19:01:51.854184] [INFO ] [MAIN ] Update Progress: 920/2372 symbols completed. GEV took 36.0s. Estimated remaining: 3h 12m 15s. Rate: 7.6 symbols/min [2025-09-25T19:01:52.443374] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:52.507248] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:52.536861] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:52.632582] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:01:52.631622] [DEBUG] [LOCAL ] GFR: Loaded 8471 existing records from primary storage. [2025-09-25T19:01:52.633100] [INFO ] [MAIN ] GFR: Loaded 8471 existing records. [2025-09-25T19:01:52.889992] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:52.922015] [DEBUG] [LOCAL ] GGB: Loaded 51045 existing records from primary storage. [2025-09-25T19:01:52.922825] [INFO ] [MAIN ] GGB: Loaded 51045 existing records. [2025-09-25T19:01:52.922670] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-25T19:01:52.934525] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-25T19:01:52.956956] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-25T19:01:52.940872] [DEBUG] [LOCAL ] GFL: Loaded 48025 existing records from primary storage. [2025-09-25T19:01:52.972952] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-25T19:01:52.973142] [INFO ] [MAIN ] GFL: Loaded 48025 existing records. [2025-09-25T19:01:53.174044] [DEBUG] [LOCAL ] GFI: Loaded 53109 existing records from primary storage. [2025-09-25T19:01:53.217722] [INFO ] [MAIN ] GFI: Loaded 53109 existing records. [2025-09-25T19:01:53.533346] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:53.629989] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-25T19:01:53.679824] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-25T19:01:53.762618] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:53.789433] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:01:53.814030] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-25T19:01:53.819227] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-25T19:01:53.825039] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-25T19:01:53.845931] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-25T19:01:53.825130] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-25T19:01:53.889346] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-25T19:01:53.894768] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-25T19:01:53.900414] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-25T19:01:53.911360] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-25T19:01:53.945184] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-25T19:01:54.196343] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:54.331026] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-25T19:01:55.069838] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:55.075418] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-25T19:01:55.073806] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:55.077787] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-25T19:01:55.167902] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:01:55.168302] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-25T19:01:55.357491] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:01:55.361167] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-25T19:01:55.961710] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T19:01:55.964526] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-25T19:01:56.698307] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T19:01:56.701280] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-25T19:01:56.729831] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T19:01:56.740074] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-25T19:01:56.857826] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T19:01:56.868965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-25T19:01:56.951422] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T19:01:56.962896] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-25T19:01:57.524919] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T19:01:57.530276] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-25T19:01:58.283903] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T19:01:58.287722] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-25T19:01:58.357991] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T19:01:58.368838] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-25T19:01:58.639492] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T19:01:58.652624] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-25T19:01:58.796849] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T19:01:58.808534] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-25T19:01:59.069176] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T19:01:59.072511] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-25T19:01:59.715681] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T19:01:59.717266] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T19:01:59.730849] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-25T19:01:59.888733] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-25T19:01:59.969486] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T19:02:00.213676] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T19:02:00.681853] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T19:02:00.693540] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-25T19:02:01.269770] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T19:02:01.488742] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-25T19:02:02.288698] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-25T19:02:02.467305] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:02:03.088785] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-25T19:02:03.354098] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T19:02:03.888710] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-25T19:02:04.323705] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T19:02:04.688773] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-25T19:02:04.811929] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T19:02:05.213321] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T19:02:05.230566] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T19:02:05.488744] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-25T19:02:06.288760] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-25T19:02:07.088778] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-25T19:02:07.238367] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T19:02:07.888710] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-25T19:02:07.897345] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T19:02:07.899251] [INFO ] [REMOTE ] GFR: Full fetch complete (12849 records). [2025-09-25T19:02:07.899338] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-25T19:02:08.286171] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-25T19:02:08.286262] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-25T19:02:08.286662] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-25T19:02:08.286752] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-25T19:02:08.287307] [DEBUG] [LOCAL ] GFR: Trimmed 12849 records to 8522 (keeping 200 days of data) [2025-09-25T19:02:08.344258] [DEBUG] [LOCAL ] GFR: Primary data saved (8522 records). [2025-09-25T19:02:08.344427] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-25T19:02:08.344573] [INFO ] [MAIN ] Update Progress: 921/2372 symbols completed. GFR took 16.5s. Estimated remaining: 3h 12m 21s. Rate: 7.5 symbols/min [2025-09-25T19:02:08.549945] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:08.602228] [DEBUG] [LOCAL ] GGG: Loaded 40958 existing records from primary storage. [2025-09-25T19:02:08.602395] [INFO ] [MAIN ] GGG: Loaded 40958 existing records. [2025-09-25T19:02:08.695852] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-25T19:02:08.794436] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-25T19:02:08.845271] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:08.845540] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-25T19:02:08.845597] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-25T19:02:08.845849] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-25T19:02:08.845907] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-25T19:02:09.211669] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:09.488779] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-25T19:02:09.664221] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T19:02:10.241676] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T19:02:10.288676] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-25T19:02:10.628877] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T19:02:11.088743] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-25T19:02:11.888787] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-25T19:02:12.052907] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T19:02:12.688750] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-25T19:02:13.426000] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-25T19:02:13.498062] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-25T19:02:13.504291] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:02:14.169867] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T19:02:14.288719] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-25T19:02:15.088692] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-25T19:02:15.191921] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T19:02:15.888694] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-25T19:02:15.921750] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T19:02:16.688717] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-25T19:02:16.840985] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T19:02:17.488736] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-25T19:02:17.714324] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T19:02:17.723862] [INFO ] [REMOTE ] GFL: Full fetch complete (68872 records). [2025-09-25T19:02:17.724020] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-25T19:02:18.141945] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-25T19:02:18.142048] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-25T19:02:18.142957] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-25T19:02:18.143022] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-25T19:02:18.144817] [DEBUG] [LOCAL ] GFL: Trimmed 68872 records to 48414 (keeping 200 days of data) [2025-09-25T19:02:18.329589] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-25T19:02:18.477390] [DEBUG] [LOCAL ] GFL: Primary data saved (48414 records). [2025-09-25T19:02:18.477694] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-25T19:02:18.477933] [INFO ] [MAIN ] Update Progress: 922/2372 symbols completed. GFL took 26.6s. Estimated remaining: 3h 12m 16s. Rate: 7.5 symbols/min [2025-09-25T19:02:18.697502] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:18.716217] [DEBUG] [LOCAL ] GGT: Loaded 14152 existing records from primary storage. [2025-09-25T19:02:18.716786] [INFO ] [MAIN ] GGT: Loaded 14152 existing records. [2025-09-25T19:02:18.919405] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:18.920181] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-25T19:02:18.950719] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-25T19:02:18.953291] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-25T19:02:18.957682] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-25T19:02:18.958050] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-25T19:02:19.097369] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-25T19:02:19.444549] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:19.452625] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T19:02:19.896682] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-25T19:02:19.914617] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T19:02:19.925830] [INFO ] [REMOTE ] GGB: Full fetch complete (74008 records). [2025-09-25T19:02:19.925976] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-25T19:02:20.340008] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-25T19:02:20.340124] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-25T19:02:20.341203] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-25T19:02:20.341273] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-25T19:02:20.343053] [DEBUG] [LOCAL ] GGB: Trimmed 74008 records to 51429 (keeping 200 days of data) [2025-09-25T19:02:20.654088] [DEBUG] [LOCAL ] GGB: Primary data saved (51429 records). [2025-09-25T19:02:20.654226] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-25T19:02:20.654335] [INFO ] [MAIN ] Update Progress: 923/2372 symbols completed. GGB took 28.8s. Estimated remaining: 3h 11m 59s. Rate: 7.5 symbols/min [2025-09-25T19:02:20.698991] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-25T19:02:20.841684] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:20.847632] [DEBUG] [LOCAL ] GGZ: Loaded 2437 existing records from primary storage. [2025-09-25T19:02:20.847763] [INFO ] [MAIN ] GGZ: Loaded 2437 existing records. [2025-09-25T19:02:21.035738] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:21.036698] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-25T19:02:21.036919] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-25T19:02:21.037372] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-25T19:02:21.037437] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-25T19:02:21.474793] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-25T19:02:21.472303] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:21.488866] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-25T19:02:21.684037] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T19:02:21.723680] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:02:22.057377] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T19:02:22.288718] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-25T19:02:23.088797] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-25T19:02:23.888753] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-25T19:02:24.339817] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T19:02:24.346787] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T19:02:24.599213] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T19:02:24.688705] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-25T19:02:25.488781] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-25T19:02:25.944512] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T19:02:26.235097] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T19:02:26.288683] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-25T19:02:27.088730] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-25T19:02:27.615928] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T19:02:27.888776] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-25T19:02:28.091545] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T19:02:28.683625] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T19:02:28.688667] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-25T19:02:29.488745] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-25T19:02:30.263784] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T19:02:30.288672] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-25T19:02:30.994772] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-25T19:02:31.006554] [INFO ] [REMOTE ] GFI: Full fetch complete (76321 records). [2025-09-25T19:02:31.006892] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-25T19:02:31.096937] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-25T19:02:31.139472] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T19:02:31.439843] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-25T19:02:31.439976] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-25T19:02:31.441007] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-25T19:02:31.441072] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-25T19:02:31.442756] [DEBUG] [LOCAL ] GFI: Trimmed 76321 records to 53499 (keeping 200 days of data) [2025-09-25T19:02:31.718625] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:02:31.812468] [DEBUG] [LOCAL ] GFI: Primary data saved (53499 records). [2025-09-25T19:02:31.812664] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-25T19:02:31.812797] [INFO ] [MAIN ] Update Progress: 924/2372 symbols completed. GFI took 40.0s. Estimated remaining: 3h 11m 56s. Rate: 7.5 symbols/min [2025-09-25T19:02:31.893882] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-25T19:02:32.000453] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:32.005797] [DEBUG] [LOCAL ] GHC: Loaded 2634 existing records from primary storage. [2025-09-25T19:02:32.005892] [INFO ] [MAIN ] GHC: Loaded 2634 existing records. [2025-09-25T19:02:32.183968] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:32.184272] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-25T19:02:32.184325] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-25T19:02:32.184490] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-25T19:02:32.184589] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-25T19:02:32.549323] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:32.688693] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-25T19:02:33.075434] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-25T19:02:33.365292] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:02:33.488740] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-25T19:02:34.288826] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-25T19:02:34.314296] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T19:02:34.847700] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T19:02:35.088730] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-25T19:02:35.607723] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-25T19:02:35.888759] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-25T19:02:36.688766] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-25T19:02:36.984438] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T19:02:36.999580] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-25T19:02:37.488774] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-25T19:02:38.288746] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-25T19:02:38.511311] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T19:02:38.897632] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T19:02:39.088706] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-25T19:02:39.562459] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T19:02:39.888704] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-25T19:02:40.481514] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T19:02:40.688754] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-25T19:02:41.080164] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-25T19:02:41.488844] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-25T19:02:42.288778] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-25T19:02:42.434771] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-25T19:02:42.920767] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T19:02:43.088752] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-25T19:02:43.690315] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T19:02:43.691770] [INFO ] [REMOTE ] GGZ: Full fetch complete (4172 records). [2025-09-25T19:02:43.691866] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-25T19:02:43.896130] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-25T19:02:44.081278] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-25T19:02:44.081384] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-25T19:02:44.081564] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-25T19:02:44.081627] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-25T19:02:44.082042] [DEBUG] [LOCAL ] GGZ: Trimmed 4172 records to 2457 (keeping 200 days of data) [2025-09-25T19:02:44.099072] [DEBUG] [LOCAL ] GGZ: Primary data saved (2457 records). [2025-09-25T19:02:44.099149] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-25T19:02:44.099228] [INFO ] [MAIN ] Update Progress: 925/2372 symbols completed. GGZ took 23.4s. Estimated remaining: 3h 11m 55s. Rate: 7.5 symbols/min [2025-09-25T19:02:44.276735] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:44.288678] [DEBUG] [LOCAL ] GHG: Loaded 3194 existing records from primary storage. [2025-09-25T19:02:44.288782] [INFO ] [MAIN ] GHG: Loaded 3194 existing records. [2025-09-25T19:02:44.471253] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:44.471582] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-25T19:02:44.471680] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-25T19:02:44.471939] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-25T19:02:44.472011] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-25T19:02:44.693906] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-25T19:02:44.852596] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:45.283344] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T19:02:45.488706] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-25T19:02:45.607907] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:02:45.615439] [INFO ] [REMOTE ] GGG: Full fetch complete (59313 records). [2025-09-25T19:02:45.615554] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-25T19:02:46.054378] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-25T19:02:46.054532] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-25T19:02:46.055867] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-25T19:02:46.055991] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-25T19:02:46.058182] [DEBUG] [LOCAL ] GGG: Trimmed 59313 records to 41294 (keeping 200 days of data) [2025-09-25T19:02:46.168493] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T19:02:46.301486] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-25T19:02:46.352930] [DEBUG] [LOCAL ] GGG: Primary data saved (41294 records). [2025-09-25T19:02:46.353117] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-25T19:02:46.353295] [INFO ] [MAIN ] Update Progress: 926/2372 symbols completed. GGG took 38.0s. Estimated remaining: 3h 11m 38s. Rate: 7.5 symbols/min [2025-09-25T19:02:46.554304] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:46.567505] [DEBUG] [LOCAL ] GHI: Loaded 6853 existing records from primary storage. [2025-09-25T19:02:46.567671] [INFO ] [MAIN ] GHI: Loaded 6853 existing records. [2025-09-25T19:02:46.768581] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:46.768943] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-25T19:02:46.769044] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-25T19:02:46.769332] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-25T19:02:46.769414] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-25T19:02:46.921078] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T19:02:47.097697] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-25T19:02:47.192299] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:47.638462] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T19:02:47.888726] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-25T19:02:48.688710] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-25T19:02:48.744358] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T19:02:48.745528] [INFO ] [REMOTE ] GHC: Full fetch complete (3266 records). [2025-09-25T19:02:48.745598] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-25T19:02:49.106025] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-25T19:02:49.106111] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-25T19:02:49.106244] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-25T19:02:49.106281] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-25T19:02:49.106703] [DEBUG] [LOCAL ] GHC: Trimmed 3266 records to 2651 (keeping 200 days of data) [2025-09-25T19:02:49.123932] [DEBUG] [LOCAL ] GHC: Primary data saved (2651 records). [2025-09-25T19:02:49.124006] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-25T19:02:49.124080] [INFO ] [MAIN ] Update Progress: 927/2372 symbols completed. GHC took 17.3s. Estimated remaining: 3h 11m 22s. Rate: 7.6 symbols/min [2025-09-25T19:02:49.228795] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T19:02:49.313190] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:02:49.320944] [DEBUG] [LOCAL ] GHLD: Loaded 4117 existing records from primary storage. [2025-09-25T19:02:49.321057] [INFO ] [MAIN ] GHLD: Loaded 4117 existing records. [2025-09-25T19:02:49.502247] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:02:49.495778] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-25T19:02:49.503836] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-25T19:02:49.503907] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-25T19:02:49.504104] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-25T19:02:49.504163] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-25T19:02:49.884966] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:02:50.288714] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-25T19:02:50.442080] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T19:02:51.088729] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-25T19:02:51.487105] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T19:02:51.544607] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T19:02:51.888752] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-25T19:02:52.333955] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T19:02:52.688749] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-25T19:02:53.487214] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T19:02:53.489913] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-25T19:02:53.865207] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-25T19:02:54.288771] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-25T19:02:54.654634] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-25T19:02:55.088773] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-25T19:02:55.575987] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T19:02:55.888767] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-25T19:02:56.582452] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T19:02:56.688751] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-25T19:02:57.370362] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T19:02:57.488761] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-25T19:02:58.232294] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T19:02:58.288770] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-25T19:02:58.948961] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T19:02:59.088767] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-25T19:02:59.541919] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T19:02:59.888760] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-25T19:03:00.462962] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:03:00.688762] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-25T19:03:01.379069] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T19:03:01.488771] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-25T19:03:02.257417] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T19:03:02.288724] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-25T19:03:03.086972] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T19:03:03.089291] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-25T19:03:03.547707] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T19:03:03.888782] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-25T19:03:04.359708] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-25T19:03:04.688794] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-25T19:03:05.342737] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T19:03:05.488715] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-25T19:03:06.096631] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T19:03:06.288761] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-25T19:03:07.027257] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T19:03:07.029116] [INFO ] [REMOTE ] GHI: Full fetch complete (11662 records). [2025-09-25T19:03:07.029190] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-25T19:03:07.097608] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-25T19:03:07.431240] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-25T19:03:07.431361] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-25T19:03:07.431701] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-25T19:03:07.431763] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-25T19:03:07.432231] [DEBUG] [LOCAL ] GHI: Trimmed 11662 records to 6903 (keeping 200 days of data) [2025-09-25T19:03:07.474866] [DEBUG] [LOCAL ] GHI: Primary data saved (6903 records). [2025-09-25T19:03:07.475047] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-25T19:03:07.475167] [INFO ] [MAIN ] Update Progress: 928/2372 symbols completed. GHI took 21.1s. Estimated remaining: 3h 11m 30s. Rate: 7.5 symbols/min [2025-09-25T19:03:07.666456] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:07.683590] [DEBUG] [LOCAL ] GHM: Loaded 14139 existing records from primary storage. [2025-09-25T19:03:07.683744] [INFO ] [MAIN ] GHM: Loaded 14139 existing records. [2025-09-25T19:03:07.816367] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T19:03:07.890430] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-25T19:03:07.890283] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:07.892387] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-25T19:03:07.892472] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-25T19:03:07.892762] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-25T19:03:07.892825] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-25T19:03:08.279782] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:08.688712] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-25T19:03:08.969041] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T19:03:08.972590] [INFO ] [REMOTE ] GGT: Full fetch complete (18724 records). [2025-09-25T19:03:08.972712] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-25T19:03:09.203371] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T19:03:09.364386] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-25T19:03:09.364499] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-25T19:03:09.365218] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-25T19:03:09.365287] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-25T19:03:09.366044] [DEBUG] [LOCAL ] GGT: Trimmed 18724 records to 14231 (keeping 200 days of data) [2025-09-25T19:03:09.461281] [DEBUG] [LOCAL ] GGT: Primary data saved (14231 records). [2025-09-25T19:03:09.461520] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-25T19:03:09.461672] [INFO ] [MAIN ] Update Progress: 929/2372 symbols completed. GGT took 51.0s. Estimated remaining: 3h 11m 13s. Rate: 7.5 symbols/min [2025-09-25T19:03:09.495301] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-25T19:03:09.708048] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:09.735280] [DEBUG] [LOCAL ] GHY: Loaded 20728 existing records from primary storage. [2025-09-25T19:03:09.735561] [INFO ] [MAIN ] GHY: Loaded 20728 existing records. [2025-09-25T19:03:09.989060] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:09.989386] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-25T19:03:09.989438] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-25T19:03:09.989751] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-25T19:03:09.989813] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-25T19:03:10.291732] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-25T19:03:10.277605] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:03:10.472270] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:10.970417] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T19:03:11.088733] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-25T19:03:11.554420] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T19:03:11.888699] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-25T19:03:12.581552] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T19:03:12.582919] [INFO ] [REMOTE ] GHG: Full fetch complete (4018 records). [2025-09-25T19:03:12.583017] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-25T19:03:12.693847] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-25T19:03:12.951751] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-25T19:03:12.951836] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-25T19:03:12.951991] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-25T19:03:12.952030] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-25T19:03:12.952401] [DEBUG] [LOCAL ] GHG: Trimmed 4018 records to 3210 (keeping 200 days of data) [2025-09-25T19:03:12.970559] [DEBUG] [LOCAL ] GHG: Primary data saved (3210 records). [2025-09-25T19:03:12.970660] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-25T19:03:12.970763] [INFO ] [MAIN ] Update Progress: 930/2372 symbols completed. GHG took 28.9s. Estimated remaining: 3h 10m 58s. Rate: 7.6 symbols/min [2025-09-25T19:03:13.143962] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:13.184770] [DEBUG] [LOCAL ] GIB: Loaded 32049 existing records from primary storage. [2025-09-25T19:03:13.184921] [INFO ] [MAIN ] GIB: Loaded 32049 existing records. [2025-09-25T19:03:13.362464] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:13.362787] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-25T19:03:13.362840] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-25T19:03:13.363156] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-25T19:03:13.363215] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-25T19:03:13.493786] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-25T19:03:13.751614] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:13.752627] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T19:03:14.288687] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-25T19:03:14.611369] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T19:03:14.871696] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T19:03:15.088798] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-25T19:03:15.888736] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-25T19:03:16.527774] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T19:03:16.582178] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T19:03:16.688773] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-25T19:03:17.488755] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-25T19:03:17.799170] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T19:03:18.288736] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-25T19:03:18.724076] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T19:03:19.088726] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-25T19:03:19.321161] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T19:03:19.322789] [INFO ] [REMOTE ] GHLD: Full fetch complete (4750 records). [2025-09-25T19:03:19.322862] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-25T19:03:19.725131] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-25T19:03:19.725215] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-25T19:03:19.725347] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-25T19:03:19.725384] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-25T19:03:19.725807] [DEBUG] [LOCAL ] GHLD: Trimmed 4750 records to 4144 (keeping 200 days of data) [2025-09-25T19:03:19.750831] [DEBUG] [LOCAL ] GHLD: Primary data saved (4144 records). [2025-09-25T19:03:19.750920] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-25T19:03:19.750999] [INFO ] [MAIN ] Update Progress: 931/2372 symbols completed. GHLD took 30.6s. Estimated remaining: 3h 10m 49s. Rate: 7.6 symbols/min [2025-09-25T19:03:19.894186] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-25T19:03:19.930095] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:19.946189] [DEBUG] [LOCAL ] GIC: Loaded 13671 existing records from primary storage. [2025-09-25T19:03:19.946321] [INFO ] [MAIN ] GIC: Loaded 13671 existing records. [2025-09-25T19:03:20.136700] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:20.137004] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-25T19:03:20.137074] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-25T19:03:20.137342] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-25T19:03:20.137401] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-25T19:03:20.428783] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T19:03:20.545249] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:20.688708] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-25T19:03:21.126821] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T19:03:21.488746] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-25T19:03:21.770623] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T19:03:22.074169] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T19:03:22.288756] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-25T19:03:23.088705] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-25T19:03:23.408899] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T19:03:23.888737] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-25T19:03:24.153119] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T19:03:24.688738] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-25T19:03:24.931819] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T19:03:25.330952] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T19:03:25.488766] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-25T19:03:26.288758] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-25T19:03:26.624226] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T19:03:26.839535] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T19:03:27.088729] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-25T19:03:27.701334] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T19:03:27.888746] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-25T19:03:28.688701] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-25T19:03:29.007446] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T19:03:29.488694] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-25T19:03:29.555675] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T19:03:30.288740] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-25T19:03:30.540919] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T19:03:31.088695] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-25T19:03:31.107586] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T19:03:31.888736] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-25T19:03:32.527705] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T19:03:32.688736] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-25T19:03:32.944367] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T19:03:32.948076] [INFO ] [REMOTE ] GHY: Full fetch complete (31899 records). [2025-09-25T19:03:32.948189] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-25T19:03:33.380045] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-25T19:03:33.380150] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-25T19:03:33.380827] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-25T19:03:33.380898] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-25T19:03:33.381973] [DEBUG] [LOCAL ] GHY: Trimmed 31899 records to 20903 (keeping 200 days of data) [2025-09-25T19:03:33.489124] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-25T19:03:33.524400] [DEBUG] [LOCAL ] GHY: Primary data saved (20903 records). [2025-09-25T19:03:33.524564] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-25T19:03:33.524690] [INFO ] [MAIN ] Update Progress: 932/2372 symbols completed. GHY took 24.1s. Estimated remaining: 3h 10m 50s. Rate: 7.5 symbols/min [2025-09-25T19:03:33.737965] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:33.804937] [DEBUG] [LOCAL ] GIL: Loaded 43210 existing records from primary storage. [2025-09-25T19:03:33.805133] [INFO ] [MAIN ] GIL: Loaded 43210 existing records. [2025-09-25T19:03:34.059933] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:34.061000] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-25T19:03:34.061126] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-25T19:03:34.061432] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-25T19:03:34.061494] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-25T19:03:34.291894] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-25T19:03:34.546794] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:03:34.658234] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T19:03:34.694515] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:35.088693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-25T19:03:35.333191] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T19:03:35.888724] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-25T19:03:36.242397] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:03:36.688749] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-25T19:03:37.320095] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T19:03:37.488730] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-25T19:03:38.005235] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T19:03:38.288728] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-25T19:03:39.003509] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T19:03:39.088805] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-25T19:03:39.302766] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T19:03:39.888784] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-25T19:03:40.598198] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:03:40.646973] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T19:03:40.688679] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-25T19:03:41.488718] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-25T19:03:42.297404] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-25T19:03:42.303170] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T19:03:42.839619] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T19:03:43.088686] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-25T19:03:43.368705] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T19:03:43.888716] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-25T19:03:44.688692] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-25T19:03:44.758553] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:03:45.489746] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-25T19:03:45.495146] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T19:03:45.568715] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T19:03:46.288731] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-25T19:03:46.566440] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T19:03:46.569769] [INFO ] [REMOTE ] GHM: Full fetch complete (21634 records). [2025-09-25T19:03:46.569845] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-25T19:03:46.961387] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-25T19:03:46.961479] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-25T19:03:46.962091] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-25T19:03:46.962155] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-25T19:03:46.962952] [DEBUG] [LOCAL ] GHM: Trimmed 21634 records to 14240 (keeping 200 days of data) [2025-09-25T19:03:47.052725] [DEBUG] [LOCAL ] GHM: Primary data saved (14240 records). [2025-09-25T19:03:47.052955] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-25T19:03:47.053105] [INFO ] [MAIN ] Update Progress: 933/2372 symbols completed. GHM took 39.6s. Estimated remaining: 3h 10m 50s. Rate: 7.5 symbols/min [2025-09-25T19:03:47.093922] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-25T19:03:47.240562] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:47.303229] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-09-25T19:03:47.303419] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-09-25T19:03:47.486726] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:47.487069] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-25T19:03:47.487127] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-25T19:03:47.487484] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-25T19:03:47.487544] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-25T19:03:47.874235] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:47.888672] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-25T19:03:47.975234] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T19:03:48.688723] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-25T19:03:49.488740] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-25T19:03:49.507057] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T19:03:49.738998] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T19:03:50.288828] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-25T19:03:50.880885] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:03:50.887319] [INFO ] [REMOTE ] GIB: Full fetch complete (45139 records). [2025-09-25T19:03:50.887447] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-25T19:03:51.090098] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-25T19:03:51.329261] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-25T19:03:51.329457] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-25T19:03:51.330343] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-25T19:03:51.330542] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-25T19:03:51.331760] [DEBUG] [LOCAL ] GIB: Trimmed 45139 records to 32311 (keeping 200 days of data) [2025-09-25T19:03:51.449631] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:03:51.492576] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (5.20 seconds). [2025-09-25T19:03:51.603916] [DEBUG] [LOCAL ] GIB: Primary data saved (32311 records). [2025-09-25T19:03:51.604060] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-25T19:03:51.604150] [INFO ] [MAIN ] Update Progress: 934/2372 symbols completed. GIB took 38.6s. Estimated remaining: 3h 10m 37s. Rate: 7.5 symbols/min [2025-09-25T19:03:51.778889] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:51.826788] [DEBUG] [LOCAL ] GKOS: Loaded 43007 existing records from primary storage. [2025-09-25T19:03:51.827001] [INFO ] [MAIN ] GKOS: Loaded 43007 existing records. [2025-09-25T19:03:51.893820] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-25T19:03:52.010754] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:52.010994] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-25T19:03:52.011048] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-25T19:03:52.011374] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-25T19:03:52.011438] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-25T19:03:52.374787] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:52.688738] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-25T19:03:53.009145] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T19:03:53.379202] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T19:03:53.488766] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-25T19:03:54.212339] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T19:03:54.288728] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-25T19:03:54.623175] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:03:55.088728] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-25T19:03:55.406312] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T19:03:55.888781] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-25T19:03:56.688844] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-25T19:03:56.759324] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:03:56.912474] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T19:03:56.916828] [INFO ] [REMOTE ] GIC: Full fetch complete (20338 records). [2025-09-25T19:03:56.916923] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-25T19:03:57.323543] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-25T19:03:57.323756] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-25T19:03:57.324484] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-25T19:03:57.324528] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-25T19:03:57.325253] [DEBUG] [LOCAL ] GIC: Trimmed 20338 records to 13732 (keeping 200 days of data) [2025-09-25T19:03:57.421579] [DEBUG] [LOCAL ] GIC: Primary data saved (13732 records). [2025-09-25T19:03:57.421819] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-25T19:03:57.421937] [INFO ] [MAIN ] Update Progress: 935/2372 symbols completed. GIC took 37.7s. Estimated remaining: 3h 10m 26s. Rate: 7.5 symbols/min [2025-09-25T19:03:57.493981] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-25T19:03:57.605490] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:57.660048] [DEBUG] [LOCAL ] GL: Loaded 37907 existing records from primary storage. [2025-09-25T19:03:57.660293] [INFO ] [MAIN ] GL: Loaded 37907 existing records. [2025-09-25T19:03:57.859389] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:03:57.859859] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-25T19:03:57.859918] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-25T19:03:57.860264] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-25T19:03:57.860327] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-25T19:03:58.289304] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:03:58.289544] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-25T19:03:58.325298] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:03:58.927327] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T19:03:58.936455] [INFO ] [REMOTE ] GIL: Full fetch complete (61370 records). [2025-09-25T19:03:58.936624] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-25T19:03:59.093918] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-25T19:03:59.361633] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-25T19:03:59.361769] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-25T19:03:59.362824] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-25T19:03:59.362892] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-25T19:03:59.364396] [DEBUG] [LOCAL ] GIL: Trimmed 61370 records to 43565 (keeping 200 days of data) [2025-09-25T19:03:59.636476] [DEBUG] [LOCAL ] GIL: Primary data saved (43565 records). [2025-09-25T19:03:59.636677] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-25T19:03:59.636792] [INFO ] [MAIN ] Update Progress: 936/2372 symbols completed. GIL took 26.1s. Estimated remaining: 3h 10m 9s. Rate: 7.6 symbols/min [2025-09-25T19:03:59.816157] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:03:59.842151] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T19:03:59.892511] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-25T19:03:59.894852] [DEBUG] [LOCAL ] GLOB: Loaded 47365 existing records from primary storage. [2025-09-25T19:03:59.895044] [INFO ] [MAIN ] GLOB: Loaded 47365 existing records. [2025-09-25T19:04:00.079547] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:00.079876] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-25T19:04:00.079925] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-25T19:04:00.080237] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-25T19:04:00.080297] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-25T19:04:00.454792] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:00.688776] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-25T19:04:01.032426] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T19:04:01.488765] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-25T19:04:01.653089] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T19:04:01.732201] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:04:02.288717] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-25T19:04:03.088763] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-25T19:04:03.303057] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T19:04:03.888733] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-25T19:04:03.960746] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:04:04.688709] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-25T19:04:04.744024] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T19:04:05.497610] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-25T19:04:05.500496] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:04:06.250071] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T19:04:06.288701] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-25T19:04:07.033319] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T19:04:07.088664] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-25T19:04:07.845503] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T19:04:07.888708] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-25T19:04:08.308585] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T19:04:08.688735] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-25T19:04:09.488695] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-25T19:04:09.767557] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T19:04:10.154517] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T19:04:10.288747] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-25T19:04:10.730115] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T19:04:11.088733] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-25T19:04:11.385186] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T19:04:11.888729] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-25T19:04:12.653982] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T19:04:12.688735] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-25T19:04:13.488757] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-25T19:04:13.580740] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T19:04:14.248700] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T19:04:14.288685] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-25T19:04:14.983261] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T19:04:15.088714] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-25T19:04:15.888732] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-25T19:04:15.995783] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:04:16.004990] [INFO ] [REMOTE ] GKOS: Full fetch complete (59874 records). [2025-09-25T19:04:16.005199] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-25T19:04:16.407627] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-25T19:04:16.407748] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-25T19:04:16.408720] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-25T19:04:16.408830] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-25T19:04:16.410681] [DEBUG] [LOCAL ] GKOS: Trimmed 59874 records to 43265 (keeping 200 days of data) [2025-09-25T19:04:16.673449] [DEBUG] [LOCAL ] GKOS: Primary data saved (43265 records). [2025-09-25T19:04:16.673789] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-25T19:04:16.674000] [INFO ] [MAIN ] Update Progress: 937/2372 symbols completed. GKOS took 25.1s. Estimated remaining: 3h 10m 15s. Rate: 7.5 symbols/min [2025-09-25T19:04:16.707586] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-25T19:04:16.859891] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:04:16.889268] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T19:04:16.906903] [DEBUG] [LOCAL ] GLP: Loaded 9463 existing records from primary storage. [2025-09-25T19:04:16.907052] [INFO ] [MAIN ] GLP: Loaded 9463 existing records. [2025-09-25T19:04:17.099928] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:17.100399] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-25T19:04:17.100458] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-25T19:04:17.101110] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-25T19:04:17.101189] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-25T19:04:17.496134] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:17.496313] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-25T19:04:17.764251] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T19:04:17.959811] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T19:04:18.289036] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-25T19:04:18.772123] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T19:04:18.792926] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T19:04:19.088737] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-25T19:04:19.888730] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-25T19:04:19.901073] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:04:20.688788] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-25T19:04:21.020855] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T19:04:21.491811] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-25T19:04:21.495292] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T19:04:22.288720] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-25T19:04:22.983841] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T19:04:23.088684] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-25T19:04:23.590633] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T19:04:23.603469] [INFO ] [REMOTE ] GIS: Full fetch complete (77650 records). [2025-09-25T19:04:23.603659] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-25T19:04:23.795564] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T19:04:23.893928] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-25T19:04:24.025340] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-25T19:04:24.025427] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-25T19:04:24.026423] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-25T19:04:24.026498] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-25T19:04:24.028144] [DEBUG] [LOCAL ] GIS: Trimmed 77650 records to 54065 (keeping 200 days of data) [2025-09-25T19:04:24.398403] [DEBUG] [LOCAL ] GIS: Primary data saved (54065 records). [2025-09-25T19:04:24.398722] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-25T19:04:24.400392] [INFO ] [MAIN ] Update Progress: 938/2372 symbols completed. GIS took 37.3s. Estimated remaining: 3h 10m 7s. Rate: 7.5 symbols/min [2025-09-25T19:04:24.596431] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:04:24.677707] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-25T19:04:24.683391] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-25T19:04:24.683820] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T19:04:24.698339] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-25T19:04:24.875419] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:24.875833] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-25T19:04:24.875892] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-25T19:04:24.876296] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-25T19:04:24.876361] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-25T19:04:25.251124] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:25.488769] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-25T19:04:25.612575] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T19:04:26.288784] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-25T19:04:26.998637] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T19:04:27.088768] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-25T19:04:27.364162] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T19:04:27.879679] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T19:04:27.888671] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-25T19:04:28.688737] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-25T19:04:28.803582] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T19:04:28.806518] [INFO ] [REMOTE ] GLP: Full fetch complete (14388 records). [2025-09-25T19:04:28.806620] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-25T19:04:29.182206] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-25T19:04:29.182305] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-25T19:04:29.183002] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-25T19:04:29.183071] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-25T19:04:29.183797] [DEBUG] [LOCAL ] GLP: Trimmed 14388 records to 9528 (keeping 200 days of data) [2025-09-25T19:04:29.253999] [DEBUG] [LOCAL ] GLP: Primary data saved (9528 records). [2025-09-25T19:04:29.254234] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-25T19:04:29.254409] [INFO ] [MAIN ] Update Progress: 939/2372 symbols completed. GLP took 12.6s. Estimated remaining: 3h 9m 54s. Rate: 7.5 symbols/min [2025-09-25T19:04:29.440260] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:04:29.497074] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-25T19:04:29.502245] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-25T19:04:29.502570] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-25T19:04:29.700635] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:29.700972] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-25T19:04:29.701023] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-25T19:04:29.701248] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-25T19:04:29.701307] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-25T19:04:30.081171] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:30.288792] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-25T19:04:30.518204] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T19:04:31.088694] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-25T19:04:31.422088] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T19:04:31.547110] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T19:04:31.888737] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-25T19:04:32.515112] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T19:04:32.688740] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-25T19:04:33.488692] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-25T19:04:33.919285] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T19:04:34.288761] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-25T19:04:34.907992] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-25T19:04:35.088714] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-25T19:04:35.365557] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T19:04:35.757160] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:04:35.888722] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-25T19:04:36.688733] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-25T19:04:37.215362] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-25T19:04:37.488741] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-25T19:04:37.871724] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T19:04:37.881449] [INFO ] [REMOTE ] GLOB: Full fetch complete (63515 records). [2025-09-25T19:04:37.881567] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-25T19:04:38.283760] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-25T19:04:38.283871] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-25T19:04:38.284996] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-25T19:04:38.285061] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-25T19:04:38.288742] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-25T19:04:38.290297] [DEBUG] [LOCAL ] GLOB: Trimmed 63515 records to 47734 (keeping 200 days of data) [2025-09-25T19:04:38.609328] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T19:04:38.631588] [DEBUG] [LOCAL ] GLOB: Primary data saved (47734 records). [2025-09-25T19:04:38.631753] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-25T19:04:38.631895] [INFO ] [MAIN ] Update Progress: 940/2372 symbols completed. GLOB took 39.0s. Estimated remaining: 3h 9m 48s. Rate: 7.5 symbols/min [2025-09-25T19:04:38.800471] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:04:38.856788] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-25T19:04:38.856972] [INFO ] [MAIN ] GME: Loaded 53761 existing records. [2025-09-25T19:04:39.035874] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:39.036119] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-25T19:04:39.036165] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-25T19:04:39.036402] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-25T19:04:39.036460] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-25T19:04:39.105284] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-25T19:04:39.420298] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:39.440837] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T19:04:39.448021] [INFO ] [REMOTE ] GL: Full fetch complete (55545 records). [2025-09-25T19:04:39.448141] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-25T19:04:39.574059] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-25T19:04:39.877435] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-25T19:04:39.877518] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-25T19:04:39.878332] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-25T19:04:39.878396] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-25T19:04:39.879567] [DEBUG] [LOCAL ] GL: Trimmed 55545 records to 38157 (keeping 200 days of data) [2025-09-25T19:04:39.888749] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-25T19:04:40.143685] [DEBUG] [LOCAL ] GL: Primary data saved (38157 records). [2025-09-25T19:04:40.143881] [INFO ] [MAIN ] GL: Full history saved. [2025-09-25T19:04:40.144853] [INFO ] [MAIN ] Update Progress: 941/2372 symbols completed. GL took 42.7s. Estimated remaining: 3h 9m 31s. Rate: 7.6 symbols/min [2025-09-25T19:04:40.315764] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:04:40.371631] [DEBUG] [LOCAL ] GMED: Loaded 48335 existing records from primary storage. [2025-09-25T19:04:40.371801] [INFO ] [MAIN ] GMED: Loaded 48335 existing records. [2025-09-25T19:04:40.603894] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:04:40.604167] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-25T19:04:40.604220] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-25T19:04:40.604533] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-25T19:04:40.604601] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-25T19:04:40.696195] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-25T19:04:40.969851] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:04:41.488795] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-25T19:04:41.757323] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (2.65 seconds). [2025-09-25T19:04:42.288758] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-25T19:04:43.248299] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-25T19:04:43.260160] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-25T19:04:44.348286] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T19:04:44.360855] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-25T19:04:44.387456] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-25T19:04:44.688792] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-25T19:04:45.163625] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:04:45.395820] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (4.70 seconds). [2025-09-25T19:04:45.488687] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-25T19:04:45.869090] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T19:04:45.913162] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T19:04:46.288787] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-25T19:04:47.088754] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-25T19:04:47.630263] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T19:04:47.888761] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-25T19:04:47.976410] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-25T19:04:48.688749] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-25T19:04:49.323703] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-25T19:04:49.488835] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-25T19:04:49.682471] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T19:04:50.288730] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-25T19:04:50.393842] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T19:04:51.088748] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-25T19:04:51.354165] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T19:04:51.888762] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-25T19:04:52.688779] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-25T19:04:53.502222] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (2.41 seconds). [2025-09-25T19:04:53.514599] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-25T19:04:53.599563] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-09-25T19:04:54.288834] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-25T19:04:55.084550] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (3.20 seconds). [2025-09-25T19:04:55.099340] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-25T19:04:55.469051] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-25T19:04:55.578201] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T19:04:55.888742] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-25T19:04:56.292630] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T19:04:56.688716] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-25T19:04:56.884848] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T19:04:57.447682] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T19:04:57.488678] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-25T19:04:58.288807] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-25T19:04:59.088769] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-25T19:04:59.206463] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:04:59.386848] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-25T19:04:59.888767] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-25T19:05:00.442774] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-25T19:05:00.453944] [INFO ] [REMOTE ] GLW: Full fetch complete (77616 records). [2025-09-25T19:05:00.454156] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-25T19:05:00.711338] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-25T19:05:00.902782] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-25T19:05:00.903158] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-25T19:05:00.904611] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-25T19:05:00.904731] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-25T19:05:00.907128] [DEBUG] [LOCAL ] GLW: Trimmed 77616 records to 54025 (keeping 200 days of data) [2025-09-25T19:05:01.209422] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-25T19:05:01.225053] [INFO ] [REMOTE ] GM: Full fetch complete (77821 records). [2025-09-25T19:05:01.226368] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-25T19:05:01.825072] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-25T19:05:01.826016] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-25T19:05:01.828820] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-25T19:05:01.829970] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-25T19:05:01.835971] [DEBUG] [LOCAL ] GM: Trimmed 77821 records to 54118 (keeping 200 days of data) [2025-09-25T19:05:01.908128] [DEBUG] [LOCAL ] GLW: Primary data saved (54025 records). [2025-09-25T19:05:01.918104] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-25T19:05:01.948291] [INFO ] [MAIN ] Update Progress: 942/2372 symbols completed. GLW took 37.5s. Estimated remaining: 3h 9m 44s. Rate: 7.5 symbols/min [2025-09-25T19:05:02.185680] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:02.244712] [DEBUG] [LOCAL ] GMRE: Loaded 37754 existing records from primary storage. [2025-09-25T19:05:02.245369] [INFO ] [MAIN ] GMRE: Loaded 37754 existing records. [2025-09-25T19:05:02.566764] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:02.569162] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-25T19:05:02.569592] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-25T19:05:02.571249] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-25T19:05:02.571992] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-25T19:05:02.757233] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T19:05:02.818607] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-25T19:05:03.202583] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:03.232727] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (3.34 seconds). [2025-09-25T19:05:03.237043] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-25T19:05:03.254350] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-25T19:05:03.279749] [DEBUG] [LOCAL ] GM: Primary data saved (54118 records). [2025-09-25T19:05:03.279939] [INFO ] [MAIN ] GM: Full history saved. [2025-09-25T19:05:03.280042] [INFO ] [MAIN ] Update Progress: 943/2372 symbols completed. GM took 34.0s. Estimated remaining: 3h 9m 26s. Rate: 7.5 symbols/min [2025-09-25T19:05:03.483548] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:03.508885] [DEBUG] [LOCAL ] GNE: Loaded 17738 existing records from primary storage. [2025-09-25T19:05:03.509049] [INFO ] [MAIN ] GNE: Loaded 17738 existing records. [2025-09-25T19:05:03.716904] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:03.717208] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-25T19:05:03.717258] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-25T19:05:03.717489] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-25T19:05:03.717549] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-25T19:05:04.094559] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:04.094940] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-25T19:05:04.839833] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T19:05:04.849504] [INFO ] [REMOTE ] GMED: Full fetch complete (69271 records). [2025-09-25T19:05:04.849726] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-25T19:05:05.137187] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:05:05.154106] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T19:05:05.204504] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-25T19:05:05.337854] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-25T19:05:05.337992] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-25T19:05:05.339235] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-25T19:05:05.339329] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-25T19:05:05.341303] [DEBUG] [LOCAL ] GMED: Trimmed 69271 records to 48718 (keeping 200 days of data) [2025-09-25T19:05:05.523033] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-25T19:05:05.652670] [DEBUG] [LOCAL ] GMED: Primary data saved (48718 records). [2025-09-25T19:05:05.652857] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-25T19:05:05.653456] [INFO ] [MAIN ] Update Progress: 944/2372 symbols completed. GMED took 25.5s. Estimated remaining: 3h 9m 9s. Rate: 7.5 symbols/min [2025-09-25T19:05:05.845805] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:05.892264] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-25T19:05:05.933474] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T19:05:05.952972] [DEBUG] [LOCAL ] GNK: Loaded 40546 existing records from primary storage. [2025-09-25T19:05:05.953137] [INFO ] [MAIN ] GNK: Loaded 40546 existing records. [2025-09-25T19:05:06.146094] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:06.146722] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-25T19:05:06.146797] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-25T19:05:06.147299] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-25T19:05:06.147360] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-25T19:05:06.294460] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-25T19:05:06.528521] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:06.738320] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T19:05:06.846060] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T19:05:07.088739] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-25T19:05:07.888711] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-25T19:05:07.969015] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T19:05:08.688808] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-25T19:05:09.488802] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-25T19:05:10.230953] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:05:10.288723] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-25T19:05:10.360195] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-25T19:05:10.404054] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T19:05:11.088799] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-25T19:05:11.665265] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T19:05:11.680979] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-25T19:05:11.888781] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-25T19:05:12.688703] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-25T19:05:12.842127] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T19:05:13.488760] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-25T19:05:14.148204] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T19:05:14.288732] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-25T19:05:14.737036] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T19:05:15.088777] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-25T19:05:15.635134] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:05:15.888788] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-25T19:05:16.682353] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T19:05:16.692111] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-25T19:05:17.488814] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-25T19:05:17.816775] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T19:05:18.288777] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-25T19:05:18.487843] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-25T19:05:18.944371] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T19:05:19.088767] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-25T19:05:19.888705] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-25T19:05:19.996887] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T19:05:20.237748] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T19:05:20.688763] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-25T19:05:21.488726] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-25T19:05:21.759969] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T19:05:21.763986] [INFO ] [REMOTE ] GNE: Full fetch complete (22334 records). [2025-09-25T19:05:21.764091] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-25T19:05:22.155785] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-25T19:05:22.155999] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-25T19:05:22.156556] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-25T19:05:22.156679] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-25T19:05:22.157507] [DEBUG] [LOCAL ] GNE: Trimmed 22334 records to 17844 (keeping 200 days of data) [2025-09-25T19:05:22.269791] [DEBUG] [LOCAL ] GNE: Primary data saved (17844 records). [2025-09-25T19:05:22.269972] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-25T19:05:22.270084] [INFO ] [MAIN ] Update Progress: 945/2372 symbols completed. GNE took 19.0s. Estimated remaining: 3h 9m 14s. Rate: 7.5 symbols/min [2025-09-25T19:05:22.303026] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-25T19:05:22.502824] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:22.507998] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-25T19:05:22.569841] [DEBUG] [LOCAL ] GNL: Loaded 47224 existing records from primary storage. [2025-09-25T19:05:22.570068] [INFO ] [MAIN ] GNL: Loaded 47224 existing records. [2025-09-25T19:05:22.763314] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:22.763900] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-25T19:05:22.764165] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-25T19:05:22.773437] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-25T19:05:22.773541] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-25T19:05:22.863483] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:05:23.093846] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-25T19:05:23.183940] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:23.570202] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T19:05:23.888787] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-25T19:05:24.560120] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T19:05:24.688783] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-25T19:05:25.488720] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-25T19:05:25.560329] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T19:05:25.818874] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T19:05:26.288755] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-25T19:05:26.870140] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T19:05:27.088748] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-25T19:05:27.684283] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T19:05:27.888764] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-25T19:05:28.257602] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T19:05:28.688739] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-25T19:05:29.488803] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-25T19:05:30.288726] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-25T19:05:30.324839] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T19:05:30.332456] [INFO ] [REMOTE ] GNK: Full fetch complete (56923 records). [2025-09-25T19:05:30.332587] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-25T19:05:30.744041] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-25T19:05:30.759339] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-25T19:05:30.771111] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-25T19:05:30.773477] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-25T19:05:30.772027] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-25T19:05:30.785434] [INFO ] [REMOTE ] GME: Full fetch complete (77921 records). [2025-09-25T19:05:30.785560] [DEBUG] [LOCAL ] GNK: Trimmed 56923 records to 40802 (keeping 200 days of data) [2025-09-25T19:05:30.785951] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-25T19:05:31.001218] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T19:05:31.103626] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-25T19:05:31.363515] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-25T19:05:31.364131] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-25T19:05:31.365679] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-25T19:05:31.365767] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-25T19:05:31.369534] [DEBUG] [LOCAL ] GME: Trimmed 77921 records to 54151 (keeping 200 days of data) [2025-09-25T19:05:31.730888] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T19:05:31.749564] [DEBUG] [LOCAL ] GNK: Primary data saved (40802 records). [2025-09-25T19:05:31.750473] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-25T19:05:31.751961] [INFO ] [MAIN ] Update Progress: 946/2372 symbols completed. GNK took 26.1s. Estimated remaining: 3h 9m 9s. Rate: 7.5 symbols/min [2025-09-25T19:05:31.899918] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-25T19:05:31.934360] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:32.050551] [DEBUG] [LOCAL ] GNRC: Loaded 45192 existing records from primary storage. [2025-09-25T19:05:32.051327] [INFO ] [MAIN ] GNRC: Loaded 45192 existing records. [2025-09-25T19:05:32.242128] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:32.243992] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-25T19:05:32.244343] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-25T19:05:32.245736] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-25T19:05:32.246143] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-25T19:05:32.375534] [DEBUG] [LOCAL ] GME: Primary data saved (54151 records). [2025-09-25T19:05:32.386413] [INFO ] [MAIN ] GME: Full history saved. [2025-09-25T19:05:32.419485] [INFO ] [MAIN ] Update Progress: 947/2372 symbols completed. GME took 53.8s. Estimated remaining: 3h 8m 50s. Rate: 7.5 symbols/min [2025-09-25T19:05:32.799715] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:32.803163] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:32.804100] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-25T19:05:32.817102] [DEBUG] [LOCAL ] GNT: Loaded 8041 existing records from primary storage. [2025-09-25T19:05:32.817493] [INFO ] [MAIN ] GNT: Loaded 8041 existing records. [2025-09-25T19:05:32.949224] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T19:05:33.039667] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:33.039959] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-25T19:05:33.040010] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-25T19:05:33.040245] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-25T19:05:33.040306] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-25T19:05:33.437883] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T19:05:33.472419] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:33.473915] [INFO ] [REMOTE ] GMRE: Full fetch complete (53648 records). [2025-09-25T19:05:33.474130] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-25T19:05:33.496199] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-25T19:05:33.863355] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-25T19:05:33.863468] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-25T19:05:33.864352] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-25T19:05:33.864420] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-25T19:05:33.865845] [DEBUG] [LOCAL ] GMRE: Trimmed 53648 records to 37959 (keeping 200 days of data) [2025-09-25T19:05:34.099000] [DEBUG] [LOCAL ] GMRE: Primary data saved (37959 records). [2025-09-25T19:05:34.099171] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-25T19:05:34.099265] [INFO ] [MAIN ] Update Progress: 948/2372 symbols completed. GMRE took 32.1s. Estimated remaining: 3h 8m 33s. Rate: 7.6 symbols/min [2025-09-25T19:05:34.279802] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:34.290209] [DEBUG] [LOCAL ] GNTY: Loaded 7230 existing records from primary storage. [2025-09-25T19:05:34.289979] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-25T19:05:34.290427] [INFO ] [MAIN ] GNTY: Loaded 7230 existing records. [2025-09-25T19:05:34.485587] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:34.486214] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-25T19:05:34.486376] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-25T19:05:34.486847] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-25T19:05:34.486920] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-25T19:05:34.664942] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T19:05:34.931719] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:34.951373] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T19:05:35.088727] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-25T19:05:35.222112] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T19:05:35.888763] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-25T19:05:36.700472] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-25T19:05:36.703490] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:05:37.183793] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-25T19:05:37.488713] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-25T19:05:37.561869] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:05:38.288740] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-25T19:05:39.088798] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-25T19:05:39.127090] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:05:39.773543] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T19:05:39.889121] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-25T19:05:40.080356] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T19:05:40.557315] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T19:05:40.688755] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-25T19:05:41.488779] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-25T19:05:42.279476] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T19:05:42.298025] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-25T19:05:42.324304] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:05:43.093767] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-25T19:05:43.102217] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T19:05:43.888756] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-25T19:05:44.634795] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T19:05:44.688749] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-25T19:05:44.740506] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T19:05:45.492853] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-25T19:05:45.498500] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:05:46.288734] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-25T19:05:46.878517] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T19:05:47.088783] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-25T19:05:47.161549] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:05:47.690927] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T19:05:47.888761] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-25T19:05:48.603367] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T19:05:48.688754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-25T19:05:49.488810] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-25T19:05:50.161159] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T19:05:50.295567] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-25T19:05:50.301976] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:05:51.088781] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-25T19:05:51.888726] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-25T19:05:51.962330] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T19:05:52.677801] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:05:52.688691] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-25T19:05:52.721231] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T19:05:53.175208] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-25T19:05:53.488794] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-25T19:05:54.288753] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-25T19:05:55.013076] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T19:05:55.070299] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T19:05:55.088692] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-25T19:05:55.888823] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-25T19:05:56.688719] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-25T19:05:56.698988] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T19:05:56.901399] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T19:05:56.911709] [INFO ] [REMOTE ] GNL: Full fetch complete (68473 records). [2025-09-25T19:05:56.912002] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-25T19:05:57.335252] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-25T19:05:57.335354] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-25T19:05:57.336669] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-25T19:05:57.336762] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-25T19:05:57.338707] [DEBUG] [LOCAL ] GNL: Trimmed 68473 records to 47530 (keeping 200 days of data) [2025-09-25T19:05:57.346900] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T19:05:57.528226] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-25T19:05:57.652108] [DEBUG] [LOCAL ] GNL: Primary data saved (47530 records). [2025-09-25T19:05:57.652306] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-25T19:05:57.652413] [INFO ] [MAIN ] Update Progress: 949/2372 symbols completed. GNL took 35.4s. Estimated remaining: 3h 8m 48s. Rate: 7.5 symbols/min [2025-09-25T19:05:57.837094] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:05:57.893257] [DEBUG] [LOCAL ] GNW: Loaded 51325 existing records from primary storage. [2025-09-25T19:05:57.893568] [INFO ] [MAIN ] GNW: Loaded 51325 existing records. [2025-09-25T19:05:58.086306] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:05:58.086736] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-25T19:05:58.086795] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-25T19:05:58.087110] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-25T19:05:58.087173] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-25T19:05:58.296087] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-25T19:05:58.419401] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T19:05:58.508231] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:05:59.088768] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-25T19:05:59.477571] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T19:05:59.482109] [INFO ] [REMOTE ] GNT: Full fetch complete (10646 records). [2025-09-25T19:05:59.482258] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-25T19:05:59.921887] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-25T19:05:59.932639] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-25T19:05:59.932787] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-25T19:05:59.933141] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-25T19:05:59.933186] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-25T19:05:59.933951] [DEBUG] [LOCAL ] GNT: Trimmed 10646 records to 8105 (keeping 200 days of data) [2025-09-25T19:05:59.987942] [DEBUG] [LOCAL ] GNT: Primary data saved (8105 records). [2025-09-25T19:05:59.988146] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-25T19:05:59.988327] [INFO ] [MAIN ] Update Progress: 950/2372 symbols completed. GNT took 27.6s. Estimated remaining: 3h 8m 32s. Rate: 7.5 symbols/min [2025-09-25T19:06:00.171183] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:00.217288] [DEBUG] [LOCAL ] GOF: Loaded 42829 existing records from primary storage. [2025-09-25T19:06:00.217503] [INFO ] [MAIN ] GOF: Loaded 42829 existing records. [2025-09-25T19:06:00.432820] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:00.433200] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-25T19:06:00.433290] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-25T19:06:00.433743] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-25T19:06:00.433806] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-25T19:06:00.695219] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-25T19:06:00.860391] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:00.898611] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T19:06:00.900583] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T19:06:00.914142] [INFO ] [REMOTE ] GNTY: Full fetch complete (10315 records). [2025-09-25T19:06:00.914979] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-25T19:06:01.314471] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-25T19:06:01.314611] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-25T19:06:01.315032] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-25T19:06:01.315125] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-25T19:06:01.315939] [DEBUG] [LOCAL ] GNTY: Trimmed 10315 records to 7283 (keeping 200 days of data) [2025-09-25T19:06:01.363850] [DEBUG] [LOCAL ] GNTY: Primary data saved (7283 records). [2025-09-25T19:06:01.364031] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-25T19:06:01.364142] [INFO ] [MAIN ] Update Progress: 951/2372 symbols completed. GNTY took 27.3s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-25T19:06:01.494150] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-25T19:06:01.579670] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:01.626297] [DEBUG] [LOCAL ] GOLF: Loaded 31640 existing records from primary storage. [2025-09-25T19:06:01.626500] [INFO ] [MAIN ] GOLF: Loaded 31640 existing records. [2025-09-25T19:06:01.838205] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:01.838534] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-25T19:06:01.838586] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-25T19:06:01.838941] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-25T19:06:01.839004] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-25T19:06:02.228277] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:02.288765] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-25T19:06:02.588008] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T19:06:03.088725] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-25T19:06:03.270601] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T19:06:03.888731] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-25T19:06:03.983016] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T19:06:04.688745] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-25T19:06:04.784686] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T19:06:04.995884] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:06:05.488832] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-25T19:06:06.244854] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T19:06:06.288824] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-25T19:06:06.593245] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T19:06:07.088809] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-25T19:06:07.685951] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:06:07.695623] [INFO ] [REMOTE ] GNRC: Full fetch complete (65252 records). [2025-09-25T19:06:07.695854] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-25T19:06:07.894086] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-25T19:06:08.136237] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-25T19:06:08.136405] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-25T19:06:08.137672] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-25T19:06:08.137742] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-25T19:06:08.139259] [DEBUG] [LOCAL ] GNRC: Trimmed 65252 records to 45546 (keeping 200 days of data) [2025-09-25T19:06:08.433435] [DEBUG] [LOCAL ] GNRC: Primary data saved (45546 records). [2025-09-25T19:06:08.433743] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-25T19:06:08.434509] [INFO ] [MAIN ] Update Progress: 952/2372 symbols completed. GNRC took 36.7s. Estimated remaining: 3h 8m 5s. Rate: 7.6 symbols/min [2025-09-25T19:06:08.628089] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:08.673901] [DEBUG] [LOCAL ] GOOS: Loaded 45448 existing records from primary storage. [2025-09-25T19:06:08.674061] [INFO ] [MAIN ] GOOS: Loaded 45448 existing records. [2025-09-25T19:06:08.708092] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-25T19:06:08.847132] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T19:06:08.917194] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:08.917542] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-25T19:06:08.917601] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-25T19:06:08.917910] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-25T19:06:08.917972] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-25T19:06:09.281094] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:09.488690] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-25T19:06:09.751148] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T19:06:10.126295] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:06:10.288701] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-25T19:06:10.937110] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T19:06:11.088680] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-25T19:06:11.888701] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-25T19:06:11.943098] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T19:06:12.184835] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T19:06:12.688736] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-25T19:06:13.224229] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T19:06:13.488721] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-25T19:06:14.288777] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-25T19:06:14.360971] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T19:06:14.870614] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T19:06:15.088724] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-25T19:06:15.888696] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-25T19:06:16.133149] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T19:06:16.688774] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-25T19:06:16.792895] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T19:06:17.033376] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T19:06:17.488786] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-25T19:06:17.594146] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T19:06:18.288775] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-25T19:06:19.071024] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T19:06:19.088698] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-25T19:06:19.888770] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-25T19:06:19.937957] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T19:06:20.688804] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-25T19:06:20.946356] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T19:06:21.398462] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T19:06:21.488770] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-25T19:06:22.288761] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-25T19:06:22.333357] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T19:06:22.796533] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T19:06:23.088741] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-25T19:06:23.555841] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T19:06:23.888759] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-25T19:06:24.481070] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T19:06:24.688765] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-25T19:06:25.105633] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T19:06:25.488787] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-25T19:06:26.084810] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:06:26.288775] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-25T19:06:26.674136] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T19:06:27.088764] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-25T19:06:27.183747] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T19:06:27.191379] [INFO ] [REMOTE ] GOLF: Full fetch complete (44870 records). [2025-09-25T19:06:27.191520] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-25T19:06:27.585684] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-25T19:06:27.585830] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-25T19:06:27.586817] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-25T19:06:27.586946] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-25T19:06:27.589168] [DEBUG] [LOCAL ] GOLF: Trimmed 44870 records to 31843 (keeping 200 days of data) [2025-09-25T19:06:27.796478] [DEBUG] [LOCAL ] GOLF: Primary data saved (31843 records). [2025-09-25T19:06:27.796698] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-25T19:06:27.796822] [INFO ] [MAIN ] Update Progress: 953/2372 symbols completed. GOLF took 26.4s. Estimated remaining: 3h 8m 14s. Rate: 7.5 symbols/min [2025-09-25T19:06:27.895689] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-25T19:06:27.990741] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:28.046165] [DEBUG] [LOCAL ] GOTU: Loaded 38964 existing records from primary storage. [2025-09-25T19:06:28.046406] [INFO ] [MAIN ] GOTU: Loaded 38964 existing records. [2025-09-25T19:06:28.247417] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:28.247945] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-25T19:06:28.248015] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-25T19:06:28.249788] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-25T19:06:28.249883] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-25T19:06:28.647552] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:28.685684] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T19:06:28.696050] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-25T19:06:29.488768] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-25T19:06:29.679562] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T19:06:30.288750] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-25T19:06:30.345304] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T19:06:31.088767] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-25T19:06:31.147991] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T19:06:31.735617] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:06:31.888754] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-25T19:06:32.704287] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-25T19:06:32.736167] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T19:06:33.488753] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-25T19:06:33.541005] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T19:06:34.288713] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-25T19:06:34.581827] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T19:06:34.595455] [INFO ] [REMOTE ] GNW: Full fetch complete (73505 records). [2025-09-25T19:06:34.595749] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-25T19:06:35.048858] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-25T19:06:35.048966] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-25T19:06:35.050366] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-25T19:06:35.050686] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-25T19:06:35.052684] [DEBUG] [LOCAL ] GNW: Trimmed 73505 records to 51708 (keeping 200 days of data) [2025-09-25T19:06:35.104979] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-25T19:06:35.367599] [DEBUG] [LOCAL ] GNW: Primary data saved (51708 records). [2025-09-25T19:06:35.368003] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-25T19:06:35.368184] [INFO ] [MAIN ] Update Progress: 954/2372 symbols completed. GNW took 37.7s. Estimated remaining: 3h 8m 5s. Rate: 7.5 symbols/min [2025-09-25T19:06:35.473639] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T19:06:35.531367] [INFO ] [REMOTE ] GOOS: Full fetch complete (65820 records). [2025-09-25T19:06:35.542153] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-25T19:06:35.602581] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:35.929432] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T19:06:35.996894] [DEBUG] [LOCAL ] GPC: Loaded 46651 existing records from primary storage. [2025-09-25T19:06:35.997415] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-25T19:06:35.997676] [INFO ] [MAIN ] GPC: Loaded 46651 existing records. [2025-09-25T19:06:36.260530] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-25T19:06:36.276617] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-25T19:06:36.283737] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-25T19:06:36.291124] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-25T19:06:36.330821] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:36.331453] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-25T19:06:36.331820] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-25T19:06:36.332215] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-25T19:06:36.332136] [DEBUG] [LOCAL ] GOOS: Trimmed 65820 records to 45704 (keeping 200 days of data) [2025-09-25T19:06:36.332879] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-25T19:06:36.842748] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:36.844527] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-25T19:06:36.879440] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T19:06:37.063244] [DEBUG] [LOCAL ] GOOS: Primary data saved (45704 records). [2025-09-25T19:06:37.063448] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-25T19:06:37.064251] [INFO ] [MAIN ] Update Progress: 955/2372 symbols completed. GOOS took 28.6s. Estimated remaining: 3h 7m 48s. Rate: 7.5 symbols/min [2025-09-25T19:06:37.256262] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:37.281034] [DEBUG] [LOCAL ] GPI: Loaded 14850 existing records from primary storage. [2025-09-25T19:06:37.281249] [INFO ] [MAIN ] GPI: Loaded 14850 existing records. [2025-09-25T19:06:37.476374] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:37.477077] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-25T19:06:37.477245] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-25T19:06:37.477748] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-25T19:06:37.477813] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-25T19:06:37.511004] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-25T19:06:37.927603] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:06:37.932394] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:37.942090] [INFO ] [REMOTE ] GOF: Full fetch complete (62225 records). [2025-09-25T19:06:37.942284] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-25T19:06:38.290156] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-25T19:06:38.351541] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-25T19:06:38.351822] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-25T19:06:38.352930] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-25T19:06:38.353073] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-25T19:06:38.355139] [DEBUG] [LOCAL ] GOF: Trimmed 62225 records to 43105 (keeping 200 days of data) [2025-09-25T19:06:38.527149] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T19:06:38.677710] [DEBUG] [LOCAL ] GOF: Primary data saved (43105 records). [2025-09-25T19:06:38.677876] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-25T19:06:38.678008] [INFO ] [MAIN ] Update Progress: 956/2372 symbols completed. GOF took 38.7s. Estimated remaining: 3h 7m 30s. Rate: 7.6 symbols/min [2025-09-25T19:06:38.852547] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:06:38.861752] [DEBUG] [LOCAL ] GPJA: Loaded 4086 existing records from primary storage. [2025-09-25T19:06:38.861911] [INFO ] [MAIN ] GPJA: Loaded 4086 existing records. [2025-09-25T19:06:39.063180] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:06:39.073438] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-25T19:06:39.075289] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-25T19:06:39.075072] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T19:06:39.078600] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-25T19:06:39.079765] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-25T19:06:39.093917] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-25T19:06:39.403424] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:06:39.522372] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:06:39.888774] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-25T19:06:40.688730] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-25T19:06:40.754723] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T19:06:40.847384] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T19:06:41.488815] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-25T19:06:42.288776] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-25T19:06:42.485142] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T19:06:42.503730] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T19:06:43.088772] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-25T19:06:43.650480] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T19:06:43.888756] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-25T19:06:44.242213] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:06:44.688770] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-25T19:06:45.488785] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-25T19:06:45.679621] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T19:06:46.275851] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:06:46.288675] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-25T19:06:46.701953] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T19:06:47.088751] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-25T19:06:47.758383] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T19:06:47.888819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-25T19:06:48.688837] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-25T19:06:48.918812] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:06:49.379710] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:06:49.488733] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-25T19:06:49.872201] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T19:06:50.288741] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-25T19:06:50.919432] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T19:06:51.088732] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-25T19:06:51.151150] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:06:51.787661] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T19:06:51.888784] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-25T19:06:52.688771] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-25T19:06:53.295687] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T19:06:53.304398] [INFO ] [REMOTE ] GOTU: Full fetch complete (59732 records). [2025-09-25T19:06:53.304684] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-25T19:06:53.513520] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-25T19:06:53.665420] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:06:53.851330] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-25T19:06:53.851462] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-25T19:06:53.852585] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-25T19:06:53.852691] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-25T19:06:53.854753] [DEBUG] [LOCAL ] GOTU: Trimmed 59732 records to 39241 (keeping 200 days of data) [2025-09-25T19:06:54.109742] [DEBUG] [LOCAL ] GOTU: Primary data saved (39241 records). [2025-09-25T19:06:54.109989] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-25T19:06:54.110175] [INFO ] [MAIN ] Update Progress: 957/2372 symbols completed. GOTU took 26.3s. Estimated remaining: 3h 7m 34s. Rate: 7.5 symbols/min [2025-09-25T19:06:54.288809] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-25T19:06:54.625222] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T19:06:54.819830] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T19:06:55.088755] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-25T19:06:55.635449] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T19:06:55.888769] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-25T19:06:56.688775] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-25T19:06:56.901078] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T19:06:57.260579] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:06:57.488742] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-25T19:06:58.288738] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-25T19:06:58.435479] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T19:06:59.088814] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-25T19:06:59.828206] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T19:06:59.870842] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:06:59.888687] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-25T19:07:00.688751] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-25T19:07:01.488806] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-25T19:07:01.889708] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T19:07:01.894039] [INFO ] [REMOTE ] GPI: Full fetch complete (20914 records). [2025-09-25T19:07:01.894336] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-25T19:07:02.182042] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T19:07:02.288888] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-25T19:07:02.387932] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-25T19:07:02.387805] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-25T19:07:02.388109] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-25T19:07:02.399302] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-25T19:07:02.399666] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-25T19:07:02.401426] [DEBUG] [LOCAL ] GPI: Trimmed 20914 records to 15035 (keeping 200 days of data) [2025-09-25T19:07:02.512162] [DEBUG] [LOCAL ] GPI: Primary data saved (15035 records). [2025-09-25T19:07:02.512342] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-25T19:07:02.512436] [INFO ] [MAIN ] Update Progress: 958/2372 symbols completed. GPI took 25.4s. Estimated remaining: 3h 7m 26s. Rate: 7.5 symbols/min [2025-09-25T19:07:03.047879] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T19:07:03.088759] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-25T19:07:03.888787] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-25T19:07:04.486477] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T19:07:04.654851] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T19:07:04.688709] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-25T19:07:05.488779] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-25T19:07:06.401844] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T19:07:06.403560] [INFO ] [REMOTE ] GPJA: Full fetch complete (7277 records). [2025-09-25T19:07:06.403663] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-25T19:07:06.601593] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T19:07:06.721179] [INFO ] [REMOTE ] GPC: Full fetch complete (69135 records). [2025-09-25T19:07:06.735162] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-25T19:07:07.017308] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-25T19:07:07.039160] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-25T19:07:07.057120] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-25T19:07:07.059715] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-25T19:07:07.126734] [DEBUG] [LOCAL ] GPJA: Trimmed 7277 records to 4119 (keeping 200 days of data) [2025-09-25T19:07:07.323286] [DEBUG] [LOCAL ] GPJA: Primary data saved (4119 records). [2025-09-25T19:07:07.323536] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-25T19:07:07.323631] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-25T19:07:07.323805] [INFO ] [MAIN ] Update Progress: 959/2372 symbols completed. GPJA took 28.6s. Estimated remaining: 3h 7m 14s. Rate: 7.5 symbols/min [2025-09-25T19:07:07.323976] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-25T19:07:07.325751] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-25T19:07:07.325839] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-25T19:07:07.328207] [DEBUG] [LOCAL ] GPC: Trimmed 69135 records to 46980 (keeping 200 days of data) [2025-09-25T19:07:07.656972] [DEBUG] [LOCAL ] GPC: Primary data saved (46980 records). [2025-09-25T19:07:07.657152] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-25T19:07:07.657262] [INFO ] [MAIN ] Update Progress: 960/2372 symbols completed. GPC took 32.3s. Estimated remaining: 3h 6m 55s. Rate: 7.6 symbols/min [2025-09-25T19:07:08.266184] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:08.308392] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:08.387813] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:08.418089] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:08.448123] [DEBUG] [LOCAL ] GPMT: Loaded 26624 existing records from primary storage. [2025-09-25T19:07:08.456412] [INFO ] [MAIN ] GPMT: Loaded 26624 existing records. [2025-09-25T19:07:08.477998] [DEBUG] [LOCAL ] GPOR: Loaded 22883 existing records from primary storage. [2025-09-25T19:07:08.508808] [INFO ] [MAIN ] GPOR: Loaded 22883 existing records. [2025-09-25T19:07:08.881730] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:08.881963] [DEBUG] [LOCAL ] GPN: Loaded 52089 existing records from primary storage. [2025-09-25T19:07:08.888872] [DEBUG] [LOCAL ] GPK: Loaded 52671 existing records from primary storage. [2025-09-25T19:07:08.910397] [INFO ] [MAIN ] GPK: Loaded 52671 existing records. [2025-09-25T19:07:08.916042] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-25T19:07:08.904859] [INFO ] [MAIN ] GPN: Loaded 52089 existing records. [2025-09-25T19:07:08.950763] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-25T19:07:09.096373] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-25T19:07:09.137274] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:09.127613] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-25T19:07:09.169764] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-25T19:07:09.302813] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-25T19:07:09.391693] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-25T19:07:09.402340] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-25T19:07:09.680215] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:09.766465] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:09.766888] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-25T19:07:09.772416] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-25T19:07:09.806754] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-25T19:07:09.839044] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-25T19:07:09.833629] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-25T19:07:09.886917] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-25T19:07:09.895968] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-25T19:07:09.909555] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-25T19:07:10.276974] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:10.306611] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-25T19:07:10.748345] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:10.781943] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-25T19:07:10.896964] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:10.907812] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-25T19:07:10.977947] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:10.978270] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-25T19:07:11.793759] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T19:07:11.800497] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-25T19:07:11.879328] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T19:07:11.885698] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-25T19:07:12.604515] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T19:07:12.614831] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-25T19:07:13.001506] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T19:07:13.007057] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-25T19:07:13.100738] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T19:07:13.106921] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-25T19:07:14.223006] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T19:07:14.221742] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:07:14.238799] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-25T19:07:14.293572] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-25T19:07:14.299548] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (3.39 seconds). [2025-09-25T19:07:14.363581] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T19:07:15.088779] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-25T19:07:15.421419] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T19:07:15.888685] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-25T19:07:15.934730] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:07:15.959586] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T19:07:16.688734] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-25T19:07:17.268961] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T19:07:17.488723] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-25T19:07:17.909606] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T19:07:18.288733] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-25T19:07:19.088763] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-25T19:07:19.142689] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T19:07:19.886907] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T19:07:19.890690] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-25T19:07:20.260994] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T19:07:20.688761] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-25T19:07:21.229201] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T19:07:21.488783] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-25T19:07:22.288819] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-25T19:07:22.335549] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T19:07:22.668913] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T19:07:23.088799] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-25T19:07:23.888730] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-25T19:07:24.069005] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T19:07:24.688827] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-25T19:07:24.893157] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T19:07:25.389465] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:07:25.488776] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-25T19:07:25.538158] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T19:07:26.288751] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-25T19:07:27.088726] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-25T19:07:27.418718] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T19:07:27.660029] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:07:27.888703] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-25T19:07:28.165126] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T19:07:28.688777] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-25T19:07:29.488707] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-25T19:07:29.811966] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T19:07:29.839931] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T19:07:30.288711] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-25T19:07:30.517807] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T19:07:31.088812] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-25T19:07:31.888732] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-25T19:07:32.129314] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T19:07:32.133559] [INFO ] [REMOTE ] GPMT: Full fetch complete (37636 records). [2025-09-25T19:07:32.133832] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-25T19:07:32.275585] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T19:07:32.595880] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-25T19:07:32.595978] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-25T19:07:32.596701] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-25T19:07:32.596766] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-25T19:07:32.597816] [DEBUG] [LOCAL ] GPMT: Trimmed 37636 records to 26703 (keeping 200 days of data) [2025-09-25T19:07:32.689750] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-25T19:07:32.764775] [DEBUG] [LOCAL ] GPMT: Primary data saved (26703 records). [2025-09-25T19:07:32.764950] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-25T19:07:32.765075] [INFO ] [MAIN ] Update Progress: 961/2372 symbols completed. GPMT took 25.1s. Estimated remaining: 3h 7m 12s. Rate: 7.5 symbols/min [2025-09-25T19:07:32.950081] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:32.991169] [DEBUG] [LOCAL ] GPRK: Loaded 39123 existing records from primary storage. [2025-09-25T19:07:32.991331] [INFO ] [MAIN ] GPRK: Loaded 39123 existing records. [2025-09-25T19:07:33.186911] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:33.187304] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-25T19:07:33.187467] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-25T19:07:33.192924] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-25T19:07:33.203416] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-25T19:07:33.267530] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T19:07:33.323622] [INFO ] [REMOTE ] GPOR: Full fetch complete (34922 records). [2025-09-25T19:07:33.326852] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-25T19:07:33.492134] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-25T19:07:33.985996] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:34.015047] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-25T19:07:34.015145] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-25T19:07:34.015846] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-25T19:07:34.015909] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-25T19:07:34.016828] [DEBUG] [LOCAL ] GPOR: Trimmed 34922 records to 23115 (keeping 200 days of data) [2025-09-25T19:07:34.155910] [DEBUG] [LOCAL ] GPOR: Primary data saved (23115 records). [2025-09-25T19:07:34.156067] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-25T19:07:34.156158] [INFO ] [MAIN ] Update Progress: 962/2372 symbols completed. GPOR took 26.5s. Estimated remaining: 3h 6m 54s. Rate: 7.5 symbols/min [2025-09-25T19:07:34.307137] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-25T19:07:34.334139] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:34.365548] [DEBUG] [LOCAL ] GRBK: Loaded 26986 existing records from primary storage. [2025-09-25T19:07:34.365821] [INFO ] [MAIN ] GRBK: Loaded 26986 existing records. [2025-09-25T19:07:34.583155] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:34.584107] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-25T19:07:34.585411] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T19:07:34.585522] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-25T19:07:34.597360] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-25T19:07:34.597428] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-25T19:07:34.976544] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:35.014749] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T19:07:35.088690] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-25T19:07:35.417666] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:07:35.888765] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-25T19:07:36.460046] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T19:07:36.688720] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-25T19:07:37.488721] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-25T19:07:37.681874] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T19:07:37.712621] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T19:07:38.288740] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-25T19:07:39.037841] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T19:07:39.088779] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-25T19:07:39.248538] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T19:07:39.888775] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-25T19:07:40.688698] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-25T19:07:40.962548] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T19:07:40.973015] [INFO ] [REMOTE ] GPK: Full fetch complete (75439 records). [2025-09-25T19:07:40.973162] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-25T19:07:41.402130] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-25T19:07:41.402399] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-25T19:07:41.403444] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-25T19:07:41.410972] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-25T19:07:41.425538] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T19:07:41.434866] [DEBUG] [LOCAL ] GPK: Trimmed 75439 records to 53051 (keeping 200 days of data) [2025-09-25T19:07:41.496517] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-25T19:07:41.796425] [DEBUG] [LOCAL ] GPK: Primary data saved (53051 records). [2025-09-25T19:07:41.796612] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-25T19:07:41.796752] [INFO ] [MAIN ] Update Progress: 963/2372 symbols completed. GPK took 34.1s. Estimated remaining: 3h 6m 46s. Rate: 7.5 symbols/min [2025-09-25T19:07:41.968021] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:41.981552] [DEBUG] [LOCAL ] GRC: Loaded 8920 existing records from primary storage. [2025-09-25T19:07:41.981793] [INFO ] [MAIN ] GRC: Loaded 8920 existing records. [2025-09-25T19:07:42.179225] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:42.179734] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-25T19:07:42.179797] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-25T19:07:42.180132] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-25T19:07:42.180194] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-25T19:07:42.291200] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-25T19:07:42.620032] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:42.653711] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T19:07:43.011289] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:07:43.088681] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-25T19:07:43.680425] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T19:07:43.888727] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-25T19:07:44.262750] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T19:07:44.605375] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T19:07:44.688733] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-25T19:07:45.488733] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-25T19:07:46.288698] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-25T19:07:46.468193] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T19:07:46.491776] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T19:07:47.088730] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-25T19:07:47.673462] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T19:07:47.888777] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-25T19:07:48.657684] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T19:07:48.688710] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-25T19:07:48.874208] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T19:07:48.884277] [INFO ] [REMOTE ] GPN: Full fetch complete (74813 records). [2025-09-25T19:07:48.884477] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-25T19:07:49.275617] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-25T19:07:49.275743] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-25T19:07:49.276855] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-25T19:07:49.276921] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-25T19:07:49.278519] [DEBUG] [LOCAL ] GPN: Trimmed 74813 records to 52461 (keeping 200 days of data) [2025-09-25T19:07:49.495901] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-25T19:07:49.618584] [DEBUG] [LOCAL ] GPN: Primary data saved (52461 records). [2025-09-25T19:07:49.618791] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-25T19:07:49.620126] [INFO ] [MAIN ] Update Progress: 964/2372 symbols completed. GPN took 42.0s. Estimated remaining: 3h 6m 38s. Rate: 7.5 symbols/min [2025-09-25T19:07:49.803545] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:07:49.827279] [DEBUG] [LOCAL ] GRDN: Loaded 19770 existing records from primary storage. [2025-09-25T19:07:49.827450] [INFO ] [MAIN ] GRDN: Loaded 19770 existing records. [2025-09-25T19:07:50.021749] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:07:50.022280] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-25T19:07:50.022491] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-25T19:07:50.022811] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-25T19:07:50.022872] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-25T19:07:50.294024] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-25T19:07:50.424922] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:07:50.421871] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T19:07:50.446908] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:07:51.088726] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-25T19:07:51.722058] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T19:07:51.888774] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-25T19:07:51.905866] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T19:07:52.688761] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-25T19:07:53.036108] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T19:07:53.488777] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-25T19:07:54.086171] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:07:54.288744] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-25T19:07:54.424507] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T19:07:55.088766] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-25T19:07:55.658301] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T19:07:55.888727] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-25T19:07:55.901628] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:07:56.688816] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-25T19:07:57.113965] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T19:07:57.488741] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-25T19:07:57.631172] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T19:07:58.288748] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-25T19:07:59.087964] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T19:07:59.096407] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-25T19:07:59.210882] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T19:07:59.888748] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-25T19:07:59.913732] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T19:08:00.688763] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-25T19:08:01.307777] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T19:08:01.488754] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-25T19:08:01.701868] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T19:08:02.288759] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-25T19:08:02.738692] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T19:08:02.743847] [INFO ] [REMOTE ] GRBK: Full fetch complete (40644 records). [2025-09-25T19:08:02.743934] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-25T19:08:03.092896] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-25T19:08:03.128214] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-25T19:08:03.128383] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-25T19:08:03.129403] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-25T19:08:03.129466] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-25T19:08:03.130452] [DEBUG] [LOCAL ] GRBK: Trimmed 40644 records to 27195 (keeping 200 days of data) [2025-09-25T19:08:03.295015] [DEBUG] [LOCAL ] GRBK: Primary data saved (27195 records). [2025-09-25T19:08:03.295189] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-25T19:08:03.295298] [INFO ] [MAIN ] Update Progress: 965/2372 symbols completed. GRBK took 29.1s. Estimated remaining: 3h 6m 38s. Rate: 7.5 symbols/min [2025-09-25T19:08:03.469598] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:03.512280] [DEBUG] [LOCAL ] GRMN: Loaded 41352 existing records from primary storage. [2025-09-25T19:08:03.512439] [INFO ] [MAIN ] GRMN: Loaded 41352 existing records. [2025-09-25T19:08:03.706707] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:03.706997] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-25T19:08:03.707046] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-25T19:08:03.707407] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-25T19:08:03.707467] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-25T19:08:03.898773] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-25T19:08:04.051892] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T19:08:04.053742] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:08:04.096523] [INFO ] [REMOTE ] GPRK: Full fetch complete (57224 records). [2025-09-25T19:08:04.119308] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-25T19:08:04.222509] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:04.555797] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-25T19:08:04.555898] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-25T19:08:04.556925] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-25T19:08:04.556993] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-25T19:08:04.558375] [DEBUG] [LOCAL ] GPRK: Trimmed 57224 records to 39489 (keeping 200 days of data) [2025-09-25T19:08:04.722181] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-25T19:08:04.798921] [DEBUG] [LOCAL ] GPRK: Primary data saved (39489 records). [2025-09-25T19:08:04.799116] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-25T19:08:04.800319] [INFO ] [MAIN ] Update Progress: 966/2372 symbols completed. GPRK took 32.0s. Estimated remaining: 3h 6m 21s. Rate: 7.5 symbols/min [2025-09-25T19:08:04.979224] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:05.030411] [DEBUG] [LOCAL ] GRND: Loaded 49997 existing records from primary storage. [2025-09-25T19:08:05.030578] [INFO ] [MAIN ] GRND: Loaded 49997 existing records. [2025-09-25T19:08:05.228142] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T19:08:05.231712] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:05.237133] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-25T19:08:05.237192] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-25T19:08:05.237485] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-25T19:08:05.237546] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-25T19:08:05.494013] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-25T19:08:05.601005] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:06.288739] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-25T19:08:06.322073] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T19:08:06.410044] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T19:08:07.088762] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-25T19:08:07.356452] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T19:08:07.888734] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-25T19:08:08.608324] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T19:08:08.688751] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-25T19:08:08.741309] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T19:08:09.488822] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-25T19:08:10.259179] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T19:08:10.288761] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-25T19:08:10.487996] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:08:10.491946] [INFO ] [REMOTE ] GRC: Full fetch complete (13060 records). [2025-09-25T19:08:10.492057] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-25T19:08:10.892849] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-25T19:08:10.892944] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-25T19:08:10.893329] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-25T19:08:10.893372] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-25T19:08:10.893966] [DEBUG] [LOCAL ] GRC: Trimmed 13060 records to 8993 (keeping 200 days of data) [2025-09-25T19:08:10.951632] [DEBUG] [LOCAL ] GRC: Primary data saved (8993 records). [2025-09-25T19:08:10.951824] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-25T19:08:10.951923] [INFO ] [MAIN ] Update Progress: 967/2372 symbols completed. GRC took 29.2s. Estimated remaining: 3h 6m 10s. Rate: 7.5 symbols/min [2025-09-25T19:08:11.093495] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-25T19:08:11.178890] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:11.213722] [DEBUG] [LOCAL ] GRNT: Loaded 33695 existing records from primary storage. [2025-09-25T19:08:11.213914] [INFO ] [MAIN ] GRNT: Loaded 33695 existing records. [2025-09-25T19:08:11.406188] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:11.406470] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-25T19:08:11.406521] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-25T19:08:11.407176] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-25T19:08:11.407236] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-25T19:08:11.780739] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:11.888705] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-25T19:08:11.988069] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T19:08:12.694528] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-25T19:08:12.710604] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T19:08:12.899854] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T19:08:13.488780] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-25T19:08:14.039624] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T19:08:14.288779] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-25T19:08:14.837375] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:08:15.088740] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-25T19:08:15.576095] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T19:08:15.888769] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-25T19:08:16.681742] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T19:08:16.691319] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-25T19:08:16.721182] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T19:08:17.488788] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-25T19:08:17.920298] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:08:18.288779] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-25T19:08:19.023163] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:08:19.088711] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-25T19:08:19.888722] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-25T19:08:19.956268] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T19:08:20.144669] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T19:08:20.150445] [INFO ] [REMOTE ] GRDN: Full fetch complete (26059 records). [2025-09-25T19:08:20.150528] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-25T19:08:20.581598] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-25T19:08:20.581725] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-25T19:08:20.582563] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-25T19:08:20.582607] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-25T19:08:20.583358] [DEBUG] [LOCAL ] GRDN: Trimmed 26059 records to 19994 (keeping 200 days of data) [2025-09-25T19:08:20.689750] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-25T19:08:20.714998] [DEBUG] [LOCAL ] GRDN: Primary data saved (19994 records). [2025-09-25T19:08:20.715228] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-25T19:08:20.715347] [INFO ] [MAIN ] Update Progress: 968/2372 symbols completed. GRDN took 31.1s. Estimated remaining: 3h 6m 5s. Rate: 7.5 symbols/min [2025-09-25T19:08:20.909047] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:20.920603] [DEBUG] [LOCAL ] GROV: Loaded 9051 existing records from primary storage. [2025-09-25T19:08:20.920777] [INFO ] [MAIN ] GROV: Loaded 9051 existing records. [2025-09-25T19:08:21.104993] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:21.105340] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-25T19:08:21.105392] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-25T19:08:21.105735] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-25T19:08:21.105796] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-25T19:08:21.488132] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:21.488806] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-25T19:08:21.555669] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:08:22.064633] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T19:08:22.288746] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-25T19:08:23.069865] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:08:23.088699] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-25T19:08:23.668949] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T19:08:23.888725] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-25T19:08:24.592592] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T19:08:24.688744] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-25T19:08:25.194330] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T19:08:25.488732] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-25T19:08:25.935284] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T19:08:26.069363] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T19:08:26.288755] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-25T19:08:27.088835] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-25T19:08:27.227945] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T19:08:27.888773] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-25T19:08:28.688782] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-25T19:08:28.752671] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T19:08:28.761449] [INFO ] [REMOTE ] GRMN: Full fetch complete (60103 records). [2025-09-25T19:08:28.761699] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-25T19:08:29.180852] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-25T19:08:29.181013] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-25T19:08:29.182000] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-25T19:08:29.182105] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-25T19:08:29.191293] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T19:08:29.194070] [DEBUG] [LOCAL ] GRMN: Trimmed 60103 records to 41576 (keeping 200 days of data) [2025-09-25T19:08:29.465741] [DEBUG] [LOCAL ] GRMN: Primary data saved (41576 records). [2025-09-25T19:08:29.465930] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-25T19:08:29.466072] [INFO ] [MAIN ] Update Progress: 969/2372 symbols completed. GRMN took 26.2s. Estimated remaining: 3h 5m 58s. Rate: 7.5 symbols/min [2025-09-25T19:08:29.498111] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-25T19:08:29.687428] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:29.690798] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T19:08:29.708997] [DEBUG] [LOCAL ] GRX: Loaded 4477 existing records from primary storage. [2025-09-25T19:08:29.709154] [INFO ] [MAIN ] GRX: Loaded 4477 existing records. [2025-09-25T19:08:29.891494] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:29.891812] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-25T19:08:29.891865] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-25T19:08:29.892113] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-25T19:08:29.892173] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-25T19:08:30.290368] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:30.290508] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-25T19:08:30.330116] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T19:08:31.088767] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-25T19:08:31.690227] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:08:31.848165] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T19:08:31.888767] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-25T19:08:32.688729] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-25T19:08:32.739635] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T19:08:33.139902] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-25T19:08:33.488769] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-25T19:08:34.069188] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T19:08:34.288748] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-25T19:08:34.786766] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T19:08:35.088750] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-25T19:08:35.647408] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-25T19:08:35.888792] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-25T19:08:36.688779] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-25T19:08:37.425301] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T19:08:37.488704] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-25T19:08:37.675914] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T19:08:38.288772] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-25T19:08:38.494543] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T19:08:39.088733] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-25T19:08:39.702966] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T19:08:39.734389] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T19:08:39.888754] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-25T19:08:40.688776] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-25T19:08:41.280937] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T19:08:41.306808] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:08:41.488783] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-25T19:08:42.061112] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T19:08:42.288801] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-25T19:08:42.851826] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T19:08:43.088745] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-25T19:08:43.666425] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-25T19:08:43.888731] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-25T19:08:44.490710] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T19:08:44.688782] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-25T19:08:45.488776] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-25T19:08:46.288811] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-25T19:08:46.314881] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T19:08:46.330612] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T19:08:46.337867] [INFO ] [REMOTE ] GRX: Full fetch complete (6449 records). [2025-09-25T19:08:46.338134] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-25T19:08:46.376414] [INFO ] [REMOTE ] GRNT: Full fetch complete (48532 records). [2025-09-25T19:08:46.412404] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-25T19:08:47.096789] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-25T19:08:47.113203] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-25T19:08:47.131502] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-25T19:08:47.148228] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-25T19:08:47.160338] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-25T19:08:47.159772] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T19:08:47.192302] [DEBUG] [LOCAL ] GRX: Trimmed 6449 records to 4508 (keeping 200 days of data) [2025-09-25T19:08:47.184405] [INFO ] [REMOTE ] GROV: Full fetch complete (14583 records). [2025-09-25T19:08:47.198127] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-25T19:08:47.210941] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-25T19:08:47.211190] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-25T19:08:47.235104] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-25T19:08:47.246943] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-25T19:08:47.317276] [DEBUG] [LOCAL ] GRNT: Trimmed 48532 records to 34006 (keeping 200 days of data) [2025-09-25T19:08:47.528988] [DEBUG] [LOCAL ] GRX: Primary data saved (4508 records). [2025-09-25T19:08:47.534755] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-25T19:08:47.630475] [INFO ] [MAIN ] Update Progress: 970/2372 symbols completed. GRX took 18.2s. Estimated remaining: 3h 6m 5s. Rate: 7.5 symbols/min [2025-09-25T19:08:47.998795] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:48.088730] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-25T19:08:48.089507] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-25T19:08:48.090169] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-25T19:08:48.091419] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-25T19:08:48.094262] [DEBUG] [LOCAL ] GROV: Trimmed 14583 records to 9156 (keeping 200 days of data) [2025-09-25T19:08:48.270492] [DEBUG] [LOCAL ] GS: Loaded 52038 existing records from primary storage. [2025-09-25T19:08:48.272887] [INFO ] [MAIN ] GS: Loaded 52038 existing records. [2025-09-25T19:08:48.373237] [DEBUG] [LOCAL ] GROV: Primary data saved (9156 records). [2025-09-25T19:08:48.389977] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-25T19:08:48.390538] [INFO ] [MAIN ] Update Progress: 971/2372 symbols completed. GROV took 27.7s. Estimated remaining: 3h 5m 46s. Rate: 7.5 symbols/min [2025-09-25T19:08:48.610738] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:48.636229] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-25T19:08:48.641499] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-25T19:08:48.641592] [DEBUG] [LOCAL ] GRNT: Primary data saved (34006 records). [2025-09-25T19:08:48.656906] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-25T19:08:48.690213] [INFO ] [MAIN ] Update Progress: 972/2372 symbols completed. GRNT took 37.7s. Estimated remaining: 3h 5m 28s. Rate: 7.5 symbols/min [2025-09-25T19:08:48.690354] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-25T19:08:48.690719] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-25T19:08:48.714662] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:49.136195] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:49.221140] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T19:08:49.246366] [DEBUG] [LOCAL ] GSBD: Loaded 39133 existing records from primary storage. [2025-09-25T19:08:49.268013] [INFO ] [MAIN ] GSBD: Loaded 39133 existing records. [2025-09-25T19:08:49.347166] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-25T19:08:49.504551] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:49.549111] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-25T19:08:49.613932] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:49.614377] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-25T19:08:49.628734] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-25T19:08:49.631710] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-25T19:08:49.631988] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-25T19:08:49.631889] [DEBUG] [LOCAL ] GSK: Loaded 53493 existing records from primary storage. [2025-09-25T19:08:49.632241] [INFO ] [MAIN ] GSK: Loaded 53493 existing records. [2025-09-25T19:08:50.077084] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:50.145294] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-25T19:08:50.162189] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-25T19:08:50.166803] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-25T19:08:50.177477] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-25T19:08:50.373959] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:50.374992] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-25T19:08:50.672842] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:50.673260] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-25T19:08:51.249967] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T19:08:51.263841] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-25T19:08:51.574469] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T19:08:51.671638] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-25T19:08:51.888767] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-25T19:08:52.596612] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T19:08:52.688722] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-25T19:08:52.778325] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:08:53.492519] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-25T19:08:53.497864] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:08:54.115479] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T19:08:54.288753] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-25T19:08:55.088709] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-25T19:08:55.275632] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T19:08:55.286001] [INFO ] [REMOTE ] GRND: Full fetch complete (70295 records). [2025-09-25T19:08:55.286153] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-25T19:08:55.692569] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-25T19:08:55.692731] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-25T19:08:55.694055] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-25T19:08:55.694122] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-25T19:08:55.695780] [DEBUG] [LOCAL ] GRND: Trimmed 70295 records to 50356 (keeping 200 days of data) [2025-09-25T19:08:55.897681] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-25T19:08:56.040516] [DEBUG] [LOCAL ] GRND: Primary data saved (50356 records). [2025-09-25T19:08:56.040714] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-25T19:08:56.040850] [INFO ] [MAIN ] Update Progress: 973/2372 symbols completed. GRND took 51.2s. Estimated remaining: 3h 5m 19s. Rate: 7.5 symbols/min [2025-09-25T19:08:56.219185] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:08:56.249407] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T19:08:56.292733] [DEBUG] [LOCAL ] GSL: Loaded 33432 existing records from primary storage. [2025-09-25T19:08:56.292922] [INFO ] [MAIN ] GSL: Loaded 33432 existing records. [2025-09-25T19:08:56.477709] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:08:56.478054] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-25T19:08:56.478108] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-25T19:08:56.478415] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-25T19:08:56.478474] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-25T19:08:56.693933] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-25T19:08:56.849021] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:08:57.287993] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-25T19:08:57.417127] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T19:08:57.488741] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-25T19:08:58.288767] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-25T19:08:58.362578] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:08:59.088755] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-25T19:08:59.575546] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-25T19:08:59.894164] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-25T19:08:59.927433] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:09:00.101446] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T19:09:00.688752] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-25T19:09:01.488744] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-25T19:09:02.218845] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-25T19:09:02.288779] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-25T19:09:02.668746] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T19:09:02.793055] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T19:09:03.088732] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-25T19:09:03.725485] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T19:09:03.888718] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-25T19:09:04.688760] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-25T19:09:05.066805] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T19:09:05.109883] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T19:09:05.488744] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-25T19:09:06.288757] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-25T19:09:07.088400] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-25T19:09:07.100902] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-25T19:09:07.158385] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T19:09:07.269213] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T19:09:07.888812] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-25T19:09:08.525841] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T19:09:08.688798] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-25T19:09:09.488777] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-25T19:09:10.101980] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-25T19:09:10.149902] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T19:09:10.288760] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-25T19:09:11.088772] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-25T19:09:11.455851] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T19:09:11.737318] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:09:11.888748] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-25T19:09:12.198480] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T19:09:12.688744] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-25T19:09:13.488733] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-25T19:09:13.830813] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T19:09:14.288763] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-25T19:09:14.737669] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-25T19:09:14.881744] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T19:09:15.088753] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-25T19:09:15.888738] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-25T19:09:16.094595] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T19:09:16.104888] [INFO ] [REMOTE ] GSK: Full fetch complete (77471 records). [2025-09-25T19:09:16.105111] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-25T19:09:16.512148] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-25T19:09:16.512278] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-25T19:09:16.513376] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-25T19:09:16.513456] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-25T19:09:16.515361] [DEBUG] [LOCAL ] GSK: Trimmed 77471 records to 53882 (keeping 200 days of data) [2025-09-25T19:09:16.703322] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-25T19:09:16.874236] [DEBUG] [LOCAL ] GSK: Primary data saved (53882 records). [2025-09-25T19:09:16.874454] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-25T19:09:16.874615] [INFO ] [MAIN ] Update Progress: 974/2372 symbols completed. GSK took 28.2s. Estimated remaining: 3h 5m 29s. Rate: 7.5 symbols/min [2025-09-25T19:09:17.061584] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:17.089906] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T19:09:17.136772] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T19:09:17.190027] [DEBUG] [LOCAL ] GTES: Loaded 50654 existing records from primary storage. [2025-09-25T19:09:17.190255] [INFO ] [MAIN ] GTES: Loaded 50654 existing records. [2025-09-25T19:09:17.377501] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:17.377891] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-25T19:09:17.377959] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-25T19:09:17.378307] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-25T19:09:17.378386] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-25T19:09:17.493884] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-25T19:09:17.756373] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:18.288748] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-25T19:09:18.407780] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T19:09:18.416283] [INFO ] [REMOTE ] GSBD: Full fetch complete (58430 records). [2025-09-25T19:09:18.416470] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-25T19:09:18.836331] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T19:09:18.866923] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-25T19:09:18.867227] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-25T19:09:18.868376] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-25T19:09:18.869003] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-25T19:09:18.870989] [DEBUG] [LOCAL ] GSBD: Trimmed 58430 records to 39474 (keeping 200 days of data) [2025-09-25T19:09:19.094044] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-25T19:09:19.134556] [DEBUG] [LOCAL ] GSBD: Primary data saved (39474 records). [2025-09-25T19:09:19.134787] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-25T19:09:19.134913] [INFO ] [MAIN ] Update Progress: 975/2372 symbols completed. GSBD took 30.7s. Estimated remaining: 3h 5m 13s. Rate: 7.5 symbols/min [2025-09-25T19:09:19.317484] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:19.371266] [DEBUG] [LOCAL ] GTLS: Loaded 42900 existing records from primary storage. [2025-09-25T19:09:19.371490] [INFO ] [MAIN ] GTLS: Loaded 42900 existing records. [2025-09-25T19:09:19.568085] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:19.568455] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-25T19:09:19.568546] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-25T19:09:19.569035] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-25T19:09:19.569125] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-25T19:09:19.890805] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-25T19:09:19.926789] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T19:09:20.017435] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:20.385695] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T19:09:20.688755] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-25T19:09:21.488730] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-25T19:09:21.948797] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T19:09:22.243945] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T19:09:22.288818] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-25T19:09:22.592310] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T19:09:23.088788] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-25T19:09:23.481633] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T19:09:23.888791] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-25T19:09:24.688734] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-25T19:09:24.796889] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T19:09:25.429348] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T19:09:25.436026] [INFO ] [REMOTE ] GSL: Full fetch complete (47900 records). [2025-09-25T19:09:25.436168] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-25T19:09:25.498090] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-25T19:09:25.849706] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-25T19:09:25.849933] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-25T19:09:25.850861] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-25T19:09:25.851160] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-25T19:09:25.852819] [DEBUG] [LOCAL ] GSL: Trimmed 47900 records to 33647 (keeping 200 days of data) [2025-09-25T19:09:25.972420] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T19:09:26.107401] [DEBUG] [LOCAL ] GSL: Primary data saved (33647 records). [2025-09-25T19:09:26.107599] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-25T19:09:26.108299] [INFO ] [MAIN ] Update Progress: 976/2372 symbols completed. GSL took 30.1s. Estimated remaining: 3h 5m 4s. Rate: 7.5 symbols/min [2025-09-25T19:09:26.293369] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:26.291692] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-25T19:09:26.340628] [DEBUG] [LOCAL ] GTN: Loaded 45696 existing records from primary storage. [2025-09-25T19:09:26.340823] [INFO ] [MAIN ] GTN: Loaded 45696 existing records. [2025-09-25T19:09:26.548002] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:26.548440] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-25T19:09:26.548501] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-25T19:09:26.548915] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-25T19:09:26.549012] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-25T19:09:26.926438] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:27.088755] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-25T19:09:27.803676] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-25T19:09:27.813895] [INFO ] [REMOTE ] GS: Full fetch complete (75788 records). [2025-09-25T19:09:27.814073] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-25T19:09:27.891859] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-25T19:09:28.127368] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T19:09:28.309225] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-25T19:09:28.309339] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-25T19:09:28.310765] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-25T19:09:28.310836] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-25T19:09:28.312820] [DEBUG] [LOCAL ] GS: Trimmed 75788 records to 52395 (keeping 200 days of data) [2025-09-25T19:09:28.688989] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-25T19:09:28.697074] [DEBUG] [LOCAL ] GS: Primary data saved (52395 records). [2025-09-25T19:09:28.697689] [INFO ] [MAIN ] GS: Full history saved. [2025-09-25T19:09:28.697823] [INFO ] [MAIN ] Update Progress: 977/2372 symbols completed. GS took 41.1s. Estimated remaining: 3h 4m 48s. Rate: 7.5 symbols/min [2025-09-25T19:09:28.911704] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:09:28.939178] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:28.989015] [DEBUG] [LOCAL ] GTY: Loaded 30364 existing records from primary storage. [2025-09-25T19:09:28.989234] [INFO ] [MAIN ] GTY: Loaded 30364 existing records. [2025-09-25T19:09:29.205783] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:29.206268] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-25T19:09:29.206360] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-25T19:09:29.206909] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-25T19:09:29.206992] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-25T19:09:29.494011] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-25T19:09:29.700252] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:29.751999] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T19:09:30.264458] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T19:09:30.288792] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-25T19:09:31.088713] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-25T19:09:31.301988] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T19:09:31.694732] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T19:09:31.888745] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-25T19:09:32.302103] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T19:09:32.688737] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-25T19:09:33.488743] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-25T19:09:33.546430] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:09:34.195323] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T19:09:34.288775] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-25T19:09:35.024839] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:09:35.088669] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-25T19:09:35.584608] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T19:09:35.888769] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-25T19:09:36.438626] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:09:36.688716] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-25T19:09:37.488755] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-25T19:09:37.558977] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T19:09:38.253876] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T19:09:38.288685] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-25T19:09:39.096868] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-25T19:09:39.115936] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T19:09:39.888700] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-25T19:09:40.014003] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T19:09:40.327478] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:09:40.688728] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-25T19:09:41.324512] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T19:09:41.488692] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-25T19:09:42.288739] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-25T19:09:42.445636] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T19:09:43.051186] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T19:09:43.088778] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-25T19:09:43.681023] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T19:09:43.888765] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-25T19:09:44.319760] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T19:09:44.329112] [INFO ] [REMOTE ] GTLS: Full fetch complete (61344 records). [2025-09-25T19:09:44.329286] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-25T19:09:44.693925] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-25T19:09:44.770929] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-25T19:09:44.771054] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-25T19:09:44.772324] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-25T19:09:44.772395] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-25T19:09:44.774275] [DEBUG] [LOCAL ] GTLS: Trimmed 61344 records to 43161 (keeping 200 days of data) [2025-09-25T19:09:45.060507] [DEBUG] [LOCAL ] GTLS: Primary data saved (43161 records). [2025-09-25T19:09:45.060720] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-25T19:09:45.060863] [INFO ] [MAIN ] Update Progress: 978/2372 symbols completed. GTLS took 25.9s. Estimated remaining: 3h 4m 52s. Rate: 7.5 symbols/min [2025-09-25T19:09:45.245014] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:45.267443] [DEBUG] [LOCAL ] GUG: Loaded 12013 existing records from primary storage. [2025-09-25T19:09:45.267615] [INFO ] [MAIN ] GUG: Loaded 12013 existing records. [2025-09-25T19:09:45.435232] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T19:09:45.498949] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-25T19:09:45.505313] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:45.506100] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-25T19:09:45.507021] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-25T19:09:45.507333] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-25T19:09:45.507394] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-25T19:09:45.938282] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:46.227945] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T19:09:46.238293] [INFO ] [REMOTE ] GTES: Full fetch complete (73959 records). [2025-09-25T19:09:46.238450] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-25T19:09:46.299946] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-25T19:09:46.682842] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-25T19:09:46.682946] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-25T19:09:46.683951] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-25T19:09:46.684021] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-25T19:09:46.685688] [DEBUG] [LOCAL ] GTES: Trimmed 73959 records to 51024 (keeping 200 days of data) [2025-09-25T19:09:46.991596] [DEBUG] [LOCAL ] GTES: Primary data saved (51024 records). [2025-09-25T19:09:46.991801] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-25T19:09:46.993272] [INFO ] [MAIN ] Update Progress: 979/2372 symbols completed. GTES took 30.1s. Estimated remaining: 3h 4m 36s. Rate: 7.5 symbols/min [2025-09-25T19:09:47.089899] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-25T19:09:47.179368] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:09:47.198361] [DEBUG] [LOCAL ] GUT: Loaded 15414 existing records from primary storage. [2025-09-25T19:09:47.198527] [INFO ] [MAIN ] GUT: Loaded 15414 existing records. [2025-09-25T19:09:47.417185] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:09:47.418416] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-25T19:09:47.418570] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-25T19:09:47.419073] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-25T19:09:47.419479] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-25T19:09:47.529351] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T19:09:47.867282] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T19:09:47.893918] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-25T19:09:47.899932] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:09:48.129384] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:09:48.688721] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-25T19:09:49.244710] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T19:09:49.488796] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-25T19:09:49.593596] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T19:09:50.288813] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-25T19:09:50.891246] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:09:51.088702] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-25T19:09:51.354761] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T19:09:51.888752] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-25T19:09:52.630971] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T19:09:52.688688] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-25T19:09:52.935136] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T19:09:53.488787] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-25T19:09:53.870902] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T19:09:54.288709] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-25T19:09:54.339254] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T19:09:55.080219] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T19:09:55.088674] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-25T19:09:55.893278] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-25T19:09:55.897064] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:09:56.688741] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-25T19:09:57.488806] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-25T19:09:57.543530] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T19:09:58.032139] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T19:09:58.288758] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-25T19:09:58.416954] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T19:09:59.088784] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-25T19:09:59.355290] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T19:09:59.888754] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-25T19:10:00.052831] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T19:10:00.688770] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-25T19:10:01.488706] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-25T19:10:01.574661] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T19:10:01.820127] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:10:01.829806] [INFO ] [REMOTE ] GTN: Full fetch complete (66453 records). [2025-09-25T19:10:01.829989] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-25T19:10:02.285637] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-25T19:10:02.285761] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-25T19:10:02.286740] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-25T19:10:02.286805] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-25T19:10:02.288284] [DEBUG] [LOCAL ] GTN: Trimmed 66453 records to 46009 (keeping 200 days of data) [2025-09-25T19:10:02.289114] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-25T19:10:02.566129] [DEBUG] [LOCAL ] GTN: Primary data saved (46009 records). [2025-09-25T19:10:02.566349] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-25T19:10:02.567496] [INFO ] [MAIN ] Update Progress: 980/2372 symbols completed. GTN took 36.5s. Estimated remaining: 3h 4m 39s. Rate: 7.5 symbols/min [2025-09-25T19:10:02.753798] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:02.792403] [DEBUG] [LOCAL ] GVA: Loaded 33696 existing records from primary storage. [2025-09-25T19:10:02.792592] [INFO ] [MAIN ] GVA: Loaded 33696 existing records. [2025-09-25T19:10:02.994299] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:02.995107] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-25T19:10:02.995200] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-25T19:10:03.008219] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-25T19:10:03.010899] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-25T19:10:03.058509] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T19:10:03.103584] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-25T19:10:03.128302] [INFO ] [REMOTE ] GTY: Full fetch complete (43305 records). [2025-09-25T19:10:03.155709] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-25T19:10:03.523691] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T19:10:03.676897] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:03.894274] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-25T19:10:03.914203] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-25T19:10:03.914338] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-25T19:10:03.915555] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-25T19:10:03.915787] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-25T19:10:03.917199] [DEBUG] [LOCAL ] GTY: Trimmed 43305 records to 30597 (keeping 200 days of data) [2025-09-25T19:10:04.021701] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-25T19:10:04.141415] [DEBUG] [LOCAL ] GTY: Primary data saved (30597 records). [2025-09-25T19:10:04.141607] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-25T19:10:04.141737] [INFO ] [MAIN ] Update Progress: 981/2372 symbols completed. GTY took 35.4s. Estimated remaining: 3h 4m 22s. Rate: 7.5 symbols/min [2025-09-25T19:10:04.335805] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:04.354928] [DEBUG] [LOCAL ] GWH: Loaded 15510 existing records from primary storage. [2025-09-25T19:10:04.355121] [INFO ] [MAIN ] GWH: Loaded 15510 existing records. [2025-09-25T19:10:04.584273] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:04.584604] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-25T19:10:04.584686] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-25T19:10:04.584959] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-25T19:10:04.585020] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-25T19:10:04.693929] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-25T19:10:04.985363] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:04.986733] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T19:10:05.488735] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-25T19:10:06.118165] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T19:10:06.288712] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-25T19:10:06.425375] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T19:10:07.088741] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-25T19:10:07.605079] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T19:10:07.888733] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-25T19:10:07.913063] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T19:10:08.688731] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-25T19:10:08.878162] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T19:10:09.405376] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T19:10:09.488754] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-25T19:10:10.288715] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-25T19:10:10.370977] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T19:10:11.088755] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-25T19:10:11.265097] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T19:10:11.888732] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-25T19:10:12.084786] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:10:12.088001] [INFO ] [REMOTE ] GUG: Full fetch complete (19975 records). [2025-09-25T19:10:12.088143] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-25T19:10:12.469148] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-25T19:10:12.469491] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-25T19:10:12.470098] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-25T19:10:12.470202] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-25T19:10:12.471961] [DEBUG] [LOCAL ] GUG: Trimmed 19975 records to 12087 (keeping 200 days of data) [2025-09-25T19:10:12.560512] [DEBUG] [LOCAL ] GUG: Primary data saved (12087 records). [2025-09-25T19:10:12.560727] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-25T19:10:12.560872] [INFO ] [MAIN ] Update Progress: 982/2372 symbols completed. GUG took 27.5s. Estimated remaining: 3h 4m 14s. Rate: 7.5 symbols/min [2025-09-25T19:10:12.691933] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-25T19:10:12.768059] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:12.826814] [DEBUG] [LOCAL ] GWRE: Loaded 41025 existing records from primary storage. [2025-09-25T19:10:12.827059] [INFO ] [MAIN ] GWRE: Loaded 41025 existing records. [2025-09-25T19:10:13.008713] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T19:10:13.061902] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:13.062205] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-25T19:10:13.062260] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-25T19:10:13.062880] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-25T19:10:13.062957] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-25T19:10:13.449185] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:13.488692] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-25T19:10:14.093009] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T19:10:14.288765] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-25T19:10:15.088771] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-25T19:10:15.288051] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T19:10:15.857551] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T19:10:15.888672] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-25T19:10:16.101750] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T19:10:16.688810] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-25T19:10:17.368729] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T19:10:17.488724] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-25T19:10:18.288735] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-25T19:10:18.893302] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T19:10:19.088739] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-25T19:10:19.755000] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (3.07 seconds). [2025-09-25T19:10:19.758379] [INFO ] [REMOTE ] GUT: Full fetch complete (22880 records). [2025-09-25T19:10:19.758467] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-25T19:10:19.759025] [FATAL] [VALIDATOR ] GUT: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T19:10:19.759113] [FATAL] [MAIN ] GUT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:10:19.759156] [WARN ] [MAIN ] GUT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:10:19.759196] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-25T19:10:19.759271] [DEBUG] [LOCAL ] GUT: No primary data file found to delete. [2025-09-25T19:10:19.759326] [INFO ] [LOCAL ] GUT: Starting deletion of derivative data. [2025-09-25T19:10:19.759782] [DEBUG] [LOCAL ] GUT: Deleted derivative data file. [2025-09-25T19:10:19.759936] [INFO ] [MAIN ] Update Progress: 983/2372 symbols completed. GUT took 32.8s. Estimated remaining: 3h 4m 5s. Rate: 7.5 symbols/min [2025-09-25T19:10:19.889970] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-25T19:10:19.976289] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:19.995971] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T19:10:20.033078] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T19:10:20.055379] [DEBUG] [LOCAL ] GWW: Loaded 19844 existing records from primary storage. [2025-09-25T19:10:20.055554] [INFO ] [MAIN ] GWW: Loaded 19844 existing records. [2025-09-25T19:10:20.267176] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:20.267618] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-25T19:10:20.267751] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-25T19:10:20.268135] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-25T19:10:20.268208] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-25T19:10:20.678328] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:20.688733] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-25T19:10:20.745265] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T19:10:21.488796] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-25T19:10:22.160807] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T19:10:22.288766] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-25T19:10:22.566480] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:10:23.088824] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-25T19:10:23.728675] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T19:10:23.851556] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T19:10:23.888740] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-25T19:10:24.688755] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-25T19:10:25.051839] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T19:10:25.488753] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-25T19:10:26.041904] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T19:10:26.255525] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T19:10:26.288704] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-25T19:10:27.088782] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-25T19:10:27.420265] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T19:10:27.888747] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-25T19:10:28.688715] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-25T19:10:28.921874] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T19:10:28.989718] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T19:10:29.488751] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-25T19:10:30.158138] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T19:10:30.167030] [INFO ] [REMOTE ] GVA: Full fetch complete (48781 records). [2025-09-25T19:10:30.167267] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-25T19:10:30.293881] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-25T19:10:30.585947] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-25T19:10:30.586161] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-25T19:10:30.587205] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-25T19:10:30.587279] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-25T19:10:30.600777] [DEBUG] [LOCAL ] GVA: Trimmed 48781 records to 33882 (keeping 200 days of data) [2025-09-25T19:10:30.617865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:10:30.851757] [DEBUG] [LOCAL ] GVA: Primary data saved (33882 records). [2025-09-25T19:10:30.851945] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-25T19:10:30.852631] [INFO ] [MAIN ] Update Progress: 984/2372 symbols completed. GVA took 28.3s. Estimated remaining: 3h 4m 2s. Rate: 7.5 symbols/min [2025-09-25T19:10:31.027394] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:31.084069] [DEBUG] [LOCAL ] GXO: Loaded 47561 existing records from primary storage. [2025-09-25T19:10:31.084252] [INFO ] [MAIN ] GXO: Loaded 47561 existing records. [2025-09-25T19:10:31.095765] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-25T19:10:31.276399] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:31.276795] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-25T19:10:31.276853] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-25T19:10:31.277233] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-25T19:10:31.277292] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-25T19:10:31.641586] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:31.888825] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-25T19:10:32.010415] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T19:10:32.071851] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-25T19:10:32.688818] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-25T19:10:33.428373] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:10:33.488721] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-25T19:10:34.019341] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T19:10:34.288788] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-25T19:10:35.072295] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T19:10:35.088672] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-25T19:10:35.888705] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-25T19:10:35.940689] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T19:10:36.382406] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T19:10:36.688688] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-25T19:10:36.947729] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T19:10:37.488743] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-25T19:10:38.288700] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-25T19:10:38.472722] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:10:38.534747] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T19:10:39.088702] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-25T19:10:39.403451] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T19:10:39.407808] [INFO ] [REMOTE ] GWH: Full fetch complete (20877 records). [2025-09-25T19:10:39.407907] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-25T19:10:39.796278] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-25T19:10:39.796373] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-25T19:10:39.796915] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-25T19:10:39.796982] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-25T19:10:39.797594] [DEBUG] [LOCAL ] GWH: Trimmed 20877 records to 15688 (keeping 200 days of data) [2025-09-25T19:10:39.888715] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-25T19:10:39.898452] [DEBUG] [LOCAL ] GWH: Primary data saved (15688 records). [2025-09-25T19:10:39.898569] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-25T19:10:39.898717] [INFO ] [MAIN ] Update Progress: 985/2372 symbols completed. GWH took 35.8s. Estimated remaining: 3h 3m 55s. Rate: 7.5 symbols/min [2025-09-25T19:10:40.086683] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:40.091804] [DEBUG] [LOCAL ] GYLD: Loaded 1540 existing records from primary storage. [2025-09-25T19:10:40.091892] [INFO ] [MAIN ] GYLD: Loaded 1540 existing records. [2025-09-25T19:10:40.274418] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:40.274771] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-25T19:10:40.274872] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-25T19:10:40.275117] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-25T19:10:40.275176] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-25T19:10:40.652989] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:40.688677] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-25T19:10:40.729048] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:10:41.005574] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-25T19:10:41.488710] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-25T19:10:41.585922] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T19:10:41.780265] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-25T19:10:42.288740] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-25T19:10:43.088740] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-25T19:10:43.317879] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T19:10:43.888725] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-25T19:10:44.232785] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T19:10:44.688739] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-25T19:10:45.157508] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T19:10:45.488801] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-25T19:10:46.157730] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:10:46.288726] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-25T19:10:47.088713] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-25T19:10:47.132411] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:10:47.888698] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-25T19:10:47.977599] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T19:10:47.985548] [INFO ] [REMOTE ] GWRE: Full fetch complete (61408 records). [2025-09-25T19:10:47.985743] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-25T19:10:48.411927] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-25T19:10:48.412151] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-25T19:10:48.414097] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-25T19:10:48.414183] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-25T19:10:48.432620] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T19:10:48.438952] [DEBUG] [LOCAL ] GWRE: Trimmed 61408 records to 41257 (keeping 200 days of data) [2025-09-25T19:10:48.688830] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-25T19:10:48.713037] [DEBUG] [LOCAL ] GWRE: Primary data saved (41257 records). [2025-09-25T19:10:48.713208] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-25T19:10:48.713334] [INFO ] [MAIN ] Update Progress: 986/2372 symbols completed. GWRE took 36.2s. Estimated remaining: 3h 3m 49s. Rate: 7.5 symbols/min [2025-09-25T19:10:48.887372] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:48.887609] [DEBUG] [LOCAL ] H: No existing data file found in primary storage. [2025-09-25T19:10:48.887675] [WARN ] [MAIN ] H: No existing data found, performing full refresh instead. [2025-09-25T19:10:48.887833] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-25T19:10:48.887898] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-25T19:10:48.888041] [DEBUG] [LOCAL ] H: No primary data file found to delete. [2025-09-25T19:10:48.888091] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-25T19:10:49.287378] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:49.495544] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-25T19:10:49.520565] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T19:10:49.578971] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T19:10:50.288765] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-25T19:10:50.955072] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T19:10:51.088785] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-25T19:10:51.450166] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:10:51.888800] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-25T19:10:52.247908] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T19:10:52.318772] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T19:10:52.323824] [INFO ] [REMOTE ] GWW: Full fetch complete (29296 records). [2025-09-25T19:10:52.324049] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-25T19:10:52.710850] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-25T19:10:52.726071] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-25T19:10:52.726160] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-25T19:10:52.727024] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-25T19:10:52.727202] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-25T19:10:52.728842] [DEBUG] [LOCAL ] GWW: Trimmed 29296 records to 20010 (keeping 200 days of data) [2025-09-25T19:10:52.896889] [DEBUG] [LOCAL ] GWW: Primary data saved (20010 records). [2025-09-25T19:10:52.897069] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-25T19:10:52.897194] [INFO ] [MAIN ] Update Progress: 987/2372 symbols completed. GWW took 33.1s. Estimated remaining: 3h 3m 35s. Rate: 7.5 symbols/min [2025-09-25T19:10:53.092109] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:53.164569] [DEBUG] [LOCAL ] HAE: Loaded 39488 existing records from primary storage. [2025-09-25T19:10:53.164790] [INFO ] [MAIN ] HAE: Loaded 39488 existing records. [2025-09-25T19:10:53.363219] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:53.363722] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-25T19:10:53.363841] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-25T19:10:53.365470] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-25T19:10:53.365549] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-25T19:10:53.493992] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-25T19:10:53.775325] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:53.980496] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T19:10:54.288727] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-25T19:10:54.435901] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T19:10:54.445771] [INFO ] [REMOTE ] GXO: Full fetch complete (70050 records). [2025-09-25T19:10:54.445971] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-25T19:10:54.884036] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-25T19:10:54.884227] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-25T19:10:54.885413] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-25T19:10:54.885483] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-25T19:10:54.887342] [DEBUG] [LOCAL ] GXO: Trimmed 70050 records to 47927 (keeping 200 days of data) [2025-09-25T19:10:55.106889] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-25T19:10:55.202828] [DEBUG] [LOCAL ] GXO: Primary data saved (47927 records). [2025-09-25T19:10:55.203023] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-25T19:10:55.203883] [INFO ] [MAIN ] Update Progress: 988/2372 symbols completed. GXO took 24.4s. Estimated remaining: 3h 3m 19s. Rate: 7.5 symbols/min [2025-09-25T19:10:55.426124] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:10:55.479896] [DEBUG] [LOCAL ] HAFN: Loaded 43545 existing records from primary storage. [2025-09-25T19:10:55.480078] [INFO ] [MAIN ] HAFN: Loaded 43545 existing records. [2025-09-25T19:10:55.585704] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-25T19:10:55.686733] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:10:55.687156] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-25T19:10:55.687280] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-25T19:10:55.687747] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-25T19:10:55.687916] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-25T19:10:55.863973] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T19:10:55.898356] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-25T19:10:56.103063] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:10:56.360485] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T19:10:56.688748] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-25T19:10:57.488746] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-25T19:10:58.288936] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-25T19:10:58.585853] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T19:10:58.993575] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T19:10:59.088775] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-25T19:10:59.869633] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:10:59.888681] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-25T19:11:00.076355] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T19:11:00.688733] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-25T19:11:01.488742] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-25T19:11:01.709094] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:11:02.288771] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-25T19:11:02.533870] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T19:11:02.590735] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-25T19:11:02.777955] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T19:11:03.088768] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-25T19:11:03.888758] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-25T19:11:04.688734] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-25T19:11:04.884026] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T19:11:05.267396] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T19:11:05.488739] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-25T19:11:06.288754] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-25T19:11:06.331834] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:11:07.042762] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T19:11:07.088759] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-25T19:11:07.544776] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T19:11:07.888732] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-25T19:11:07.987269] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T19:11:08.688772] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-25T19:11:09.141865] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-25T19:11:09.358543] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T19:11:09.488747] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-25T19:11:10.047277] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T19:11:10.048429] [INFO ] [REMOTE ] GYLD: Full fetch complete (2050 records). [2025-09-25T19:11:10.048507] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-25T19:11:10.293906] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-25T19:11:10.451289] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-25T19:11:10.451395] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-25T19:11:10.451511] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-25T19:11:10.451554] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-25T19:11:10.451966] [DEBUG] [LOCAL ] GYLD: Trimmed 2050 records to 1558 (keeping 200 days of data) [2025-09-25T19:11:10.462943] [DEBUG] [LOCAL ] GYLD: Primary data saved (1558 records). [2025-09-25T19:11:10.463053] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-25T19:11:10.463151] [INFO ] [MAIN ] Update Progress: 989/2372 symbols completed. GYLD took 30.6s. Estimated remaining: 3h 3m 22s. Rate: 7.5 symbols/min [2025-09-25T19:11:10.643243] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:10.711569] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-25T19:11:10.711783] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-25T19:11:10.900804] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:10.901133] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-25T19:11:10.901189] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-25T19:11:10.901453] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-25T19:11:10.901513] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-25T19:11:11.093933] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-25T19:11:11.274629] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:11.888855] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-25T19:11:12.051568] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T19:11:12.636919] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T19:11:12.688772] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-25T19:11:13.488708] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-25T19:11:13.911893] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T19:11:14.288715] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-25T19:11:14.330262] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:11:14.995456] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T19:11:15.088779] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-25T19:11:15.888709] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-25T19:11:16.320773] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T19:11:16.688805] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-25T19:11:16.815701] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:11:17.029549] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T19:11:17.488786] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-25T19:11:18.288736] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-25T19:11:18.592310] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T19:11:18.779075] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T19:11:19.088788] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-25T19:11:19.616350] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T19:11:19.888731] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-25T19:11:20.576456] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:11:20.688671] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-25T19:11:21.449511] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:11:21.457635] [INFO ] [REMOTE ] HAFN: Full fetch complete (65887 records). [2025-09-25T19:11:21.457805] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-25T19:11:21.493830] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-25T19:11:21.859069] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-25T19:11:21.859161] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-25T19:11:21.860114] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-25T19:11:21.860179] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-25T19:11:21.861690] [DEBUG] [LOCAL ] HAFN: Trimmed 65887 records to 43874 (keeping 200 days of data) [2025-09-25T19:11:22.125443] [DEBUG] [LOCAL ] HAFN: Primary data saved (43874 records). [2025-09-25T19:11:22.127138] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-25T19:11:22.127852] [INFO ] [MAIN ] Update Progress: 990/2372 symbols completed. HAFN took 26.9s. Estimated remaining: 3h 3m 19s. Rate: 7.5 symbols/min [2025-09-25T19:11:22.290343] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-25T19:11:22.310624] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:22.350372] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T19:11:22.364161] [INFO ] [REMOTE ] H: Full fetch complete (61873 records). [2025-09-25T19:11:22.364408] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-25T19:11:22.675561] [DEBUG] [LOCAL ] HASI: Loaded 47223 existing records from primary storage. [2025-09-25T19:11:22.707240] [INFO ] [MAIN ] HASI: Loaded 47223 existing records. [2025-09-25T19:11:22.971507] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-25T19:11:22.982815] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-25T19:11:22.987738] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-25T19:11:22.993775] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-25T19:11:23.017967] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:23.018550] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-25T19:11:23.018608] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-25T19:11:23.018747] [DEBUG] [LOCAL ] H: Trimmed 61873 records to 45216 (keeping 200 days of data) [2025-09-25T19:11:23.019622] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-25T19:11:23.019766] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-25T19:11:23.517524] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:23.519936] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-25T19:11:23.569949] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T19:11:23.753535] [DEBUG] [LOCAL ] H: Primary data saved (45216 records). [2025-09-25T19:11:23.753824] [INFO ] [MAIN ] H: Full history saved. [2025-09-25T19:11:23.754025] [INFO ] [MAIN ] Update Progress: 991/2372 symbols completed. H took 35.0s. Estimated remaining: 3h 3m 2s. Rate: 7.5 symbols/min [2025-09-25T19:11:23.901393] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-25T19:11:23.953260] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T19:11:23.950336] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:24.010750] [DEBUG] [LOCAL ] HAYW: Loaded 48718 existing records from primary storage. [2025-09-25T19:11:24.010958] [INFO ] [MAIN ] HAYW: Loaded 48718 existing records. [2025-09-25T19:11:24.206803] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:24.207091] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-25T19:11:24.207144] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-25T19:11:24.207511] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-25T19:11:24.207571] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-25T19:11:24.575870] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:24.688684] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-25T19:11:25.079368] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T19:11:25.488727] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-25T19:11:25.730157] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:11:26.299761] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-25T19:11:26.304419] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T19:11:27.088828] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-25T19:11:27.119375] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T19:11:27.822326] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:11:27.888757] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-25T19:11:28.688723] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-25T19:11:28.751611] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T19:11:29.403095] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:11:29.488747] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-25T19:11:30.265698] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:11:30.288670] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-25T19:11:31.088703] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-25T19:11:31.504703] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T19:11:31.832527] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:11:31.888703] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-25T19:11:32.305547] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T19:11:32.688727] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-25T19:11:33.191607] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T19:11:33.488772] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-25T19:11:34.288767] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-25T19:11:34.431576] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T19:11:35.088688] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-25T19:11:35.152949] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T19:11:35.888695] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-25T19:11:35.990122] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T19:11:36.430167] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T19:11:36.438996] [INFO ] [REMOTE ] HAE: Full fetch complete (57977 records). [2025-09-25T19:11:36.439147] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-25T19:11:36.699126] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-25T19:11:36.834156] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-25T19:11:36.834246] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-25T19:11:36.835158] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-25T19:11:36.835226] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-25T19:11:36.836825] [DEBUG] [LOCAL ] HAE: Trimmed 57977 records to 39857 (keeping 200 days of data) [2025-09-25T19:11:37.077403] [DEBUG] [LOCAL ] HAE: Primary data saved (39857 records). [2025-09-25T19:11:37.077592] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-25T19:11:37.077714] [INFO ] [MAIN ] Update Progress: 992/2372 symbols completed. HAE took 44.2s. Estimated remaining: 3h 3m 2s. Rate: 7.5 symbols/min [2025-09-25T19:11:37.252997] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:37.263740] [DEBUG] [LOCAL ] HBB: Loaded 6870 existing records from primary storage. [2025-09-25T19:11:37.263882] [INFO ] [MAIN ] HBB: Loaded 6870 existing records. [2025-09-25T19:11:37.444833] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:37.445107] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-25T19:11:37.445155] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-25T19:11:37.445370] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-25T19:11:37.445428] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-25T19:11:37.501507] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-25T19:11:37.818408] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:37.961055] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T19:11:38.288708] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-25T19:11:38.391049] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:11:38.846069] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-25T19:11:39.088723] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-25T19:11:39.212098] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T19:11:39.888789] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-25T19:11:40.688715] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-25T19:11:40.727371] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T19:11:41.195220] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T19:11:41.437104] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T19:11:41.488756] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-25T19:11:42.288734] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-25T19:11:43.050093] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T19:11:43.088682] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-25T19:11:43.888754] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-25T19:11:44.353359] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T19:11:44.515754] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T19:11:44.676616] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T19:11:44.688674] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-25T19:11:45.422783] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T19:11:45.488677] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-25T19:11:46.257894] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T19:11:46.288670] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-25T19:11:47.084058] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T19:11:47.088668] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-25T19:11:47.888773] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-25T19:11:48.688749] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-25T19:11:48.746025] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T19:11:49.268061] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T19:11:49.488208] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T19:11:49.492881] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-25T19:11:49.981529] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T19:11:50.288805] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-25T19:11:51.088797] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-25T19:11:51.888753] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-25T19:11:52.458481] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T19:11:52.470112] [INFO ] [REMOTE ] HAL: Full fetch complete (77766 records). [2025-09-25T19:11:52.470346] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-25T19:11:52.699378] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-25T19:11:52.916061] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-25T19:11:52.916298] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-25T19:11:52.917742] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-25T19:11:52.917887] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-25T19:11:52.950518] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:11:52.960266] [DEBUG] [LOCAL ] HAL: Trimmed 77766 records to 54108 (keeping 200 days of data) [2025-09-25T19:11:52.961894] [INFO ] [REMOTE ] HAYW: Full fetch complete (70976 records). [2025-09-25T19:11:52.962470] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-25T19:11:53.540758] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-25T19:11:53.596147] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-25T19:11:53.608594] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T19:11:53.610608] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-25T19:11:53.614107] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-25T19:11:53.614534] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-25T19:11:53.651891] [DEBUG] [LOCAL ] HAYW: Trimmed 70976 records to 49080 (keeping 200 days of data) [2025-09-25T19:11:53.815411] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:11:53.831843] [INFO ] [REMOTE ] HASI: Full fetch complete (68010 records). [2025-09-25T19:11:53.877139] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-25T19:11:54.283349] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T19:11:54.298099] [INFO ] [REMOTE ] HBB: Full fetch complete (9853 records). [2025-09-25T19:11:54.328198] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-25T19:11:54.468239] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-25T19:11:54.469227] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-25T19:11:54.480798] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-25T19:11:54.556624] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-25T19:11:54.652778] [DEBUG] [LOCAL ] HASI: Trimmed 68010 records to 47537 (keeping 200 days of data) [2025-09-25T19:11:54.716564] [DEBUG] [LOCAL ] HAL: Primary data saved (54108 records). [2025-09-25T19:11:54.818156] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-25T19:11:54.875258] [INFO ] [MAIN ] Update Progress: 993/2372 symbols completed. HAL took 44.4s. Estimated remaining: 3h 3m 7s. Rate: 7.5 symbols/min [2025-09-25T19:11:55.261723] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:55.300565] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-25T19:11:55.301689] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-25T19:11:55.303851] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-25T19:11:55.305460] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-25T19:11:55.307355] [DEBUG] [LOCAL ] HBB: Trimmed 9853 records to 6893 (keeping 200 days of data) [2025-09-25T19:11:55.469603] [DEBUG] [LOCAL ] HBB: Primary data saved (6893 records). [2025-09-25T19:11:55.471214] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-25T19:11:55.472723] [DEBUG] [LOCAL ] HBI: Loaded 53012 existing records from primary storage. [2025-09-25T19:11:55.474351] [INFO ] [MAIN ] HBI: Loaded 53012 existing records. [2025-09-25T19:11:55.474569] [INFO ] [MAIN ] Update Progress: 994/2372 symbols completed. HBB took 18.4s. Estimated remaining: 3h 2m 49s. Rate: 7.5 symbols/min [2025-09-25T19:11:55.697387] [DEBUG] [LOCAL ] HAYW: Primary data saved (49080 records). [2025-09-25T19:11:55.715369] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-25T19:11:55.726467] [INFO ] [MAIN ] Update Progress: 995/2372 symbols completed. HAYW took 32.0s. Estimated remaining: 3h 2m 31s. Rate: 7.5 symbols/min [2025-09-25T19:11:56.064482] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:56.139745] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:56.163528] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-25T19:11:56.165278] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-25T19:11:56.211941] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-25T19:11:56.245867] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-25T19:11:56.251166] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:56.499323] [DEBUG] [LOCAL ] HBM: Loaded 52903 existing records from primary storage. [2025-09-25T19:11:56.517986] [INFO ] [MAIN ] HBM: Loaded 52903 existing records. [2025-09-25T19:11:56.754004] [DEBUG] [LOCAL ] HCA: Loaded 47182 existing records from primary storage. [2025-09-25T19:11:56.791879] [INFO ] [MAIN ] HCA: Loaded 47182 existing records. [2025-09-25T19:11:56.979765] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:57.047673] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-25T19:11:57.054463] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-25T19:11:57.069243] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-25T19:11:57.058976] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:57.080910] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-25T19:11:57.081811] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-25T19:11:57.418887] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:57.430408] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-25T19:11:57.438333] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-25T19:11:57.459343] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-25T19:11:57.460019] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-25T19:11:57.539760] [DEBUG] [LOCAL ] HASI: Primary data saved (47537 records). [2025-09-25T19:11:57.571188] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-25T19:11:57.593474] [INFO ] [MAIN ] Update Progress: 996/2372 symbols completed. HASI took 35.5s. Estimated remaining: 3h 2m 14s. Rate: 7.6 symbols/min [2025-09-25T19:11:57.874969] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:57.908309] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-25T19:11:58.180400] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:11:58.267798] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:58.268290] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-25T19:11:58.318267] [DEBUG] [LOCAL ] HCC: Loaded 45391 existing records from primary storage. [2025-09-25T19:11:58.318472] [INFO ] [MAIN ] HCC: Loaded 45391 existing records. [2025-09-25T19:11:58.517358] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:11:58.517692] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-25T19:11:58.517752] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-25T19:11:58.518191] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-25T19:11:58.518251] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-25T19:11:58.910585] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:11:58.911015] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-25T19:11:58.950090] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T19:11:58.962821] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-25T19:11:59.685219] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T19:11:59.696892] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-25T19:11:59.976790] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:11:59.989201] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-25T19:12:00.074741] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T19:12:00.083440] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-25T19:12:00.636196] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T19:12:00.688737] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-25T19:12:01.065063] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T19:12:01.228243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T19:12:01.488780] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-25T19:12:01.779932] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T19:12:02.288734] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-25T19:12:02.448673] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T19:12:03.021062] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:12:03.088681] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-25T19:12:03.817762] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:12:03.888720] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-25T19:12:04.341340] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T19:12:04.688761] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-25T19:12:05.488756] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-25T19:12:05.654689] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:12:06.288736] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-25T19:12:06.433460] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:12:07.088749] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-25T19:12:07.509417] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T19:12:07.657935] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T19:12:07.888827] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-25T19:12:08.641456] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T19:12:08.688798] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-25T19:12:09.488763] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-25T19:12:09.944267] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T19:12:10.288752] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-25T19:12:10.401275] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:12:11.088741] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-25T19:12:11.271968] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T19:12:11.888694] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-25T19:12:11.949934] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:12:12.468972] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T19:12:12.688765] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-25T19:12:13.488786] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-25T19:12:13.604487] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T19:12:14.288789] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-25T19:12:14.378099] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:12:15.088787] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-25T19:12:15.157899] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T19:12:15.888725] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-25T19:12:15.986832] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T19:12:16.688698] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-25T19:12:16.720836] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T19:12:17.168403] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T19:12:17.488738] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-25T19:12:18.105783] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T19:12:18.288848] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-25T19:12:19.088731] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-25T19:12:19.310371] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T19:12:19.888711] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-25T19:12:20.053865] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T19:12:20.688763] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-25T19:12:20.852159] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T19:12:21.488695] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-25T19:12:21.557819] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:12:22.288710] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-25T19:12:22.621182] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T19:12:23.088819] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-25T19:12:23.275038] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T19:12:23.658727] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T19:12:23.667285] [INFO ] [REMOTE ] HCA: Full fetch complete (69007 records). [2025-09-25T19:12:23.667439] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-25T19:12:23.900006] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-25T19:12:24.083283] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-25T19:12:24.083365] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-25T19:12:24.084526] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-25T19:12:24.084601] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-25T19:12:24.086380] [DEBUG] [LOCAL ] HCA: Trimmed 69007 records to 47438 (keeping 200 days of data) [2025-09-25T19:12:24.390220] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T19:12:24.404810] [INFO ] [REMOTE ] HCC: Full fetch complete (64368 records). [2025-09-25T19:12:24.405030] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-25T19:12:24.693785] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-25T19:12:24.877546] [DEBUG] [LOCAL ] HCA: Primary data saved (47438 records). [2025-09-25T19:12:24.880758] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-25T19:12:24.880916] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-25T19:12:24.880840] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-25T19:12:24.883671] [INFO ] [MAIN ] Update Progress: 997/2372 symbols completed. HCA took 29.1s. Estimated remaining: 3h 2m 33s. Rate: 7.5 symbols/min [2025-09-25T19:12:24.881917] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-25T19:12:24.884002] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-25T19:12:24.885664] [DEBUG] [LOCAL ] HCC: Trimmed 64368 records to 45714 (keeping 200 days of data) [2025-09-25T19:12:25.183315] [DEBUG] [LOCAL ] HCC: Primary data saved (45714 records). [2025-09-25T19:12:25.183486] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-25T19:12:25.183597] [INFO ] [MAIN ] Update Progress: 998/2372 symbols completed. HCC took 27.5s. Estimated remaining: 3h 2m 14s. Rate: 7.5 symbols/min [2025-09-25T19:12:25.512938] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T19:12:25.525018] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-25T19:12:26.749824] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T19:12:26.764573] [INFO ] [REMOTE ] HBI: Full fetch complete (76898 records). [2025-09-25T19:12:26.764824] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-25T19:12:27.199215] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-25T19:12:27.199474] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-25T19:12:27.200901] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-25T19:12:27.200994] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-25T19:12:27.203088] [DEBUG] [LOCAL ] HBI: Trimmed 76898 records to 53387 (keeping 200 days of data) [2025-09-25T19:12:27.326081] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T19:12:27.339276] [INFO ] [REMOTE ] HBM: Full fetch complete (76109 records). [2025-09-25T19:12:27.340104] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-25T19:12:27.773462] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-25T19:12:27.774013] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-25T19:12:27.776070] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-25T19:12:27.776163] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-25T19:12:27.783187] [DEBUG] [LOCAL ] HBM: Trimmed 76109 records to 53293 (keeping 200 days of data) [2025-09-25T19:12:28.252921] [DEBUG] [LOCAL ] HBI: Primary data saved (53387 records). [2025-09-25T19:12:28.254184] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-25T19:12:28.254774] [INFO ] [MAIN ] Update Progress: 999/2372 symbols completed. HBI took 33.4s. Estimated remaining: 3h 1m 60s. Rate: 7.5 symbols/min [2025-09-25T19:12:28.347871] [DEBUG] [LOCAL ] HBM: Primary data saved (53293 records). [2025-09-25T19:12:28.348082] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-25T19:12:28.348224] [INFO ] [MAIN ] Update Progress: 1000/2372 symbols completed. HBM took 32.9s. Estimated remaining: 3h 1m 41s. Rate: 7.6 symbols/min [2025-09-25T19:12:28.933980] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:12:29.018627] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:12:29.083629] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:12:29.118208] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:12:29.118604] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-25T19:12:29.123221] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-25T19:12:29.123453] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-25T19:12:29.123507] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-25T19:12:29.123552] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-25T19:12:29.123587] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-25T19:12:29.245818] [DEBUG] [LOCAL ] HCI: Loaded 13906 existing records from primary storage. [2025-09-25T19:12:29.256627] [INFO ] [MAIN ] HCI: Loaded 13906 existing records. [2025-09-25T19:12:29.688634] [DEBUG] [LOCAL ] HDB: Loaded 51926 existing records from primary storage. [2025-09-25T19:12:29.687491] [DEBUG] [LOCAL ] HD: Loaded 53515 existing records from primary storage. [2025-09-25T19:12:29.716393] [INFO ] [MAIN ] HD: Loaded 53515 existing records. [2025-09-25T19:12:29.735309] [INFO ] [MAIN ] HDB: Loaded 51926 existing records. [2025-09-25T19:12:29.710886] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:12:29.835823] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-25T19:12:29.830599] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:12:29.886936] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-25T19:12:29.897580] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-25T19:12:29.932433] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-25T19:12:29.983632] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-25T19:12:30.142736] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:12:30.151615] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-25T19:12:30.164200] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-25T19:12:30.209746] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-25T19:12:30.220194] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-25T19:12:30.321112] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:12:30.352522] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-25T19:12:30.395012] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-25T19:12:30.414575] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-25T19:12:30.413413] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-25T19:12:30.435222] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-25T19:12:30.465421] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-25T19:12:30.813478] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T19:12:30.830298] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-25T19:12:31.141891] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:12:31.206408] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:12:31.229505] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-25T19:12:31.239939] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T19:12:31.244049] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-25T19:12:31.246006] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-25T19:12:31.329624] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:12:31.330002] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-25T19:12:31.585562] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-25T19:12:31.888803] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-25T19:12:32.141573] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-25T19:12:32.260097] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:12:32.688725] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-25T19:12:32.981353] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-25T19:12:32.986441] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T19:12:33.046299] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T19:12:33.488754] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-25T19:12:34.288741] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-25T19:12:35.088694] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-25T19:12:35.170890] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T19:12:35.358619] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-25T19:12:35.466367] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T19:12:35.888756] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-25T19:12:36.688732] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-25T19:12:36.769518] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T19:12:37.488815] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-25T19:12:38.288758] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-25T19:12:38.523075] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-25T19:12:38.774817] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T19:12:39.088759] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-25T19:12:39.225377] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T19:12:39.437083] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T19:12:39.888738] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-25T19:12:40.241792] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-25T19:12:40.242552] [INFO ] [REMOTE ] HCXY: Full fetch complete (598 records). [2025-09-25T19:12:40.242623] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-25T19:12:40.243070] [FATAL] [VALIDATOR ] HCXY: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T19:12:40.243159] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:12:40.243214] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:12:40.243278] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-25T19:12:40.243344] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-25T19:12:40.243392] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-25T19:12:40.243476] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-25T19:12:40.243571] [INFO ] [MAIN ] Update Progress: 1001/2372 symbols completed. HCXY took 11.8s. Estimated remaining: 3h 1m 38s. Rate: 7.5 symbols/min [2025-09-25T19:12:40.426895] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:12:40.478489] [DEBUG] [LOCAL ] HE: Loaded 49192 existing records from primary storage. [2025-09-25T19:12:40.478725] [INFO ] [MAIN ] HE: Loaded 49192 existing records. [2025-09-25T19:12:40.661864] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:12:40.662126] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-25T19:12:40.662194] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-25T19:12:40.662479] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-25T19:12:40.662536] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-25T19:12:40.693787] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-25T19:12:41.023515] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:12:41.488737] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-25T19:12:42.288713] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-25T19:12:42.585006] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:12:43.088693] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-25T19:12:43.521754] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-25T19:12:43.625460] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T19:12:43.888728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-25T19:12:44.688697] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-25T19:12:44.873211] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T19:12:45.488712] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-25T19:12:45.728554] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T19:12:46.123684] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T19:12:46.288747] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-25T19:12:46.705846] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T19:12:47.088725] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-25T19:12:47.888713] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-25T19:12:48.001710] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T19:12:48.688675] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-25T19:12:48.875965] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T19:12:49.022971] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T19:12:49.488721] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-25T19:12:50.293801] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-25T19:12:50.312970] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T19:12:51.088692] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-25T19:12:51.604964] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T19:12:51.888708] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-25T19:12:52.025358] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T19:12:52.442485] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T19:12:52.524169] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T19:12:52.688728] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-25T19:12:53.488734] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-25T19:12:54.288697] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-25T19:12:54.426198] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:12:54.501594] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T19:12:55.088727] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-25T19:12:55.888696] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-25T19:12:56.222881] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T19:12:56.261558] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T19:12:56.688757] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-25T19:12:57.278560] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T19:12:57.488757] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-25T19:12:58.288742] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-25T19:12:58.356143] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T19:12:58.411121] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:12:59.088730] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-25T19:12:59.888747] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-25T19:13:00.089170] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T19:13:00.132441] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T19:13:00.136703] [INFO ] [REMOTE ] HCI: Full fetch complete (19347 records). [2025-09-25T19:13:00.136931] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-25T19:13:00.554490] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-25T19:13:00.554628] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-25T19:13:00.555299] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-25T19:13:00.555348] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-25T19:13:00.556086] [DEBUG] [LOCAL ] HCI: Trimmed 19347 records to 13999 (keeping 200 days of data) [2025-09-25T19:13:00.664336] [DEBUG] [LOCAL ] HCI: Primary data saved (13999 records). [2025-09-25T19:13:00.664534] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-25T19:13:00.664672] [INFO ] [MAIN ] Update Progress: 1002/2372 symbols completed. HCI took 32.3s. Estimated remaining: 3h 1m 48s. Rate: 7.5 symbols/min [2025-09-25T19:13:00.698618] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-25T19:13:00.850610] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:00.903271] [DEBUG] [LOCAL ] HEI: Loaded 32518 existing records from primary storage. [2025-09-25T19:13:00.903472] [INFO ] [MAIN ] HEI: Loaded 32518 existing records. [2025-09-25T19:13:01.098876] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:01.099314] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-25T19:13:01.099388] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-25T19:13:01.099676] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-25T19:13:01.099755] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-25T19:13:01.460405] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:01.488665] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-25T19:13:02.126451] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-25T19:13:02.178009] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T19:13:02.288730] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-25T19:13:02.615051] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T19:13:03.088725] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-25T19:13:03.888752] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-25T19:13:04.618454] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-25T19:13:04.688797] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-25T19:13:04.781075] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T19:13:05.488701] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-25T19:13:05.645499] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:13:06.288813] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-25T19:13:06.750719] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T19:13:06.761088] [INFO ] [REMOTE ] HD: Full fetch complete (77447 records). [2025-09-25T19:13:06.761259] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-25T19:13:07.094034] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-25T19:13:07.172936] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-25T19:13:07.173048] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-25T19:13:07.174214] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-25T19:13:07.174286] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-25T19:13:07.176163] [DEBUG] [LOCAL ] HD: Trimmed 77447 records to 53902 (keeping 200 days of data) [2025-09-25T19:13:07.443601] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T19:13:07.455260] [INFO ] [REMOTE ] HDB: Full fetch complete (75224 records). [2025-09-25T19:13:07.456179] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-25T19:13:07.976956] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-25T19:13:07.978181] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-25T19:13:07.980176] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-25T19:13:07.980428] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-25T19:13:08.014185] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T19:13:08.026495] [DEBUG] [LOCAL ] HDB: Trimmed 75224 records to 52305 (keeping 200 days of data) [2025-09-25T19:13:08.029777] [INFO ] [REMOTE ] HE: Full fetch complete (72461 records). [2025-09-25T19:13:08.032316] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-25T19:13:08.259744] [DEBUG] [LOCAL ] HD: Primary data saved (53902 records). [2025-09-25T19:13:08.271671] [INFO ] [MAIN ] HD: Full history saved. [2025-09-25T19:13:08.277265] [INFO ] [MAIN ] Update Progress: 1003/2372 symbols completed. HD took 39.9s. Estimated remaining: 3h 1m 39s. Rate: 7.5 symbols/min [2025-09-25T19:13:08.871904] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:09.036204] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-25T19:13:09.036427] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-25T19:13:09.035953] [DEBUG] [LOCAL ] HEQ: Loaded 6152 existing records from primary storage. [2025-09-25T19:13:09.039828] [INFO ] [MAIN ] HEQ: Loaded 6152 existing records. [2025-09-25T19:13:09.038803] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-25T19:13:09.040385] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-25T19:13:09.093735] [DEBUG] [LOCAL ] HE: Trimmed 72461 records to 49539 (keeping 200 days of data) [2025-09-25T19:13:09.196739] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-25T19:13:09.263366] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-25T19:13:09.374745] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:09.387204] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-25T19:13:09.389272] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-25T19:13:09.395853] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-25T19:13:09.396686] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-25T19:13:09.984935] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:09.986862] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-25T19:13:10.020187] [DEBUG] [LOCAL ] HDB: Primary data saved (52305 records). [2025-09-25T19:13:10.020972] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-25T19:13:10.022141] [INFO ] [MAIN ] Update Progress: 1004/2372 symbols completed. HDB took 41.7s. Estimated remaining: 3h 1m 23s. Rate: 7.5 symbols/min [2025-09-25T19:13:10.265104] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:10.290329] [DEBUG] [LOCAL ] HE: Primary data saved (49539 records). [2025-09-25T19:13:10.290611] [INFO ] [MAIN ] HE: Full history saved. [2025-09-25T19:13:10.291349] [INFO ] [MAIN ] Update Progress: 1005/2372 symbols completed. HE took 30.0s. Estimated remaining: 3h 1m 4s. Rate: 7.5 symbols/min [2025-09-25T19:13:10.518071] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:10.518334] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-25T19:13:10.518410] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-25T19:13:10.520048] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-25T19:13:10.520316] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-25T19:13:10.520424] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-25T19:13:10.520191] [DEBUG] [LOCAL ] HESM: Loaded 48169 existing records from primary storage. [2025-09-25T19:13:10.520494] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-25T19:13:10.520783] [INFO ] [MAIN ] HESM: Loaded 48169 existing records. [2025-09-25T19:13:10.747383] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T19:13:10.760396] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-25T19:13:11.002336] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:11.032482] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-25T19:13:11.050851] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-25T19:13:11.065560] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-25T19:13:11.069901] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-25T19:13:11.235453] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:11.239291] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-25T19:13:11.238902] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T19:13:11.305294] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-25T19:13:11.586709] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:11.588476] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T19:13:11.660566] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-25T19:13:11.888750] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-25T19:13:12.688797] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-25T19:13:12.846253] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:13:13.293573] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T19:13:13.431095] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:13:13.488677] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-25T19:13:14.288752] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-25T19:13:14.392866] [DEBUG] [REMOTE ] HF: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-25T19:13:14.393264] [WARN ] [REMOTE ] HF: No data returned for month 2025-01 [2025-09-25T19:13:15.072888] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T19:13:15.088718] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-25T19:13:15.698752] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T19:13:15.888752] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-25T19:13:16.229824] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-25T19:13:16.688755] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-25T19:13:16.939561] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-25T19:13:17.488802] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-25T19:13:18.288828] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-25T19:13:18.535739] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-09-25T19:13:19.022984] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:13:19.088791] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-25T19:13:19.552765] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T19:13:19.888859] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-25T19:13:20.688809] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-25T19:13:20.926490] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-25T19:13:21.488745] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-25T19:13:21.663868] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:13:21.741845] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-25T19:13:22.288737] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-25T19:13:23.088786] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-25T19:13:23.869926] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T19:13:23.897964] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-25T19:13:23.908990] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T19:13:24.688796] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-25T19:13:25.488712] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-25T19:13:25.602381] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T19:13:25.872624] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T19:13:26.236227] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T19:13:26.288740] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-25T19:13:26.634626] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-25T19:13:27.088789] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-25T19:13:27.888748] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-25T19:13:28.121373] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-25T19:13:28.267178] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T19:13:28.688728] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-25T19:13:29.488735] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-25T19:13:30.218997] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T19:13:30.222054] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T19:13:30.288667] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-25T19:13:30.893211] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T19:13:31.088691] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-25T19:13:31.888736] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-25T19:13:32.695278] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-25T19:13:32.721444] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T19:13:32.721203] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T19:13:32.733687] [INFO ] [REMOTE ] HEQ: Full fetch complete (9090 records). [2025-09-25T19:13:32.734424] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-25T19:13:33.110812] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-25T19:13:33.120286] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-25T19:13:33.121234] [INFO ] [REMOTE ] HF: Full fetch complete (432 records). [2025-09-25T19:13:33.121435] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-25T19:13:33.121354] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-25T19:13:33.127211] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-25T19:13:33.127307] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-25T19:13:33.194830] [DEBUG] [LOCAL ] HEQ: Trimmed 9090 records to 6173 (keeping 200 days of data) [2025-09-25T19:13:33.320895] [DEBUG] [LOCAL ] HEQ: Primary data saved (6173 records). [2025-09-25T19:13:33.346800] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-25T19:13:33.346986] [INFO ] [MAIN ] Update Progress: 1006/2372 symbols completed. HEQ took 25.1s. Estimated remaining: 3h 1m 17s. Rate: 7.5 symbols/min [2025-09-25T19:13:33.352700] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-25T19:13:33.421372] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:13:33.433092] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:13:33.450267] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-25T19:13:33.459176] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-25T19:13:33.461964] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-25T19:13:33.462087] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-25T19:13:33.462269] [INFO ] [MAIN ] Update Progress: 1007/2372 symbols completed. HF took 23.2s. Estimated remaining: 3h 0m 58s. Rate: 7.5 symbols/min [2025-09-25T19:13:33.490534] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-25T19:13:33.604747] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:33.628008] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-25T19:13:33.634113] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-25T19:13:33.646114] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-25T19:13:33.646486] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-25T19:13:33.652077] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-25T19:13:33.662337] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-25T19:13:33.804819] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:34.031091] [DEBUG] [LOCAL ] HFRO: Loaded 17448 existing records from primary storage. [2025-09-25T19:13:34.031326] [INFO ] [MAIN ] HFRO: Loaded 17448 existing records. [2025-09-25T19:13:34.238638] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:34.305739] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-25T19:13:34.311493] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:34.312723] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-25T19:13:34.312785] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-25T19:13:34.313123] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-25T19:13:34.313182] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-25T19:13:34.690767] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:35.088733] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-25T19:13:35.333160] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T19:13:35.419983] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T19:13:35.888740] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-25T19:13:36.376684] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T19:13:36.688748] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-25T19:13:36.996401] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T19:13:37.488760] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-25T19:13:37.830081] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-25T19:13:37.846361] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T19:13:38.288756] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-25T19:13:38.565478] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-25T19:13:39.088741] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-25T19:13:39.513870] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T19:13:39.888730] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-25T19:13:40.688771] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-25T19:13:40.884421] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:13:40.889864] [INFO ] [REMOTE ] HEI: Full fetch complete (48980 records). [2025-09-25T19:13:40.890012] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-25T19:13:41.166923] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T19:13:41.282811] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-25T19:13:41.282908] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-25T19:13:41.283832] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-25T19:13:41.283897] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-25T19:13:41.285141] [DEBUG] [LOCAL ] HEI: Trimmed 48980 records to 32653 (keeping 200 days of data) [2025-09-25T19:13:41.488864] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-25T19:13:41.503597] [DEBUG] [LOCAL ] HEI: Primary data saved (32653 records). [2025-09-25T19:13:41.503932] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-25T19:13:41.505570] [INFO ] [MAIN ] Update Progress: 1008/2372 symbols completed. HEI took 40.8s. Estimated remaining: 3h 0m 50s. Rate: 7.5 symbols/min [2025-09-25T19:13:41.679827] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:41.697612] [DEBUG] [LOCAL ] HGER: Loaded 13138 existing records from primary storage. [2025-09-25T19:13:41.697789] [INFO ] [MAIN ] HGER: Loaded 13138 existing records. [2025-09-25T19:13:41.885216] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:41.885484] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-25T19:13:41.885536] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-25T19:13:41.885776] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-25T19:13:41.885840] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-25T19:13:42.259379] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:42.288752] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-25T19:13:42.919295] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T19:13:43.088757] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-25T19:13:43.232626] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T19:13:43.554971] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T19:13:43.888730] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-25T19:13:44.496330] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T19:13:44.688728] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-25T19:13:45.488729] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-25T19:13:46.288769] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-25T19:13:46.535746] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T19:13:46.632385] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-25T19:13:46.885270] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-25T19:13:46.895125] [INFO ] [REMOTE ] HESM: Full fetch complete (68988 records). [2025-09-25T19:13:46.895317] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-25T19:13:47.096201] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-25T19:13:47.323961] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-25T19:13:47.324051] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-25T19:13:47.325228] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-25T19:13:47.325315] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-25T19:13:47.327083] [DEBUG] [LOCAL ] HESM: Trimmed 68988 records to 48522 (keeping 200 days of data) [2025-09-25T19:13:47.646870] [DEBUG] [LOCAL ] HESM: Primary data saved (48522 records). [2025-09-25T19:13:47.647034] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-25T19:13:47.648238] [INFO ] [MAIN ] Update Progress: 1009/2372 symbols completed. HESM took 37.6s. Estimated remaining: 3h 0m 40s. Rate: 7.5 symbols/min [2025-09-25T19:13:47.830891] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:13:47.845917] [DEBUG] [LOCAL ] HGLB: Loaded 9759 existing records from primary storage. [2025-09-25T19:13:47.846142] [INFO ] [MAIN ] HGLB: Loaded 9759 existing records. [2025-09-25T19:13:47.895826] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-25T19:13:48.056061] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:13:48.056513] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-25T19:13:48.056598] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-25T19:13:48.056963] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-25T19:13:48.057026] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-25T19:13:48.410351] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T19:13:48.507993] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:13:48.690667] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-25T19:13:48.693855] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T19:13:49.488758] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-25T19:13:49.505936] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T19:13:49.837940] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T19:13:50.288771] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-25T19:13:51.033528] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T19:13:51.088747] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-25T19:13:51.492089] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T19:13:51.888738] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-25T19:13:52.688772] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-25T19:13:52.941244] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T19:13:53.463134] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T19:13:53.488696] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-25T19:13:54.288738] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-25T19:13:54.321844] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T19:13:55.088725] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-25T19:13:55.198127] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T19:13:55.888721] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-25T19:13:55.928281] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T19:13:56.688759] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-25T19:13:56.807010] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T19:13:57.488753] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-25T19:13:57.568125] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T19:13:58.288707] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-25T19:13:58.490507] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T19:13:59.073320] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T19:13:59.088677] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-25T19:13:59.512485] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T19:13:59.888748] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-25T19:14:00.315791] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T19:14:00.688759] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-25T19:14:01.481993] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T19:14:01.488675] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-25T19:14:02.288707] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-25T19:14:02.433371] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T19:14:03.049946] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T19:14:03.088714] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-25T19:14:03.888685] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-25T19:14:04.207020] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T19:14:04.211370] [INFO ] [REMOTE ] HFRO: Full fetch complete (28875 records). [2025-09-25T19:14:04.211472] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-25T19:14:04.598937] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T19:14:04.643966] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-25T19:14:04.644052] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-25T19:14:04.644850] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-25T19:14:04.644914] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-25T19:14:04.645759] [DEBUG] [LOCAL ] HFRO: Trimmed 28875 records to 17616 (keeping 200 days of data) [2025-09-25T19:14:04.691343] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-25T19:14:04.763758] [DEBUG] [LOCAL ] HFRO: Primary data saved (17616 records). [2025-09-25T19:14:04.763943] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-25T19:14:04.764045] [INFO ] [MAIN ] Update Progress: 1010/2372 symbols completed. HFRO took 31.3s. Estimated remaining: 3h 0m 44s. Rate: 7.5 symbols/min [2025-09-25T19:14:04.951798] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:04.967475] [DEBUG] [LOCAL ] HGTY: Loaded 13112 existing records from primary storage. [2025-09-25T19:14:04.967611] [INFO ] [MAIN ] HGTY: Loaded 13112 existing records. [2025-09-25T19:14:05.160948] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:05.161241] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-25T19:14:05.161291] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-25T19:14:05.161563] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-25T19:14:05.161624] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-25T19:14:05.504610] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-25T19:14:05.552102] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:05.820839] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-25T19:14:06.084993] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:14:06.089247] [INFO ] [REMOTE ] HGER: Full fetch complete (16340 records). [2025-09-25T19:14:06.089324] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-25T19:14:06.297797] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-25T19:14:06.498823] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-25T19:14:06.498909] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-25T19:14:06.499339] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-25T19:14:06.499378] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-25T19:14:06.499983] [DEBUG] [LOCAL ] HGER: Trimmed 16340 records to 13284 (keeping 200 days of data) [2025-09-25T19:14:06.579771] [DEBUG] [LOCAL ] HGER: Primary data saved (13284 records). [2025-09-25T19:14:06.579930] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-25T19:14:06.580022] [INFO ] [MAIN ] Update Progress: 1011/2372 symbols completed. HGER took 25.1s. Estimated remaining: 3h 0m 28s. Rate: 7.5 symbols/min [2025-09-25T19:14:06.753694] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:06.802910] [DEBUG] [LOCAL ] HGV: Loaded 46877 existing records from primary storage. [2025-09-25T19:14:06.803098] [INFO ] [MAIN ] HGV: Loaded 46877 existing records. [2025-09-25T19:14:06.987637] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:06.987937] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-25T19:14:06.987998] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-25T19:14:06.988394] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-25T19:14:06.988455] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-25T19:14:07.086675] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T19:14:07.094382] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-25T19:14:07.100166] [INFO ] [REMOTE ] HFND: Full fetch complete (1790 records). [2025-09-25T19:14:07.101012] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-25T19:14:07.558665] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-25T19:14:07.572721] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:14:07.593951] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:14:07.597886] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:07.598058] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-25T19:14:07.598564] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-25T19:14:07.598680] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-25T19:14:07.598791] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-25T19:14:07.598920] [INFO ] [MAIN ] Update Progress: 1012/2372 symbols completed. HFND took 34.3s. Estimated remaining: 3h 0m 11s. Rate: 7.5 symbols/min [2025-09-25T19:14:07.781956] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:07.820554] [DEBUG] [LOCAL ] HHH: Loaded 32641 existing records from primary storage. [2025-09-25T19:14:07.820760] [INFO ] [MAIN ] HHH: Loaded 32641 existing records. [2025-09-25T19:14:07.890671] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-25T19:14:08.005633] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:08.005925] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-25T19:14:08.005975] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-25T19:14:08.006332] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-25T19:14:08.006391] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-25T19:14:08.127999] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:14:08.419673] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:08.688800] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-25T19:14:09.351625] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T19:14:09.488720] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-25T19:14:09.852843] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T19:14:10.288799] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-25T19:14:11.031715] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T19:14:11.063149] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T19:14:11.088666] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-25T19:14:11.888780] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-25T19:14:12.531992] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T19:14:12.628037] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T19:14:12.688814] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-25T19:14:13.488728] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-25T19:14:14.254070] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T19:14:14.288662] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-25T19:14:14.322607] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T19:14:15.088775] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-25T19:14:15.203984] [DEBUG] [REMOTE ] HGLB: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-25T19:14:15.204350] [WARN ] [REMOTE ] HGLB: No data returned for month 2025-08 [2025-09-25T19:14:15.888746] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-25T19:14:16.057877] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T19:14:16.688719] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-25T19:14:16.842409] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T19:14:16.844974] [INFO ] [REMOTE ] HGLB: Full fetch complete (13053 records). [2025-09-25T19:14:16.845058] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-25T19:14:17.048790] [WARN ] [VALIDATOR ] HGLB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-25T19:14:17.049108] [FATAL] [MAIN ] HGLB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:14:17.049187] [WARN ] [MAIN ] HGLB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:14:17.049262] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-25T19:14:17.049339] [DEBUG] [LOCAL ] HGLB: No primary data file found to delete. [2025-09-25T19:14:17.049380] [INFO ] [LOCAL ] HGLB: Starting deletion of derivative data. [2025-09-25T19:14:17.049933] [DEBUG] [LOCAL ] HGLB: Deleted derivative data file. [2025-09-25T19:14:17.050050] [INFO ] [MAIN ] Update Progress: 1013/2372 symbols completed. HGLB took 29.4s. Estimated remaining: 3h 0m 5s. Rate: 7.5 symbols/min [2025-09-25T19:14:17.246411] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:17.294741] [DEBUG] [LOCAL ] HI: Loaded 35136 existing records from primary storage. [2025-09-25T19:14:17.294991] [INFO ] [MAIN ] HI: Loaded 35136 existing records. [2025-09-25T19:14:17.489245] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-25T19:14:17.494063] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:17.495808] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-25T19:14:17.495884] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-25T19:14:17.496466] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-25T19:14:17.496571] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-25T19:14:17.908314] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:18.295210] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-25T19:14:18.302447] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:14:18.743296] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T19:14:19.012851] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T19:14:19.088740] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-25T19:14:19.888718] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-25T19:14:19.898514] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:14:20.688746] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-25T19:14:21.184897] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T19:14:21.488793] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-25T19:14:21.878991] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T19:14:22.025540] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T19:14:22.288747] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-25T19:14:23.088822] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-25T19:14:23.649080] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T19:14:23.888708] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-25T19:14:23.936438] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T19:14:24.688776] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-25T19:14:25.488719] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-25T19:14:25.616032] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:14:26.004906] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T19:14:26.288761] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-25T19:14:26.436694] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T19:14:27.088820] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-25T19:14:27.899215] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-25T19:14:27.923417] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:14:28.256762] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T19:14:28.688748] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-25T19:14:28.866376] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T19:14:29.488923] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-25T19:14:30.101767] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T19:14:30.111114] [INFO ] [REMOTE ] HGV: Full fetch complete (65654 records). [2025-09-25T19:14:30.111401] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-25T19:14:30.298317] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-25T19:14:30.551297] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-25T19:14:30.551484] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-25T19:14:30.553491] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-25T19:14:30.553756] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-25T19:14:30.582204] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T19:14:30.593524] [DEBUG] [LOCAL ] HGV: Trimmed 65654 records to 47168 (keeping 200 days of data) [2025-09-25T19:14:30.900739] [DEBUG] [LOCAL ] HGV: Primary data saved (47168 records). [2025-09-25T19:14:30.900935] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-25T19:14:30.901174] [INFO ] [MAIN ] Update Progress: 1014/2372 symbols completed. HGV took 24.3s. Estimated remaining: 3h 0m 5s. Rate: 7.5 symbols/min [2025-09-25T19:14:31.094942] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-25T19:14:31.094795] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:31.167431] [DEBUG] [LOCAL ] HIG: Loaded 51237 existing records from primary storage. [2025-09-25T19:14:31.167697] [INFO ] [MAIN ] HIG: Loaded 51237 existing records. [2025-09-25T19:14:31.291266] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T19:14:31.381453] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:31.381827] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-25T19:14:31.381882] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-25T19:14:31.382368] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-25T19:14:31.382442] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-25T19:14:31.800912] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:31.888862] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-25T19:14:32.671340] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:14:32.692866] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-25T19:14:32.703823] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:14:33.488779] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-25T19:14:34.290962] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-25T19:14:34.295426] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T19:14:34.371502] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T19:14:35.088796] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-25T19:14:35.770865] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T19:14:35.888684] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-25T19:14:36.301281] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T19:14:36.306101] [INFO ] [REMOTE ] HGTY: Full fetch complete (17237 records). [2025-09-25T19:14:36.306248] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-25T19:14:36.686621] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-25T19:14:36.686764] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-25T19:14:36.687609] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-25T19:14:36.687710] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-25T19:14:36.688732] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-25T19:14:36.689820] [DEBUG] [LOCAL ] HGTY: Trimmed 17237 records to 13226 (keeping 200 days of data) [2025-09-25T19:14:36.789936] [DEBUG] [LOCAL ] HGTY: Primary data saved (13226 records). [2025-09-25T19:14:36.790146] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-25T19:14:36.790316] [INFO ] [MAIN ] Update Progress: 1015/2372 symbols completed. HGTY took 32.0s. Estimated remaining: 2h 59m 54s. Rate: 7.5 symbols/min [2025-09-25T19:14:36.979320] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:37.043414] [DEBUG] [LOCAL ] HII: Loaded 35179 existing records from primary storage. [2025-09-25T19:14:37.043617] [INFO ] [MAIN ] HII: Loaded 35179 existing records. [2025-09-25T19:14:37.233114] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:37.233587] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-25T19:14:37.233677] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-25T19:14:37.234102] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-25T19:14:37.234162] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-25T19:14:37.489752] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-25T19:14:37.636198] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:37.660729] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:14:37.732106] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T19:14:38.288754] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-25T19:14:39.088777] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-25T19:14:39.316500] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T19:14:39.641109] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:14:39.888743] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-25T19:14:40.230918] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T19:14:40.688825] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-25T19:14:41.312523] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T19:14:41.488787] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-25T19:14:41.915188] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T19:14:42.288770] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-25T19:14:43.016593] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T19:14:43.088699] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-25T19:14:43.639494] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T19:14:43.888776] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-25T19:14:44.202256] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T19:14:44.208680] [INFO ] [REMOTE ] HI: Full fetch complete (49738 records). [2025-09-25T19:14:44.208834] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-25T19:14:44.607238] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-25T19:14:44.607333] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-25T19:14:44.608459] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-25T19:14:44.608538] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-25T19:14:44.609815] [DEBUG] [LOCAL ] HI: Trimmed 49738 records to 35414 (keeping 200 days of data) [2025-09-25T19:14:44.714954] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-25T19:14:44.849700] [DEBUG] [LOCAL ] HI: Primary data saved (35414 records). [2025-09-25T19:14:44.849875] [INFO ] [MAIN ] HI: Full history saved. [2025-09-25T19:14:44.850002] [INFO ] [MAIN ] Update Progress: 1016/2372 symbols completed. HI took 27.8s. Estimated remaining: 2h 59m 46s. Rate: 7.5 symbols/min [2025-09-25T19:14:45.025355] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:45.091027] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-25T19:14:45.091240] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-25T19:14:45.280415] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:45.280943] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-25T19:14:45.281006] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-25T19:14:45.281285] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-25T19:14:45.281342] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-25T19:14:45.497717] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-25T19:14:45.648185] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T19:14:45.679468] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:46.288727] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-25T19:14:46.337169] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T19:14:46.343583] [INFO ] [REMOTE ] HHH: Full fetch complete (45192 records). [2025-09-25T19:14:46.343713] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-25T19:14:46.729256] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-25T19:14:46.729369] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-25T19:14:46.730381] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-25T19:14:46.730445] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-25T19:14:46.731610] [DEBUG] [LOCAL ] HHH: Trimmed 45192 records to 32833 (keeping 200 days of data) [2025-09-25T19:14:46.945342] [DEBUG] [LOCAL ] HHH: Primary data saved (32833 records). [2025-09-25T19:14:46.945505] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-25T19:14:46.945704] [INFO ] [MAIN ] Update Progress: 1017/2372 symbols completed. HHH took 39.3s. Estimated remaining: 2h 59m 31s. Rate: 7.5 symbols/min [2025-09-25T19:14:47.100587] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-25T19:14:47.123534] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:14:47.149683] [DEBUG] [LOCAL ] HIO: Loaded 23601 existing records from primary storage. [2025-09-25T19:14:47.149907] [INFO ] [MAIN ] HIO: Loaded 23601 existing records. [2025-09-25T19:14:47.343321] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:14:47.343977] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-25T19:14:47.344159] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-25T19:14:47.344500] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-25T19:14:47.344582] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-25T19:14:47.486828] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T19:14:47.756180] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:14:47.888671] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-25T19:14:48.688721] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-25T19:14:48.828849] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-25T19:14:48.869212] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T19:14:48.903479] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T19:14:49.488767] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-25T19:14:50.116557] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T19:14:50.288730] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-25T19:14:50.876830] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T19:14:51.088754] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-25T19:14:51.799370] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T19:14:51.888680] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-25T19:14:52.688729] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-25T19:14:52.842579] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T19:14:53.488704] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-25T19:14:53.646578] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T19:14:54.288756] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-25T19:14:55.062420] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T19:14:55.100344] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-25T19:14:55.106677] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-25T19:14:55.888694] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-25T19:14:55.983218] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:14:56.157217] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:14:56.688809] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-25T19:14:57.165939] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T19:14:57.488800] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-25T19:14:58.288748] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-25T19:14:58.733256] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T19:14:59.088750] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-25T19:14:59.164985] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-25T19:14:59.366099] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T19:14:59.888757] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-25T19:15:00.652564] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T19:15:00.688685] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-25T19:15:01.488800] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-25T19:15:02.288814] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-25T19:15:02.546562] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T19:15:02.642511] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-25T19:15:03.000415] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:15:03.088688] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-25T19:15:03.768438] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T19:15:03.888744] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-25T19:15:03.965799] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T19:15:04.688796] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-25T19:15:05.488776] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-25T19:15:05.536502] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T19:15:05.544341] [INFO ] [REMOTE ] HII: Full fetch complete (53417 records). [2025-09-25T19:15:05.544571] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-25T19:15:05.770712] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T19:15:06.207989] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-25T19:15:06.208100] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-25T19:15:06.209176] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-25T19:15:06.209243] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-25T19:15:06.211611] [DEBUG] [LOCAL ] HII: Trimmed 53417 records to 35496 (keeping 200 days of data) [2025-09-25T19:15:06.311829] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-25T19:15:06.456039] [DEBUG] [LOCAL ] HII: Primary data saved (35496 records). [2025-09-25T19:15:06.456193] [INFO ] [MAIN ] HII: Full history saved. [2025-09-25T19:15:06.456981] [INFO ] [MAIN ] Update Progress: 1018/2372 symbols completed. HII took 29.7s. Estimated remaining: 2h 59m 38s. Rate: 7.5 symbols/min [2025-09-25T19:15:06.627924] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:06.652549] [DEBUG] [LOCAL ] HIPO: Loaded 22567 existing records from primary storage. [2025-09-25T19:15:06.652715] [INFO ] [MAIN ] HIPO: Loaded 22567 existing records. [2025-09-25T19:15:06.832460] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:06.832786] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-25T19:15:06.832855] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-25T19:15:06.833121] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-25T19:15:06.833180] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-25T19:15:07.093599] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-25T19:15:07.214792] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:07.321107] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T19:15:07.423154] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:15:07.433073] [INFO ] [REMOTE ] HIG: Full fetch complete (73274 records). [2025-09-25T19:15:07.433216] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-25T19:15:07.832404] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-25T19:15:07.832497] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-25T19:15:07.833607] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-25T19:15:07.833728] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-25T19:15:07.835675] [DEBUG] [LOCAL ] HIG: Trimmed 73274 records to 51610 (keeping 200 days of data) [2025-09-25T19:15:07.897972] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-25T19:15:08.198535] [DEBUG] [LOCAL ] HIG: Primary data saved (51610 records). [2025-09-25T19:15:08.198731] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-25T19:15:08.199351] [INFO ] [MAIN ] Update Progress: 1019/2372 symbols completed. HIG took 37.3s. Estimated remaining: 2h 59m 22s. Rate: 7.5 symbols/min [2025-09-25T19:15:08.380467] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:08.432357] [DEBUG] [LOCAL ] HIW: Loaded 44709 existing records from primary storage. [2025-09-25T19:15:08.432522] [INFO ] [MAIN ] HIW: Loaded 44709 existing records. [2025-09-25T19:15:08.640787] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:08.641194] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-25T19:15:08.641261] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-25T19:15:08.641619] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-25T19:15:08.641767] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-25T19:15:08.697685] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-25T19:15:09.099052] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:09.114974] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:15:09.488807] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-25T19:15:09.691847] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-25T19:15:09.949508] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T19:15:10.288790] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-25T19:15:10.763965] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T19:15:11.088754] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-25T19:15:11.329784] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T19:15:11.888788] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-25T19:15:12.213229] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T19:15:12.688736] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-25T19:15:13.488768] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-25T19:15:13.630243] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T19:15:14.288756] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-25T19:15:14.356798] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-25T19:15:14.715547] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T19:15:14.721490] [INFO ] [REMOTE ] HIO: Full fetch complete (36616 records). [2025-09-25T19:15:14.721623] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-25T19:15:15.098506] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-25T19:15:15.114768] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-25T19:15:15.114831] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-25T19:15:15.115589] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-25T19:15:15.115772] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-25T19:15:15.116906] [DEBUG] [LOCAL ] HIO: Trimmed 36616 records to 23776 (keeping 200 days of data) [2025-09-25T19:15:15.266621] [DEBUG] [LOCAL ] HIO: Primary data saved (23776 records). [2025-09-25T19:15:15.266844] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-25T19:15:15.266963] [INFO ] [MAIN ] Update Progress: 1020/2372 symbols completed. HIO took 28.3s. Estimated remaining: 2h 59m 13s. Rate: 7.5 symbols/min [2025-09-25T19:15:15.446788] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:15.461368] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T19:15:15.488002] [DEBUG] [LOCAL ] HIX: Loaded 20343 existing records from primary storage. [2025-09-25T19:15:15.488201] [INFO ] [MAIN ] HIX: Loaded 20343 existing records. [2025-09-25T19:15:15.670464] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:15.670819] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-25T19:15:15.670876] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-25T19:15:15.671139] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-25T19:15:15.671201] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-25T19:15:15.893876] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-25T19:15:16.045872] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:16.519985] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:15:16.689853] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T19:15:16.689081] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-25T19:15:17.488701] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-25T19:15:17.843618] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T19:15:18.288748] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-25T19:15:19.088804] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-25T19:15:19.800673] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:15:19.897264] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-25T19:15:19.919763] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-25T19:15:20.227837] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T19:15:20.688721] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-25T19:15:21.493016] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-25T19:15:21.514123] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T19:15:21.569930] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T19:15:22.288745] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-25T19:15:23.088718] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-25T19:15:23.398997] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T19:15:23.888758] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-25T19:15:24.223519] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-25T19:15:24.691290] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-25T19:15:24.696277] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T19:15:24.735384] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T19:15:25.488727] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-25T19:15:25.796073] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T19:15:26.288732] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-25T19:15:26.602116] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T19:15:27.088743] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-25T19:15:27.888778] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-25T19:15:28.155946] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T19:15:28.688718] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-25T19:15:28.921785] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-25T19:15:29.055102] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T19:15:29.488725] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-25T19:15:29.903992] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T19:15:29.908586] [INFO ] [REMOTE ] HIPO: Full fetch complete (31669 records). [2025-09-25T19:15:29.908704] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-25T19:15:30.292138] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-25T19:15:30.292282] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-25T19:15:30.291877] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-25T19:15:30.294313] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-25T19:15:30.294387] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-25T19:15:30.295292] [DEBUG] [LOCAL ] HIPO: Trimmed 31669 records to 22682 (keeping 200 days of data) [2025-09-25T19:15:30.431763] [DEBUG] [LOCAL ] HIPO: Primary data saved (22682 records). [2025-09-25T19:15:30.431916] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-25T19:15:30.432019] [INFO ] [MAIN ] Update Progress: 1021/2372 symbols completed. HIPO took 24.0s. Estimated remaining: 2h 59m 14s. Rate: 7.5 symbols/min [2025-09-25T19:15:30.605438] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:30.626314] [DEBUG] [LOCAL ] HKD: Loaded 18353 existing records from primary storage. [2025-09-25T19:15:30.626454] [INFO ] [MAIN ] HKD: Loaded 18353 existing records. [2025-09-25T19:15:30.812333] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:30.812666] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-25T19:15:30.812743] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-25T19:15:30.812996] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-25T19:15:30.813056] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-25T19:15:31.099088] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-25T19:15:31.184079] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:31.542352] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T19:15:31.888692] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-25T19:15:32.224272] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-25T19:15:32.235269] [INFO ] [REMOTE ] HIMS: Full fetch complete (77935 records). [2025-09-25T19:15:32.235477] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-25T19:15:32.622681] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T19:15:32.690560] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-25T19:15:32.743319] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-25T19:15:32.743422] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-25T19:15:32.744907] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-25T19:15:32.744979] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-25T19:15:32.747582] [DEBUG] [LOCAL ] HIMS: Trimmed 77935 records to 54207 (keeping 200 days of data) [2025-09-25T19:15:33.083139] [DEBUG] [LOCAL ] HIMS: Primary data saved (54207 records). [2025-09-25T19:15:33.083295] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-25T19:15:33.084258] [INFO ] [MAIN ] Update Progress: 1022/2372 symbols completed. HIMS took 48.2s. Estimated remaining: 2h 58m 59s. Rate: 7.5 symbols/min [2025-09-25T19:15:33.285042] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:33.281508] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:15:33.348114] [DEBUG] [LOCAL ] HL: Loaded 53671 existing records from primary storage. [2025-09-25T19:15:33.348317] [INFO ] [MAIN ] HL: Loaded 53671 existing records. [2025-09-25T19:15:33.498360] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-25T19:15:33.533327] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:33.533580] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-25T19:15:33.533704] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-25T19:15:33.533994] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-25T19:15:33.534056] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-25T19:15:33.910505] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:34.288756] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-25T19:15:34.350297] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T19:15:34.648847] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:15:35.088729] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-25T19:15:35.888697] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-25T19:15:36.172408] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T19:15:36.237621] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T19:15:36.688798] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-25T19:15:37.500307] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-25T19:15:37.533171] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T19:15:37.858089] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T19:15:38.288746] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-25T19:15:38.328825] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T19:15:39.088726] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-25T19:15:39.802045] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T19:15:39.811424] [INFO ] [REMOTE ] HIW: Full fetch complete (64717 records). [2025-09-25T19:15:39.811624] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-25T19:15:39.895684] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-25T19:15:40.228680] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-25T19:15:40.228817] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-25T19:15:40.229928] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-25T19:15:40.230000] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-25T19:15:40.231707] [DEBUG] [LOCAL ] HIW: Trimmed 64717 records to 45015 (keeping 200 days of data) [2025-09-25T19:15:40.527912] [DEBUG] [LOCAL ] HIW: Primary data saved (45015 records). [2025-09-25T19:15:40.528114] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-25T19:15:40.528265] [INFO ] [MAIN ] Update Progress: 1023/2372 symbols completed. HIW took 32.3s. Estimated remaining: 2h 58m 51s. Rate: 7.5 symbols/min [2025-09-25T19:15:40.694984] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-25T19:15:40.725268] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:40.773377] [DEBUG] [LOCAL ] HLF: Loaded 48699 existing records from primary storage. [2025-09-25T19:15:40.773557] [INFO ] [MAIN ] HLF: Loaded 48699 existing records. [2025-09-25T19:15:40.985577] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:40.986459] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-25T19:15:40.986811] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-25T19:15:40.987380] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-25T19:15:40.987734] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-25T19:15:41.123746] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T19:15:41.159388] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T19:15:41.454560] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:41.488713] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-25T19:15:41.924357] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:15:42.288741] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-25T19:15:43.088749] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-25T19:15:43.213001] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T19:15:43.253486] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T19:15:43.257371] [INFO ] [REMOTE ] HIX: Full fetch complete (30478 records). [2025-09-25T19:15:43.257455] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-25T19:15:43.639516] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-25T19:15:43.639602] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-25T19:15:43.640315] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-25T19:15:43.640379] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-25T19:15:43.641177] [DEBUG] [LOCAL ] HIX: Trimmed 30478 records to 20487 (keeping 200 days of data) [2025-09-25T19:15:43.763104] [DEBUG] [LOCAL ] HIX: Primary data saved (20487 records). [2025-09-25T19:15:43.763253] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-25T19:15:43.763342] [INFO ] [MAIN ] Update Progress: 1024/2372 symbols completed. HIX took 28.5s. Estimated remaining: 2h 58m 37s. Rate: 7.5 symbols/min [2025-09-25T19:15:43.893627] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-25T19:15:43.949237] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:15:43.999529] [DEBUG] [LOCAL ] HLI: Loaded 31188 existing records from primary storage. [2025-09-25T19:15:43.999781] [INFO ] [MAIN ] HLI: Loaded 31188 existing records. [2025-09-25T19:15:44.163103] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T19:15:44.257362] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:15:44.257764] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-25T19:15:44.257827] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-25T19:15:44.258157] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-25T19:15:44.258219] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-25T19:15:44.652784] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:15:44.688737] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-25T19:15:45.488706] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-25T19:15:45.848144] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-25T19:15:45.991820] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T19:15:46.288685] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-25T19:15:46.510197] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T19:15:47.088725] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-25T19:15:47.652766] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T19:15:47.888755] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-25T19:15:48.104075] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T19:15:48.688718] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-25T19:15:49.488764] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-25T19:15:49.616705] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T19:15:50.288756] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-25T19:15:50.575365] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:15:50.851531] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T19:15:51.088769] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-25T19:15:51.888704] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-25T19:15:52.063447] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:15:52.404500] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T19:15:52.688716] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-25T19:15:53.240699] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:15:53.488805] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-25T19:15:54.288702] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-25T19:15:54.365715] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:15:54.745264] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T19:15:55.088736] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-25T19:15:55.649103] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T19:15:55.888730] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-25T19:15:56.688746] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-25T19:15:57.125956] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T19:15:57.488717] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-25T19:15:57.522048] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T19:15:58.120759] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T19:15:58.288791] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-25T19:15:58.573447] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T19:15:59.088800] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-25T19:15:59.679410] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T19:15:59.888864] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-25T19:16:00.688777] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-25T19:16:01.168660] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-25T19:16:01.422522] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T19:16:01.488753] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-25T19:16:02.003387] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T19:16:02.288777] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-25T19:16:02.782212] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T19:16:02.787068] [INFO ] [REMOTE ] HKD: Full fetch complete (28696 records). [2025-09-25T19:16:02.787155] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-25T19:16:03.093896] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-25T19:16:03.164139] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-25T19:16:03.164220] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-25T19:16:03.164927] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-25T19:16:03.164988] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-25T19:16:03.165858] [DEBUG] [LOCAL ] HKD: Trimmed 28696 records to 18493 (keeping 200 days of data) [2025-09-25T19:16:03.269055] [DEBUG] [LOCAL ] HKD: Primary data saved (18493 records). [2025-09-25T19:16:03.269200] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-25T19:16:03.269288] [INFO ] [MAIN ] Update Progress: 1025/2372 symbols completed. HKD took 32.8s. Estimated remaining: 2h 58m 44s. Rate: 7.5 symbols/min [2025-09-25T19:16:03.448719] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:03.478469] [DEBUG] [LOCAL ] HLIO: Loaded 28212 existing records from primary storage. [2025-09-25T19:16:03.478686] [INFO ] [MAIN ] HLIO: Loaded 28212 existing records. [2025-09-25T19:16:03.682108] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:03.682793] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-25T19:16:03.682885] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-25T19:16:03.683359] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-25T19:16:03.683433] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-25T19:16:03.814273] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T19:16:03.900397] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-25T19:16:04.092053] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:04.688706] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-25T19:16:04.810060] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:16:05.488764] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-25T19:16:05.967330] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T19:16:06.029485] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-25T19:16:06.288761] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-25T19:16:06.811249] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T19:16:07.088783] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-25T19:16:07.352728] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T19:16:07.888784] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-25T19:16:08.418436] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T19:16:08.424099] [INFO ] [REMOTE ] HLI: Full fetch complete (45386 records). [2025-09-25T19:16:08.424200] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-25T19:16:08.698209] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-25T19:16:08.840782] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-25T19:16:08.840867] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-25T19:16:08.841714] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-25T19:16:08.841778] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-25T19:16:08.842874] [DEBUG] [LOCAL ] HLI: Trimmed 45386 records to 31388 (keeping 200 days of data) [2025-09-25T19:16:09.056120] [DEBUG] [LOCAL ] HLI: Primary data saved (31388 records). [2025-09-25T19:16:09.056273] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-25T19:16:09.056364] [INFO ] [MAIN ] Update Progress: 1026/2372 symbols completed. HLI took 25.3s. Estimated remaining: 2h 58m 33s. Rate: 7.5 symbols/min [2025-09-25T19:16:09.230465] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:09.265756] [DEBUG] [LOCAL ] HLLY: Loaded 33404 existing records from primary storage. [2025-09-25T19:16:09.265960] [INFO ] [MAIN ] HLLY: Loaded 33404 existing records. [2025-09-25T19:16:09.451104] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:09.451360] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-25T19:16:09.451409] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-25T19:16:09.451745] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-25T19:16:09.451806] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-25T19:16:09.490916] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-25T19:16:09.870004] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:09.871588] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T19:16:09.881094] [INFO ] [REMOTE ] HLF: Full fetch complete (71377 records). [2025-09-25T19:16:09.881238] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-25T19:16:10.273364] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-25T19:16:10.273452] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-25T19:16:10.274510] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-25T19:16:10.274575] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-25T19:16:10.276163] [DEBUG] [LOCAL ] HLF: Trimmed 71377 records to 49031 (keeping 200 days of data) [2025-09-25T19:16:10.327688] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-25T19:16:10.572454] [DEBUG] [LOCAL ] HLF: Primary data saved (49031 records). [2025-09-25T19:16:10.572611] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-25T19:16:10.572739] [INFO ] [MAIN ] Update Progress: 1027/2372 symbols completed. HLF took 30.0s. Estimated remaining: 2h 58m 17s. Rate: 7.5 symbols/min [2025-09-25T19:16:10.766970] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:10.768624] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T19:16:10.818106] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T19:16:10.865892] [DEBUG] [LOCAL ] HLN: Loaded 53094 existing records from primary storage. [2025-09-25T19:16:10.866140] [INFO ] [MAIN ] HLN: Loaded 53094 existing records. [2025-09-25T19:16:11.050137] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:11.050537] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-25T19:16:11.050603] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-25T19:16:11.051107] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-25T19:16:11.051168] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-25T19:16:11.094335] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-25T19:16:11.418458] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:11.776469] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T19:16:11.888793] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-25T19:16:12.688720] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-25T19:16:12.827007] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T19:16:13.144457] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T19:16:13.488738] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-25T19:16:14.288763] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-25T19:16:14.530926] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T19:16:14.543128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T19:16:15.088750] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-25T19:16:15.888739] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-25T19:16:16.617460] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-25T19:16:16.639805] [INFO ] [REMOTE ] HL: Full fetch complete (77654 records). [2025-09-25T19:16:16.649080] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-25T19:16:16.649691] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T19:16:16.693803] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-25T19:16:17.148800] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-25T19:16:17.148418] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-25T19:16:17.149055] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-25T19:16:17.150728] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-25T19:16:17.150821] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-25T19:16:17.164216] [DEBUG] [LOCAL ] HL: Trimmed 77654 records to 54061 (keeping 200 days of data) [2025-09-25T19:16:17.490752] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-25T19:16:17.528209] [DEBUG] [LOCAL ] HL: Primary data saved (54061 records). [2025-09-25T19:16:17.528818] [INFO ] [MAIN ] HL: Full history saved. [2025-09-25T19:16:17.529513] [INFO ] [MAIN ] Update Progress: 1028/2372 symbols completed. HL took 44.4s. Estimated remaining: 2h 58m 7s. Rate: 7.5 symbols/min [2025-09-25T19:16:17.732454] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:17.749554] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T19:16:17.810186] [DEBUG] [LOCAL ] HLT: Loaded 50720 existing records from primary storage. [2025-09-25T19:16:17.810374] [INFO ] [MAIN ] HLT: Loaded 50720 existing records. [2025-09-25T19:16:18.010240] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:18.010536] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-25T19:16:18.010678] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-25T19:16:18.011176] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-25T19:16:18.011240] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-25T19:16:18.300350] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-25T19:16:18.429361] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:19.088703] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-25T19:16:19.193955] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T19:16:19.446672] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T19:16:19.888737] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-25T19:16:20.680323] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T19:16:20.690148] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-25T19:16:21.256600] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:16:21.488719] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-25T19:16:22.288726] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-25T19:16:22.588462] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T19:16:23.088705] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-25T19:16:23.281174] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:16:23.388951] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T19:16:23.888727] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-25T19:16:24.048529] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T19:16:24.688742] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-25T19:16:25.333500] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T19:16:25.488734] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-25T19:16:26.288799] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-25T19:16:26.374635] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T19:16:26.860974] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:16:27.088724] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-25T19:16:27.624261] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T19:16:27.888721] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-25T19:16:28.584690] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:16:28.688686] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-25T19:16:29.177109] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T19:16:29.488780] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-25T19:16:30.288686] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-25T19:16:30.469114] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T19:16:31.088729] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-25T19:16:31.290038] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T19:16:31.422781] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T19:16:31.888763] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-25T19:16:32.688747] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-25T19:16:32.983687] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T19:16:33.043703] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T19:16:33.048214] [INFO ] [REMOTE ] HLIO: Full fetch complete (36194 records). [2025-09-25T19:16:33.048344] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-25T19:16:33.455117] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-25T19:16:33.455245] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-25T19:16:33.456333] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-25T19:16:33.456417] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-25T19:16:33.459522] [DEBUG] [LOCAL ] HLIO: Trimmed 36194 records to 28351 (keeping 200 days of data) [2025-09-25T19:16:33.524778] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-25T19:16:33.655447] [DEBUG] [LOCAL ] HLIO: Primary data saved (28351 records). [2025-09-25T19:16:33.655635] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-25T19:16:33.655840] [INFO ] [MAIN ] Update Progress: 1029/2372 symbols completed. HLIO took 30.4s. Estimated remaining: 2h 58m 10s. Rate: 7.5 symbols/min [2025-09-25T19:16:33.835085] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T19:16:33.862920] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:33.921861] [DEBUG] [LOCAL ] HLX: Loaded 48031 existing records from primary storage. [2025-09-25T19:16:33.922064] [INFO ] [MAIN ] HLX: Loaded 48031 existing records. [2025-09-25T19:16:34.100794] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:34.101128] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-25T19:16:34.101178] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-25T19:16:34.101621] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-25T19:16:34.101729] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-25T19:16:34.291930] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-25T19:16:34.480243] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:35.088709] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-25T19:16:35.165489] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:16:35.423049] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T19:16:35.888743] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-25T19:16:36.688724] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-25T19:16:37.014817] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T19:16:37.438229] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T19:16:37.446208] [INFO ] [REMOTE ] HLLY: Full fetch complete (46228 records). [2025-09-25T19:16:37.446342] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-25T19:16:37.493907] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-25T19:16:37.869242] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-25T19:16:37.869332] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-25T19:16:37.870279] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-25T19:16:37.870354] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-25T19:16:37.871537] [DEBUG] [LOCAL ] HLLY: Trimmed 46228 records to 33705 (keeping 200 days of data) [2025-09-25T19:16:38.078728] [DEBUG] [LOCAL ] HLLY: Primary data saved (33705 records). [2025-09-25T19:16:38.078923] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-25T19:16:38.079259] [INFO ] [MAIN ] Update Progress: 1030/2372 symbols completed. HLLY took 29.0s. Estimated remaining: 2h 57m 57s. Rate: 7.5 symbols/min [2025-09-25T19:16:38.257431] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:38.290271] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-25T19:16:38.296418] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T19:16:38.347223] [DEBUG] [LOCAL ] HMC: Loaded 46818 existing records from primary storage. [2025-09-25T19:16:38.347391] [INFO ] [MAIN ] HMC: Loaded 46818 existing records. [2025-09-25T19:16:38.536886] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:38.537194] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-25T19:16:38.537244] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-25T19:16:38.537541] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-25T19:16:38.537599] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-25T19:16:38.911846] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:38.961800] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T19:16:39.088706] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-25T19:16:39.893863] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-25T19:16:39.910610] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T19:16:40.688701] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-25T19:16:41.085217] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T19:16:41.488750] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-25T19:16:41.565326] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:16:42.288752] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-25T19:16:42.585469] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T19:16:43.088723] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-25T19:16:43.175811] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T19:16:43.888698] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-25T19:16:44.132319] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:16:44.142757] [INFO ] [REMOTE ] HLT: Full fetch complete (73449 records). [2025-09-25T19:16:44.142919] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-25T19:16:44.551043] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-25T19:16:44.551134] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-25T19:16:44.552210] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-25T19:16:44.552277] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-25T19:16:44.554034] [DEBUG] [LOCAL ] HLT: Trimmed 73449 records to 51092 (keeping 200 days of data) [2025-09-25T19:16:44.689179] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-25T19:16:44.898958] [DEBUG] [LOCAL ] HLT: Primary data saved (51092 records). [2025-09-25T19:16:44.899158] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-25T19:16:44.900977] [INFO ] [MAIN ] Update Progress: 1031/2372 symbols completed. HLT took 27.4s. Estimated remaining: 2h 57m 48s. Rate: 7.5 symbols/min [2025-09-25T19:16:45.115766] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:45.118781] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T19:16:45.156486] [DEBUG] [LOCAL ] HMN: Loaded 23386 existing records from primary storage. [2025-09-25T19:16:45.156693] [INFO ] [MAIN ] HMN: Loaded 23386 existing records. [2025-09-25T19:16:45.343505] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:45.343791] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-25T19:16:45.343845] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-25T19:16:45.344054] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-25T19:16:45.344113] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-25T19:16:45.500171] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-25T19:16:45.733352] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:45.764219] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T19:16:46.148542] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T19:16:46.288716] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-25T19:16:47.088797] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-25T19:16:47.343599] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:16:47.353552] [INFO ] [REMOTE ] HLN: Full fetch complete (76781 records). [2025-09-25T19:16:47.353763] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-25T19:16:47.768273] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-25T19:16:47.768517] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-25T19:16:47.769885] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-25T19:16:47.769981] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-25T19:16:47.771765] [DEBUG] [LOCAL ] HLN: Trimmed 76781 records to 53477 (keeping 200 days of data) [2025-09-25T19:16:47.890180] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-25T19:16:47.949673] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T19:16:48.060481] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T19:16:48.186047] [DEBUG] [LOCAL ] HLN: Primary data saved (53477 records). [2025-09-25T19:16:48.186207] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-25T19:16:48.186330] [INFO ] [MAIN ] Update Progress: 1032/2372 symbols completed. HLN took 37.6s. Estimated remaining: 2h 57m 34s. Rate: 7.5 symbols/min [2025-09-25T19:16:48.372128] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:16:48.432255] [DEBUG] [LOCAL ] HMY: Loaded 53136 existing records from primary storage. [2025-09-25T19:16:48.432444] [INFO ] [MAIN ] HMY: Loaded 53136 existing records. [2025-09-25T19:16:48.612078] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:16:48.612366] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-25T19:16:48.612425] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-25T19:16:48.612793] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-25T19:16:48.612887] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-25T19:16:48.693853] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-25T19:16:48.978824] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:16:49.488730] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-25T19:16:49.580282] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T19:16:50.288742] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-25T19:16:50.519500] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:16:50.540935] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T19:16:51.088728] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-25T19:16:51.888760] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-25T19:16:52.166425] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T19:16:52.688713] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-25T19:16:52.739078] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T19:16:53.384023] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:16:53.488766] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-25T19:16:54.288808] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-25T19:16:54.736660] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T19:16:54.869340] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T19:16:55.088688] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-25T19:16:55.239149] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T19:16:55.888753] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-25T19:16:56.669942] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:16:56.688679] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-25T19:16:56.912633] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T19:16:57.488722] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-25T19:16:58.288697] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-25T19:16:58.455444] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T19:16:58.634705] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T19:16:59.088722] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-25T19:16:59.888748] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-25T19:17:00.016866] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T19:17:00.476016] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T19:17:00.688706] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-25T19:17:01.220167] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T19:17:01.488738] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-25T19:17:02.288746] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-25T19:17:02.579383] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T19:17:02.589062] [INFO ] [REMOTE ] HLX: Full fetch complete (69252 records). [2025-09-25T19:17:02.589252] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-25T19:17:03.016153] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-25T19:17:03.016414] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-25T19:17:03.018471] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-25T19:17:03.018606] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-25T19:17:03.020861] [DEBUG] [LOCAL ] HLX: Trimmed 69252 records to 48349 (keeping 200 days of data) [2025-09-25T19:17:03.100767] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-25T19:17:03.145486] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:17:03.186746] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T19:17:03.385084] [DEBUG] [LOCAL ] HLX: Primary data saved (48349 records). [2025-09-25T19:17:03.385284] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-25T19:17:03.386282] [INFO ] [MAIN ] Update Progress: 1033/2372 symbols completed. HLX took 29.7s. Estimated remaining: 2h 57m 35s. Rate: 7.5 symbols/min [2025-09-25T19:17:03.572459] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:03.572769] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-25T19:17:03.572824] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-25T19:17:03.572998] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-25T19:17:03.573042] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-25T19:17:03.573085] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-25T19:17:03.573117] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-25T19:17:03.893948] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-25T19:17:03.959020] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:04.688738] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-25T19:17:04.820627] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:17:04.893734] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:17:04.894145] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-25T19:17:05.488797] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-25T19:17:05.718541] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:17:05.719027] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-25T19:17:06.100059] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-25T19:17:06.288789] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-25T19:17:06.491039] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:17:06.491538] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-25T19:17:07.088763] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-25T19:17:07.297448] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:17:07.297932] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-25T19:17:07.888794] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-25T19:17:08.688748] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-25T19:17:09.488806] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-25T19:17:09.946029] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T19:17:10.139843] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-25T19:17:10.288799] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-25T19:17:10.493381] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:17:10.493891] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-25T19:17:10.976153] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:17:11.088766] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-25T19:17:11.888715] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-25T19:17:12.066233] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T19:17:12.688741] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-25T19:17:13.488773] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-25T19:17:13.731592] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T19:17:14.112492] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T19:17:14.288816] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-25T19:17:14.807419] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T19:17:15.088765] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-25T19:17:15.699588] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T19:17:15.888725] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-25T19:17:16.688705] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-25T19:17:16.846319] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T19:17:17.488745] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-25T19:17:17.533630] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T19:17:17.538215] [INFO ] [REMOTE ] HMN: Full fetch complete (31683 records). [2025-09-25T19:17:17.538319] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-25T19:17:17.946474] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T19:17:17.968831] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-25T19:17:17.969059] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-25T19:17:17.969877] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-25T19:17:17.969959] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-25T19:17:17.970264] [INFO ] [REMOTE ] HMC: Full fetch complete (69529 records). [2025-09-25T19:17:17.970415] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-25T19:17:17.971420] [DEBUG] [LOCAL ] HMN: Trimmed 31683 records to 23517 (keeping 200 days of data) [2025-09-25T19:17:18.291927] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-25T19:17:18.521619] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-25T19:17:18.521998] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-25T19:17:18.526858] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-25T19:17:18.542907] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-25T19:17:18.548632] [DEBUG] [LOCAL ] HMC: Trimmed 69529 records to 47152 (keeping 200 days of data) [2025-09-25T19:17:18.552481] [DEBUG] [LOCAL ] HMN: Primary data saved (23517 records). [2025-09-25T19:17:18.552598] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-25T19:17:18.552764] [INFO ] [MAIN ] Update Progress: 1034/2372 symbols completed. HMN took 33.7s. Estimated remaining: 2h 57m 37s. Rate: 7.5 symbols/min [2025-09-25T19:17:18.831427] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:18.883794] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T19:17:18.908628] [DEBUG] [LOCAL ] HNI: Loaded 28817 existing records from primary storage. [2025-09-25T19:17:18.909450] [INFO ] [MAIN ] HNI: Loaded 28817 existing records. [2025-09-25T19:17:19.137086] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-25T19:17:19.173083] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:19.202744] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-25T19:17:19.203634] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-25T19:17:19.204520] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-25T19:17:19.205747] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-25T19:17:19.628884] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:19.709077] [DEBUG] [LOCAL ] HMC: Primary data saved (47152 records). [2025-09-25T19:17:19.709261] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-25T19:17:19.709371] [INFO ] [MAIN ] Update Progress: 1035/2372 symbols completed. HMC took 41.6s. Estimated remaining: 2h 57m 20s. Rate: 7.5 symbols/min [2025-09-25T19:17:19.898281] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-25T19:17:19.902556] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:19.957519] [DEBUG] [LOCAL ] HOG: Loaded 51232 existing records from primary storage. [2025-09-25T19:17:19.957718] [INFO ] [MAIN ] HOG: Loaded 51232 existing records. [2025-09-25T19:17:20.155048] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:20.155376] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-25T19:17:20.155457] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-25T19:17:20.155757] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-25T19:17:20.155820] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-25T19:17:20.559312] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:20.593542] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-25T19:17:20.688703] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-25T19:17:21.132367] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T19:17:21.143519] [INFO ] [REMOTE ] HNGE: Full fetch complete (26844 records). [2025-09-25T19:17:21.143725] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-25T19:17:21.250964] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T19:17:21.459261] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 87 unique days, need 200 days [2025-09-25T19:17:21.459777] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:17:21.459857] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:17:21.459932] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-25T19:17:21.460018] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-25T19:17:21.460057] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-25T19:17:21.460115] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-25T19:17:21.460218] [INFO ] [MAIN ] Update Progress: 1036/2372 symbols completed. HNGE took 18.1s. Estimated remaining: 2h 57m 4s. Rate: 7.5 symbols/min [2025-09-25T19:17:21.499105] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-25T19:17:21.659076] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:21.708729] [DEBUG] [LOCAL ] HOMB: Loaded 43638 existing records from primary storage. [2025-09-25T19:17:21.708947] [INFO ] [MAIN ] HOMB: Loaded 43638 existing records. [2025-09-25T19:17:21.893791] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:21.894100] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-25T19:17:21.894149] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-25T19:17:21.894447] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-25T19:17:21.894506] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-25T19:17:22.285583] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:22.297681] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-25T19:17:22.319231] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T19:17:23.088799] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-25T19:17:23.644521] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T19:17:23.704247] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:17:23.888745] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-25T19:17:24.688700] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-25T19:17:24.728369] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:17:25.433759] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T19:17:25.488752] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-25T19:17:25.847390] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T19:17:26.288778] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-25T19:17:27.088731] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-25T19:17:27.193987] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T19:17:27.815312] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:17:27.888793] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-25T19:17:27.990325] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T19:17:28.688765] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-25T19:17:29.488740] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-25T19:17:29.707586] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:17:29.938532] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T19:17:30.288766] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-25T19:17:31.088769] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-25T19:17:31.343421] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T19:17:31.373005] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T19:17:31.888738] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-25T19:17:32.688901] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-25T19:17:32.691793] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T19:17:33.032025] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T19:17:33.488730] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-25T19:17:34.288759] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-25T19:17:34.589337] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:17:35.088747] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-25T19:17:35.232886] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:17:35.445235] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T19:17:35.888742] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-25T19:17:36.688764] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-25T19:17:36.870745] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T19:17:37.488703] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-25T19:17:37.516452] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T19:17:38.153738] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-25T19:17:38.163926] [INFO ] [REMOTE ] HMY: Full fetch complete (76658 records). [2025-09-25T19:17:38.164077] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-25T19:17:38.293838] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-25T19:17:38.635539] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-25T19:17:38.635749] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-25T19:17:38.636996] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-25T19:17:38.637067] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-25T19:17:38.638905] [DEBUG] [LOCAL ] HMY: Trimmed 76658 records to 53525 (keeping 200 days of data) [2025-09-25T19:17:38.988551] [DEBUG] [LOCAL ] HMY: Primary data saved (53525 records). [2025-09-25T19:17:38.988766] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-25T19:17:38.988946] [INFO ] [MAIN ] Update Progress: 1037/2372 symbols completed. HMY took 50.8s. Estimated remaining: 2h 57m 8s. Rate: 7.5 symbols/min [2025-09-25T19:17:39.088691] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-25T19:17:39.131439] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:17:39.888777] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-25T19:17:39.977361] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T19:17:40.505386] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T19:17:40.688716] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-25T19:17:41.488808] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-25T19:17:41.677298] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T19:17:41.827529] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T19:17:41.835613] [INFO ] [REMOTE ] HNI: Full fetch complete (41262 records). [2025-09-25T19:17:41.835844] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-25T19:17:42.240516] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-25T19:17:42.240616] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-25T19:17:42.241672] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-25T19:17:42.241749] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-25T19:17:42.243058] [DEBUG] [LOCAL ] HNI: Trimmed 41262 records to 29093 (keeping 200 days of data) [2025-09-25T19:17:42.309312] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-25T19:17:42.459028] [DEBUG] [LOCAL ] HNI: Primary data saved (29093 records). [2025-09-25T19:17:42.459260] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-25T19:17:42.459400] [INFO ] [MAIN ] Update Progress: 1038/2372 symbols completed. HNI took 23.9s. Estimated remaining: 2h 56m 55s. Rate: 7.5 symbols/min [2025-09-25T19:17:42.998010] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T19:17:43.088672] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-25T19:17:44.016849] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:17:44.028037] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-25T19:17:44.721520] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T19:17:44.732127] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-25T19:17:45.863006] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T19:17:45.872841] [INFO ] [REMOTE ] HOG: Full fetch complete (74265 records). [2025-09-25T19:17:45.872991] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-25T19:17:46.276630] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-25T19:17:46.276805] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-25T19:17:46.278117] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-25T19:17:46.278223] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-25T19:17:46.280260] [DEBUG] [LOCAL ] HOG: Trimmed 74265 records to 51604 (keeping 200 days of data) [2025-09-25T19:17:46.401826] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:17:46.414024] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-25T19:17:46.644998] [DEBUG] [LOCAL ] HOG: Primary data saved (51604 records). [2025-09-25T19:17:46.645158] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-25T19:17:46.645258] [INFO ] [MAIN ] Update Progress: 1039/2372 symbols completed. HOG took 26.9s. Estimated remaining: 2h 56m 42s. Rate: 7.5 symbols/min [2025-09-25T19:17:48.124224] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:17:48.133442] [INFO ] [REMOTE ] HOMB: Full fetch complete (63835 records). [2025-09-25T19:17:48.133604] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-25T19:17:48.542172] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-25T19:17:48.542262] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-25T19:17:48.543329] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-25T19:17:48.543394] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-25T19:17:48.545049] [DEBUG] [LOCAL ] HOMB: Trimmed 63835 records to 43979 (keeping 200 days of data) [2025-09-25T19:17:48.826575] [DEBUG] [LOCAL ] HOMB: Primary data saved (43979 records). [2025-09-25T19:17:48.826753] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-25T19:17:48.828316] [INFO ] [MAIN ] Update Progress: 1040/2372 symbols completed. HOMB took 27.4s. Estimated remaining: 2h 56m 27s. Rate: 7.5 symbols/min [2025-09-25T19:17:49.430594] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:49.536088] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:49.575198] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:49.593392] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:17:49.610592] [DEBUG] [LOCAL ] HOV: Loaded 13773 existing records from primary storage. [2025-09-25T19:17:49.610793] [INFO ] [MAIN ] HOV: Loaded 13773 existing records. [2025-09-25T19:17:49.837368] [DEBUG] [LOCAL ] HOUS: Loaded 44130 existing records from primary storage. [2025-09-25T19:17:49.861460] [INFO ] [MAIN ] HOUS: Loaded 44130 existing records. [2025-09-25T19:17:49.906727] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:49.955570] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-25T19:17:49.935574] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-25T19:17:49.971338] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-25T19:17:49.971444] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-25T19:17:49.971097] [DEBUG] [LOCAL ] HP: Loaded 51587 existing records from primary storage. [2025-09-25T19:17:49.995744] [INFO ] [MAIN ] HP: Loaded 51587 existing records. [2025-09-25T19:17:49.995846] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-25T19:17:50.049096] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-25T19:17:50.476820] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:50.665963] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-25T19:17:50.729918] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-25T19:17:50.750055] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:50.773867] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-25T19:17:50.773386] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:17:50.774356] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-25T19:17:50.774029] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-25T19:17:50.796398] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-25T19:17:50.801709] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-25T19:17:50.801856] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-25T19:17:50.819995] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-25T19:17:50.820575] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-25T19:17:50.875939] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-25T19:17:50.967117] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-25T19:17:51.377819] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:51.445476] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-25T19:17:52.133690] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:52.151994] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-25T19:17:52.166809] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:52.174237] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-25T19:17:52.267239] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:17:52.267799] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-25T19:17:52.572070] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T19:17:52.575735] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-25T19:17:53.408770] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T19:17:53.411934] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-25T19:17:53.584841] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:17:53.594211] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-25T19:17:53.868482] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T19:17:53.878815] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-25T19:17:53.933740] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T19:17:53.936751] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-25T19:17:54.327797] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-25T19:17:54.338803] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-25T19:17:54.469819] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T19:17:54.472868] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-25T19:17:54.735061] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T19:17:55.013384] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T19:17:55.088702] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-25T19:17:55.348572] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T19:17:55.888696] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-25T19:17:56.326049] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T19:17:56.552706] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T19:17:56.688736] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-25T19:17:56.830060] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T19:17:57.488760] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-25T19:17:58.288793] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-25T19:17:58.476354] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T19:17:59.088690] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-25T19:17:59.211115] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T19:17:59.337107] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T19:17:59.888766] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-25T19:18:00.688723] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-25T19:18:01.018147] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:18:01.481907] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-25T19:18:01.492452] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-25T19:18:02.288796] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-25T19:18:02.358386] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T19:18:02.420284] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T19:18:03.088790] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-25T19:18:03.761633] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T19:18:03.888709] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-25T19:18:04.688697] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-25T19:18:04.926445] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T19:18:05.032037] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T19:18:05.446785] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T19:18:05.449939] [INFO ] [REMOTE ] HOV: Full fetch complete (19494 records). [2025-09-25T19:18:05.450017] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-25T19:18:05.493809] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-25T19:18:05.817027] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-25T19:18:05.817116] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-25T19:18:05.817637] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-25T19:18:05.817720] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-25T19:18:05.818349] [DEBUG] [LOCAL ] HOV: Trimmed 19494 records to 13886 (keeping 200 days of data) [2025-09-25T19:18:05.908487] [DEBUG] [LOCAL ] HOV: Primary data saved (13886 records). [2025-09-25T19:18:05.908662] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-25T19:18:05.908780] [INFO ] [MAIN ] Update Progress: 1041/2372 symbols completed. HOV took 17.1s. Estimated remaining: 2h 56m 30s. Rate: 7.5 symbols/min [2025-09-25T19:18:06.089487] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:06.100077] [DEBUG] [LOCAL ] HPF: Loaded 7289 existing records from primary storage. [2025-09-25T19:18:06.100230] [INFO ] [MAIN ] HPF: Loaded 7289 existing records. [2025-09-25T19:18:06.281718] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:06.282010] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-25T19:18:06.282059] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-25T19:18:06.282301] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-25T19:18:06.282365] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-25T19:18:06.293895] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-25T19:18:06.654956] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:07.059934] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T19:18:07.088710] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-25T19:18:07.888767] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-25T19:18:08.100400] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T19:18:08.630705] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:18:08.677113] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T19:18:08.688677] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-25T19:18:09.488782] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-25T19:18:10.214946] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T19:18:10.288668] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-25T19:18:11.059625] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T19:18:11.088672] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-25T19:18:11.870338] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T19:18:11.888689] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-25T19:18:12.688736] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-25T19:18:12.845639] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:18:13.447509] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T19:18:13.497186] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-25T19:18:13.517072] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:18:14.288797] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-25T19:18:15.088761] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-25T19:18:15.675293] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-25T19:18:15.833579] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T19:18:15.843883] [INFO ] [REMOTE ] HP: Full fetch complete (73895 records). [2025-09-25T19:18:15.844089] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-25T19:18:15.893924] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-25T19:18:16.257709] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-25T19:18:16.257805] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-25T19:18:16.258876] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-25T19:18:16.258945] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-25T19:18:16.260839] [DEBUG] [LOCAL ] HP: Trimmed 73895 records to 51932 (keeping 200 days of data) [2025-09-25T19:18:16.582803] [DEBUG] [LOCAL ] HP: Primary data saved (51932 records). [2025-09-25T19:18:16.582958] [INFO ] [MAIN ] HP: Full history saved. [2025-09-25T19:18:16.586664] [INFO ] [MAIN ] Update Progress: 1042/2372 symbols completed. HP took 27.8s. Estimated remaining: 2h 56m 26s. Rate: 7.5 symbols/min [2025-09-25T19:18:16.689147] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-25T19:18:16.800439] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:16.814664] [DEBUG] [LOCAL ] HPI: Loaded 10154 existing records from primary storage. [2025-09-25T19:18:16.814800] [INFO ] [MAIN ] HPI: Loaded 10154 existing records. [2025-09-25T19:18:16.991419] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T19:18:17.026244] [INFO ] [REMOTE ] HOUS: Full fetch complete (62958 records). [2025-09-25T19:18:17.051195] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-25T19:18:17.051033] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:17.051748] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-25T19:18:17.051839] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-25T19:18:17.127717] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-25T19:18:17.151806] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-25T19:18:17.634516] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T19:18:17.722421] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-25T19:18:17.781419] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-25T19:18:17.781609] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-25T19:18:17.806856] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-25T19:18:17.806999] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-25T19:18:17.844498] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:17.846216] [DEBUG] [LOCAL ] HOUS: Trimmed 62958 records to 44514 (keeping 200 days of data) [2025-09-25T19:18:17.964252] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T19:18:18.140562] [DEBUG] [LOCAL ] HOUS: Primary data saved (44514 records). [2025-09-25T19:18:18.140740] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-25T19:18:18.140845] [INFO ] [MAIN ] Update Progress: 1043/2372 symbols completed. HOUS took 29.3s. Estimated remaining: 2h 56m 10s. Rate: 7.5 symbols/min [2025-09-25T19:18:18.291592] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-25T19:18:18.311455] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:18.366796] [DEBUG] [LOCAL ] HPP: Loaded 50831 existing records from primary storage. [2025-09-25T19:18:18.367133] [INFO ] [MAIN ] HPP: Loaded 50831 existing records. [2025-09-25T19:18:18.554902] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T19:18:18.554376] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:18.557403] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-25T19:18:18.557815] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-25T19:18:18.558197] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-25T19:18:18.558258] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-25T19:18:18.872441] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T19:18:18.943439] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:19.088779] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-25T19:18:19.888726] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-25T19:18:20.688702] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-25T19:18:21.191209] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-25T19:18:21.488807] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-25T19:18:21.599169] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:18:21.629969] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T19:18:22.288778] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-25T19:18:23.088746] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-25T19:18:23.635258] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T19:18:23.762452] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T19:18:23.888730] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-25T19:18:23.941974] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T19:18:24.688811] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-25T19:18:24.700994] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:18:25.488744] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-25T19:18:26.288680] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-25T19:18:26.825973] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T19:18:26.847912] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T19:18:26.880258] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T19:18:27.088707] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-25T19:18:27.888724] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-25T19:18:28.672869] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:18:28.688681] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-25T19:18:28.744387] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T19:18:29.403276] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T19:18:29.488685] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-25T19:18:30.288750] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-25T19:18:30.914924] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T19:18:31.088765] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-25T19:18:31.214449] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T19:18:31.828741] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T19:18:31.888666] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-25T19:18:32.688713] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-25T19:18:32.721439] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T19:18:33.488730] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-25T19:18:34.288744] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-25T19:18:34.456846] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T19:18:34.459508] [INFO ] [REMOTE ] HPF: Full fetch complete (10800 records). [2025-09-25T19:18:34.459626] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-25T19:18:34.848461] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-25T19:18:34.848694] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-25T19:18:34.849080] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-25T19:18:34.849200] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-25T19:18:34.850289] [DEBUG] [LOCAL ] HPF: Trimmed 10800 records to 7349 (keeping 200 days of data) [2025-09-25T19:18:34.880464] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T19:18:34.933112] [INFO ] [REMOTE ] HPE: Full fetch complete (77732 records). [2025-09-25T19:18:34.938575] [DEBUG] [LOCAL ] HPF: Primary data saved (7349 records). [2025-09-25T19:18:34.938893] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-25T19:18:34.939024] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-25T19:18:34.939599] [INFO ] [MAIN ] Update Progress: 1044/2372 symbols completed. HPF took 29.0s. Estimated remaining: 2h 56m 13s. Rate: 7.5 symbols/min [2025-09-25T19:18:35.096445] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-25T19:18:35.298952] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:35.575257] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-25T19:18:35.575410] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-25T19:18:35.576700] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-25T19:18:35.576783] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-25T19:18:35.579299] [DEBUG] [LOCAL ] HPE: Trimmed 77732 records to 54087 (keeping 200 days of data) [2025-09-25T19:18:35.708021] [DEBUG] [LOCAL ] HPQ: Loaded 53668 existing records from primary storage. [2025-09-25T19:18:35.710301] [INFO ] [MAIN ] HPQ: Loaded 53668 existing records. [2025-09-25T19:18:35.917632] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T19:18:35.986019] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-25T19:18:35.995377] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:35.999797] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-25T19:18:36.000611] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-25T19:18:36.005802] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:18:36.002793] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-25T19:18:36.017744] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-25T19:18:36.568865] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:36.663083] [DEBUG] [LOCAL ] HPE: Primary data saved (54087 records). [2025-09-25T19:18:36.663262] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-25T19:18:36.663451] [INFO ] [MAIN ] Update Progress: 1045/2372 symbols completed. HPE took 47.8s. Estimated remaining: 2h 55m 57s. Rate: 7.5 symbols/min [2025-09-25T19:18:36.694732] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-25T19:18:36.828168] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T19:18:36.858616] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:36.880949] [DEBUG] [LOCAL ] HPS: Loaded 10153 existing records from primary storage. [2025-09-25T19:18:36.881158] [INFO ] [MAIN ] HPS: Loaded 10153 existing records. [2025-09-25T19:18:37.074754] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:37.075149] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-25T19:18:37.075218] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-25T19:18:37.075474] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-25T19:18:37.075535] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-25T19:18:37.464851] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:37.488756] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-25T19:18:38.288686] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-25T19:18:38.722189] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T19:18:39.072262] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:18:39.088672] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-25T19:18:39.176192] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:18:39.888770] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-25T19:18:39.914841] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T19:18:40.688761] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-25T19:18:41.488779] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-25T19:18:41.762213] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T19:18:42.236144] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T19:18:42.240076] [INFO ] [REMOTE ] HPI: Full fetch complete (13495 records). [2025-09-25T19:18:42.240201] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-25T19:18:42.294580] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-25T19:18:42.694476] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-25T19:18:42.694312] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T19:18:42.694761] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-25T19:18:42.706349] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-25T19:18:42.706461] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-25T19:18:42.708712] [DEBUG] [LOCAL ] HPI: Trimmed 13495 records to 10226 (keeping 200 days of data) [2025-09-25T19:18:42.782915] [DEBUG] [LOCAL ] HPI: Primary data saved (10226 records). [2025-09-25T19:18:42.783134] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-25T19:18:42.783275] [INFO ] [MAIN ] Update Progress: 1046/2372 symbols completed. HPI took 26.2s. Estimated remaining: 2h 55m 47s. Rate: 7.5 symbols/min [2025-09-25T19:18:42.962461] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:43.002407] [DEBUG] [LOCAL ] HQH: Loaded 24925 existing records from primary storage. [2025-09-25T19:18:43.002799] [INFO ] [MAIN ] HQH: Loaded 24925 existing records. [2025-09-25T19:18:43.093921] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-25T19:18:43.126100] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T19:18:43.215161] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:43.215501] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-25T19:18:43.215552] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-25T19:18:43.215968] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-25T19:18:43.216029] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-25T19:18:43.596434] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:43.888759] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-25T19:18:44.688789] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-25T19:18:44.748885] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T19:18:44.747761] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T19:18:45.488803] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-25T19:18:46.288943] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-25T19:18:46.503876] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T19:18:47.088733] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-25T19:18:47.239872] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T19:18:47.249923] [INFO ] [REMOTE ] HPP: Full fetch complete (73366 records). [2025-09-25T19:18:47.250071] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-25T19:18:47.590042] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T19:18:47.705734] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-25T19:18:47.705871] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-25T19:18:47.707340] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-25T19:18:47.707467] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-25T19:18:47.712519] [DEBUG] [LOCAL ] HPP: Trimmed 73366 records to 51214 (keeping 200 days of data) [2025-09-25T19:18:47.896240] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-25T19:18:48.038849] [DEBUG] [LOCAL ] HPP: Primary data saved (51214 records). [2025-09-25T19:18:48.039067] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-25T19:18:48.039247] [INFO ] [MAIN ] Update Progress: 1047/2372 symbols completed. HPP took 29.9s. Estimated remaining: 2h 55m 35s. Rate: 7.5 symbols/min [2025-09-25T19:18:48.222218] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:18:48.242041] [DEBUG] [LOCAL ] HQL: Loaded 15812 existing records from primary storage. [2025-09-25T19:18:48.242276] [INFO ] [MAIN ] HQL: Loaded 15812 existing records. [2025-09-25T19:18:48.428748] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:18:48.429078] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-25T19:18:48.429127] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-25T19:18:48.429382] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-25T19:18:48.429440] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-25T19:18:48.699581] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-25T19:18:48.828760] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:18:48.862410] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:18:49.146213] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T19:18:49.489002] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-25T19:18:49.597237] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T19:18:50.288690] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-25T19:18:50.558624] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T19:18:51.088716] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-25T19:18:51.098604] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:18:51.888695] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-25T19:18:52.098033] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T19:18:52.688707] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-25T19:18:53.440479] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T19:18:53.488666] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-25T19:18:53.698920] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T19:18:54.288742] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-25T19:18:54.308047] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T19:18:55.088810] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-25T19:18:55.329891] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T19:18:55.888816] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-25T19:18:56.688744] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-25T19:18:56.747333] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T19:18:57.172406] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-25T19:18:57.488776] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-25T19:18:57.797010] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T19:18:58.288709] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-25T19:18:58.480791] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:18:59.088689] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-25T19:18:59.433522] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T19:18:59.702958] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T19:18:59.888689] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-25T19:19:00.688769] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-25T19:19:01.181524] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:19:01.490923] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-25T19:19:01.495701] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T19:19:02.288774] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-25T19:19:03.088683] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-25T19:19:03.454884] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T19:19:03.564896] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T19:19:03.682949] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-25T19:19:03.888786] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-25T19:19:04.688707] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-25T19:19:04.924313] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T19:19:04.927394] [INFO ] [REMOTE ] HPS: Full fetch complete (15173 records). [2025-09-25T19:19:04.927484] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-25T19:19:05.326349] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-25T19:19:05.326460] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-25T19:19:05.327006] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-25T19:19:05.327071] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-25T19:19:05.327672] [DEBUG] [LOCAL ] HPS: Trimmed 15173 records to 10230 (keeping 200 days of data) [2025-09-25T19:19:05.394066] [DEBUG] [LOCAL ] HPS: Primary data saved (10230 records). [2025-09-25T19:19:05.394206] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-25T19:19:05.394297] [INFO ] [MAIN ] Update Progress: 1048/2372 symbols completed. HPS took 28.7s. Estimated remaining: 2h 55m 39s. Rate: 7.5 symbols/min [2025-09-25T19:19:05.493929] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-25T19:19:05.569881] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:05.634452] [DEBUG] [LOCAL ] HR: Loaded 51962 existing records from primary storage. [2025-09-25T19:19:05.634613] [INFO ] [MAIN ] HR: Loaded 51962 existing records. [2025-09-25T19:19:05.824825] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:05.825266] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-25T19:19:05.825339] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-25T19:19:05.826167] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-25T19:19:05.826230] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-25T19:19:06.207734] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:06.288702] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-25T19:19:06.691415] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T19:19:06.718388] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T19:19:07.088714] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-25T19:19:07.888692] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-25T19:19:07.988071] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T19:19:08.113018] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T19:19:08.688720] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-25T19:19:09.173586] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T19:19:09.488747] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-25T19:19:10.288820] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-25T19:19:10.668070] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T19:19:10.694073] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T19:19:11.088748] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-25T19:19:11.711240] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T19:19:11.888689] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-25T19:19:11.918576] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T19:19:12.688736] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-25T19:19:13.030623] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T19:19:13.488767] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-25T19:19:13.980851] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T19:19:13.985769] [INFO ] [REMOTE ] HQH: Full fetch complete (37280 records). [2025-09-25T19:19:13.985877] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-25T19:19:14.194507] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T19:19:14.293791] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-25T19:19:14.403228] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-25T19:19:14.403329] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-25T19:19:14.404423] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-25T19:19:14.404487] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-25T19:19:14.405446] [DEBUG] [LOCAL ] HQH: Trimmed 37280 records to 25135 (keeping 200 days of data) [2025-09-25T19:19:14.579672] [DEBUG] [LOCAL ] HQH: Primary data saved (25135 records). [2025-09-25T19:19:14.579836] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-25T19:19:14.579939] [INFO ] [MAIN ] Update Progress: 1049/2372 symbols completed. HQH took 31.8s. Estimated remaining: 2h 55m 33s. Rate: 7.5 symbols/min [2025-09-25T19:19:14.759395] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:14.817490] [DEBUG] [LOCAL ] HRB: Loaded 48582 existing records from primary storage. [2025-09-25T19:19:14.817679] [INFO ] [MAIN ] HRB: Loaded 48582 existing records. [2025-09-25T19:19:14.994939] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:14.995293] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-25T19:19:14.995350] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-25T19:19:14.995736] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-25T19:19:14.995807] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-25T19:19:15.094473] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-25T19:19:15.367397] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:15.378241] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T19:19:15.381838] [INFO ] [REMOTE ] HQL: Full fetch complete (24239 records). [2025-09-25T19:19:15.382045] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-25T19:19:15.759312] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-25T19:19:15.759417] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-25T19:19:15.760038] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-25T19:19:15.760104] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-25T19:19:15.761114] [DEBUG] [LOCAL ] HQL: Trimmed 24239 records to 15972 (keeping 200 days of data) [2025-09-25T19:19:15.864481] [DEBUG] [LOCAL ] HQL: Primary data saved (15972 records). [2025-09-25T19:19:15.864670] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-25T19:19:15.864791] [INFO ] [MAIN ] Update Progress: 1050/2372 symbols completed. HQL took 27.8s. Estimated remaining: 2h 55m 17s. Rate: 7.5 symbols/min [2025-09-25T19:19:15.895333] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-25T19:19:16.046859] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:16.093047] [DEBUG] [LOCAL ] HRI: Loaded 33102 existing records from primary storage. [2025-09-25T19:19:16.093326] [INFO ] [MAIN ] HRI: Loaded 33102 existing records. [2025-09-25T19:19:16.341541] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:16.342035] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-25T19:19:16.342098] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-25T19:19:16.342390] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-25T19:19:16.342463] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-25T19:19:16.696162] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-25T19:19:16.721100] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:17.388031] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-25T19:19:17.399799] [INFO ] [REMOTE ] HPQ: Full fetch complete (77668 records). [2025-09-25T19:19:17.399943] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-25T19:19:17.499481] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-25T19:19:17.809518] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-25T19:19:17.809783] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-25T19:19:17.810896] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-25T19:19:17.821800] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-25T19:19:17.843014] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T19:19:17.853413] [DEBUG] [LOCAL ] HPQ: Trimmed 77668 records to 54058 (keeping 200 days of data) [2025-09-25T19:19:18.195402] [DEBUG] [LOCAL ] HPQ: Primary data saved (54058 records). [2025-09-25T19:19:18.195678] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-25T19:19:18.196736] [INFO ] [MAIN ] Update Progress: 1051/2372 symbols completed. HPQ took 43.3s. Estimated remaining: 2h 55m 2s. Rate: 7.5 symbols/min [2025-09-25T19:19:18.295587] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-25T19:19:18.374764] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:18.441943] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T19:19:18.467990] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-25T19:19:18.468173] [INFO ] [MAIN ] HRL: Loaded 53088 existing records. [2025-09-25T19:19:18.666899] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:18.667297] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-25T19:19:18.667370] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-25T19:19:18.667884] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-25T19:19:18.667945] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-25T19:19:18.979887] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T19:19:19.096753] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-25T19:19:19.123735] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:19.888785] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-25T19:19:20.023606] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:19:20.330584] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T19:19:20.688743] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-25T19:19:21.488804] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-25T19:19:21.627496] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T19:19:22.288760] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-25T19:19:22.507695] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T19:19:23.088731] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-25T19:19:23.207897] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T19:19:23.888711] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-25T19:19:24.221408] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T19:19:24.688768] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-25T19:19:24.903764] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:19:25.343423] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:19:25.488790] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-25T19:19:25.975337] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T19:19:26.288744] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-25T19:19:27.088711] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-25T19:19:27.281702] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T19:19:27.888747] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-25T19:19:28.229584] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T19:19:28.543215] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T19:19:28.688705] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-25T19:19:29.488719] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-25T19:19:29.629826] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T19:19:30.033018] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T19:19:30.288774] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-25T19:19:30.600138] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T19:19:31.088757] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-25T19:19:31.888724] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-25T19:19:32.046580] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T19:19:32.688755] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-25T19:19:32.947775] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T19:19:33.499335] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-25T19:19:33.502835] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T19:19:34.288699] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-25T19:19:34.351492] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T19:19:35.088727] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-25T19:19:35.226792] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:19:35.765116] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T19:19:35.888668] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-25T19:19:36.537305] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:19:36.688724] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-25T19:19:37.140733] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T19:19:37.488722] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-25T19:19:37.980216] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T19:19:38.288717] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-25T19:19:39.088732] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-25T19:19:39.486347] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T19:19:39.495972] [INFO ] [REMOTE ] HRB: Full fetch complete (69786 records). [2025-09-25T19:19:39.496114] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-25T19:19:39.890502] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-25T19:19:39.978933] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-25T19:19:39.979063] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-25T19:19:39.980224] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-25T19:19:39.980380] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-25T19:19:39.982181] [DEBUG] [LOCAL ] HRB: Trimmed 69786 records to 48936 (keeping 200 days of data) [2025-09-25T19:19:40.251118] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:19:40.304101] [INFO ] [REMOTE ] HR: Full fetch complete (74829 records). [2025-09-25T19:19:40.316090] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-25T19:19:40.566421] [DEBUG] [LOCAL ] HRB: Primary data saved (48936 records). [2025-09-25T19:19:40.566901] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-25T19:19:40.592461] [INFO ] [MAIN ] Update Progress: 1052/2372 symbols completed. HRB took 26.0s. Estimated remaining: 2h 55m 12s. Rate: 7.5 symbols/min [2025-09-25T19:19:40.935443] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-25T19:19:40.954727] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-25T19:19:40.954523] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:40.956008] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-25T19:19:40.956987] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-25T19:19:40.989710] [DEBUG] [LOCAL ] HR: Trimmed 74829 records to 52347 (keeping 200 days of data) [2025-09-25T19:19:40.994219] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T19:19:41.060186] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-25T19:19:41.129351] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T19:19:41.157058] [DEBUG] [LOCAL ] HRTG: Loaded 33109 existing records from primary storage. [2025-09-25T19:19:41.161151] [INFO ] [MAIN ] HRTG: Loaded 33109 existing records. [2025-09-25T19:19:41.361090] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:41.362537] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-25T19:19:41.362621] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-25T19:19:41.364193] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-25T19:19:41.364587] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-25T19:19:41.489240] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-25T19:19:41.757154] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:41.969715] [DEBUG] [LOCAL ] HR: Primary data saved (52347 records). [2025-09-25T19:19:41.969910] [INFO ] [MAIN ] HR: Full history saved. [2025-09-25T19:19:41.970023] [INFO ] [MAIN ] Update Progress: 1053/2372 symbols completed. HR took 36.6s. Estimated remaining: 2h 54m 56s. Rate: 7.5 symbols/min [2025-09-25T19:19:42.138602] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:42.191318] [DEBUG] [LOCAL ] HSBC: Loaded 51123 existing records from primary storage. [2025-09-25T19:19:42.191546] [INFO ] [MAIN ] HSBC: Loaded 51123 existing records. [2025-09-25T19:19:42.292027] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-25T19:19:42.373365] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:42.373634] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-25T19:19:42.373717] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-25T19:19:42.374032] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-25T19:19:42.374091] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-25T19:19:42.737380] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:43.002448] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:19:43.008120] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T19:19:43.088680] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-25T19:19:43.428058] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T19:19:43.888731] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-25T19:19:44.688719] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-25T19:19:44.805493] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:19:44.901418] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T19:19:45.488735] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-25T19:19:45.869077] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T19:19:45.875299] [INFO ] [REMOTE ] HRI: Full fetch complete (46003 records). [2025-09-25T19:19:45.875417] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-25T19:19:46.289322] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-25T19:19:46.289095] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-25T19:19:46.289693] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-25T19:19:46.291522] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-25T19:19:46.291753] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-25T19:19:46.293149] [DEBUG] [LOCAL ] HRI: Trimmed 46003 records to 33319 (keeping 200 days of data) [2025-09-25T19:19:46.510140] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T19:19:46.535969] [DEBUG] [LOCAL ] HRI: Primary data saved (33319 records). [2025-09-25T19:19:46.536211] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-25T19:19:46.537983] [INFO ] [MAIN ] Update Progress: 1054/2372 symbols completed. HRI took 30.7s. Estimated remaining: 2h 54m 43s. Rate: 7.5 symbols/min [2025-09-25T19:19:46.719215] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:46.741294] [DEBUG] [LOCAL ] HSHP: Loaded 15569 existing records from primary storage. [2025-09-25T19:19:46.741454] [INFO ] [MAIN ] HSHP: Loaded 15569 existing records. [2025-09-25T19:19:46.916562] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:46.916918] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-25T19:19:46.916968] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-25T19:19:46.917218] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-25T19:19:46.917277] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-25T19:19:47.093623] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-25T19:19:47.277550] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:47.888740] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-25T19:19:48.349337] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T19:19:48.688781] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-25T19:19:48.996150] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:19:48.991620] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T19:19:49.488752] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-25T19:19:49.887833] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T19:19:50.288780] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-25T19:19:51.088805] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-25T19:19:51.430671] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T19:19:51.751852] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T19:19:51.888677] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-25T19:19:52.162418] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T19:19:52.688778] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-25T19:19:53.346061] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T19:19:53.488782] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-25T19:19:54.288703] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-25T19:19:54.532032] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:19:54.541938] [INFO ] [REMOTE ] HRL: Full fetch complete (76684 records). [2025-09-25T19:19:54.542093] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-25T19:19:54.957982] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-25T19:19:54.958104] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-25T19:19:54.959328] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-25T19:19:54.959409] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-25T19:19:54.981860] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T19:19:54.980615] [DEBUG] [LOCAL ] HRL: Trimmed 76684 records to 53474 (keeping 200 days of data) [2025-09-25T19:19:55.089144] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-25T19:19:55.340516] [DEBUG] [LOCAL ] HRL: Primary data saved (53474 records). [2025-09-25T19:19:55.340717] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-25T19:19:55.342716] [INFO ] [MAIN ] Update Progress: 1055/2372 symbols completed. HRL took 37.1s. Estimated remaining: 2h 54m 36s. Rate: 7.5 symbols/min [2025-09-25T19:19:55.514367] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:19:55.569585] [DEBUG] [LOCAL ] HSY: Loaded 50426 existing records from primary storage. [2025-09-25T19:19:55.569776] [INFO ] [MAIN ] HSY: Loaded 50426 existing records. [2025-09-25T19:19:55.755972] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:19:55.756580] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-25T19:19:55.756679] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-25T19:19:55.756987] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-25T19:19:55.757050] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-25T19:19:55.904410] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-25T19:19:56.141956] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:19:56.163960] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T19:19:56.187334] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T19:19:56.688755] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-25T19:19:57.420087] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:19:57.488706] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-25T19:19:58.288799] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-25T19:19:58.597751] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T19:19:58.853547] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T19:19:59.088773] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-25T19:19:59.444513] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:19:59.888752] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-25T19:20:00.628619] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:20:00.688671] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-25T19:20:01.488746] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-25T19:20:02.077421] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-25T19:20:02.288829] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-25T19:20:02.708867] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-25T19:20:03.045920] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:20:03.053122] [INFO ] [REMOTE ] HRTG: Full fetch complete (42453 records). [2025-09-25T19:20:03.053306] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-25T19:20:03.093819] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-25T19:20:03.491633] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-25T19:20:03.491771] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-25T19:20:03.492591] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-25T19:20:03.492716] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-25T19:20:03.494173] [DEBUG] [LOCAL ] HRTG: Trimmed 42453 records to 33404 (keeping 200 days of data) [2025-09-25T19:20:03.703755] [DEBUG] [LOCAL ] HRTG: Primary data saved (33404 records). [2025-09-25T19:20:03.703932] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-25T19:20:03.704036] [INFO ] [MAIN ] Update Progress: 1056/2372 symbols completed. HRTG took 23.1s. Estimated remaining: 2h 54m 29s. Rate: 7.5 symbols/min [2025-09-25T19:20:03.880462] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:03.880675] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-25T19:20:03.880730] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-25T19:20:03.880882] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-25T19:20:03.880927] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-25T19:20:03.880968] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-25T19:20:03.881001] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-25T19:20:03.903541] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-25T19:20:04.267314] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:04.340858] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T19:20:04.688725] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-25T19:20:04.893787] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:20:04.894302] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-25T19:20:05.076197] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T19:20:05.128430] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T19:20:05.488726] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-25T19:20:05.712289] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:20:05.712679] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-25T19:20:06.288746] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-25T19:20:07.088863] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-25T19:20:07.888758] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-25T19:20:08.174680] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T19:20:08.688748] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-25T19:20:08.750324] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T19:20:08.917758] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-25T19:20:08.954508] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T19:20:09.488787] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-25T19:20:10.288764] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-25T19:20:11.088735] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-25T19:20:11.387671] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:20:11.888708] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-25T19:20:12.096062] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T19:20:12.190316] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T19:20:12.688740] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-25T19:20:13.488716] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-25T19:20:13.500898] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:20:13.596132] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:20:14.288734] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-25T19:20:14.473807] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T19:20:15.088723] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-25T19:20:15.888734] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-25T19:20:16.356317] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T19:20:16.688696] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-25T19:20:16.790988] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T19:20:16.891307] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T19:20:17.488713] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-25T19:20:18.288689] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-25T19:20:18.589063] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T19:20:18.789579] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T19:20:19.088751] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-25T19:20:19.643428] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-25T19:20:19.647234] [INFO ] [REMOTE ] HSHP: Full fetch complete (23426 records). [2025-09-25T19:20:19.647315] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-25T19:20:19.900426] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-25T19:20:20.028117] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-25T19:20:20.028205] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-25T19:20:20.028924] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-25T19:20:20.028989] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-25T19:20:20.029685] [DEBUG] [LOCAL ] HSHP: Trimmed 23426 records to 15656 (keeping 200 days of data) [2025-09-25T19:20:20.124014] [DEBUG] [LOCAL ] HSHP: Primary data saved (15656 records). [2025-09-25T19:20:20.124194] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-25T19:20:20.124303] [INFO ] [MAIN ] Update Progress: 1057/2372 symbols completed. HSHP took 33.6s. Estimated remaining: 2h 54m 32s. Rate: 7.5 symbols/min [2025-09-25T19:20:20.297134] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:20.315783] [DEBUG] [LOCAL ] HTD: Loaded 13524 existing records from primary storage. [2025-09-25T19:20:20.316015] [INFO ] [MAIN ] HTD: Loaded 13524 existing records. [2025-09-25T19:20:20.527622] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:20.528349] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-25T19:20:20.528407] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-25T19:20:20.528935] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-25T19:20:20.529000] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-25T19:20:20.697021] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-25T19:20:20.741284] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T19:20:20.944158] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:21.183627] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T19:20:21.193679] [INFO ] [REMOTE ] HSBC: Full fetch complete (73647 records). [2025-09-25T19:20:21.193875] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-25T19:20:21.499768] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-25T19:20:21.645492] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-25T19:20:21.645592] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-25T19:20:21.647177] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-25T19:20:21.647437] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-25T19:20:21.649627] [DEBUG] [LOCAL ] HSBC: Trimmed 73647 records to 51502 (keeping 200 days of data) [2025-09-25T19:20:21.991105] [DEBUG] [LOCAL ] HSBC: Primary data saved (51502 records). [2025-09-25T19:20:21.991312] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-25T19:20:21.992215] [INFO ] [MAIN ] Update Progress: 1058/2372 symbols completed. HSBC took 40.0s. Estimated remaining: 2h 54m 16s. Rate: 7.5 symbols/min [2025-09-25T19:20:22.164685] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:22.164930] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-25T19:20:22.164987] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-25T19:20:22.165140] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-25T19:20:22.165184] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-25T19:20:22.165224] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-25T19:20:22.165257] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-25T19:20:22.275812] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T19:20:22.288959] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-25T19:20:22.575471] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:22.770937] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T19:20:23.088754] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-25T19:20:23.240087] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T19:20:23.373405] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-25T19:20:23.888761] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-25T19:20:24.688729] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-25T19:20:25.026926] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-25T19:20:25.191134] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T19:20:25.488751] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-25T19:20:26.288760] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-25T19:20:27.088712] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-25T19:20:27.197617] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T19:20:27.207244] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T19:20:27.218752] [INFO ] [REMOTE ] HSY: Full fetch complete (73791 records). [2025-09-25T19:20:27.219051] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-25T19:20:27.639619] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T19:20:27.683826] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-25T19:20:27.683953] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-25T19:20:27.685519] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-25T19:20:27.685605] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-25T19:20:27.691450] [DEBUG] [LOCAL ] HSY: Trimmed 73791 records to 50791 (keeping 200 days of data) [2025-09-25T19:20:27.903334] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-25T19:20:28.066396] [DEBUG] [LOCAL ] HSY: Primary data saved (50791 records). [2025-09-25T19:20:28.066722] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-25T19:20:28.067686] [INFO ] [MAIN ] Update Progress: 1059/2372 symbols completed. HSY took 32.7s. Estimated remaining: 2h 54m 6s. Rate: 7.5 symbols/min [2025-09-25T19:20:28.226401] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-25T19:20:28.254887] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:28.323960] [DEBUG] [LOCAL ] HTGC: Loaded 47557 existing records from primary storage. [2025-09-25T19:20:28.324177] [INFO ] [MAIN ] HTGC: Loaded 47557 existing records. [2025-09-25T19:20:28.572098] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:28.573931] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-25T19:20:28.573989] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-25T19:20:28.574626] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-25T19:20:28.574726] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-25T19:20:28.698717] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-25T19:20:28.982129] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:29.240545] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T19:20:29.488758] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-25T19:20:30.071497] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T19:20:30.288744] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-25T19:20:31.019681] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T19:20:31.088698] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-25T19:20:31.888713] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-25T19:20:32.019583] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T19:20:32.022303] [INFO ] [REMOTE ] HTB: Full fetch complete (7772 records). [2025-09-25T19:20:32.022432] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-25T19:20:32.215460] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-25T19:20:32.215766] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:20:32.215845] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:20:32.215991] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-25T19:20:32.216106] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-25T19:20:32.216201] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-25T19:20:32.216287] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-25T19:20:32.216502] [INFO ] [MAIN ] Update Progress: 1060/2372 symbols completed. HTB took 28.5s. Estimated remaining: 2h 53m 53s. Rate: 7.5 symbols/min [2025-09-25T19:20:32.395702] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:32.448961] [DEBUG] [LOCAL ] HTH: Loaded 32387 existing records from primary storage. [2025-09-25T19:20:32.449152] [INFO ] [MAIN ] HTH: Loaded 32387 existing records. [2025-09-25T19:20:32.627099] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:32.627393] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-25T19:20:32.627441] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-25T19:20:32.628055] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-25T19:20:32.628115] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-25T19:20:32.693879] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-25T19:20:33.040834] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:33.488722] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-25T19:20:33.534316] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T19:20:33.604193] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T19:20:34.288758] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-25T19:20:34.620791] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T19:20:35.088718] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-25T19:20:35.417037] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-25T19:20:35.755529] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T19:20:35.888717] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-25T19:20:36.688734] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-25T19:20:37.105706] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T19:20:37.458492] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T19:20:37.488720] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-25T19:20:38.288722] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-25T19:20:38.475738] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T19:20:39.088738] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-25T19:20:39.527929] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T19:20:39.888695] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-25T19:20:40.002013] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T19:20:40.688705] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-25T19:20:41.006315] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-25T19:20:41.136749] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T19:20:41.488745] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-25T19:20:42.288806] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-25T19:20:42.877184] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T19:20:43.088707] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-25T19:20:43.169033] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T19:20:43.888763] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-25T19:20:44.648245] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T19:20:44.688726] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-25T19:20:44.921543] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-25T19:20:45.266944] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T19:20:45.488755] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-25T19:20:46.288773] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-25T19:20:47.088757] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-25T19:20:47.273023] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:20:47.339203] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-25T19:20:47.344451] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T19:20:47.888774] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-25T19:20:48.332630] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-25T19:20:48.333572] [INFO ] [REMOTE ] HTFC: Full fetch complete (842 records). [2025-09-25T19:20:48.333686] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-25T19:20:48.334148] [FATAL] [VALIDATOR ] HTFC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T19:20:48.334237] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:20:48.334283] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:20:48.334324] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-25T19:20:48.334391] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-25T19:20:48.334433] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-25T19:20:48.334535] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-25T19:20:48.334676] [INFO ] [MAIN ] Update Progress: 1061/2372 symbols completed. HTFC took 26.3s. Estimated remaining: 2h 53m 55s. Rate: 7.5 symbols/min [2025-09-25T19:20:48.514389] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:48.602335] [DEBUG] [LOCAL ] HUBB: Loaded 37168 existing records from primary storage. [2025-09-25T19:20:48.602670] [INFO ] [MAIN ] HUBB: Loaded 37168 existing records. [2025-09-25T19:20:48.693905] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-25T19:20:48.800469] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:48.800899] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-25T19:20:48.800960] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-25T19:20:48.801295] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-25T19:20:48.801357] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-25T19:20:49.175195] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:49.488731] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-25T19:20:50.288689] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-25T19:20:50.581732] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T19:20:50.863373] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T19:20:51.088796] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-25T19:20:51.694098] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:20:51.888737] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-25T19:20:51.921210] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T19:20:52.688733] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-25T19:20:53.488687] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-25T19:20:53.733098] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T19:20:53.776282] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T19:20:54.288722] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-25T19:20:54.786387] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T19:20:55.051911] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T19:20:55.055435] [INFO ] [REMOTE ] HTD: Full fetch complete (18887 records). [2025-09-25T19:20:55.055521] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-25T19:20:55.093806] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-25T19:20:55.436616] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-25T19:20:55.436732] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-25T19:20:55.437188] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-25T19:20:55.437228] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-25T19:20:55.438619] [DEBUG] [LOCAL ] HTD: Trimmed 18887 records to 13643 (keeping 200 days of data) [2025-09-25T19:20:55.534763] [DEBUG] [LOCAL ] HTD: Primary data saved (13643 records). [2025-09-25T19:20:55.534930] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-25T19:20:55.535053] [INFO ] [MAIN ] Update Progress: 1062/2372 symbols completed. HTD took 35.4s. Estimated remaining: 2h 53m 46s. Rate: 7.5 symbols/min [2025-09-25T19:20:55.704948] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:55.760535] [DEBUG] [LOCAL ] HUBS: Loaded 39485 existing records from primary storage. [2025-09-25T19:20:55.760713] [INFO ] [MAIN ] HUBS: Loaded 39485 existing records. [2025-09-25T19:20:55.900324] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-25T19:20:55.941851] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:55.942109] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-25T19:20:55.942156] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-25T19:20:55.942390] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-25T19:20:55.942449] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-25T19:20:56.312274] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:56.666169] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T19:20:56.688672] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-25T19:20:57.298252] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T19:20:57.488791] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-25T19:20:58.203045] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T19:20:58.209444] [INFO ] [REMOTE ] HTH: Full fetch complete (46713 records). [2025-09-25T19:20:58.209604] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-25T19:20:58.293850] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-25T19:20:58.607447] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-25T19:20:58.607540] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-25T19:20:58.608472] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-25T19:20:58.608539] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-25T19:20:58.609943] [DEBUG] [LOCAL ] HTH: Trimmed 46713 records to 32572 (keeping 200 days of data) [2025-09-25T19:20:58.842857] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:20:58.864249] [DEBUG] [LOCAL ] HTH: Primary data saved (32572 records). [2025-09-25T19:20:58.864468] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-25T19:20:58.864623] [INFO ] [MAIN ] Update Progress: 1063/2372 symbols completed. HTH took 26.6s. Estimated remaining: 2h 53m 33s. Rate: 7.5 symbols/min [2025-09-25T19:20:59.049574] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:20:59.088761] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-25T19:20:59.110106] [DEBUG] [LOCAL ] HUM: Loaded 48864 existing records from primary storage. [2025-09-25T19:20:59.110297] [INFO ] [MAIN ] HUM: Loaded 48864 existing records. [2025-09-25T19:20:59.310146] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:20:59.310424] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-25T19:20:59.310484] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-25T19:20:59.310859] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-25T19:20:59.310918] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-25T19:20:59.701296] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:20:59.842184] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T19:20:59.888801] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-25T19:21:00.693941] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-25T19:21:00.718864] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T19:21:00.908890] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T19:21:01.488757] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-25T19:21:02.300129] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-25T19:21:02.313203] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T19:21:02.856717] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T19:21:03.088741] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-25T19:21:03.891112] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-25T19:21:03.894514] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T19:21:04.688781] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-25T19:21:04.961844] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T19:21:05.043931] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T19:21:05.488764] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-25T19:21:06.224315] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:21:06.288753] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-25T19:21:06.945831] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T19:21:07.088750] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-25T19:21:07.888719] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-25T19:21:07.968329] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T19:21:08.688699] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-25T19:21:08.900226] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T19:21:09.488703] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-25T19:21:09.553383] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T19:21:09.764910] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T19:21:10.288951] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-25T19:21:11.088752] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-25T19:21:11.470944] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T19:21:11.888692] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-25T19:21:12.019982] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T19:21:12.694811] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-25T19:21:12.697909] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T19:21:13.488722] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-25T19:21:13.792795] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T19:21:14.288701] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-25T19:21:14.422585] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T19:21:14.437729] [INFO ] [REMOTE ] HTGC: Full fetch complete (68183 records). [2025-09-25T19:21:14.438043] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-25T19:21:14.703099] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T19:21:14.940260] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-25T19:21:14.940389] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-25T19:21:14.941491] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-25T19:21:14.941558] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-25T19:21:14.943103] [DEBUG] [LOCAL ] HTGC: Trimmed 68183 records to 47908 (keeping 200 days of data) [2025-09-25T19:21:15.091739] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-25T19:21:15.274147] [DEBUG] [LOCAL ] HTGC: Primary data saved (47908 records). [2025-09-25T19:21:15.274326] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-25T19:21:15.276530] [INFO ] [MAIN ] Update Progress: 1064/2372 symbols completed. HTGC took 47.2s. Estimated remaining: 2h 53m 35s. Rate: 7.5 symbols/min [2025-09-25T19:21:15.452556] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:15.513678] [DEBUG] [LOCAL ] HUN: Loaded 53196 existing records from primary storage. [2025-09-25T19:21:15.513863] [INFO ] [MAIN ] HUN: Loaded 53196 existing records. [2025-09-25T19:21:15.712153] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:15.712596] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-25T19:21:15.712678] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-25T19:21:15.713069] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-25T19:21:15.713148] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-25T19:21:15.893313] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-25T19:21:16.136577] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T19:21:16.158447] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:16.688718] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-25T19:21:16.829755] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:21:17.101639] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T19:21:17.108546] [INFO ] [REMOTE ] HUBB: Full fetch complete (53653 records). [2025-09-25T19:21:17.108696] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-25T19:21:17.508873] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-25T19:21:17.534591] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-25T19:21:17.534713] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-25T19:21:17.535859] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-25T19:21:17.535928] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-25T19:21:17.537353] [DEBUG] [LOCAL ] HUBB: Trimmed 53653 records to 37414 (keeping 200 days of data) [2025-09-25T19:21:17.809720] [DEBUG] [LOCAL ] HUBB: Primary data saved (37414 records). [2025-09-25T19:21:17.809871] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-25T19:21:17.810879] [INFO ] [MAIN ] Update Progress: 1065/2372 symbols completed. HUBB took 29.5s. Estimated remaining: 2h 53m 21s. Rate: 7.5 symbols/min [2025-09-25T19:21:18.026156] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T19:21:18.047593] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:18.101486] [DEBUG] [LOCAL ] HUYA: Loaded 44413 existing records from primary storage. [2025-09-25T19:21:18.101673] [INFO ] [MAIN ] HUYA: Loaded 44413 existing records. [2025-09-25T19:21:18.284698] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:18.285052] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-25T19:21:18.285098] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-25T19:21:18.285411] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-25T19:21:18.285470] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-25T19:21:18.290374] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-25T19:21:18.661156] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:19.088752] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-25T19:21:19.602253] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T19:21:19.888766] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-25T19:21:20.018237] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:21:20.258525] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:21:20.688735] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-25T19:21:21.488758] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-25T19:21:22.241931] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-25T19:21:22.308718] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T19:21:22.293801] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-25T19:21:22.572515] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T19:21:23.088702] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-25T19:21:23.888698] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-25T19:21:24.314322] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T19:21:24.326975] [INFO ] [REMOTE ] HUM: Full fetch complete (70975 records). [2025-09-25T19:21:24.327192] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-25T19:21:24.588163] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:21:24.698994] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-25T19:21:24.822036] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-25T19:21:24.822139] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-25T19:21:24.823347] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-25T19:21:24.823427] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-25T19:21:24.825426] [DEBUG] [LOCAL ] HUM: Trimmed 70975 records to 49222 (keeping 200 days of data) [2025-09-25T19:21:25.143683] [DEBUG] [LOCAL ] HUM: Primary data saved (49222 records). [2025-09-25T19:21:25.143844] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-25T19:21:25.143940] [INFO ] [MAIN ] Update Progress: 1066/2372 symbols completed. HUM took 26.3s. Estimated remaining: 2h 53m 12s. Rate: 7.5 symbols/min [2025-09-25T19:21:25.316127] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:25.354234] [DEBUG] [LOCAL ] HVT: Loaded 16003 existing records from primary storage. [2025-09-25T19:21:25.354391] [INFO ] [MAIN ] HVT: Loaded 16003 existing records. [2025-09-25T19:21:25.379912] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:21:25.493877] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-25T19:21:25.562292] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:25.563334] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-25T19:21:25.563383] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-25T19:21:25.563679] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-25T19:21:25.563742] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-25T19:21:25.918220] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:26.288730] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-25T19:21:26.485413] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T19:21:27.043511] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T19:21:27.088693] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-25T19:21:27.318660] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:21:27.888727] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-25T19:21:28.578987] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T19:21:28.688721] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-25T19:21:29.488771] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-25T19:21:29.651021] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:21:30.288713] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-25T19:21:30.437037] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T19:21:31.088729] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-25T19:21:31.213694] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T19:21:31.237278] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T19:21:31.888879] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-25T19:21:32.679791] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:21:32.689920] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-25T19:21:33.491878] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-25T19:21:33.549153] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T19:21:33.564280] [INFO ] [REMOTE ] HUBS: Full fetch complete (55382 records). [2025-09-25T19:21:33.564629] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-25T19:21:34.026421] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-25T19:21:34.026556] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-25T19:21:34.027672] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-25T19:21:34.027782] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-25T19:21:34.031368] [DEBUG] [LOCAL ] HUBS: Trimmed 55382 records to 39738 (keeping 200 days of data) [2025-09-25T19:21:34.289725] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-25T19:21:34.328419] [DEBUG] [LOCAL ] HUBS: Primary data saved (39738 records). [2025-09-25T19:21:34.328668] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-25T19:21:34.328997] [INFO ] [MAIN ] Update Progress: 1067/2372 symbols completed. HUBS took 38.8s. Estimated remaining: 2h 53m 5s. Rate: 7.5 symbols/min [2025-09-25T19:21:34.418391] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T19:21:34.606561] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:34.694070] [DEBUG] [LOCAL ] HWM: Loaded 53011 existing records from primary storage. [2025-09-25T19:21:34.694290] [INFO ] [MAIN ] HWM: Loaded 53011 existing records. [2025-09-25T19:21:34.893154] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:34.893636] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-25T19:21:34.893736] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-25T19:21:34.894811] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-25T19:21:34.894885] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-25T19:21:35.108764] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-25T19:21:35.302853] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:35.328682] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T19:21:35.369021] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T19:21:35.888717] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-25T19:21:36.688721] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-25T19:21:36.803503] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T19:21:37.238016] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T19:21:37.488761] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-25T19:21:38.211260] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T19:21:38.288713] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-25T19:21:38.559171] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T19:21:39.088860] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-25T19:21:39.888728] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-25T19:21:40.271932] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T19:21:40.589408] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:21:40.688736] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-25T19:21:41.031296] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T19:21:41.488796] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-25T19:21:42.288760] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-25T19:21:42.386951] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T19:21:42.397833] [INFO ] [REMOTE ] HUN: Full fetch complete (76608 records). [2025-09-25T19:21:42.398059] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-25T19:21:42.823946] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-25T19:21:42.824105] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-25T19:21:42.825273] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-25T19:21:42.825371] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-25T19:21:42.827673] [DEBUG] [LOCAL ] HUN: Trimmed 76608 records to 53586 (keeping 200 days of data) [2025-09-25T19:21:43.089927] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-25T19:21:43.206049] [DEBUG] [LOCAL ] HUN: Primary data saved (53586 records). [2025-09-25T19:21:43.206221] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-25T19:21:43.206929] [INFO ] [MAIN ] Update Progress: 1068/2372 symbols completed. HUN took 27.9s. Estimated remaining: 2h 52m 58s. Rate: 7.5 symbols/min [2025-09-25T19:21:43.306130] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T19:21:43.422280] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:43.477209] [DEBUG] [LOCAL ] HXL: Loaded 45976 existing records from primary storage. [2025-09-25T19:21:43.477372] [INFO ] [MAIN ] HXL: Loaded 45976 existing records. [2025-09-25T19:21:43.670560] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:43.671207] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-25T19:21:43.671277] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-25T19:21:43.671710] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-25T19:21:43.671782] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-25T19:21:43.889297] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-25T19:21:44.137547] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:44.172115] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T19:21:44.187950] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T19:21:44.688733] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-25T19:21:45.488788] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-25T19:21:45.597901] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:21:46.179821] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T19:21:46.226716] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T19:21:46.288675] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-25T19:21:47.088802] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-25T19:21:47.419331] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:21:47.888738] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-25T19:21:48.688752] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-25T19:21:49.074894] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T19:21:49.123562] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T19:21:49.488756] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-25T19:21:50.288713] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-25T19:21:50.398505] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:21:50.408704] [INFO ] [REMOTE ] HUYA: Full fetch complete (63753 records). [2025-09-25T19:21:50.408885] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-25T19:21:50.816130] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-25T19:21:50.816264] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-25T19:21:50.817443] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-25T19:21:50.817511] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-25T19:21:50.819489] [DEBUG] [LOCAL ] HUYA: Trimmed 63753 records to 44671 (keeping 200 days of data) [2025-09-25T19:21:51.091715] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-25T19:21:51.124197] [DEBUG] [LOCAL ] HUYA: Primary data saved (44671 records). [2025-09-25T19:21:51.124390] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-25T19:21:51.125095] [INFO ] [MAIN ] Update Progress: 1069/2372 symbols completed. HUYA took 33.3s. Estimated remaining: 2h 52m 50s. Rate: 7.5 symbols/min [2025-09-25T19:21:51.259469] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T19:21:51.347571] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:51.366079] [DEBUG] [LOCAL ] HY: Loaded 10087 existing records from primary storage. [2025-09-25T19:21:51.366280] [INFO ] [MAIN ] HY: Loaded 10087 existing records. [2025-09-25T19:21:51.573831] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:21:51.574552] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-25T19:21:51.574709] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-25T19:21:51.586595] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-25T19:21:51.605870] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-25T19:21:51.672449] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-25T19:21:51.893979] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-25T19:21:52.014509] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:52.675962] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:21:52.688670] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-25T19:21:53.488776] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-25T19:21:53.632291] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:21:53.890795] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T19:21:54.249052] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T19:21:54.253752] [INFO ] [REMOTE ] HVT: Full fetch complete (23594 records). [2025-09-25T19:21:54.253988] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-25T19:21:54.293852] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-25T19:21:54.706167] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-25T19:21:54.706289] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-25T19:21:54.707055] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-25T19:21:54.707124] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-25T19:21:54.708051] [DEBUG] [LOCAL ] HVT: Trimmed 23594 records to 16061 (keeping 200 days of data) [2025-09-25T19:21:54.828547] [DEBUG] [LOCAL ] HVT: Primary data saved (16061 records). [2025-09-25T19:21:54.829470] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-25T19:21:54.829597] [INFO ] [MAIN ] Update Progress: 1070/2372 symbols completed. HVT took 29.7s. Estimated remaining: 2h 52m 37s. Rate: 7.5 symbols/min [2025-09-25T19:21:55.013793] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:21:55.014030] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-25T19:21:55.014069] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-25T19:21:55.014261] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-25T19:21:55.014424] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-25T19:21:55.014491] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-25T19:21:55.014528] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-25T19:21:55.090580] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-25T19:21:55.162845] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T19:21:55.408744] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:21:55.888724] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-25T19:21:56.688726] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-25T19:21:56.763898] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:21:57.021569] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-25T19:21:57.488754] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-25T19:21:57.717176] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T19:21:58.288742] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-25T19:21:59.086963] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T19:21:59.090831] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-25T19:21:59.828801] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T19:21:59.888688] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-25T19:22:00.200881] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-25T19:22:00.262998] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T19:22:00.688734] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-25T19:22:00.953174] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-25T19:22:01.488736] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-25T19:22:02.288754] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-25T19:22:03.088728] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-25T19:22:03.371358] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-09-25T19:22:03.426943] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T19:22:03.888756] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-25T19:22:03.990262] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T19:22:04.239449] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-25T19:22:04.688726] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-25T19:22:05.038299] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T19:22:05.488736] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-25T19:22:05.848363] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T19:22:06.288690] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-25T19:22:06.720261] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T19:22:07.088732] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-25T19:22:07.877505] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T19:22:07.888751] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-25T19:22:08.688742] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-25T19:22:09.493963] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-25T19:22:09.523674] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T19:22:09.549050] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T19:22:10.288747] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-25T19:22:11.088906] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-25T19:22:11.346883] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-25T19:22:11.578244] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T19:22:11.599629] [INFO ] [REMOTE ] HWM: Full fetch complete (76640 records). [2025-09-25T19:22:11.599895] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-25T19:22:11.820563] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T19:22:11.889908] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-25T19:22:12.127493] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-25T19:22:12.127639] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-25T19:22:12.129063] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-25T19:22:12.129178] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-25T19:22:12.133774] [DEBUG] [LOCAL ] HWM: Trimmed 76640 records to 53388 (keeping 200 days of data) [2025-09-25T19:22:12.520078] [DEBUG] [LOCAL ] HWM: Primary data saved (53388 records). [2025-09-25T19:22:12.520384] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-25T19:22:12.523038] [INFO ] [MAIN ] Update Progress: 1071/2372 symbols completed. HWM took 38.2s. Estimated remaining: 2h 52m 41s. Rate: 7.5 symbols/min [2025-09-25T19:22:12.710298] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-25T19:22:12.716837] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:12.717161] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-25T19:22:12.717221] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-25T19:22:12.717460] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-25T19:22:12.717552] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-25T19:22:12.717606] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-25T19:22:12.717705] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-25T19:22:13.147486] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:13.488710] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-25T19:22:13.686353] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T19:22:13.688589] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T19:22:13.704371] [INFO ] [REMOTE ] HXL: Full fetch complete (66124 records). [2025-09-25T19:22:13.704563] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-25T19:22:13.871173] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-25T19:22:14.155553] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-25T19:22:14.155717] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-25T19:22:14.157025] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-25T19:22:14.157133] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-25T19:22:14.159463] [DEBUG] [LOCAL ] HXL: Trimmed 66124 records to 46282 (keeping 200 days of data) [2025-09-25T19:22:14.288780] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-25T19:22:14.512875] [DEBUG] [LOCAL ] HXL: Primary data saved (46282 records). [2025-09-25T19:22:14.513073] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-25T19:22:14.514612] [INFO ] [MAIN ] Update Progress: 1072/2372 symbols completed. HXL took 31.3s. Estimated remaining: 2h 52m 26s. Rate: 7.5 symbols/min [2025-09-25T19:22:14.643694] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T19:22:14.713891] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:14.745770] [DEBUG] [LOCAL ] HYI: Loaded 8938 existing records from primary storage. [2025-09-25T19:22:14.745977] [INFO ] [MAIN ] HYI: Loaded 8938 existing records. [2025-09-25T19:22:14.935248] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:22:14.935541] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-25T19:22:14.935596] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-25T19:22:14.937008] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-25T19:22:14.937079] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-25T19:22:15.088957] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-25T19:22:15.318892] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:15.888760] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-25T19:22:16.002859] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T19:22:16.650621] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T19:22:16.688773] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-25T19:22:17.473403] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T19:22:17.488681] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-25T19:22:18.288803] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-25T19:22:18.305851] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T19:22:19.023056] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-25T19:22:19.088733] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-25T19:22:19.853730] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T19:22:19.888825] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-25T19:22:20.246895] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-25T19:22:20.247906] [INFO ] [REMOTE ] HYAC: Full fetch complete (867 records). [2025-09-25T19:22:20.248003] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-25T19:22:20.248772] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-23) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T19:22:20.249874] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:22:20.249990] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:22:20.250116] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-25T19:22:20.250243] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-25T19:22:20.250313] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-25T19:22:20.250384] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-25T19:22:20.250507] [INFO ] [MAIN ] Update Progress: 1073/2372 symbols completed. HYAC took 25.4s. Estimated remaining: 2h 52m 15s. Rate: 7.5 symbols/min [2025-09-25T19:22:20.462144] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:20.550714] [DEBUG] [LOCAL ] HYT: Loaded 33293 existing records from primary storage. [2025-09-25T19:22:20.550891] [INFO ] [MAIN ] HYT: Loaded 33293 existing records. [2025-09-25T19:22:20.699731] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-25T19:22:20.749449] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:22:20.749863] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-25T19:22:20.749927] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-25T19:22:20.750326] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-25T19:22:20.750389] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-25T19:22:21.145033] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:21.273076] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:22:21.490740] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-25T19:22:22.288730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-25T19:22:22.855913] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T19:22:22.867982] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T19:22:23.088769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-25T19:22:23.888787] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-25T19:22:24.138946] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-25T19:22:24.548065] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T19:22:24.688753] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-25T19:22:25.488779] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-25T19:22:25.982668] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T19:22:26.211282] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T19:22:26.288769] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-25T19:22:27.088766] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-25T19:22:27.479296] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T19:22:27.788830] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:22:27.888730] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-25T19:22:28.221529] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-25T19:22:28.688738] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-25T19:22:29.005628] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-25T19:22:29.488735] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-25T19:22:30.288740] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-25T19:22:30.609068] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-25T19:22:30.994077] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T19:22:31.088693] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-25T19:22:31.888758] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-25T19:22:32.480144] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T19:22:32.503320] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T19:22:32.688736] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-25T19:22:33.488758] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-25T19:22:34.059066] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T19:22:34.084607] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:22:34.288779] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-25T19:22:35.094266] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-25T19:22:35.097939] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T19:22:35.865715] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T19:22:35.888753] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-25T19:22:36.688734] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-25T19:22:36.719825] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T19:22:37.097916] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-25T19:22:37.098810] [INFO ] [REMOTE ] HYBX: Full fetch complete (800 records). [2025-09-25T19:22:37.098892] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-25T19:22:37.323249] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-25T19:22:37.323564] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:22:37.323620] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:22:37.323726] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-25T19:22:37.323946] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-25T19:22:37.324042] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-25T19:22:37.324131] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-25T19:22:37.324342] [INFO ] [MAIN ] Update Progress: 1074/2372 symbols completed. HYBX took 24.8s. Estimated remaining: 2h 52m 18s. Rate: 7.5 symbols/min [2025-09-25T19:22:37.490208] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-25T19:22:37.518041] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:37.539854] [DEBUG] [LOCAL ] HYTR: Loaded 3166 existing records from primary storage. [2025-09-25T19:22:37.540030] [INFO ] [MAIN ] HYTR: Loaded 3166 existing records. [2025-09-25T19:22:37.726141] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:22:37.726880] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-25T19:22:37.726930] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-25T19:22:37.727294] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-25T19:22:37.727367] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-25T19:22:38.100751] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:38.288755] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-25T19:22:38.746585] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T19:22:38.870157] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T19:22:39.088748] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-25T19:22:39.888762] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-25T19:22:40.026457] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T19:22:40.031388] [INFO ] [REMOTE ] HY: Full fetch complete (15247 records). [2025-09-25T19:22:40.031473] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-25T19:22:40.408962] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-25T19:22:40.409075] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-25T19:22:40.409523] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-25T19:22:40.409620] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-25T19:22:40.410308] [DEBUG] [LOCAL ] HY: Trimmed 15247 records to 10146 (keeping 200 days of data) [2025-09-25T19:22:40.488789] [DEBUG] [LOCAL ] HY: Primary data saved (10146 records). [2025-09-25T19:22:40.488966] [INFO ] [MAIN ] HY: Full history saved. [2025-09-25T19:22:40.489148] [INFO ] [MAIN ] Update Progress: 1075/2372 symbols completed. HY took 49.4s. Estimated remaining: 2h 52m 5s. Rate: 7.5 symbols/min [2025-09-25T19:22:40.664890] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:40.695898] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-25T19:22:40.712105] [DEBUG] [LOCAL ] HZO: Loaded 29309 existing records from primary storage. [2025-09-25T19:22:40.712271] [INFO ] [MAIN ] HZO: Loaded 29309 existing records. [2025-09-25T19:22:40.924720] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:22:40.925498] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-25T19:22:40.925579] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-25T19:22:40.925943] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-25T19:22:40.926039] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-25T19:22:41.007440] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T19:22:41.330256] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T19:22:41.376639] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:41.488743] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-25T19:22:42.288773] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-25T19:22:42.570561] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:22:43.088712] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-25T19:22:43.877300] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T19:22:43.883585] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T19:22:43.890850] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-25T19:22:43.893565] [INFO ] [REMOTE ] HYT: Full fetch complete (46967 records). [2025-09-25T19:22:43.893893] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-25T19:22:44.329288] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-25T19:22:44.329488] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-25T19:22:44.330631] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-25T19:22:44.330722] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-25T19:22:44.332055] [DEBUG] [LOCAL ] HYT: Trimmed 46967 records to 33532 (keeping 200 days of data) [2025-09-25T19:22:44.562065] [DEBUG] [LOCAL ] HYT: Primary data saved (33532 records). [2025-09-25T19:22:44.562234] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-25T19:22:44.562341] [INFO ] [MAIN ] Update Progress: 1076/2372 symbols completed. HYT took 24.3s. Estimated remaining: 2h 51m 52s. Rate: 7.5 symbols/min [2025-09-25T19:22:44.694742] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-25T19:22:44.754960] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:22:44.764326] [DEBUG] [LOCAL ] IAE: Loaded 5981 existing records from primary storage. [2025-09-25T19:22:44.764463] [INFO ] [MAIN ] IAE: Loaded 5981 existing records. [2025-09-25T19:22:44.828173] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T19:22:44.981531] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:22:44.982326] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-25T19:22:44.982399] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-25T19:22:44.982746] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-25T19:22:44.982808] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-25T19:22:45.353100] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:22:45.488703] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-25T19:22:45.636023] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T19:22:45.638232] [INFO ] [REMOTE ] HYI: Full fetch complete (12968 records). [2025-09-25T19:22:45.638354] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-25T19:22:46.091537] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-25T19:22:46.091696] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-25T19:22:46.092164] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-25T19:22:46.092249] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-25T19:22:46.096443] [DEBUG] [LOCAL ] HYI: Trimmed 12968 records to 9110 (keeping 200 days of data) [2025-09-25T19:22:46.213005] [DEBUG] [LOCAL ] HYI: Primary data saved (9110 records). [2025-09-25T19:22:46.213225] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-25T19:22:46.213433] [INFO ] [MAIN ] Update Progress: 1077/2372 symbols completed. HYI took 31.7s. Estimated remaining: 2h 51m 36s. Rate: 7.5 symbols/min [2025-09-25T19:22:46.288785] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-25T19:22:46.654774] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T19:22:46.848828] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T19:22:47.088739] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-25T19:22:47.802601] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T19:22:47.888733] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-25T19:22:48.688743] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-25T19:22:49.179463] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T19:22:49.183539] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T19:22:49.488755] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-25T19:22:50.232019] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T19:22:50.288694] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-25T19:22:50.953868] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T19:22:51.088743] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-25T19:22:51.655800] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T19:22:51.888725] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-25T19:22:52.688844] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-25T19:22:53.488842] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-25T19:23:04.071203] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (10.58 seconds). [2025-09-25T19:23:04.075790] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-25T19:23:04.391819] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (12.50 seconds). [2025-09-25T19:23:04.395857] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-25T19:23:04.733163] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T19:23:04.735426] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-25T19:23:04.807140] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T19:23:04.808774] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-25T19:23:05.231858] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-25T19:23:05.233497] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-25T19:23:05.780397] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T19:23:05.782115] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-25T19:23:06.246741] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T19:23:06.248137] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-25T19:23:06.296296] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (13.61 seconds). [2025-09-25T19:23:06.306161] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-25T19:23:06.398030] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T19:23:06.400350] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-25T19:23:06.823022] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T19:23:06.824323] [INFO ] [REMOTE ] HYTR: Full fetch complete (4468 records). [2025-09-25T19:23:06.824449] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-25T19:23:07.281380] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T19:23:07.287517] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-25T19:23:07.288666] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-25T19:23:07.288725] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-25T19:23:07.288900] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-25T19:23:07.289086] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-25T19:23:07.289719] [DEBUG] [LOCAL ] HYTR: Trimmed 4468 records to 3189 (keeping 200 days of data) [2025-09-25T19:23:07.326080] [DEBUG] [LOCAL ] HYTR: Primary data saved (3189 records). [2025-09-25T19:23:07.326190] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-25T19:23:07.326341] [INFO ] [MAIN ] Update Progress: 1078/2372 symbols completed. HYTR took 30.0s. Estimated remaining: 2h 51m 44s. Rate: 7.5 symbols/min [2025-09-25T19:23:07.496504] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T19:23:07.503895] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-25T19:23:07.917350] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T19:23:07.919827] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-25T19:23:08.495132] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T19:23:08.501785] [INFO ] [REMOTE ] IAE: Full fetch complete (8636 records). [2025-09-25T19:23:08.501866] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-25T19:23:08.538899] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T19:23:08.577939] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-25T19:23:08.909109] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-25T19:23:08.909192] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-25T19:23:08.909462] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-25T19:23:08.909500] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-25T19:23:08.909956] [DEBUG] [LOCAL ] IAE: Trimmed 8636 records to 6040 (keeping 200 days of data) [2025-09-25T19:23:08.954884] [DEBUG] [LOCAL ] IAE: Primary data saved (6040 records). [2025-09-25T19:23:08.955030] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-25T19:23:08.955156] [INFO ] [MAIN ] Update Progress: 1079/2372 symbols completed. IAE took 24.4s. Estimated remaining: 2h 51m 29s. Rate: 7.5 symbols/min [2025-09-25T19:23:09.960387] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T19:23:09.967743] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-25T19:23:11.122950] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:23:11.133521] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-25T19:23:12.643804] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T19:23:12.655708] [INFO ] [REMOTE ] HZO: Full fetch complete (40784 records). [2025-09-25T19:23:12.655981] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-25T19:23:13.071434] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-25T19:23:13.071566] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-25T19:23:13.072677] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-25T19:23:13.072751] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-25T19:23:13.074206] [DEBUG] [LOCAL ] HZO: Trimmed 40784 records to 29552 (keeping 200 days of data) [2025-09-25T19:23:13.294835] [DEBUG] [LOCAL ] HZO: Primary data saved (29552 records). [2025-09-25T19:23:13.295054] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-25T19:23:13.295184] [INFO ] [MAIN ] Update Progress: 1080/2372 symbols completed. HZO took 32.8s. Estimated remaining: 2h 51m 17s. Rate: 7.5 symbols/min [2025-09-25T19:23:13.978752] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:14.054473] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:14.094292] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:14.291693] [DEBUG] [LOCAL ] IBP: Loaded 29270 existing records from primary storage. [2025-09-25T19:23:14.315328] [INFO ] [MAIN ] IBP: Loaded 29270 existing records. [2025-09-25T19:23:14.340050] [DEBUG] [LOCAL ] IBN: Loaded 52894 existing records from primary storage. [2025-09-25T19:23:14.340249] [INFO ] [MAIN ] IBN: Loaded 52894 existing records. [2025-09-25T19:23:14.301494] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:14.350372] [DEBUG] [LOCAL ] IAG: Loaded 53445 existing records from primary storage. [2025-09-25T19:23:14.350508] [INFO ] [MAIN ] IAG: Loaded 53445 existing records. [2025-09-25T19:23:14.688981] [DEBUG] [LOCAL ] IBM: Loaded 53636 existing records from primary storage. [2025-09-25T19:23:14.689151] [INFO ] [MAIN ] IBM: Loaded 53636 existing records. [2025-09-25T19:23:15.013070] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:15.013384] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-25T19:23:15.013434] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-25T19:23:15.020073] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-25T19:23:15.025791] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-25T19:23:15.092783] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:15.093035] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-25T19:23:15.093081] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-25T19:23:15.093362] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-25T19:23:15.093421] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-25T19:23:15.142405] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:15.170210] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-25T19:23:15.170266] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-25T19:23:15.213026] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-25T19:23:15.221955] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-25T19:23:15.504695] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:15.504981] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-25T19:23:15.505027] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-25T19:23:15.505505] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-25T19:23:15.505569] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-25T19:23:16.606493] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:16.615498] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-25T19:23:16.670034] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:16.687205] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-25T19:23:16.710140] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:16.716110] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-25T19:23:16.801546] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:16.801938] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-25T19:23:17.975391] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T19:23:17.983704] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-25T19:23:18.128415] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T19:23:18.139255] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-25T19:23:18.200833] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T19:23:18.211552] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-25T19:23:19.001627] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T19:23:19.020704] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-25T19:23:19.028799] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T19:23:19.033828] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-25T19:23:19.477200] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T19:23:19.487966] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-25T19:23:19.944769] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:23:19.955788] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-25T19:23:20.343797] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T19:23:20.350620] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-25T19:23:21.088097] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T19:23:21.099585] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-25T19:23:21.191464] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T19:23:21.202728] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-25T19:23:21.267274] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T19:23:21.273998] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-25T19:23:21.444746] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T19:23:21.455206] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-25T19:23:22.532179] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T19:23:22.538948] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-25T19:23:22.903969] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T19:23:22.918154] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-25T19:23:23.093117] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:23:23.106173] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-25T19:23:23.286105] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T19:23:23.303947] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-25T19:23:23.491753] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T19:23:23.502516] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-25T19:23:24.706714] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T19:23:24.714802] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-25T19:23:24.953007] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T19:23:24.970934] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-25T19:23:25.209972] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-25T19:23:25.230177] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-25T19:23:25.278004] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T19:23:25.488730] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-25T19:23:26.107516] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T19:23:26.288733] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-25T19:23:26.850878] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T19:23:27.088685] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-25T19:23:27.261662] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:23:27.615307] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-25T19:23:27.686897] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T19:23:27.888764] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-25T19:23:28.435840] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:23:28.688822] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-25T19:23:29.488784] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-25T19:23:29.830828] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T19:23:30.128485] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T19:23:30.137340] [INFO ] [REMOTE ] IBP: Full fetch complete (41102 records). [2025-09-25T19:23:30.137539] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-25T19:23:30.290694] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-25T19:23:30.557662] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-25T19:23:30.557774] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-25T19:23:30.559192] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-25T19:23:30.559314] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-25T19:23:30.564616] [DEBUG] [LOCAL ] IBP: Trimmed 41102 records to 29439 (keeping 200 days of data) [2025-09-25T19:23:30.779599] [DEBUG] [LOCAL ] IBP: Primary data saved (29439 records). [2025-09-25T19:23:30.779806] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-25T19:23:30.780013] [INFO ] [MAIN ] Update Progress: 1081/2372 symbols completed. IBP took 17.5s. Estimated remaining: 2h 51m 20s. Rate: 7.5 symbols/min [2025-09-25T19:23:30.978581] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:31.045092] [DEBUG] [LOCAL ] IBTA: Loaded 37926 existing records from primary storage. [2025-09-25T19:23:31.045288] [INFO ] [MAIN ] IBTA: Loaded 37926 existing records. [2025-09-25T19:23:31.090269] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-25T19:23:31.241214] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:31.244433] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-25T19:23:31.244539] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-25T19:23:31.245420] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-25T19:23:31.245527] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-25T19:23:31.475552] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T19:23:31.744565] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:31.888806] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-25T19:23:32.230311] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T19:23:32.688697] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-25T19:23:33.312223] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T19:23:33.429777] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T19:23:33.488684] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-25T19:23:34.290006] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-25T19:23:34.653505] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T19:23:35.088705] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-25T19:23:35.353073] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:23:35.368636] [INFO ] [REMOTE ] IBN: Full fetch complete (76256 records). [2025-09-25T19:23:35.368831] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-25T19:23:35.825829] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-25T19:23:35.825956] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-25T19:23:35.827393] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-25T19:23:35.827463] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-25T19:23:35.829306] [DEBUG] [LOCAL ] IBN: Trimmed 76256 records to 53266 (keeping 200 days of data) [2025-09-25T19:23:35.907851] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-25T19:23:36.219026] [DEBUG] [LOCAL ] IBN: Primary data saved (53266 records). [2025-09-25T19:23:36.219227] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-25T19:23:36.219447] [INFO ] [MAIN ] Update Progress: 1082/2372 symbols completed. IBN took 22.9s. Estimated remaining: 2h 51m 9s. Rate: 7.5 symbols/min [2025-09-25T19:23:36.417224] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:36.521130] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-25T19:23:36.522264] [DEBUG] [LOCAL ] ICE: Loaded 53025 existing records from primary storage. [2025-09-25T19:23:36.533059] [INFO ] [MAIN ] ICE: Loaded 53025 existing records. [2025-09-25T19:23:36.694716] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-25T19:23:36.784133] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:36.784440] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-25T19:23:36.784503] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-25T19:23:36.784946] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-25T19:23:36.785026] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-25T19:23:37.202570] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:37.227732] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T19:23:37.347363] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T19:23:37.357748] [INFO ] [REMOTE ] IAG: Full fetch complete (77224 records). [2025-09-25T19:23:37.357906] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-25T19:23:37.493896] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-25T19:23:37.785078] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-25T19:23:37.785165] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-25T19:23:37.786280] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-25T19:23:37.786359] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-25T19:23:37.788189] [DEBUG] [LOCAL ] IAG: Trimmed 77224 records to 53835 (keeping 200 days of data) [2025-09-25T19:23:38.117332] [DEBUG] [LOCAL ] IAG: Primary data saved (53835 records). [2025-09-25T19:23:38.117481] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-25T19:23:38.118468] [INFO ] [MAIN ] Update Progress: 1083/2372 symbols completed. IAG took 24.8s. Estimated remaining: 2h 50m 54s. Rate: 7.5 symbols/min [2025-09-25T19:23:38.300330] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:38.297781] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-25T19:23:38.365556] [DEBUG] [LOCAL ] ICL: Loaded 38635 existing records from primary storage. [2025-09-25T19:23:38.365749] [INFO ] [MAIN ] ICL: Loaded 38635 existing records. [2025-09-25T19:23:38.561606] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:38.562390] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-25T19:23:38.562453] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-25T19:23:38.563000] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-25T19:23:38.563062] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-25T19:23:38.759296] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T19:23:39.093899] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-25T19:23:39.248816] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:39.282434] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-25T19:23:39.888742] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-25T19:23:40.231858] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T19:23:40.276317] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T19:23:40.688753] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-25T19:23:41.363154] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T19:23:41.488704] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-25T19:23:42.288720] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-25T19:23:42.368131] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T19:23:42.963429] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T19:23:43.088682] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-25T19:23:43.567859] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T19:23:43.888772] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-25T19:23:44.075421] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T19:23:44.688700] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-25T19:23:45.488684] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-25T19:23:45.633065] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T19:23:46.226909] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:23:46.288679] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-25T19:23:47.088716] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-25T19:23:47.888718] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-25T19:23:47.973459] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-25T19:23:48.199675] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T19:23:48.688721] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-25T19:23:48.892817] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T19:23:49.252103] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T19:23:49.488726] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-25T19:23:50.288735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-25T19:23:50.662571] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T19:23:51.088739] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-25T19:23:51.713102] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T19:23:51.725207] [INFO ] [REMOTE ] IBM: Full fetch complete (77618 records). [2025-09-25T19:23:51.725378] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-25T19:23:51.890874] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-25T19:23:52.028525] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:23:52.125178] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T19:23:52.248197] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-25T19:23:52.248310] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-25T19:23:52.249544] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-25T19:23:52.249617] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-25T19:23:52.251396] [DEBUG] [LOCAL ] IBM: Trimmed 77618 records to 54026 (keeping 200 days of data) [2025-09-25T19:23:52.634235] [DEBUG] [LOCAL ] IBM: Primary data saved (54026 records). [2025-09-25T19:23:52.634406] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-25T19:23:52.634551] [INFO ] [MAIN ] Update Progress: 1084/2372 symbols completed. IBM took 39.3s. Estimated remaining: 2h 50m 54s. Rate: 7.5 symbols/min [2025-09-25T19:23:52.699849] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-25T19:23:52.837819] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:23:52.884192] [DEBUG] [LOCAL ] IDA: Loaded 31989 existing records from primary storage. [2025-09-25T19:23:52.884356] [INFO ] [MAIN ] IDA: Loaded 31989 existing records. [2025-09-25T19:23:53.066903] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:23:53.067384] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-25T19:23:53.067441] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-25T19:23:53.067772] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-25T19:23:53.067833] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-25T19:23:53.431161] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:23:53.488723] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-25T19:23:53.800421] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T19:23:54.025542] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T19:23:54.283730] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T19:23:54.289184] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-25T19:23:55.088916] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-25T19:23:55.900043] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-25T19:23:55.907687] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T19:23:56.450357] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T19:23:56.688924] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-25T19:23:57.349300] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:23:57.488827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-25T19:23:58.004204] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T19:23:58.288925] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-25T19:23:58.564320] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T19:23:59.088846] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-25T19:23:59.888713] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-25T19:23:59.961965] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:24:00.688780] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-25T19:24:00.869608] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T19:24:01.124531] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T19:24:01.488911] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-25T19:24:02.202138] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:24:02.288761] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-25T19:24:03.088816] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-25T19:24:03.238224] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T19:24:03.251397] [INFO ] [REMOTE ] IBTA: Full fetch complete (50636 records). [2025-09-25T19:24:03.251705] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-25T19:24:03.704411] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-25T19:24:03.704576] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-25T19:24:03.706622] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-25T19:24:03.706756] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-25T19:24:03.711049] [DEBUG] [LOCAL ] IBTA: Trimmed 50636 records to 38211 (keeping 200 days of data) [2025-09-25T19:24:03.860254] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T19:24:03.884212] [INFO ] [REMOTE ] ICL: Full fetch complete (56198 records). [2025-09-25T19:24:03.884492] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-25T19:24:03.894800] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-25T19:24:04.143675] [DEBUG] [LOCAL ] IBTA: Primary data saved (38211 records). [2025-09-25T19:24:04.143875] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-25T19:24:04.159865] [INFO ] [MAIN ] Update Progress: 1085/2372 symbols completed. IBTA took 33.4s. Estimated remaining: 2h 50m 50s. Rate: 7.5 symbols/min [2025-09-25T19:24:04.586328] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:04.646916] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T19:24:04.689352] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-25T19:24:04.712341] [DEBUG] [LOCAL ] IDE: Loaded 8581 existing records from primary storage. [2025-09-25T19:24:04.712503] [INFO ] [MAIN ] IDE: Loaded 8581 existing records. [2025-09-25T19:24:04.830883] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-25T19:24:04.830975] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-25T19:24:04.832143] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-25T19:24:04.832217] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-25T19:24:04.833962] [DEBUG] [LOCAL ] ICL: Trimmed 56198 records to 38902 (keeping 200 days of data) [2025-09-25T19:24:05.090592] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:05.092123] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-25T19:24:05.092812] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-25T19:24:05.093866] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-25T19:24:05.094226] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-25T19:24:05.243025] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:24:05.499856] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-25T19:24:05.592121] [DEBUG] [LOCAL ] ICL: Primary data saved (38902 records). [2025-09-25T19:24:05.592287] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-25T19:24:05.592450] [INFO ] [MAIN ] Update Progress: 1086/2372 symbols completed. ICL took 27.5s. Estimated remaining: 2h 50m 34s. Rate: 7.5 symbols/min [2025-09-25T19:24:05.792128] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:05.840661] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:05.865241] [DEBUG] [LOCAL ] IDT: Loaded 17671 existing records from primary storage. [2025-09-25T19:24:05.865377] [INFO ] [MAIN ] IDT: Loaded 17671 existing records. [2025-09-25T19:24:06.042827] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:06.043117] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-25T19:24:06.043173] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-25T19:24:06.043430] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-25T19:24:06.043490] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-25T19:24:06.289035] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-25T19:24:06.417113] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:06.514865] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T19:24:06.525782] [INFO ] [REMOTE ] ICE: Full fetch complete (76771 records). [2025-09-25T19:24:06.525992] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-25T19:24:06.879159] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T19:24:06.966390] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T19:24:06.997976] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-25T19:24:06.998067] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-25T19:24:06.999200] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-25T19:24:06.999267] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-25T19:24:07.002398] [DEBUG] [LOCAL ] ICE: Trimmed 76771 records to 53415 (keeping 200 days of data) [2025-09-25T19:24:07.108563] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-25T19:24:07.369557] [DEBUG] [LOCAL ] ICE: Primary data saved (53415 records). [2025-09-25T19:24:07.369741] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-25T19:24:07.369934] [INFO ] [MAIN ] Update Progress: 1087/2372 symbols completed. ICE took 31.2s. Estimated remaining: 2h 50m 19s. Rate: 7.5 symbols/min [2025-09-25T19:24:07.544915] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:07.598903] [DEBUG] [LOCAL ] IEX: Loaded 38371 existing records from primary storage. [2025-09-25T19:24:07.599058] [INFO ] [MAIN ] IEX: Loaded 38371 existing records. [2025-09-25T19:24:07.773362] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:07.773762] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-25T19:24:07.773815] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-25T19:24:07.774104] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-25T19:24:07.774172] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-25T19:24:07.894062] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-25T19:24:08.147010] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:08.688709] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-25T19:24:08.769362] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T19:24:08.799892] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T19:24:09.488700] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-25T19:24:09.767981] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:24:10.288719] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-25T19:24:10.521064] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:24:11.088777] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-25T19:24:11.494204] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T19:24:11.888730] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-25T19:24:11.980762] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T19:24:12.613611] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T19:24:12.688758] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-25T19:24:13.462948] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T19:24:13.488671] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-25T19:24:14.288719] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-25T19:24:14.561037] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T19:24:15.088716] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-25T19:24:15.769784] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T19:24:15.888686] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-25T19:24:16.088623] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T19:24:16.688722] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-25T19:24:17.449278] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T19:24:17.488672] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-25T19:24:17.776067] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T19:24:18.288770] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-25T19:24:18.916820] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T19:24:19.088760] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-25T19:24:19.136345] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T19:24:19.888739] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-25T19:24:20.237211] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T19:24:20.688723] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-25T19:24:21.383131] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T19:24:21.488714] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-25T19:24:21.730428] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T19:24:22.288745] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-25T19:24:22.788558] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T19:24:22.896321] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T19:24:23.088722] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-25T19:24:23.888722] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-25T19:24:24.671236] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T19:24:24.688676] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-25T19:24:25.042416] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T19:24:25.048729] [INFO ] [REMOTE ] IDT: Full fetch complete (22555 records). [2025-09-25T19:24:25.049013] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-25T19:24:25.433718] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-25T19:24:25.433816] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-25T19:24:25.434511] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-25T19:24:25.434576] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-25T19:24:25.435544] [DEBUG] [LOCAL ] IDT: Trimmed 22555 records to 17791 (keeping 200 days of data) [2025-09-25T19:24:25.493880] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-25T19:24:25.554563] [DEBUG] [LOCAL ] IDT: Primary data saved (17791 records). [2025-09-25T19:24:25.557772] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-25T19:24:25.557932] [INFO ] [MAIN ] Update Progress: 1088/2372 symbols completed. IDT took 20.0s. Estimated remaining: 2h 50m 23s. Rate: 7.5 symbols/min [2025-09-25T19:24:25.747357] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:25.820371] [DEBUG] [LOCAL ] IFF: Loaded 50966 existing records from primary storage. [2025-09-25T19:24:25.820525] [INFO ] [MAIN ] IFF: Loaded 50966 existing records. [2025-09-25T19:24:26.041336] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:26.042212] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-25T19:24:26.042334] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-25T19:24:26.042928] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-25T19:24:26.043020] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-25T19:24:26.288724] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-25T19:24:26.392176] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T19:24:26.489103] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:26.996380] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:24:27.047218] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T19:24:27.088686] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-25T19:24:27.888746] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-25T19:24:28.647747] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-25T19:24:28.688765] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-25T19:24:28.833044] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T19:24:29.488764] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-25T19:24:30.164587] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T19:24:30.176789] [INFO ] [REMOTE ] IEX: Full fetch complete (53451 records). [2025-09-25T19:24:30.177100] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-25T19:24:30.292453] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-25T19:24:30.604011] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-25T19:24:30.604105] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-25T19:24:30.605045] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-25T19:24:30.605112] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-25T19:24:30.606497] [DEBUG] [LOCAL ] IEX: Trimmed 53451 records to 38697 (keeping 200 days of data) [2025-09-25T19:24:30.873486] [DEBUG] [LOCAL ] IEX: Primary data saved (38697 records). [2025-09-25T19:24:30.873639] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-25T19:24:30.873788] [INFO ] [MAIN ] Update Progress: 1089/2372 symbols completed. IEX took 23.5s. Estimated remaining: 2h 50m 12s. Rate: 7.5 symbols/min [2025-09-25T19:24:31.049884] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:31.072280] [DEBUG] [LOCAL ] IFN: Loaded 18198 existing records from primary storage. [2025-09-25T19:24:31.072423] [INFO ] [MAIN ] IFN: Loaded 18198 existing records. [2025-09-25T19:24:31.105734] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-25T19:24:31.221271] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:24:31.303366] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:31.303726] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-25T19:24:31.303781] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-25T19:24:31.304161] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-25T19:24:31.304224] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-25T19:24:31.673677] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:31.863094] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T19:24:31.888696] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-25T19:24:32.008748] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T19:24:32.688762] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-25T19:24:33.061959] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:24:33.488732] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-25T19:24:33.979344] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T19:24:34.257564] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T19:24:34.288675] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-25T19:24:35.088733] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-25T19:24:35.598404] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T19:24:35.888729] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-25T19:24:36.688696] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-25T19:24:36.731254] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T19:24:36.737034] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T19:24:37.488720] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-25T19:24:38.092017] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:24:38.097526] [INFO ] [REMOTE ] IDA: Full fetch complete (44697 records). [2025-09-25T19:24:38.097687] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-25T19:24:38.289896] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-25T19:24:38.488392] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:24:38.494695] [INFO ] [REMOTE ] IDE: Full fetch complete (12788 records). [2025-09-25T19:24:38.494830] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-25T19:24:38.573359] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-25T19:24:38.573443] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-25T19:24:38.574312] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-25T19:24:38.574385] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-25T19:24:38.582542] [DEBUG] [LOCAL ] IDA: Trimmed 44697 records to 32201 (keeping 200 days of data) [2025-09-25T19:24:39.015980] [DEBUG] [LOCAL ] IDA: Primary data saved (32201 records). [2025-09-25T19:24:39.016157] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-25T19:24:39.019914] [INFO ] [MAIN ] Update Progress: 1090/2372 symbols completed. IDA took 46.4s. Estimated remaining: 2h 50m 4s. Rate: 7.5 symbols/min [2025-09-25T19:24:39.144718] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-25T19:24:39.423987] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:39.429008] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-25T19:24:39.429106] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-25T19:24:39.429522] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-25T19:24:39.429586] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-25T19:24:39.431114] [DEBUG] [LOCAL ] IDE: Trimmed 12788 records to 8650 (keeping 200 days of data) [2025-09-25T19:24:39.510157] [DEBUG] [LOCAL ] IDE: Primary data saved (8650 records). [2025-09-25T19:24:39.510413] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-25T19:24:39.510852] [INFO ] [MAIN ] Update Progress: 1091/2372 symbols completed. IDE took 35.4s. Estimated remaining: 2h 49m 48s. Rate: 7.5 symbols/min [2025-09-25T19:24:39.534465] [DEBUG] [LOCAL ] IFS: Loaded 23056 existing records from primary storage. [2025-09-25T19:24:39.534577] [INFO ] [MAIN ] IFS: Loaded 23056 existing records. [2025-09-25T19:24:39.909972] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:39.910294] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-25T19:24:39.910346] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-25T19:24:39.910635] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-25T19:24:39.912219] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-25T19:24:39.995729] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:24:40.051522] [DEBUG] [LOCAL ] IGA: Loaded 9680 existing records from primary storage. [2025-09-25T19:24:40.051679] [INFO ] [MAIN ] IGA: Loaded 9680 existing records. [2025-09-25T19:24:40.257968] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T19:24:40.336408] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-25T19:24:40.415508] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T19:24:40.569784] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:24:40.570808] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-25T19:24:40.570888] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-25T19:24:40.571423] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-25T19:24:40.571493] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-25T19:24:40.695717] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-25T19:24:40.781436] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:41.037133] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:24:41.488922] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-25T19:24:41.753163] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T19:24:42.204261] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T19:24:42.288717] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-25T19:24:42.430333] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T19:24:43.088720] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-25T19:24:43.144611] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T19:24:43.888730] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-25T19:24:44.065619] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T19:24:44.606036] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T19:24:44.688726] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-25T19:24:45.488776] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-25T19:24:45.512856] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T19:24:46.288830] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-25T19:24:47.088723] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-25T19:24:47.241058] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T19:24:47.363317] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:24:47.665417] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T19:24:47.888845] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-25T19:24:48.688765] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-25T19:24:48.963480] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T19:24:49.488753] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-25T19:24:49.671728] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:24:50.288805] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-25T19:24:51.088707] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-25T19:24:51.179600] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:24:51.201549] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T19:24:51.797019] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T19:24:51.888735] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-25T19:24:52.688778] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-25T19:24:52.926446] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T19:24:53.426417] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T19:24:53.488748] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-25T19:24:54.288715] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-25T19:24:54.303863] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T19:24:55.088713] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-25T19:24:55.445835] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:24:55.888726] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-25T19:24:56.688781] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-25T19:24:56.842238] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T19:24:57.017969] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:24:57.152002] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T19:24:57.488721] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-25T19:24:58.288731] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-25T19:24:58.612867] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T19:24:59.088706] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-25T19:24:59.497404] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T19:24:59.888702] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-25T19:25:00.278472] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T19:25:00.282493] [INFO ] [REMOTE ] IFN: Full fetch complete (29002 records). [2025-09-25T19:25:00.282659] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-25T19:25:00.682335] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-25T19:25:00.682448] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-25T19:25:00.683136] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-25T19:25:00.683209] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-25T19:25:00.684050] [DEBUG] [LOCAL ] IFN: Trimmed 29002 records to 18336 (keeping 200 days of data) [2025-09-25T19:25:00.688680] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-25T19:25:00.834008] [DEBUG] [LOCAL ] IFN: Primary data saved (18336 records). [2025-09-25T19:25:00.834185] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-25T19:25:00.834414] [INFO ] [MAIN ] Update Progress: 1092/2372 symbols completed. IFN took 30.0s. Estimated remaining: 2h 49m 55s. Rate: 7.5 symbols/min [2025-09-25T19:25:01.024920] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:01.049109] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T19:25:01.078548] [DEBUG] [LOCAL ] IGD: Loaded 18929 existing records from primary storage. [2025-09-25T19:25:01.078737] [INFO ] [MAIN ] IGD: Loaded 18929 existing records. [2025-09-25T19:25:01.265441] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:01.266960] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-25T19:25:01.267126] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-25T19:25:01.267814] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-25T19:25:01.267895] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-25T19:25:01.493816] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-25T19:25:01.683210] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:01.832389] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T19:25:01.838152] [INFO ] [REMOTE ] IGA: Full fetch complete (13610 records). [2025-09-25T19:25:01.838324] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-25T19:25:02.257888] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-25T19:25:02.257970] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-25T19:25:02.258301] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-25T19:25:02.258340] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-25T19:25:02.259051] [DEBUG] [LOCAL ] IGA: Trimmed 13610 records to 9727 (keeping 200 days of data) [2025-09-25T19:25:02.289241] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-25T19:25:02.329403] [DEBUG] [LOCAL ] IGA: Primary data saved (9727 records). [2025-09-25T19:25:02.329517] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-25T19:25:02.329636] [INFO ] [MAIN ] Update Progress: 1093/2372 symbols completed. IGA took 22.8s. Estimated remaining: 2h 49m 40s. Rate: 7.5 symbols/min [2025-09-25T19:25:02.506216] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T19:25:02.526319] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:02.539329] [DEBUG] [LOCAL ] IGI: Loaded 3677 existing records from primary storage. [2025-09-25T19:25:02.539449] [INFO ] [MAIN ] IGI: Loaded 3677 existing records. [2025-09-25T19:25:02.722891] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:02.723168] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-25T19:25:02.723217] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-25T19:25:02.723435] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-25T19:25:02.723497] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-25T19:25:03.088556] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:03.088720] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-25T19:25:03.888736] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-25T19:25:04.156027] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T19:25:04.199480] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T19:25:04.521065] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T19:25:04.688713] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-25T19:25:05.488685] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-25T19:25:05.709731] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T19:25:05.811192] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-25T19:25:06.288728] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-25T19:25:07.088709] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-25T19:25:07.554462] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T19:25:07.888730] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-25T19:25:08.220112] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:25:08.233826] [INFO ] [REMOTE ] IFF: Full fetch complete (72888 records). [2025-09-25T19:25:08.233997] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-25T19:25:08.497573] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T19:25:08.702750] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-25T19:25:08.710756] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-25T19:25:08.710820] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-25T19:25:08.711911] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-25T19:25:08.711981] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-25T19:25:08.713749] [DEBUG] [LOCAL ] IFF: Trimmed 72888 records to 51351 (keeping 200 days of data) [2025-09-25T19:25:09.050308] [DEBUG] [LOCAL ] IFF: Primary data saved (51351 records). [2025-09-25T19:25:09.050453] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-25T19:25:09.051936] [INFO ] [MAIN ] Update Progress: 1094/2372 symbols completed. IFF took 43.5s. Estimated remaining: 2h 49m 30s. Rate: 7.5 symbols/min [2025-09-25T19:25:09.234138] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:09.286928] [DEBUG] [LOCAL ] IGR: Loaded 30512 existing records from primary storage. [2025-09-25T19:25:09.287073] [INFO ] [MAIN ] IGR: Loaded 30512 existing records. [2025-09-25T19:25:09.486923] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:09.487772] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-25T19:25:09.487830] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-25T19:25:09.488088] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-25T19:25:09.488147] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-25T19:25:09.503504] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-25T19:25:09.861901] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:25:09.894384] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:10.288725] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-25T19:25:10.842859] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T19:25:10.911395] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:25:11.088738] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-25T19:25:11.571961] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T19:25:11.888725] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-25T19:25:12.472474] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T19:25:12.688723] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-25T19:25:13.488721] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-25T19:25:14.072148] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-25T19:25:14.132425] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T19:25:14.288724] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-25T19:25:14.917910] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T19:25:15.088715] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-25T19:25:15.709199] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T19:25:15.710427] [INFO ] [REMOTE ] IGI: Full fetch complete (5230 records). [2025-09-25T19:25:15.710496] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-25T19:25:15.893848] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-25T19:25:16.169820] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-25T19:25:16.169900] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-25T19:25:16.170104] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-25T19:25:16.170211] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-25T19:25:16.170680] [DEBUG] [LOCAL ] IGI: Trimmed 5230 records to 3710 (keeping 200 days of data) [2025-09-25T19:25:16.196425] [DEBUG] [LOCAL ] IGI: Primary data saved (3710 records). [2025-09-25T19:25:16.196529] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-25T19:25:16.196706] [INFO ] [MAIN ] Update Progress: 1095/2372 symbols completed. IGI took 13.9s. Estimated remaining: 2h 49m 21s. Rate: 7.5 symbols/min [2025-09-25T19:25:16.370906] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:16.377682] [DEBUG] [LOCAL ] IH: Loaded 3416 existing records from primary storage. [2025-09-25T19:25:16.377773] [INFO ] [MAIN ] IH: Loaded 3416 existing records. [2025-09-25T19:25:16.580767] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:16.581314] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-25T19:25:16.581361] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-25T19:25:16.581581] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-25T19:25:16.581666] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-25T19:25:16.699768] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-25T19:25:16.985829] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:17.032957] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T19:25:17.488710] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-25T19:25:18.210232] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T19:25:18.288694] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-25T19:25:18.665932] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T19:25:18.676887] [INFO ] [REMOTE ] IFS: Full fetch complete (31536 records). [2025-09-25T19:25:18.677068] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-25T19:25:19.066191] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-25T19:25:19.066309] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-25T19:25:19.067150] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-25T19:25:19.067259] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-25T19:25:19.069716] [DEBUG] [LOCAL ] IFS: Trimmed 31536 records to 23244 (keeping 200 days of data) [2025-09-25T19:25:19.154795] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-25T19:25:19.244854] [DEBUG] [LOCAL ] IFS: Primary data saved (23244 records). [2025-09-25T19:25:19.245078] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-25T19:25:19.245955] [INFO ] [MAIN ] Update Progress: 1096/2372 symbols completed. IFS took 40.2s. Estimated remaining: 2h 49m 8s. Rate: 7.5 symbols/min [2025-09-25T19:25:19.426455] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:19.440849] [DEBUG] [LOCAL ] IHD: Loaded 7151 existing records from primary storage. [2025-09-25T19:25:19.440959] [INFO ] [MAIN ] IHD: Loaded 7151 existing records. [2025-09-25T19:25:19.614597] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T19:25:19.649497] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:19.649804] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-25T19:25:19.649862] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-25T19:25:19.650170] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-25T19:25:19.650240] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-25T19:25:19.725209] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T19:25:19.889076] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-25T19:25:20.019496] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:20.357228] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T19:25:20.688711] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-25T19:25:21.488768] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-25T19:25:21.952638] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T19:25:22.288722] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-25T19:25:22.580183] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T19:25:23.088740] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-25T19:25:23.700763] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T19:25:23.783145] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T19:25:23.888743] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-25T19:25:24.688823] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-25T19:25:24.904477] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T19:25:25.266201] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T19:25:25.488764] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-25T19:25:26.288790] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-25T19:25:26.307829] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T19:25:27.088764] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-25T19:25:27.561246] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T19:25:27.707470] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T19:25:27.888733] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-25T19:25:28.688779] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-25T19:25:28.978931] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T19:25:29.488879] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-25T19:25:29.495156] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:25:30.288780] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-25T19:25:30.980925] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:25:31.047220] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T19:25:31.088671] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-25T19:25:31.888691] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-25T19:25:31.899665] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:25:32.688739] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-25T19:25:33.286486] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T19:25:33.401195] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T19:25:33.488682] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-25T19:25:34.288732] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-25T19:25:34.346887] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T19:25:35.076987] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T19:25:35.088670] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-25T19:25:35.888715] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-25T19:25:36.238423] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T19:25:36.663085] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T19:25:36.688678] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-25T19:25:37.488719] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-25T19:25:38.073005] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T19:25:38.084523] [INFO ] [REMOTE ] IGR: Full fetch complete (45756 records). [2025-09-25T19:25:38.084837] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-25T19:25:38.085866] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T19:25:38.289258] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-25T19:25:38.526480] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-25T19:25:38.526603] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-25T19:25:38.527528] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-25T19:25:38.527594] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-25T19:25:38.531829] [DEBUG] [LOCAL ] IGR: Trimmed 45756 records to 30674 (keeping 200 days of data) [2025-09-25T19:25:38.736222] [DEBUG] [LOCAL ] IGR: Primary data saved (30674 records). [2025-09-25T19:25:38.736384] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-25T19:25:38.736705] [INFO ] [MAIN ] Update Progress: 1097/2372 symbols completed. IGR took 29.7s. Estimated remaining: 2h 49m 13s. Rate: 7.5 symbols/min [2025-09-25T19:25:38.933315] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:38.973465] [DEBUG] [LOCAL ] IHG: Loaded 24600 existing records from primary storage. [2025-09-25T19:25:38.973618] [INFO ] [MAIN ] IHG: Loaded 24600 existing records. [2025-09-25T19:25:39.093201] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-25T19:25:39.159790] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:39.160457] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-25T19:25:39.160525] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-25T19:25:39.160962] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-25T19:25:39.161616] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-25T19:25:39.347434] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T19:25:39.559795] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:39.888728] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-25T19:25:40.039157] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T19:25:40.520518] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T19:25:40.688745] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-25T19:25:41.008539] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-25T19:25:41.488730] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-25T19:25:42.288753] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-25T19:25:42.460115] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T19:25:42.729446] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-25T19:25:43.088737] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-25T19:25:43.888717] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-25T19:25:44.116202] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T19:25:44.121682] [INFO ] [REMOTE ] IGD: Full fetch complete (29402 records). [2025-09-25T19:25:44.121764] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-25T19:25:44.495009] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-25T19:25:44.497960] [INFO ] [REMOTE ] IHD: Full fetch complete (11871 records). [2025-09-25T19:25:44.498075] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-25T19:25:44.604353] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-25T19:25:44.604452] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-25T19:25:44.605242] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-25T19:25:44.605308] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-25T19:25:44.615898] [DEBUG] [LOCAL ] IGD: Trimmed 29402 records to 19050 (keeping 200 days of data) [2025-09-25T19:25:44.698886] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-25T19:25:44.908193] [DEBUG] [LOCAL ] IGD: Primary data saved (19050 records). [2025-09-25T19:25:44.908438] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-25T19:25:44.908621] [INFO ] [MAIN ] Update Progress: 1098/2372 symbols completed. IGD took 44.1s. Estimated remaining: 2h 49m 3s. Rate: 7.5 symbols/min [2025-09-25T19:25:45.042263] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-25T19:25:45.432870] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:45.488918] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-25T19:25:45.527783] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-25T19:25:45.527913] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-25T19:25:45.528363] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-25T19:25:45.528413] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-25T19:25:45.542138] [DEBUG] [LOCAL ] IHD: Trimmed 11871 records to 7189 (keeping 200 days of data) [2025-09-25T19:25:45.603021] [DEBUG] [LOCAL ] IHS: Loaded 39058 existing records from primary storage. [2025-09-25T19:25:45.603225] [INFO ] [MAIN ] IHS: Loaded 39058 existing records. [2025-09-25T19:25:45.682933] [DEBUG] [LOCAL ] IHD: Primary data saved (7189 records). [2025-09-25T19:25:45.683172] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-25T19:25:45.683535] [INFO ] [MAIN ] Update Progress: 1099/2372 symbols completed. IHD took 26.4s. Estimated remaining: 2h 48m 47s. Rate: 7.5 symbols/min [2025-09-25T19:25:46.173014] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:46.173414] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-25T19:25:46.173470] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-25T19:25:46.181839] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-25T19:25:46.181929] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-25T19:25:46.215184] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T19:25:46.272998] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:46.296887] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-25T19:25:46.306321] [DEBUG] [LOCAL ] IIF: Loaded 5750 existing records from primary storage. [2025-09-25T19:25:46.306480] [INFO ] [MAIN ] IIF: Loaded 5750 existing records. [2025-09-25T19:25:46.772442] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:46.797745] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-25T19:25:46.803745] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-25T19:25:46.836705] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-25T19:25:46.858103] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:46.858720] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-25T19:25:46.911302] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T19:25:47.095304] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-25T19:25:47.256007] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:47.888780] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-25T19:25:48.353562] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T19:25:48.620016] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T19:25:48.688717] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-25T19:25:49.488948] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-25T19:25:50.089391] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T19:25:50.128397] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T19:25:50.131214] [INFO ] [REMOTE ] IH: Full fetch complete (4954 records). [2025-09-25T19:25:50.131328] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-25T19:25:50.293873] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-25T19:25:50.544325] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-25T19:25:50.544428] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-25T19:25:50.544758] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-25T19:25:50.544868] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-25T19:25:50.545539] [DEBUG] [LOCAL ] IH: Trimmed 4954 records to 3429 (keeping 200 days of data) [2025-09-25T19:25:50.570187] [DEBUG] [LOCAL ] IH: Primary data saved (3429 records). [2025-09-25T19:25:50.570353] [INFO ] [MAIN ] IH: Full history saved. [2025-09-25T19:25:50.570623] [INFO ] [MAIN ] Update Progress: 1100/2372 symbols completed. IH took 34.4s. Estimated remaining: 2h 48m 35s. Rate: 7.5 symbols/min [2025-09-25T19:25:50.751326] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:25:50.782688] [DEBUG] [LOCAL ] IIIN: Loaded 16693 existing records from primary storage. [2025-09-25T19:25:50.782971] [INFO ] [MAIN ] IIIN: Loaded 16693 existing records. [2025-09-25T19:25:50.960449] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:25:50.961037] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-25T19:25:50.961092] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-25T19:25:50.961510] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-25T19:25:50.961580] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-25T19:25:51.098759] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-25T19:25:51.376906] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:25:51.488280] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T19:25:51.888741] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-25T19:25:52.023092] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T19:25:52.688792] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-25T19:25:53.141920] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T19:25:53.488814] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-25T19:25:53.707285] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:25:54.288791] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-25T19:25:55.096977] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T19:25:55.104663] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-25T19:25:55.494335] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T19:25:55.888752] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-25T19:25:56.491386] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T19:25:56.688678] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-25T19:25:56.871133] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T19:25:57.488980] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-25T19:25:57.911768] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T19:25:58.288716] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-25T19:25:58.719305] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T19:25:59.088909] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-25T19:25:59.475492] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T19:25:59.888746] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-25T19:26:00.389894] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T19:26:00.688709] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-25T19:26:01.488710] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-25T19:26:01.587242] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T19:26:02.274168] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T19:26:02.288675] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-25T19:26:02.329522] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T19:26:03.088728] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-25T19:26:03.485507] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T19:26:03.490407] [INFO ] [REMOTE ] IHG: Full fetch complete (33603 records). [2025-09-25T19:26:03.490549] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-25T19:26:03.714117] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T19:26:03.888733] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-25T19:26:03.928479] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-25T19:26:03.928577] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-25T19:26:03.929353] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-25T19:26:03.929416] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-25T19:26:03.930242] [DEBUG] [LOCAL ] IHG: Trimmed 33603 records to 24781 (keeping 200 days of data) [2025-09-25T19:26:04.107545] [DEBUG] [LOCAL ] IHG: Primary data saved (24781 records). [2025-09-25T19:26:04.107722] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-25T19:26:04.107924] [INFO ] [MAIN ] Update Progress: 1101/2372 symbols completed. IHG took 25.4s. Estimated remaining: 2h 48m 34s. Rate: 7.5 symbols/min [2025-09-25T19:26:04.285856] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:04.315146] [DEBUG] [LOCAL ] IIM: Loaded 15907 existing records from primary storage. [2025-09-25T19:26:04.315298] [INFO ] [MAIN ] IIM: Loaded 15907 existing records. [2025-09-25T19:26:04.523380] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:04.523987] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-25T19:26:04.524074] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-25T19:26:04.524433] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-25T19:26:04.524513] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-25T19:26:04.688982] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-25T19:26:04.883617] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:05.488676] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-25T19:26:05.568070] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T19:26:05.734529] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T19:26:06.165811] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T19:26:06.288683] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-25T19:26:07.088749] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-25T19:26:07.458860] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:26:07.728211] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T19:26:07.888695] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-25T19:26:08.688723] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-25T19:26:09.338034] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:26:09.417787] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-25T19:26:09.488719] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-25T19:26:10.288721] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-25T19:26:10.633402] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T19:26:11.018147] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T19:26:11.088730] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-25T19:26:11.888724] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-25T19:26:12.607169] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:26:12.692093] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-25T19:26:12.695223] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:26:13.488718] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-25T19:26:13.699833] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T19:26:14.288688] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-25T19:26:14.322081] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:26:15.088757] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-25T19:26:15.870522] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T19:26:15.888675] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-25T19:26:16.173900] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T19:26:16.688735] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-25T19:26:17.447304] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:26:17.454627] [INFO ] [REMOTE ] IHS: Full fetch complete (52228 records). [2025-09-25T19:26:17.454843] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-25T19:26:17.494746] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-25T19:26:17.649223] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T19:26:17.901236] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-25T19:26:17.901353] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-25T19:26:17.902227] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-25T19:26:17.902375] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-25T19:26:17.903859] [DEBUG] [LOCAL ] IHS: Trimmed 52228 records to 39219 (keeping 200 days of data) [2025-09-25T19:26:18.144214] [DEBUG] [LOCAL ] IHS: Primary data saved (39219 records). [2025-09-25T19:26:18.144376] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-25T19:26:18.144529] [INFO ] [MAIN ] Update Progress: 1102/2372 symbols completed. IHS took 33.2s. Estimated remaining: 2h 48m 33s. Rate: 7.5 symbols/min [2025-09-25T19:26:18.301056] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-25T19:26:18.360442] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:18.404431] [DEBUG] [LOCAL ] IIPR: Loaded 29633 existing records from primary storage. [2025-09-25T19:26:18.404594] [INFO ] [MAIN ] IIPR: Loaded 29633 existing records. [2025-09-25T19:26:18.552116] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T19:26:18.634776] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:18.635175] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-25T19:26:18.635233] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-25T19:26:18.635936] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-25T19:26:18.636030] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-25T19:26:18.993403] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:19.088757] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-25T19:26:19.370356] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T19:26:19.888720] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-25T19:26:19.971043] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T19:26:20.688705] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-25T19:26:20.793817] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T19:26:21.488728] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-25T19:26:21.599522] [DEBUG] [REMOTE ] IIIN: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-25T19:26:21.599976] [WARN ] [REMOTE ] IIIN: No data returned for month 2025-09 [2025-09-25T19:26:21.600111] [INFO ] [REMOTE ] IIIN: Full fetch complete (23558 records). [2025-09-25T19:26:21.600208] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-25T19:26:21.602222] [FATAL] [VALIDATOR ] IIIN: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T19:26:21.602310] [FATAL] [MAIN ] IIIN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:26:21.602378] [WARN ] [MAIN ] IIIN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:26:21.602631] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-25T19:26:21.602771] [DEBUG] [LOCAL ] IIIN: No primary data file found to delete. [2025-09-25T19:26:21.602840] [INFO ] [LOCAL ] IIIN: Starting deletion of derivative data. [2025-09-25T19:26:21.603578] [DEBUG] [LOCAL ] IIIN: Deleted derivative data file. [2025-09-25T19:26:21.603817] [INFO ] [MAIN ] Update Progress: 1103/2372 symbols completed. IIIN took 31.0s. Estimated remaining: 2h 48m 20s. Rate: 7.5 symbols/min [2025-09-25T19:26:21.730853] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T19:26:21.807257] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:21.875238] [DEBUG] [LOCAL ] IMAX: Loaded 42759 existing records from primary storage. [2025-09-25T19:26:21.875458] [INFO ] [MAIN ] IMAX: Loaded 42759 existing records. [2025-09-25T19:26:22.055291] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:22.055682] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-25T19:26:22.055739] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-25T19:26:22.056026] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-25T19:26:22.056084] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-25T19:26:22.299730] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-25T19:26:22.434972] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:22.989713] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T19:26:23.088678] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-25T19:26:23.543305] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T19:26:23.544611] [INFO ] [REMOTE ] IIF: Full fetch complete (9536 records). [2025-09-25T19:26:23.544731] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-25T19:26:23.894618] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-25T19:26:23.926182] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-25T19:26:23.926271] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-25T19:26:23.926658] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-25T19:26:23.926798] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-25T19:26:23.927617] [DEBUG] [LOCAL ] IIF: Trimmed 9536 records to 5769 (keeping 200 days of data) [2025-09-25T19:26:23.969908] [DEBUG] [LOCAL ] IIF: Primary data saved (5769 records). [2025-09-25T19:26:23.970079] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-25T19:26:23.970258] [INFO ] [MAIN ] Update Progress: 1104/2372 symbols completed. IIF took 38.3s. Estimated remaining: 2h 48m 5s. Rate: 7.5 symbols/min [2025-09-25T19:26:24.142041] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:24.216955] [DEBUG] [LOCAL ] INFA: Loaded 49983 existing records from primary storage. [2025-09-25T19:26:24.217109] [INFO ] [MAIN ] INFA: Loaded 49983 existing records. [2025-09-25T19:26:24.400113] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:24.400456] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-25T19:26:24.400523] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-25T19:26:24.401074] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-25T19:26:24.401136] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-25T19:26:24.688674] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-25T19:26:24.766234] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:24.922157] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T19:26:25.488759] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-25T19:26:26.103119] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:26:26.288711] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-25T19:26:27.088788] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-25T19:26:27.245984] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T19:26:27.840851] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T19:26:27.888702] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-25T19:26:28.647191] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T19:26:28.688683] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-25T19:26:29.434934] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T19:26:29.488709] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-25T19:26:30.235901] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T19:26:30.288661] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-25T19:26:31.088758] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-25T19:26:31.151429] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T19:26:31.290056] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T19:26:31.888698] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-25T19:26:32.106260] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T19:26:32.688798] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-25T19:26:33.344594] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T19:26:33.488784] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-25T19:26:34.288724] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-25T19:26:34.438857] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T19:26:34.645926] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T19:26:34.649765] [INFO ] [REMOTE ] IIM: Full fetch complete (25356 records). [2025-09-25T19:26:34.649849] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-25T19:26:35.055927] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-25T19:26:35.056034] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-25T19:26:35.056679] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-25T19:26:35.056741] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-25T19:26:35.058160] [DEBUG] [LOCAL ] IIM: Trimmed 25356 records to 15993 (keeping 200 days of data) [2025-09-25T19:26:35.109022] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-25T19:26:35.185118] [DEBUG] [LOCAL ] IIM: Primary data saved (15993 records). [2025-09-25T19:26:35.185356] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-25T19:26:35.185515] [INFO ] [MAIN ] Update Progress: 1105/2372 symbols completed. IIM took 31.1s. Estimated remaining: 2h 48m 1s. Rate: 7.5 symbols/min [2025-09-25T19:26:35.379110] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:35.462962] [DEBUG] [LOCAL ] INFY: Loaded 53600 existing records from primary storage. [2025-09-25T19:26:35.463178] [INFO ] [MAIN ] INFY: Loaded 53600 existing records. [2025-09-25T19:26:35.709562] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:35.710274] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-25T19:26:35.710340] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-25T19:26:35.710857] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-25T19:26:35.710941] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-25T19:26:35.863477] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T19:26:35.893761] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-25T19:26:36.153345] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:36.619126] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:26:36.688683] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-25T19:26:36.822863] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T19:26:37.488837] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-25T19:26:38.288870] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-25T19:26:38.601761] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T19:26:38.777829] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T19:26:39.088739] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-25T19:26:39.537779] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T19:26:39.888785] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-25T19:26:40.458053] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T19:26:40.688819] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-25T19:26:41.488747] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-25T19:26:41.688699] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T19:26:42.288695] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-25T19:26:42.382221] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T19:26:43.088748] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-25T19:26:43.425309] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T19:26:43.727776] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T19:26:43.888747] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-25T19:26:44.492154] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T19:26:44.688745] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-25T19:26:45.488717] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-25T19:26:45.529249] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:26:45.687678] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:26:45.693404] [INFO ] [REMOTE ] IIPR: Full fetch complete (44154 records). [2025-09-25T19:26:45.693520] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-25T19:26:46.116452] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-25T19:26:46.116604] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-25T19:26:46.117553] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-25T19:26:46.117628] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-25T19:26:46.121604] [DEBUG] [LOCAL ] IIPR: Trimmed 44154 records to 29843 (keeping 200 days of data) [2025-09-25T19:26:46.294258] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-25T19:26:46.331368] [DEBUG] [LOCAL ] IIPR: Primary data saved (29843 records). [2025-09-25T19:26:46.331565] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-25T19:26:46.331742] [INFO ] [MAIN ] Update Progress: 1106/2372 symbols completed. IIPR took 28.2s. Estimated remaining: 2h 47m 57s. Rate: 7.5 symbols/min [2025-09-25T19:26:46.534674] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:46.592668] [DEBUG] [LOCAL ] ING: Loaded 50795 existing records from primary storage. [2025-09-25T19:26:46.592874] [INFO ] [MAIN ] ING: Loaded 50795 existing records. [2025-09-25T19:26:46.792291] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:46.794441] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-25T19:26:46.794515] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-25T19:26:46.794888] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-25T19:26:46.794949] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-25T19:26:47.090915] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-25T19:26:47.192396] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:47.888714] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-25T19:26:48.834697] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T19:26:48.851306] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-25T19:26:48.937040] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-09-25T19:26:49.488709] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-25T19:26:49.596222] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:26:50.288754] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-25T19:26:50.592214] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T19:26:50.865529] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (4.57 seconds). [2025-09-25T19:26:51.005548] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T19:26:51.088870] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-25T19:26:51.888896] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-25T19:26:52.688748] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-25T19:26:53.105282] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:26:53.191085] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (2.90 seconds). [2025-09-25T19:26:53.488779] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-25T19:26:54.288811] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-25T19:26:54.441638] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T19:26:54.457145] [INFO ] [REMOTE ] INFA: Full fetch complete (71769 records). [2025-09-25T19:26:54.457504] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-25T19:26:54.641530] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (3.55 seconds). [2025-09-25T19:26:54.833278] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T19:26:55.028290] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-25T19:26:55.028410] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-25T19:26:55.029921] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-25T19:26:55.030068] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-25T19:26:55.032127] [DEBUG] [LOCAL ] INFA: Trimmed 71769 records to 50299 (keeping 200 days of data) [2025-09-25T19:26:55.126738] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-25T19:26:55.413214] [DEBUG] [LOCAL ] INFA: Primary data saved (50299 records). [2025-09-25T19:26:55.413435] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-25T19:26:55.413679] [INFO ] [MAIN ] Update Progress: 1107/2372 symbols completed. INFA took 31.4s. Estimated remaining: 2h 47m 50s. Rate: 7.5 symbols/min [2025-09-25T19:26:55.608039] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:55.653076] [DEBUG] [LOCAL ] INGM: Loaded 28712 existing records from primary storage. [2025-09-25T19:26:55.653255] [INFO ] [MAIN ] INGM: Loaded 28712 existing records. [2025-09-25T19:26:55.832839] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:55.833116] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-25T19:26:55.833164] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-25T19:26:55.833478] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-25T19:26:55.833547] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-25T19:26:55.898757] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-25T19:26:56.283407] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:56.384542] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T19:26:56.688773] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-25T19:26:57.488936] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-25T19:26:57.561089] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T19:26:57.904527] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T19:26:57.927798] [INFO ] [REMOTE ] IMAX: Full fetch complete (59559 records). [2025-09-25T19:26:57.927953] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-25T19:26:58.290608] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-25T19:26:58.411854] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-25T19:26:58.411953] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-25T19:26:58.412927] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-25T19:26:58.413007] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-25T19:26:58.414572] [DEBUG] [LOCAL ] IMAX: Trimmed 59559 records to 43076 (keeping 200 days of data) [2025-09-25T19:26:58.695987] [DEBUG] [LOCAL ] IMAX: Primary data saved (43076 records). [2025-09-25T19:26:58.696140] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-25T19:26:58.696232] [INFO ] [MAIN ] Update Progress: 1108/2372 symbols completed. IMAX took 37.1s. Estimated remaining: 2h 47m 37s. Rate: 7.5 symbols/min [2025-09-25T19:26:58.883389] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:26:58.934059] [DEBUG] [LOCAL ] INGR: Loaded 33328 existing records from primary storage. [2025-09-25T19:26:58.934223] [INFO ] [MAIN ] INGR: Loaded 33328 existing records. [2025-09-25T19:26:59.075257] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T19:26:59.093737] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-25T19:26:59.169154] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:26:59.170126] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-25T19:26:59.170175] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-25T19:26:59.170420] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-25T19:26:59.170478] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-25T19:26:59.536529] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:26:59.888704] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-25T19:27:00.343723] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T19:27:00.415721] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (5.29 seconds). [2025-09-25T19:27:00.522256] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T19:27:00.688757] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-25T19:27:01.462032] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T19:27:01.490117] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-25T19:27:01.516803] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:27:02.288814] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-25T19:27:03.088775] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-25T19:27:03.425981] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T19:27:03.783972] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T19:27:03.888745] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-25T19:27:04.090984] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T19:27:04.688783] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-25T19:27:05.349347] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T19:27:05.488707] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-25T19:27:06.288782] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-25T19:27:06.513324] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T19:27:07.054122] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T19:27:07.088696] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-25T19:27:07.605803] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T19:27:07.888740] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-25T19:27:08.688724] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-25T19:27:08.778382] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T19:27:09.157735] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T19:27:09.488767] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-25T19:27:10.272199] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T19:27:10.288694] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-25T19:27:11.088816] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-25T19:27:11.394116] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T19:27:11.715784] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T19:27:11.888752] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-25T19:27:11.923969] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T19:27:12.688729] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-25T19:27:13.488785] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-25T19:27:14.137584] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-25T19:27:14.153126] [INFO ] [REMOTE ] INFY: Full fetch complete (77533 records). [2025-09-25T19:27:14.153307] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-25T19:27:14.290283] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-25T19:27:14.438770] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T19:27:14.658186] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-25T19:27:14.658302] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-25T19:27:14.659377] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-25T19:27:14.659447] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-25T19:27:14.661080] [DEBUG] [LOCAL ] INFY: Trimmed 77533 records to 53988 (keeping 200 days of data) [2025-09-25T19:27:15.035102] [DEBUG] [LOCAL ] INFY: Primary data saved (53988 records). [2025-09-25T19:27:15.035286] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-25T19:27:15.036924] [INFO ] [MAIN ] Update Progress: 1109/2372 symbols completed. INFY took 39.9s. Estimated remaining: 2h 47m 38s. Rate: 7.5 symbols/min [2025-09-25T19:27:15.088896] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-25T19:27:15.255514] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:15.288457] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T19:27:15.377105] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T19:27:15.385631] [DEBUG] [LOCAL ] INN: Loaded 41927 existing records from primary storage. [2025-09-25T19:27:15.388735] [INFO ] [MAIN ] INN: Loaded 41927 existing records. [2025-09-25T19:27:15.590509] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:15.591224] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-25T19:27:15.591307] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-25T19:27:15.591924] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-25T19:27:15.592008] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-25T19:27:15.893788] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-25T19:27:15.960458] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:16.353926] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T19:27:16.688766] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-25T19:27:16.989455] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T19:27:17.488756] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-25T19:27:18.051702] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T19:27:18.057094] [INFO ] [REMOTE ] INGM: Full fetch complete (42214 records). [2025-09-25T19:27:18.057246] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-25T19:27:18.299697] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-25T19:27:18.452848] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-25T19:27:18.452932] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-25T19:27:18.453700] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-25T19:27:18.453763] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-25T19:27:18.454638] [DEBUG] [LOCAL ] INGM: Trimmed 42214 records to 28961 (keeping 200 days of data) [2025-09-25T19:27:18.633951] [DEBUG] [LOCAL ] INGM: Primary data saved (28961 records). [2025-09-25T19:27:18.634108] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-25T19:27:18.634215] [INFO ] [MAIN ] Update Progress: 1110/2372 symbols completed. INGM took 23.2s. Estimated remaining: 2h 47m 26s. Rate: 7.5 symbols/min [2025-09-25T19:27:18.829140] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:18.829367] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-25T19:27:18.829407] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-25T19:27:18.829741] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-25T19:27:18.829794] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-25T19:27:18.829838] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-25T19:27:18.829872] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-25T19:27:19.095734] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-25T19:27:19.209257] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:19.400265] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T19:27:19.888748] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-25T19:27:19.965702] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T19:27:20.090149] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:27:20.090711] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-25T19:27:20.550061] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:27:20.688733] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-25T19:27:21.126719] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T19:27:21.488760] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-25T19:27:22.288746] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-25T19:27:22.827456] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T19:27:23.088758] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-25T19:27:23.556557] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T19:27:23.888734] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-25T19:27:24.688740] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-25T19:27:24.767979] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T19:27:24.775853] [INFO ] [REMOTE ] INGR: Full fetch complete (49916 records). [2025-09-25T19:27:24.775985] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-25T19:27:25.003720] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T19:27:25.249526] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-25T19:27:25.249757] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-25T19:27:25.250625] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-25T19:27:25.250732] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-25T19:27:25.251897] [DEBUG] [LOCAL ] INGR: Trimmed 49916 records to 33657 (keeping 200 days of data) [2025-09-25T19:27:25.481193] [DEBUG] [LOCAL ] INGR: Primary data saved (33657 records). [2025-09-25T19:27:25.481627] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-25T19:27:25.483472] [INFO ] [MAIN ] Update Progress: 1111/2372 symbols completed. INGR took 26.8s. Estimated remaining: 2h 47m 16s. Rate: 7.5 symbols/min [2025-09-25T19:27:25.489411] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-25T19:27:25.672704] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:25.722316] [DEBUG] [LOCAL ] INSP: Loaded 36853 existing records from primary storage. [2025-09-25T19:27:25.722476] [INFO ] [MAIN ] INSP: Loaded 36853 existing records. [2025-09-25T19:27:25.783306] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T19:27:25.936353] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:25.936982] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-25T19:27:25.937041] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-25T19:27:25.937517] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-25T19:27:25.937586] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-25T19:27:26.290588] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-25T19:27:26.321498] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:26.555214] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:27:27.088906] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-25T19:27:27.779689] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T19:27:27.888721] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-25T19:27:28.688757] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-25T19:27:28.928151] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T19:27:29.036253] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:27:29.488768] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-25T19:27:30.288784] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-25T19:27:30.402548] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T19:27:30.505975] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T19:27:31.088868] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-25T19:27:31.888729] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-25T19:27:31.996639] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:27:32.505510] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T19:27:32.688742] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-25T19:27:33.416676] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T19:27:33.488678] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-25T19:27:34.049451] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T19:27:34.288747] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-25T19:27:35.078725] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:27:35.088785] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-25T19:27:35.723736] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T19:27:35.888755] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-25T19:27:36.252235] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T19:27:36.688827] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-25T19:27:37.467750] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:27:37.488675] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-25T19:27:38.288747] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-25T19:27:38.570585] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T19:27:38.588383] [INFO ] [REMOTE ] ING: Full fetch complete (73624 records). [2025-09-25T19:27:38.588812] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-25T19:27:39.103261] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T19:27:39.116100] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-25T19:27:39.117782] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-25T19:27:39.117851] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-25T19:27:39.119129] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-25T19:27:39.119225] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-25T19:27:39.123063] [DEBUG] [LOCAL ] ING: Trimmed 73624 records to 51166 (keeping 200 days of data) [2025-09-25T19:27:39.435313] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T19:27:39.572173] [DEBUG] [LOCAL ] ING: Primary data saved (51166 records). [2025-09-25T19:27:39.572458] [INFO ] [MAIN ] ING: Full history saved. [2025-09-25T19:27:39.572715] [INFO ] [MAIN ] Update Progress: 1112/2372 symbols completed. ING took 53.2s. Estimated remaining: 2h 47m 15s. Rate: 7.5 symbols/min [2025-09-25T19:27:39.776365] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:39.835956] [DEBUG] [LOCAL ] INSW: Loaded 40298 existing records from primary storage. [2025-09-25T19:27:39.836189] [INFO ] [MAIN ] INSW: Loaded 40298 existing records. [2025-09-25T19:27:39.889338] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-25T19:27:40.042743] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:40.043324] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-25T19:27:40.043410] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-25T19:27:40.043853] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-25T19:27:40.043942] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-25T19:27:40.458166] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T19:27:40.502047] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:40.688754] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-25T19:27:41.255914] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T19:27:41.488758] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-25T19:27:41.894458] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T19:27:41.902362] [INFO ] [REMOTE ] INR: Full fetch complete (33260 records). [2025-09-25T19:27:41.902547] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-25T19:27:42.109553] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 164 unique days, need 200 days [2025-09-25T19:27:42.111212] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:27:42.111299] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:27:42.111368] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-25T19:27:42.111476] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-25T19:27:42.111547] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-25T19:27:42.111630] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-25T19:27:42.111785] [INFO ] [MAIN ] Update Progress: 1113/2372 symbols completed. INR took 23.5s. Estimated remaining: 2h 47m 1s. Rate: 7.5 symbols/min [2025-09-25T19:27:42.293399] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-25T19:27:42.299021] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:42.402322] [DEBUG] [LOCAL ] INVH: Loaded 53141 existing records from primary storage. [2025-09-25T19:27:42.402576] [INFO ] [MAIN ] INVH: Loaded 53141 existing records. [2025-09-25T19:27:42.598826] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:42.599548] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-25T19:27:42.599609] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-25T19:27:42.600009] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-25T19:27:42.600068] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-25T19:27:42.974533] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T19:27:43.004572] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:43.088726] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-25T19:27:43.426795] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T19:27:43.434207] [INFO ] [REMOTE ] INN: Full fetch complete (57752 records). [2025-09-25T19:27:43.434350] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-25T19:27:43.851958] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-25T19:27:43.852050] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-25T19:27:43.853023] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-25T19:27:43.853701] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-25T19:27:43.855002] [DEBUG] [LOCAL ] INN: Trimmed 57752 records to 42206 (keeping 200 days of data) [2025-09-25T19:27:43.928891] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-25T19:27:44.014410] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T19:27:44.191774] [DEBUG] [LOCAL ] INN: Primary data saved (42206 records). [2025-09-25T19:27:44.191949] [INFO ] [MAIN ] INN: Full history saved. [2025-09-25T19:27:44.192171] [INFO ] [MAIN ] Update Progress: 1114/2372 symbols completed. INN took 29.2s. Estimated remaining: 2h 46m 47s. Rate: 7.5 symbols/min [2025-09-25T19:27:44.385217] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:44.421990] [DEBUG] [LOCAL ] INVX: Loaded 28856 existing records from primary storage. [2025-09-25T19:27:44.422145] [INFO ] [MAIN ] INVX: Loaded 28856 existing records. [2025-09-25T19:27:44.607083] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:44.607453] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-25T19:27:44.607502] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-25T19:27:44.607824] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-25T19:27:44.607896] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-25T19:27:44.694272] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-25T19:27:44.990999] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:45.488741] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-25T19:27:45.578821] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T19:27:46.288773] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-25T19:27:46.456749] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T19:27:46.978750] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:27:47.088732] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-25T19:27:47.744312] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T19:27:47.888751] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-25T19:27:48.688728] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-25T19:27:48.896564] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T19:27:49.488707] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-25T19:27:49.668053] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T19:27:50.288758] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-25T19:27:50.326426] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:27:51.090253] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-25T19:27:51.095337] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T19:27:51.105852] [INFO ] [REMOTE ] INSP: Full fetch complete (52524 records). [2025-09-25T19:27:51.105982] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-25T19:27:51.519639] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-25T19:27:51.519763] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-25T19:27:51.520602] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-25T19:27:51.520663] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-25T19:27:51.523694] [DEBUG] [LOCAL ] INSP: Trimmed 52524 records to 37201 (keeping 200 days of data) [2025-09-25T19:27:51.761851] [DEBUG] [LOCAL ] INSP: Primary data saved (37201 records). [2025-09-25T19:27:51.762014] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-25T19:27:51.763427] [INFO ] [MAIN ] Update Progress: 1115/2372 symbols completed. INSP took 26.3s. Estimated remaining: 2h 46m 38s. Rate: 7.5 symbols/min [2025-09-25T19:27:51.889831] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-25T19:27:51.950016] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:27:51.979822] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T19:27:52.044281] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-25T19:27:52.044446] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-25T19:27:52.222761] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:27:52.223000] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-25T19:27:52.223047] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-25T19:27:52.223384] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-25T19:27:52.223442] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-25T19:27:52.433318] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T19:27:52.639719] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:27:52.688770] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-25T19:27:53.385489] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T19:27:53.488692] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-25T19:27:54.288734] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-25T19:27:54.372841] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:27:55.088832] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-25T19:27:55.645296] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T19:27:55.686838] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-25T19:27:55.888720] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-25T19:27:56.688740] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-25T19:27:57.488746] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-25T19:27:57.758165] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T19:27:57.808198] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-25T19:27:58.219221] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:27:58.288692] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-25T19:27:59.092262] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-25T19:27:59.106303] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:27:59.446893] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:27:59.888934] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-25T19:28:00.688770] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-25T19:28:00.984206] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T19:28:01.488846] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-25T19:28:02.288827] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-25T19:28:02.370036] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:28:02.609804] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-25T19:28:03.088759] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-25T19:28:03.268136] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T19:28:03.511432] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T19:28:03.888761] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-25T19:28:04.688803] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-25T19:28:05.238825] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T19:28:05.488750] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-25T19:28:05.625294] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-25T19:28:06.288762] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-25T19:28:06.852798] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T19:28:07.088825] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-25T19:28:07.214001] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:28:07.888803] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-25T19:28:08.688748] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-25T19:28:08.867926] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T19:28:08.967384] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-25T19:28:09.390100] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T19:28:09.488750] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-25T19:28:09.815119] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T19:28:10.288812] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-25T19:28:11.088770] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-25T19:28:11.194809] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:28:11.203543] [INFO ] [REMOTE ] INSW: Full fetch complete (60774 records). [2025-09-25T19:28:11.203841] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-25T19:28:11.645678] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-25T19:28:11.645897] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-25T19:28:11.647276] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-25T19:28:11.647452] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-25T19:28:11.649384] [DEBUG] [LOCAL ] INSW: Trimmed 60774 records to 40590 (keeping 200 days of data) [2025-09-25T19:28:11.921032] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-25T19:28:12.015200] [DEBUG] [LOCAL ] INSW: Primary data saved (40590 records). [2025-09-25T19:28:12.015419] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-25T19:28:12.015823] [INFO ] [MAIN ] Update Progress: 1116/2372 symbols completed. INSW took 32.4s. Estimated remaining: 2h 46m 44s. Rate: 7.5 symbols/min [2025-09-25T19:28:12.201199] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:12.275533] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T19:28:12.321552] [INFO ] [REMOTE ] INVH: Full fetch complete (76690 records). [2025-09-25T19:28:12.321906] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-25T19:28:12.373608] [DEBUG] [LOCAL ] IOT: Loaded 53470 existing records from primary storage. [2025-09-25T19:28:12.373835] [INFO ] [MAIN ] IOT: Loaded 53470 existing records. [2025-09-25T19:28:12.787965] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:12.845752] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-25T19:28:12.858802] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-25T19:28:12.878679] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-25T19:28:12.878899] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-25T19:28:13.086973] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-25T19:28:13.087110] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-25T19:28:13.088309] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-25T19:28:13.088436] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-25T19:28:13.092689] [DEBUG] [LOCAL ] INVH: Trimmed 76690 records to 53530 (keeping 200 days of data) [2025-09-25T19:28:13.370904] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T19:28:13.395481] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-25T19:28:13.917487] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:13.917983] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-25T19:28:13.969747] [DEBUG] [LOCAL ] INVH: Primary data saved (53530 records). [2025-09-25T19:28:13.969851] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-25T19:28:13.969945] [INFO ] [MAIN ] Update Progress: 1117/2372 symbols completed. INVH took 31.9s. Estimated remaining: 2h 46m 29s. Rate: 7.5 symbols/min [2025-09-25T19:28:13.969564] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-25T19:28:14.288729] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-25T19:28:14.706733] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T19:28:15.088741] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-25T19:28:16.029048] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-25T19:28:16.041305] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-25T19:28:16.458911] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T19:28:16.475687] [INFO ] [REMOTE ] INVX: Full fetch complete (44382 records). [2025-09-25T19:28:16.475956] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-25T19:28:16.784963] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-25T19:28:16.815346] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-25T19:28:17.010591] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-25T19:28:17.010744] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-25T19:28:17.012058] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-25T19:28:17.012123] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-25T19:28:17.013246] [DEBUG] [LOCAL ] INVX: Trimmed 44382 records to 29093 (keeping 200 days of data) [2025-09-25T19:28:17.211378] [DEBUG] [LOCAL ] INVX: Primary data saved (29093 records). [2025-09-25T19:28:17.212414] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-25T19:28:17.212558] [INFO ] [MAIN ] Update Progress: 1118/2372 symbols completed. INVX took 33.0s. Estimated remaining: 2h 46m 16s. Rate: 7.5 symbols/min [2025-09-25T19:28:17.808685] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T19:28:17.829138] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-25T19:28:19.417315] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-25T19:28:19.429856] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-25T19:28:19.764153] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T19:28:19.774822] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-25T19:28:21.667679] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:28:21.679595] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-25T19:28:22.309162] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-25T19:28:22.325106] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-25T19:28:23.523333] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T19:28:23.537766] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-25T19:28:24.745518] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-25T19:28:24.762207] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-25T19:28:25.336551] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T19:28:25.348213] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-25T19:28:27.308798] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T19:28:27.323254] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-25T19:28:27.629196] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.87 seconds). [2025-09-25T19:28:27.642107] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-25T19:28:27.642359] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-25T19:28:28.052833] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-25T19:28:28.052938] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-25T19:28:28.054081] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-25T19:28:28.054152] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-25T19:28:28.057214] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 54178 (keeping 200 days of data) [2025-09-25T19:28:28.422249] [DEBUG] [LOCAL ] IONQ: Primary data saved (54178 records). [2025-09-25T19:28:28.422455] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-25T19:28:28.422585] [INFO ] [MAIN ] Update Progress: 1119/2372 symbols completed. IONQ took 36.7s. Estimated remaining: 2h 46m 12s. Rate: 7.5 symbols/min [2025-09-25T19:28:29.338566] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T19:28:29.354182] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-25T19:28:31.424582] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-25T19:28:31.440855] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-25T19:28:33.574840] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-25T19:28:33.590452] [INFO ] [REMOTE ] IOT: Full fetch complete (77380 records). [2025-09-25T19:28:33.590735] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-25T19:28:34.034566] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-25T19:28:34.034744] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-25T19:28:34.035995] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-25T19:28:34.036235] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-25T19:28:34.054322] [DEBUG] [LOCAL ] IOT: Trimmed 77380 records to 53859 (keeping 200 days of data) [2025-09-25T19:28:34.429365] [DEBUG] [LOCAL ] IOT: Primary data saved (53859 records). [2025-09-25T19:28:34.429579] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-25T19:28:34.429835] [INFO ] [MAIN ] Update Progress: 1120/2372 symbols completed. IOT took 22.4s. Estimated remaining: 2h 46m 2s. Rate: 7.5 symbols/min [2025-09-25T19:28:35.168365] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:35.182603] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:35.193403] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:35.219042] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:35.273471] [DEBUG] [LOCAL ] IQI: Loaded 17974 existing records from primary storage. [2025-09-25T19:28:35.273671] [INFO ] [MAIN ] IQI: Loaded 17974 existing records. [2025-09-25T19:28:35.309128] [DEBUG] [LOCAL ] IPI: Loaded 21297 existing records from primary storage. [2025-09-25T19:28:35.309284] [INFO ] [MAIN ] IPI: Loaded 21297 existing records. [2025-09-25T19:28:35.429207] [DEBUG] [LOCAL ] IPG: Loaded 53331 existing records from primary storage. [2025-09-25T19:28:35.429385] [INFO ] [MAIN ] IPG: Loaded 53331 existing records. [2025-09-25T19:28:35.576301] [DEBUG] [LOCAL ] IP: Loaded 53315 existing records from primary storage. [2025-09-25T19:28:35.604069] [INFO ] [MAIN ] IP: Loaded 53315 existing records. [2025-09-25T19:28:36.024502] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:36.062461] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-25T19:28:36.062551] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-25T19:28:36.112599] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-25T19:28:36.125623] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-25T19:28:36.207527] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:36.214710] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-25T19:28:36.214773] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-25T19:28:36.215165] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-25T19:28:36.215227] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-25T19:28:36.214393] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:36.220917] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-25T19:28:36.220962] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-25T19:28:36.221178] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-25T19:28:36.221236] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-25T19:28:36.391720] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:36.392108] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-25T19:28:36.392168] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-25T19:28:36.392533] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-25T19:28:36.392593] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-25T19:28:37.691434] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:37.707239] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-25T19:28:37.869255] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:37.870078] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-25T19:28:37.895024] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:37.895482] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-25T19:28:37.905949] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:37.906379] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-25T19:28:38.933872] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T19:28:38.938783] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-25T19:28:39.019821] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:28:39.027594] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-25T19:28:39.725424] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T19:28:39.740161] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-25T19:28:39.783917] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T19:28:39.796096] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-25T19:28:39.996032] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T19:28:40.000327] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-25T19:28:40.092881] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T19:28:40.097263] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-25T19:28:40.999080] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T19:28:41.004162] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-25T19:28:41.168708] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T19:28:41.174702] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-25T19:28:41.392508] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T19:28:41.393748] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T19:28:41.419496] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-25T19:28:41.424105] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-25T19:28:41.792618] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T19:28:41.802498] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-25T19:28:42.163475] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:28:42.168905] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-25T19:28:42.917835] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T19:28:42.928265] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-25T19:28:42.985301] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T19:28:42.991864] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-25T19:28:43.233347] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T19:28:43.235384] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T19:28:43.258611] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-25T19:28:43.259144] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-25T19:28:43.873367] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T19:28:43.880896] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-25T19:28:44.071283] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T19:28:44.077530] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-25T19:28:44.753753] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T19:28:44.758036] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-25T19:28:45.059493] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T19:28:45.072017] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-25T19:28:45.149534] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:28:45.210426] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T19:28:45.416112] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T19:28:45.488739] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-25T19:28:46.288696] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-25T19:28:46.543944] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T19:28:46.647712] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T19:28:47.088724] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-25T19:28:47.900207] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-25T19:28:47.931840] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:28:48.175492] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T19:28:48.688782] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-25T19:28:49.039393] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T19:28:49.488806] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-25T19:28:50.288754] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-25T19:28:50.521750] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T19:28:50.875949] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:28:50.881022] [INFO ] [REMOTE ] IPI: Full fetch complete (29194 records). [2025-09-25T19:28:50.881205] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-25T19:28:51.095749] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-25T19:28:51.339288] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-25T19:28:51.339639] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-25T19:28:51.340453] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-25T19:28:51.340530] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-25T19:28:51.341878] [DEBUG] [LOCAL ] IPI: Trimmed 29194 records to 21545 (keeping 200 days of data) [2025-09-25T19:28:51.493068] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T19:28:51.527156] [INFO ] [REMOTE ] IQI: Full fetch complete (27151 records). [2025-09-25T19:28:51.527247] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-25T19:28:51.577984] [DEBUG] [LOCAL ] IPI: Primary data saved (21545 records). [2025-09-25T19:28:51.631733] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-25T19:28:51.644066] [INFO ] [MAIN ] Update Progress: 1121/2372 symbols completed. IPI took 17.2s. Estimated remaining: 2h 46m 4s. Rate: 7.5 symbols/min [2025-09-25T19:28:51.902031] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-25T19:28:52.035444] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:52.174876] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-25T19:28:52.174983] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-25T19:28:52.176117] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-25T19:28:52.176562] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-25T19:28:52.189501] [DEBUG] [LOCAL ] IQI: Trimmed 27151 records to 18062 (keeping 200 days of data) [2025-09-25T19:28:52.298769] [DEBUG] [LOCAL ] IQV: Loaded 50208 existing records from primary storage. [2025-09-25T19:28:52.298936] [INFO ] [MAIN ] IQV: Loaded 50208 existing records. [2025-09-25T19:28:52.382928] [DEBUG] [LOCAL ] IQI: Primary data saved (18062 records). [2025-09-25T19:28:52.383117] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-25T19:28:52.383269] [INFO ] [MAIN ] Update Progress: 1122/2372 symbols completed. IQI took 18.0s. Estimated remaining: 2h 45m 48s. Rate: 7.5 symbols/min [2025-09-25T19:28:52.674507] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:52.680827] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-25T19:28:52.680902] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-25T19:28:52.681299] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-25T19:28:52.681378] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-25T19:28:52.813255] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:28:53.027114] [DEBUG] [LOCAL ] IR: Loaded 52697 existing records from primary storage. [2025-09-25T19:28:53.027370] [INFO ] [MAIN ] IR: Loaded 52697 existing records. [2025-09-25T19:28:53.040559] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T19:28:53.091415] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-25T19:28:53.457011] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:28:53.477881] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:53.478204] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-25T19:28:53.478771] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-25T19:28:53.479198] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-25T19:28:53.479262] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-25T19:28:53.494862] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-25T19:28:53.747488] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T19:28:53.956896] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:28:54.288747] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-25T19:28:54.662183] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T19:28:55.088751] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-25T19:28:55.315720] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T19:28:55.888702] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-25T19:28:56.148440] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T19:28:56.458118] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T19:28:56.688763] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-25T19:28:57.488782] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-25T19:28:57.625041] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T19:28:58.288706] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-25T19:28:58.550443] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T19:28:58.805796] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T19:28:59.088736] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-25T19:28:59.888733] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-25T19:29:00.116238] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T19:29:00.688703] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-25T19:29:00.752923] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:29:01.488746] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-25T19:29:01.620100] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T19:29:01.631365] [INFO ] [REMOTE ] IP: Full fetch complete (77050 records). [2025-09-25T19:29:01.631601] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-25T19:29:02.153921] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-25T19:29:02.154024] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-25T19:29:02.155436] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-25T19:29:02.155507] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-25T19:29:02.157857] [DEBUG] [LOCAL ] IP: Trimmed 77050 records to 53703 (keeping 200 days of data) [2025-09-25T19:29:02.288929] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-25T19:29:02.537526] [DEBUG] [LOCAL ] IP: Primary data saved (53703 records). [2025-09-25T19:29:02.537741] [INFO ] [MAIN ] IP: Full history saved. [2025-09-25T19:29:02.537856] [INFO ] [MAIN ] Update Progress: 1123/2372 symbols completed. IP took 28.1s. Estimated remaining: 2h 45m 43s. Rate: 7.5 symbols/min [2025-09-25T19:29:02.640467] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T19:29:02.668665] [INFO ] [REMOTE ] IPG: Full fetch complete (77249 records). [2025-09-25T19:29:02.668847] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-25T19:29:02.834270] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:03.199745] [DEBUG] [LOCAL ] IRM: Loaded 49460 existing records from primary storage. [2025-09-25T19:29:03.199977] [INFO ] [MAIN ] IRM: Loaded 49460 existing records. [2025-09-25T19:29:03.294839] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T19:29:03.319536] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-25T19:29:03.403313] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-25T19:29:03.423057] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-25T19:29:03.441854] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-25T19:29:03.457722] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-25T19:29:03.536359] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:03.536877] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-25T19:29:03.536932] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-25T19:29:03.537759] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-25T19:29:03.537821] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-25T19:29:03.583897] [DEBUG] [LOCAL ] IPG: Trimmed 77249 records to 53721 (keeping 200 days of data) [2025-09-25T19:29:04.057172] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:04.057498] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-25T19:29:04.201726] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T19:29:04.325173] [DEBUG] [LOCAL ] IPG: Primary data saved (53721 records). [2025-09-25T19:29:04.325375] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-25T19:29:04.327142] [INFO ] [MAIN ] Update Progress: 1124/2372 symbols completed. IPG took 29.9s. Estimated remaining: 2h 45m 28s. Rate: 7.5 symbols/min [2025-09-25T19:29:04.500296] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:04.526579] [DEBUG] [LOCAL ] IRS: Loaded 21830 existing records from primary storage. [2025-09-25T19:29:04.526780] [INFO ] [MAIN ] IRS: Loaded 21830 existing records. [2025-09-25T19:29:04.688753] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-25T19:29:04.715229] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:04.715469] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-25T19:29:04.715514] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-25T19:29:04.716694] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-25T19:29:04.716759] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-25T19:29:05.087832] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:05.170598] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T19:29:05.489222] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-25T19:29:05.999687] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T19:29:06.288840] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-25T19:29:06.386169] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T19:29:06.532335] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T19:29:07.088745] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-25T19:29:07.888789] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-25T19:29:08.095109] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T19:29:08.458871] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:29:08.688745] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-25T19:29:09.129530] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T19:29:09.488836] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-25T19:29:10.288787] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-25T19:29:10.558069] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T19:29:10.563124] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T19:29:11.088838] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-25T19:29:11.888841] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-25T19:29:12.093378] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T19:29:12.360605] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T19:29:12.688830] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-25T19:29:13.467938] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:29:13.488673] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-25T19:29:13.753490] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T19:29:14.288783] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-25T19:29:15.088747] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-25T19:29:15.106054] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:29:15.482031] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T19:29:15.888795] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-25T19:29:16.688768] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-25T19:29:16.949868] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:29:16.997319] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T19:29:17.488868] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-25T19:29:18.232673] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T19:29:18.288756] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-25T19:29:18.879005] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T19:29:19.088803] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-25T19:29:19.888751] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-25T19:29:20.149385] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:29:20.159242] [INFO ] [REMOTE ] IQV: Full fetch complete (72302 records). [2025-09-25T19:29:20.159449] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-25T19:29:20.609282] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-25T19:29:20.609404] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-25T19:29:20.610834] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-25T19:29:20.610948] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-25T19:29:20.612600] [DEBUG] [LOCAL ] IQV: Trimmed 72302 records to 50564 (keeping 200 days of data) [2025-09-25T19:29:20.698748] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-25T19:29:20.837301] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T19:29:21.059114] [DEBUG] [LOCAL ] IQV: Primary data saved (50564 records). [2025-09-25T19:29:21.059314] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-25T19:29:21.059579] [INFO ] [MAIN ] Update Progress: 1125/2372 symbols completed. IQV took 29.4s. Estimated remaining: 2h 45m 29s. Rate: 7.5 symbols/min [2025-09-25T19:29:21.263255] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:21.307336] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T19:29:21.368464] [DEBUG] [LOCAL ] IRT: Loaded 50394 existing records from primary storage. [2025-09-25T19:29:21.368698] [INFO ] [MAIN ] IRT: Loaded 50394 existing records. [2025-09-25T19:29:21.493807] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-25T19:29:21.582215] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:21.586011] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-25T19:29:21.586615] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-25T19:29:21.590152] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-25T19:29:21.590242] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-25T19:29:21.996603] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:22.121446] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T19:29:22.289251] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-25T19:29:23.088753] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-25T19:29:23.137930] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:29:23.888743] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-25T19:29:24.152057] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T19:29:24.195850] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T19:29:24.688713] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-25T19:29:25.488711] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-25T19:29:25.576874] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T19:29:26.210300] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T19:29:26.217462] [INFO ] [REMOTE ] IRS: Full fetch complete (32215 records). [2025-09-25T19:29:26.217618] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-25T19:29:26.295063] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-25T19:29:26.656456] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-25T19:29:26.656613] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-25T19:29:26.658090] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-25T19:29:26.658162] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-25T19:29:26.659376] [DEBUG] [LOCAL ] IRS: Trimmed 32215 records to 21983 (keeping 200 days of data) [2025-09-25T19:29:26.823945] [DEBUG] [LOCAL ] IRS: Primary data saved (21983 records). [2025-09-25T19:29:26.824184] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-25T19:29:26.824378] [INFO ] [MAIN ] Update Progress: 1126/2372 symbols completed. IRS took 22.5s. Estimated remaining: 2h 45m 19s. Rate: 7.5 symbols/min [2025-09-25T19:29:27.001514] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:29:27.081000] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:27.088692] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-25T19:29:27.109673] [DEBUG] [LOCAL ] ISD: Loaded 15572 existing records from primary storage. [2025-09-25T19:29:27.109841] [INFO ] [MAIN ] ISD: Loaded 15572 existing records. [2025-09-25T19:29:27.301459] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:27.303183] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-25T19:29:27.303273] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-25T19:29:27.303559] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-25T19:29:27.303619] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-25T19:29:27.689224] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:27.888730] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-25T19:29:28.018369] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:29:28.688712] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-25T19:29:28.829383] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T19:29:28.839344] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T19:29:28.851396] [INFO ] [REMOTE ] IR: Full fetch complete (76136 records). [2025-09-25T19:29:28.853733] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-25T19:29:29.322795] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-25T19:29:29.322957] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-25T19:29:29.324552] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-25T19:29:29.324666] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-25T19:29:29.326975] [DEBUG] [LOCAL ] IR: Trimmed 76136 records to 53084 (keeping 200 days of data) [2025-09-25T19:29:29.539735] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-25T19:29:29.715988] [DEBUG] [LOCAL ] IR: Primary data saved (53084 records). [2025-09-25T19:29:29.716174] [INFO ] [MAIN ] IR: Full history saved. [2025-09-25T19:29:29.716333] [INFO ] [MAIN ] Update Progress: 1127/2372 symbols completed. IR took 37.3s. Estimated remaining: 2h 45m 6s. Rate: 7.5 symbols/min [2025-09-25T19:29:29.890917] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:29.948458] [DEBUG] [LOCAL ] IT: Loaded 41579 existing records from primary storage. [2025-09-25T19:29:29.948634] [INFO ] [MAIN ] IT: Loaded 41579 existing records. [2025-09-25T19:29:30.136929] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:30.137486] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-25T19:29:30.137551] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-25T19:29:30.138024] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-25T19:29:30.138096] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-25T19:29:30.289755] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-25T19:29:30.302478] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:29:30.492011] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T19:29:30.603563] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:31.088734] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-25T19:29:31.888745] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-25T19:29:32.027117] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T19:29:32.688719] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-25T19:29:32.773154] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T19:29:32.834155] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T19:29:33.488750] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-25T19:29:34.288704] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-25T19:29:34.411352] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:29:34.449421] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T19:29:35.088764] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-25T19:29:35.653603] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T19:29:35.888766] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-25T19:29:36.139802] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T19:29:36.688756] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-25T19:29:37.242736] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T19:29:37.488682] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-25T19:29:38.288717] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-25T19:29:38.462492] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:29:38.897039] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T19:29:39.088706] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-25T19:29:39.785660] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T19:29:39.888696] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-25T19:29:40.598940] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:29:40.688682] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-25T19:29:41.488777] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-25T19:29:41.531694] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:29:42.288764] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-25T19:29:42.699286] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T19:29:42.713995] [INFO ] [REMOTE ] IRM: Full fetch complete (72254 records). [2025-09-25T19:29:42.714253] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-25T19:29:43.094750] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-25T19:29:43.180260] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-25T19:29:43.180501] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-25T19:29:43.181832] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-25T19:29:43.181973] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-25T19:29:43.184190] [DEBUG] [LOCAL ] IRM: Trimmed 72254 records to 49808 (keeping 200 days of data) [2025-09-25T19:29:43.229028] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:29:43.641621] [DEBUG] [LOCAL ] IRM: Primary data saved (49808 records). [2025-09-25T19:29:43.641937] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-25T19:29:43.642200] [INFO ] [MAIN ] Update Progress: 1128/2372 symbols completed. IRM took 41.1s. Estimated remaining: 2h 45m 4s. Rate: 7.5 symbols/min [2025-09-25T19:29:43.830888] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:43.879461] [DEBUG] [LOCAL ] ITGR: Loaded 31524 existing records from primary storage. [2025-09-25T19:29:43.879635] [INFO ] [MAIN ] ITGR: Loaded 31524 existing records. [2025-09-25T19:29:43.894412] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-25T19:29:44.001256] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:29:44.154754] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:44.155071] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-25T19:29:44.155121] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-25T19:29:44.155556] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-25T19:29:44.155637] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-25T19:29:44.276144] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T19:29:44.570557] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:44.688755] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-25T19:29:45.402319] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T19:29:45.488676] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-25T19:29:46.288978] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-25T19:29:46.476070] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T19:29:47.072973] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:29:47.088675] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-25T19:29:47.298323] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T19:29:47.888843] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-25T19:29:48.548413] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T19:29:48.688700] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-25T19:29:49.488720] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-25T19:29:49.736551] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T19:29:49.759833] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T19:29:50.288841] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-25T19:29:51.008516] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T19:29:51.088725] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-25T19:29:51.222690] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T19:29:51.888732] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-25T19:29:52.203078] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:29:52.688781] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-25T19:29:53.488785] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-25T19:29:53.781902] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T19:29:53.795494] [INFO ] [REMOTE ] IT: Full fetch complete (55469 records). [2025-09-25T19:29:53.795732] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-25T19:29:54.244795] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-25T19:29:54.244929] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-25T19:29:54.246341] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-25T19:29:54.246449] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-25T19:29:54.250523] [DEBUG] [LOCAL ] IT: Trimmed 55469 records to 41941 (keeping 200 days of data) [2025-09-25T19:29:54.319713] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-25T19:29:54.429018] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T19:29:54.657180] [DEBUG] [LOCAL ] IT: Primary data saved (41941 records). [2025-09-25T19:29:54.657358] [INFO ] [MAIN ] IT: Full history saved. [2025-09-25T19:29:54.657587] [INFO ] [MAIN ] Update Progress: 1129/2372 symbols completed. IT took 24.9s. Estimated remaining: 2h 44m 60s. Rate: 7.5 symbols/min [2025-09-25T19:29:54.843216] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:54.879129] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T19:29:54.920409] [DEBUG] [LOCAL ] ITT: Loaded 33096 existing records from primary storage. [2025-09-25T19:29:54.920661] [INFO ] [MAIN ] ITT: Loaded 33096 existing records. [2025-09-25T19:29:55.089574] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-25T19:29:55.118248] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:55.118606] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-25T19:29:55.118722] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-25T19:29:55.119244] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-25T19:29:55.119334] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-25T19:29:55.155456] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T19:29:55.159696] [INFO ] [REMOTE ] ISD: Full fetch complete (23869 records). [2025-09-25T19:29:55.159822] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-25T19:29:55.907328] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-25T19:29:55.986750] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-25T19:29:55.986870] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-25T19:29:55.988042] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-25T19:29:55.988122] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-25T19:29:55.997838] [DEBUG] [LOCAL ] ISD: Trimmed 23869 records to 15685 (keeping 200 days of data) [2025-09-25T19:29:55.997528] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:56.115997] [DEBUG] [LOCAL ] ISD: Primary data saved (15685 records). [2025-09-25T19:29:56.116190] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-25T19:29:56.116343] [INFO ] [MAIN ] Update Progress: 1130/2372 symbols completed. ISD took 29.3s. Estimated remaining: 2h 44m 44s. Rate: 7.5 symbols/min [2025-09-25T19:29:56.298714] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:56.336924] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T19:29:56.401464] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-25T19:29:56.401661] [INFO ] [MAIN ] ITUB: Loaded 53304 existing records. [2025-09-25T19:29:56.581346] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:56.581608] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-25T19:29:56.582512] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-25T19:29:56.582861] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-25T19:29:56.582920] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-25T19:29:56.694777] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-25T19:29:56.957970] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:57.488742] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-25T19:29:57.762018] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T19:29:57.772761] [INFO ] [REMOTE ] IRT: Full fetch complete (72420 records). [2025-09-25T19:29:57.772927] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-25T19:29:58.045919] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T19:29:58.204226] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-25T19:29:58.204333] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-25T19:29:58.205896] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-25T19:29:58.205971] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-25T19:29:58.209068] [DEBUG] [LOCAL ] IRT: Trimmed 72420 records to 50769 (keeping 200 days of data) [2025-09-25T19:29:58.295506] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-25T19:29:58.509424] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T19:29:58.607749] [DEBUG] [LOCAL ] IRT: Primary data saved (50769 records). [2025-09-25T19:29:58.607925] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-25T19:29:58.608067] [INFO ] [MAIN ] Update Progress: 1131/2372 symbols completed. IRT took 37.5s. Estimated remaining: 2h 44m 30s. Rate: 7.5 symbols/min [2025-09-25T19:29:58.778989] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:29:58.835025] [DEBUG] [LOCAL ] ITW: Loaded 46224 existing records from primary storage. [2025-09-25T19:29:58.835198] [INFO ] [MAIN ] ITW: Loaded 46224 existing records. [2025-09-25T19:29:59.016729] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:29:59.017124] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-25T19:29:59.017187] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-25T19:29:59.017459] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-25T19:29:59.017517] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-25T19:29:59.089836] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-25T19:29:59.395887] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:29:59.888725] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-25T19:30:00.132534] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T19:30:00.632020] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T19:30:00.688691] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-25T19:30:01.224578] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T19:30:01.488792] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-25T19:30:02.169299] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T19:30:02.288762] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-25T19:30:03.088766] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-25T19:30:03.420540] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T19:30:03.600299] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T19:30:03.888764] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-25T19:30:04.598494] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:30:04.688744] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-25T19:30:05.488757] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-25T19:30:05.674901] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T19:30:06.230784] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:30:06.288689] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-25T19:30:06.443052] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T19:30:07.088785] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-25T19:30:07.888716] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-25T19:30:08.049950] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T19:30:08.688750] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-25T19:30:08.923000] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T19:30:09.200004] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T19:30:09.488675] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-25T19:30:10.288716] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-25T19:30:10.333005] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T19:30:11.088739] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-25T19:30:11.518702] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T19:30:11.568928] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T19:30:11.888727] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-25T19:30:12.420243] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T19:30:12.688733] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-25T19:30:13.488752] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-25T19:30:13.636613] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T19:30:14.013430] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T19:30:14.288711] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-25T19:30:15.088810] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-25T19:30:15.371172] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T19:30:15.888744] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-25T19:30:15.968350] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T19:30:16.045814] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T19:30:16.688808] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-25T19:30:17.425492] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:30:17.488725] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-25T19:30:18.138765] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T19:30:18.288795] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-25T19:30:19.088749] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-25T19:30:19.303265] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T19:30:19.731534] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T19:30:19.738612] [INFO ] [REMOTE ] ITT: Full fetch complete (46902 records). [2025-09-25T19:30:19.738978] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-25T19:30:19.891298] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-25T19:30:20.207334] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-25T19:30:20.207466] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-25T19:30:20.208466] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-25T19:30:20.208605] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-25T19:30:20.210845] [DEBUG] [LOCAL ] ITT: Trimmed 46902 records to 33310 (keeping 200 days of data) [2025-09-25T19:30:20.453247] [DEBUG] [LOCAL ] ITT: Primary data saved (33310 records). [2025-09-25T19:30:20.453455] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-25T19:30:20.453747] [INFO ] [MAIN ] Update Progress: 1132/2372 symbols completed. ITT took 25.8s. Estimated remaining: 2h 44m 38s. Rate: 7.5 symbols/min [2025-09-25T19:30:20.585262] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T19:30:20.672499] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:20.688697] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-25T19:30:20.741907] [DEBUG] [LOCAL ] IVR: Loaded 47862 existing records from primary storage. [2025-09-25T19:30:20.742118] [INFO ] [MAIN ] IVR: Loaded 47862 existing records. [2025-09-25T19:30:20.931077] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:20.931474] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-25T19:30:20.931534] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-25T19:30:20.934222] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-25T19:30:20.934316] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-25T19:30:21.350687] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:21.493873] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-25T19:30:21.536305] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T19:30:21.927181] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T19:30:21.937135] [INFO ] [REMOTE ] ITGR: Full fetch complete (41457 records). [2025-09-25T19:30:21.937293] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-25T19:30:22.290369] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-25T19:30:22.405568] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-25T19:30:22.405708] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-25T19:30:22.406796] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-25T19:30:22.406873] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-25T19:30:22.408167] [DEBUG] [LOCAL ] ITGR: Trimmed 41457 records to 31817 (keeping 200 days of data) [2025-09-25T19:30:22.660552] [DEBUG] [LOCAL ] ITGR: Primary data saved (31817 records). [2025-09-25T19:30:22.660779] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-25T19:30:22.660980] [INFO ] [MAIN ] Update Progress: 1133/2372 symbols completed. ITGR took 39.0s. Estimated remaining: 2h 44m 23s. Rate: 7.5 symbols/min [2025-09-25T19:30:22.875460] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:22.917890] [DEBUG] [LOCAL ] IVT: Loaded 30919 existing records from primary storage. [2025-09-25T19:30:22.918075] [INFO ] [MAIN ] IVT: Loaded 30919 existing records. [2025-09-25T19:30:23.101951] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-25T19:30:23.110334] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:23.111394] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-25T19:30:23.111449] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-25T19:30:23.111862] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-25T19:30:23.111929] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-25T19:30:23.317197] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T19:30:23.587175] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:23.888708] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-25T19:30:24.149844] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T19:30:24.688713] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-25T19:30:24.809633] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:30:25.465778] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T19:30:25.488777] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-25T19:30:26.288704] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-25T19:30:26.633928] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T19:30:27.088710] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-25T19:30:27.206009] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T19:30:27.454817] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T19:30:27.888755] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-25T19:30:28.688755] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-25T19:30:28.803167] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:30:29.489708] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-25T19:30:29.674773] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T19:30:29.684918] [INFO ] [REMOTE ] ITW: Full fetch complete (66491 records). [2025-09-25T19:30:29.685134] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-25T19:30:29.936281] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T19:30:30.183479] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-25T19:30:30.183598] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-25T19:30:30.184811] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-25T19:30:30.184883] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-25T19:30:30.186747] [DEBUG] [LOCAL ] ITW: Trimmed 66491 records to 46541 (keeping 200 days of data) [2025-09-25T19:30:30.294423] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-25T19:30:30.514669] [DEBUG] [LOCAL ] ITW: Primary data saved (46541 records). [2025-09-25T19:30:30.514902] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-25T19:30:30.517006] [INFO ] [MAIN ] Update Progress: 1134/2372 symbols completed. ITW took 31.9s. Estimated remaining: 2h 44m 15s. Rate: 7.5 symbols/min [2025-09-25T19:30:30.709529] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:30.790247] [DEBUG] [LOCAL ] IVZ: Loaded 53136 existing records from primary storage. [2025-09-25T19:30:30.790521] [INFO ] [MAIN ] IVZ: Loaded 53136 existing records. [2025-09-25T19:30:31.001968] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:31.002531] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-25T19:30:31.002615] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-25T19:30:31.003200] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-25T19:30:31.003282] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-25T19:30:31.093777] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-25T19:30:31.389585] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T19:30:31.445763] [INFO ] [REMOTE ] ITUB: Full fetch complete (77163 records). [2025-09-25T19:30:31.446086] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-25T19:30:31.536935] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:31.894758] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-25T19:30:31.957867] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-25T19:30:31.957977] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-25T19:30:31.959208] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-25T19:30:31.959279] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-25T19:30:31.961292] [DEBUG] [LOCAL ] ITUB: Trimmed 77163 records to 53694 (keeping 200 days of data) [2025-09-25T19:30:32.244313] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T19:30:32.384855] [DEBUG] [LOCAL ] ITUB: Primary data saved (53694 records). [2025-09-25T19:30:32.385078] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-25T19:30:32.386352] [INFO ] [MAIN ] Update Progress: 1135/2372 symbols completed. ITUB took 36.3s. Estimated remaining: 2h 44m 1s. Rate: 7.5 symbols/min [2025-09-25T19:30:32.472292] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T19:30:32.612508] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:32.645305] [DEBUG] [LOCAL ] IX: Loaded 22617 existing records from primary storage. [2025-09-25T19:30:32.645452] [INFO ] [MAIN ] IX: Loaded 22617 existing records. [2025-09-25T19:30:32.689902] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-25T19:30:32.830888] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:32.831264] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-25T19:30:32.831312] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-25T19:30:32.831587] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-25T19:30:32.831678] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-25T19:30:33.188797] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:33.488726] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-25T19:30:33.737544] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T19:30:34.263537] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T19:30:34.288676] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-25T19:30:34.523118] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:30:35.088733] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-25T19:30:35.153796] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T19:30:35.888733] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-25T19:30:36.688715] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-25T19:30:36.734215] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T19:30:36.828448] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T19:30:37.488742] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-25T19:30:38.025580] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T19:30:38.288721] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-25T19:30:39.088758] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-25T19:30:39.203010] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T19:30:39.250820] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T19:30:39.888740] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-25T19:30:40.128206] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T19:30:40.688747] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-25T19:30:41.169297] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T19:30:41.488745] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-25T19:30:42.288730] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-25T19:30:42.568549] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T19:30:42.820226] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T19:30:43.088723] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-25T19:30:43.215345] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T19:30:43.888718] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-25T19:30:44.688717] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-25T19:30:44.968815] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T19:30:44.990818] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:30:45.488746] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-25T19:30:46.010850] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T19:30:46.288733] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-25T19:30:46.786891] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T19:30:47.088763] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-25T19:30:47.530976] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T19:30:47.793893] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T19:30:47.888731] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-25T19:30:48.688819] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-25T19:30:49.086733] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T19:30:49.094757] [INFO ] [REMOTE ] IX: Full fetch complete (27013 records). [2025-09-25T19:30:49.095022] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-25T19:30:49.493848] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-25T19:30:49.533560] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-25T19:30:49.533968] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-25T19:30:49.535031] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-25T19:30:49.535144] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-25T19:30:49.536761] [DEBUG] [LOCAL ] IX: Trimmed 27013 records to 22798 (keeping 200 days of data) [2025-09-25T19:30:49.696167] [DEBUG] [LOCAL ] IX: Primary data saved (22798 records). [2025-09-25T19:30:49.696346] [INFO ] [MAIN ] IX: Full history saved. [2025-09-25T19:30:49.696511] [INFO ] [MAIN ] Update Progress: 1136/2372 symbols completed. IX took 17.3s. Estimated remaining: 2h 44m 3s. Rate: 7.5 symbols/min [2025-09-25T19:30:49.877279] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:49.953686] [DEBUG] [LOCAL ] J: Loaded 40350 existing records from primary storage. [2025-09-25T19:30:49.953870] [INFO ] [MAIN ] J: Loaded 40350 existing records. [2025-09-25T19:30:50.137784] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:30:50.189118] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:50.189913] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-25T19:30:50.189971] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-25T19:30:50.190500] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-25T19:30:50.190572] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-25T19:30:50.292044] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-25T19:30:50.555837] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:51.088736] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-25T19:30:51.370611] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T19:30:51.888741] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-25T19:30:51.997185] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:30:52.688706] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-25T19:30:52.729793] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T19:30:53.488762] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-25T19:30:53.596691] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T19:30:54.288706] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-25T19:30:54.460950] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T19:30:55.088711] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-25T19:30:55.377829] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T19:30:55.888896] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-25T19:30:56.223411] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T19:30:56.500177] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T19:30:56.518738] [INFO ] [REMOTE ] IVT: Full fetch complete (45590 records). [2025-09-25T19:30:56.519053] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-25T19:30:56.703755] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-25T19:30:56.983716] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-25T19:30:56.983833] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-25T19:30:56.985053] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-25T19:30:56.985129] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-25T19:30:56.987182] [DEBUG] [LOCAL ] IVT: Trimmed 45590 records to 31117 (keeping 200 days of data) [2025-09-25T19:30:57.213162] [DEBUG] [LOCAL ] IVT: Primary data saved (31117 records). [2025-09-25T19:30:57.213347] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-25T19:30:57.213513] [INFO ] [MAIN ] Update Progress: 1137/2372 symbols completed. IVT took 34.6s. Estimated remaining: 2h 43m 55s. Rate: 7.5 symbols/min [2025-09-25T19:30:57.427711] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:30:57.481147] [DEBUG] [LOCAL ] JBGS: Loaded 42470 existing records from primary storage. [2025-09-25T19:30:57.481407] [INFO ] [MAIN ] JBGS: Loaded 42470 existing records. [2025-09-25T19:30:57.495754] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-25T19:30:57.607260] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:30:57.830302] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:30:57.830700] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-25T19:30:57.830756] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-25T19:30:57.831159] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-25T19:30:57.831218] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-25T19:30:58.211454] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:30:58.242763] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:30:58.288675] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-25T19:30:59.088696] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-25T19:30:59.165733] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T19:30:59.734120] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T19:30:59.888685] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-25T19:31:00.688704] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-25T19:31:01.211393] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-25T19:31:01.488761] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-25T19:31:01.752349] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:31:01.767305] [INFO ] [REMOTE ] IVR: Full fetch complete (69004 records). [2025-09-25T19:31:01.767470] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-25T19:31:02.201084] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-25T19:31:02.201196] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-25T19:31:02.202565] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-25T19:31:02.202635] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-25T19:31:02.204359] [DEBUG] [LOCAL ] IVR: Trimmed 69004 records to 48228 (keeping 200 days of data) [2025-09-25T19:31:02.310939] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-25T19:31:02.486213] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T19:31:02.579755] [DEBUG] [LOCAL ] IVR: Primary data saved (48228 records). [2025-09-25T19:31:02.579961] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-25T19:31:02.580132] [INFO ] [MAIN ] Update Progress: 1138/2372 symbols completed. IVR took 42.1s. Estimated remaining: 2h 43m 44s. Rate: 7.5 symbols/min [2025-09-25T19:31:02.760475] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:02.818484] [DEBUG] [LOCAL ] JBI: Loaded 43886 existing records from primary storage. [2025-09-25T19:31:02.818672] [INFO ] [MAIN ] JBI: Loaded 43886 existing records. [2025-09-25T19:31:03.003079] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:31:03.005584] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-25T19:31:03.005662] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-25T19:31:03.005965] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-25T19:31:03.006041] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-25T19:31:03.103871] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-25T19:31:03.394980] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:03.444220] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:31:03.469188] [INFO ] [REMOTE ] IVZ: Full fetch complete (76759 records). [2025-09-25T19:31:03.469435] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-25T19:31:03.905807] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-25T19:31:03.905935] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-25T19:31:03.907199] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-25T19:31:03.907398] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-25T19:31:03.901730] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-25T19:31:03.923863] [DEBUG] [LOCAL ] IVZ: Trimmed 76759 records to 53522 (keeping 200 days of data) [2025-09-25T19:31:03.941458] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T19:31:04.325241] [DEBUG] [LOCAL ] IVZ: Primary data saved (53522 records). [2025-09-25T19:31:04.325491] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-25T19:31:04.328483] [INFO ] [MAIN ] Update Progress: 1139/2372 symbols completed. IVZ took 33.8s. Estimated remaining: 2h 43m 29s. Rate: 7.5 symbols/min [2025-09-25T19:31:04.523058] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:04.623275] [DEBUG] [LOCAL ] JBL: Loaded 48383 existing records from primary storage. [2025-09-25T19:31:04.623491] [INFO ] [MAIN ] JBL: Loaded 48383 existing records. [2025-09-25T19:31:04.697757] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-25T19:31:04.825672] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:31:04.826457] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-25T19:31:04.826582] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-25T19:31:04.827089] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-25T19:31:04.827154] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-25T19:31:04.916862] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T19:31:05.318297] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:05.348377] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T19:31:05.488729] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-25T19:31:06.279948] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:31:06.288676] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-25T19:31:06.710005] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T19:31:07.088769] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-25T19:31:07.815104] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T19:31:07.888783] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-25T19:31:08.390233] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T19:31:08.688748] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-25T19:31:09.223559] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T19:31:09.488741] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-25T19:31:10.211341] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T19:31:10.288748] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-25T19:31:11.027353] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:31:11.088672] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-25T19:31:11.888720] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-25T19:31:12.191662] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T19:31:12.592155] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:31:12.688749] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-25T19:31:13.488701] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-25T19:31:13.521006] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T19:31:14.288735] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-25T19:31:14.539035] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T19:31:15.064611] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T19:31:15.088681] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-25T19:31:15.831785] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T19:31:15.888745] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-25T19:31:16.688741] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-25T19:31:16.898443] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T19:31:17.488746] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-25T19:31:17.586898] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T19:31:18.060356] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T19:31:18.288746] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-25T19:31:19.031966] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:31:19.088700] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-25T19:31:19.888754] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-25T19:31:19.927602] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:31:20.688810] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-25T19:31:20.907415] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T19:31:21.140714] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T19:31:21.488730] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-25T19:31:22.251006] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:31:22.261605] [INFO ] [REMOTE ] JBGS: Full fetch complete (59050 records). [2025-09-25T19:31:22.261800] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-25T19:31:22.296806] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-25T19:31:22.701484] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T19:31:22.744351] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-25T19:31:22.744472] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-25T19:31:22.745697] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-25T19:31:22.745776] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-25T19:31:22.747833] [DEBUG] [LOCAL ] JBGS: Trimmed 59050 records to 42776 (keeping 200 days of data) [2025-09-25T19:31:23.021006] [DEBUG] [LOCAL ] JBGS: Primary data saved (42776 records). [2025-09-25T19:31:23.021170] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-25T19:31:23.021296] [INFO ] [MAIN ] Update Progress: 1140/2372 symbols completed. JBGS took 25.8s. Estimated remaining: 2h 43m 33s. Rate: 7.5 symbols/min [2025-09-25T19:31:23.099786] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-25T19:31:23.248294] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:23.278417] [DEBUG] [LOCAL ] JBND: Loaded 25512 existing records from primary storage. [2025-09-25T19:31:23.278589] [INFO ] [MAIN ] JBND: Loaded 25512 existing records. [2025-09-25T19:31:23.470945] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:31:23.471394] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-25T19:31:23.471508] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-25T19:31:23.471882] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-25T19:31:23.471944] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-25T19:31:23.853343] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:23.888668] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-25T19:31:24.005718] [DEBUG] [REMOTE ] JBND: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-25T19:31:24.006179] [WARN ] [REMOTE ] JBND: No data returned for month 2024-12 [2025-09-25T19:31:24.083807] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T19:31:24.163464] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:31:24.688742] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-25T19:31:25.488937] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-25T19:31:26.288705] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-25T19:31:26.592960] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T19:31:27.088695] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-25T19:31:27.157269] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T19:31:27.173244] [INFO ] [REMOTE ] J: Full fetch complete (59155 records). [2025-09-25T19:31:27.173398] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-25T19:31:27.622288] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-25T19:31:27.622418] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-25T19:31:27.623693] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-25T19:31:27.623770] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-25T19:31:27.633366] [DEBUG] [LOCAL ] J: Trimmed 59155 records to 40657 (keeping 200 days of data) [2025-09-25T19:31:27.891665] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-25T19:31:27.904324] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:31:27.993572] [DEBUG] [LOCAL ] J: Primary data saved (40657 records). [2025-09-25T19:31:27.993849] [INFO ] [MAIN ] J: Full history saved. [2025-09-25T19:31:27.994060] [INFO ] [MAIN ] Update Progress: 1141/2372 symbols completed. J took 38.3s. Estimated remaining: 2h 43m 22s. Rate: 7.5 symbols/min [2025-09-25T19:31:28.211865] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:28.212180] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-25T19:31:28.212263] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-25T19:31:28.213259] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-25T19:31:28.213318] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-25T19:31:28.213387] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-25T19:31:28.214019] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-25T19:31:28.613292] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:28.643698] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T19:31:28.688680] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-25T19:31:28.885757] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T19:31:28.890759] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:28.891325] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-25T19:31:29.488757] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-25T19:31:30.288829] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-25T19:31:31.088821] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-25T19:31:31.259609] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T19:31:31.320541] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T19:31:31.888776] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-25T19:31:32.095318] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:32.095896] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-25T19:31:32.596934] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:31:32.688669] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-25T19:31:33.488816] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-25T19:31:33.709095] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:33.709468] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-25T19:31:34.024836] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T19:31:34.032766] [INFO ] [REMOTE ] JBI: Full fetch complete (64506 records). [2025-09-25T19:31:34.032976] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-25T19:31:34.297787] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-25T19:31:34.451335] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-25T19:31:34.451429] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-25T19:31:34.452802] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-25T19:31:34.452908] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-25T19:31:34.454445] [DEBUG] [LOCAL ] JBI: Trimmed 64506 records to 44143 (keeping 200 days of data) [2025-09-25T19:31:34.775867] [DEBUG] [LOCAL ] JBI: Primary data saved (44143 records). [2025-09-25T19:31:34.776062] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-25T19:31:34.776318] [INFO ] [MAIN ] Update Progress: 1142/2372 symbols completed. JBI took 32.2s. Estimated remaining: 2h 43m 12s. Rate: 7.5 symbols/min [2025-09-25T19:31:34.950312] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:34.950506] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-25T19:31:34.950543] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-25T19:31:34.951541] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-25T19:31:34.951596] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-25T19:31:34.951639] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-25T19:31:34.951736] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-25T19:31:35.093913] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-25T19:31:35.318039] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:35.888800] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-25T19:31:36.090314] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:36.090733] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-25T19:31:36.214846] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T19:31:36.333508] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T19:31:36.343555] [INFO ] [REMOTE ] JBL: Full fetch complete (70069 records). [2025-09-25T19:31:36.343711] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-25T19:31:36.694321] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-25T19:31:36.754261] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-25T19:31:36.754395] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-25T19:31:36.755997] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-25T19:31:36.756065] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-25T19:31:36.761229] [DEBUG] [LOCAL ] JBL: Trimmed 70069 records to 48770 (keeping 200 days of data) [2025-09-25T19:31:37.093329] [DEBUG] [LOCAL ] JBL: Primary data saved (48770 records). [2025-09-25T19:31:37.093487] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-25T19:31:37.094939] [INFO ] [MAIN ] Update Progress: 1143/2372 symbols completed. JBL took 32.8s. Estimated remaining: 2h 42m 58s. Rate: 7.5 symbols/min [2025-09-25T19:31:37.265245] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:37.286320] [DEBUG] [LOCAL ] JCE: Loaded 6457 existing records from primary storage. [2025-09-25T19:31:37.286493] [INFO ] [MAIN ] JCE: Loaded 6457 existing records. [2025-09-25T19:31:37.474481] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:31:37.474994] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-25T19:31:37.475064] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-25T19:31:37.475472] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-25T19:31:37.475530] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-25T19:31:37.497741] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-25T19:31:37.863990] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:37.992543] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T19:31:38.288769] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-25T19:31:38.669290] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T19:31:38.797157] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-25T19:31:39.088850] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-25T19:31:39.888828] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-25T19:31:40.090944] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:40.091614] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-25T19:31:40.368381] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T19:31:40.688792] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-25T19:31:40.886316] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:40.886741] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-25T19:31:41.488755] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-25T19:31:42.288791] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-25T19:31:42.791210] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T19:31:43.062438] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T19:31:43.088739] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-25T19:31:43.888720] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-25T19:31:44.547249] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T19:31:44.688745] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-25T19:31:45.040847] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:31:45.488742] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-25T19:31:46.074284] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:31:46.074746] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-25T19:31:46.106218] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T19:31:46.288777] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-25T19:31:47.088713] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-25T19:31:47.636667] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:31:47.888667] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-25T19:31:48.239316] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T19:31:48.688687] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-25T19:31:49.373740] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:31:49.488698] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-25T19:31:49.799033] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T19:31:50.069811] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T19:31:50.288700] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-25T19:31:50.873735] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T19:31:51.088743] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-25T19:31:51.888714] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-25T19:31:52.688688] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-25T19:31:52.868472] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T19:31:53.147256] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T19:31:53.413480] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T19:31:53.488748] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-25T19:31:54.080699] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T19:31:54.288773] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-25T19:31:55.088741] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-25T19:31:55.730141] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T19:31:55.888674] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-25T19:31:55.930822] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T19:31:56.688957] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-25T19:31:57.334180] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T19:31:57.342571] [INFO ] [REMOTE ] JBTM: Full fetch complete (42242 records). [2025-09-25T19:31:57.342712] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-25T19:31:57.493799] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-25T19:31:57.572625] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-25T19:31:57.573221] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:31:57.573307] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:31:57.573393] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-25T19:31:57.573552] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-25T19:31:57.573631] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-25T19:31:57.573739] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-25T19:31:57.573866] [INFO ] [MAIN ] Update Progress: 1144/2372 symbols completed. JBTM took 22.8s. Estimated remaining: 2h 43m 4s. Rate: 7.5 symbols/min [2025-09-25T19:31:57.749802] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:31:57.829252] [DEBUG] [LOCAL ] JCI: Loaded 53547 existing records from primary storage. [2025-09-25T19:31:57.829422] [INFO ] [MAIN ] JCI: Loaded 53547 existing records. [2025-09-25T19:31:58.011261] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:31:58.011588] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-25T19:31:58.011810] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-25T19:31:58.012325] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-25T19:31:58.012394] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-25T19:31:58.299094] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-25T19:31:58.389222] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T19:31:58.423694] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:31:58.768045] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-25T19:31:59.088737] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-25T19:31:59.429504] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T19:31:59.626056] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T19:31:59.888750] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-25T19:32:00.688763] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-25T19:32:00.762554] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T19:32:00.767856] [INFO ] [REMOTE ] JCE: Full fetch complete (9087 records). [2025-09-25T19:32:00.767972] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-25T19:32:01.153636] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-25T19:32:01.153794] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-25T19:32:01.154093] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-25T19:32:01.154189] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-25T19:32:01.154686] [DEBUG] [LOCAL ] JCE: Trimmed 9087 records to 6504 (keeping 200 days of data) [2025-09-25T19:32:01.207593] [DEBUG] [LOCAL ] JCE: Primary data saved (6504 records). [2025-09-25T19:32:01.208390] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-25T19:32:01.208518] [INFO ] [MAIN ] Update Progress: 1145/2372 symbols completed. JCE took 24.1s. Estimated remaining: 2h 42m 51s. Rate: 7.5 symbols/min [2025-09-25T19:32:01.400411] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:01.477803] [DEBUG] [LOCAL ] JEF: Loaded 49996 existing records from primary storage. [2025-09-25T19:32:01.478033] [INFO ] [MAIN ] JEF: Loaded 49996 existing records. [2025-09-25T19:32:01.495794] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-25T19:32:01.698167] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:01.698622] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-25T19:32:01.698706] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-25T19:32:01.699168] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-25T19:32:01.699243] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-25T19:32:02.111989] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:02.288745] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-25T19:32:02.698493] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T19:32:02.710807] [INFO ] [REMOTE ] JBS: Full fetch complete (27137 records). [2025-09-25T19:32:02.711024] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-25T19:32:02.956184] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T19:32:02.966250] [INFO ] [REMOTE ] JBND: Full fetch complete (31521 records). [2025-09-25T19:32:02.966370] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-25T19:32:03.108746] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-25T19:32:03.160758] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-25T19:32:03.161174] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:32:03.161218] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:32:03.161259] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-25T19:32:03.161323] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-25T19:32:03.161360] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-25T19:32:03.161398] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-25T19:32:03.161466] [INFO ] [MAIN ] Update Progress: 1146/2372 symbols completed. JBS took 35.2s. Estimated remaining: 2h 42m 37s. Rate: 7.5 symbols/min [2025-09-25T19:32:03.496406] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:03.497732] [WARN ] [VALIDATOR ] JBND: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T19:32:03.498946] [FATAL] [MAIN ] JBND: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:32:03.499050] [WARN ] [MAIN ] JBND: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:32:03.499143] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-25T19:32:03.499280] [DEBUG] [LOCAL ] JBND: No primary data file found to delete. [2025-09-25T19:32:03.499367] [INFO ] [LOCAL ] JBND: Starting deletion of derivative data. [2025-09-25T19:32:03.500125] [DEBUG] [LOCAL ] JBND: Deleted derivative data file. [2025-09-25T19:32:03.500294] [INFO ] [MAIN ] Update Progress: 1147/2372 symbols completed. JBND took 40.5s. Estimated remaining: 2h 42m 21s. Rate: 7.5 symbols/min [2025-09-25T19:32:03.700104] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:03.750044] [DEBUG] [LOCAL ] JELD: Loaded 46167 existing records from primary storage. [2025-09-25T19:32:03.750228] [INFO ] [MAIN ] JELD: Loaded 46167 existing records. [2025-09-25T19:32:03.755901] [DEBUG] [LOCAL ] JEQ: Loaded 9156 existing records from primary storage. [2025-09-25T19:32:03.755992] [INFO ] [MAIN ] JEQ: Loaded 9156 existing records. [2025-09-25T19:32:04.173455] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:04.174059] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-25T19:32:04.174228] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-25T19:32:04.174537] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-25T19:32:04.174602] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-25T19:32:04.258200] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:04.258490] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-25T19:32:04.258538] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-25T19:32:04.258837] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-25T19:32:04.258903] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-25T19:32:04.301750] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T19:32:04.401302] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-25T19:32:04.957514] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T19:32:04.996862] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-25T19:32:05.124795] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:05.186914] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:05.488754] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-25T19:32:06.038051] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T19:32:06.043105] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:32:06.288700] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-25T19:32:06.444865] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:32:07.088789] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-25T19:32:07.888705] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-25T19:32:08.059776] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T19:32:08.688714] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-25T19:32:08.814691] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T19:32:08.913363] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:32:09.488764] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-25T19:32:10.288716] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-25T19:32:10.645832] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T19:32:11.059026] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T19:32:11.088696] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-25T19:32:11.491214] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T19:32:11.888722] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-25T19:32:12.644381] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T19:32:12.688672] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-25T19:32:13.493859] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-25T19:32:13.528177] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:32:14.031061] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T19:32:14.288743] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-25T19:32:15.031169] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T19:32:15.088700] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-25T19:32:15.888696] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-25T19:32:16.050629] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T19:32:16.538067] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T19:32:16.688740] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-25T19:32:17.488692] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-25T19:32:17.552699] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:32:18.170531] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-25T19:32:18.288736] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-25T19:32:19.088730] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-25T19:32:19.854319] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T19:32:19.889704] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T19:32:19.899681] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-25T19:32:20.688730] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-25T19:32:20.703221] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T19:32:20.915864] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (4.23 seconds). [2025-09-25T19:32:21.488721] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-25T19:32:22.288739] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-25T19:32:22.491079] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T19:32:22.885051] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T19:32:23.021223] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T19:32:23.088742] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-25T19:32:23.888733] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-25T19:32:24.688688] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-25T19:32:25.331998] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T19:32:25.488769] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-25T19:32:25.663009] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:32:26.288768] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-25T19:32:26.334842] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-09-25T19:32:26.537296] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T19:32:27.088726] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-25T19:32:27.787194] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:32:27.888689] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-25T19:32:28.688708] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-25T19:32:28.944299] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:32:28.957622] [INFO ] [REMOTE ] JEF: Full fetch complete (72858 records). [2025-09-25T19:32:28.957877] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-25T19:32:29.456427] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-25T19:32:29.458694] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-25T19:32:29.460280] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-25T19:32:29.460349] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-25T19:32:29.462115] [DEBUG] [LOCAL ] JEF: Trimmed 72858 records to 50382 (keeping 200 days of data) [2025-09-25T19:32:29.557978] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-25T19:32:29.839546] [DEBUG] [LOCAL ] JEF: Primary data saved (50382 records). [2025-09-25T19:32:29.839852] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-25T19:32:29.840998] [INFO ] [MAIN ] Update Progress: 1148/2372 symbols completed. JEF took 28.6s. Estimated remaining: 2h 42m 32s. Rate: 7.5 symbols/min [2025-09-25T19:32:30.043674] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T19:32:30.098143] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:30.151909] [DEBUG] [LOCAL ] JFR: Loaded 30352 existing records from primary storage. [2025-09-25T19:32:30.152079] [INFO ] [MAIN ] JFR: Loaded 30352 existing records. [2025-09-25T19:32:30.301701] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-25T19:32:30.346801] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:30.363417] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-25T19:32:30.389740] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-25T19:32:30.390255] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-25T19:32:30.390367] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-25T19:32:30.415208] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:32:30.718301] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:32:30.818103] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:31.088850] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-25T19:32:31.888827] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-25T19:32:32.156680] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T19:32:32.509308] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T19:32:32.517676] [INFO ] [REMOTE ] JEQ: Full fetch complete (11468 records). [2025-09-25T19:32:32.518062] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-25T19:32:32.607476] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T19:32:32.693865] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-25T19:32:33.065528] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-25T19:32:33.065636] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-25T19:32:33.066055] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-25T19:32:33.066159] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-25T19:32:33.067272] [DEBUG] [LOCAL ] JEQ: Trimmed 11468 records to 9203 (keeping 200 days of data) [2025-09-25T19:32:33.133080] [DEBUG] [LOCAL ] JEQ: Primary data saved (9203 records). [2025-09-25T19:32:33.133239] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-25T19:32:33.133380] [INFO ] [MAIN ] Update Progress: 1149/2372 symbols completed. JEQ took 29.6s. Estimated remaining: 2h 42m 19s. Rate: 7.5 symbols/min [2025-09-25T19:32:33.312300] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:33.330452] [DEBUG] [LOCAL ] JGH: Loaded 10954 existing records from primary storage. [2025-09-25T19:32:33.331989] [INFO ] [MAIN ] JGH: Loaded 10954 existing records. [2025-09-25T19:32:33.496989] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-25T19:32:33.534532] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:33.535095] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-25T19:32:33.535148] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-25T19:32:33.535536] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-25T19:32:33.535611] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-25T19:32:33.909784] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:34.293892] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-25T19:32:34.325434] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:32:34.991569] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T19:32:35.088693] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-25T19:32:35.888787] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-25T19:32:36.272738] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T19:32:36.293151] [INFO ] [REMOTE ] JCI: Full fetch complete (77411 records). [2025-09-25T19:32:36.293439] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-25T19:32:36.547101] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T19:32:36.694691] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-25T19:32:36.842146] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-25T19:32:36.842274] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-25T19:32:36.843750] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-25T19:32:36.843865] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-25T19:32:36.846434] [DEBUG] [LOCAL ] JCI: Trimmed 77411 records to 53937 (keeping 200 days of data) [2025-09-25T19:32:37.245213] [DEBUG] [LOCAL ] JCI: Primary data saved (53937 records). [2025-09-25T19:32:37.245458] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-25T19:32:37.245631] [INFO ] [MAIN ] Update Progress: 1150/2372 symbols completed. JCI took 39.7s. Estimated remaining: 2h 42m 7s. Rate: 7.5 symbols/min [2025-09-25T19:32:37.443396] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:37.491769] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T19:32:37.492741] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-25T19:32:37.519347] [INFO ] [REMOTE ] JELD: Full fetch complete (63590 records). [2025-09-25T19:32:37.519593] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-25T19:32:37.553699] [DEBUG] [LOCAL ] JHG: Loaded 47903 existing records from primary storage. [2025-09-25T19:32:37.553917] [INFO ] [MAIN ] JHG: Loaded 47903 existing records. [2025-09-25T19:32:38.018432] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:38.026000] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-25T19:32:38.026077] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-25T19:32:38.026372] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-25T19:32:38.026438] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-25T19:32:38.184004] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T19:32:38.256355] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T19:32:38.293305] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-25T19:32:38.539729] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-25T19:32:38.539851] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-25T19:32:38.541420] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-25T19:32:38.541489] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-25T19:32:38.548983] [DEBUG] [LOCAL ] JELD: Trimmed 63590 records to 46491 (keeping 200 days of data) [2025-09-25T19:32:38.931578] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:39.098311] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-25T19:32:39.136433] [DEBUG] [LOCAL ] JELD: Primary data saved (46491 records). [2025-09-25T19:32:39.136628] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-25T19:32:39.138046] [INFO ] [MAIN ] Update Progress: 1151/2372 symbols completed. JELD took 36.0s. Estimated remaining: 2h 41m 53s. Rate: 7.5 symbols/min [2025-09-25T19:32:39.330388] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:39.348443] [DEBUG] [LOCAL ] JHI: Loaded 3595 existing records from primary storage. [2025-09-25T19:32:39.348627] [INFO ] [MAIN ] JHI: Loaded 3595 existing records. [2025-09-25T19:32:39.563269] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:39.563777] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-25T19:32:39.563848] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-25T19:32:39.564166] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-25T19:32:39.564231] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-25T19:32:39.894085] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-25T19:32:39.969321] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:39.979141] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T19:32:40.394200] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-25T19:32:40.688761] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-25T19:32:41.333247] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T19:32:41.494467] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-25T19:32:41.498486] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T19:32:42.063509] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T19:32:42.288811] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-25T19:32:43.088899] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-25T19:32:43.753917] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T19:32:43.888732] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-25T19:32:44.367130] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T19:32:44.688780] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-25T19:32:45.418426] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T19:32:45.446925] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T19:32:45.488670] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-25T19:32:46.288813] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-25T19:32:46.881790] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T19:32:47.088769] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-25T19:32:47.254973] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:32:47.724795] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T19:32:47.888690] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-25T19:32:48.688709] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-25T19:32:48.700605] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T19:32:49.306290] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:32:49.488693] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-25T19:32:50.288696] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-25T19:32:50.375480] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T19:32:50.929662] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T19:32:51.088753] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-25T19:32:51.655794] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T19:32:51.888723] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-25T19:32:52.375577] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T19:32:52.688707] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-25T19:32:53.226814] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T19:32:53.488721] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-25T19:32:54.247775] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T19:32:54.249339] [INFO ] [REMOTE ] JHI: Full fetch complete (5305 records). [2025-09-25T19:32:54.249425] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-25T19:32:54.294726] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-25T19:32:54.671044] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-25T19:32:54.671158] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-25T19:32:54.671364] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-25T19:32:54.671428] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-25T19:32:54.672006] [DEBUG] [LOCAL ] JHI: Trimmed 5305 records to 3617 (keeping 200 days of data) [2025-09-25T19:32:54.696636] [DEBUG] [LOCAL ] JHI: Primary data saved (3617 records). [2025-09-25T19:32:54.696831] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-25T19:32:54.696996] [INFO ] [MAIN ] Update Progress: 1152/2372 symbols completed. JHI took 15.6s. Estimated remaining: 2h 41m 53s. Rate: 7.5 symbols/min [2025-09-25T19:32:54.881670] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:32:54.889209] [DEBUG] [LOCAL ] JHS: Loaded 2851 existing records from primary storage. [2025-09-25T19:32:54.889319] [INFO ] [MAIN ] JHS: Loaded 2851 existing records. [2025-09-25T19:32:55.078987] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:32:55.081034] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-25T19:32:55.081102] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-25T19:32:55.081362] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-25T19:32:55.081437] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-25T19:32:55.094904] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-25T19:32:55.278706] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T19:32:55.466004] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:32:55.888686] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-25T19:32:56.143275] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T19:32:56.688742] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-25T19:32:57.490184] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-25T19:32:57.493623] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T19:32:57.574513] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T19:32:58.288768] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-25T19:32:58.466819] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T19:32:59.088759] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-25T19:32:59.533715] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T19:32:59.889605] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-25T19:32:59.893571] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T19:33:00.353637] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T19:33:00.688767] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-25T19:33:01.488885] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-25T19:33:02.093636] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:33:02.102038] [INFO ] [REMOTE ] JFR: Full fetch complete (48016 records). [2025-09-25T19:33:02.102170] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-25T19:33:02.191389] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T19:33:02.289987] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-25T19:33:02.552583] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-25T19:33:02.552768] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-25T19:33:02.553852] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-25T19:33:02.554287] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-25T19:33:02.556698] [DEBUG] [LOCAL ] JFR: Trimmed 48016 records to 30635 (keeping 200 days of data) [2025-09-25T19:33:02.785167] [DEBUG] [LOCAL ] JFR: Primary data saved (30635 records). [2025-09-25T19:33:02.785381] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-25T19:33:02.785631] [INFO ] [MAIN ] Update Progress: 1153/2372 symbols completed. JFR took 32.9s. Estimated remaining: 2h 41m 45s. Rate: 7.5 symbols/min [2025-09-25T19:33:02.975696] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:03.043066] [DEBUG] [LOCAL ] JHX: Loaded 50437 existing records from primary storage. [2025-09-25T19:33:03.043271] [INFO ] [MAIN ] JHX: Loaded 50437 existing records. [2025-09-25T19:33:03.093829] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-25T19:33:03.173428] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T19:33:03.270307] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:03.272720] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-25T19:33:03.272802] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-25T19:33:03.274688] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-25T19:33:03.274763] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-25T19:33:03.671759] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:03.697939] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T19:33:03.888861] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-25T19:33:04.689076] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-25T19:33:05.176349] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T19:33:05.215854] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T19:33:05.220793] [INFO ] [REMOTE ] JGH: Full fetch complete (14850 records). [2025-09-25T19:33:05.221046] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-25T19:33:05.490031] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-25T19:33:05.654984] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-25T19:33:05.655075] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-25T19:33:05.655562] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-25T19:33:05.655665] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-25T19:33:05.657131] [DEBUG] [LOCAL ] JGH: Trimmed 14850 records to 11018 (keeping 200 days of data) [2025-09-25T19:33:05.757716] [DEBUG] [LOCAL ] JGH: Primary data saved (11018 records). [2025-09-25T19:33:05.757893] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-25T19:33:05.758105] [INFO ] [MAIN ] Update Progress: 1154/2372 symbols completed. JGH took 32.6s. Estimated remaining: 2h 41m 32s. Rate: 7.5 symbols/min [2025-09-25T19:33:05.948475] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:05.983470] [DEBUG] [LOCAL ] JILL: Loaded 16769 existing records from primary storage. [2025-09-25T19:33:05.983690] [INFO ] [MAIN ] JILL: Loaded 16769 existing records. [2025-09-25T19:33:06.177910] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:06.178361] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-25T19:33:06.178421] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-25T19:33:06.178779] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-25T19:33:06.178840] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-25T19:33:06.293791] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-25T19:33:06.575842] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:07.088744] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-25T19:33:07.271854] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T19:33:07.888785] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-25T19:33:08.115444] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:33:08.354720] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T19:33:08.688759] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-25T19:33:09.489959] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-25T19:33:09.672004] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:33:09.863120] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-25T19:33:10.288768] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-25T19:33:11.088713] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-25T19:33:11.123499] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:33:11.389393] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (5.90 seconds). [2025-09-25T19:33:11.660850] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T19:33:11.888754] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-25T19:33:12.688747] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-25T19:33:13.455300] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T19:33:13.488780] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-25T19:33:13.494893] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:33:14.078702] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T19:33:14.288708] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-25T19:33:15.088765] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-25T19:33:15.115850] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:33:15.572740] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T19:33:15.888749] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-25T19:33:16.688687] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-25T19:33:17.304907] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T19:33:17.488737] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-25T19:33:18.288705] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-25T19:33:18.797676] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T19:33:19.002371] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T19:33:19.045439] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-25T19:33:19.088678] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-25T19:33:19.888740] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-25T19:33:20.688720] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-25T19:33:20.753300] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T19:33:21.488724] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-25T19:33:21.835775] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T19:33:21.833041] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T19:33:22.288758] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-25T19:33:23.088739] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-25T19:33:23.164680] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T19:33:23.174005] [INFO ] [REMOTE ] JHG: Full fetch complete (68412 records). [2025-09-25T19:33:23.174169] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-25T19:33:23.358510] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T19:33:23.618373] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-25T19:33:23.618491] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-25T19:33:23.620575] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-25T19:33:23.620662] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-25T19:33:23.622237] [DEBUG] [LOCAL ] JHG: Trimmed 68412 records to 48212 (keeping 200 days of data) [2025-09-25T19:33:23.862169] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T19:33:23.863737] [INFO ] [REMOTE ] JHS: Full fetch complete (4422 records). [2025-09-25T19:33:23.881787] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-25T19:33:23.889200] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-25T19:33:24.053859] [DEBUG] [LOCAL ] JHG: Primary data saved (48212 records). [2025-09-25T19:33:24.054056] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-25T19:33:24.054277] [INFO ] [MAIN ] Update Progress: 1155/2372 symbols completed. JHG took 46.8s. Estimated remaining: 2h 41m 35s. Rate: 7.5 symbols/min [2025-09-25T19:33:24.407879] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:24.548913] [DEBUG] [LOCAL ] JKS: Loaded 40108 existing records from primary storage. [2025-09-25T19:33:24.549128] [INFO ] [MAIN ] JKS: Loaded 40108 existing records. [2025-09-25T19:33:24.715825] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-25T19:33:24.874778] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-25T19:33:24.874922] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-25T19:33:24.875218] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-25T19:33:24.875267] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-25T19:33:24.876722] [DEBUG] [LOCAL ] JHS: Trimmed 4422 records to 2864 (keeping 200 days of data) [2025-09-25T19:33:25.039782] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T19:33:25.052730] [DEBUG] [LOCAL ] JHS: Primary data saved (2864 records). [2025-09-25T19:33:25.071087] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-25T19:33:25.071292] [INFO ] [MAIN ] Update Progress: 1156/2372 symbols completed. JHS took 30.4s. Estimated remaining: 2h 41m 20s. Rate: 7.5 symbols/min [2025-09-25T19:33:25.153131] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:25.153455] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-25T19:33:25.153532] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-25T19:33:25.166695] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-25T19:33:25.209736] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-25T19:33:25.498807] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-25T19:33:25.543318] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:25.908137] [DEBUG] [LOCAL ] JLL: Loaded 32095 existing records from primary storage. [2025-09-25T19:33:25.908306] [INFO ] [MAIN ] JLL: Loaded 32095 existing records. [2025-09-25T19:33:25.920494] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:26.101440] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:26.101839] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-25T19:33:26.101891] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-25T19:33:26.102157] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-25T19:33:26.102217] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-25T19:33:26.290011] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-25T19:33:26.498964] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:26.553094] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T19:33:26.571460] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T19:33:27.088744] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-25T19:33:27.888698] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-25T19:33:27.987223] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T19:33:28.199737] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T19:33:28.204553] [INFO ] [REMOTE ] JILL: Full fetch complete (23042 records). [2025-09-25T19:33:28.204693] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-25T19:33:28.617677] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-25T19:33:28.617825] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-25T19:33:28.618611] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-25T19:33:28.618683] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-25T19:33:28.619830] [DEBUG] [LOCAL ] JILL: Trimmed 23042 records to 16873 (keeping 200 days of data) [2025-09-25T19:33:28.712519] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-25T19:33:28.760105] [DEBUG] [LOCAL ] JILL: Primary data saved (16873 records). [2025-09-25T19:33:28.760271] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-25T19:33:28.760388] [INFO ] [MAIN ] Update Progress: 1157/2372 symbols completed. JILL took 23.0s. Estimated remaining: 2h 41m 7s. Rate: 7.5 symbols/min [2025-09-25T19:33:29.488762] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-25T19:33:29.613638] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:33:29.997308] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T19:33:30.288751] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-25T19:33:31.088730] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-25T19:33:31.171076] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T19:33:31.888705] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-25T19:33:32.220606] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T19:33:32.511337] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:33:32.688778] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-25T19:33:33.024438] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T19:33:33.488713] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-25T19:33:34.288748] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-25T19:33:34.467025] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T19:33:34.476097] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T19:33:35.088703] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-25T19:33:35.888776] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-25T19:33:36.038603] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T19:33:36.688846] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-25T19:33:36.811709] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T19:33:36.825193] [INFO ] [REMOTE ] JHX: Full fetch complete (57308 records). [2025-09-25T19:33:36.825311] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-25T19:33:37.264843] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-25T19:33:37.264993] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-25T19:33:37.266314] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-25T19:33:37.266471] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-25T19:33:37.268776] [DEBUG] [LOCAL ] JHX: Trimmed 57308 records to 50827 (keeping 200 days of data) [2025-09-25T19:33:37.393304] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:33:37.495456] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-25T19:33:37.650807] [DEBUG] [LOCAL ] JHX: Primary data saved (50827 records). [2025-09-25T19:33:37.650984] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-25T19:33:37.652200] [INFO ] [MAIN ] Update Progress: 1158/2372 symbols completed. JHX took 34.9s. Estimated remaining: 2h 41m 0s. Rate: 7.5 symbols/min [2025-09-25T19:33:38.239615] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T19:33:38.288683] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-25T19:33:39.073766] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T19:33:39.088694] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-25T19:33:39.661810] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:33:39.888833] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-25T19:33:40.096080] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T19:33:40.689760] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-25T19:33:41.441933] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T19:33:41.488735] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-25T19:33:42.143191] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:33:42.288848] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-25T19:33:43.145113] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T19:33:43.155804] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-25T19:33:43.533974] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T19:33:43.888887] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-25T19:33:44.746603] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T19:33:44.755710] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-25T19:33:45.380057] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:33:45.488762] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-25T19:33:46.687815] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:33:46.702039] [INFO ] [REMOTE ] JKS: Full fetch complete (59334 records). [2025-09-25T19:33:46.702231] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-25T19:33:47.036282] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T19:33:47.056877] [INFO ] [REMOTE ] JLL: Full fetch complete (44878 records). [2025-09-25T19:33:47.057011] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-25T19:33:47.262028] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-25T19:33:47.262142] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-25T19:33:47.263773] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-25T19:33:47.271530] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-25T19:33:47.273304] [DEBUG] [LOCAL ] JKS: Trimmed 59334 records to 40399 (keeping 200 days of data) [2025-09-25T19:33:47.915306] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-25T19:33:47.915481] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-25T19:33:47.917233] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-25T19:33:47.917339] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-25T19:33:47.920668] [DEBUG] [LOCAL ] JLL: Trimmed 44878 records to 32288 (keeping 200 days of data) [2025-09-25T19:33:48.080735] [DEBUG] [LOCAL ] JKS: Primary data saved (40399 records). [2025-09-25T19:33:48.080926] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-25T19:33:48.081188] [INFO ] [MAIN ] Update Progress: 1159/2372 symbols completed. JKS took 24.0s. Estimated remaining: 2h 40m 55s. Rate: 7.5 symbols/min [2025-09-25T19:33:48.201423] [DEBUG] [LOCAL ] JLL: Primary data saved (32288 records). [2025-09-25T19:33:48.201617] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-25T19:33:48.201799] [INFO ] [MAIN ] Update Progress: 1160/2372 symbols completed. JLL took 23.1s. Estimated remaining: 2h 40m 39s. Rate: 7.5 symbols/min [2025-09-25T19:33:48.954069] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:48.961509] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:48.963404] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:48.984532] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:33:48.989854] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-25T19:33:48.989898] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-25T19:33:48.990181] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-25T19:33:48.990250] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-25T19:33:48.990318] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-25T19:33:48.990377] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-25T19:33:48.989697] [DEBUG] [LOCAL ] JLS: Loaded 4088 existing records from primary storage. [2025-09-25T19:33:48.996761] [INFO ] [MAIN ] JLS: Loaded 4088 existing records. [2025-09-25T19:33:49.261025] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-25T19:33:49.272005] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-25T19:33:49.482128] [DEBUG] [LOCAL ] JMIA: Loaded 50508 existing records from primary storage. [2025-09-25T19:33:49.482401] [INFO ] [MAIN ] JMIA: Loaded 50508 existing records. [2025-09-25T19:33:49.697449] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:49.703007] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-25T19:33:49.703069] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-25T19:33:49.703359] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-25T19:33:49.703420] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-25T19:33:50.161706] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:50.161987] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-25T19:33:50.162058] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-25T19:33:50.162492] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-25T19:33:50.162554] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-25T19:33:50.332757] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:33:50.333139] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-25T19:33:50.333197] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-25T19:33:50.333623] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-25T19:33:50.344382] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-25T19:33:50.618495] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:50.619101] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-25T19:33:51.030374] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:51.085337] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-25T19:33:51.372209] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T19:33:51.387557] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-25T19:33:51.426257] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:51.428562] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-25T19:33:51.452455] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:33:51.452834] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-25T19:33:51.789357] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T19:33:51.790587] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-25T19:33:52.021627] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T19:33:52.023314] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-25T19:33:52.226213] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T19:33:52.227568] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-25T19:33:52.592320] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-25T19:33:52.605082] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T19:33:52.688727] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-25T19:33:53.127548] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T19:33:53.488751] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-25T19:33:53.563408] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-25T19:33:53.815211] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-25T19:33:54.141276] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.69 seconds). [2025-09-25T19:33:54.288784] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-25T19:33:55.088751] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-25T19:33:55.393672] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-25T19:33:55.888754] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-25T19:33:56.463364] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T19:33:56.673397] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-25T19:33:56.688674] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-25T19:33:57.488751] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-25T19:33:58.288747] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-25T19:33:58.969418] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-25T19:33:58.953797] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T19:33:59.062046] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T19:33:59.088706] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-25T19:33:59.777434] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T19:33:59.888684] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-25T19:34:00.537953] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T19:34:00.688707] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-25T19:34:01.369253] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T19:34:01.488733] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-25T19:34:01.936127] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-25T19:34:02.288745] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-25T19:34:03.088760] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-25T19:34:03.629482] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T19:34:03.630531] [INFO ] [REMOTE ] JMM: Full fetch complete (2291 records). [2025-09-25T19:34:03.630607] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-25T19:34:03.848941] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-25T19:34:03.849243] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:34:03.849303] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:34:03.849370] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-25T19:34:03.849503] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-25T19:34:03.849576] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-25T19:34:03.849819] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-25T19:34:03.849936] [INFO ] [MAIN ] Update Progress: 1161/2372 symbols completed. JMM took 15.6s. Estimated remaining: 2h 40m 39s. Rate: 7.5 symbols/min [2025-09-25T19:34:03.898754] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-25T19:34:04.056092] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:04.124009] [DEBUG] [LOCAL ] JOBY: Loaded 53799 existing records from primary storage. [2025-09-25T19:34:04.124205] [INFO ] [MAIN ] JOBY: Loaded 53799 existing records. [2025-09-25T19:34:04.313949] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:04.314292] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-25T19:34:04.314340] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-25T19:34:04.314758] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-25T19:34:04.314820] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-25T19:34:04.664692] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-25T19:34:04.699101] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-25T19:34:04.798301] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:05.321956] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T19:34:05.488859] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-25T19:34:05.732288] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T19:34:06.288894] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-25T19:34:07.088889] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-25T19:34:07.838407] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-25T19:34:07.888730] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-25T19:34:08.688812] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-25T19:34:08.919032] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T19:34:09.452830] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T19:34:09.481017] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (3.19 seconds). [2025-09-25T19:34:09.496118] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-25T19:34:10.070602] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T19:34:10.293946] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-25T19:34:10.552315] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-25T19:34:11.088798] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-25T19:34:11.888870] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-25T19:34:12.688737] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-25T19:34:12.870017] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-25T19:34:13.109041] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T19:34:13.158610] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T19:34:13.160979] [INFO ] [REMOTE ] JLS: Full fetch complete (5800 records). [2025-09-25T19:34:13.161087] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-25T19:34:13.488715] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-25T19:34:13.593145] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-25T19:34:13.593280] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-25T19:34:13.593517] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-25T19:34:13.593634] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-25T19:34:13.594744] [DEBUG] [LOCAL ] JLS: Trimmed 5800 records to 4110 (keeping 200 days of data) [2025-09-25T19:34:13.637710] [DEBUG] [LOCAL ] JLS: Primary data saved (4110 records). [2025-09-25T19:34:13.638003] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-25T19:34:13.638356] [INFO ] [MAIN ] Update Progress: 1162/2372 symbols completed. JLS took 25.4s. Estimated remaining: 2h 40m 33s. Rate: 7.5 symbols/min [2025-09-25T19:34:13.856772] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:13.886270] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T19:34:13.925919] [DEBUG] [LOCAL ] JOE: Loaded 24559 existing records from primary storage. [2025-09-25T19:34:13.926099] [INFO ] [MAIN ] JOE: Loaded 24559 existing records. [2025-09-25T19:34:14.173658] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:14.174006] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-25T19:34:14.174061] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-25T19:34:14.174449] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-25T19:34:14.174520] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-25T19:34:14.289035] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-25T19:34:14.587154] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:15.009265] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T19:34:15.088674] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-25T19:34:15.888820] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-25T19:34:16.539955] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-25T19:34:16.688741] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-25T19:34:17.006365] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T19:34:17.488738] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-25T19:34:17.563787] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T19:34:18.155621] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-25T19:34:18.288820] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-25T19:34:19.088768] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-25T19:34:19.490632] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T19:34:19.888736] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-25T19:34:20.621529] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-25T19:34:20.688752] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-25T19:34:20.872998] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T19:34:21.162614] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T19:34:21.488791] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-25T19:34:22.288700] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-25T19:34:22.511479] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T19:34:23.088695] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-25T19:34:23.373357] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T19:34:23.888741] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-25T19:34:23.957949] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-25T19:34:24.688739] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-25T19:34:25.488734] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-25T19:34:25.584783] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-25T19:34:25.606503] [INFO ] [REMOTE ] JNJ: Full fetch complete (77855 records). [2025-09-25T19:34:25.606865] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-25T19:34:26.054321] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T19:34:26.089946] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-25T19:34:26.113181] [INFO ] [REMOTE ] JMIA: Full fetch complete (73263 records). [2025-09-25T19:34:26.113462] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-25T19:34:26.277463] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-25T19:34:26.277557] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-25T19:34:26.296891] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-25T19:34:26.297110] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-25T19:34:26.294743] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-25T19:34:26.314637] [DEBUG] [LOCAL ] JNJ: Trimmed 77855 records to 54143 (keeping 200 days of data) [2025-09-25T19:34:27.018740] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-25T19:34:27.018923] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-25T19:34:27.020280] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-25T19:34:27.020356] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-25T19:34:27.049636] [DEBUG] [LOCAL ] JMIA: Trimmed 73263 records to 50895 (keeping 200 days of data) [2025-09-25T19:34:27.084913] [DEBUG] [LOCAL ] JNJ: Primary data saved (54143 records). [2025-09-25T19:34:27.085107] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-25T19:34:27.087806] [INFO ] [MAIN ] Update Progress: 1163/2372 symbols completed. JNJ took 38.9s. Estimated remaining: 2h 40m 30s. Rate: 7.5 symbols/min [2025-09-25T19:34:27.605677] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:27.605954] [DEBUG] [LOCAL ] JOF: No existing data file found in primary storage. [2025-09-25T19:34:27.606010] [WARN ] [MAIN ] JOF: No existing data found, performing full refresh instead. [2025-09-25T19:34:27.606198] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-25T19:34:27.606264] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-25T19:34:27.606333] [DEBUG] [LOCAL ] JOF: No primary data file found to delete. [2025-09-25T19:34:27.606388] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-25T19:34:27.735793] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T19:34:27.745892] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-25T19:34:27.789956] [DEBUG] [LOCAL ] JMIA: Primary data saved (50895 records). [2025-09-25T19:34:27.790102] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-25T19:34:27.790218] [INFO ] [MAIN ] Update Progress: 1164/2372 symbols completed. JMIA took 39.6s. Estimated remaining: 2h 40m 15s. Rate: 7.5 symbols/min [2025-09-25T19:34:28.185486] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:28.276423] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-25T19:34:28.295427] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-25T19:34:28.386236] [DEBUG] [LOCAL ] JPC: Loaded 37066 existing records from primary storage. [2025-09-25T19:34:28.386416] [INFO ] [MAIN ] JPC: Loaded 37066 existing records. [2025-09-25T19:34:28.445003] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:28.594119] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:28.594482] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-25T19:34:28.594529] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-25T19:34:28.594875] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-25T19:34:28.594936] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-25T19:34:28.693830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-25T19:34:28.989753] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:29.092501] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T19:34:29.488683] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-25T19:34:29.653410] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T19:34:30.288762] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-25T19:34:30.934068] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-25T19:34:31.088742] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-25T19:34:31.447944] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T19:34:31.503337] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T19:34:31.888761] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-25T19:34:32.688789] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-25T19:34:33.390747] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T19:34:33.488774] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-25T19:34:33.905528] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:34:33.999585] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-25T19:34:34.288759] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-25T19:34:34.966430] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T19:34:35.088766] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-25T19:34:35.888803] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-25T19:34:36.343275] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T19:34:36.499163] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T19:34:36.688685] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-25T19:34:37.163346] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.87 seconds). [2025-09-25T19:34:37.488748] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-25T19:34:37.964064] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T19:34:37.968769] [INFO ] [REMOTE ] JOE: Full fetch complete (36315 records). [2025-09-25T19:34:37.968880] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-25T19:34:38.177574] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T19:34:38.293031] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-25T19:34:38.385735] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-25T19:34:38.385832] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-25T19:34:38.386701] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-25T19:34:38.386766] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-25T19:34:38.387662] [DEBUG] [LOCAL ] JOE: Trimmed 36315 records to 24733 (keeping 200 days of data) [2025-09-25T19:34:38.548907] [DEBUG] [LOCAL ] JOE: Primary data saved (24733 records). [2025-09-25T19:34:38.549066] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-25T19:34:38.549161] [INFO ] [MAIN ] Update Progress: 1165/2372 symbols completed. JOE took 24.9s. Estimated remaining: 2h 40m 10s. Rate: 7.5 symbols/min [2025-09-25T19:34:38.720784] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:38.792754] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-25T19:34:38.792935] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-25T19:34:38.971045] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:38.971420] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-25T19:34:38.971468] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-25T19:34:38.971917] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-25T19:34:38.972478] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-25T19:34:39.093780] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-25T19:34:39.344909] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:39.888717] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-25T19:34:40.599245] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:34:40.616107] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T19:34:40.688677] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-25T19:34:41.195268] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.90 seconds). [2025-09-25T19:34:41.205292] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-25T19:34:41.205451] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-25T19:34:41.494991] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-25T19:34:41.649581] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-25T19:34:41.649742] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-25T19:34:41.651777] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-25T19:34:41.651873] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-25T19:34:41.653891] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 54189 (keeping 200 days of data) [2025-09-25T19:34:42.002720] [DEBUG] [LOCAL ] JOBY: Primary data saved (54189 records). [2025-09-25T19:34:42.002885] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-25T19:34:42.002996] [INFO ] [MAIN ] Update Progress: 1166/2372 symbols completed. JOBY took 38.2s. Estimated remaining: 2h 39m 57s. Rate: 7.5 symbols/min [2025-09-25T19:34:42.189372] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:42.272601] [DEBUG] [LOCAL ] JQC: Loaded 33645 existing records from primary storage. [2025-09-25T19:34:42.272866] [INFO ] [MAIN ] JQC: Loaded 33645 existing records. [2025-09-25T19:34:42.279728] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T19:34:42.296818] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-25T19:34:42.382561] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T19:34:42.492109] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:42.492753] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-25T19:34:42.492817] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-25T19:34:42.493423] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-25T19:34:42.493501] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-25T19:34:42.878824] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:43.088785] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-25T19:34:43.737052] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T19:34:43.888788] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-25T19:34:44.688935] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-25T19:34:44.858901] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-25T19:34:45.213194] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T19:34:45.488824] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-25T19:34:46.288784] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-25T19:34:46.422071] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T19:34:46.988206] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T19:34:47.088754] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-25T19:34:47.763683] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-25T19:34:47.829977] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T19:34:47.888733] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-25T19:34:48.655772] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T19:34:48.688726] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-25T19:34:49.488827] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-25T19:34:49.516382] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T19:34:49.518769] [INFO ] [REMOTE ] JOF: Full fetch complete (9482 records). [2025-09-25T19:34:49.518913] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-25T19:34:49.937193] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-25T19:34:49.937335] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-25T19:34:49.937712] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-25T19:34:49.937823] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-25T19:34:49.938372] [DEBUG] [LOCAL ] JOF: Trimmed 9482 records to 7145 (keeping 200 days of data) [2025-09-25T19:34:49.995727] [DEBUG] [LOCAL ] JOF: Primary data saved (7145 records). [2025-09-25T19:34:49.995946] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-25T19:34:49.996160] [INFO ] [MAIN ] Update Progress: 1167/2372 symbols completed. JOF took 22.9s. Estimated remaining: 2h 39m 49s. Rate: 7.5 symbols/min [2025-09-25T19:34:50.179948] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:34:50.216663] [DEBUG] [LOCAL ] JRI: Loaded 14901 existing records from primary storage. [2025-09-25T19:34:50.216860] [INFO ] [MAIN ] JRI: Loaded 14901 existing records. [2025-09-25T19:34:50.290449] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-25T19:34:50.419551] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:34:50.421523] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-25T19:34:50.421578] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-25T19:34:50.422032] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-25T19:34:50.422106] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-25T19:34:50.834467] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:34:51.088809] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-25T19:34:51.743029] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:34:51.792850] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-25T19:34:51.888692] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-25T19:34:52.261936] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:34:52.688979] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-25T19:34:53.488825] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-25T19:34:53.947517] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T19:34:54.062749] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-25T19:34:54.288754] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-25T19:34:54.863333] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T19:34:55.088733] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-25T19:34:55.700091] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T19:34:55.888764] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-25T19:34:56.592497] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T19:34:56.688740] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-25T19:34:57.385735] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T19:34:57.488752] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-25T19:34:58.176954] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:34:58.288730] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-25T19:34:58.692308] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T19:34:59.088746] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-25T19:34:59.816770] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T19:34:59.824224] [INFO ] [REMOTE ] JPC: Full fetch complete (55734 records). [2025-09-25T19:34:59.824363] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-25T19:34:59.895850] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-25T19:34:59.987994] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T19:35:00.319157] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-25T19:35:00.319297] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-25T19:35:00.320476] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-25T19:35:00.320545] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-25T19:35:00.322108] [DEBUG] [LOCAL ] JPC: Trimmed 55734 records to 37351 (keeping 200 days of data) [2025-09-25T19:35:00.566753] [DEBUG] [LOCAL ] JPC: Primary data saved (37351 records). [2025-09-25T19:35:00.566933] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-25T19:35:00.567082] [INFO ] [MAIN ] Update Progress: 1168/2372 symbols completed. JPC took 32.8s. Estimated remaining: 2h 39m 44s. Rate: 7.5 symbols/min [2025-09-25T19:35:00.694023] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-25T19:35:00.762151] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:00.783099] [DEBUG] [LOCAL ] JRS: Loaded 11089 existing records from primary storage. [2025-09-25T19:35:00.783271] [INFO ] [MAIN ] JRS: Loaded 11089 existing records. [2025-09-25T19:35:00.844204] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T19:35:00.986163] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:00.988697] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-25T19:35:00.988778] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-25T19:35:00.989055] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-25T19:35:00.989130] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-25T19:35:01.362066] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:01.488727] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-25T19:35:02.227809] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T19:35:02.288756] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-25T19:35:03.088719] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-25T19:35:03.471189] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T19:35:03.888774] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-25T19:35:04.141562] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-25T19:35:04.209769] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T19:35:04.688724] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-25T19:35:04.714965] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T19:35:05.488744] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-25T19:35:06.085438] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:35:06.091820] [INFO ] [REMOTE ] JQC: Full fetch complete (48566 records). [2025-09-25T19:35:06.092078] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-25T19:35:06.291710] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T19:35:06.297769] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-25T19:35:06.521485] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-25T19:35:06.521579] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-25T19:35:06.522572] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-25T19:35:06.522638] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-25T19:35:06.523742] [DEBUG] [LOCAL ] JQC: Trimmed 48566 records to 33842 (keeping 200 days of data) [2025-09-25T19:35:06.742893] [DEBUG] [LOCAL ] JQC: Primary data saved (33842 records). [2025-09-25T19:35:06.743117] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-25T19:35:06.743282] [INFO ] [MAIN ] Update Progress: 1169/2372 symbols completed. JQC took 24.7s. Estimated remaining: 2h 39m 34s. Rate: 7.5 symbols/min [2025-09-25T19:35:06.925853] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:06.983257] [DEBUG] [LOCAL ] JXN: Loaded 45954 existing records from primary storage. [2025-09-25T19:35:06.983433] [INFO ] [MAIN ] JXN: Loaded 45954 existing records. [2025-09-25T19:35:07.093838] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-25T19:35:07.168141] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:07.168517] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-25T19:35:07.168567] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-25T19:35:07.169061] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-25T19:35:07.169123] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-25T19:35:07.525027] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:07.888736] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-25T19:35:07.980507] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T19:35:08.688750] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-25T19:35:08.814075] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-25T19:35:09.260019] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T19:35:09.488734] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-25T19:35:09.553446] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T19:35:10.288765] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-25T19:35:10.487608] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T19:35:11.088759] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-25T19:35:11.870762] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T19:35:11.888673] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-25T19:35:12.604092] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-25T19:35:12.623023] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T19:35:12.688693] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-25T19:35:13.488743] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-25T19:35:14.282129] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T19:35:14.288702] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-25T19:35:15.088745] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-25T19:35:15.211523] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.52 seconds). [2025-09-25T19:35:15.409554] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T19:35:15.888891] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-25T19:35:15.893131] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T19:35:16.688843] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-25T19:35:17.488731] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-25T19:35:17.566018] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T19:35:18.288758] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-25T19:35:18.305824] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-25T19:35:18.425568] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T19:35:19.088795] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-25T19:35:19.886994] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T19:35:19.896385] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-25T19:35:20.688952] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-25T19:35:20.966625] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T19:35:21.488740] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-25T19:35:21.727846] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-25T19:35:21.738879] [INFO ] [REMOTE ] JPM: Full fetch complete (77892 records). [2025-09-25T19:35:21.739117] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-25T19:35:22.043373] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T19:35:22.213826] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-25T19:35:22.213943] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-25T19:35:22.215585] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-25T19:35:22.215781] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-25T19:35:22.220613] [DEBUG] [LOCAL ] JPM: Trimmed 77892 records to 54184 (keeping 200 days of data) [2025-09-25T19:35:22.281327] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T19:35:22.291803] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-25T19:35:22.664860] [DEBUG] [LOCAL ] JPM: Primary data saved (54184 records). [2025-09-25T19:35:22.665061] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-25T19:35:22.667584] [INFO ] [MAIN ] Update Progress: 1170/2372 symbols completed. JPM took 44.1s. Estimated remaining: 2h 39m 35s. Rate: 7.5 symbols/min [2025-09-25T19:35:22.845222] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:22.907449] [DEBUG] [LOCAL ] K: Loaded 49862 existing records from primary storage. [2025-09-25T19:35:22.907673] [INFO ] [MAIN ] K: Loaded 49862 existing records. [2025-09-25T19:35:23.093913] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-25T19:35:23.171852] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:23.172132] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-25T19:35:23.172184] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-25T19:35:23.173479] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-25T19:35:23.173555] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-25T19:35:23.576262] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:23.888825] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-25T19:35:24.360571] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T19:35:24.365147] [INFO ] [REMOTE ] JRI: Full fetch complete (23131 records). [2025-09-25T19:35:24.365232] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-25T19:35:24.694880] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-25T19:35:24.781257] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-25T19:35:24.781365] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-25T19:35:24.782216] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-25T19:35:24.782305] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-25T19:35:24.783102] [DEBUG] [LOCAL ] JRI: Trimmed 23131 records to 14986 (keeping 200 days of data) [2025-09-25T19:35:24.896049] [DEBUG] [LOCAL ] JRI: Primary data saved (14986 records). [2025-09-25T19:35:24.896274] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-25T19:35:24.896447] [INFO ] [MAIN ] Update Progress: 1171/2372 symbols completed. JRI took 34.9s. Estimated remaining: 2h 39m 21s. Rate: 7.5 symbols/min [2025-09-25T19:35:25.076299] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:25.096720] [DEBUG] [LOCAL ] KAI: Loaded 13573 existing records from primary storage. [2025-09-25T19:35:25.096889] [INFO ] [MAIN ] KAI: Loaded 13573 existing records. [2025-09-25T19:35:25.311893] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:25.312263] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-25T19:35:25.312318] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-25T19:35:25.312547] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-25T19:35:25.312629] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-25T19:35:25.375361] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T19:35:25.498574] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-25T19:35:25.620106] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T19:35:25.768807] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:26.288741] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-25T19:35:26.995100] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (4.70 seconds). [2025-09-25T19:35:26.976567] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T19:35:27.088691] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-25T19:35:27.202883] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T19:35:27.888809] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-25T19:35:28.678173] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T19:35:28.688701] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-25T19:35:28.758982] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:35:29.488708] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-25T19:35:29.597491] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T19:35:29.601820] [INFO ] [REMOTE ] JRS: Full fetch complete (16148 records). [2025-09-25T19:35:29.601936] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-25T19:35:29.985383] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-25T19:35:29.985483] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-25T19:35:29.985980] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-25T19:35:29.986043] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-25T19:35:29.986625] [DEBUG] [LOCAL ] JRS: Trimmed 16148 records to 11185 (keeping 200 days of data) [2025-09-25T19:35:30.057672] [DEBUG] [LOCAL ] JRS: Primary data saved (11185 records). [2025-09-25T19:35:30.057841] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-25T19:35:30.057975] [INFO ] [MAIN ] Update Progress: 1172/2372 symbols completed. JRS took 29.5s. Estimated remaining: 2h 39m 10s. Rate: 7.5 symbols/min [2025-09-25T19:35:30.239675] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:30.288756] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-25T19:35:30.309863] [DEBUG] [LOCAL ] KAR: Loaded 39814 existing records from primary storage. [2025-09-25T19:35:30.310092] [INFO ] [MAIN ] KAR: Loaded 39814 existing records. [2025-09-25T19:35:30.522369] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:30.524726] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-25T19:35:30.524798] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-25T19:35:30.525174] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-25T19:35:30.525235] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-25T19:35:30.915962] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:31.089164] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-25T19:35:31.104072] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:35:31.389156] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T19:35:31.888733] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-25T19:35:32.648338] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T19:35:32.688701] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-25T19:35:32.866398] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-25T19:35:33.488816] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-25T19:35:34.288760] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-25T19:35:34.385443] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T19:35:34.967757] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T19:35:35.088681] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-25T19:35:35.401676] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T19:35:35.888716] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-25T19:35:36.453840] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T19:35:36.688718] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-25T19:35:37.135899] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T19:35:37.488688] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-25T19:35:38.079930] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T19:35:38.288738] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-25T19:35:38.981965] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T19:35:39.088765] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-25T19:35:39.514937] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T19:35:39.888707] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-25T19:35:40.688724] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-25T19:35:40.863356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:35:41.036351] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T19:35:41.364159] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T19:35:41.488739] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-25T19:35:42.288746] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-25T19:35:43.091280] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-25T19:35:43.198044] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T19:35:43.211607] [INFO ] [REMOTE ] JXN: Full fetch complete (65392 records). [2025-09-25T19:35:43.211792] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-25T19:35:43.643089] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-25T19:35:43.643197] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-25T19:35:43.644394] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-25T19:35:43.644464] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-25T19:35:43.645913] [DEBUG] [LOCAL ] JXN: Trimmed 65392 records to 46259 (keeping 200 days of data) [2025-09-25T19:35:43.820965] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T19:35:43.902829] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-25T19:35:44.016849] [DEBUG] [LOCAL ] JXN: Primary data saved (46259 records). [2025-09-25T19:35:44.017054] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-25T19:35:44.017378] [INFO ] [MAIN ] Update Progress: 1173/2372 symbols completed. JXN took 37.3s. Estimated remaining: 2h 39m 8s. Rate: 7.5 symbols/min [2025-09-25T19:35:44.200344] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:44.246119] [DEBUG] [LOCAL ] KB: Loaded 24099 existing records from primary storage. [2025-09-25T19:35:44.246284] [INFO ] [MAIN ] KB: Loaded 24099 existing records. [2025-09-25T19:35:44.428084] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:44.428361] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-25T19:35:44.428408] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-25T19:35:44.428910] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-25T19:35:44.429011] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-25T19:35:44.689794] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-25T19:35:44.826863] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:44.864281] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T19:35:44.892481] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T19:35:45.489024] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-25T19:35:46.294577] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-25T19:35:46.313824] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T19:35:46.675594] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T19:35:47.088825] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-25T19:35:47.888786] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-25T19:35:47.927928] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T19:35:48.082697] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T19:35:48.688746] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-25T19:35:49.128098] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T19:35:49.488862] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-25T19:35:49.989911] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T19:35:50.288775] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-25T19:35:50.861250] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T19:35:51.088767] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-25T19:35:51.306611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T19:35:51.310205] [INFO ] [REMOTE ] KAI: Full fetch complete (18846 records). [2025-09-25T19:35:51.310356] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-25T19:35:51.727442] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-25T19:35:51.727558] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-25T19:35:51.728197] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-25T19:35:51.728302] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-25T19:35:51.729393] [DEBUG] [LOCAL ] KAI: Trimmed 18846 records to 13650 (keeping 200 days of data) [2025-09-25T19:35:51.841763] [DEBUG] [LOCAL ] KAI: Primary data saved (13650 records). [2025-09-25T19:35:51.842066] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-25T19:35:51.842394] [INFO ] [MAIN ] Update Progress: 1174/2372 symbols completed. KAI took 26.9s. Estimated remaining: 2h 38m 60s. Rate: 7.5 symbols/min [2025-09-25T19:35:51.888839] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-25T19:35:52.040810] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:52.072553] [DEBUG] [LOCAL ] KBDC: Loaded 20843 existing records from primary storage. [2025-09-25T19:35:52.072760] [INFO ] [MAIN ] KBDC: Loaded 20843 existing records. [2025-09-25T19:35:52.261691] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:52.262275] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-25T19:35:52.262328] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-25T19:35:52.262813] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-25T19:35:52.262887] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-25T19:35:52.677745] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:52.688689] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-25T19:35:52.972762] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T19:35:52.983828] [INFO ] [REMOTE ] K: Full fetch complete (71922 records). [2025-09-25T19:35:52.984033] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-25T19:35:53.324517] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T19:35:53.462189] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-25T19:35:53.462309] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-25T19:35:53.463485] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-25T19:35:53.463577] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-25T19:35:53.468607] [DEBUG] [LOCAL ] K: Trimmed 71922 records to 50249 (keeping 200 days of data) [2025-09-25T19:35:53.488749] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-25T19:35:53.825664] [DEBUG] [LOCAL ] K: Primary data saved (50249 records). [2025-09-25T19:35:53.825864] [INFO ] [MAIN ] K: Full history saved. [2025-09-25T19:35:53.826021] [INFO ] [MAIN ] Update Progress: 1175/2372 symbols completed. K took 31.2s. Estimated remaining: 2h 38m 46s. Rate: 7.5 symbols/min [2025-09-25T19:35:54.001585] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:54.064314] [DEBUG] [LOCAL ] KBH: Loaded 48915 existing records from primary storage. [2025-09-25T19:35:54.064495] [INFO ] [MAIN ] KBH: Loaded 48915 existing records. [2025-09-25T19:35:54.249145] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:54.249524] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-25T19:35:54.249585] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-25T19:35:54.249980] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-25T19:35:54.250039] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-25T19:35:54.288849] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-25T19:35:54.398350] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:35:54.422345] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T19:35:54.662785] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:55.088713] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-25T19:35:55.734125] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:35:55.888683] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-25T19:35:56.184093] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T19:35:56.688731] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-25T19:35:57.430440] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T19:35:57.438798] [INFO ] [REMOTE ] KAR: Full fetch complete (56682 records). [2025-09-25T19:35:57.438944] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-25T19:35:57.501444] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-25T19:35:57.883419] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-25T19:35:57.883556] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-25T19:35:57.884727] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-25T19:35:57.884791] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-25T19:35:57.887877] [DEBUG] [LOCAL ] KAR: Trimmed 56682 records to 40122 (keeping 200 days of data) [2025-09-25T19:35:58.180981] [DEBUG] [LOCAL ] KAR: Primary data saved (40122 records). [2025-09-25T19:35:58.181184] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-25T19:35:58.183845] [INFO ] [MAIN ] Update Progress: 1176/2372 symbols completed. KAR took 28.1s. Estimated remaining: 2h 38m 34s. Rate: 7.5 symbols/min [2025-09-25T19:35:58.294775] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-25T19:35:58.418265] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:35:58.451605] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T19:35:58.482993] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:35:58.546250] [DEBUG] [LOCAL ] KBR: Loaded 48149 existing records from primary storage. [2025-09-25T19:35:58.546505] [INFO ] [MAIN ] KBR: Loaded 48149 existing records. [2025-09-25T19:35:58.763494] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:35:58.763986] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-25T19:35:58.764059] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-25T19:35:58.764437] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-25T19:35:58.764529] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-25T19:35:59.105508] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-25T19:35:59.150842] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:35:59.469869] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T19:35:59.888727] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-25T19:36:00.688714] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-25T19:36:01.050510] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:36:01.102545] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-25T19:36:01.488739] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-25T19:36:02.288767] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-25T19:36:02.456386] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T19:36:02.754207] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T19:36:03.088768] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-25T19:36:03.888720] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-25T19:36:04.019375] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T19:36:04.441838] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T19:36:04.688740] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-25T19:36:05.126136] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T19:36:05.488825] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-25T19:36:06.221583] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:36:06.288675] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-25T19:36:06.448561] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T19:36:07.088716] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-25T19:36:07.888693] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-25T19:36:08.014410] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T19:36:08.325508] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T19:36:08.688741] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-25T19:36:09.488710] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-25T19:36:09.704416] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:36:09.954136] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T19:36:10.288728] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-25T19:36:11.088691] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-25T19:36:11.263530] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T19:36:11.475577] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T19:36:11.888694] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-25T19:36:12.157214] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T19:36:12.688711] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-25T19:36:13.488717] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-25T19:36:13.585822] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T19:36:13.976396] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:36:14.288761] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-25T19:36:15.088787] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-25T19:36:15.112708] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T19:36:15.237823] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T19:36:15.888812] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-25T19:36:16.688746] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-25T19:36:16.813419] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:36:17.491972] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-25T19:36:17.504726] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T19:36:17.534926] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T19:36:17.541290] [INFO ] [REMOTE ] KB: Full fetch complete (34479 records). [2025-09-25T19:36:17.541545] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-25T19:36:17.997448] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-25T19:36:17.997595] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-25T19:36:17.998537] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-25T19:36:17.998665] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-25T19:36:18.006911] [DEBUG] [LOCAL ] KB: Trimmed 34479 records to 24295 (keeping 200 days of data) [2025-09-25T19:36:18.184776] [DEBUG] [LOCAL ] KB: Primary data saved (24295 records). [2025-09-25T19:36:18.184941] [INFO ] [MAIN ] KB: Full history saved. [2025-09-25T19:36:18.185100] [INFO ] [MAIN ] Update Progress: 1177/2372 symbols completed. KB took 34.2s. Estimated remaining: 2h 38m 39s. Rate: 7.5 symbols/min [2025-09-25T19:36:18.291936] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-25T19:36:18.378335] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:18.464019] [DEBUG] [LOCAL ] KD: Loaded 52290 existing records from primary storage. [2025-09-25T19:36:18.464202] [INFO ] [MAIN ] KD: Loaded 52290 existing records. [2025-09-25T19:36:18.732073] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:36:18.732599] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-25T19:36:18.732675] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-25T19:36:18.733136] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-25T19:36:18.733196] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-25T19:36:19.095765] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-25T19:36:19.126347] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:19.215701] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:36:19.888704] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-25T19:36:20.060408] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T19:36:20.111149] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T19:36:20.688781] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-25T19:36:21.488783] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-25T19:36:21.585968] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T19:36:21.882368] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T19:36:22.288952] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-25T19:36:23.088936] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-25T19:36:23.232224] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T19:36:23.888696] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-25T19:36:24.078444] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T19:36:24.114357] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T19:36:24.688734] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-25T19:36:25.477105] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T19:36:25.487227] [INFO ] [REMOTE ] KBR: Full fetch complete (69981 records). [2025-09-25T19:36:25.487393] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-25T19:36:25.493927] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-25T19:36:25.901823] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-25T19:36:25.901934] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-25T19:36:25.903243] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-25T19:36:25.903312] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-25T19:36:25.905631] [DEBUG] [LOCAL ] KBR: Trimmed 69981 records to 48536 (keeping 200 days of data) [2025-09-25T19:36:26.228553] [DEBUG] [LOCAL ] KBR: Primary data saved (48536 records). [2025-09-25T19:36:26.228802] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-25T19:36:26.230011] [INFO ] [MAIN ] Update Progress: 1178/2372 symbols completed. KBR took 28.0s. Estimated remaining: 2h 38m 31s. Rate: 7.5 symbols/min [2025-09-25T19:36:26.300810] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-25T19:36:26.429406] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:26.444620] [DEBUG] [LOCAL ] KEN: Loaded 4766 existing records from primary storage. [2025-09-25T19:36:26.444806] [INFO ] [MAIN ] KEN: Loaded 4766 existing records. [2025-09-25T19:36:26.628874] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T19:36:26.705144] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:36:26.706691] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-25T19:36:26.706768] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-25T19:36:26.707021] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-25T19:36:26.707079] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-25T19:36:27.098179] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:27.093816] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-25T19:36:27.256007] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:36:27.710362] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T19:36:27.716679] [INFO ] [REMOTE ] KBDC: Full fetch complete (28191 records). [2025-09-25T19:36:27.716781] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-25T19:36:27.890613] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-25T19:36:28.110471] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-25T19:36:28.110573] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-25T19:36:28.111423] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-25T19:36:28.111490] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-25T19:36:28.112428] [DEBUG] [LOCAL ] KBDC: Trimmed 28191 records to 21035 (keeping 200 days of data) [2025-09-25T19:36:28.266808] [DEBUG] [LOCAL ] KBDC: Primary data saved (21035 records). [2025-09-25T19:36:28.266967] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-25T19:36:28.267093] [INFO ] [MAIN ] Update Progress: 1179/2372 symbols completed. KBDC took 36.4s. Estimated remaining: 2h 38m 17s. Rate: 7.5 symbols/min [2025-09-25T19:36:28.473993] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:28.536806] [DEBUG] [LOCAL ] KEP: Loaded 30642 existing records from primary storage. [2025-09-25T19:36:28.537025] [INFO ] [MAIN ] KEP: Loaded 30642 existing records. [2025-09-25T19:36:28.543461] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T19:36:28.692141] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-25T19:36:28.737158] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:36:28.738465] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-25T19:36:28.738525] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-25T19:36:28.738861] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-25T19:36:28.738932] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-25T19:36:28.868006] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T19:36:29.154667] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:29.344108] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T19:36:29.488767] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-25T19:36:30.288746] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-25T19:36:31.088816] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-25T19:36:31.294948] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T19:36:31.304950] [INFO ] [REMOTE ] KBH: Full fetch complete (70659 records). [2025-09-25T19:36:31.305159] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-25T19:36:31.786273] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-25T19:36:31.786417] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-25T19:36:31.788016] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-25T19:36:31.788098] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-25T19:36:31.792947] [DEBUG] [LOCAL ] KBH: Trimmed 70659 records to 49303 (keeping 200 days of data) [2025-09-25T19:36:31.908354] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-25T19:36:32.153874] [DEBUG] [LOCAL ] KBH: Primary data saved (49303 records). [2025-09-25T19:36:32.154092] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-25T19:36:32.154249] [INFO ] [MAIN ] Update Progress: 1180/2372 symbols completed. KBH took 38.3s. Estimated remaining: 2h 38m 5s. Rate: 7.5 symbols/min [2025-09-25T19:36:32.303386] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T19:36:32.359148] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:32.418038] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-25T19:36:32.457722] [DEBUG] [LOCAL ] KEX: Loaded 38021 existing records from primary storage. [2025-09-25T19:36:32.457903] [INFO ] [MAIN ] KEX: Loaded 38021 existing records. [2025-09-25T19:36:32.640952] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:36:32.641363] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-25T19:36:32.641431] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-25T19:36:32.641829] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-25T19:36:32.641900] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-25T19:36:32.691796] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-25T19:36:32.794989] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:36:33.052634] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:33.488734] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-25T19:36:34.002847] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-25T19:36:34.288708] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-25T19:36:34.442011] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T19:36:35.092241] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-25T19:36:35.093760] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T19:36:35.888738] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-25T19:36:36.688703] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-25T19:36:36.927296] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T19:36:37.085791] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T19:36:37.293901] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T19:36:37.488722] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-25T19:36:38.108798] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T19:36:38.288736] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-25T19:36:39.088728] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-25T19:36:39.888758] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-25T19:36:40.267620] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-25T19:36:40.635014] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T19:36:40.653150] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T19:36:40.688728] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-25T19:36:41.488752] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-25T19:36:41.522328] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T19:36:42.288753] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-25T19:36:42.808095] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T19:36:43.088770] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-25T19:36:43.888777] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-25T19:36:44.234832] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T19:36:44.367000] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T19:36:44.591945] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-25T19:36:44.688744] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-25T19:36:45.489045] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-25T19:36:46.052463] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T19:36:46.288754] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-25T19:36:46.383914] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T19:36:47.088758] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-25T19:36:47.693208] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T19:36:47.695055] [INFO ] [REMOTE ] KEN: Full fetch complete (5973 records). [2025-09-25T19:36:47.695192] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-25T19:36:47.885834] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T19:36:47.892844] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-25T19:36:48.162661] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-25T19:36:48.162778] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-25T19:36:48.163039] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-25T19:36:48.163107] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-25T19:36:48.163872] [DEBUG] [LOCAL ] KEN: Trimmed 5973 records to 4776 (keeping 200 days of data) [2025-09-25T19:36:48.197725] [DEBUG] [LOCAL ] KEN: Primary data saved (4776 records). [2025-09-25T19:36:48.197904] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-25T19:36:48.200877] [INFO ] [MAIN ] Update Progress: 1181/2372 symbols completed. KEN took 22.0s. Estimated remaining: 2h 38m 5s. Rate: 7.5 symbols/min [2025-09-25T19:36:48.398867] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:48.399106] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-25T19:36:48.399163] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-25T19:36:48.399714] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-25T19:36:48.399768] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-25T19:36:48.399813] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-25T19:36:48.399847] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-25T19:36:48.697789] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-25T19:36:48.829139] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:49.492139] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-25T19:36:49.850624] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:36:49.864910] [INFO ] [REMOTE ] KD: Full fetch complete (75579 records). [2025-09-25T19:36:49.865098] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-25T19:36:50.298016] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-25T19:36:50.298136] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-25T19:36:50.296987] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-25T19:36:50.299928] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-25T19:36:50.303052] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-25T19:36:50.309271] [DEBUG] [LOCAL ] KD: Trimmed 75579 records to 52678 (keeping 200 days of data) [2025-09-25T19:36:50.527527] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T19:36:50.687023] [DEBUG] [LOCAL ] KD: Primary data saved (52678 records). [2025-09-25T19:36:50.687202] [INFO ] [MAIN ] KD: Full history saved. [2025-09-25T19:36:50.687379] [INFO ] [MAIN ] Update Progress: 1182/2372 symbols completed. KD took 32.5s. Estimated remaining: 2h 37m 51s. Rate: 7.5 symbols/min [2025-09-25T19:36:50.878297] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:36:50.934371] [DEBUG] [LOCAL ] KEYS: Loaded 43320 existing records from primary storage. [2025-09-25T19:36:50.934550] [INFO ] [MAIN ] KEYS: Loaded 43320 existing records. [2025-09-25T19:36:51.096840] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-25T19:36:51.149323] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:36:51.149708] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-25T19:36:51.149779] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-25T19:36:51.150264] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-25T19:36:51.150360] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-25T19:36:51.291181] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T19:36:51.650833] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:36:51.674338] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T19:36:51.888741] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-25T19:36:52.338488] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T19:36:52.688734] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-25T19:36:53.195453] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T19:36:53.488756] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-25T19:36:54.215756] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T19:36:54.288754] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-25T19:36:55.088859] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-25T19:36:55.219350] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:36:55.598819] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T19:36:55.888737] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-25T19:36:56.688845] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-25T19:36:56.742166] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T19:36:57.500415] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-25T19:36:57.529724] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:36:58.182629] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:36:58.288683] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-25T19:36:58.707485] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T19:36:59.088777] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-25T19:36:59.580053] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T19:36:59.888774] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-25T19:37:00.688794] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-25T19:37:01.013453] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T19:37:01.490955] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-25T19:37:01.498244] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T19:37:02.288886] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-25T19:37:02.441109] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T19:37:02.944224] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:37:03.088759] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-25T19:37:03.888734] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-25T19:37:04.328811] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T19:37:04.688835] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-25T19:37:04.810137] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T19:37:04.820097] [INFO ] [REMOTE ] KEX: Full fetch complete (55545 records). [2025-09-25T19:37:04.820357] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-25T19:37:05.268564] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-25T19:37:05.268712] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-25T19:37:05.269843] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-25T19:37:05.269912] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-25T19:37:05.271384] [DEBUG] [LOCAL ] KEX: Trimmed 55545 records to 38367 (keeping 200 days of data) [2025-09-25T19:37:05.491313] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-25T19:37:05.583298] [DEBUG] [LOCAL ] KEX: Primary data saved (38367 records). [2025-09-25T19:37:05.583589] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-25T19:37:05.583964] [INFO ] [MAIN ] Update Progress: 1183/2372 symbols completed. KEX took 33.4s. Estimated remaining: 2h 37m 50s. Rate: 7.5 symbols/min [2025-09-25T19:37:05.799214] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T19:37:05.829851] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:05.839028] [DEBUG] [LOCAL ] KF: Loaded 2470 existing records from primary storage. [2025-09-25T19:37:05.839134] [INFO ] [MAIN ] KF: Loaded 2470 existing records. [2025-09-25T19:37:06.017089] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:06.017415] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-25T19:37:06.017486] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-25T19:37:06.017881] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-25T19:37:06.017962] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-25T19:37:06.294088] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-25T19:37:06.417882] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:06.663909] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T19:37:06.887944] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:37:06.894866] [INFO ] [REMOTE ] KEP: Full fetch complete (41647 records). [2025-09-25T19:37:06.895001] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-25T19:37:07.110760] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-25T19:37:07.328852] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-25T19:37:07.328962] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-25T19:37:07.330390] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-25T19:37:07.330456] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-25T19:37:07.338010] [DEBUG] [LOCAL ] KEP: Trimmed 41647 records to 30936 (keeping 200 days of data) [2025-09-25T19:37:07.556114] [DEBUG] [LOCAL ] KEP: Primary data saved (30936 records). [2025-09-25T19:37:07.556303] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-25T19:37:07.556497] [INFO ] [MAIN ] Update Progress: 1184/2372 symbols completed. KEP took 39.3s. Estimated remaining: 2h 37m 36s. Rate: 7.5 symbols/min [2025-09-25T19:37:07.736087] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:07.768715] [DEBUG] [LOCAL ] KFRC: Loaded 19440 existing records from primary storage. [2025-09-25T19:37:07.768874] [INFO ] [MAIN ] KFRC: Loaded 19440 existing records. [2025-09-25T19:37:07.893800] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-25T19:37:08.050243] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:08.050705] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-25T19:37:08.050765] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-25T19:37:08.051133] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-25T19:37:08.051194] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-25T19:37:08.206182] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T19:37:08.497814] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:08.688712] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-25T19:37:08.839662] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T19:37:08.924093] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:37:09.488686] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-25T19:37:09.680699] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T19:37:10.288687] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-25T19:37:10.911297] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T19:37:11.095931] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-25T19:37:11.122686] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T19:37:11.888732] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-25T19:37:11.981808] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T19:37:12.688744] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-25T19:37:13.488706] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-25T19:37:13.854217] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T19:37:13.902466] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T19:37:14.288727] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-25T19:37:14.474557] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T19:37:14.743429] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T19:37:15.088768] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-25T19:37:15.681928] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T19:37:15.888739] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-25T19:37:16.688731] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-25T19:37:16.916985] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T19:37:17.488767] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-25T19:37:18.059084] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:37:18.288742] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-25T19:37:18.600837] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T19:37:18.869883] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T19:37:19.088751] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-25T19:37:19.888798] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-25T19:37:20.170400] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T19:37:20.688736] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-25T19:37:21.488690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-25T19:37:21.587872] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T19:37:21.907012] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T19:37:22.288726] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-25T19:37:23.088753] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-25T19:37:23.250319] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:37:23.263637] [INFO ] [REMOTE ] KEY: Full fetch complete (77256 records). [2025-09-25T19:37:23.264043] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-25T19:37:23.374016] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T19:37:23.538719] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T19:37:23.540805] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:37:23.540935] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:37:23.541101] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-25T19:37:23.541236] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-25T19:37:23.541530] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-25T19:37:23.541616] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-25T19:37:23.541822] [INFO ] [MAIN ] Update Progress: 1185/2372 symbols completed. KEY took 35.3s. Estimated remaining: 2h 37m 36s. Rate: 7.5 symbols/min [2025-09-25T19:37:23.753024] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:23.774109] [DEBUG] [LOCAL ] KFS: Loaded 8319 existing records from primary storage. [2025-09-25T19:37:23.774262] [INFO ] [MAIN ] KFS: Loaded 8319 existing records. [2025-09-25T19:37:23.894820] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-25T19:37:23.983431] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:23.984088] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-25T19:37:23.984139] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-25T19:37:23.984891] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-25T19:37:23.984953] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-25T19:37:24.366438] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:24.549605] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T19:37:24.564451] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T19:37:24.688697] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-25T19:37:25.489034] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-25T19:37:26.148939] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T19:37:26.288690] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-25T19:37:26.517803] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T19:37:26.530048] [INFO ] [REMOTE ] KEYS: Full fetch complete (62995 records). [2025-09-25T19:37:26.530217] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-25T19:37:26.955581] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T19:37:26.981363] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-25T19:37:26.981477] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-25T19:37:26.982682] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-25T19:37:26.982790] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-25T19:37:26.989302] [DEBUG] [LOCAL ] KEYS: Trimmed 62995 records to 43637 (keeping 200 days of data) [2025-09-25T19:37:27.103360] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-25T19:37:27.321730] [DEBUG] [LOCAL ] KEYS: Primary data saved (43637 records). [2025-09-25T19:37:27.321932] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-25T19:37:27.322095] [INFO ] [MAIN ] Update Progress: 1186/2372 symbols completed. KEYS took 36.6s. Estimated remaining: 2h 37m 24s. Rate: 7.5 symbols/min [2025-09-25T19:37:27.514779] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:27.559670] [DEBUG] [LOCAL ] KFY: Loaded 30608 existing records from primary storage. [2025-09-25T19:37:27.559873] [INFO ] [MAIN ] KFY: Loaded 30608 existing records. [2025-09-25T19:37:27.576254] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T19:37:27.756907] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:27.757466] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-25T19:37:27.757639] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-25T19:37:27.758227] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-25T19:37:27.758293] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-25T19:37:27.896550] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-25T19:37:28.132513] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:28.688740] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-25T19:37:29.117205] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:37:29.488759] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-25T19:37:29.773759] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-25T19:37:30.288817] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-25T19:37:31.088845] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-25T19:37:31.530215] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T19:37:31.888743] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-25T19:37:32.460006] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T19:37:32.630146] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (3.94 seconds). [2025-09-25T19:37:32.688686] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-25T19:37:33.087682] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T19:37:33.093545] [INFO ] [REMOTE ] KFRC: Full fetch complete (25359 records). [2025-09-25T19:37:33.093731] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-25T19:37:33.229693] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T19:37:33.242565] [INFO ] [REMOTE ] KF: Full fetch complete (3706 records). [2025-09-25T19:37:33.242673] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-25T19:37:33.491796] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-25T19:37:33.759372] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-25T19:37:33.759487] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-25T19:37:33.760574] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-25T19:37:33.760664] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-25T19:37:33.775214] [DEBUG] [LOCAL ] KFRC: Trimmed 25359 records to 19601 (keeping 200 days of data) [2025-09-25T19:37:34.068796] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-25T19:37:34.069405] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-25T19:37:34.069978] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-25T19:37:34.070308] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-25T19:37:34.072090] [DEBUG] [LOCAL ] KF: Trimmed 3706 records to 2476 (keeping 200 days of data) [2025-09-25T19:37:34.078666] [DEBUG] [LOCAL ] KFRC: Primary data saved (19601 records). [2025-09-25T19:37:34.078897] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-25T19:37:34.079109] [INFO ] [MAIN ] Update Progress: 1187/2372 symbols completed. KFRC took 26.5s. Estimated remaining: 2h 37m 15s. Rate: 7.5 symbols/min [2025-09-25T19:37:34.219690] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T19:37:34.226254] [DEBUG] [LOCAL ] KF: Primary data saved (2476 records). [2025-09-25T19:37:34.226365] [INFO ] [MAIN ] KF: Full history saved. [2025-09-25T19:37:34.226571] [INFO ] [MAIN ] Update Progress: 1188/2372 symbols completed. KF took 28.6s. Estimated remaining: 2h 36m 59s. Rate: 7.5 symbols/min [2025-09-25T19:37:34.290805] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-25T19:37:34.423980] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:34.563059] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:34.631911] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-25T19:37:34.632092] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-25T19:37:34.802146] [DEBUG] [LOCAL ] KGS: Loaded 45757 existing records from primary storage. [2025-09-25T19:37:34.802339] [INFO ] [MAIN ] KGS: Loaded 45757 existing records. [2025-09-25T19:37:34.892248] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:34.892660] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-25T19:37:34.892743] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-25T19:37:34.893094] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-25T19:37:34.893162] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-25T19:37:35.099809] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-25T19:37:35.230798] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T19:37:35.276208] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:35.318886] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-25T19:37:35.318942] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-25T19:37:35.319220] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-25T19:37:35.319293] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-25T19:37:35.663221] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:35.870827] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:35.888675] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-25T19:37:36.517429] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:37:36.688743] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-25T19:37:37.498253] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-25T19:37:37.503096] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T19:37:38.288742] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-25T19:37:38.632970] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T19:37:38.726609] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:37:39.088741] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-25T19:37:39.896409] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-25T19:37:39.916601] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T19:37:40.518690] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T19:37:40.688711] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-25T19:37:40.915311] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T19:37:41.488735] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-25T19:37:41.779588] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T19:37:42.288750] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-25T19:37:43.088708] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-25T19:37:43.251023] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T19:37:43.504072] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-25T19:37:43.888752] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-25T19:37:44.631403] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T19:37:44.688713] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-25T19:37:45.362210] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T19:37:45.488724] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-25T19:37:45.918502] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T19:37:46.288746] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-25T19:37:47.088756] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-25T19:37:47.451071] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T19:37:47.847536] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T19:37:47.871392] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:37:47.888676] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-25T19:37:48.688723] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-25T19:37:49.229017] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T19:37:49.488735] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-25T19:37:50.284467] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T19:37:50.293796] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-25T19:37:50.886048] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T19:37:51.068908] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T19:37:51.088747] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-25T19:37:51.888729] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-25T19:37:52.044286] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T19:37:52.047298] [INFO ] [REMOTE ] KFS: Full fetch complete (10530 records). [2025-09-25T19:37:52.047381] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-25T19:37:52.418536] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-25T19:37:52.418639] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-25T19:37:52.419110] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-25T19:37:52.419152] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-25T19:37:52.419634] [DEBUG] [LOCAL ] KFS: Trimmed 10530 records to 8422 (keeping 200 days of data) [2025-09-25T19:37:52.489401] [DEBUG] [LOCAL ] KFS: Primary data saved (8422 records). [2025-09-25T19:37:52.489572] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-25T19:37:52.489734] [INFO ] [MAIN ] Update Progress: 1189/2372 symbols completed. KFS took 28.9s. Estimated remaining: 2h 37m 2s. Rate: 7.5 symbols/min [2025-09-25T19:37:52.666878] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:52.688752] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-25T19:37:52.772714] [DEBUG] [LOCAL ] KIM: Loaded 53063 existing records from primary storage. [2025-09-25T19:37:52.772908] [INFO ] [MAIN ] KIM: Loaded 53063 existing records. [2025-09-25T19:37:52.953250] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:37:52.953662] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-25T19:37:52.953739] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-25T19:37:52.954226] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-25T19:37:52.954327] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-25T19:37:53.314574] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:37:53.488686] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-25T19:37:53.788890] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T19:37:53.957868] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T19:37:54.288760] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-25T19:37:55.000018] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T19:37:55.088695] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-25T19:37:55.888687] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-25T19:37:56.033667] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T19:37:56.672882] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T19:37:56.688872] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-25T19:37:57.297621] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T19:37:57.489469] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-25T19:37:58.227521] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T19:37:58.288700] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-25T19:37:59.075547] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T19:37:59.088672] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-25T19:37:59.090770] [INFO ] [REMOTE ] KFY: Full fetch complete (43729 records). [2025-09-25T19:37:59.090914] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-25T19:37:59.493943] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-25T19:37:59.494053] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-25T19:37:59.495216] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-25T19:37:59.495404] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-25T19:37:59.496857] [DEBUG] [LOCAL ] KFY: Trimmed 43729 records to 30872 (keeping 200 days of data) [2025-09-25T19:37:59.714440] [DEBUG] [LOCAL ] KFY: Primary data saved (30872 records). [2025-09-25T19:37:59.714588] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-25T19:37:59.714834] [INFO ] [MAIN ] Update Progress: 1190/2372 symbols completed. KFY took 32.4s. Estimated remaining: 2h 36m 53s. Rate: 7.5 symbols/min [2025-09-25T19:37:59.892036] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-25T19:37:59.899193] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:37:59.929709] [DEBUG] [LOCAL ] KIO: Loaded 21295 existing records from primary storage. [2025-09-25T19:37:59.929892] [INFO ] [MAIN ] KIO: Loaded 21295 existing records. [2025-09-25T19:38:00.040393] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T19:38:00.163973] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:38:00.164322] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-25T19:38:00.164374] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-25T19:38:00.165505] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-25T19:38:00.165581] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-25T19:38:00.528845] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:00.688775] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-25T19:38:01.250421] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T19:38:01.336717] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T19:38:01.488795] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-25T19:38:01.896556] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T19:38:02.288896] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-25T19:38:03.088896] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-25T19:38:03.156289] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:38:03.365388] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T19:38:03.888843] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-25T19:38:04.688886] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-25T19:38:05.160952] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T19:38:05.488706] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-25T19:38:05.609869] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T19:38:06.288785] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-25T19:38:06.547580] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T19:38:07.088726] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-25T19:38:07.384760] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T19:38:07.436685] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T19:38:07.888830] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-25T19:38:08.631968] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T19:38:08.688690] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-25T19:38:08.812976] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:38:09.488721] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-25T19:38:09.832802] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T19:38:10.288740] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-25T19:38:11.088767] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-25T19:38:11.371033] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T19:38:11.682527] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T19:38:11.692620] [INFO ] [REMOTE ] KGC: Full fetch complete (77693 records). [2025-09-25T19:38:11.692978] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-25T19:38:11.910730] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-25T19:38:12.151001] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-25T19:38:12.151096] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-25T19:38:12.152156] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-25T19:38:12.152224] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-25T19:38:12.155241] [DEBUG] [LOCAL ] KGC: Trimmed 77693 records to 54089 (keeping 200 days of data) [2025-09-25T19:38:12.537579] [DEBUG] [LOCAL ] KGC: Primary data saved (54089 records). [2025-09-25T19:38:12.537759] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-25T19:38:12.538055] [INFO ] [MAIN ] Update Progress: 1191/2372 symbols completed. KGC took 38.5s. Estimated remaining: 2h 36m 50s. Rate: 7.5 symbols/min [2025-09-25T19:38:12.691723] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-25T19:38:12.725072] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:12.811583] [DEBUG] [LOCAL ] KKR: Loaded 53501 existing records from primary storage. [2025-09-25T19:38:12.811773] [INFO ] [MAIN ] KKR: Loaded 53501 existing records. [2025-09-25T19:38:12.960960] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T19:38:12.968723] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T19:38:13.064140] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:38:13.064454] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-25T19:38:13.064543] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-25T19:38:13.065013] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-25T19:38:13.065093] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-25T19:38:13.427108] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:13.488719] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-25T19:38:14.209781] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T19:38:14.220940] [INFO ] [REMOTE ] KGS: Full fetch complete (65997 records). [2025-09-25T19:38:14.221164] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-25T19:38:14.294797] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-25T19:38:14.646544] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-25T19:38:14.646669] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-25T19:38:14.647746] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-25T19:38:14.647830] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-25T19:38:14.655816] [DEBUG] [LOCAL ] KGS: Trimmed 65997 records to 46108 (keeping 200 days of data) [2025-09-25T19:38:14.991194] [DEBUG] [LOCAL ] KGS: Primary data saved (46108 records). [2025-09-25T19:38:14.991627] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-25T19:38:14.995055] [INFO ] [MAIN ] Update Progress: 1192/2372 symbols completed. KGS took 40.8s. Estimated remaining: 2h 36m 36s. Rate: 7.5 symbols/min [2025-09-25T19:38:15.103712] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-25T19:38:15.110222] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:38:15.262191] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:15.283027] [DEBUG] [LOCAL ] KKRS: Loaded 5740 existing records from primary storage. [2025-09-25T19:38:15.283212] [INFO ] [MAIN ] KKRS: Loaded 5740 existing records. [2025-09-25T19:38:15.463839] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:38:15.464274] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-25T19:38:15.464320] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-25T19:38:15.464537] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-25T19:38:15.464595] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-25T19:38:15.827447] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:15.888719] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-25T19:38:16.027872] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T19:38:16.461199] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T19:38:16.495137] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-25T19:38:16.688748] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-25T19:38:17.488709] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-25T19:38:17.819129] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T19:38:18.043417] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-25T19:38:18.288744] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-25T19:38:19.088728] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-25T19:38:19.673813] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T19:38:19.888729] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-25T19:38:20.051393] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:38:20.688765] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-25T19:38:21.123553] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T19:38:21.130007] [INFO ] [REMOTE ] KIO: Full fetch complete (30845 records). [2025-09-25T19:38:21.130102] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-25T19:38:21.499119] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-25T19:38:21.558080] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-25T19:38:21.558216] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-25T19:38:21.559296] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-25T19:38:21.559364] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-25T19:38:21.560703] [DEBUG] [LOCAL ] KIO: Trimmed 30845 records to 21449 (keeping 200 days of data) [2025-09-25T19:38:21.730036] [DEBUG] [LOCAL ] KIO: Primary data saved (21449 records). [2025-09-25T19:38:21.730230] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-25T19:38:21.730343] [INFO ] [MAIN ] Update Progress: 1193/2372 symbols completed. KIO took 22.0s. Estimated remaining: 2h 36m 27s. Rate: 7.5 symbols/min [2025-09-25T19:38:21.915320] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:21.915605] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-25T19:38:21.915683] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-25T19:38:21.916918] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-25T19:38:21.916965] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-25T19:38:21.917011] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-25T19:38:21.917046] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-25T19:38:22.129891] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T19:38:22.294086] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-25T19:38:22.331417] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:22.620319] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T19:38:23.088735] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-25T19:38:23.888753] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-25T19:38:24.461519] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T19:38:24.479157] [INFO ] [REMOTE ] KIM: Full fetch complete (76825 records). [2025-09-25T19:38:24.479479] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-25T19:38:24.706761] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-25T19:38:24.817017] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T19:38:24.908551] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T19:38:25.084761] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:25.085286] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-25T19:38:25.111794] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-25T19:38:25.111928] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-25T19:38:25.113589] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-25T19:38:25.113743] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-25T19:38:25.117053] [DEBUG] [LOCAL ] KIM: Trimmed 76825 records to 53446 (keeping 200 days of data) [2025-09-25T19:38:25.489739] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-25T19:38:25.524367] [DEBUG] [LOCAL ] KIM: Primary data saved (53446 records). [2025-09-25T19:38:25.524539] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-25T19:38:25.527230] [INFO ] [MAIN ] Update Progress: 1194/2372 symbols completed. KIM took 33.0s. Estimated remaining: 2h 36m 15s. Rate: 7.5 symbols/min [2025-09-25T19:38:25.715275] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:25.715795] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-25T19:38:25.716090] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-25T19:38:25.716298] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-25T19:38:25.716343] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-25T19:38:25.716392] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-25T19:38:25.716428] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-25T19:38:25.757291] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:25.757699] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-25T19:38:26.092338] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:26.288862] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-25T19:38:26.497851] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:26.498325] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-25T19:38:27.088786] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-25T19:38:27.289289] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:27.289894] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-25T19:38:27.888971] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-25T19:38:28.688810] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-25T19:38:28.910025] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:28.910561] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-25T19:38:29.488806] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-25T19:38:29.875781] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T19:38:30.208291] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T19:38:30.288730] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-25T19:38:31.086384] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T19:38:31.088782] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-25T19:38:31.297429] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:31.297974] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-25T19:38:31.888771] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-25T19:38:32.688898] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-25T19:38:33.195014] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T19:38:33.488704] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-25T19:38:33.564445] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:38:33.692262] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:33.692582] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-25T19:38:34.288969] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-25T19:38:34.508030] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:34.508406] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-25T19:38:35.088784] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-25T19:38:35.305515] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:35.305958] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-25T19:38:35.888735] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-25T19:38:36.085858] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:36.086287] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-25T19:38:36.688727] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-25T19:38:36.893374] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:36.893832] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-25T19:38:37.488722] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-25T19:38:37.968419] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T19:38:38.288745] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-25T19:38:38.502466] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:38.502910] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-25T19:38:39.088797] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-25T19:38:39.700354] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T19:38:39.888758] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-25T19:38:40.090236] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:40.090679] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-25T19:38:40.688748] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-25T19:38:41.488721] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-25T19:38:42.142024] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T19:38:42.144035] [INFO ] [REMOTE ] KKRS: Full fetch complete (8022 records). [2025-09-25T19:38:42.144178] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-25T19:38:42.293914] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-25T19:38:42.555132] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T19:38:42.632108] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-25T19:38:42.632200] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-25T19:38:42.632458] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-25T19:38:42.632557] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-25T19:38:42.633060] [DEBUG] [LOCAL ] KKRS: Trimmed 8022 records to 5781 (keeping 200 days of data) [2025-09-25T19:38:42.676313] [DEBUG] [LOCAL ] KKRS: Primary data saved (5781 records). [2025-09-25T19:38:42.676402] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-25T19:38:42.676672] [INFO ] [MAIN ] Update Progress: 1195/2372 symbols completed. KKRS took 27.7s. Estimated remaining: 2h 36m 16s. Rate: 7.5 symbols/min [2025-09-25T19:38:42.861245] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:42.939102] [DEBUG] [LOCAL ] KLC: Loaded 36523 existing records from primary storage. [2025-09-25T19:38:42.939294] [INFO ] [MAIN ] KLC: Loaded 36523 existing records. [2025-09-25T19:38:43.090383] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-25T19:38:43.126985] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T19:38:43.197745] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:38:43.198111] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-25T19:38:43.198187] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-25T19:38:43.199997] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-25T19:38:43.200093] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-25T19:38:43.349535] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:38:43.350114] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-25T19:38:43.598186] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:43.888751] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-25T19:38:44.688755] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-25T19:38:44.767104] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T19:38:45.488730] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-25T19:38:46.288722] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-25T19:38:46.451775] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:38:46.458146] [INFO ] [REMOTE ] KLAR: Full fetch complete (4412 records). [2025-09-25T19:38:46.458224] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-25T19:38:46.650314] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 12 unique days, need 200 days [2025-09-25T19:38:46.652412] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:38:46.652880] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:38:46.653182] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-25T19:38:46.653319] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-25T19:38:46.653425] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-25T19:38:46.653548] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-25T19:38:46.653741] [INFO ] [MAIN ] Update Progress: 1196/2372 symbols completed. KLAR took 21.1s. Estimated remaining: 2h 36m 4s. Rate: 7.5 symbols/min [2025-09-25T19:38:46.849699] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:38:46.973251] [DEBUG] [LOCAL ] KLG: Loaded 41876 existing records from primary storage. [2025-09-25T19:38:46.973483] [INFO ] [MAIN ] KLG: Loaded 41876 existing records. [2025-09-25T19:38:47.090036] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-25T19:38:47.178993] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:38:47.179327] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-25T19:38:47.179374] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-25T19:38:47.179986] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-25T19:38:47.180048] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-25T19:38:47.351520] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T19:38:47.691507] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:38:47.698253] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:38:47.888668] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-25T19:38:47.961678] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T19:38:48.688854] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-25T19:38:49.322094] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T19:38:49.488721] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-25T19:38:50.288717] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-25T19:38:50.631395] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T19:38:51.082410] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T19:38:51.091464] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-25T19:38:51.524812] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T19:38:51.888749] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-25T19:38:52.688751] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-25T19:38:52.983440] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T19:38:53.424924] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T19:38:53.464138] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T19:38:53.466625] [INFO ] [REMOTE ] KKRT: Full fetch complete (8610 records). [2025-09-25T19:38:53.466730] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-25T19:38:53.496572] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-25T19:38:53.663143] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-25T19:38:53.664131] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:38:53.664315] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:38:53.664548] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-25T19:38:53.666110] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-25T19:38:53.666172] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-25T19:38:53.666234] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-25T19:38:53.666344] [INFO ] [MAIN ] Update Progress: 1197/2372 symbols completed. KKRT took 31.9s. Estimated remaining: 2h 35m 55s. Rate: 7.5 symbols/min [2025-09-25T19:38:54.288816] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-25T19:38:55.088819] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-25T19:38:55.164981] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:38:55.888785] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-25T19:38:56.207132] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T19:38:56.378014] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T19:38:56.391564] [INFO ] [REMOTE ] KKR: Full fetch complete (77440 records). [2025-09-25T19:38:56.391759] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-25T19:38:56.697745] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-25T19:38:56.816621] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-25T19:38:56.816746] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-25T19:38:56.817816] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-25T19:38:56.817921] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-25T19:38:56.820084] [DEBUG] [LOCAL ] KKR: Trimmed 77440 records to 53891 (keeping 200 days of data) [2025-09-25T19:38:57.098348] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T19:38:57.225247] [DEBUG] [LOCAL ] KKR: Primary data saved (53891 records). [2025-09-25T19:38:57.225397] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-25T19:38:57.226823] [INFO ] [MAIN ] Update Progress: 1198/2372 symbols completed. KKR took 44.7s. Estimated remaining: 2h 35m 43s. Rate: 7.5 symbols/min [2025-09-25T19:38:57.488880] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-25T19:38:58.210291] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:38:58.288730] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-25T19:38:58.864869] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T19:38:59.088733] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-25T19:38:59.358014] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:38:59.888840] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-25T19:39:00.689022] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T19:39:00.709708] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-25T19:39:01.390194] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T19:39:01.488858] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-25T19:39:02.250256] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T19:39:02.288772] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-25T19:39:02.914422] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T19:39:03.088838] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-25T19:39:03.738564] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:39:03.888759] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-25T19:39:04.429236] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T19:39:04.688767] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-25T19:39:05.553687] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T19:39:05.569564] [INFO ] [REMOTE ] KLG: Full fetch complete (61794 records). [2025-09-25T19:39:05.569942] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-25T19:39:05.905804] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T19:39:05.927559] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-25T19:39:06.108629] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-25T19:39:06.108793] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-25T19:39:06.110405] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-25T19:39:06.110495] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-25T19:39:06.115351] [DEBUG] [LOCAL ] KLG: Trimmed 61794 records to 42246 (keeping 200 days of data) [2025-09-25T19:39:06.437524] [DEBUG] [LOCAL ] KLG: Primary data saved (42246 records). [2025-09-25T19:39:06.437768] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-25T19:39:06.438711] [INFO ] [MAIN ] Update Progress: 1199/2372 symbols completed. KLG took 19.8s. Estimated remaining: 2h 35m 36s. Rate: 7.5 symbols/min [2025-09-25T19:39:07.448404] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T19:39:07.459024] [INFO ] [REMOTE ] KLC: Full fetch complete (50748 records). [2025-09-25T19:39:07.459209] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-25T19:39:07.882176] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-25T19:39:07.882319] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-25T19:39:07.883175] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-25T19:39:07.883240] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-25T19:39:07.884403] [DEBUG] [LOCAL ] KLC: Trimmed 50748 records to 36807 (keeping 200 days of data) [2025-09-25T19:39:08.116932] [DEBUG] [LOCAL ] KLC: Primary data saved (36807 records). [2025-09-25T19:39:08.117124] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-25T19:39:08.117301] [INFO ] [MAIN ] Update Progress: 1200/2372 symbols completed. KLC took 25.4s. Estimated remaining: 2h 35m 22s. Rate: 7.5 symbols/min [2025-09-25T19:39:08.808083] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:08.810732] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:08.841765] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:08.901665] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:08.902882] [DEBUG] [LOCAL ] KMPB: Loaded 3581 existing records from primary storage. [2025-09-25T19:39:08.903036] [INFO ] [MAIN ] KMPB: Loaded 3581 existing records. [2025-09-25T19:39:09.063438] [DEBUG] [LOCAL ] KMT: Loaded 43072 existing records from primary storage. [2025-09-25T19:39:09.063618] [INFO ] [MAIN ] KMT: Loaded 43072 existing records. [2025-09-25T19:39:09.151613] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-25T19:39:09.168900] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-25T19:39:09.241398] [DEBUG] [LOCAL ] KMPR: Loaded 38424 existing records from primary storage. [2025-09-25T19:39:09.264810] [INFO ] [MAIN ] KMPR: Loaded 38424 existing records. [2025-09-25T19:39:09.633731] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:09.641117] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-25T19:39:09.641255] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-25T19:39:09.641610] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-25T19:39:09.643924] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-25T19:39:09.769148] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:09.775953] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-25T19:39:09.776006] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-25T19:39:09.776277] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-25T19:39:09.776335] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-25T19:39:10.165922] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:10.166189] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-25T19:39:10.166259] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-25T19:39:10.179192] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:10.179532] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-25T19:39:10.179593] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-25T19:39:10.179678] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-25T19:39:10.179778] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-25T19:39:10.225928] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-25T19:39:10.235453] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-25T19:39:11.218053] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:11.238781] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-25T19:39:11.275072] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:11.275345] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-25T19:39:11.528704] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:11.529070] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-25T19:39:11.578676] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:11.579042] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-25T19:39:11.925782] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T19:39:11.927541] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-25T19:39:12.400824] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T19:39:12.402635] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-25T19:39:12.858394] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T19:39:12.859822] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-25T19:39:12.862231] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T19:39:12.870954] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-25T19:39:12.908401] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T19:39:12.914123] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-25T19:39:13.530796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T19:39:13.532708] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-25T19:39:13.610152] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T19:39:13.808185] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T19:39:13.860799] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-25T19:39:14.288735] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-25T19:39:14.343471] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T19:39:14.780829] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-25T19:39:15.088693] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-25T19:39:15.888718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-25T19:39:16.496071] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T19:39:16.688713] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-25T19:39:16.746484] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T19:39:17.488735] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-25T19:39:18.288762] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-25T19:39:18.873297] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T19:39:19.036893] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-25T19:39:19.085138] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T19:39:19.096299] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-25T19:39:19.570396] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T19:39:19.888740] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-25T19:39:20.688725] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-25T19:39:21.191806] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T19:39:21.261672] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T19:39:21.488730] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-25T19:39:22.071711] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T19:39:22.072913] [INFO ] [REMOTE ] KMPB: Full fetch complete (4927 records). [2025-09-25T19:39:22.072987] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-25T19:39:22.296951] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-25T19:39:22.508490] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-25T19:39:22.508580] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-25T19:39:22.508752] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-25T19:39:22.508813] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-25T19:39:22.509184] [DEBUG] [LOCAL ] KMPB: Trimmed 4927 records to 3623 (keeping 200 days of data) [2025-09-25T19:39:22.532929] [DEBUG] [LOCAL ] KMPB: Primary data saved (3623 records). [2025-09-25T19:39:22.533043] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-25T19:39:22.533221] [INFO ] [MAIN ] Update Progress: 1201/2372 symbols completed. KMPB took 14.4s. Estimated remaining: 2h 35m 21s. Rate: 7.5 symbols/min [2025-09-25T19:39:22.715577] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:22.785665] [DEBUG] [LOCAL ] KMX: Loaded 53117 existing records from primary storage. [2025-09-25T19:39:22.785985] [INFO ] [MAIN ] KMX: Loaded 53117 existing records. [2025-09-25T19:39:22.983320] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:22.983724] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-25T19:39:22.983796] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-25T19:39:22.984182] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-25T19:39:22.984241] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-25T19:39:23.097862] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-25T19:39:23.374153] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:23.780102] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T19:39:23.888717] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-25T19:39:24.688700] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-25T19:39:25.181373] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T19:39:25.295504] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T19:39:25.488705] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-25T19:39:26.075895] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:39:26.288729] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-25T19:39:26.916564] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T19:39:27.088726] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-25T19:39:27.888770] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-25T19:39:28.043947] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T19:39:28.688728] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-25T19:39:28.904476] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T19:39:29.196515] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-25T19:39:29.488753] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-25T19:39:30.294742] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-25T19:39:30.313669] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T19:39:30.743088] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T19:39:31.088741] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-25T19:39:31.888730] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-25T19:39:32.182318] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T19:39:32.670351] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T19:39:32.688685] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-25T19:39:33.237984] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:39:33.488769] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-25T19:39:34.270450] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T19:39:34.288769] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-25T19:39:35.088784] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-25T19:39:35.468544] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T19:39:35.551913] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T19:39:35.888792] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-25T19:39:36.688718] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-25T19:39:36.961272] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T19:39:37.488849] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-25T19:39:37.743776] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T19:39:38.288731] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-25T19:39:38.557221] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T19:39:38.572383] [INFO ] [REMOTE ] KMPR: Full fetch complete (50842 records). [2025-09-25T19:39:38.572544] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-25T19:39:39.021453] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-25T19:39:39.021583] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-25T19:39:39.022517] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-25T19:39:39.022638] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-25T19:39:39.048768] [DEBUG] [LOCAL ] KMPR: Trimmed 50842 records to 38785 (keeping 200 days of data) [2025-09-25T19:39:39.126534] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-25T19:39:39.179229] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T19:39:39.342617] [DEBUG] [LOCAL ] KMPR: Primary data saved (38785 records). [2025-09-25T19:39:39.342791] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-25T19:39:39.343016] [INFO ] [MAIN ] Update Progress: 1202/2372 symbols completed. KMPR took 31.2s. Estimated remaining: 2h 35m 21s. Rate: 7.5 symbols/min [2025-09-25T19:39:39.524432] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:39.581749] [DEBUG] [LOCAL ] KN: Loaded 38876 existing records from primary storage. [2025-09-25T19:39:39.581906] [INFO ] [MAIN ] KN: Loaded 38876 existing records. [2025-09-25T19:39:39.760293] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:39.760983] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-25T19:39:39.761038] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-25T19:39:39.761515] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-25T19:39:39.761583] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-25T19:39:39.902310] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-25T19:39:40.127463] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:40.421850] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T19:39:40.688712] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-25T19:39:40.806527] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T19:39:41.387665] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T19:39:41.488700] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-25T19:39:42.074959] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:39:42.288733] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-25T19:39:43.088728] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-25T19:39:43.277029] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T19:39:43.897953] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T19:39:43.910729] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-25T19:39:44.543411] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:39:44.688720] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-25T19:39:45.488743] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-25T19:39:45.954355] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-25T19:39:45.993856] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T19:39:46.289807] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-25T19:39:47.088720] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-25T19:39:47.479294] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-25T19:39:47.491044] [INFO ] [REMOTE ] KMI: Full fetch complete (77764 records). [2025-09-25T19:39:47.491248] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-25T19:39:47.854135] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T19:39:47.893789] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-25T19:39:47.985594] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-25T19:39:47.985713] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-25T19:39:47.986889] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-25T19:39:47.986959] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-25T19:39:47.988577] [DEBUG] [LOCAL ] KMI: Trimmed 77764 records to 54083 (keeping 200 days of data) [2025-09-25T19:39:48.345826] [DEBUG] [LOCAL ] KMI: Primary data saved (54083 records). [2025-09-25T19:39:48.345979] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-25T19:39:48.346155] [INFO ] [MAIN ] Update Progress: 1203/2372 symbols completed. KMI took 40.2s. Estimated remaining: 2h 35m 14s. Rate: 7.5 symbols/min [2025-09-25T19:39:48.525161] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:48.574391] [DEBUG] [LOCAL ] KNF: Loaded 35874 existing records from primary storage. [2025-09-25T19:39:48.574612] [INFO ] [MAIN ] KNF: Loaded 35874 existing records. [2025-09-25T19:39:48.693833] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-25T19:39:48.779371] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:48.779788] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-25T19:39:48.779879] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-25T19:39:48.780327] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-25T19:39:48.780406] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-25T19:39:49.079276] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-25T19:39:49.235805] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:49.471471] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T19:39:49.488687] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-25T19:39:50.288684] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-25T19:39:50.741545] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-25T19:39:50.754608] [INFO ] [REMOTE ] KMX: Full fetch complete (75965 records). [2025-09-25T19:39:50.756760] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-25T19:39:50.873920] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:39:51.093827] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-25T19:39:51.213898] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-25T19:39:51.213995] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-25T19:39:51.215061] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-25T19:39:51.215126] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-25T19:39:51.217348] [DEBUG] [LOCAL ] KMX: Trimmed 75965 records to 53507 (keeping 200 days of data) [2025-09-25T19:39:51.559420] [DEBUG] [LOCAL ] KMX: Primary data saved (53507 records). [2025-09-25T19:39:51.559565] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-25T19:39:51.561408] [INFO ] [MAIN ] Update Progress: 1204/2372 symbols completed. KMX took 29.0s. Estimated remaining: 2h 35m 2s. Rate: 7.5 symbols/min [2025-09-25T19:39:51.713208] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T19:39:51.726815] [INFO ] [REMOTE ] KMT: Full fetch complete (62064 records). [2025-09-25T19:39:51.726948] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-25T19:39:51.901080] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:51.910065] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-25T19:39:51.987463] [DEBUG] [LOCAL ] KNOP: Loaded 9990 existing records from primary storage. [2025-09-25T19:39:51.987611] [INFO ] [MAIN ] KNOP: Loaded 9990 existing records. [2025-09-25T19:39:52.413803] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:52.414092] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-25T19:39:52.414142] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-25T19:39:52.414464] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-25T19:39:52.414524] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-25T19:39:52.468920] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-25T19:39:52.469007] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-25T19:39:52.470031] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-25T19:39:52.470095] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-25T19:39:52.477762] [DEBUG] [LOCAL ] KMT: Trimmed 62064 records to 43390 (keeping 200 days of data) [2025-09-25T19:39:52.660460] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T19:39:52.690882] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-25T19:39:53.173621] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T19:39:53.187040] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:53.200830] [DEBUG] [LOCAL ] KMT: Primary data saved (43390 records). [2025-09-25T19:39:53.201009] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-25T19:39:53.201136] [INFO ] [MAIN ] Update Progress: 1205/2372 symbols completed. KMT took 45.1s. Estimated remaining: 2h 34m 48s. Rate: 7.5 symbols/min [2025-09-25T19:39:53.382634] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:39:53.409034] [DEBUG] [LOCAL ] KNSL: Loaded 18098 existing records from primary storage. [2025-09-25T19:39:53.409186] [INFO ] [MAIN ] KNSL: Loaded 18098 existing records. [2025-09-25T19:39:53.494759] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-25T19:39:53.612433] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:39:53.612801] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-25T19:39:53.612893] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-25T19:39:53.613318] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-25T19:39:53.613380] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-25T19:39:54.148456] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T19:39:54.204058] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:39:54.288713] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-25T19:39:54.528494] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T19:39:55.088736] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-25T19:39:55.387769] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T19:39:55.888768] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-25T19:39:55.941048] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T19:39:56.688694] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-25T19:39:57.160621] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T19:39:57.488744] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-25T19:39:57.796764] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T19:39:58.288712] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-25T19:39:59.040303] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T19:39:59.088691] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-25T19:39:59.344723] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T19:39:59.888740] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-25T19:40:00.248564] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T19:40:00.688777] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-25T19:40:00.996039] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T19:40:01.488850] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-25T19:40:01.504868] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T19:40:02.288911] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-25T19:40:03.026387] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T19:40:03.088793] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-25T19:40:03.641372] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T19:40:03.888883] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-25T19:40:04.310502] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T19:40:04.688778] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-25T19:40:05.364238] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T19:40:05.488769] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-25T19:40:06.237099] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T19:40:06.288705] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-25T19:40:07.005435] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:40:07.088699] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-25T19:40:07.169220] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T19:40:07.888900] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-25T19:40:08.144617] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T19:40:08.688791] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-25T19:40:08.909550] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T19:40:09.488768] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-25T19:40:09.746367] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:40:10.288722] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-25T19:40:10.330826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T19:40:11.088700] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-25T19:40:11.491236] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T19:40:11.660591] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T19:40:11.888745] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-25T19:40:12.688756] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-25T19:40:12.784856] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T19:40:13.488722] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-25T19:40:13.775364] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T19:40:14.220768] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T19:40:14.288714] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-25T19:40:15.088708] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-25T19:40:15.211127] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T19:40:15.214832] [INFO ] [REMOTE ] KNOP: Full fetch complete (14643 records). [2025-09-25T19:40:15.214970] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-25T19:40:15.615457] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-25T19:40:15.615574] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-25T19:40:15.615982] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-25T19:40:15.616093] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-25T19:40:15.616717] [DEBUG] [LOCAL ] KNOP: Trimmed 14643 records to 10121 (keeping 200 days of data) [2025-09-25T19:40:15.709193] [DEBUG] [LOCAL ] KNOP: Primary data saved (10121 records). [2025-09-25T19:40:15.709332] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-25T19:40:15.709542] [INFO ] [MAIN ] Update Progress: 1206/2372 symbols completed. KNOP took 24.1s. Estimated remaining: 2h 34m 54s. Rate: 7.5 symbols/min [2025-09-25T19:40:15.880218] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:15.888683] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-25T19:40:15.965433] [DEBUG] [LOCAL ] KNTK: Loaded 46087 existing records from primary storage. [2025-09-25T19:40:15.965585] [INFO ] [MAIN ] KNTK: Loaded 46087 existing records. [2025-09-25T19:40:16.149520] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:16.150290] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-25T19:40:16.150366] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-25T19:40:16.151359] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-25T19:40:16.151444] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-25T19:40:16.296668] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T19:40:16.311556] [INFO ] [REMOTE ] KNSL: Full fetch complete (26764 records). [2025-09-25T19:40:16.311640] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-25T19:40:16.693546] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-25T19:40:16.772806] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:16.946680] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-25T19:40:16.946807] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-25T19:40:16.947450] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-25T19:40:16.947511] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-25T19:40:16.948328] [DEBUG] [LOCAL ] KNSL: Trimmed 26764 records to 18261 (keeping 200 days of data) [2025-09-25T19:40:17.081951] [DEBUG] [LOCAL ] KNSL: Primary data saved (18261 records). [2025-09-25T19:40:17.082091] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-25T19:40:17.082222] [INFO ] [MAIN ] Update Progress: 1207/2372 symbols completed. KNSL took 23.9s. Estimated remaining: 2h 34m 40s. Rate: 7.5 symbols/min [2025-09-25T19:40:17.257093] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:17.330695] [DEBUG] [LOCAL ] KNX: Loaded 52595 existing records from primary storage. [2025-09-25T19:40:17.330847] [INFO ] [MAIN ] KNX: Loaded 52595 existing records. [2025-09-25T19:40:17.438070] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T19:40:17.493804] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-25T19:40:17.561638] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:17.561964] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-25T19:40:17.562016] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-25T19:40:17.562391] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-25T19:40:17.562451] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-25T19:40:17.918075] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:18.288734] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-25T19:40:19.088785] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-25T19:40:19.243176] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-25T19:40:19.254053] [INFO ] [REMOTE ] KN: Full fetch complete (56399 records). [2025-09-25T19:40:19.254182] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-25T19:40:19.280011] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T19:40:19.288362] [INFO ] [REMOTE ] KNF: Full fetch complete (50566 records). [2025-09-25T19:40:19.288621] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-25T19:40:20.123709] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T19:40:20.184026] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-25T19:40:20.267488] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-25T19:40:20.267635] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-25T19:40:20.268346] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-25T19:40:20.268409] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-25T19:40:20.270493] [DEBUG] [LOCAL ] KN: Trimmed 56399 records to 39156 (keeping 200 days of data) [2025-09-25T19:40:20.438350] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-25T19:40:20.439335] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-25T19:40:20.440781] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-25T19:40:20.440861] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-25T19:40:20.443620] [DEBUG] [LOCAL ] KNF: Trimmed 50566 records to 36152 (keeping 200 days of data) [2025-09-25T19:40:20.755754] [DEBUG] [LOCAL ] KN: Primary data saved (39156 records). [2025-09-25T19:40:20.756009] [INFO ] [MAIN ] KN: Full history saved. [2025-09-25T19:40:20.757938] [INFO ] [MAIN ] Update Progress: 1208/2372 symbols completed. KN took 41.4s. Estimated remaining: 2h 34m 27s. Rate: 7.5 symbols/min [2025-09-25T19:40:20.866882] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T19:40:20.895060] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-25T19:40:21.083758] [DEBUG] [LOCAL ] KNF: Primary data saved (36152 records). [2025-09-25T19:40:21.084007] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-25T19:40:21.084168] [INFO ] [MAIN ] Update Progress: 1209/2372 symbols completed. KNF took 32.7s. Estimated remaining: 2h 34m 12s. Rate: 7.5 symbols/min [2025-09-25T19:40:21.262125] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:21.292786] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-09-25T19:40:21.292990] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-09-25T19:40:21.311696] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-25T19:40:21.317698] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-25T19:40:21.323708] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-25T19:40:21.345700] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-25T19:40:21.384797] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:21.549012] [DEBUG] [LOCAL ] KODK: Loaded 43383 existing records from primary storage. [2025-09-25T19:40:21.549289] [INFO ] [MAIN ] KODK: Loaded 43383 existing records. [2025-09-25T19:40:22.066831] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:22.067097] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-25T19:40:22.067144] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-25T19:40:22.077684] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-25T19:40:22.077766] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-25T19:40:22.073272] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T19:40:22.123455] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-25T19:40:22.156279] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T19:40:22.294780] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-25T19:40:22.362100] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:22.613327] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:23.088747] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-25T19:40:23.880958] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T19:40:23.890438] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-25T19:40:23.959139] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:40:24.688721] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-25T19:40:25.432336] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:40:25.488681] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-25T19:40:25.843170] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-25T19:40:26.288703] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-25T19:40:26.484193] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T19:40:26.733975] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T19:40:27.088697] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-25T19:40:27.888701] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-25T19:40:28.688763] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-25T19:40:28.734037] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T19:40:28.882878] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-25T19:40:29.448820] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T19:40:29.488677] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-25T19:40:30.288710] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-25T19:40:30.483317] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T19:40:31.070241] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T19:40:31.088676] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-25T19:40:31.888760] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-25T19:40:32.635588] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-25T19:40:32.695996] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-25T19:40:32.721634] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T19:40:33.288792] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T19:40:33.488733] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-25T19:40:34.288785] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-25T19:40:35.089869] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-25T19:40:35.128426] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:40:35.234268] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-25T19:40:35.888725] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-25T19:40:36.079420] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T19:40:36.688712] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-25T19:40:36.780681] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T19:40:37.488848] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-25T19:40:38.288939] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-25T19:40:38.417633] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:40:38.590196] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-25T19:40:39.094469] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-25T19:40:39.117050] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T19:40:39.888815] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-25T19:40:40.242898] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T19:40:40.514189] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T19:40:40.688722] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-25T19:40:41.295406] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T19:40:41.488745] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-25T19:40:42.288773] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-25T19:40:43.088798] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-25T19:40:43.745223] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T19:40:43.888720] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-25T19:40:44.144481] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-25T19:40:44.516315] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T19:40:44.528566] [INFO ] [REMOTE ] KNTK: Full fetch complete (64198 records). [2025-09-25T19:40:44.528779] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-25T19:40:44.693979] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-25T19:40:44.999989] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-25T19:40:45.000104] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-25T19:40:45.001313] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-25T19:40:45.001443] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-25T19:40:45.003149] [DEBUG] [LOCAL ] KNTK: Trimmed 64198 records to 46447 (keeping 200 days of data) [2025-09-25T19:40:45.332230] [DEBUG] [LOCAL ] KNTK: Primary data saved (46447 records). [2025-09-25T19:40:45.332481] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-25T19:40:45.334221] [INFO ] [MAIN ] Update Progress: 1210/2372 symbols completed. KNTK took 29.6s. Estimated remaining: 2h 34m 20s. Rate: 7.5 symbols/min [2025-09-25T19:40:45.543685] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:45.575116] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T19:40:45.585435] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-25T19:40:45.616545] [DEBUG] [LOCAL ] KOF: Loaded 25908 existing records from primary storage. [2025-09-25T19:40:45.616762] [INFO ] [MAIN ] KOF: Loaded 25908 existing records. [2025-09-25T19:40:45.810112] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:45.810851] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-25T19:40:45.810918] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-25T19:40:45.811546] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-25T19:40:45.811624] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-25T19:40:46.186233] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:46.288695] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-25T19:40:47.211246] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-25T19:40:47.222519] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-25T19:40:47.346833] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:40:47.527844] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (6.84 seconds). [2025-09-25T19:40:47.566218] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T19:40:47.888781] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-25T19:40:48.688749] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-25T19:40:49.493896] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-25T19:40:49.497197] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T19:40:49.507702] [INFO ] [REMOTE ] KODK: Full fetch complete (63431 records). [2025-09-25T19:40:49.507852] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-25T19:40:49.955951] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-25T19:40:49.956071] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-25T19:40:49.957089] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-25T19:40:49.957164] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-25T19:40:49.958985] [DEBUG] [LOCAL ] KODK: Trimmed 63431 records to 43657 (keeping 200 days of data) [2025-09-25T19:40:50.099972] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-25T19:40:50.274112] [DEBUG] [LOCAL ] KODK: Primary data saved (43657 records). [2025-09-25T19:40:50.274279] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-25T19:40:50.274415] [INFO ] [MAIN ] Update Progress: 1211/2372 symbols completed. KODK took 29.2s. Estimated remaining: 2h 34m 9s. Rate: 7.5 symbols/min [2025-09-25T19:40:50.290878] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-25T19:40:50.458792] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:50.488300] [DEBUG] [LOCAL ] KOP: Loaded 17845 existing records from primary storage. [2025-09-25T19:40:50.488475] [INFO ] [MAIN ] KOP: Loaded 17845 existing records. [2025-09-25T19:40:50.697976] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T19:40:50.708609] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:50.708921] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-25T19:40:50.708979] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-25T19:40:50.709247] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-25T19:40:50.709326] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-25T19:40:50.843304] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-25T19:40:50.887477] [INFO ] [REMOTE ] KNX: Full fetch complete (75739 records). [2025-09-25T19:40:50.887717] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-25T19:40:51.115778] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-25T19:40:51.370146] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:51.570490] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-25T19:40:51.570579] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-25T19:40:51.571573] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-25T19:40:51.571639] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-25T19:40:51.573203] [DEBUG] [LOCAL ] KNX: Trimmed 75739 records to 52981 (keeping 200 days of data) [2025-09-25T19:40:51.898736] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-25T19:40:51.926416] [DEBUG] [LOCAL ] KNX: Primary data saved (52981 records). [2025-09-25T19:40:51.926618] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-25T19:40:51.926834] [INFO ] [MAIN ] Update Progress: 1212/2372 symbols completed. KNX took 34.8s. Estimated remaining: 2h 33m 55s. Rate: 7.5 symbols/min [2025-09-25T19:40:52.112150] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:52.117545] [DEBUG] [LOCAL ] KORE: Loaded 1970 existing records from primary storage. [2025-09-25T19:40:52.117707] [INFO ] [MAIN ] KORE: Loaded 1970 existing records. [2025-09-25T19:40:52.306178] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:52.307233] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-25T19:40:52.307282] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-25T19:40:52.307488] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-25T19:40:52.307547] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-25T19:40:52.413048] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T19:40:52.693913] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-25T19:40:52.767723] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:52.773260] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T19:40:52.958021] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-25T19:40:53.488737] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-25T19:40:54.035940] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T19:40:54.288766] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-25T19:40:54.500963] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T19:40:55.088687] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-25T19:40:55.370972] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:40:55.888726] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-25T19:40:56.688748] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-25T19:40:57.175087] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:40:57.488757] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-25T19:40:57.736336] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T19:40:57.747250] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-25T19:40:57.758906] [INFO ] [REMOTE ] KO: Full fetch complete (77214 records). [2025-09-25T19:40:57.759166] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-25T19:40:57.992694] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T19:40:57.993866] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:40:57.993990] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:40:57.994116] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-25T19:40:57.994290] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-09-25T19:40:57.994413] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-09-25T19:40:57.994503] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-09-25T19:40:57.994717] [INFO ] [MAIN ] Update Progress: 1213/2372 symbols completed. KO took 37.2s. Estimated remaining: 2h 33m 45s. Rate: 7.5 symbols/min [2025-09-25T19:40:58.198633] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:40:58.288749] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-25T19:40:58.321991] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T19:40:58.330210] [DEBUG] [LOCAL ] KOS: Loaded 53064 existing records from primary storage. [2025-09-25T19:40:58.330442] [INFO ] [MAIN ] KOS: Loaded 53064 existing records. [2025-09-25T19:40:58.521405] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:40:58.521847] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-25T19:40:58.521909] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-25T19:40:58.522411] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-25T19:40:58.522473] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-25T19:40:58.888512] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:40:59.088709] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-25T19:40:59.454507] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T19:40:59.888755] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-25T19:41:00.314746] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T19:41:00.688835] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-25T19:41:01.488734] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-25T19:41:01.868512] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T19:41:01.929174] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-25T19:41:02.044349] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T19:41:02.288735] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-25T19:41:03.088690] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-25T19:41:03.408071] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T19:41:03.888730] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-25T19:41:04.366445] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T19:41:04.688745] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-25T19:41:05.488732] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-25T19:41:05.756171] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T19:41:05.976626] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T19:41:06.083615] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T19:41:06.288708] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-25T19:41:06.722909] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T19:41:07.088705] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-25T19:41:07.465750] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-25T19:41:07.888756] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-25T19:41:08.688696] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-25T19:41:09.055281] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-25T19:41:09.079597] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T19:41:09.488739] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-25T19:41:10.288739] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-25T19:41:10.726554] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T19:41:11.070615] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:41:11.088666] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-25T19:41:11.888709] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-25T19:41:12.101536] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T19:41:12.688719] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-25T19:41:13.488688] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-25T19:41:13.654438] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:41:13.711753] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T19:41:13.976982] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T19:41:14.289130] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-25T19:41:15.088824] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-25T19:41:15.660447] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T19:41:15.682325] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:41:15.687747] [INFO ] [REMOTE ] KOF: Full fetch complete (36965 records). [2025-09-25T19:41:15.687854] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-25T19:41:15.894268] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-25T19:41:16.091442] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-25T19:41:16.091845] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-25T19:41:16.093052] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-25T19:41:16.093148] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-25T19:41:16.095399] [DEBUG] [LOCAL ] KOF: Trimmed 36965 records to 26094 (keeping 200 days of data) [2025-09-25T19:41:16.269563] [DEBUG] [LOCAL ] KOF: Primary data saved (26094 records). [2025-09-25T19:41:16.269743] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-25T19:41:16.269879] [INFO ] [MAIN ] Update Progress: 1214/2372 symbols completed. KOF took 30.9s. Estimated remaining: 2h 33m 47s. Rate: 7.5 symbols/min [2025-09-25T19:41:16.387894] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T19:41:16.389020] [INFO ] [REMOTE ] KORE: Full fetch complete (6061 records). [2025-09-25T19:41:16.389094] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-25T19:41:16.483442] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:16.688699] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-25T19:41:16.783298] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-25T19:41:16.783501] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-25T19:41:17.049391] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-25T19:41:17.049496] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-25T19:41:17.049784] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-25T19:41:17.049893] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-25T19:41:17.050701] [DEBUG] [LOCAL ] KORE: Trimmed 6061 records to 1990 (keeping 200 days of data) [2025-09-25T19:41:17.064030] [DEBUG] [LOCAL ] KORE: Primary data saved (1990 records). [2025-09-25T19:41:17.064203] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-25T19:41:17.064324] [INFO ] [MAIN ] Update Progress: 1215/2372 symbols completed. KORE took 25.1s. Estimated remaining: 2h 33m 32s. Rate: 7.5 symbols/min [2025-09-25T19:41:17.221377] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:17.221689] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-25T19:41:17.221751] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-25T19:41:17.222248] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-25T19:41:17.222321] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-25T19:41:17.417607] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:17.503074] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-25T19:41:17.596261] [DEBUG] [LOCAL ] KRC: Loaded 48389 existing records from primary storage. [2025-09-25T19:41:17.596491] [INFO ] [MAIN ] KRC: Loaded 48389 existing records. [2025-09-25T19:41:18.036194] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:18.037603] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:18.036599] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-25T19:41:18.038203] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-25T19:41:18.038604] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-25T19:41:18.038708] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-25T19:41:18.290129] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-25T19:41:18.427553] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:18.703896] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T19:41:18.840825] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T19:41:18.846723] [INFO ] [REMOTE ] KOP: Full fetch complete (25430 records). [2025-09-25T19:41:18.846853] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-25T19:41:19.089465] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-25T19:41:19.261276] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-25T19:41:19.261407] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-25T19:41:19.262369] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-25T19:41:19.262465] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-25T19:41:19.263818] [DEBUG] [LOCAL ] KOP: Trimmed 25430 records to 17944 (keeping 200 days of data) [2025-09-25T19:41:19.393334] [DEBUG] [LOCAL ] KOP: Primary data saved (17944 records). [2025-09-25T19:41:19.393566] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-25T19:41:19.393743] [INFO ] [MAIN ] Update Progress: 1216/2372 symbols completed. KOP took 29.1s. Estimated remaining: 2h 33m 19s. Rate: 7.5 symbols/min [2025-09-25T19:41:19.582950] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:19.638908] [DEBUG] [LOCAL ] KREF: Loaded 37132 existing records from primary storage. [2025-09-25T19:41:19.639122] [INFO ] [MAIN ] KREF: Loaded 37132 existing records. [2025-09-25T19:41:19.870667] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:19.871113] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-25T19:41:19.871210] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-25T19:41:19.871625] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-25T19:41:19.871735] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-25T19:41:19.916283] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-25T19:41:20.337754] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-25T19:41:20.384942] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:20.688750] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-25T19:41:20.794537] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T19:41:21.488757] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-25T19:41:21.762814] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T19:41:21.813949] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T19:41:22.288754] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-25T19:41:23.088739] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-25T19:41:23.225189] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T19:41:23.880922] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T19:41:23.890739] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-25T19:41:24.431881] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T19:41:24.688755] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-25T19:41:25.324290] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T19:41:25.488728] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-25T19:41:26.288713] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-25T19:41:26.580632] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T19:41:27.088701] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-25T19:41:27.506521] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T19:41:27.565057] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T19:41:27.888764] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-25T19:41:28.688733] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-25T19:41:28.977847] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T19:41:29.011590] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T19:41:29.488740] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-25T19:41:30.288702] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-25T19:41:30.779183] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T19:41:30.831713] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T19:41:31.088722] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-25T19:41:31.741658] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T19:41:31.752620] [INFO ] [REMOTE ] KOS: Full fetch complete (76848 records). [2025-09-25T19:41:31.752833] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-25T19:41:31.899031] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-25T19:41:32.199710] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-25T19:41:32.199830] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-25T19:41:32.201052] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-25T19:41:32.201126] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-25T19:41:32.203217] [DEBUG] [LOCAL ] KOS: Trimmed 76848 records to 53448 (keeping 200 days of data) [2025-09-25T19:41:32.538878] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T19:41:32.599803] [DEBUG] [LOCAL ] KOS: Primary data saved (53448 records). [2025-09-25T19:41:32.600041] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-25T19:41:32.601403] [INFO ] [MAIN ] Update Progress: 1217/2372 symbols completed. KOS took 34.6s. Estimated remaining: 2h 33m 16s. Rate: 7.5 symbols/min [2025-09-25T19:41:32.693806] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-25T19:41:32.816221] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:32.899338] [DEBUG] [LOCAL ] KRG: Loaded 49177 existing records from primary storage. [2025-09-25T19:41:32.899609] [INFO ] [MAIN ] KRG: Loaded 49177 existing records. [2025-09-25T19:41:33.112250] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:33.112797] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-25T19:41:33.112887] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-25T19:41:33.113299] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-25T19:41:33.113382] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-25T19:41:33.269381] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T19:41:33.493876] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-25T19:41:33.559345] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:34.288891] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-25T19:41:34.692517] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-25T19:41:35.079928] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T19:41:35.091880] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-25T19:41:35.629681] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T19:41:35.888720] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-25T19:41:36.693892] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-25T19:41:36.709057] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:41:37.125346] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T19:41:37.488782] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-25T19:41:38.288815] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-25T19:41:38.684108] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T19:41:39.088735] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-25T19:41:39.147381] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:41:39.888186] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T19:41:39.897561] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-25T19:41:40.688763] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-25T19:41:41.104261] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T19:41:41.327523] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T19:41:41.488855] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-25T19:41:42.288708] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-25T19:41:42.333466] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:41:43.054568] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T19:41:43.088740] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-25T19:41:43.888770] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-25T19:41:44.266071] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T19:41:44.586208] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T19:41:44.688762] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-25T19:41:45.500799] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-25T19:41:45.521424] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T19:41:45.587766] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T19:41:46.288787] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-25T19:41:47.090601] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-25T19:41:47.199769] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T19:41:47.888693] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-25T19:41:48.444272] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-25T19:41:48.455021] [INFO ] [REMOTE ] KR: Full fetch complete (77679 records). [2025-09-25T19:41:48.455250] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-25T19:41:48.693695] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-25T19:41:48.944286] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T19:41:48.996499] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-25T19:41:48.996614] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-25T19:41:48.997752] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-25T19:41:48.997839] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-25T19:41:49.000072] [DEBUG] [LOCAL ] KR: Trimmed 77679 records to 54072 (keeping 200 days of data) [2025-09-25T19:41:49.364016] [DEBUG] [LOCAL ] KR: Primary data saved (54072 records). [2025-09-25T19:41:49.364163] [INFO ] [MAIN ] KR: Full history saved. [2025-09-25T19:41:49.364296] [INFO ] [MAIN ] Update Progress: 1218/2372 symbols completed. KR took 33.1s. Estimated remaining: 2h 33m 16s. Rate: 7.5 symbols/min [2025-09-25T19:41:49.488670] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-25T19:41:49.568274] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T19:41:49.585810] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:49.588817] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-25T19:41:49.588871] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-25T19:41:49.589079] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-25T19:41:49.589122] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-25T19:41:49.589163] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-25T19:41:49.589195] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-25T19:41:49.957864] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:50.288731] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-25T19:41:50.385952] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T19:41:50.413973] [INFO ] [REMOTE ] KREF: Full fetch complete (52004 records). [2025-09-25T19:41:50.414302] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-25T19:41:50.849973] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-25T19:41:50.850309] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-25T19:41:50.851771] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-25T19:41:50.851882] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-25T19:41:50.853474] [DEBUG] [LOCAL ] KREF: Trimmed 52004 records to 37458 (keeping 200 days of data) [2025-09-25T19:41:51.102721] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-25T19:41:51.125209] [DEBUG] [LOCAL ] KREF: Primary data saved (37458 records). [2025-09-25T19:41:51.125447] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-25T19:41:51.125834] [INFO ] [MAIN ] Update Progress: 1219/2372 symbols completed. KREF took 31.7s. Estimated remaining: 2h 33m 2s. Rate: 7.5 symbols/min [2025-09-25T19:41:51.318894] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:51.349739] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:41:51.350190] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-25T19:41:51.363477] [DEBUG] [LOCAL ] KRO: Loaded 26034 existing records from primary storage. [2025-09-25T19:41:51.363695] [INFO ] [MAIN ] KRO: Loaded 26034 existing records. [2025-09-25T19:41:51.558081] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:51.558709] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-25T19:41:51.558768] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-25T19:41:51.559219] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-25T19:41:51.559289] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-25T19:41:51.903749] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-25T19:41:51.931682] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-25T19:41:52.059276] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T19:41:52.097590] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:52.101425] [INFO ] [REMOTE ] KRC: Full fetch complete (69621 records). [2025-09-25T19:41:52.101531] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-25T19:41:52.136948] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:41:52.137684] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-25T19:41:52.521839] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-25T19:41:52.521948] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-25T19:41:52.523990] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-25T19:41:52.524075] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-25T19:41:52.527434] [DEBUG] [LOCAL ] KRC: Trimmed 69621 records to 48747 (keeping 200 days of data) [2025-09-25T19:41:52.723582] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-25T19:41:52.867005] [DEBUG] [LOCAL ] KRC: Primary data saved (48747 records). [2025-09-25T19:41:52.867209] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-25T19:41:52.867412] [INFO ] [MAIN ] Update Progress: 1220/2372 symbols completed. KRC took 35.8s. Estimated remaining: 2h 32m 49s. Rate: 7.5 symbols/min [2025-09-25T19:41:53.047092] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:41:53.094225] [DEBUG] [LOCAL ] KRP: Loaded 37523 existing records from primary storage. [2025-09-25T19:41:53.094398] [INFO ] [MAIN ] KRP: Loaded 37523 existing records. [2025-09-25T19:41:53.281163] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:41:53.282192] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-25T19:41:53.282242] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-25T19:41:53.282531] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-25T19:41:53.282603] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-25T19:41:53.489430] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-25T19:41:53.713076] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:41:54.023931] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T19:41:54.288753] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-25T19:41:55.088687] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-25T19:41:55.150968] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T19:41:55.485430] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T19:41:55.888816] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-25T19:41:56.216222] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T19:41:56.688838] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-25T19:41:57.297850] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T19:41:57.488801] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-25T19:41:57.922773] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T19:41:58.288780] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-25T19:41:58.986746] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T19:41:59.088707] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-25T19:41:59.583322] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T19:41:59.888703] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-25T19:42:00.688741] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-25T19:42:00.830380] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:42:00.863710] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T19:42:01.488721] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-25T19:42:02.293807] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-25T19:42:02.307709] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T19:42:02.645992] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:42:03.088682] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-25T19:42:03.704170] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T19:42:03.888676] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-25T19:42:04.374887] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:42:04.688771] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-25T19:42:05.488696] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-25T19:42:05.897396] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T19:42:05.909547] [INFO ] [REMOTE ] KRG: Full fetch complete (71040 records). [2025-09-25T19:42:05.911259] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-25T19:42:06.257226] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T19:42:06.293827] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-25T19:42:06.459349] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-25T19:42:06.459467] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-25T19:42:06.461065] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-25T19:42:06.461142] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-25T19:42:06.462933] [DEBUG] [LOCAL ] KRG: Trimmed 71040 records to 49543 (keeping 200 days of data) [2025-09-25T19:42:06.865532] [DEBUG] [LOCAL ] KRG: Primary data saved (49543 records). [2025-09-25T19:42:06.866753] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-25T19:42:06.867991] [INFO ] [MAIN ] Update Progress: 1221/2372 symbols completed. KRG took 34.3s. Estimated remaining: 2h 32m 46s. Rate: 7.5 symbols/min [2025-09-25T19:42:06.922030] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T19:42:07.086334] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:07.088731] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-25T19:42:07.162862] [DEBUG] [LOCAL ] KSS: Loaded 53607 existing records from primary storage. [2025-09-25T19:42:07.163057] [INFO ] [MAIN ] KSS: Loaded 53607 existing records. [2025-09-25T19:42:07.362765] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:07.363582] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-25T19:42:07.363672] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-25T19:42:07.364009] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-25T19:42:07.364071] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-25T19:42:07.775706] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:07.888727] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-25T19:42:07.980434] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:42:08.488763] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T19:42:08.688722] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-25T19:42:09.488678] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-25T19:42:10.041255] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-25T19:42:10.207492] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T19:42:10.288723] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-25T19:42:11.093884] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-25T19:42:11.111857] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:42:11.431077] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T19:42:11.888726] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-25T19:42:12.385470] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T19:42:12.688797] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-25T19:42:13.488706] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-25T19:42:13.779236] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T19:42:13.965941] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T19:42:14.288779] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-25T19:42:14.608991] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T19:42:15.088806] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-25T19:42:15.888685] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-25T19:42:16.296069] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T19:42:16.560072] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:42:16.688729] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-25T19:42:17.488723] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-25T19:42:17.794304] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T19:42:17.805604] [INFO ] [REMOTE ] KRMN: Full fetch complete (50269 records). [2025-09-25T19:42:17.805865] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-25T19:42:18.016112] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 155 unique days, need 200 days [2025-09-25T19:42:18.017007] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:42:18.017117] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:42:18.017222] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-25T19:42:18.017376] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-25T19:42:18.017455] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-25T19:42:18.017534] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-25T19:42:18.017754] [INFO ] [MAIN ] Update Progress: 1222/2372 symbols completed. KRMN took 28.7s. Estimated remaining: 2h 32m 41s. Rate: 7.5 symbols/min [2025-09-25T19:42:18.197287] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:18.256986] [DEBUG] [LOCAL ] KT: Loaded 45678 existing records from primary storage. [2025-09-25T19:42:18.257215] [INFO ] [MAIN ] KT: Loaded 45678 existing records. [2025-09-25T19:42:18.291434] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-25T19:42:18.481719] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:18.482722] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-25T19:42:18.482800] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-25T19:42:18.483707] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-25T19:42:18.483797] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-25T19:42:18.767554] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T19:42:18.914072] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T19:42:18.925697] [INFO ] [REMOTE ] KRO: Full fetch complete (34914 records). [2025-09-25T19:42:18.925820] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-25T19:42:18.987176] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:19.097478] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-25T19:42:19.351819] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-25T19:42:19.351942] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-25T19:42:19.352733] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-25T19:42:19.352795] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-25T19:42:19.353742] [DEBUG] [LOCAL ] KRO: Trimmed 34914 records to 26251 (keeping 200 days of data) [2025-09-25T19:42:19.522535] [DEBUG] [LOCAL ] KRO: Primary data saved (26251 records). [2025-09-25T19:42:19.522714] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-25T19:42:19.522860] [INFO ] [MAIN ] Update Progress: 1223/2372 symbols completed. KRO took 28.4s. Estimated remaining: 2h 32m 27s. Rate: 7.5 symbols/min [2025-09-25T19:42:19.707952] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:19.754753] [DEBUG] [LOCAL ] KTB: Loaded 41077 existing records from primary storage. [2025-09-25T19:42:19.754919] [INFO ] [MAIN ] KTB: Loaded 41077 existing records. [2025-09-25T19:42:19.822096] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T19:42:19.888732] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-25T19:42:19.971972] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:19.972329] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-25T19:42:19.972374] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-25T19:42:19.972777] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-25T19:42:19.972838] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-25T19:42:20.326195] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:20.688714] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-25T19:42:21.322541] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-25T19:42:21.385206] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T19:42:21.488732] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-25T19:42:22.284067] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T19:42:22.293397] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-25T19:42:22.952738] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T19:42:22.959163] [INFO ] [REMOTE ] KRP: Full fetch complete (54827 records). [2025-09-25T19:42:22.959264] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-25T19:42:23.100750] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-25T19:42:23.369715] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-25T19:42:23.369812] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-25T19:42:23.370767] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-25T19:42:23.370831] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-25T19:42:23.372093] [DEBUG] [LOCAL ] KRP: Trimmed 54827 records to 37736 (keeping 200 days of data) [2025-09-25T19:42:23.596203] [DEBUG] [LOCAL ] KRP: Primary data saved (37736 records). [2025-09-25T19:42:23.596356] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-25T19:42:23.596474] [INFO ] [MAIN ] Update Progress: 1224/2372 symbols completed. KRP took 30.7s. Estimated remaining: 2h 32m 16s. Rate: 7.5 symbols/min [2025-09-25T19:42:23.775591] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:23.796285] [DEBUG] [LOCAL ] KTF: Loaded 12966 existing records from primary storage. [2025-09-25T19:42:23.796436] [INFO ] [MAIN ] KTF: Loaded 12966 existing records. [2025-09-25T19:42:23.894260] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-25T19:42:23.985796] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:23.986145] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-25T19:42:23.986194] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-25T19:42:23.986484] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-25T19:42:23.986543] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-25T19:42:24.366498] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T19:42:24.418560] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:24.451806] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T19:42:24.688719] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-25T19:42:25.279580] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:42:25.488701] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-25T19:42:26.288702] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-25T19:42:26.715550] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T19:42:26.907573] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:42:27.088675] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-25T19:42:27.557329] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T19:42:27.888717] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-25T19:42:28.656703] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T19:42:28.688668] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-25T19:42:29.437298] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T19:42:29.488728] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-25T19:42:30.288777] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-25T19:42:30.395204] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T19:42:30.508348] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:42:31.088854] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-25T19:42:31.888705] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-25T19:42:32.466360] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T19:42:32.525369] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T19:42:32.688749] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-25T19:42:33.488814] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-25T19:42:33.577501] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T19:42:34.288785] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-25T19:42:34.426002] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:42:35.088724] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-25T19:42:35.214136] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T19:42:35.551400] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T19:42:35.888737] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-25T19:42:36.704715] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-25T19:42:36.704587] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:42:37.086901] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T19:42:37.488760] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-25T19:42:38.148040] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T19:42:38.288773] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-25T19:42:38.979958] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T19:42:39.007545] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T19:42:39.013070] [INFO ] [REMOTE ] KSS: Full fetch complete (77638 records). [2025-09-25T19:42:39.013332] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-25T19:42:39.094726] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-25T19:42:39.463850] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-25T19:42:39.463968] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-25T19:42:39.465191] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-25T19:42:39.465311] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-25T19:42:39.469622] [DEBUG] [LOCAL ] KSS: Trimmed 77638 records to 53996 (keeping 200 days of data) [2025-09-25T19:42:39.830957] [DEBUG] [LOCAL ] KSS: Primary data saved (53996 records). [2025-09-25T19:42:39.831164] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-25T19:42:39.833105] [INFO ] [MAIN ] Update Progress: 1225/2372 symbols completed. KSS took 33.0s. Estimated remaining: 2h 32m 16s. Rate: 7.5 symbols/min [2025-09-25T19:42:39.898020] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-25T19:42:40.015309] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:40.015493] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-25T19:42:40.015531] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-25T19:42:40.016253] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-25T19:42:40.016297] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-25T19:42:40.016338] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-25T19:42:40.016383] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-25T19:42:40.391716] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:40.433027] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T19:42:40.688715] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-25T19:42:41.035464] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T19:42:41.272088] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T19:42:41.488735] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-25T19:42:42.189735] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T19:42:42.288866] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-25T19:42:43.088739] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-25T19:42:43.827075] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T19:42:43.888674] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-25T19:42:44.078283] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T19:42:44.688796] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-25T19:42:44.802338] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T19:42:45.488796] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-25T19:42:46.064192] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T19:42:46.178299] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:42:46.288712] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-25T19:42:47.088711] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-25T19:42:47.844331] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T19:42:47.888773] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-25T19:42:48.107488] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T19:42:48.353778] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T19:42:48.688722] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-25T19:42:49.488790] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-25T19:42:50.288753] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-25T19:42:50.327590] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T19:42:50.483719] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T19:42:50.497697] [INFO ] [REMOTE ] KTB: Full fetch complete (57638 records). [2025-09-25T19:42:50.497990] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-25T19:42:51.095705] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-25T19:42:51.099558] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-25T19:42:51.100194] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-25T19:42:51.101894] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-25T19:42:51.102031] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-25T19:42:51.107099] [DEBUG] [LOCAL ] KTB: Trimmed 57638 records to 41408 (keeping 200 days of data) [2025-09-25T19:42:51.415549] [DEBUG] [LOCAL ] KTB: Primary data saved (41408 records). [2025-09-25T19:42:51.415748] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-25T19:42:51.416056] [INFO ] [MAIN ] Update Progress: 1226/2372 symbols completed. KTB took 31.9s. Estimated remaining: 2h 32m 11s. Rate: 7.5 symbols/min [2025-09-25T19:42:51.541284] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T19:42:51.603251] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:51.684428] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-25T19:42:51.684601] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-25T19:42:51.891536] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-25T19:42:51.902754] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T19:42:51.933535] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:51.934180] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-25T19:42:51.934247] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-25T19:42:51.934716] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-25T19:42:51.934794] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-25T19:42:52.293961] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:52.462807] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T19:42:52.688710] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-25T19:42:53.488716] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-25T19:42:54.288697] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-25T19:42:54.479969] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T19:42:54.916903] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T19:42:55.088678] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-25T19:42:55.307292] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T19:42:55.316327] [INFO ] [REMOTE ] KT: Full fetch complete (66799 records). [2025-09-25T19:42:55.316478] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-25T19:42:55.725709] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-25T19:42:55.725815] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-25T19:42:55.727496] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-25T19:42:55.727584] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-25T19:42:55.729267] [DEBUG] [LOCAL ] KT: Trimmed 66799 records to 46028 (keeping 200 days of data) [2025-09-25T19:42:55.929216] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-25T19:42:55.984979] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T19:42:56.077319] [DEBUG] [LOCAL ] KT: Primary data saved (46028 records). [2025-09-25T19:42:56.077536] [INFO ] [MAIN ] KT: Full history saved. [2025-09-25T19:42:56.078982] [INFO ] [MAIN ] Update Progress: 1227/2372 symbols completed. KT took 38.1s. Estimated remaining: 2h 31m 60s. Rate: 7.5 symbols/min [2025-09-25T19:42:56.259883] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:42:56.328129] [DEBUG] [LOCAL ] KVYO: Loaded 49916 existing records from primary storage. [2025-09-25T19:42:56.328327] [INFO ] [MAIN ] KVYO: Loaded 49916 existing records. [2025-09-25T19:42:56.614571] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:42:56.615005] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-25T19:42:56.615056] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-25T19:42:56.615451] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-25T19:42:56.615517] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-25T19:42:56.693998] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-25T19:42:57.028880] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:42:57.488709] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-25T19:42:57.708183] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T19:42:57.731070] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T19:42:58.288730] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-25T19:42:59.088777] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-25T19:42:59.224344] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T19:42:59.673174] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T19:42:59.888725] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-25T19:43:00.116521] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T19:43:00.688771] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-25T19:43:01.488731] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-25T19:43:01.528324] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:43:02.288730] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-25T19:43:02.376239] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T19:43:02.380152] [INFO ] [REMOTE ] KTF: Full fetch complete (18233 records). [2025-09-25T19:43:02.380312] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-25T19:43:02.816776] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-25T19:43:02.816895] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-25T19:43:02.817364] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-25T19:43:02.817410] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-25T19:43:02.818940] [DEBUG] [LOCAL ] KTF: Trimmed 18233 records to 13031 (keeping 200 days of data) [2025-09-25T19:43:02.931212] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-25T19:43:02.954181] [DEBUG] [LOCAL ] KTF: Primary data saved (13031 records). [2025-09-25T19:43:02.954368] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-25T19:43:02.954493] [INFO ] [MAIN ] Update Progress: 1228/2372 symbols completed. KTF took 39.4s. Estimated remaining: 2h 31m 51s. Rate: 7.5 symbols/min [2025-09-25T19:43:03.093916] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-25T19:43:03.159980] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:03.223239] [DEBUG] [LOCAL ] KW: Loaded 40700 existing records from primary storage. [2025-09-25T19:43:03.223414] [INFO ] [MAIN ] KW: Loaded 40700 existing records. [2025-09-25T19:43:03.428169] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:03.428508] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-25T19:43:03.428559] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-25T19:43:03.430696] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-25T19:43:03.430760] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-25T19:43:03.828056] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:03.888682] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-25T19:43:04.019302] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T19:43:04.026093] [INFO ] [REMOTE ] KUKE: Full fetch complete (7890 records). [2025-09-25T19:43:04.026249] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-25T19:43:04.048322] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T19:43:04.242325] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T19:43:04.242729] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:43:04.242822] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:43:04.243009] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-25T19:43:04.243106] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-25T19:43:04.243177] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-25T19:43:04.243260] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-25T19:43:04.243369] [INFO ] [MAIN ] Update Progress: 1229/2372 symbols completed. KUKE took 24.4s. Estimated remaining: 2h 31m 37s. Rate: 7.5 symbols/min [2025-09-25T19:43:04.432067] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:04.459268] [DEBUG] [LOCAL ] KWR: Loaded 16760 existing records from primary storage. [2025-09-25T19:43:04.459420] [INFO ] [MAIN ] KWR: Loaded 16760 existing records. [2025-09-25T19:43:04.658019] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:04.658504] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-25T19:43:04.658591] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-25T19:43:04.659301] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-25T19:43:04.659361] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-25T19:43:04.693872] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-25T19:43:05.045247] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:05.077230] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T19:43:05.488733] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-25T19:43:06.288864] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-25T19:43:06.330266] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T19:43:06.966570] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T19:43:07.088754] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-25T19:43:07.605913] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T19:43:07.888777] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-25T19:43:08.449080] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T19:43:08.688874] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-25T19:43:09.252101] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T19:43:09.488759] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-25T19:43:10.261372] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T19:43:10.288690] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-25T19:43:10.531898] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:43:11.088712] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-25T19:43:11.903387] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-25T19:43:11.935321] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T19:43:12.688726] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-25T19:43:12.749030] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:43:13.014149] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T19:43:13.488766] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-25T19:43:14.288703] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-25T19:43:14.449424] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T19:43:14.469301] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T19:43:15.088748] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-25T19:43:15.888711] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-25T19:43:16.076820] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T19:43:16.688743] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-25T19:43:16.807427] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:43:16.855273] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T19:43:17.488758] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-25T19:43:18.288861] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-25T19:43:18.584900] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T19:43:18.761084] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T19:43:19.088697] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-25T19:43:19.434816] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T19:43:19.888729] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-25T19:43:20.688686] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-25T19:43:20.756092] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:43:21.488766] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-25T19:43:21.744026] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T19:43:21.783047] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T19:43:22.288745] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-25T19:43:23.050691] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:43:23.063703] [INFO ] [REMOTE ] KVYO: Full fetch complete (71452 records). [2025-09-25T19:43:23.063936] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-25T19:43:23.101849] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-25T19:43:23.353564] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T19:43:23.536672] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-25T19:43:23.536801] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-25T19:43:23.538371] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-25T19:43:23.538474] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-25T19:43:23.540318] [DEBUG] [LOCAL ] KVYO: Trimmed 71452 records to 50306 (keeping 200 days of data) [2025-09-25T19:43:23.885363] [DEBUG] [LOCAL ] KVYO: Primary data saved (50306 records). [2025-09-25T19:43:23.885550] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-25T19:43:23.887411] [INFO ] [MAIN ] Update Progress: 1230/2372 symbols completed. KVYO took 27.8s. Estimated remaining: 2h 31m 40s. Rate: 7.5 symbols/min [2025-09-25T19:43:23.894723] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-25T19:43:24.088587] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:24.135292] [DEBUG] [LOCAL ] KYN: Loaded 30081 existing records from primary storage. [2025-09-25T19:43:24.135459] [INFO ] [MAIN ] KYN: Loaded 30081 existing records. [2025-09-25T19:43:24.338291] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:24.342117] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-25T19:43:24.342218] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-25T19:43:24.342547] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-25T19:43:24.342628] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-25T19:43:24.693619] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-25T19:43:24.730614] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:25.489753] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-25T19:43:25.512915] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:43:25.822726] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:43:26.228629] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-09-25T19:43:26.239675] [INFO ] [REMOTE ] KVUE: Full fetch complete (77671 records). [2025-09-25T19:43:26.239833] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-25T19:43:26.295799] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-25T19:43:26.686445] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-25T19:43:26.686551] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-25T19:43:26.688321] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-25T19:43:26.688388] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-25T19:43:26.690226] [DEBUG] [LOCAL ] KVUE: Trimmed 77671 records to 54057 (keeping 200 days of data) [2025-09-25T19:43:27.056069] [DEBUG] [LOCAL ] KVUE: Primary data saved (54057 records). [2025-09-25T19:43:27.056225] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-25T19:43:27.056378] [INFO ] [MAIN ] Update Progress: 1231/2372 symbols completed. KVUE took 35.6s. Estimated remaining: 2h 31m 27s. Rate: 7.5 symbols/min [2025-09-25T19:43:27.089718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-25T19:43:27.221165] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T19:43:27.272489] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:27.323936] [DEBUG] [LOCAL ] L: Loaded 40956 existing records from primary storage. [2025-09-25T19:43:27.324117] [INFO ] [MAIN ] L: Loaded 40956 existing records. [2025-09-25T19:43:27.514955] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:27.515242] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-25T19:43:27.515291] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-25T19:43:27.516004] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-25T19:43:27.516138] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-25T19:43:27.897481] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-25T19:43:27.909706] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:27.936887] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:43:28.265788] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T19:43:28.688840] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-25T19:43:29.354986] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T19:43:29.488728] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-25T19:43:29.849904] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T19:43:30.288678] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-25T19:43:30.699450] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T19:43:31.088815] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-25T19:43:31.794385] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T19:43:31.895308] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-25T19:43:31.897852] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T19:43:31.901911] [INFO ] [REMOTE ] KWR: Full fetch complete (23986 records). [2025-09-25T19:43:31.901991] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-25T19:43:32.327680] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-25T19:43:32.328559] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-25T19:43:32.329670] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-25T19:43:32.329776] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-25T19:43:32.333792] [DEBUG] [LOCAL ] KWR: Trimmed 23986 records to 16844 (keeping 200 days of data) [2025-09-25T19:43:32.468610] [DEBUG] [LOCAL ] KWR: Primary data saved (16844 records). [2025-09-25T19:43:32.468806] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-25T19:43:32.468946] [INFO ] [MAIN ] Update Progress: 1232/2372 symbols completed. KWR took 28.2s. Estimated remaining: 2h 31m 17s. Rate: 7.5 symbols/min [2025-09-25T19:43:32.642732] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:32.698686] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-25T19:43:32.726165] [DEBUG] [LOCAL ] LAC: Loaded 52311 existing records from primary storage. [2025-09-25T19:43:32.726337] [INFO ] [MAIN ] LAC: Loaded 52311 existing records. [2025-09-25T19:43:32.925143] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:32.927526] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-25T19:43:32.927576] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-25T19:43:32.928160] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-25T19:43:32.928234] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-25T19:43:33.346870] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:33.498990] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-25T19:43:33.504939] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:43:33.683383] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T19:43:34.288952] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-25T19:43:35.088746] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-25T19:43:35.574041] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T19:43:35.808080] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T19:43:35.888684] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-25T19:43:36.236308] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T19:43:36.246510] [INFO ] [REMOTE ] KW: Full fetch complete (56939 records). [2025-09-25T19:43:36.246683] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-25T19:43:36.703909] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-25T19:43:36.727706] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-25T19:43:36.727804] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-25T19:43:36.728880] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-25T19:43:36.729009] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-25T19:43:36.730687] [DEBUG] [LOCAL ] KW: Trimmed 56939 records to 40961 (keeping 200 days of data) [2025-09-25T19:43:37.023137] [DEBUG] [LOCAL ] KW: Primary data saved (40961 records). [2025-09-25T19:43:37.023358] [INFO ] [MAIN ] KW: Full history saved. [2025-09-25T19:43:37.023554] [INFO ] [MAIN ] Update Progress: 1233/2372 symbols completed. KW took 34.1s. Estimated remaining: 2h 31m 6s. Rate: 7.5 symbols/min [2025-09-25T19:43:37.184462] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T19:43:37.256156] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:37.289336] [DEBUG] [LOCAL ] LAD: Loaded 23631 existing records from primary storage. [2025-09-25T19:43:37.289521] [INFO ] [MAIN ] LAD: Loaded 23631 existing records. [2025-09-25T19:43:37.471067] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:37.471520] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-25T19:43:37.471577] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-25T19:43:37.471894] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-25T19:43:37.471958] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-25T19:43:37.491731] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-25T19:43:37.845202] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:38.288748] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-25T19:43:38.497364] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T19:43:38.737958] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T19:43:39.088818] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-25T19:43:39.505270] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T19:43:39.888787] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-25T19:43:40.688749] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-25T19:43:40.899579] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T19:43:41.487035] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T19:43:41.498724] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-25T19:43:41.555158] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T19:43:42.288691] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-25T19:43:42.764824] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T19:43:43.088718] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-25T19:43:43.888717] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-25T19:43:44.215298] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T19:43:44.591963] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:43:44.688681] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-25T19:43:45.345580] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T19:43:45.488717] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-25T19:43:46.291539] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-25T19:43:46.306906] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:43:46.786575] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T19:43:47.088787] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-25T19:43:47.658870] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:43:47.888737] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-25T19:43:48.688711] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-25T19:43:48.721635] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:43:49.488696] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-25T19:43:49.913048] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T19:43:50.034661] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T19:43:50.288735] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-25T19:43:51.090287] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-25T19:43:51.104748] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T19:43:51.116585] [INFO ] [REMOTE ] L: Full fetch complete (59558 records). [2025-09-25T19:43:51.117766] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-25T19:43:51.540314] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-25T19:43:51.540446] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-25T19:43:51.541471] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-25T19:43:51.541537] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-25T19:43:51.542981] [DEBUG] [LOCAL ] L: Trimmed 59558 records to 41261 (keeping 200 days of data) [2025-09-25T19:43:51.834672] [DEBUG] [LOCAL ] L: Primary data saved (41261 records). [2025-09-25T19:43:51.834836] [INFO ] [MAIN ] L: Full history saved. [2025-09-25T19:43:51.835091] [INFO ] [MAIN ] Update Progress: 1234/2372 symbols completed. L took 24.8s. Estimated remaining: 2h 31m 4s. Rate: 7.5 symbols/min [2025-09-25T19:43:51.892145] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-25T19:43:52.040041] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:43:52.096921] [DEBUG] [LOCAL ] LADR: Loaded 38668 existing records from primary storage. [2025-09-25T19:43:52.097105] [INFO ] [MAIN ] LADR: Loaded 38668 existing records. [2025-09-25T19:43:52.304759] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:43:52.305086] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-25T19:43:52.305155] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-25T19:43:52.305640] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-25T19:43:52.305760] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-25T19:43:52.398133] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-25T19:43:52.555699] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T19:43:52.692143] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-25T19:43:52.712562] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T19:43:52.833053] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:43:53.488711] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-25T19:43:53.884946] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T19:43:54.288743] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-25T19:43:55.088705] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-25T19:43:55.379050] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-25T19:43:55.584752] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T19:43:55.888738] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-25T19:43:56.184943] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T19:43:56.688719] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-25T19:43:57.488713] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-25T19:43:57.908156] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T19:43:57.932574] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T19:43:58.288758] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-25T19:43:58.456592] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T19:43:59.088771] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-25T19:43:59.455365] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T19:43:59.888754] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-25T19:44:00.688048] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T19:44:00.692235] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-25T19:44:00.694847] [INFO ] [REMOTE ] LAD: Full fetch complete (35325 records). [2025-09-25T19:44:00.694991] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-25T19:44:00.881616] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T19:44:01.164716] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-25T19:44:01.164821] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-25T19:44:01.165596] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-25T19:44:01.165695] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-25T19:44:01.166895] [DEBUG] [LOCAL ] LAD: Trimmed 35325 records to 23870 (keeping 200 days of data) [2025-09-25T19:44:01.321970] [DEBUG] [LOCAL ] LAD: Primary data saved (23870 records). [2025-09-25T19:44:01.322123] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-25T19:44:01.322292] [INFO ] [MAIN ] Update Progress: 1235/2372 symbols completed. LAD took 24.3s. Estimated remaining: 2h 30m 58s. Rate: 7.5 symbols/min [2025-09-25T19:44:01.495052] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:01.495735] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-25T19:44:01.501724] [DEBUG] [LOCAL ] LANV: Loaded 2781 existing records from primary storage. [2025-09-25T19:44:01.501837] [INFO ] [MAIN ] LANV: Loaded 2781 existing records. [2025-09-25T19:44:01.756486] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:01.756768] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-25T19:44:01.756820] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-25T19:44:01.757134] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-25T19:44:01.757194] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-25T19:44:02.136040] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:02.256725] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:44:02.263187] [INFO ] [REMOTE ] KYN: Full fetch complete (44720 records). [2025-09-25T19:44:02.263344] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-25T19:44:02.294750] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-25T19:44:02.681936] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-25T19:44:02.682026] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-25T19:44:02.682963] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-25T19:44:02.683047] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-25T19:44:02.684566] [DEBUG] [LOCAL ] KYN: Trimmed 44720 records to 30234 (keeping 200 days of data) [2025-09-25T19:44:02.802497] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-25T19:44:02.917597] [DEBUG] [LOCAL ] KYN: Primary data saved (30234 records). [2025-09-25T19:44:02.917798] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-25T19:44:02.917959] [INFO ] [MAIN ] Update Progress: 1236/2372 symbols completed. KYN took 39.0s. Estimated remaining: 2h 30m 44s. Rate: 7.5 symbols/min [2025-09-25T19:44:03.047925] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T19:44:03.093840] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-25T19:44:03.173423] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:03.173879] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-25T19:44:03.173937] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-25T19:44:03.174318] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-25T19:44:03.174370] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-25T19:44:03.174414] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-25T19:44:03.174455] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-25T19:44:03.706329] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:03.707740] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T19:44:03.888753] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-25T19:44:04.101235] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:44:04.101612] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-25T19:44:04.688724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-25T19:44:05.488741] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-25T19:44:06.219018] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T19:44:06.288669] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-25T19:44:06.794266] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T19:44:06.813361] [INFO ] [REMOTE ] LAC: Full fetch complete (75968 records). [2025-09-25T19:44:06.813602] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-25T19:44:07.095808] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-25T19:44:07.272756] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-25T19:44:07.272851] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-25T19:44:07.273905] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-25T19:44:07.273980] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-25T19:44:07.279476] [DEBUG] [LOCAL ] LAC: Trimmed 75968 records to 52701 (keeping 200 days of data) [2025-09-25T19:44:07.624245] [DEBUG] [LOCAL ] LAC: Primary data saved (52701 records). [2025-09-25T19:44:07.624482] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-25T19:44:07.626996] [INFO ] [MAIN ] Update Progress: 1237/2372 symbols completed. LAC took 35.2s. Estimated remaining: 2h 30m 33s. Rate: 7.5 symbols/min [2025-09-25T19:44:07.705281] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T19:44:07.723699] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T19:44:07.888717] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-25T19:44:08.688806] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-25T19:44:09.274279] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T19:44:09.488736] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-25T19:44:10.288885] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-25T19:44:10.381302] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T19:44:10.776151] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T19:44:11.090203] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-25T19:44:11.099899] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T19:44:11.588179] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T19:44:11.888765] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-25T19:44:12.688829] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-25T19:44:13.154944] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T19:44:13.314491] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T19:44:13.488770] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-25T19:44:14.288799] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-25T19:44:15.088819] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-25T19:44:15.159271] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:44:15.356566] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T19:44:15.490727] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T19:44:15.888734] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-25T19:44:16.688873] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-25T19:44:17.133562] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T19:44:17.488763] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-25T19:44:17.667096] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T19:44:18.288739] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-25T19:44:19.087180] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T19:44:19.091623] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-25T19:44:19.573557] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T19:44:19.888693] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-25T19:44:20.223065] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T19:44:20.470133] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T19:44:20.688732] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-25T19:44:21.488735] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-25T19:44:22.288730] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-25T19:44:22.353054] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T19:44:22.537516] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T19:44:23.063911] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T19:44:23.065497] [INFO ] [REMOTE ] LANV: Full fetch complete (4417 records). [2025-09-25T19:44:23.065610] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-25T19:44:23.096236] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-25T19:44:23.469199] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-25T19:44:23.469307] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-25T19:44:23.469509] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-25T19:44:23.469664] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-25T19:44:23.470073] [DEBUG] [LOCAL ] LANV: Trimmed 4417 records to 2808 (keeping 200 days of data) [2025-09-25T19:44:23.487872] [DEBUG] [LOCAL ] LANV: Primary data saved (2808 records). [2025-09-25T19:44:23.487984] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-25T19:44:23.488133] [INFO ] [MAIN ] Update Progress: 1238/2372 symbols completed. LANV took 22.2s. Estimated remaining: 2h 30m 32s. Rate: 7.5 symbols/min [2025-09-25T19:44:23.888774] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-25T19:44:24.958230] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T19:44:24.968793] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-25T19:44:25.508891] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T19:44:25.518924] [INFO ] [REMOTE ] LADR: Full fetch complete (55058 records). [2025-09-25T19:44:25.519214] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-25T19:44:25.983429] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-25T19:44:25.983573] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-25T19:44:25.985221] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-25T19:44:25.985303] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-25T19:44:25.987431] [DEBUG] [LOCAL ] LADR: Trimmed 55058 records to 38917 (keeping 200 days of data) [2025-09-25T19:44:26.287997] [DEBUG] [LOCAL ] LADR: Primary data saved (38917 records). [2025-09-25T19:44:26.288224] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-25T19:44:26.288381] [INFO ] [MAIN ] Update Progress: 1239/2372 symbols completed. LADR took 34.5s. Estimated remaining: 2h 30m 19s. Rate: 7.5 symbols/min [2025-09-25T19:44:26.432383] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T19:44:26.445627] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-25T19:44:28.365213] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T19:44:28.375439] [INFO ] [REMOTE ] LAR: Full fetch complete (55157 records). [2025-09-25T19:44:28.375672] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-25T19:44:28.580328] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-25T19:44:28.582942] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:44:28.583017] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:44:28.583099] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-25T19:44:28.583237] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-25T19:44:28.583315] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-25T19:44:28.583395] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-25T19:44:28.583506] [INFO ] [MAIN ] Update Progress: 1240/2372 symbols completed. LAR took 25.7s. Estimated remaining: 2h 30m 6s. Rate: 7.5 symbols/min [2025-09-25T19:44:29.342221] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:29.352954] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:29.373947] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:29.435090] [DEBUG] [LOCAL ] LAW: Loaded 13939 existing records from primary storage. [2025-09-25T19:44:29.435289] [INFO ] [MAIN ] LAW: Loaded 13939 existing records. [2025-09-25T19:44:29.470947] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:29.548824] [DEBUG] [LOCAL ] LB: Loaded 37678 existing records from primary storage. [2025-09-25T19:44:29.570816] [INFO ] [MAIN ] LB: Loaded 37678 existing records. [2025-09-25T19:44:29.737095] [DEBUG] [LOCAL ] LBRT: Loaded 52919 existing records from primary storage. [2025-09-25T19:44:29.737267] [INFO ] [MAIN ] LBRT: Loaded 52919 existing records. [2025-09-25T19:44:29.848987] [DEBUG] [LOCAL ] LAZ: Loaded 45202 existing records from primary storage. [2025-09-25T19:44:29.849215] [INFO ] [MAIN ] LAZ: Loaded 45202 existing records. [2025-09-25T19:44:30.011736] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:30.012302] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-25T19:44:30.012360] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-25T19:44:30.033907] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-25T19:44:30.034010] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-25T19:44:30.538833] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:30.539594] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-25T19:44:30.539665] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-25T19:44:30.539989] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-25T19:44:30.540049] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-25T19:44:30.538989] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:30.545914] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-25T19:44:30.545958] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-25T19:44:30.546201] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-25T19:44:30.546260] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-25T19:44:30.661833] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:30.662106] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-25T19:44:30.662162] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-25T19:44:30.662425] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-25T19:44:30.662487] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-25T19:44:31.534999] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:31.544664] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-25T19:44:32.004935] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:32.019385] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-25T19:44:32.018841] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:32.031883] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:32.020990] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-25T19:44:32.032627] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-25T19:44:32.587971] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:44:32.592326] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-25T19:44:33.368404] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T19:44:33.372303] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-25T19:44:33.527289] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T19:44:33.535757] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-25T19:44:33.616422] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T19:44:33.625432] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-25T19:44:33.723465] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T19:44:33.736999] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-25T19:44:34.302330] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T19:44:34.308172] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-25T19:44:35.072528] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T19:44:35.083491] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-25T19:44:35.127020] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T19:44:35.130314] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-25T19:44:35.326747] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T19:44:35.373066] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:44:35.888739] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-25T19:44:36.016513] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T19:44:36.317199] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T19:44:36.688771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-25T19:44:37.246355] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T19:44:37.488734] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-25T19:44:38.288855] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-25T19:44:38.347796] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T19:44:38.646342] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T19:44:39.088726] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-25T19:44:39.888796] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-25T19:44:39.965484] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T19:44:40.579321] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T19:44:40.688719] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-25T19:44:40.868768] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T19:44:41.488813] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-25T19:44:42.288804] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-25T19:44:42.375780] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T19:44:42.565402] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T19:44:42.834863] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-25T19:44:43.088718] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-25T19:44:43.888771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-25T19:44:44.623602] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T19:44:44.688729] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-25T19:44:45.288537] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:44:45.488760] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-25T19:44:46.098863] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T19:44:46.117705] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T19:44:46.288757] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-25T19:44:47.088806] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-25T19:44:47.792928] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T19:44:47.822341] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T19:44:47.888738] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-25T19:44:48.688875] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-25T19:44:49.454903] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T19:44:49.488715] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-25T19:44:49.661390] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T19:44:50.288741] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-25T19:44:51.088735] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-25T19:44:51.260120] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:44:51.885002] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T19:44:51.894998] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-25T19:44:52.163239] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T19:44:52.688872] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-25T19:44:53.483771] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T19:44:53.493852] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-25T19:44:53.724034] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T19:44:54.288738] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-25T19:44:54.745341] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T19:44:54.753469] [INFO ] [REMOTE ] LB: Full fetch complete (56033 records). [2025-09-25T19:44:54.753669] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-25T19:44:55.099792] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-25T19:44:55.210294] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-25T19:44:55.210413] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-25T19:44:55.211450] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-25T19:44:55.211561] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-25T19:44:55.213044] [DEBUG] [LOCAL ] LB: Trimmed 56033 records to 37889 (keeping 200 days of data) [2025-09-25T19:44:55.487510] [DEBUG] [LOCAL ] LB: Primary data saved (37889 records). [2025-09-25T19:44:55.487730] [INFO ] [MAIN ] LB: Full history saved. [2025-09-25T19:44:55.487972] [INFO ] [MAIN ] Update Progress: 1241/2372 symbols completed. LB took 26.9s. Estimated remaining: 2h 30m 16s. Rate: 7.5 symbols/min [2025-09-25T19:44:55.681317] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:55.769241] [DEBUG] [LOCAL ] LC: Loaded 47900 existing records from primary storage. [2025-09-25T19:44:55.769425] [INFO ] [MAIN ] LC: Loaded 47900 existing records. [2025-09-25T19:44:55.889098] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-25T19:44:55.944634] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T19:44:56.038498] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:56.040621] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-25T19:44:56.040789] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-25T19:44:56.041231] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-25T19:44:56.041316] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-25T19:44:56.074887] [INFO ] [REMOTE ] LAZ: Full fetch complete (65923 records). [2025-09-25T19:44:56.100856] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-25T19:44:56.173193] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T19:44:56.177126] [INFO ] [REMOTE ] LAW: Full fetch complete (20784 records). [2025-09-25T19:44:56.177218] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-25T19:44:57.520221] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:57.520598] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-25T19:44:57.733192] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T19:44:57.792055] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-25T19:44:57.800107] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-25T19:44:57.800167] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-25T19:44:57.800480] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-25T19:44:57.804234] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-25T19:44:57.805748] [DEBUG] [LOCAL ] LAW: Trimmed 20784 records to 14087 (keeping 200 days of data) [2025-09-25T19:44:57.908142] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-25T19:44:57.908238] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-25T19:44:57.909218] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-25T19:44:57.909285] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-25T19:44:57.913561] [DEBUG] [LOCAL ] LAZ: Trimmed 65923 records to 45524 (keeping 200 days of data) [2025-09-25T19:44:58.038914] [DEBUG] [LOCAL ] LAW: Primary data saved (14087 records). [2025-09-25T19:44:58.039077] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-25T19:44:58.039188] [INFO ] [MAIN ] Update Progress: 1242/2372 symbols completed. LAW took 29.4s. Estimated remaining: 2h 30m 3s. Rate: 7.5 symbols/min [2025-09-25T19:44:58.404396] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:58.420619] [DEBUG] [LOCAL ] LAZ: Primary data saved (45524 records). [2025-09-25T19:44:58.423823] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-25T19:44:58.423925] [INFO ] [MAIN ] Update Progress: 1243/2372 symbols completed. LAZ took 29.8s. Estimated remaining: 2h 29m 48s. Rate: 7.5 symbols/min [2025-09-25T19:44:58.504784] [DEBUG] [LOCAL ] LCII: Loaded 28619 existing records from primary storage. [2025-09-25T19:44:58.504939] [INFO ] [MAIN ] LCII: Loaded 28619 existing records. [2025-09-25T19:44:58.821789] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:44:58.886138] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:58.887264] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-25T19:44:58.887389] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-25T19:44:58.888085] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-25T19:44:58.888151] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-25T19:44:59.042462] [DEBUG] [LOCAL ] LDI: Loaded 44007 existing records from primary storage. [2025-09-25T19:44:59.042631] [INFO ] [MAIN ] LDI: Loaded 44007 existing records. [2025-09-25T19:44:59.121421] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T19:44:59.153698] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-25T19:44:59.464478] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:44:59.474012] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-25T19:44:59.474075] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-25T19:44:59.474410] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-25T19:44:59.474524] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-25T19:44:59.606295] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T19:44:59.632744] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-25T19:44:59.787049] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:44:59.893712] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-25T19:45:00.020184] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:00.447979] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T19:45:00.571990] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T19:45:00.688700] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-25T19:45:01.488696] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-25T19:45:01.687223] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-25T19:45:01.698360] [INFO ] [REMOTE ] LBRT: Full fetch complete (76530 records). [2025-09-25T19:45:01.698601] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-25T19:45:01.861052] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:45:02.241762] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-25T19:45:02.241880] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-25T19:45:02.243053] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-25T19:45:02.243131] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-25T19:45:02.245076] [DEBUG] [LOCAL ] LBRT: Trimmed 76530 records to 53307 (keeping 200 days of data) [2025-09-25T19:45:02.321740] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-25T19:45:02.521356] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T19:45:02.643340] [DEBUG] [LOCAL ] LBRT: Primary data saved (53307 records). [2025-09-25T19:45:02.643503] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-25T19:45:02.643612] [INFO ] [MAIN ] Update Progress: 1244/2372 symbols completed. LBRT took 34.0s. Estimated remaining: 2h 29m 37s. Rate: 7.5 symbols/min [2025-09-25T19:45:02.839301] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:02.894485] [DEBUG] [LOCAL ] LDOS: Loaded 45746 existing records from primary storage. [2025-09-25T19:45:02.894704] [INFO ] [MAIN ] LDOS: Loaded 45746 existing records. [2025-09-25T19:45:03.088816] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-25T19:45:03.094554] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:03.094864] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-25T19:45:03.094919] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-25T19:45:03.095675] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-25T19:45:03.095740] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-25T19:45:03.401906] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T19:45:03.523424] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:03.888725] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-25T19:45:04.325952] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T19:45:04.688738] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-25T19:45:05.402423] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:45:05.488675] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-25T19:45:05.631613] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T19:45:06.288737] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-25T19:45:06.996097] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T19:45:07.088735] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-25T19:45:07.888723] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-25T19:45:08.054424] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T19:45:08.587087] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T19:45:08.688761] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-25T19:45:09.500399] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-25T19:45:09.522864] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T19:45:10.288798] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-25T19:45:10.399776] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T19:45:10.871810] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:45:11.088713] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-25T19:45:11.535756] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T19:45:11.888721] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-25T19:45:12.364307] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T19:45:12.688701] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-25T19:45:13.391272] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:45:13.488704] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-25T19:45:14.288750] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-25T19:45:14.470635] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T19:45:14.752839] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T19:45:15.088808] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-25T19:45:15.688723] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T19:45:15.888727] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-25T19:45:16.688794] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-25T19:45:16.802506] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T19:45:16.857088] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T19:45:17.488848] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-25T19:45:18.288772] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-25T19:45:18.379869] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T19:45:18.844549] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T19:45:19.088735] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-25T19:45:19.735628] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T19:45:19.888973] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-25T19:45:19.931811] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T19:45:19.939574] [INFO ] [REMOTE ] LCII: Full fetch complete (39059 records). [2025-09-25T19:45:19.939749] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-25T19:45:20.382511] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-25T19:45:20.382698] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-25T19:45:20.384009] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-25T19:45:20.384130] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-25T19:45:20.385711] [DEBUG] [LOCAL ] LCII: Trimmed 39059 records to 28760 (keeping 200 days of data) [2025-09-25T19:45:20.619886] [DEBUG] [LOCAL ] LCII: Primary data saved (28760 records). [2025-09-25T19:45:20.620144] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-25T19:45:20.620358] [INFO ] [MAIN ] Update Progress: 1245/2372 symbols completed. LCII took 22.6s. Estimated remaining: 2h 29m 38s. Rate: 7.5 symbols/min [2025-09-25T19:45:20.693828] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-25T19:45:20.814772] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:20.838117] [DEBUG] [LOCAL ] LDP: Loaded 12957 existing records from primary storage. [2025-09-25T19:45:20.838268] [INFO ] [MAIN ] LDP: Loaded 12957 existing records. [2025-09-25T19:45:21.023372] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:21.023756] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-25T19:45:21.023842] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-25T19:45:21.024173] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-25T19:45:21.024262] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-25T19:45:21.400668] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:21.488731] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-25T19:45:22.173083] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T19:45:22.191958] [INFO ] [REMOTE ] LDI: Full fetch complete (60228 records). [2025-09-25T19:45:22.192243] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-25T19:45:22.294740] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-25T19:45:22.608293] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T19:45:22.750948] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-25T19:45:22.751069] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-25T19:45:22.752422] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-25T19:45:22.755015] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-25T19:45:22.756869] [DEBUG] [LOCAL ] LDI: Trimmed 60228 records to 44397 (keeping 200 days of data) [2025-09-25T19:45:22.761519] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T19:45:23.048662] [DEBUG] [LOCAL ] LDI: Primary data saved (44397 records). [2025-09-25T19:45:23.048935] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-25T19:45:23.049115] [INFO ] [MAIN ] Update Progress: 1246/2372 symbols completed. LDI took 24.6s. Estimated remaining: 2h 29m 25s. Rate: 7.5 symbols/min [2025-09-25T19:45:23.093151] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-25T19:45:23.247798] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:23.312024] [DEBUG] [LOCAL ] LEA: Loaded 41801 existing records from primary storage. [2025-09-25T19:45:23.312334] [INFO ] [MAIN ] LEA: Loaded 41801 existing records. [2025-09-25T19:45:23.508219] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:23.508732] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-25T19:45:23.508793] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-25T19:45:23.509288] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-25T19:45:23.509353] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-25T19:45:23.894099] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-25T19:45:23.955214] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:24.013623] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:45:24.065745] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T19:45:24.688724] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-25T19:45:25.387353] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T19:45:25.488768] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-25T19:45:26.276948] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T19:45:26.288674] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-25T19:45:26.321869] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:45:27.088882] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-25T19:45:27.893913] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-25T19:45:27.910706] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T19:45:28.688687] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-25T19:45:28.934023] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T19:45:28.990902] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T19:45:29.488705] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-25T19:45:29.683393] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:45:30.288755] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-25T19:45:31.053737] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T19:45:31.088713] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-25T19:45:31.607491] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T19:45:31.888730] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-25T19:45:32.690350] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-25T19:45:32.690209] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T19:45:33.488752] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-25T19:45:33.699418] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T19:45:34.255339] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T19:45:34.288718] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-25T19:45:34.438001] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T19:45:35.088769] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-25T19:45:35.779992] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:45:35.888747] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-25T19:45:36.688718] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-25T19:45:36.854385] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T19:45:36.932494] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T19:45:37.488833] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-25T19:45:38.228556] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T19:45:38.278732] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T19:45:38.288702] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-25T19:45:39.088827] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-25T19:45:39.867803] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T19:45:39.888691] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-25T19:45:40.076182] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T19:45:40.688777] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-25T19:45:41.488769] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-25T19:45:41.712690] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T19:45:41.725846] [INFO ] [REMOTE ] LDOS: Full fetch complete (67729 records). [2025-09-25T19:45:41.726216] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-25T19:45:42.216916] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-25T19:45:42.217054] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-25T19:45:42.218419] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-25T19:45:42.218554] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-25T19:45:42.220577] [DEBUG] [LOCAL ] LDOS: Trimmed 67729 records to 46091 (keeping 200 days of data) [2025-09-25T19:45:42.303939] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-25T19:45:42.532041] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:45:42.554703] [INFO ] [REMOTE ] LC: Full fetch complete (70400 records). [2025-09-25T19:45:42.554898] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-25T19:45:42.967005] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T19:45:43.017909] [DEBUG] [LOCAL ] LDOS: Primary data saved (46091 records). [2025-09-25T19:45:43.018027] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-25T19:45:43.017765] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T19:45:43.021507] [INFO ] [MAIN ] Update Progress: 1247/2372 symbols completed. LDOS took 40.4s. Estimated remaining: 2h 29m 28s. Rate: 7.5 symbols/min [2025-09-25T19:45:43.094702] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-25T19:45:43.335375] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-25T19:45:43.335515] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-25T19:45:43.337038] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-25T19:45:43.337172] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-25T19:45:43.347736] [DEBUG] [LOCAL ] LC: Trimmed 70400 records to 48267 (keeping 200 days of data) [2025-09-25T19:45:43.372345] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:43.618698] [DEBUG] [LOCAL ] LEG: Loaded 50384 existing records from primary storage. [2025-09-25T19:45:43.628806] [INFO ] [MAIN ] LEG: Loaded 50384 existing records. [2025-09-25T19:45:43.893441] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-25T19:45:43.955715] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:43.956133] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-25T19:45:43.956247] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-25T19:45:43.960187] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-25T19:45:43.960291] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-25T19:45:44.003037] [DEBUG] [LOCAL ] LC: Primary data saved (48267 records). [2025-09-25T19:45:44.003225] [INFO ] [MAIN ] LC: Full history saved. [2025-09-25T19:45:44.003367] [INFO ] [MAIN ] Update Progress: 1248/2372 symbols completed. LC took 48.5s. Estimated remaining: 2h 29m 13s. Rate: 7.5 symbols/min [2025-09-25T19:45:44.361978] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:44.635305] [DEBUG] [LOCAL ] LEN: Loaded 53191 existing records from primary storage. [2025-09-25T19:45:44.635609] [INFO ] [MAIN ] LEN: Loaded 53191 existing records. [2025-09-25T19:45:44.682540] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:44.695482] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-25T19:45:44.760591] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T19:45:44.911026] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:44.912013] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-25T19:45:44.912070] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-25T19:45:44.912419] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-25T19:45:44.912483] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-25T19:45:44.927620] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T19:45:44.931212] [INFO ] [REMOTE ] LDP: Full fetch complete (19462 records). [2025-09-25T19:45:44.931324] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-25T19:45:45.497804] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-25T19:45:45.776154] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-25T19:45:45.776251] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-25T19:45:45.780578] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-25T19:45:45.780816] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-25T19:45:45.781925] [DEBUG] [LOCAL ] LDP: Trimmed 19462 records to 13041 (keeping 200 days of data) [2025-09-25T19:45:45.788770] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:45.877929] [DEBUG] [LOCAL ] LDP: Primary data saved (13041 records). [2025-09-25T19:45:45.878114] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-25T19:45:45.878271] [INFO ] [MAIN ] Update Progress: 1249/2372 symbols completed. LDP took 25.3s. Estimated remaining: 2h 28m 60s. Rate: 7.5 symbols/min [2025-09-25T19:45:46.052229] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:46.080747] [DEBUG] [LOCAL ] LEO: Loaded 17545 existing records from primary storage. [2025-09-25T19:45:46.080906] [INFO ] [MAIN ] LEO: Loaded 17545 existing records. [2025-09-25T19:45:46.263369] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:46.263748] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-25T19:45:46.264274] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-25T19:45:46.264529] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-25T19:45:46.264607] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-25T19:45:46.297737] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-25T19:45:46.588735] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T19:45:46.708750] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:47.093906] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-25T19:45:47.116257] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T19:45:47.888754] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-25T19:45:48.043539] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T19:45:48.135589] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:45:48.688772] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-25T19:45:49.488755] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-25T19:45:49.651865] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:45:49.661919] [INFO ] [REMOTE ] LEA: Full fetch complete (61012 records). [2025-09-25T19:45:49.662187] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-25T19:45:49.797129] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T19:45:50.294924] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-25T19:45:50.337311] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-25T19:45:50.337499] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-25T19:45:50.339837] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-25T19:45:50.340055] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-25T19:45:50.343004] [DEBUG] [LOCAL ] LEA: Trimmed 61012 records to 42166 (keeping 200 days of data) [2025-09-25T19:45:50.769282] [DEBUG] [LOCAL ] LEA: Primary data saved (42166 records). [2025-09-25T19:45:50.769620] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-25T19:45:50.769933] [INFO ] [MAIN ] Update Progress: 1250/2372 symbols completed. LEA took 27.7s. Estimated remaining: 2h 28m 49s. Rate: 7.5 symbols/min [2025-09-25T19:45:50.998046] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:45:51.087750] [DEBUG] [LOCAL ] LEVI: Loaded 51549 existing records from primary storage. [2025-09-25T19:45:51.087976] [INFO ] [MAIN ] LEVI: Loaded 51549 existing records. [2025-09-25T19:45:51.093897] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-25T19:45:51.347048] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:45:51.347623] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-25T19:45:51.347719] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-25T19:45:51.348087] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-25T19:45:51.348169] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-25T19:45:51.668908] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T19:45:51.793859] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-25T19:45:51.891048] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-25T19:45:51.917264] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:45:52.688741] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-25T19:45:52.788007] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T19:45:52.828619] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T19:45:53.488730] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-25T19:45:54.288696] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-25T19:45:54.532591] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T19:45:54.646555] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T19:45:55.088745] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-25T19:45:55.762918] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T19:45:55.888766] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-25T19:45:56.029880] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T19:45:56.688777] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-25T19:45:57.488767] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-25T19:45:57.584723] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T19:45:58.288777] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-25T19:45:58.494311] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T19:45:59.088911] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-25T19:45:59.255618] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T19:45:59.888764] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-25T19:46:00.139454] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T19:46:00.688706] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-25T19:46:00.769456] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:46:00.993472] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T19:46:01.488745] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-25T19:46:02.288731] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-25T19:46:02.350492] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:46:02.933712] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T19:46:03.088731] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-25T19:46:03.888737] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-25T19:46:04.354732] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T19:46:04.688726] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-25T19:46:04.913489] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:46:05.488759] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-25T19:46:05.602244] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:46:06.288772] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-25T19:46:06.627611] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T19:46:07.088711] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-25T19:46:07.508873] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T19:46:07.597607] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T19:46:07.888761] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-25T19:46:08.688708] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-25T19:46:08.855537] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-25T19:46:09.178201] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T19:46:09.488736] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-25T19:46:10.288702] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-25T19:46:10.364017] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T19:46:10.518488] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T19:46:11.088736] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-25T19:46:11.888849] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-25T19:46:12.016215] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:46:12.161317] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T19:46:12.164991] [INFO ] [REMOTE ] LEO: Full fetch complete (27144 records). [2025-09-25T19:46:12.165075] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-25T19:46:12.543043] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-25T19:46:12.543144] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-25T19:46:12.543977] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-25T19:46:12.544041] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-25T19:46:12.544944] [DEBUG] [LOCAL ] LEO: Trimmed 27144 records to 17726 (keeping 200 days of data) [2025-09-25T19:46:12.661193] [DEBUG] [LOCAL ] LEO: Primary data saved (17726 records). [2025-09-25T19:46:12.661486] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-25T19:46:12.661671] [INFO ] [MAIN ] Update Progress: 1251/2372 symbols completed. LEO took 26.8s. Estimated remaining: 2h 28m 54s. Rate: 7.5 symbols/min [2025-09-25T19:46:12.694752] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-25T19:46:12.857333] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:12.883322] [DEBUG] [LOCAL ] LFT: Loaded 18087 existing records from primary storage. [2025-09-25T19:46:12.883550] [INFO ] [MAIN ] LFT: Loaded 18087 existing records. [2025-09-25T19:46:13.069283] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:13.071767] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-25T19:46:13.071832] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-25T19:46:13.072179] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-25T19:46:13.072242] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-25T19:46:13.463258] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:13.488728] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-25T19:46:13.589381] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T19:46:14.290697] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-25T19:46:14.491015] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T19:46:15.088916] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-25T19:46:15.313451] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T19:46:15.755812] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T19:46:15.888751] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-25T19:46:15.969441] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T19:46:16.576935] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T19:46:16.688691] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-25T19:46:17.488783] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-25T19:46:17.528454] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T19:46:18.288824] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-25T19:46:19.067670] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T19:46:19.088682] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-25T19:46:19.249833] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T19:46:19.888763] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-25T19:46:20.689846] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-25T19:46:20.844723] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:46:20.855254] [INFO ] [REMOTE ] LEVI: Full fetch complete (74466 records). [2025-09-25T19:46:20.855544] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-25T19:46:21.286182] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-25T19:46:21.286316] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-25T19:46:21.287983] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-25T19:46:21.291415] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-25T19:46:21.293525] [DEBUG] [LOCAL ] LEVI: Trimmed 74466 records to 51936 (keeping 200 days of data) [2025-09-25T19:46:21.473448] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T19:46:21.495758] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-25T19:46:21.575909] [INFO ] [REMOTE ] LEG: Full fetch complete (73216 records). [2025-09-25T19:46:21.576123] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-25T19:46:22.107212] [DEBUG] [LOCAL ] LEVI: Primary data saved (51936 records). [2025-09-25T19:46:22.107450] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-25T19:46:22.107717] [INFO ] [MAIN ] Update Progress: 1252/2372 symbols completed. LEVI took 31.3s. Estimated remaining: 2h 28m 47s. Rate: 7.5 symbols/min [2025-09-25T19:46:22.373381] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-25T19:46:22.373524] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-25T19:46:22.375369] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-25T19:46:22.375455] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-25T19:46:22.385757] [DEBUG] [LOCAL ] LEG: Trimmed 73216 records to 50759 (keeping 200 days of data) [2025-09-25T19:46:22.567973] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:22.681889] [DEBUG] [LOCAL ] LGI: Loaded 10017 existing records from primary storage. [2025-09-25T19:46:22.682124] [INFO ] [MAIN ] LGI: Loaded 10017 existing records. [2025-09-25T19:46:22.689610] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T19:46:22.715602] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-25T19:46:22.910904] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T19:46:23.002987] [INFO ] [REMOTE ] LEN: Full fetch complete (77029 records). [2025-09-25T19:46:23.003416] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-25T19:46:23.184405] [DEBUG] [LOCAL ] LEG: Primary data saved (50759 records). [2025-09-25T19:46:23.184677] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-25T19:46:23.184845] [INFO ] [MAIN ] Update Progress: 1253/2372 symbols completed. LEG took 40.2s. Estimated remaining: 2h 28m 33s. Rate: 7.5 symbols/min [2025-09-25T19:46:23.204620] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:23.210597] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-25T19:46:23.210682] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-25T19:46:23.211118] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-25T19:46:23.211191] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-25T19:46:23.805084] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:23.916109] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T19:46:23.958297] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-25T19:46:24.038533] [DEBUG] [LOCAL ] LH: Loaded 38227 existing records from primary storage. [2025-09-25T19:46:24.063078] [INFO ] [MAIN ] LH: Loaded 38227 existing records. [2025-09-25T19:46:24.318558] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-25T19:46:24.329412] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-25T19:46:24.331037] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-25T19:46:24.331112] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-25T19:46:24.348920] [DEBUG] [LOCAL ] LEN: Trimmed 77029 records to 53580 (keeping 200 days of data) [2025-09-25T19:46:24.618789] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:24.623150] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-25T19:46:24.640211] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:24.641793] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-25T19:46:24.641850] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-25T19:46:24.642186] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-25T19:46:24.642247] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-25T19:46:25.244774] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T19:46:25.264663] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-25T19:46:25.302752] [DEBUG] [LOCAL ] LEN: Primary data saved (53580 records). [2025-09-25T19:46:25.302984] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-25T19:46:25.303192] [INFO ] [MAIN ] Update Progress: 1254/2372 symbols completed. LEN took 41.3s. Estimated remaining: 2h 28m 20s. Rate: 7.5 symbols/min [2025-09-25T19:46:25.438093] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:25.471950] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T19:46:25.493788] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-25T19:46:25.579359] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:25.650085] [DEBUG] [LOCAL ] LHX: Loaded 48707 existing records from primary storage. [2025-09-25T19:46:25.650310] [INFO ] [MAIN ] LHX: Loaded 48707 existing records. [2025-09-25T19:46:25.839884] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:25.840523] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-25T19:46:25.840597] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-25T19:46:25.841294] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-25T19:46:25.841365] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-25T19:46:26.227008] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:26.263044] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T19:46:26.288694] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-25T19:46:26.361266] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T19:46:27.060922] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T19:46:27.088683] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-25T19:46:27.888799] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-25T19:46:28.591672] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T19:46:28.678302] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T19:46:28.688711] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-25T19:46:29.488766] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-25T19:46:30.168999] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T19:46:30.288691] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-25T19:46:30.594055] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T19:46:31.088728] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-25T19:46:31.794112] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:46:31.869621] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T19:46:31.873124] [INFO ] [REMOTE ] LFT: Full fetch complete (23967 records). [2025-09-25T19:46:31.873218] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-25T19:46:31.889328] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-25T19:46:32.338683] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-25T19:46:32.338791] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-25T19:46:32.339557] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-25T19:46:32.339620] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-25T19:46:32.341012] [DEBUG] [LOCAL ] LFT: Trimmed 23967 records to 18180 (keeping 200 days of data) [2025-09-25T19:46:32.476576] [DEBUG] [LOCAL ] LFT: Primary data saved (18180 records). [2025-09-25T19:46:32.476803] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-25T19:46:32.476990] [INFO ] [MAIN ] Update Progress: 1255/2372 symbols completed. LFT took 19.8s. Estimated remaining: 2h 28m 11s. Rate: 7.5 symbols/min [2025-09-25T19:46:32.671565] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:32.688764] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-25T19:46:32.719617] [DEBUG] [LOCAL ] LII: Loaded 28324 existing records from primary storage. [2025-09-25T19:46:32.719850] [INFO ] [MAIN ] LII: Loaded 28324 existing records. [2025-09-25T19:46:32.911440] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:32.912212] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-25T19:46:32.913159] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-25T19:46:32.913750] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-25T19:46:32.913834] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-25T19:46:33.350666] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:33.488693] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-25T19:46:33.588477] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T19:46:34.288739] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-25T19:46:34.366838] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T19:46:34.470850] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T19:46:35.088760] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-25T19:46:35.190070] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T19:46:35.888764] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-25T19:46:36.665453] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T19:46:36.688680] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-25T19:46:36.813209] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T19:46:37.488785] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-25T19:46:37.512299] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T19:46:38.288751] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-25T19:46:38.520824] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T19:46:39.064850] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:46:39.088683] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-25T19:46:39.888756] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-25T19:46:40.493029] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T19:46:40.688767] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-25T19:46:40.745476] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:46:41.488742] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-25T19:46:42.175917] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T19:46:42.288792] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-25T19:46:42.912985] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T19:46:43.088766] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-25T19:46:43.149378] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T19:46:43.153945] [INFO ] [REMOTE ] LGI: Full fetch complete (14303 records). [2025-09-25T19:46:43.154178] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-25T19:46:43.780204] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-25T19:46:43.780338] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-25T19:46:43.781090] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-25T19:46:43.781162] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-25T19:46:43.782157] [DEBUG] [LOCAL ] LGI: Trimmed 14303 records to 10065 (keeping 200 days of data) [2025-09-25T19:46:43.872396] [DEBUG] [LOCAL ] LGI: Primary data saved (10065 records). [2025-09-25T19:46:43.872599] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-25T19:46:43.872762] [INFO ] [MAIN ] Update Progress: 1256/2372 symbols completed. LGI took 21.8s. Estimated remaining: 2h 28m 6s. Rate: 7.5 symbols/min [2025-09-25T19:46:43.891156] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-25T19:46:44.103990] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:44.167176] [DEBUG] [LOCAL ] LION: Loaded 43248 existing records from primary storage. [2025-09-25T19:46:44.167351] [INFO ] [MAIN ] LION: Loaded 43248 existing records. [2025-09-25T19:46:44.353201] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:44.356104] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-25T19:46:44.356170] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-25T19:46:44.356440] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-25T19:46:44.356501] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-25T19:46:44.669334] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:46:44.693810] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-25T19:46:44.806710] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:45.488735] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-25T19:46:45.607299] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T19:46:46.232242] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:46:46.288720] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-25T19:46:46.528111] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:46:47.088751] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-25T19:46:47.859425] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T19:46:47.888727] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-25T19:46:48.688758] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-25T19:46:48.765626] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T19:46:49.264433] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T19:46:49.488744] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-25T19:46:49.768375] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T19:46:50.288806] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-25T19:46:50.945423] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T19:46:50.951694] [INFO ] [REMOTE ] LH: Full fetch complete (54830 records). [2025-09-25T19:46:50.951894] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-25T19:46:51.094889] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-25T19:46:51.371936] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-25T19:46:51.372031] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-25T19:46:51.373226] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-25T19:46:51.373359] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-25T19:46:51.374715] [DEBUG] [LOCAL ] LH: Trimmed 54830 records to 38437 (keeping 200 days of data) [2025-09-25T19:46:51.639484] [DEBUG] [LOCAL ] LH: Primary data saved (38437 records). [2025-09-25T19:46:51.643804] [INFO ] [MAIN ] LH: Full history saved. [2025-09-25T19:46:51.643952] [INFO ] [MAIN ] Update Progress: 1257/2372 symbols completed. LH took 28.5s. Estimated remaining: 2h 27m 58s. Rate: 7.5 symbols/min [2025-09-25T19:46:51.827531] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:46:51.837623] [DEBUG] [LOCAL ] LITB: Loaded 4382 existing records from primary storage. [2025-09-25T19:46:51.840804] [INFO ] [MAIN ] LITB: Loaded 4382 existing records. [2025-09-25T19:46:51.914726] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-25T19:46:52.046810] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:46:52.047446] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-25T19:46:52.047495] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-25T19:46:52.047728] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-25T19:46:52.047786] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-25T19:46:52.213203] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T19:46:52.547329] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:46:52.618919] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T19:46:52.693839] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-25T19:46:52.708550] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T19:46:53.488729] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-25T19:46:53.976353] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T19:46:54.288733] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-25T19:46:54.540970] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T19:46:55.088732] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-25T19:46:55.284503] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T19:46:55.484140] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T19:46:55.888728] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-25T19:46:56.688795] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-25T19:46:57.177634] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T19:46:57.488704] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-25T19:46:58.288759] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-25T19:46:58.462471] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T19:46:58.664407] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T19:46:58.771614] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T19:46:59.089709] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-25T19:46:59.539423] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T19:46:59.888777] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-25T19:47:00.539395] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T19:47:00.688762] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-25T19:47:01.488756] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-25T19:47:02.288763] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-25T19:47:02.326919] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T19:47:02.529737] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T19:47:03.088793] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-25T19:47:03.734543] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T19:47:03.744007] [INFO ] [REMOTE ] LII: Full fetch complete (41296 records). [2025-09-25T19:47:03.744236] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-25T19:47:03.888935] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-25T19:47:04.179266] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-25T19:47:04.179367] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-25T19:47:04.180483] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-25T19:47:04.180583] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-25T19:47:04.181685] [DEBUG] [LOCAL ] LII: Trimmed 41296 records to 28514 (keeping 200 days of data) [2025-09-25T19:47:04.377312] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T19:47:04.427986] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-25T19:47:04.445720] [DEBUG] [LOCAL ] LII: Primary data saved (28514 records). [2025-09-25T19:47:04.445903] [INFO ] [MAIN ] LII: Full history saved. [2025-09-25T19:47:04.446069] [INFO ] [MAIN ] Update Progress: 1258/2372 symbols completed. LII took 32.0s. Estimated remaining: 2h 27m 54s. Rate: 7.5 symbols/min [2025-09-25T19:47:04.627871] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:04.699480] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-25T19:47:04.704071] [DEBUG] [LOCAL ] LLY: Loaded 53288 existing records from primary storage. [2025-09-25T19:47:04.704251] [INFO ] [MAIN ] LLY: Loaded 53288 existing records. [2025-09-25T19:47:04.898962] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:04.899554] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-25T19:47:04.899622] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-25T19:47:04.900075] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-25T19:47:04.900145] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-25T19:47:05.294712] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:05.488778] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-25T19:47:06.288735] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-25T19:47:06.529549] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T19:47:06.767120] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T19:47:07.088790] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-25T19:47:07.533610] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-25T19:47:07.888726] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-25T19:47:08.188097] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-25T19:47:08.189988] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.70 seconds). [2025-09-25T19:47:08.688721] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-25T19:47:09.488774] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-25T19:47:10.288711] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-25T19:47:11.037627] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T19:47:11.039586] [INFO ] [REMOTE ] LITB: Full fetch complete (5625 records). [2025-09-25T19:47:11.039683] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-25T19:47:11.101917] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-25T19:47:11.295744] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T19:47:11.335230] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-25T19:47:11.563486] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-25T19:47:11.563609] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-25T19:47:11.563884] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-25T19:47:11.563943] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-25T19:47:11.564409] [DEBUG] [LOCAL ] LITB: Trimmed 5625 records to 4406 (keeping 200 days of data) [2025-09-25T19:47:11.596491] [DEBUG] [LOCAL ] LITB: Primary data saved (4406 records). [2025-09-25T19:47:11.596682] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-25T19:47:11.596920] [INFO ] [MAIN ] Update Progress: 1259/2372 symbols completed. LITB took 20.0s. Estimated remaining: 2h 27m 46s. Rate: 7.5 symbols/min [2025-09-25T19:47:11.871775] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:11.888693] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-25T19:47:11.958031] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-09-25T19:47:11.958222] [INFO ] [MAIN ] LMND: Loaded 51874 existing records. [2025-09-25T19:47:12.181960] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:12.182903] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-25T19:47:12.182963] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-25T19:47:12.183454] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-25T19:47:12.183538] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-25T19:47:12.604010] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:12.688692] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-25T19:47:13.052740] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T19:47:13.488695] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-25T19:47:13.634819] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T19:47:14.288735] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-25T19:47:15.031702] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-25T19:47:15.088702] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-25T19:47:15.125023] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T19:47:15.888753] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-25T19:47:16.277903] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T19:47:16.688791] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-25T19:47:16.936498] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T19:47:17.410431] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T19:47:17.420495] [INFO ] [REMOTE ] LHX: Full fetch complete (70823 records). [2025-09-25T19:47:17.422711] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-25T19:47:17.488682] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-25T19:47:17.860895] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-25T19:47:17.861010] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-25T19:47:17.862273] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-25T19:47:17.862343] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-25T19:47:17.864070] [DEBUG] [LOCAL ] LHX: Trimmed 70823 records to 49078 (keeping 200 days of data) [2025-09-25T19:47:18.218407] [DEBUG] [LOCAL ] LHX: Primary data saved (49078 records). [2025-09-25T19:47:18.218590] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-25T19:47:18.218742] [INFO ] [MAIN ] Update Progress: 1260/2372 symbols completed. LHX took 52.9s. Estimated remaining: 2h 27m 36s. Rate: 7.5 symbols/min [2025-09-25T19:47:18.290485] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-25T19:47:18.397580] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:18.466032] [DEBUG] [LOCAL ] LMT: Loaded 49894 existing records from primary storage. [2025-09-25T19:47:18.466250] [INFO ] [MAIN ] LMT: Loaded 49894 existing records. [2025-09-25T19:47:18.651296] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:18.653222] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-25T19:47:18.653275] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-25T19:47:18.653609] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-25T19:47:18.653698] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-25T19:47:19.036072] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:19.088671] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-25T19:47:19.243346] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-25T19:47:19.407399] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T19:47:19.420330] [INFO ] [REMOTE ] LION: Full fetch complete (54324 records). [2025-09-25T19:47:19.420529] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-25T19:47:19.839300] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-25T19:47:19.839404] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-25T19:47:19.840695] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-25T19:47:19.840764] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-25T19:47:19.842481] [DEBUG] [LOCAL ] LION: Trimmed 54324 records to 43618 (keeping 200 days of data) [2025-09-25T19:47:19.901409] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-25T19:47:20.136151] [DEBUG] [LOCAL ] LION: Primary data saved (43618 records). [2025-09-25T19:47:20.136413] [INFO ] [MAIN ] LION: Full history saved. [2025-09-25T19:47:20.136542] [INFO ] [MAIN ] Update Progress: 1261/2372 symbols completed. LION took 36.3s. Estimated remaining: 2h 27m 23s. Rate: 7.5 symbols/min [2025-09-25T19:47:20.269468] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T19:47:20.387912] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:20.449060] [DEBUG] [LOCAL ] LNC: Loaded 51623 existing records from primary storage. [2025-09-25T19:47:20.449278] [INFO ] [MAIN ] LNC: Loaded 51623 existing records. [2025-09-25T19:47:20.648901] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:20.649301] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-25T19:47:20.649351] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-25T19:47:20.649844] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-25T19:47:20.649920] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-25T19:47:20.698170] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-25T19:47:21.041423] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:21.158136] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-25T19:47:21.488783] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-25T19:47:22.236885] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-25T19:47:22.288795] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-25T19:47:22.295824] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T19:47:23.088723] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-25T19:47:23.160858] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T19:47:23.888699] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-25T19:47:24.004265] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T19:47:24.688753] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-25T19:47:25.488759] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-25T19:47:25.808339] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-25T19:47:25.870393] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T19:47:26.288742] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-25T19:47:26.354419] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T19:47:27.088860] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-25T19:47:27.265973] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:47:27.888732] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-25T19:47:28.474945] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T19:47:28.688729] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-25T19:47:28.784750] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-25T19:47:29.488815] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-25T19:47:29.781622] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T19:47:30.288755] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-25T19:47:30.851229] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-25T19:47:31.088718] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-25T19:47:31.272241] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:47:31.888739] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-25T19:47:32.688741] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-25T19:47:32.745337] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-25T19:47:32.813384] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T19:47:33.488794] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-25T19:47:33.709280] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T19:47:34.288703] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-25T19:47:34.530945] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T19:47:35.088689] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-25T19:47:35.511029] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T19:47:35.888699] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-25T19:47:36.435756] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-25T19:47:36.688751] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-25T19:47:37.331167] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T19:47:37.488754] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-25T19:47:37.836460] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-25T19:47:38.288808] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-25T19:47:38.924800] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T19:47:38.929623] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-25T19:47:39.088780] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-25T19:47:39.888861] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-25T19:47:40.688830] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-25T19:47:41.117638] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.83 seconds). [2025-09-25T19:47:41.129131] [INFO ] [REMOTE ] LLY: Full fetch complete (77263 records). [2025-09-25T19:47:41.129367] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-25T19:47:41.302567] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-25T19:47:41.497792] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-25T19:47:41.509599] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:47:41.708537] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-25T19:47:41.708719] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-25T19:47:41.710714] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-25T19:47:41.710887] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-25T19:47:41.714777] [DEBUG] [LOCAL ] LLY: Trimmed 77263 records to 53678 (keeping 200 days of data) [2025-09-25T19:47:42.133917] [DEBUG] [LOCAL ] LLY: Primary data saved (53678 records). [2025-09-25T19:47:42.134119] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-25T19:47:42.135825] [INFO ] [MAIN ] Update Progress: 1262/2372 symbols completed. LLY took 37.7s. Estimated remaining: 2h 27m 28s. Rate: 7.5 symbols/min [2025-09-25T19:47:42.288937] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-25T19:47:42.325198] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:42.341501] [DEBUG] [LOCAL ] LND: Loaded 4968 existing records from primary storage. [2025-09-25T19:47:42.341944] [INFO ] [MAIN ] LND: Loaded 4968 existing records. [2025-09-25T19:47:42.558920] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:42.559839] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-25T19:47:42.559922] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-25T19:47:42.560368] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-25T19:47:42.561072] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-25T19:47:42.839251] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-25T19:47:43.002382] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:43.088737] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-25T19:47:43.556314] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T19:47:43.567002] [INFO ] [REMOTE ] LMND: Full fetch complete (75288 records). [2025-09-25T19:47:43.567202] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-25T19:47:43.666178] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-25T19:47:43.893809] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-25T19:47:44.022322] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T19:47:44.077325] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-25T19:47:44.077442] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-25T19:47:44.078920] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-25T19:47:44.079003] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-25T19:47:44.080975] [DEBUG] [LOCAL ] LMND: Trimmed 75288 records to 52260 (keeping 200 days of data) [2025-09-25T19:47:44.440543] [DEBUG] [LOCAL ] LMND: Primary data saved (52260 records). [2025-09-25T19:47:44.441112] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-25T19:47:44.442808] [INFO ] [MAIN ] Update Progress: 1263/2372 symbols completed. LMND took 32.8s. Estimated remaining: 2h 27m 15s. Rate: 7.5 symbols/min [2025-09-25T19:47:44.635175] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:44.688697] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-25T19:47:44.711905] [DEBUG] [LOCAL ] LNG: Loaded 51493 existing records from primary storage. [2025-09-25T19:47:44.712088] [INFO ] [MAIN ] LNG: Loaded 51493 existing records. [2025-09-25T19:47:44.797056] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T19:47:44.918083] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:44.918735] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-25T19:47:44.918798] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-25T19:47:44.919348] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-25T19:47:44.919410] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-25T19:47:45.308782] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:45.488760] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-25T19:47:46.136320] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T19:47:46.288726] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-25T19:47:46.996041] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-25T19:47:47.088742] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-25T19:47:47.739799] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T19:47:47.888721] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-25T19:47:48.176258] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T19:47:48.688744] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-25T19:47:49.393498] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-25T19:47:49.488688] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-25T19:47:49.796909] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T19:47:49.807134] [INFO ] [REMOTE ] LNC: Full fetch complete (74101 records). [2025-09-25T19:47:49.807278] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-25T19:47:50.221257] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-25T19:47:50.221389] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-25T19:47:50.222941] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-25T19:47:50.223016] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-25T19:47:50.225252] [DEBUG] [LOCAL ] LNC: Trimmed 74101 records to 51993 (keeping 200 days of data) [2025-09-25T19:47:50.297765] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-25T19:47:50.599674] [DEBUG] [LOCAL ] LNC: Primary data saved (51993 records). [2025-09-25T19:47:50.599875] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-25T19:47:50.600014] [INFO ] [MAIN ] Update Progress: 1264/2372 symbols completed. LNC took 30.5s. Estimated remaining: 2h 27m 5s. Rate: 7.5 symbols/min [2025-09-25T19:47:50.792173] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:50.813373] [DEBUG] [LOCAL ] LNN: Loaded 11268 existing records from primary storage. [2025-09-25T19:47:50.813551] [INFO ] [MAIN ] LNN: Loaded 11268 existing records. [2025-09-25T19:47:50.942328] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T19:47:51.009606] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:51.010081] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-25T19:47:51.010135] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-25T19:47:51.010449] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-25T19:47:51.010512] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-25T19:47:51.094685] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-25T19:47:51.394389] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:51.642425] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-25T19:47:51.760871] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T19:47:51.888743] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-25T19:47:52.688758] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-25T19:47:53.488772] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-25T19:47:53.533263] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T19:47:54.147933] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-25T19:47:54.169755] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T19:47:54.288782] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-25T19:47:55.088761] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-25T19:47:55.888751] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-25T19:47:56.482084] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T19:47:56.611240] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-25T19:47:56.623999] [INFO ] [REMOTE ] LMT: Full fetch complete (72544 records). [2025-09-25T19:47:56.624369] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-25T19:47:56.696808] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-25T19:47:56.834870] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T19:47:57.148580] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-25T19:47:57.148745] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-25T19:47:57.150345] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-25T19:47:57.150416] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-25T19:47:57.154477] [DEBUG] [LOCAL ] LMT: Trimmed 72544 records to 50266 (keeping 200 days of data) [2025-09-25T19:47:57.384951] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T19:47:57.491905] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-25T19:47:57.533995] [DEBUG] [LOCAL ] LMT: Primary data saved (50266 records). [2025-09-25T19:47:57.534133] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-25T19:47:57.534246] [INFO ] [MAIN ] Update Progress: 1265/2372 symbols completed. LMT took 39.3s. Estimated remaining: 2h 26m 56s. Rate: 7.5 symbols/min [2025-09-25T19:47:57.712795] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:57.759962] [DEBUG] [LOCAL ] LOAR: Loaded 41692 existing records from primary storage. [2025-09-25T19:47:57.760178] [INFO ] [MAIN ] LOAR: Loaded 41692 existing records. [2025-09-25T19:47:57.957900] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:57.958495] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-25T19:47:57.958581] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-25T19:47:57.959565] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-25T19:47:57.959631] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-25T19:47:58.293851] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-25T19:47:58.352511] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T19:47:58.359155] [INFO ] [REMOTE ] LND: Full fetch complete (8655 records). [2025-09-25T19:47:58.359307] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-25T19:47:58.411962] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:58.783301] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-25T19:47:58.783410] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-25T19:47:58.783821] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-25T19:47:58.783900] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-25T19:47:58.784758] [DEBUG] [LOCAL ] LND: Trimmed 8655 records to 4991 (keeping 200 days of data) [2025-09-25T19:47:58.816016] [DEBUG] [LOCAL ] LND: Primary data saved (4991 records). [2025-09-25T19:47:58.816120] [INFO ] [MAIN ] LND: Full history saved. [2025-09-25T19:47:58.816262] [INFO ] [MAIN ] Update Progress: 1266/2372 symbols completed. LND took 16.7s. Estimated remaining: 2h 26m 42s. Rate: 7.5 symbols/min [2025-09-25T19:47:58.999043] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:47:59.041734] [DEBUG] [LOCAL ] LOB: Loaded 27485 existing records from primary storage. [2025-09-25T19:47:59.041948] [INFO ] [MAIN ] LOB: Loaded 27485 existing records. [2025-09-25T19:47:59.092740] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-25T19:47:59.262550] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:47:59.263048] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-25T19:47:59.263102] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-25T19:47:59.263565] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-25T19:47:59.263625] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-25T19:47:59.641960] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:47:59.888696] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-25T19:47:59.954442] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T19:48:00.474401] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T19:48:00.688749] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-25T19:48:01.148676] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T19:48:01.488742] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-25T19:48:01.603474] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T19:48:02.288755] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-25T19:48:03.088743] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-25T19:48:03.531633] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T19:48:03.557784] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T19:48:03.724005] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T19:48:03.888741] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-25T19:48:04.688878] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-25T19:48:05.312113] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T19:48:05.488767] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-25T19:48:05.502555] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T19:48:06.288815] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-25T19:48:06.898781] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T19:48:07.088702] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-25T19:48:07.167713] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T19:48:07.895359] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T19:48:07.895674] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-25T19:48:08.689015] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-25T19:48:08.885751] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T19:48:09.488769] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-25T19:48:10.288712] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-25T19:48:10.370457] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:48:10.607692] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T19:48:11.088762] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-25T19:48:11.888781] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-25T19:48:12.001389] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T19:48:12.598733] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T19:48:12.633803] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T19:48:12.688736] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-25T19:48:13.488740] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-25T19:48:14.295810] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-25T19:48:14.332530] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T19:48:14.810453] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T19:48:15.091929] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-25T19:48:15.097495] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T19:48:15.888747] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-25T19:48:16.688747] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-25T19:48:16.774363] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T19:48:16.847832] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T19:48:16.856204] [INFO ] [REMOTE ] LNN: Full fetch complete (15576 records). [2025-09-25T19:48:16.856577] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-25T19:48:17.260751] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-25T19:48:17.260910] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-25T19:48:17.261507] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-25T19:48:17.261609] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-25T19:48:17.262755] [DEBUG] [LOCAL ] LNN: Trimmed 15576 records to 11349 (keeping 200 days of data) [2025-09-25T19:48:17.348875] [DEBUG] [LOCAL ] LNN: Primary data saved (11349 records). [2025-09-25T19:48:17.349050] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-25T19:48:17.349271] [INFO ] [MAIN ] Update Progress: 1267/2372 symbols completed. LNN took 26.7s. Estimated remaining: 2h 26m 44s. Rate: 7.5 symbols/min [2025-09-25T19:48:17.497446] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-25T19:48:17.534117] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:17.547296] [DEBUG] [LOCAL ] LOCL: Loaded 3595 existing records from primary storage. [2025-09-25T19:48:17.547439] [INFO ] [MAIN ] LOCL: Loaded 3595 existing records. [2025-09-25T19:48:17.731579] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:17.731907] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-25T19:48:17.731977] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-25T19:48:17.732324] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-25T19:48:17.732410] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-25T19:48:18.097931] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:18.288744] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-25T19:48:18.686209] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T19:48:18.962996] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:48:19.088737] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-25T19:48:19.639232] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T19:48:19.888739] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-25T19:48:20.500167] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-25T19:48:20.576307] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T19:48:20.584235] [INFO ] [REMOTE ] LOAR: Full fetch complete (56465 records). [2025-09-25T19:48:20.584372] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-25T19:48:20.691075] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-25T19:48:21.003994] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-25T19:48:21.004102] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-25T19:48:21.005223] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-25T19:48:21.005288] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-25T19:48:21.006843] [DEBUG] [LOCAL ] LOAR: Trimmed 56465 records to 41940 (keeping 200 days of data) [2025-09-25T19:48:21.216699] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-25T19:48:21.310582] [DEBUG] [LOCAL ] LOAR: Primary data saved (41940 records). [2025-09-25T19:48:21.310785] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-25T19:48:21.310949] [INFO ] [MAIN ] Update Progress: 1268/2372 symbols completed. LOAR took 23.8s. Estimated remaining: 2h 26m 32s. Rate: 7.5 symbols/min [2025-09-25T19:48:21.497021] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-25T19:48:21.504411] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:21.566996] [DEBUG] [LOCAL ] LOMA: Loaded 31918 existing records from primary storage. [2025-09-25T19:48:21.567165] [INFO ] [MAIN ] LOMA: Loaded 31918 existing records. [2025-09-25T19:48:21.750119] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:21.750456] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-25T19:48:21.750500] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-25T19:48:21.750922] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-25T19:48:21.750981] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-25T19:48:22.113001] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:22.288728] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-25T19:48:23.088696] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-25T19:48:23.496721] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T19:48:23.748034] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T19:48:23.781318] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T19:48:23.888702] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-25T19:48:24.688774] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-25T19:48:25.262279] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T19:48:25.488757] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-25T19:48:26.288761] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-25T19:48:26.649928] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T19:48:26.772604] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T19:48:26.792516] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T19:48:27.088756] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-25T19:48:27.888806] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-25T19:48:28.208297] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T19:48:28.688738] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-25T19:48:28.989464] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T19:48:29.488705] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-25T19:48:29.810039] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T19:48:30.288750] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-25T19:48:30.684135] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T19:48:31.088747] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-25T19:48:31.511871] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:48:31.888831] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-25T19:48:32.300942] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T19:48:32.688769] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-25T19:48:33.051506] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T19:48:33.488791] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-25T19:48:33.857042] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T19:48:34.230693] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T19:48:34.288708] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-25T19:48:34.724392] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-25T19:48:35.088771] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-25T19:48:35.888912] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-25T19:48:36.302800] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-25T19:48:36.323747] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T19:48:36.331443] [INFO ] [REMOTE ] LOB: Full fetch complete (37754 records). [2025-09-25T19:48:36.331622] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-25T19:48:36.688758] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-25T19:48:36.743018] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-25T19:48:36.743133] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-25T19:48:36.744379] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-25T19:48:36.744494] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-25T19:48:36.747243] [DEBUG] [LOCAL ] LOB: Trimmed 37754 records to 27742 (keeping 200 days of data) [2025-09-25T19:48:36.951431] [DEBUG] [LOCAL ] LOB: Primary data saved (27742 records). [2025-09-25T19:48:36.951626] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-25T19:48:36.951858] [INFO ] [MAIN ] Update Progress: 1269/2372 symbols completed. LOB took 38.1s. Estimated remaining: 2h 26m 31s. Rate: 7.5 symbols/min [2025-09-25T19:48:37.138963] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:37.223685] [DEBUG] [LOCAL ] LOW: Loaded 52958 existing records from primary storage. [2025-09-25T19:48:37.223885] [INFO ] [MAIN ] LOW: Loaded 52958 existing records. [2025-09-25T19:48:37.405025] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:37.405588] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-25T19:48:37.405662] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-25T19:48:37.406262] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-25T19:48:37.406335] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-25T19:48:37.499744] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-25T19:48:37.781375] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:38.275057] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T19:48:38.288749] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-25T19:48:38.292415] [INFO ] [REMOTE ] LNG: Full fetch complete (74719 records). [2025-09-25T19:48:38.292697] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-25T19:48:38.456925] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T19:48:38.843785] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-25T19:48:38.843917] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-25T19:48:38.845514] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-25T19:48:38.845589] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-25T19:48:38.847965] [DEBUG] [LOCAL ] LNG: Trimmed 74719 records to 51871 (keeping 200 days of data) [2025-09-25T19:48:39.099740] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-25T19:48:39.259485] [DEBUG] [LOCAL ] LNG: Primary data saved (51871 records). [2025-09-25T19:48:39.259771] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-25T19:48:39.262877] [INFO ] [MAIN ] Update Progress: 1270/2372 symbols completed. LNG took 54.8s. Estimated remaining: 2h 26m 18s. Rate: 7.5 symbols/min [2025-09-25T19:48:39.440335] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:39.510885] [DEBUG] [LOCAL ] LPG: Loaded 40053 existing records from primary storage. [2025-09-25T19:48:39.511112] [INFO ] [MAIN ] LPG: Loaded 40053 existing records. [2025-09-25T19:48:39.711337] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:39.711886] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-25T19:48:39.711976] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-25T19:48:39.715695] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-25T19:48:39.715771] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-25T19:48:39.894750] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-25T19:48:40.140117] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:40.181414] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T19:48:40.336954] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-25T19:48:40.471990] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T19:48:40.688725] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-25T19:48:41.488781] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-25T19:48:42.293744] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-25T19:48:42.331284] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T19:48:42.786490] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T19:48:42.799377] [INFO ] [REMOTE ] LOMA: Full fetch complete (48106 records). [2025-09-25T19:48:42.799576] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-25T19:48:43.097830] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-25T19:48:43.211516] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-25T19:48:43.211621] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-25T19:48:43.212795] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-25T19:48:43.212859] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-25T19:48:43.215848] [DEBUG] [LOCAL ] LOMA: Trimmed 48106 records to 32261 (keeping 200 days of data) [2025-09-25T19:48:43.426675] [DEBUG] [LOCAL ] LOMA: Primary data saved (32261 records). [2025-09-25T19:48:43.426852] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-25T19:48:43.426998] [INFO ] [MAIN ] Update Progress: 1271/2372 symbols completed. LOMA took 22.1s. Estimated remaining: 2h 26m 7s. Rate: 7.5 symbols/min [2025-09-25T19:48:43.610501] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T19:48:43.613420] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:43.649378] [DEBUG] [LOCAL ] LPL: Loaded 25786 existing records from primary storage. [2025-09-25T19:48:43.649548] [INFO ] [MAIN ] LPL: Loaded 25786 existing records. [2025-09-25T19:48:43.835537] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:43.835993] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-25T19:48:43.836061] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-25T19:48:43.836383] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-25T19:48:43.836464] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-25T19:48:43.894161] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-25T19:48:44.218855] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:44.302103] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T19:48:44.629295] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T19:48:44.631120] [INFO ] [REMOTE ] LOCL: Full fetch complete (4833 records). [2025-09-25T19:48:44.631192] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-25T19:48:44.692712] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-25T19:48:45.041042] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-25T19:48:45.041275] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-25T19:48:45.041553] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-25T19:48:45.041600] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-25T19:48:45.042714] [DEBUG] [LOCAL ] LOCL: Trimmed 4833 records to 3622 (keeping 200 days of data) [2025-09-25T19:48:45.070354] [DEBUG] [LOCAL ] LOCL: Primary data saved (3622 records). [2025-09-25T19:48:45.070558] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-25T19:48:45.070803] [INFO ] [MAIN ] Update Progress: 1272/2372 symbols completed. LOCL took 27.7s. Estimated remaining: 2h 25m 53s. Rate: 7.5 symbols/min [2025-09-25T19:48:45.259546] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:48:45.320948] [DEBUG] [LOCAL ] LPX: Loaded 39704 existing records from primary storage. [2025-09-25T19:48:45.321126] [INFO ] [MAIN ] LPX: Loaded 39704 existing records. [2025-09-25T19:48:45.493909] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-25T19:48:45.529546] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:48:45.530904] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-25T19:48:45.530958] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-25T19:48:45.531250] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-25T19:48:45.531311] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-25T19:48:45.884791] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T19:48:45.960278] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:48:46.288742] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-25T19:48:47.088742] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-25T19:48:47.149813] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T19:48:47.888860] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-25T19:48:47.959626] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T19:48:48.197552] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T19:48:48.688834] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-25T19:48:49.488726] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-25T19:48:49.753606] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T19:48:50.252862] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T19:48:50.288670] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-25T19:48:50.664384] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T19:48:51.088704] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-25T19:48:51.888714] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-25T19:48:51.934452] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T19:48:52.688758] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-25T19:48:52.719184] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T19:48:53.392313] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T19:48:53.488698] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-25T19:48:54.288773] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-25T19:48:54.781957] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T19:48:54.833380] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T19:48:55.088748] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-25T19:48:55.896243] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-25T19:48:55.918832] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T19:48:56.689692] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-25T19:48:56.702687] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:48:56.756014] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T19:48:57.488755] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-25T19:48:58.288754] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-25T19:48:58.643304] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T19:48:58.941944] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T19:48:59.088777] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-25T19:48:59.886006] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T19:48:59.888994] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-25T19:49:00.543273] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:49:00.688790] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-25T19:49:00.934206] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T19:49:01.488729] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-25T19:49:02.125961] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T19:49:02.288764] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-25T19:49:03.056478] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T19:49:03.088705] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-25T19:49:03.888913] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-25T19:49:04.377697] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T19:49:04.528942] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T19:49:04.690197] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-25T19:49:04.694212] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T19:49:05.488764] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-25T19:49:06.224965] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T19:49:06.288713] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-25T19:49:06.558704] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T19:49:07.088736] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-25T19:49:07.888757] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-25T19:49:07.962521] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T19:49:07.975236] [INFO ] [REMOTE ] LPG: Full fetch complete (59847 records). [2025-09-25T19:49:07.975450] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-25T19:49:08.420398] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-25T19:49:08.420527] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-25T19:49:08.422065] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-25T19:49:08.422186] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-25T19:49:08.423971] [DEBUG] [LOCAL ] LPG: Trimmed 59847 records to 40307 (keeping 200 days of data) [2025-09-25T19:49:08.689056] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-25T19:49:08.723699] [DEBUG] [LOCAL ] LPG: Primary data saved (40307 records). [2025-09-25T19:49:08.723875] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-25T19:49:08.724167] [INFO ] [MAIN ] Update Progress: 1273/2372 symbols completed. LPG took 29.5s. Estimated remaining: 2h 25m 59s. Rate: 7.5 symbols/min [2025-09-25T19:49:08.908054] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:08.968793] [DEBUG] [LOCAL ] LRN: Loaded 39954 existing records from primary storage. [2025-09-25T19:49:08.968979] [INFO ] [MAIN ] LRN: Loaded 39954 existing records. [2025-09-25T19:49:09.210483] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-25T19:49:09.241687] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:09.242113] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-25T19:49:09.242174] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-25T19:49:09.244506] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-25T19:49:09.244596] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-25T19:49:09.281149] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T19:49:09.488967] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-25T19:49:09.617668] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T19:49:09.655129] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:10.288737] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-25T19:49:11.088730] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-25T19:49:11.485741] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T19:49:11.498585] [INFO ] [REMOTE ] LOW: Full fetch complete (76507 records). [2025-09-25T19:49:11.498907] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-25T19:49:11.621161] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T19:49:11.891348] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-25T19:49:12.032286] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-25T19:49:12.032443] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-25T19:49:12.035133] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-25T19:49:12.035209] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-25T19:49:12.038000] [DEBUG] [LOCAL ] LOW: Trimmed 76507 records to 53346 (keeping 200 days of data) [2025-09-25T19:49:12.411018] [DEBUG] [LOCAL ] LOW: Primary data saved (53346 records). [2025-09-25T19:49:12.411185] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-25T19:49:12.412507] [INFO ] [MAIN ] Update Progress: 1274/2372 symbols completed. LOW took 35.5s. Estimated remaining: 2h 25m 47s. Rate: 7.5 symbols/min [2025-09-25T19:49:12.606624] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:12.684600] [DEBUG] [LOCAL ] LSPD: Loaded 43263 existing records from primary storage. [2025-09-25T19:49:12.688023] [INFO ] [MAIN ] LSPD: Loaded 43263 existing records. [2025-09-25T19:49:12.694004] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-25T19:49:12.717231] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:49:12.929241] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:12.930885] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-25T19:49:12.930962] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-25T19:49:12.931374] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-25T19:49:12.931452] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-25T19:49:13.296674] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:13.483777] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T19:49:13.495525] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-25T19:49:14.179902] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T19:49:14.288762] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-25T19:49:15.045276] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T19:49:15.053350] [INFO ] [REMOTE ] LPL: Full fetch complete (34722 records). [2025-09-25T19:49:15.053441] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-25T19:49:15.095708] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-25T19:49:15.466767] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-25T19:49:15.467781] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-25T19:49:15.468831] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-25T19:49:15.468895] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-25T19:49:15.470199] [DEBUG] [LOCAL ] LPL: Trimmed 34722 records to 26050 (keeping 200 days of data) [2025-09-25T19:49:15.509215] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T19:49:15.562470] [INFO ] [REMOTE ] LPX: Full fetch complete (58569 records). [2025-09-25T19:49:15.562627] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-25T19:49:15.859962] [DEBUG] [LOCAL ] LPL: Primary data saved (26050 records). [2025-09-25T19:49:15.875795] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-25T19:49:15.877738] [INFO ] [MAIN ] Update Progress: 1275/2372 symbols completed. LPL took 32.5s. Estimated remaining: 2h 25m 35s. Rate: 7.5 symbols/min [2025-09-25T19:49:15.889955] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-25T19:49:16.319008] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:16.323302] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-25T19:49:16.323475] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-25T19:49:16.325069] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-25T19:49:16.325151] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-25T19:49:16.327271] [DEBUG] [LOCAL ] LPX: Trimmed 58569 records to 40015 (keeping 200 days of data) [2025-09-25T19:49:16.475485] [DEBUG] [LOCAL ] LTC: Loaded 29980 existing records from primary storage. [2025-09-25T19:49:16.489742] [INFO ] [MAIN ] LTC: Loaded 29980 existing records. [2025-09-25T19:49:16.743128] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T19:49:16.818293] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-25T19:49:16.920945] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:16.921295] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-25T19:49:16.921364] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-25T19:49:16.923036] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-25T19:49:16.923113] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-25T19:49:16.978566] [DEBUG] [LOCAL ] LPX: Primary data saved (40015 records). [2025-09-25T19:49:16.978738] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-25T19:49:16.978880] [INFO ] [MAIN ] Update Progress: 1276/2372 symbols completed. LPX took 31.9s. Estimated remaining: 2h 25m 22s. Rate: 7.5 symbols/min [2025-09-25T19:49:17.271995] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:17.367237] [DEBUG] [LOCAL ] LTH: Loaded 51869 existing records from primary storage. [2025-09-25T19:49:17.367450] [INFO ] [MAIN ] LTH: Loaded 51869 existing records. [2025-09-25T19:49:17.694167] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T19:49:17.768596] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-25T19:49:17.838871] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:17.834446] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T19:49:17.841716] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:17.841896] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-25T19:49:17.841941] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-25T19:49:17.842438] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-25T19:49:17.842501] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-25T19:49:18.293920] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-25T19:49:18.328842] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:19.088705] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-25T19:49:19.339430] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T19:49:19.412768] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T19:49:19.888717] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-25T19:49:20.688805] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T19:49:20.688930] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-25T19:49:20.858173] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T19:49:21.488754] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-25T19:49:22.232915] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:49:22.288680] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-25T19:49:22.856770] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T19:49:23.088734] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-25T19:49:23.888775] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-25T19:49:23.916418] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T19:49:24.688748] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-25T19:49:24.762567] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:49:25.488698] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-25T19:49:25.593751] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T19:49:26.293897] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-25T19:49:26.310522] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:49:26.713190] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T19:49:27.088725] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-25T19:49:27.888739] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-25T19:49:28.042839] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T19:49:28.632267] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T19:49:28.688694] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-25T19:49:29.488735] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-25T19:49:29.625526] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T19:49:30.175639] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T19:49:30.288725] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-25T19:49:31.005040] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:49:31.088732] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-25T19:49:31.689381] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T19:49:31.888764] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-25T19:49:32.221398] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T19:49:32.688715] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-25T19:49:33.316228] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T19:49:33.488746] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-25T19:49:34.288744] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-25T19:49:34.350678] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:49:34.968722] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T19:49:34.977430] [INFO ] [REMOTE ] LSPD: Full fetch complete (61455 records). [2025-09-25T19:49:34.977718] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-25T19:49:35.095741] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-25T19:49:35.422792] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-25T19:49:35.422917] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-25T19:49:35.424329] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-25T19:49:35.424399] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-25T19:49:35.426354] [DEBUG] [LOCAL ] LSPD: Trimmed 61455 records to 43518 (keeping 200 days of data) [2025-09-25T19:49:35.753470] [DEBUG] [LOCAL ] LSPD: Primary data saved (43518 records). [2025-09-25T19:49:35.753684] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-25T19:49:35.755323] [INFO ] [MAIN ] Update Progress: 1277/2372 symbols completed. LSPD took 23.3s. Estimated remaining: 2h 25m 23s. Rate: 7.5 symbols/min [2025-09-25T19:49:35.758620] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T19:49:35.888737] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-25T19:49:36.617051] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T19:49:36.688668] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-25T19:49:37.190263] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T19:49:37.488890] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-25T19:49:38.236003] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T19:49:38.249210] [INFO ] [REMOTE ] LRN: Full fetch complete (58417 records). [2025-09-25T19:49:38.249455] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-25T19:49:38.296758] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-25T19:49:38.700843] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-25T19:49:38.700980] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-25T19:49:38.702276] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-25T19:49:38.702374] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-25T19:49:38.703904] [DEBUG] [LOCAL ] LRN: Trimmed 58417 records to 40224 (keeping 200 days of data) [2025-09-25T19:49:39.043881] [DEBUG] [LOCAL ] LRN: Primary data saved (40224 records). [2025-09-25T19:49:39.044338] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-25T19:49:39.044675] [INFO ] [MAIN ] Update Progress: 1278/2372 symbols completed. LRN took 30.3s. Estimated remaining: 2h 25m 11s. Rate: 7.5 symbols/min [2025-09-25T19:49:39.059574] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T19:49:39.088765] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-25T19:49:39.638970] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T19:49:39.888770] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-25T19:49:40.914538] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T19:49:40.933749] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-25T19:49:41.092539] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T19:49:41.488787] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-25T19:49:42.655666] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T19:49:42.667944] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-25T19:49:43.004366] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:49:43.088743] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-25T19:49:44.431351] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T19:49:44.443622] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-25T19:49:44.499513] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T19:49:44.688844] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-25T19:49:46.006823] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T19:49:46.013804] [INFO ] [REMOTE ] LTC: Full fetch complete (43120 records). [2025-09-25T19:49:46.013928] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-25T19:49:46.218858] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T19:49:46.240878] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-25T19:49:46.547140] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-25T19:49:46.547285] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-25T19:49:46.548371] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-25T19:49:46.548454] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-25T19:49:46.549806] [DEBUG] [LOCAL ] LTC: Trimmed 43120 records to 30236 (keeping 200 days of data) [2025-09-25T19:49:46.763000] [DEBUG] [LOCAL ] LTC: Primary data saved (30236 records). [2025-09-25T19:49:46.763176] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-25T19:49:46.763457] [INFO ] [MAIN ] Update Progress: 1279/2372 symbols completed. LTC took 30.9s. Estimated remaining: 2h 25m 3s. Rate: 7.5 symbols/min [2025-09-25T19:49:48.193239] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-25T19:49:48.203060] [INFO ] [REMOTE ] LTH: Full fetch complete (73942 records). [2025-09-25T19:49:48.203228] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-25T19:49:48.624158] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-25T19:49:48.624360] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-25T19:49:48.625727] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-25T19:49:48.625800] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-25T19:49:48.627780] [DEBUG] [LOCAL ] LTH: Trimmed 73942 records to 52212 (keeping 200 days of data) [2025-09-25T19:49:48.982243] [DEBUG] [LOCAL ] LTH: Primary data saved (52212 records). [2025-09-25T19:49:48.982418] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-25T19:49:48.982623] [INFO ] [MAIN ] Update Progress: 1280/2372 symbols completed. LTH took 32.0s. Estimated remaining: 2h 24m 50s. Rate: 7.5 symbols/min [2025-09-25T19:49:49.675639] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:49.740164] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:49.740407] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-25T19:49:49.740465] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-25T19:49:49.740698] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-25T19:49:49.740845] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-25T19:49:49.740917] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-25T19:49:49.740986] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-25T19:49:49.749042] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:49.790781] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:49:49.907480] [DEBUG] [LOCAL ] LU: Loaded 48960 existing records from primary storage. [2025-09-25T19:49:49.907717] [INFO ] [MAIN ] LU: Loaded 48960 existing records. [2025-09-25T19:49:50.051338] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-25T19:49:50.051508] [INFO ] [MAIN ] LUMN: Loaded 53634 existing records. [2025-09-25T19:49:50.166089] [DEBUG] [LOCAL ] LTM: Loaded 36299 existing records from primary storage. [2025-09-25T19:49:50.166254] [INFO ] [MAIN ] LTM: Loaded 36299 existing records. [2025-09-25T19:49:50.655055] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:50.660887] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-25T19:49:50.660960] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-25T19:49:50.661621] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-25T19:49:50.701849] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-25T19:49:50.811216] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:50.816818] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-25T19:49:50.816871] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-25T19:49:50.817260] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-25T19:49:50.817319] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-25T19:49:51.041582] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:49:51.041886] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-25T19:49:51.041937] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-25T19:49:51.042220] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-25T19:49:51.042280] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-25T19:49:51.241134] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:51.241523] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-25T19:49:51.949403] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:51.980040] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-25T19:49:52.071042] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:52.071393] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-25T19:49:52.115459] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:49:52.115797] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-25T19:49:52.354370] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T19:49:52.359767] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-25T19:49:53.192149] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:49:53.198150] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-25T19:49:53.443048] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T19:49:53.451462] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-25T19:49:53.706225] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T19:49:53.724543] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-25T19:49:54.004554] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T19:49:54.019980] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-25T19:49:54.139917] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T19:49:54.145391] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-25T19:49:54.402884] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T19:49:54.410587] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-25T19:49:55.012910] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T19:49:55.088697] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-25T19:49:55.354231] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T19:49:55.666738] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T19:49:55.668251] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T19:49:55.888749] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-25T19:49:56.306335] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T19:49:56.688761] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-25T19:49:57.317892] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T19:49:57.488775] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-25T19:49:58.288756] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-25T19:49:58.393421] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T19:49:58.755822] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T19:49:59.088794] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-25T19:49:59.226877] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T19:49:59.888762] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-25T19:50:00.688741] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-25T19:50:00.867528] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T19:50:01.162147] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T19:50:01.488755] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-25T19:50:02.288759] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-25T19:50:02.426101] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T19:50:02.710917] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T19:50:03.088753] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-25T19:50:03.888752] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-25T19:50:04.097360] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T19:50:04.495259] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T19:50:04.688699] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-25T19:50:05.133864] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T19:50:05.488748] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-25T19:50:05.995081] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T19:50:06.288743] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-25T19:50:07.088686] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-25T19:50:07.410694] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T19:50:07.633011] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T19:50:07.888729] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-25T19:50:08.438949] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:50:08.688769] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-25T19:50:09.488696] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-25T19:50:09.878088] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T19:50:10.173973] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:50:10.288740] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-25T19:50:10.818481] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T19:50:10.825357] [INFO ] [REMOTE ] LUCK: Full fetch complete (40412 records). [2025-09-25T19:50:10.825469] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-25T19:50:11.053526] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-25T19:50:11.054229] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:50:11.054343] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:50:11.054444] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-25T19:50:11.054589] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-25T19:50:11.054699] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-25T19:50:11.054783] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-25T19:50:11.054886] [INFO ] [MAIN ] Update Progress: 1281/2372 symbols completed. LUCK took 22.1s. Estimated remaining: 2h 24m 54s. Rate: 7.5 symbols/min [2025-09-25T19:50:11.092840] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-25T19:50:11.256108] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:11.334553] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-25T19:50:11.334752] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-09-25T19:50:11.524158] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:11.524564] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-25T19:50:11.524614] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-25T19:50:11.525407] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-25T19:50:11.525470] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-25T19:50:11.892753] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-25T19:50:11.919013] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T19:50:12.014135] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:12.688729] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-25T19:50:13.049591] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T19:50:13.488716] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-25T19:50:13.623916] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T19:50:14.288788] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-25T19:50:14.667743] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T19:50:14.678060] [INFO ] [REMOTE ] LTM: Full fetch complete (47104 records). [2025-09-25T19:50:14.678255] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-25T19:50:15.094766] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-25T19:50:15.151164] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-25T19:50:15.151275] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-25T19:50:15.152264] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-25T19:50:15.152341] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-25T19:50:15.154074] [DEBUG] [LOCAL ] LTM: Trimmed 47104 records to 36687 (keeping 200 days of data) [2025-09-25T19:50:15.381028] [DEBUG] [LOCAL ] LTM: Primary data saved (36687 records). [2025-09-25T19:50:15.381206] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-25T19:50:15.381303] [INFO ] [MAIN ] Update Progress: 1282/2372 symbols completed. LTM took 26.4s. Estimated remaining: 2h 24m 43s. Rate: 7.5 symbols/min [2025-09-25T19:50:15.518120] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T19:50:15.602394] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:15.602638] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-25T19:50:15.602717] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-25T19:50:15.602928] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-25T19:50:15.602971] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-25T19:50:15.603013] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-25T19:50:15.603043] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-25T19:50:15.918743] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-25T19:50:15.926549] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T19:50:16.098871] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:16.636288] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T19:50:16.688733] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-25T19:50:16.889822] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:50:16.890282] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-25T19:50:17.492752] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-25T19:50:17.731313] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:50:17.731819] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-25T19:50:17.783800] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T19:50:18.289001] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-25T19:50:18.499480] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:50:18.499857] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-25T19:50:19.088850] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-25T19:50:19.888796] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-25T19:50:20.688790] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-25T19:50:20.896583] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:50:20.898387] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-25T19:50:21.488801] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-25T19:50:21.530310] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-25T19:50:21.573992] [INFO ] [REMOTE ] LUMN: Full fetch complete (77634 records). [2025-09-25T19:50:21.574339] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-25T19:50:21.602584] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:50:22.075409] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-25T19:50:22.075541] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-25T19:50:22.076864] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-25T19:50:22.076992] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-25T19:50:22.079058] [DEBUG] [LOCAL ] LUMN: Trimmed 77634 records to 54024 (keeping 200 days of data) [2025-09-25T19:50:22.300768] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-25T19:50:22.435253] [DEBUG] [LOCAL ] LUMN: Primary data saved (54024 records). [2025-09-25T19:50:22.435453] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-25T19:50:22.435763] [INFO ] [MAIN ] Update Progress: 1283/2372 symbols completed. LUMN took 33.4s. Estimated remaining: 2h 24m 34s. Rate: 7.5 symbols/min [2025-09-25T19:50:22.563901] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:50:22.564356] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-25T19:50:22.648563] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:22.716345] [DEBUG] [LOCAL ] LVS: Loaded 53564 existing records from primary storage. [2025-09-25T19:50:22.716531] [INFO ] [MAIN ] LVS: Loaded 53564 existing records. [2025-09-25T19:50:22.928142] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:22.928405] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-25T19:50:22.928451] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-25T19:50:22.929330] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-25T19:50:22.929406] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-25T19:50:23.093874] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-25T19:50:23.397553] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:23.408332] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T19:50:23.888728] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-25T19:50:24.688742] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-25T19:50:24.949900] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T19:50:25.095822] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T19:50:25.108216] [INFO ] [REMOTE ] LU: Full fetch complete (70379 records). [2025-09-25T19:50:25.108406] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-25T19:50:25.488750] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-25T19:50:25.537934] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-25T19:50:25.538100] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-25T19:50:25.539218] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-25T19:50:25.539290] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-25T19:50:25.541076] [DEBUG] [LOCAL ] LU: Trimmed 70379 records to 49314 (keeping 200 days of data) [2025-09-25T19:50:25.853625] [DEBUG] [LOCAL ] LU: Primary data saved (49314 records). [2025-09-25T19:50:25.853882] [INFO ] [MAIN ] LU: Full history saved. [2025-09-25T19:50:25.855522] [INFO ] [MAIN ] Update Progress: 1284/2372 symbols completed. LU took 36.8s. Estimated remaining: 2h 24m 22s. Rate: 7.5 symbols/min [2025-09-25T19:50:26.051146] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:26.094219] [DEBUG] [LOCAL ] LVWR: Loaded 17553 existing records from primary storage. [2025-09-25T19:50:26.094371] [INFO ] [MAIN ] LVWR: Loaded 17553 existing records. [2025-09-25T19:50:26.282825] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:26.283206] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-25T19:50:26.283269] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-25T19:50:26.283542] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-25T19:50:26.283602] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-25T19:50:26.289000] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-25T19:50:26.647700] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T19:50:26.772507] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:27.088775] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-25T19:50:27.278457] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T19:50:27.495122] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T19:50:27.699090] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-25T19:50:27.888738] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-25T19:50:28.506138] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T19:50:28.688784] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-25T19:50:29.357471] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T19:50:29.488690] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-25T19:50:30.288721] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-25T19:50:30.502354] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T19:50:30.931341] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T19:50:31.088760] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-25T19:50:31.888735] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-25T19:50:32.688746] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-25T19:50:32.821752] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T19:50:33.276823] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:50:33.290398] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T19:50:33.294302] [INFO ] [REMOTE ] LUXE: Full fetch complete (13787 records). [2025-09-25T19:50:33.294569] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-25T19:50:33.494765] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-25T19:50:33.609427] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 102 unique days, need 200 days [2025-09-25T19:50:33.610164] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:50:33.610276] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:50:33.610398] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-25T19:50:33.610543] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-25T19:50:33.610631] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-25T19:50:33.610745] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-25T19:50:33.610981] [INFO ] [MAIN ] Update Progress: 1285/2372 symbols completed. LUXE took 18.2s. Estimated remaining: 2h 24m 14s. Rate: 7.5 symbols/min [2025-09-25T19:50:33.861697] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:33.993985] [DEBUG] [LOCAL ] LW: Loaded 51165 existing records from primary storage. [2025-09-25T19:50:33.994570] [INFO ] [MAIN ] LW: Loaded 51165 existing records. [2025-09-25T19:50:34.261469] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:34.264306] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-25T19:50:34.264388] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-25T19:50:34.264894] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-25T19:50:34.264988] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-25T19:50:34.298742] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-25T19:50:34.732811] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:35.088739] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-25T19:50:35.555455] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T19:50:35.691327] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T19:50:35.888709] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-25T19:50:35.999786] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T19:50:36.688728] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-25T19:50:37.488721] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-25T19:50:37.678342] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T19:50:38.288699] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-25T19:50:38.361626] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T19:50:38.507396] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:50:39.088757] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-25T19:50:39.888714] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-25T19:50:40.085660] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T19:50:40.688706] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-25T19:50:40.990442] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:50:41.488706] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-25T19:50:41.603621] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T19:50:42.288701] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-25T19:50:42.323127] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T19:50:43.088746] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-25T19:50:43.354874] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T19:50:43.517346] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T19:50:43.888742] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-25T19:50:44.688747] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-25T19:50:45.443304] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-25T19:50:45.488684] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-25T19:50:45.614293] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T19:50:46.040206] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T19:50:46.288746] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-25T19:50:47.088752] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-25T19:50:47.147536] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T19:50:47.718988] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T19:50:47.888775] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-25T19:50:48.511292] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T19:50:48.688752] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-25T19:50:49.331675] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T19:50:49.488795] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-25T19:50:50.288753] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-25T19:50:50.373381] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T19:50:50.492179] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T19:50:51.088765] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-25T19:50:51.888759] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-25T19:50:52.363115] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T19:50:52.688713] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-25T19:50:52.976611] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T19:50:53.488743] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-25T19:50:53.848887] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:50:53.868453] [INFO ] [REMOTE ] LVS: Full fetch complete (77514 records). [2025-09-25T19:50:53.868720] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-25T19:50:54.289493] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-25T19:50:54.406999] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-25T19:50:54.407149] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-25T19:50:54.408495] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-25T19:50:54.408689] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-25T19:50:54.412596] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T19:50:54.429690] [DEBUG] [LOCAL ] LVS: Trimmed 77514 records to 53954 (keeping 200 days of data) [2025-09-25T19:50:54.792250] [DEBUG] [LOCAL ] LVS: Primary data saved (53954 records). [2025-09-25T19:50:54.792429] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-25T19:50:54.792634] [INFO ] [MAIN ] Update Progress: 1286/2372 symbols completed. LVS took 32.4s. Estimated remaining: 2h 24m 17s. Rate: 7.5 symbols/min [2025-09-25T19:50:54.969160] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:54.999517] [DEBUG] [LOCAL ] LXFR: Loaded 17085 existing records from primary storage. [2025-09-25T19:50:54.999752] [INFO ] [MAIN ] LXFR: Loaded 17085 existing records. [2025-09-25T19:50:55.095732] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-25T19:50:55.247326] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:55.250835] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T19:50:55.247623] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-25T19:50:55.261771] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-25T19:50:55.262309] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-25T19:50:55.262404] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-25T19:50:55.604165] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T19:50:55.619155] [INFO ] [REMOTE ] LVWR: Full fetch complete (19874 records). [2025-09-25T19:50:55.619309] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-25T19:50:55.812092] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:55.899684] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-25T19:50:56.110075] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-25T19:50:56.110189] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-25T19:50:56.110665] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-25T19:50:56.110728] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-25T19:50:56.111694] [DEBUG] [LOCAL ] LVWR: Trimmed 19874 records to 17624 (keeping 200 days of data) [2025-09-25T19:50:56.227361] [DEBUG] [LOCAL ] LVWR: Primary data saved (17624 records). [2025-09-25T19:50:56.227541] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-25T19:50:56.227715] [INFO ] [MAIN ] Update Progress: 1287/2372 symbols completed. LVWR took 30.4s. Estimated remaining: 2h 24m 4s. Rate: 7.5 symbols/min [2025-09-25T19:50:56.397303] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:56.470815] [DEBUG] [LOCAL ] LXP: Loaded 50657 existing records from primary storage. [2025-09-25T19:50:56.470975] [INFO ] [MAIN ] LXP: Loaded 50657 existing records. [2025-09-25T19:50:56.649561] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:56.652899] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-25T19:50:56.652950] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-25T19:50:56.653290] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-25T19:50:56.653350] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-25T19:50:56.690861] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-25T19:50:57.065831] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:57.073194] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T19:50:57.176123] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T19:50:57.186524] [INFO ] [REMOTE ] LUV: Full fetch complete (77727 records). [2025-09-25T19:50:57.186713] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-25T19:50:57.493780] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-25T19:50:57.615378] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-25T19:50:57.615493] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-25T19:50:57.617040] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-25T19:50:57.617109] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-25T19:50:57.618856] [DEBUG] [LOCAL ] LUV: Trimmed 77727 records to 54079 (keeping 200 days of data) [2025-09-25T19:50:57.974399] [DEBUG] [LOCAL ] LUV: Primary data saved (54079 records). [2025-09-25T19:50:57.974566] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-25T19:50:57.974745] [INFO ] [MAIN ] Update Progress: 1288/2372 symbols completed. LUV took 46.9s. Estimated remaining: 2h 23m 51s. Rate: 7.5 symbols/min [2025-09-25T19:50:58.166574] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:50:58.210663] [DEBUG] [LOCAL ] LXU: Loaded 32004 existing records from primary storage. [2025-09-25T19:50:58.210832] [INFO ] [MAIN ] LXU: Loaded 32004 existing records. [2025-09-25T19:50:58.293998] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-25T19:50:58.413444] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:50:58.413859] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-25T19:50:58.413925] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-25T19:50:58.414256] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-25T19:50:58.414315] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-25T19:50:58.596197] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T19:50:58.723400] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T19:50:58.903781] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:50:59.088732] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-25T19:50:59.888716] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-25T19:50:59.980188] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T19:51:00.046447] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T19:51:00.688815] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-25T19:51:01.334125] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:51:01.488730] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-25T19:51:01.699566] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T19:51:02.288803] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-25T19:51:03.099622] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-25T19:51:03.133544] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:51:03.666480] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T19:51:03.888777] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-25T19:51:04.694981] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-25T19:51:04.701835] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T19:51:04.721960] [INFO ] [REMOTE ] LW: Full fetch complete (74586 records). [2025-09-25T19:51:04.722270] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-25T19:51:05.203901] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-25T19:51:05.204071] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-25T19:51:05.205568] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-25T19:51:05.205666] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-25T19:51:05.207704] [DEBUG] [LOCAL ] LW: Trimmed 74586 records to 51531 (keeping 200 days of data) [2025-09-25T19:51:05.491253] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-25T19:51:05.546267] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T19:51:05.647918] [DEBUG] [LOCAL ] LW: Primary data saved (51531 records). [2025-09-25T19:51:05.648178] [INFO ] [MAIN ] LW: Full history saved. [2025-09-25T19:51:05.649814] [INFO ] [MAIN ] Update Progress: 1289/2372 symbols completed. LW took 32.0s. Estimated remaining: 2h 23m 43s. Rate: 7.5 symbols/min [2025-09-25T19:51:05.843334] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:05.843606] [DEBUG] [LOCAL ] LYB: No existing data file found in primary storage. [2025-09-25T19:51:05.843687] [WARN ] [MAIN ] LYB: No existing data found, performing full refresh instead. [2025-09-25T19:51:05.843861] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-25T19:51:05.843927] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-25T19:51:05.843996] [DEBUG] [LOCAL ] LYB: No primary data file found to delete. [2025-09-25T19:51:05.844088] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-25T19:51:06.201795] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T19:51:06.298759] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-25T19:51:06.410815] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:06.519303] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T19:51:07.088757] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-25T19:51:07.395682] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T19:51:07.888717] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-25T19:51:08.156534] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:51:08.688759] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-25T19:51:09.425856] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T19:51:09.488764] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-25T19:51:10.288753] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-25T19:51:10.542282] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T19:51:10.672439] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-25T19:51:11.088740] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-25T19:51:11.747265] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T19:51:11.888710] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-25T19:51:12.688688] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-25T19:51:13.083573] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T19:51:13.147097] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T19:51:13.306395] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T19:51:13.488759] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-25T19:51:14.288754] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-25T19:51:14.905271] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T19:51:15.088717] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-25T19:51:15.362713] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T19:51:15.888764] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-25T19:51:16.648056] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T19:51:16.688708] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-25T19:51:16.891521] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-25T19:51:17.488739] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-25T19:51:17.969972] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T19:51:18.288739] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-25T19:51:19.088749] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-25T19:51:19.247924] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T19:51:19.265102] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T19:51:19.269820] [INFO ] [REMOTE ] LXFR: Full fetch complete (25146 records). [2025-09-25T19:51:19.269905] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-25T19:51:19.676492] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-25T19:51:19.676602] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-25T19:51:19.677500] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-25T19:51:19.677591] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-25T19:51:19.678400] [DEBUG] [LOCAL ] LXFR: Trimmed 25146 records to 17187 (keeping 200 days of data) [2025-09-25T19:51:19.790030] [DEBUG] [LOCAL ] LXFR: Primary data saved (17187 records). [2025-09-25T19:51:19.790201] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-25T19:51:19.790340] [INFO ] [MAIN ] Update Progress: 1290/2372 symbols completed. LXFR took 25.0s. Estimated remaining: 2h 23m 40s. Rate: 7.5 symbols/min [2025-09-25T19:51:19.894740] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-25T19:51:19.978211] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:20.035164] [DEBUG] [LOCAL ] LYG: Loaded 52864 existing records from primary storage. [2025-09-25T19:51:20.035361] [INFO ] [MAIN ] LYG: Loaded 52864 existing records. [2025-09-25T19:51:20.236715] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:51:20.237251] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-25T19:51:20.237301] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-25T19:51:20.237618] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-25T19:51:20.237708] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-25T19:51:20.344694] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T19:51:20.364839] [INFO ] [REMOTE ] LXU: Full fetch complete (44955 records). [2025-09-25T19:51:20.365000] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-25T19:51:20.688779] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-25T19:51:20.887784] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:21.051663] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-25T19:51:21.051765] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-25T19:51:21.052587] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-25T19:51:21.052628] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-25T19:51:21.054448] [DEBUG] [LOCAL ] LXU: Trimmed 44955 records to 32191 (keeping 200 days of data) [2025-09-25T19:51:21.243128] [DEBUG] [LOCAL ] LXU: Primary data saved (32191 records). [2025-09-25T19:51:21.243291] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-25T19:51:21.243388] [INFO ] [MAIN ] Update Progress: 1291/2372 symbols completed. LXU took 23.3s. Estimated remaining: 2h 23m 26s. Rate: 7.5 symbols/min [2025-09-25T19:51:21.416156] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:21.474858] [DEBUG] [LOCAL ] LYV: Loaded 51163 existing records from primary storage. [2025-09-25T19:51:21.475085] [INFO ] [MAIN ] LYV: Loaded 51163 existing records. [2025-09-25T19:51:21.490688] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-25T19:51:21.690359] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:51:21.690684] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-25T19:51:21.690744] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-25T19:51:21.691021] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-25T19:51:21.691081] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-25T19:51:21.734901] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T19:51:22.118799] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:22.288701] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-25T19:51:22.416966] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T19:51:22.914226] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T19:51:23.088726] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-25T19:51:23.804896] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T19:51:23.888760] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-25T19:51:24.503488] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T19:51:24.688747] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-25T19:51:25.488761] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-25T19:51:25.770228] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T19:51:26.042311] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T19:51:26.288744] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-25T19:51:27.088748] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-25T19:51:27.243987] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T19:51:27.888745] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-25T19:51:28.260103] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T19:51:28.688700] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-25T19:51:28.732671] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:51:29.488754] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-25T19:51:29.652282] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T19:51:30.288758] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-25T19:51:30.748963] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T19:51:31.090713] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-25T19:51:31.093932] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T19:51:31.676597] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T19:51:31.888797] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-25T19:51:32.688803] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-25T19:51:32.812295] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:51:33.488749] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-25T19:51:33.776625] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T19:51:33.999107] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T19:51:34.288941] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-25T19:51:35.088793] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-25T19:51:35.239191] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T19:51:35.888760] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-25T19:51:36.104676] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T19:51:36.689806] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-25T19:51:36.920795] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:51:37.488782] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-25T19:51:37.644830] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T19:51:37.660852] [INFO ] [REMOTE ] LYB: Full fetch complete (77456 records). [2025-09-25T19:51:37.661147] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-25T19:51:38.056680] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T19:51:38.089884] [INFO ] [REMOTE ] LXP: Full fetch complete (72438 records). [2025-09-25T19:51:38.090075] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-25T19:51:38.285497] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-25T19:51:38.294118] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-25T19:51:38.293952] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-25T19:51:38.296060] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-25T19:51:38.296225] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-25T19:51:38.300574] [DEBUG] [LOCAL ] LYB: Trimmed 77456 records to 53989 (keeping 200 days of data) [2025-09-25T19:51:38.952209] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-25T19:51:38.952360] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-25T19:51:38.954005] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-25T19:51:38.954077] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-25T19:51:38.960130] [DEBUG] [LOCAL ] LXP: Trimmed 72438 records to 51002 (keeping 200 days of data) [2025-09-25T19:51:39.203081] [DEBUG] [LOCAL ] LYB: Primary data saved (53989 records). [2025-09-25T19:51:39.203285] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-25T19:51:39.203522] [INFO ] [MAIN ] Update Progress: 1292/2372 symbols completed. LYB took 33.6s. Estimated remaining: 2h 23m 27s. Rate: 7.5 symbols/min [2025-09-25T19:51:39.432161] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T19:51:39.469584] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-25T19:51:39.686894] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:39.690569] [DEBUG] [LOCAL ] LXP: Primary data saved (51002 records). [2025-09-25T19:51:39.690690] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-25T19:51:39.693749] [INFO ] [MAIN ] Update Progress: 1293/2372 symbols completed. LXP took 43.5s. Estimated remaining: 2h 23m 13s. Rate: 7.5 symbols/min [2025-09-25T19:51:39.779908] [DEBUG] [LOCAL ] LZB: Loaded 35569 existing records from primary storage. [2025-09-25T19:51:39.780129] [INFO ] [MAIN ] LZB: Loaded 35569 existing records. [2025-09-25T19:51:40.062547] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:40.171324] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T19:51:40.191998] [DEBUG] [LOCAL ] LZM: Loaded 13587 existing records from primary storage. [2025-09-25T19:51:40.192093] [INFO ] [MAIN ] LZM: Loaded 13587 existing records. [2025-09-25T19:51:40.215967] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-25T19:51:40.223961] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:51:40.224139] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-25T19:51:40.224209] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-25T19:51:40.224587] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-25T19:51:40.224710] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-25T19:51:40.585677] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:51:40.585980] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-25T19:51:40.586032] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-25T19:51:40.586582] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-25T19:51:40.591923] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-25T19:51:41.216436] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:41.232353] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-25T19:51:41.308986] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T19:51:41.317711] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:41.488762] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-25T19:51:42.081493] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T19:51:42.187625] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T19:51:42.288700] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-25T19:51:42.336983] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T19:51:43.088738] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-25T19:51:43.840801] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T19:51:43.888780] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-25T19:51:44.069901] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T19:51:44.688745] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-25T19:51:45.488809] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-25T19:51:45.506061] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T19:51:45.914265] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T19:51:46.270793] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T19:51:46.288673] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-25T19:51:47.088746] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-25T19:51:47.277124] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:51:47.888739] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-25T19:51:48.688739] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-25T19:51:48.960263] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T19:51:48.960818] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:51:49.488696] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-25T19:51:50.288706] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-25T19:51:50.315550] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T19:51:50.515402] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T19:51:51.088746] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-25T19:51:51.681164] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T19:51:51.888670] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-25T19:51:52.688702] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-25T19:51:52.959020] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T19:51:52.969624] [INFO ] [REMOTE ] LYV: Full fetch complete (73630 records). [2025-09-25T19:51:52.969817] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-25T19:51:53.348800] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T19:51:53.449895] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-25T19:51:53.450018] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-25T19:51:53.451290] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-25T19:51:53.451370] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-25T19:51:53.453263] [DEBUG] [LOCAL ] LYV: Trimmed 73630 records to 51528 (keeping 200 days of data) [2025-09-25T19:51:53.521958] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-25T19:51:53.815867] [DEBUG] [LOCAL ] LYV: Primary data saved (51528 records). [2025-09-25T19:51:53.816050] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-25T19:51:53.816182] [INFO ] [MAIN ] Update Progress: 1294/2372 symbols completed. LYV took 32.6s. Estimated remaining: 2h 23m 10s. Rate: 7.5 symbols/min [2025-09-25T19:51:54.003462] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:51:54.068103] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-25T19:51:54.068275] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-25T19:51:54.262116] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:51:54.262528] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-25T19:51:54.262586] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-25T19:51:54.263319] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-25T19:51:54.263391] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-25T19:51:54.299948] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-25T19:51:54.512498] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T19:51:54.721287] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:51:55.072339] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T19:51:55.088730] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-25T19:51:55.108393] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T19:51:55.888815] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-25T19:51:56.688786] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-25T19:51:57.112713] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T19:51:57.247219] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T19:51:57.496682] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-25T19:51:57.500226] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T19:51:58.288885] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-25T19:51:59.088701] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-25T19:51:59.121027] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T19:51:59.458144] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T19:51:59.483000] [INFO ] [REMOTE ] LYG: Full fetch complete (76049 records). [2025-09-25T19:51:59.483370] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-25T19:51:59.893815] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-25T19:51:59.961556] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-25T19:51:59.961700] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-25T19:51:59.963061] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-25T19:51:59.963226] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-25T19:51:59.965631] [DEBUG] [LOCAL ] LYG: Trimmed 76049 records to 53243 (keeping 200 days of data) [2025-09-25T19:52:00.324992] [DEBUG] [LOCAL ] LYG: Primary data saved (53243 records). [2025-09-25T19:52:00.325240] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-25T19:52:00.325557] [INFO ] [MAIN ] Update Progress: 1295/2372 symbols completed. LYG took 40.5s. Estimated remaining: 2h 23m 0s. Rate: 7.5 symbols/min [2025-09-25T19:52:00.417969] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T19:52:00.545364] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:00.625430] [DEBUG] [LOCAL ] MA: Loaded 52569 existing records from primary storage. [2025-09-25T19:52:00.625628] [INFO ] [MAIN ] MA: Loaded 52569 existing records. [2025-09-25T19:52:00.693817] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-25T19:52:00.824401] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:00.827233] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-25T19:52:00.827297] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-25T19:52:00.827736] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-25T19:52:00.827811] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-25T19:52:01.227452] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:01.467065] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T19:52:01.488737] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-25T19:52:01.798557] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T19:52:01.804314] [INFO ] [REMOTE ] LZM: Full fetch complete (17975 records). [2025-09-25T19:52:01.804536] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-25T19:52:02.265864] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-25T19:52:02.265964] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-25T19:52:02.266625] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-25T19:52:02.266731] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-25T19:52:02.267507] [DEBUG] [LOCAL ] LZM: Trimmed 17975 records to 13758 (keeping 200 days of data) [2025-09-25T19:52:02.305756] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-25T19:52:02.368360] [DEBUG] [LOCAL ] LZM: Primary data saved (13758 records). [2025-09-25T19:52:02.368521] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-25T19:52:02.368695] [INFO ] [MAIN ] Update Progress: 1296/2372 symbols completed. LZM took 22.7s. Estimated remaining: 2h 22m 48s. Rate: 7.5 symbols/min [2025-09-25T19:52:02.567602] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:02.640932] [DEBUG] [LOCAL ] MAA: Loaded 42807 existing records from primary storage. [2025-09-25T19:52:02.641126] [INFO ] [MAIN ] MAA: Loaded 42807 existing records. [2025-09-25T19:52:02.838602] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:02.839882] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-25T19:52:02.839946] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-25T19:52:02.840199] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-25T19:52:02.840259] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-25T19:52:02.991953] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T19:52:03.091915] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-25T19:52:03.303949] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:03.888723] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-25T19:52:04.296907] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T19:52:04.688714] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-25T19:52:05.122867] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T19:52:05.381368] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:52:05.488705] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-25T19:52:06.269179] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T19:52:06.288688] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-25T19:52:07.088774] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-25T19:52:07.351026] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T19:52:07.815702] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T19:52:07.888762] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-25T19:52:08.688751] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-25T19:52:08.799663] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T19:52:09.151390] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T19:52:09.488741] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-25T19:52:10.294787] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-25T19:52:10.315113] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T19:52:10.325930] [INFO ] [REMOTE ] LZB: Full fetch complete (50260 records). [2025-09-25T19:52:10.326083] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-25T19:52:10.739803] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-25T19:52:10.739930] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-25T19:52:10.740982] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-25T19:52:10.741051] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-25T19:52:10.743358] [DEBUG] [LOCAL ] LZB: Trimmed 50260 records to 35833 (keeping 200 days of data) [2025-09-25T19:52:11.023177] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T19:52:11.034224] [DEBUG] [LOCAL ] LZB: Primary data saved (35833 records). [2025-09-25T19:52:11.034342] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-25T19:52:11.034499] [INFO ] [MAIN ] Update Progress: 1297/2372 symbols completed. LZB took 31.8s. Estimated remaining: 2h 22m 40s. Rate: 7.5 symbols/min [2025-09-25T19:52:11.090781] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-25T19:52:11.240709] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:11.311048] [DEBUG] [LOCAL ] MAC: Loaded 49705 existing records from primary storage. [2025-09-25T19:52:11.311244] [INFO ] [MAIN ] MAC: Loaded 49705 existing records. [2025-09-25T19:52:11.509305] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:11.509613] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-25T19:52:11.509851] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-25T19:52:11.510170] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-25T19:52:11.510248] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-25T19:52:11.891241] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-25T19:52:11.913902] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:11.965603] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T19:52:12.688721] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-25T19:52:13.089807] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T19:52:13.488693] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-25T19:52:13.979519] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-25T19:52:14.288709] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-25T19:52:14.371596] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T19:52:15.088749] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-25T19:52:15.158867] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T19:52:15.888777] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-25T19:52:16.321564] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T19:52:16.688784] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-25T19:52:16.769360] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T19:52:17.488727] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-25T19:52:17.981137] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-25T19:52:18.289183] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T19:52:18.289337] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-25T19:52:18.701096] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T19:52:19.088765] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-25T19:52:19.888760] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-25T19:52:20.143069] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T19:52:20.694733] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-25T19:52:20.718295] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T19:52:21.488761] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-25T19:52:21.573687] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T19:52:22.288702] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-25T19:52:22.735491] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T19:52:23.088745] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-25T19:52:23.172477] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T19:52:23.888790] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-25T19:52:23.940219] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T19:52:24.688747] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-25T19:52:25.204535] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T19:52:25.488698] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-25T19:52:25.818622] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T19:52:25.912569] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T19:52:26.288717] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-25T19:52:27.088777] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-25T19:52:27.139024] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T19:52:27.743083] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:52:27.888769] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-25T19:52:28.688759] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-25T19:52:29.225271] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-25T19:52:29.465108] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T19:52:29.488719] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-25T19:52:30.032823] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T19:52:30.048476] [INFO ] [REMOTE ] MAA: Full fetch complete (60969 records). [2025-09-25T19:52:30.048676] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-25T19:52:30.295759] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-25T19:52:30.505919] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-25T19:52:30.506054] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-25T19:52:30.507589] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-25T19:52:30.507800] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-25T19:52:30.516011] [DEBUG] [LOCAL ] MAA: Trimmed 60969 records to 43062 (keeping 200 days of data) [2025-09-25T19:52:30.863797] [DEBUG] [LOCAL ] MAA: Primary data saved (43062 records). [2025-09-25T19:52:30.864095] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-25T19:52:30.864342] [INFO ] [MAIN ] Update Progress: 1298/2372 symbols completed. MAA took 28.5s. Estimated remaining: 2h 22m 42s. Rate: 7.5 symbols/min [2025-09-25T19:52:31.069172] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:31.088734] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-25T19:52:31.137876] [DEBUG] [LOCAL ] MAGN: Loaded 34933 existing records from primary storage. [2025-09-25T19:52:31.138087] [INFO ] [MAIN ] MAGN: Loaded 34933 existing records. [2025-09-25T19:52:31.349014] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:31.349943] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-25T19:52:31.350003] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-25T19:52:31.352359] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-25T19:52:31.352449] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-25T19:52:31.625957] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T19:52:31.789797] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T19:52:31.879738] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:31.888671] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-25T19:52:32.688738] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-25T19:52:32.786094] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T19:52:32.802166] [INFO ] [REMOTE ] M: Full fetch complete (77511 records). [2025-09-25T19:52:32.802535] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-25T19:52:33.268506] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-25T19:52:33.268615] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-25T19:52:33.270128] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-25T19:52:33.270198] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-25T19:52:33.274747] [DEBUG] [LOCAL ] M: Trimmed 77511 records to 53925 (keeping 200 days of data) [2025-09-25T19:52:33.420092] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T19:52:33.516495] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-25T19:52:33.691898] [DEBUG] [LOCAL ] M: Primary data saved (53925 records). [2025-09-25T19:52:33.692071] [INFO ] [MAIN ] M: Full history saved. [2025-09-25T19:52:33.692268] [INFO ] [MAIN ] Update Progress: 1299/2372 symbols completed. M took 39.9s. Estimated remaining: 2h 22m 30s. Rate: 7.5 symbols/min [2025-09-25T19:52:33.866314] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:33.921026] [DEBUG] [LOCAL ] MAIN: Loaded 41379 existing records from primary storage. [2025-09-25T19:52:33.921193] [INFO ] [MAIN ] MAIN: Loaded 41379 existing records. [2025-09-25T19:52:34.294773] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-25T19:52:34.305385] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:34.307770] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-25T19:52:34.307840] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-25T19:52:34.308224] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-25T19:52:34.308287] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-25T19:52:34.744227] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:34.716802] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T19:52:34.757353] [INFO ] [REMOTE ] MA: Full fetch complete (76273 records). [2025-09-25T19:52:34.757620] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-25T19:52:34.969485] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:52:35.094898] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-25T19:52:35.235924] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-25T19:52:35.236047] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-25T19:52:35.237574] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-25T19:52:35.237682] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-25T19:52:35.239868] [DEBUG] [LOCAL ] MA: Trimmed 76273 records to 52958 (keeping 200 days of data) [2025-09-25T19:52:35.599851] [DEBUG] [LOCAL ] MA: Primary data saved (52958 records). [2025-09-25T19:52:35.600051] [INFO ] [MAIN ] MA: Full history saved. [2025-09-25T19:52:35.600189] [INFO ] [MAIN ] Update Progress: 1300/2372 symbols completed. MA took 35.3s. Estimated remaining: 2h 22m 17s. Rate: 7.5 symbols/min [2025-09-25T19:52:35.792298] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:35.856874] [DEBUG] [LOCAL ] MAN: Loaded 43547 existing records from primary storage. [2025-09-25T19:52:35.857083] [INFO ] [MAIN ] MAN: Loaded 43547 existing records. [2025-09-25T19:52:35.904338] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-25T19:52:36.059834] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:36.060317] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-25T19:52:36.060422] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-25T19:52:36.060794] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-25T19:52:36.060863] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-25T19:52:36.547526] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:36.599693] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-25T19:52:36.680220] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T19:52:36.697331] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-25T19:52:37.488810] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-25T19:52:37.712020] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T19:52:38.288736] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-25T19:52:38.439689] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T19:52:38.451622] [INFO ] [REMOTE ] MAC: Full fetch complete (71455 records). [2025-09-25T19:52:38.453882] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-25T19:52:38.909397] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-25T19:52:38.909506] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-25T19:52:38.910981] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-25T19:52:38.911061] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-25T19:52:38.912920] [DEBUG] [LOCAL ] MAC: Trimmed 71455 records to 50079 (keeping 200 days of data) [2025-09-25T19:52:39.132264] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-25T19:52:39.166952] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T19:52:39.305606] [DEBUG] [LOCAL ] MAC: Primary data saved (50079 records). [2025-09-25T19:52:39.305789] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-25T19:52:39.307147] [INFO ] [MAIN ] Update Progress: 1301/2372 symbols completed. MAC took 28.3s. Estimated remaining: 2h 22m 5s. Rate: 7.5 symbols/min [2025-09-25T19:52:39.485023] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:39.532755] [DEBUG] [LOCAL ] MANU: Loaded 27119 existing records from primary storage. [2025-09-25T19:52:39.532908] [INFO ] [MAIN ] MANU: Loaded 27119 existing records. [2025-09-25T19:52:39.679043] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T19:52:39.759223] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:39.759929] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-25T19:52:39.759979] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-25T19:52:39.760212] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-25T19:52:39.760272] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-25T19:52:39.899935] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-25T19:52:40.152857] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:40.161853] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T19:52:40.688728] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-25T19:52:41.477414] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T19:52:41.488682] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-25T19:52:42.288720] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-25T19:52:42.403160] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T19:52:43.088716] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-25T19:52:43.263614] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:52:43.511435] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T19:52:43.888809] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-25T19:52:44.529389] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T19:52:44.688741] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-25T19:52:45.488821] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-25T19:52:45.677738] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T19:52:46.288770] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-25T19:52:46.328937] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:52:46.861323] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:52:47.089789] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-25T19:52:47.826830] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:52:47.888707] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-25T19:52:48.433912] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T19:52:48.688747] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-25T19:52:49.488784] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-25T19:52:49.542133] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T19:52:50.288745] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-25T19:52:50.355907] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T19:52:51.001951] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T19:52:51.088687] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-25T19:52:51.888761] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-25T19:52:52.014446] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T19:52:52.689864] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-25T19:52:52.694618] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T19:52:52.944730] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T19:52:53.488740] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-25T19:52:54.288724] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-25T19:52:54.446271] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:52:55.088750] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-25T19:52:55.141014] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T19:52:55.392307] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T19:52:55.888725] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-25T19:52:56.688690] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-25T19:52:56.941106] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T19:52:56.949773] [INFO ] [REMOTE ] MAIN: Full fetch complete (59706 records). [2025-09-25T19:52:56.949892] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-25T19:52:57.408931] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-25T19:52:57.409049] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-25T19:52:57.410283] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-25T19:52:57.410365] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-25T19:52:57.411883] [DEBUG] [LOCAL ] MAIN: Trimmed 59706 records to 41683 (keeping 200 days of data) [2025-09-25T19:52:57.511004] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-25T19:52:57.635698] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T19:52:57.731442] [DEBUG] [LOCAL ] MAIN: Primary data saved (41683 records). [2025-09-25T19:52:57.731614] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-25T19:52:57.731798] [INFO ] [MAIN ] Update Progress: 1302/2372 symbols completed. MAIN took 24.0s. Estimated remaining: 2h 22m 6s. Rate: 7.5 symbols/min [2025-09-25T19:52:57.909062] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:52:57.971047] [DEBUG] [LOCAL ] MAS: Loaded 52338 existing records from primary storage. [2025-09-25T19:52:57.971220] [INFO ] [MAIN ] MAS: Loaded 52338 existing records. [2025-09-25T19:52:58.195586] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T19:52:58.201580] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:52:58.207635] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-25T19:52:58.207761] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-25T19:52:58.208763] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-25T19:52:58.208846] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-25T19:52:58.293818] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-25T19:52:58.599553] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:52:58.795442] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T19:52:59.088708] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-25T19:52:59.888725] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-25T19:52:59.975071] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T19:52:59.984711] [INFO ] [REMOTE ] MAN: Full fetch complete (61999 records). [2025-09-25T19:52:59.984942] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-25T19:53:00.117441] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T19:53:00.426939] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-25T19:53:00.427058] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-25T19:53:00.428634] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-25T19:53:00.428753] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-25T19:53:00.430565] [DEBUG] [LOCAL ] MAN: Trimmed 61999 records to 43878 (keeping 200 days of data) [2025-09-25T19:53:00.689742] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-25T19:53:00.716063] [DEBUG] [LOCAL ] MAN: Primary data saved (43878 records). [2025-09-25T19:53:00.716254] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-25T19:53:00.716536] [INFO ] [MAIN ] Update Progress: 1303/2372 symbols completed. MAN took 25.1s. Estimated remaining: 2h 21m 54s. Rate: 7.5 symbols/min [2025-09-25T19:53:00.894353] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:00.941605] [DEBUG] [LOCAL ] MATV: Loaded 37531 existing records from primary storage. [2025-09-25T19:53:00.941825] [INFO ] [MAIN ] MATV: Loaded 37531 existing records. [2025-09-25T19:53:01.124979] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:01.125431] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-25T19:53:01.125488] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-25T19:53:01.125808] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-25T19:53:01.125870] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-25T19:53:01.496713] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-25T19:53:01.496536] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:01.888707] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T19:53:02.202828] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T19:53:02.209424] [INFO ] [REMOTE ] MAGN: Full fetch complete (50982 records). [2025-09-25T19:53:02.209554] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-25T19:53:02.294938] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-25T19:53:02.662329] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-25T19:53:02.662431] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-25T19:53:02.664203] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-25T19:53:02.664274] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-25T19:53:02.665733] [DEBUG] [LOCAL ] MAGN: Trimmed 50982 records to 35204 (keeping 200 days of data) [2025-09-25T19:53:02.911757] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T19:53:02.936117] [DEBUG] [LOCAL ] MAGN: Primary data saved (35204 records). [2025-09-25T19:53:02.936333] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-25T19:53:02.936483] [INFO ] [MAIN ] Update Progress: 1304/2372 symbols completed. MAGN took 32.1s. Estimated remaining: 2h 21m 41s. Rate: 7.5 symbols/min [2025-09-25T19:53:03.098849] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-25T19:53:03.132060] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:03.198246] [DEBUG] [LOCAL ] MATX: Loaded 31538 existing records from primary storage. [2025-09-25T19:53:03.198616] [INFO ] [MAIN ] MATX: Loaded 31538 existing records. [2025-09-25T19:53:03.402481] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:03.404859] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-25T19:53:03.404914] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-25T19:53:03.405256] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-25T19:53:03.405318] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-25T19:53:03.761424] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T19:53:03.840731] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:03.888680] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-25T19:53:04.688728] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-25T19:53:04.839558] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T19:53:05.270292] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T19:53:05.488740] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-25T19:53:05.849737] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T19:53:06.288723] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-25T19:53:06.865397] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T19:53:07.088748] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-25T19:53:07.150754] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T19:53:07.888914] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-25T19:53:08.688872] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-25T19:53:08.856564] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:53:09.106366] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T19:53:09.488781] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-25T19:53:10.001209] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T19:53:10.288779] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-25T19:53:10.599563] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T19:53:11.088819] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-25T19:53:11.893682] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T19:53:11.906037] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-25T19:53:12.688809] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-25T19:53:12.908105] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T19:53:13.316135] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T19:53:13.488756] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-25T19:53:14.147823] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T19:53:14.288801] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-25T19:53:14.366046] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T19:53:15.088860] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-25T19:53:15.752052] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T19:53:15.888830] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-25T19:53:16.535004] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T19:53:16.688764] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-25T19:53:17.407597] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T19:53:17.488760] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-25T19:53:17.799788] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T19:53:18.288773] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-25T19:53:19.095576] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-25T19:53:19.102742] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T19:53:19.832862] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T19:53:19.888698] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-25T19:53:20.642838] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T19:53:20.688766] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-25T19:53:21.296998] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T19:53:21.488782] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-25T19:53:22.288753] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-25T19:53:22.551116] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T19:53:22.976322] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:53:23.088801] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-25T19:53:23.546545] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T19:53:23.888751] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-25T19:53:24.587885] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T19:53:24.688763] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-25T19:53:25.380989] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T19:53:25.392059] [INFO ] [REMOTE ] MANU: Full fetch complete (38262 records). [2025-09-25T19:53:25.392367] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-25T19:53:25.493920] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-25T19:53:25.882636] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-25T19:53:25.882826] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-25T19:53:25.884054] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-25T19:53:25.884174] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-25T19:53:25.892303] [DEBUG] [LOCAL ] MANU: Trimmed 38262 records to 27364 (keeping 200 days of data) [2025-09-25T19:53:26.106181] [DEBUG] [LOCAL ] MANU: Primary data saved (27364 records). [2025-09-25T19:53:26.106433] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-25T19:53:26.106747] [INFO ] [MAIN ] Update Progress: 1305/2372 symbols completed. MANU took 46.8s. Estimated remaining: 2h 21m 46s. Rate: 7.5 symbols/min [2025-09-25T19:53:26.173788] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T19:53:26.180241] [INFO ] [REMOTE ] MATV: Full fetch complete (52419 records). [2025-09-25T19:53:26.180378] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-25T19:53:26.314721] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-25T19:53:26.494967] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:26.499406] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T19:53:26.757071] [DEBUG] [LOCAL ] MAX: Loaded 30824 existing records from primary storage. [2025-09-25T19:53:26.757352] [INFO ] [MAIN ] MAX: Loaded 30824 existing records. [2025-09-25T19:53:27.094740] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-25T19:53:27.192072] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-25T19:53:27.192203] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-25T19:53:27.193524] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-25T19:53:27.193616] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-25T19:53:27.198939] [DEBUG] [LOCAL ] MATV: Trimmed 52419 records to 37749 (keeping 200 days of data) [2025-09-25T19:53:27.203799] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:27.206956] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-25T19:53:27.207083] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-25T19:53:27.207597] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-25T19:53:27.207748] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-25T19:53:27.680352] [DEBUG] [LOCAL ] MATV: Primary data saved (37749 records). [2025-09-25T19:53:27.680568] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-25T19:53:27.680738] [INFO ] [MAIN ] Update Progress: 1306/2372 symbols completed. MATV took 27.0s. Estimated remaining: 2h 21m 33s. Rate: 7.5 symbols/min [2025-09-25T19:53:28.102384] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:28.121344] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-25T19:53:28.128758] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:28.187354] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T19:53:28.256951] [DEBUG] [LOCAL ] MBC: Loaded 43095 existing records from primary storage. [2025-09-25T19:53:28.257181] [INFO ] [MAIN ] MBC: Loaded 43095 existing records. [2025-09-25T19:53:28.476783] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:28.477237] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-25T19:53:28.477288] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-25T19:53:28.477751] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-25T19:53:28.477815] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-25T19:53:28.698784] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-25T19:53:28.810276] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T19:53:28.905705] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:29.158278] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T19:53:29.488822] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-25T19:53:30.288825] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-25T19:53:30.471488] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T19:53:31.031797] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:53:31.088716] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-25T19:53:31.662981] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T19:53:31.668578] [INFO ] [REMOTE ] MATX: Full fetch complete (42533 records). [2025-09-25T19:53:31.668709] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-25T19:53:31.961746] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-25T19:53:32.193483] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-25T19:53:32.193596] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-25T19:53:32.194683] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-25T19:53:32.194748] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-25T19:53:32.196067] [DEBUG] [LOCAL ] MATX: Trimmed 42533 records to 31717 (keeping 200 days of data) [2025-09-25T19:53:32.440055] [DEBUG] [LOCAL ] MATX: Primary data saved (31717 records). [2025-09-25T19:53:32.440289] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-25T19:53:32.440444] [INFO ] [MAIN ] Update Progress: 1307/2372 symbols completed. MATX took 29.5s. Estimated remaining: 2h 21m 22s. Rate: 7.5 symbols/min [2025-09-25T19:53:32.661990] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T19:53:32.682705] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:32.688726] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-25T19:53:32.722294] [DEBUG] [LOCAL ] MBI: Loaded 24678 existing records from primary storage. [2025-09-25T19:53:32.722520] [INFO ] [MAIN ] MBI: Loaded 24678 existing records. [2025-09-25T19:53:32.941795] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:32.942073] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-25T19:53:32.942123] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-25T19:53:32.942485] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-25T19:53:32.942577] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-25T19:53:33.300129] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:33.488803] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-25T19:53:33.887995] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T19:53:33.899437] [INFO ] [REMOTE ] MAS: Full fetch complete (74821 records). [2025-09-25T19:53:33.901720] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-25T19:53:34.161812] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T19:53:34.294013] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-25T19:53:34.391261] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-25T19:53:34.391377] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-25T19:53:34.392907] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-25T19:53:34.392979] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-25T19:53:34.395545] [DEBUG] [LOCAL ] MAS: Trimmed 74821 records to 52722 (keeping 200 days of data) [2025-09-25T19:53:34.507617] [DEBUG] [REMOTE ] MBI: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-25T19:53:34.508103] [WARN ] [REMOTE ] MBI: No data returned for month 2024-12 [2025-09-25T19:53:34.770258] [DEBUG] [LOCAL ] MAS: Primary data saved (52722 records). [2025-09-25T19:53:34.770466] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-25T19:53:34.770596] [INFO ] [MAIN ] Update Progress: 1308/2372 symbols completed. MAS took 37.0s. Estimated remaining: 2h 21m 9s. Rate: 7.5 symbols/min [2025-09-25T19:53:34.928524] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T19:53:35.014558] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:35.093896] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-25T19:53:35.100092] [DEBUG] [LOCAL ] MC: Loaded 44280 existing records from primary storage. [2025-09-25T19:53:35.100299] [INFO ] [MAIN ] MC: Loaded 44280 existing records. [2025-09-25T19:53:35.292368] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:35.293103] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-25T19:53:35.293163] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-25T19:53:35.293480] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-25T19:53:35.293541] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-25T19:53:35.672225] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:35.888775] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-25T19:53:36.321614] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T19:53:36.688751] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-25T19:53:37.323678] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T19:53:37.466763] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T19:53:37.488717] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-25T19:53:38.296697] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-25T19:53:38.308682] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T19:53:39.088797] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-25T19:53:39.748281] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T19:53:39.888737] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-25T19:53:40.690281] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T19:53:40.694450] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-25T19:53:40.946785] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T19:53:41.488779] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-25T19:53:42.051523] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T19:53:42.288832] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-25T19:53:43.037808] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T19:53:43.088711] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-25T19:53:43.311866] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T19:53:43.888770] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-25T19:53:44.515258] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T19:53:44.688774] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-25T19:53:45.488767] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-25T19:53:45.622357] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T19:53:45.676189] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:53:46.288748] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-25T19:53:47.003793] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T19:53:47.088677] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-25T19:53:47.888715] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-25T19:53:48.011851] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T19:53:48.276061] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T19:53:48.688732] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-25T19:53:49.275071] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T19:53:49.488698] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-25T19:53:50.119747] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T19:53:50.132740] [INFO ] [REMOTE ] MBC: Full fetch complete (62598 records). [2025-09-25T19:53:50.132954] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-25T19:53:50.299955] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-25T19:53:50.568746] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-25T19:53:50.568876] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-25T19:53:50.570079] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-25T19:53:50.570195] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-25T19:53:50.574165] [DEBUG] [LOCAL ] MBC: Trimmed 62598 records to 43426 (keeping 200 days of data) [2025-09-25T19:53:50.854058] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T19:53:50.918413] [DEBUG] [LOCAL ] MBC: Primary data saved (43426 records). [2025-09-25T19:53:50.918584] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-25T19:53:50.918774] [INFO ] [MAIN ] Update Progress: 1309/2372 symbols completed. MBC took 23.2s. Estimated remaining: 2h 21m 8s. Rate: 7.5 symbols/min [2025-09-25T19:53:51.092411] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:53:51.094716] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-25T19:53:51.113708] [DEBUG] [LOCAL ] MCB: Loaded 11686 existing records from primary storage. [2025-09-25T19:53:51.113882] [INFO ] [MAIN ] MCB: Loaded 11686 existing records. [2025-09-25T19:53:51.302352] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:53:51.302959] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-25T19:53:51.303032] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-25T19:53:51.303417] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-25T19:53:51.303502] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-25T19:53:51.752503] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:53:51.770098] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T19:53:51.888727] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-25T19:53:52.467903] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T19:53:52.688738] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-25T19:53:52.876587] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T19:53:53.488739] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-25T19:53:53.878585] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T19:53:54.288729] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-25T19:53:54.580617] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T19:53:55.088758] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-25T19:53:55.175328] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T19:53:55.888753] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-25T19:53:56.688739] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-25T19:53:56.751492] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T19:53:56.815040] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T19:53:57.488728] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-25T19:53:57.711458] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T19:53:58.288752] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-25T19:53:58.762258] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T19:53:59.088761] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-25T19:53:59.152837] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T19:53:59.888899] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-25T19:54:00.626568] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T19:54:00.688735] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-25T19:54:00.792345] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T19:54:01.488746] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-25T19:54:02.251211] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T19:54:02.259303] [INFO ] [REMOTE ] MAX: Full fetch complete (45425 records). [2025-09-25T19:54:02.259468] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-25T19:54:02.293852] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-25T19:54:02.660381] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-25T19:54:02.660487] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-25T19:54:02.661567] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-25T19:54:02.661669] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-25T19:54:02.663145] [DEBUG] [LOCAL ] MAX: Trimmed 45425 records to 31061 (keeping 200 days of data) [2025-09-25T19:54:02.809793] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T19:54:02.846970] [INFO ] [REMOTE ] MC: Full fetch complete (62372 records). [2025-09-25T19:54:02.847261] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-25T19:54:02.964669] [DEBUG] [LOCAL ] MAX: Primary data saved (31061 records). [2025-09-25T19:54:02.964828] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-25T19:54:02.965015] [INFO ] [MAIN ] Update Progress: 1310/2372 symbols completed. MAX took 36.9s. Estimated remaining: 2h 21m 4s. Rate: 7.5 symbols/min [2025-09-25T19:54:03.093804] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-25T19:54:03.187787] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T19:54:03.369695] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:03.369933] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-09-25T19:54:03.369988] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-09-25T19:54:03.370125] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-25T19:54:03.370164] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-25T19:54:03.370204] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-25T19:54:03.370237] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-25T19:54:03.817731] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-25T19:54:03.851688] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-25T19:54:03.853431] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-25T19:54:03.853532] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-25T19:54:03.855399] [DEBUG] [LOCAL ] MC: Trimmed 62372 records to 44594 (keeping 200 days of data) [2025-09-25T19:54:03.933544] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-25T19:54:04.106184] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:04.302537] [DEBUG] [LOCAL ] MC: Primary data saved (44594 records). [2025-09-25T19:54:04.302893] [INFO ] [MAIN ] MC: Full history saved. [2025-09-25T19:54:04.303208] [INFO ] [MAIN ] Update Progress: 1311/2372 symbols completed. MC took 29.5s. Estimated remaining: 2h 20m 50s. Rate: 7.5 symbols/min [2025-09-25T19:54:04.539906] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T19:54:04.552029] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:04.569551] [DEBUG] [LOCAL ] MCI: Loaded 6397 existing records from primary storage. [2025-09-25T19:54:04.569738] [INFO ] [MAIN ] MCI: Loaded 6397 existing records. [2025-09-25T19:54:04.693846] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-25T19:54:04.767760] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:04.768199] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-25T19:54:04.768251] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-25T19:54:04.768623] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-25T19:54:04.768726] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-25T19:54:05.193194] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:05.206133] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T19:54:05.488764] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-25T19:54:06.095815] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T19:54:06.102986] [INFO ] [REMOTE ] MBI: Full fetch complete (33419 records). [2025-09-25T19:54:06.103132] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-25T19:54:06.232764] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T19:54:06.293795] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-25T19:54:06.359948] [WARN ] [VALIDATOR ] MBI: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T19:54:06.360626] [FATAL] [MAIN ] MBI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:54:06.360786] [WARN ] [MAIN ] MBI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:54:06.360951] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-25T19:54:06.361068] [DEBUG] [LOCAL ] MBI: No primary data file found to delete. [2025-09-25T19:54:06.361137] [INFO ] [LOCAL ] MBI: Starting deletion of derivative data. [2025-09-25T19:54:06.363422] [DEBUG] [LOCAL ] MBI: Deleted derivative data file. [2025-09-25T19:54:06.363613] [INFO ] [MAIN ] Update Progress: 1312/2372 symbols completed. MBI took 33.9s. Estimated remaining: 2h 20m 37s. Rate: 7.5 symbols/min [2025-09-25T19:54:06.542909] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:06.627537] [DEBUG] [LOCAL ] MCK: Loaded 39330 existing records from primary storage. [2025-09-25T19:54:06.627770] [INFO ] [MAIN ] MCK: Loaded 39330 existing records. [2025-09-25T19:54:06.819376] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:06.819840] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-25T19:54:06.819901] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-25T19:54:06.820509] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-25T19:54:06.820571] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-25T19:54:07.094097] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-25T19:54:07.236913] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:07.247001] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T19:54:07.888785] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-25T19:54:08.688903] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-25T19:54:09.279373] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T19:54:09.288272] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T19:54:09.438714] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T19:54:09.488670] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-25T19:54:10.288860] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-25T19:54:11.083597] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T19:54:11.088669] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-25T19:54:11.131181] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T19:54:11.877386] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T19:54:11.888684] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-25T19:54:12.406568] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-25T19:54:12.688859] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-25T19:54:13.488751] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-25T19:54:14.288805] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-25T19:54:15.088803] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-25T19:54:15.361792] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T19:54:15.379709] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-25T19:54:15.441277] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T19:54:15.888796] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-25T19:54:16.688759] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-25T19:54:17.169835] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T19:54:17.488755] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-25T19:54:18.264436] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T19:54:18.288675] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-25T19:54:18.477422] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T19:54:18.639098] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (3.55 seconds). [2025-09-25T19:54:19.044007] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T19:54:19.088672] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-25T19:54:19.693407] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T19:54:19.888720] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-25T19:54:20.688705] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-25T19:54:21.419941] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T19:54:21.488777] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-25T19:54:21.716788] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T19:54:22.288808] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-25T19:54:22.901759] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T19:54:23.088773] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-25T19:54:23.386088] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T19:54:23.888729] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-25T19:54:24.552929] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T19:54:24.560592] [INFO ] [REMOTE ] MCI: Full fetch complete (9920 records). [2025-09-25T19:54:24.560724] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-25T19:54:24.582018] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T19:54:24.694754] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-25T19:54:25.001252] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-25T19:54:25.001386] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-25T19:54:25.001766] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-25T19:54:25.001833] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-25T19:54:25.002392] [DEBUG] [LOCAL ] MCI: Trimmed 9920 records to 6446 (keeping 200 days of data) [2025-09-25T19:54:25.053897] [DEBUG] [LOCAL ] MCI: Primary data saved (6446 records). [2025-09-25T19:54:25.054031] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-25T19:54:25.054233] [INFO ] [MAIN ] Update Progress: 1313/2372 symbols completed. MCI took 20.8s. Estimated remaining: 2h 20m 38s. Rate: 7.5 symbols/min [2025-09-25T19:54:25.230302] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:25.249074] [DEBUG] [LOCAL ] MCN: Loaded 8126 existing records from primary storage. [2025-09-25T19:54:25.249218] [INFO ] [MAIN ] MCN: Loaded 8126 existing records. [2025-09-25T19:54:25.431197] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:25.431494] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-25T19:54:25.431570] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-25T19:54:25.431998] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-25T19:54:25.432079] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-25T19:54:25.496840] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-25T19:54:25.800464] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:26.288719] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-25T19:54:26.885977] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T19:54:26.888966] [INFO ] [REMOTE ] MCB: Full fetch complete (16314 records). [2025-09-25T19:54:26.889076] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-25T19:54:27.090217] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-25T19:54:27.245128] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-25T19:54:27.353695] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-25T19:54:27.353796] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-25T19:54:27.354255] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-25T19:54:27.354297] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-25T19:54:27.355169] [DEBUG] [LOCAL ] MCB: Trimmed 16314 records to 11768 (keeping 200 days of data) [2025-09-25T19:54:27.438926] [DEBUG] [LOCAL ] MCB: Primary data saved (11768 records). [2025-09-25T19:54:27.439101] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-25T19:54:27.439428] [INFO ] [MAIN ] Update Progress: 1314/2372 symbols completed. MCB took 36.5s. Estimated remaining: 2h 20m 26s. Rate: 7.5 symbols/min [2025-09-25T19:54:27.627736] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:27.678892] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T19:54:27.697426] [DEBUG] [LOCAL ] MCO: Loaded 39518 existing records from primary storage. [2025-09-25T19:54:27.697606] [INFO ] [MAIN ] MCO: Loaded 39518 existing records. [2025-09-25T19:54:27.879781] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:27.880146] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-25T19:54:27.880193] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-25T19:54:27.880737] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-25T19:54:27.880799] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-25T19:54:27.893838] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-25T19:54:28.327857] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:28.688735] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-25T19:54:28.871505] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:54:29.346859] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-25T19:54:29.488736] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-25T19:54:29.906784] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T19:54:30.288755] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-25T19:54:30.903199] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T19:54:30.913102] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T19:54:31.088722] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-25T19:54:31.888765] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-25T19:54:32.611596] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T19:54:32.688698] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-25T19:54:32.737099] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T19:54:33.478726] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T19:54:33.488676] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-25T19:54:34.274953] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T19:54:34.288742] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-25T19:54:35.088914] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-25T19:54:35.861838] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T19:54:35.888723] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-25T19:54:36.236318] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T19:54:36.692069] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-25T19:54:36.699270] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T19:54:37.489020] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-25T19:54:38.136483] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T19:54:38.288711] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-25T19:54:38.587479] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T19:54:38.605945] [INFO ] [REMOTE ] MCK: Full fetch complete (57529 records). [2025-09-25T19:54:38.606182] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-25T19:54:39.010845] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-25T19:54:39.010950] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-25T19:54:39.012010] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-25T19:54:39.012149] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-25T19:54:39.014615] [DEBUG] [LOCAL ] MCK: Trimmed 57529 records to 39698 (keeping 200 days of data) [2025-09-25T19:54:39.103675] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-25T19:54:39.335844] [DEBUG] [LOCAL ] MCK: Primary data saved (39698 records). [2025-09-25T19:54:39.336096] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-25T19:54:39.336399] [INFO ] [MAIN ] Update Progress: 1315/2372 symbols completed. MCK took 33.0s. Estimated remaining: 2h 20m 21s. Rate: 7.5 symbols/min [2025-09-25T19:54:39.520839] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:39.543266] [DEBUG] [LOCAL ] MCR: Loaded 8764 existing records from primary storage. [2025-09-25T19:54:39.543423] [INFO ] [MAIN ] MCR: Loaded 8764 existing records. [2025-09-25T19:54:39.629330] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T19:54:39.788500] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:39.789190] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-25T19:54:39.789241] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-25T19:54:39.789569] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-25T19:54:39.789658] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-25T19:54:39.880755] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T19:54:39.894771] [INFO ] [REMOTE ] MCN: Full fetch complete (11574 records). [2025-09-25T19:54:39.894902] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-25T19:54:39.901866] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-25T19:54:40.469579] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:40.609909] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-25T19:54:40.609996] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-25T19:54:40.610214] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-25T19:54:40.610253] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-25T19:54:40.611415] [DEBUG] [LOCAL ] MCN: Trimmed 11574 records to 8199 (keeping 200 days of data) [2025-09-25T19:54:40.667534] [DEBUG] [LOCAL ] MCN: Primary data saved (8199 records). [2025-09-25T19:54:40.667699] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-25T19:54:40.667813] [INFO ] [MAIN ] Update Progress: 1316/2372 symbols completed. MCN took 15.6s. Estimated remaining: 2h 20m 8s. Rate: 7.5 symbols/min [2025-09-25T19:54:40.697880] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-25T19:54:40.855274] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:54:40.891419] [DEBUG] [LOCAL ] MCS: Loaded 21218 existing records from primary storage. [2025-09-25T19:54:40.891628] [INFO ] [MAIN ] MCS: Loaded 21218 existing records. [2025-09-25T19:54:41.089369] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:54:41.090427] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-25T19:54:41.090492] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-25T19:54:41.090826] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-25T19:54:41.090887] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-25T19:54:41.446699] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:54:41.488696] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-25T19:54:42.095005] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-25T19:54:42.288680] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-25T19:54:42.483430] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T19:54:42.548021] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T19:54:43.088780] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-25T19:54:43.888741] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-25T19:54:43.942634] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T19:54:44.607875] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-25T19:54:44.688698] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-25T19:54:45.488757] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-25T19:54:45.583042] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T19:54:45.742557] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T19:54:46.288755] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-25T19:54:47.088768] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-25T19:54:47.431175] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T19:54:47.888739] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-25T19:54:48.238411] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T19:54:48.252128] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T19:54:48.688761] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-25T19:54:49.488685] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-25T19:54:49.811800] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T19:54:50.001478] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-25T19:54:50.288696] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-25T19:54:50.364700] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T19:54:51.088726] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-25T19:54:51.341412] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T19:54:51.888717] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-25T19:54:51.923316] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T19:54:52.688700] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-25T19:54:52.922614] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T19:54:53.488751] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-25T19:54:54.288749] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-25T19:54:54.612796] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T19:54:54.713159] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-25T19:54:54.889069] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-25T19:54:54.903717] [INFO ] [REMOTE ] MCD: Full fetch complete (77028 records). [2025-09-25T19:54:54.903923] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-25T19:54:55.093809] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-25T19:54:55.181861] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T19:54:55.184402] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:54:55.184470] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:54:55.184551] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-25T19:54:55.184741] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-09-25T19:54:55.184819] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-09-25T19:54:55.184899] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-09-25T19:54:55.185082] [INFO ] [MAIN ] Update Progress: 1317/2372 symbols completed. MCD took 52.2s. Estimated remaining: 2h 20m 5s. Rate: 7.5 symbols/min [2025-09-25T19:54:55.888753] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-25T19:54:56.247632] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T19:54:56.688734] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-25T19:54:57.425431] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T19:54:57.488696] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-25T19:54:57.507797] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T19:54:58.288785] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-25T19:54:58.994279] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T19:54:59.088757] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-25T19:54:59.553322] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T19:54:59.558117] [INFO ] [REMOTE ] MCS: Full fetch complete (30351 records). [2025-09-25T19:54:59.558203] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-25T19:54:59.640209] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T19:54:59.893856] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-25T19:54:59.983234] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-25T19:54:59.983351] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-25T19:54:59.984172] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-25T19:54:59.984239] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-25T19:54:59.985261] [DEBUG] [LOCAL ] MCS: Trimmed 30351 records to 21354 (keeping 200 days of data) [2025-09-25T19:55:00.147702] [DEBUG] [LOCAL ] MCS: Primary data saved (21354 records). [2025-09-25T19:55:00.147887] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-25T19:55:00.148084] [INFO ] [MAIN ] Update Progress: 1318/2372 symbols completed. MCS took 19.5s. Estimated remaining: 2h 19m 55s. Rate: 7.5 symbols/min [2025-09-25T19:55:00.688759] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-25T19:55:01.257044] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T19:55:01.474255] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T19:55:01.488677] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-25T19:55:02.253184] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T19:55:02.288667] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-25T19:55:03.088816] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-25T19:55:03.146442] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T19:55:03.888788] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-25T19:55:04.499828] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T19:55:04.688890] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-25T19:55:04.799102] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T19:55:05.488775] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-25T19:55:06.494576] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T19:55:06.524930] [INFO ] [REMOTE ] MCR: Full fetch complete (14215 records). [2025-09-25T19:55:06.528779] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-25T19:55:06.529908] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:55:06.602977] [INFO ] [REMOTE ] MCO: Full fetch complete (56646 records). [2025-09-25T19:55:06.635810] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-25T19:55:07.268434] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-25T19:55:07.268781] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-25T19:55:07.269310] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-25T19:55:07.269422] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-25T19:55:07.270409] [DEBUG] [LOCAL ] MCR: Trimmed 14215 records to 8814 (keeping 200 days of data) [2025-09-25T19:55:07.420801] [DEBUG] [LOCAL ] MCR: Primary data saved (8814 records). [2025-09-25T19:55:07.420986] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-25T19:55:07.421183] [INFO ] [MAIN ] Update Progress: 1319/2372 symbols completed. MCR took 28.1s. Estimated remaining: 2h 19m 46s. Rate: 7.5 symbols/min [2025-09-25T19:55:07.514773] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-25T19:55:07.514920] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-25T19:55:07.515882] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-25T19:55:07.516071] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-25T19:55:07.517983] [DEBUG] [LOCAL ] MCO: Trimmed 56646 records to 39809 (keeping 200 days of data) [2025-09-25T19:55:07.847168] [DEBUG] [LOCAL ] MCO: Primary data saved (39809 records). [2025-09-25T19:55:07.847495] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-25T19:55:07.847765] [INFO ] [MAIN ] Update Progress: 1320/2372 symbols completed. MCO took 40.4s. Estimated remaining: 2h 19m 32s. Rate: 7.5 symbols/min [2025-09-25T19:55:08.562167] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:08.632943] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:08.667091] [DEBUG] [LOCAL ] MDST: Loaded 5536 existing records from primary storage. [2025-09-25T19:55:08.667279] [INFO ] [MAIN ] MDST: Loaded 5536 existing records. [2025-09-25T19:55:08.728581] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:08.767595] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:08.915486] [DEBUG] [LOCAL ] MD: Loaded 38661 existing records from primary storage. [2025-09-25T19:55:08.926920] [INFO ] [MAIN ] MD: Loaded 38661 existing records. [2025-09-25T19:55:08.956974] [DEBUG] [LOCAL ] MCY: Loaded 25078 existing records from primary storage. [2025-09-25T19:55:08.957153] [INFO ] [MAIN ] MCY: Loaded 25078 existing records. [2025-09-25T19:55:09.120928] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-25T19:55:09.121204] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-25T19:55:09.357693] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:09.358140] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-25T19:55:09.358209] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-25T19:55:09.390826] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-25T19:55:09.403956] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-25T19:55:09.761858] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:09.762508] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-25T19:55:09.762560] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-25T19:55:09.762722] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:09.762913] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-25T19:55:09.762963] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-25T19:55:09.776834] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-25T19:55:09.776925] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-25T19:55:09.782997] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-25T19:55:09.783072] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-25T19:55:10.019919] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:10.020269] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-25T19:55:10.020344] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-25T19:55:10.020622] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-25T19:55:10.037190] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-25T19:55:10.949409] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:10.949962] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-25T19:55:11.247746] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:11.257034] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-25T19:55:11.226584] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:11.273274] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-25T19:55:11.318221] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:11.318522] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-25T19:55:11.662141] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T19:55:11.664481] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-25T19:55:12.222261] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T19:55:12.224753] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-25T19:55:12.735823] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T19:55:12.742787] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-25T19:55:12.813163] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T19:55:12.821389] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-25T19:55:12.851933] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T19:55:12.854302] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-25T19:55:13.197967] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T19:55:13.273391] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-25T19:55:13.488726] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-25T19:55:14.046625] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T19:55:14.061309] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:55:14.209740] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T19:55:14.288735] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-25T19:55:15.088788] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-25T19:55:15.703938] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T19:55:15.876232] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T19:55:15.888689] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-25T19:55:16.568186] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T19:55:16.688730] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-25T19:55:17.418605] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T19:55:17.488741] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-25T19:55:18.288735] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-25T19:55:18.921284] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T19:55:19.088742] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-25T19:55:19.655847] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T19:55:19.714967] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T19:55:19.888744] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-25T19:55:20.688730] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-25T19:55:20.771454] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T19:55:20.773716] [INFO ] [REMOTE ] MDST: Full fetch complete (8488 records). [2025-09-25T19:55:20.773801] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-25T19:55:21.206306] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-25T19:55:21.206443] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-25T19:55:21.207191] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-25T19:55:21.207278] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-25T19:55:21.208051] [DEBUG] [LOCAL ] MDST: Trimmed 8488 records to 5600 (keeping 200 days of data) [2025-09-25T19:55:21.246778] [DEBUG] [LOCAL ] MDST: Primary data saved (5600 records). [2025-09-25T19:55:21.246953] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-25T19:55:21.247218] [INFO ] [MAIN ] Update Progress: 1321/2372 symbols completed. MDST took 13.4s. Estimated remaining: 2h 19m 28s. Rate: 7.5 symbols/min [2025-09-25T19:55:21.423060] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:21.488764] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-25T19:55:21.492538] [DEBUG] [LOCAL ] MDU: Loaded 47888 existing records from primary storage. [2025-09-25T19:55:21.493090] [INFO ] [MAIN ] MDU: Loaded 47888 existing records. [2025-09-25T19:55:21.703174] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:21.703561] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-25T19:55:21.703639] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-25T19:55:21.704845] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-25T19:55:21.704946] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-25T19:55:22.094557] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:22.119758] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T19:55:22.288726] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-25T19:55:23.088798] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-25T19:55:23.428403] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T19:55:23.888754] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-25T19:55:24.005535] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T19:55:24.564813] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T19:55:24.688689] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-25T19:55:25.148891] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T19:55:25.488729] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-25T19:55:26.252347] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T19:55:26.288676] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-25T19:55:27.088741] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-25T19:55:27.280273] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T19:55:27.690323] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T19:55:27.888695] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-25T19:55:28.514741] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T19:55:28.688718] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-25T19:55:29.423464] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T19:55:29.488739] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-25T19:55:30.290709] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-25T19:55:30.303563] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T19:55:31.062130] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T19:55:31.088743] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-25T19:55:31.888759] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-25T19:55:32.267881] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T19:55:32.688739] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-25T19:55:32.792274] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T19:55:33.488925] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-25T19:55:33.539951] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T19:55:33.551491] [INFO ] [REMOTE ] MD: Full fetch complete (55223 records). [2025-09-25T19:55:33.551697] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-25T19:55:34.047912] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T19:55:34.205188] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-25T19:55:34.205327] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-25T19:55:34.206893] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-25T19:55:34.206971] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-25T19:55:34.208972] [DEBUG] [LOCAL ] MD: Trimmed 55223 records to 38877 (keeping 200 days of data) [2025-09-25T19:55:34.291724] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-25T19:55:34.523403] [DEBUG] [LOCAL ] MD: Primary data saved (38877 records). [2025-09-25T19:55:34.523594] [INFO ] [MAIN ] MD: Full history saved. [2025-09-25T19:55:34.523754] [INFO ] [MAIN ] Update Progress: 1322/2372 symbols completed. MD took 26.7s. Estimated remaining: 2h 19m 25s. Rate: 7.5 symbols/min [2025-09-25T19:55:34.785179] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:34.793342] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T19:55:34.815139] [DEBUG] [LOCAL ] MDV: Loaded 8649 existing records from primary storage. [2025-09-25T19:55:34.815328] [INFO ] [MAIN ] MDV: Loaded 8649 existing records. [2025-09-25T19:55:35.016460] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:35.020360] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-25T19:55:35.020428] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-25T19:55:35.020777] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-25T19:55:35.020852] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-25T19:55:35.093791] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-25T19:55:35.400187] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T19:55:35.426568] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:35.888715] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-25T19:55:36.688739] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-25T19:55:37.146328] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T19:55:37.278403] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T19:55:37.488741] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-25T19:55:37.870220] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T19:55:38.288738] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-25T19:55:39.088723] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-25T19:55:39.389041] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T19:55:39.635780] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-25T19:55:39.888730] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-25T19:55:40.411620] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T19:55:40.688755] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-25T19:55:41.488768] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-25T19:55:41.755342] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T19:55:41.895009] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T19:55:42.288745] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-25T19:55:42.713301] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T19:55:42.718069] [INFO ] [REMOTE ] MCY: Full fetch complete (41572 records). [2025-09-25T19:55:42.718332] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-25T19:55:43.095748] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-25T19:55:43.152298] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-25T19:55:43.152417] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-25T19:55:43.153834] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-25T19:55:43.153902] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-25T19:55:43.155491] [DEBUG] [LOCAL ] MCY: Trimmed 41572 records to 25210 (keeping 200 days of data) [2025-09-25T19:55:43.329534] [DEBUG] [LOCAL ] MCY: Primary data saved (25210 records). [2025-09-25T19:55:43.329767] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-25T19:55:43.329886] [INFO ] [MAIN ] Update Progress: 1323/2372 symbols completed. MCY took 35.5s. Estimated remaining: 2h 19m 17s. Rate: 7.5 symbols/min [2025-09-25T19:55:43.522945] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:43.546429] [DEBUG] [LOCAL ] MEC: Loaded 16379 existing records from primary storage. [2025-09-25T19:55:43.546606] [INFO ] [MAIN ] MEC: Loaded 16379 existing records. [2025-09-25T19:55:43.740978] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:43.744110] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-25T19:55:43.744161] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-25T19:55:43.744483] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-25T19:55:43.744545] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-25T19:55:43.784530] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T19:55:43.893979] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-25T19:55:44.184969] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:44.229336] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T19:55:44.592330] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T19:55:44.688734] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-25T19:55:45.488817] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-25T19:55:45.713055] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T19:55:46.147225] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T19:55:46.288739] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-25T19:55:46.997821] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T19:55:47.088738] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-25T19:55:47.820556] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T19:55:47.888784] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-25T19:55:48.688873] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-25T19:55:49.488795] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-25T19:55:49.783173] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T19:55:50.280720] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T19:55:50.288689] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-25T19:55:50.356034] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T19:55:51.089527] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-25T19:55:51.094596] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T19:55:51.888810] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-25T19:55:52.681786] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T19:55:52.688670] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-25T19:55:52.927602] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:55:52.938331] [INFO ] [REMOTE ] MDT: Full fetch complete (77699 records). [2025-09-25T19:55:52.938755] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-25T19:55:53.417802] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-25T19:55:53.417949] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-25T19:55:53.419282] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-25T19:55:53.419448] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-25T19:55:53.421600] [DEBUG] [LOCAL ] MDT: Trimmed 77699 records to 54068 (keeping 200 days of data) [2025-09-25T19:55:53.449224] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T19:55:53.508473] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-25T19:55:53.833933] [DEBUG] [LOCAL ] MDT: Primary data saved (54068 records). [2025-09-25T19:55:53.834147] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-25T19:55:53.834497] [INFO ] [MAIN ] Update Progress: 1324/2372 symbols completed. MDT took 45.9s. Estimated remaining: 2h 19m 11s. Rate: 7.5 symbols/min [2025-09-25T19:55:54.010106] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:54.044980] [DEBUG] [LOCAL ] MED: Loaded 21775 existing records from primary storage. [2025-09-25T19:55:54.045218] [INFO ] [MAIN ] MED: Loaded 21775 existing records. [2025-09-25T19:55:54.246591] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:54.247448] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-25T19:55:54.247519] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-25T19:55:54.248074] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-25T19:55:54.248177] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-25T19:55:54.294055] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-25T19:55:54.625955] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:55.088774] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-25T19:55:55.366681] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T19:55:55.376965] [INFO ] [REMOTE ] MDU: Full fetch complete (70304 records). [2025-09-25T19:55:55.377137] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-25T19:55:55.416017] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T19:55:55.789897] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-25T19:55:55.790023] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-25T19:55:55.791140] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-25T19:55:55.791205] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-25T19:55:55.793818] [DEBUG] [LOCAL ] MDU: Trimmed 70304 records to 48273 (keeping 200 days of data) [2025-09-25T19:55:55.906001] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-25T19:55:56.141054] [DEBUG] [LOCAL ] MDU: Primary data saved (48273 records). [2025-09-25T19:55:56.141215] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-25T19:55:56.142675] [INFO ] [MAIN ] Update Progress: 1325/2372 symbols completed. MDU took 34.9s. Estimated remaining: 2h 18m 59s. Rate: 7.5 symbols/min [2025-09-25T19:55:56.341680] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:56.344502] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T19:55:56.401004] [DEBUG] [LOCAL ] MEG: Loaded 31972 existing records from primary storage. [2025-09-25T19:55:56.401194] [INFO ] [MAIN ] MEG: Loaded 31972 existing records. [2025-09-25T19:55:56.596600] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:56.597120] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-25T19:55:56.597189] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-25T19:55:56.597481] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-25T19:55:56.597552] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-25T19:55:56.695210] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-25T19:55:56.712208] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T19:55:56.992846] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:57.478538] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T19:55:57.482903] [INFO ] [REMOTE ] MDV: Full fetch complete (11574 records). [2025-09-25T19:55:57.482992] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-25T19:55:57.493945] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-25T19:55:57.878468] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-25T19:55:57.878564] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-25T19:55:57.878928] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-25T19:55:57.878994] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-25T19:55:57.880423] [DEBUG] [LOCAL ] MDV: Trimmed 11574 records to 8699 (keeping 200 days of data) [2025-09-25T19:55:57.950302] [DEBUG] [LOCAL ] MDV: Primary data saved (8699 records). [2025-09-25T19:55:57.950459] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-25T19:55:57.950627] [INFO ] [MAIN ] Update Progress: 1326/2372 symbols completed. MDV took 23.4s. Estimated remaining: 2h 18m 46s. Rate: 7.5 symbols/min [2025-09-25T19:55:58.121783] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:55:58.163822] [DEBUG] [LOCAL ] MEGI: Loaded 20443 existing records from primary storage. [2025-09-25T19:55:58.164093] [INFO ] [MAIN ] MEGI: Loaded 20443 existing records. [2025-09-25T19:55:58.293793] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-25T19:55:58.367840] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:55:58.369060] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-25T19:55:58.369112] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-25T19:55:58.369369] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-25T19:55:58.369433] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-25T19:55:58.677932] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T19:55:58.773416] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:55:59.088748] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-25T19:55:59.819845] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T19:55:59.888679] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-25T19:56:00.214153] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T19:56:00.688729] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-25T19:56:01.013601] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T19:56:01.488783] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-25T19:56:01.698403] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T19:56:02.288758] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-25T19:56:02.771122] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T19:56:03.088714] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-25T19:56:03.290817] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T19:56:03.888717] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-25T19:56:04.309118] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T19:56:04.688722] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-25T19:56:05.146896] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T19:56:05.488705] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-25T19:56:05.751738] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T19:56:06.288697] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-25T19:56:06.605011] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T19:56:07.088696] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-25T19:56:07.287372] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T19:56:07.888724] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-25T19:56:08.123821] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T19:56:08.688725] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-25T19:56:08.980419] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T19:56:09.488699] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-25T19:56:09.527032] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T19:56:10.288686] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-25T19:56:10.544334] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T19:56:11.088701] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-25T19:56:11.281997] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T19:56:11.888725] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-25T19:56:12.508126] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T19:56:12.688765] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-25T19:56:12.962154] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T19:56:13.488689] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-25T19:56:13.797077] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T19:56:14.288749] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-25T19:56:14.351065] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T19:56:15.088735] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-25T19:56:15.317087] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T19:56:15.888827] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-25T19:56:16.298524] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T19:56:16.306008] [INFO ] [REMOTE ] MEC: Full fetch complete (22716 records). [2025-09-25T19:56:16.306160] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-25T19:56:16.694740] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-25T19:56:16.744242] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-25T19:56:16.744360] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-25T19:56:16.745042] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-25T19:56:16.745150] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-25T19:56:16.746954] [DEBUG] [LOCAL ] MEC: Trimmed 22716 records to 16543 (keeping 200 days of data) [2025-09-25T19:56:16.891537] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T19:56:16.915004] [DEBUG] [LOCAL ] MEC: Primary data saved (16543 records). [2025-09-25T19:56:16.915270] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-25T19:56:16.915559] [INFO ] [MAIN ] Update Progress: 1327/2372 symbols completed. MEC took 33.6s. Estimated remaining: 2h 18m 47s. Rate: 7.5 symbols/min [2025-09-25T19:56:17.097699] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:17.163094] [DEBUG] [LOCAL ] MEI: Loaded 32456 existing records from primary storage. [2025-09-25T19:56:17.163292] [INFO ] [MAIN ] MEI: Loaded 32456 existing records. [2025-09-25T19:56:17.347302] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:17.348015] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-25T19:56:17.348078] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-25T19:56:17.348844] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-25T19:56:17.348964] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-25T19:56:17.493879] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-25T19:56:17.725960] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T19:56:17.838076] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:18.288768] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-25T19:56:18.990847] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T19:56:19.088760] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-25T19:56:19.358970] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T19:56:19.888878] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-25T19:56:20.142910] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T19:56:20.688765] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-25T19:56:20.768113] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T19:56:20.772299] [INFO ] [REMOTE ] MED: Full fetch complete (32971 records). [2025-09-25T19:56:20.772404] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-25T19:56:21.178340] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-25T19:56:21.178457] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-25T19:56:21.179357] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-25T19:56:21.179425] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-25T19:56:21.180338] [DEBUG] [LOCAL ] MED: Trimmed 32971 records to 21913 (keeping 200 days of data) [2025-09-25T19:56:21.330484] [DEBUG] [LOCAL ] MED: Primary data saved (21913 records). [2025-09-25T19:56:21.330633] [INFO ] [MAIN ] MED: Full history saved. [2025-09-25T19:56:21.330786] [INFO ] [MAIN ] Update Progress: 1328/2372 symbols completed. MED took 27.5s. Estimated remaining: 2h 18m 36s. Rate: 7.5 symbols/min [2025-09-25T19:56:21.488809] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-25T19:56:21.512209] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:21.597905] [DEBUG] [LOCAL ] MET: Loaded 53316 existing records from primary storage. [2025-09-25T19:56:21.598161] [INFO ] [MAIN ] MET: Loaded 53316 existing records. [2025-09-25T19:56:21.910236] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:21.910816] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-25T19:56:21.910879] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-25T19:56:21.911330] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-25T19:56:21.911399] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-25T19:56:22.143571] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T19:56:22.289479] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-25T19:56:22.330257] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:22.661360] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T19:56:23.088802] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-25T19:56:23.270304] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T19:56:23.888778] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-25T19:56:24.688697] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-25T19:56:25.022495] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T19:56:25.047269] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T19:56:25.059124] [INFO ] [REMOTE ] MEGI: Full fetch complete (30600 records). [2025-09-25T19:56:25.059215] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-25T19:56:25.449148] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-25T19:56:25.449276] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-25T19:56:25.450107] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-25T19:56:25.450178] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-25T19:56:25.451129] [DEBUG] [LOCAL ] MEGI: Trimmed 30600 records to 20538 (keeping 200 days of data) [2025-09-25T19:56:25.522876] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-25T19:56:25.618431] [DEBUG] [LOCAL ] MEGI: Primary data saved (20538 records). [2025-09-25T19:56:25.618634] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-25T19:56:25.618826] [INFO ] [MAIN ] Update Progress: 1329/2372 symbols completed. MEGI took 27.7s. Estimated remaining: 2h 18m 25s. Rate: 7.5 symbols/min [2025-09-25T19:56:25.791839] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:25.864199] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T19:56:25.887603] [DEBUG] [LOCAL ] MFA: Loaded 45317 existing records from primary storage. [2025-09-25T19:56:25.887786] [INFO ] [MAIN ] MFA: Loaded 45317 existing records. [2025-09-25T19:56:26.066101] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:26.066451] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-25T19:56:26.066503] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-25T19:56:26.066941] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-25T19:56:26.067024] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-25T19:56:26.294831] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-25T19:56:26.524394] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:27.088786] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-25T19:56:27.399413] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T19:56:27.440976] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T19:56:27.888691] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-25T19:56:28.335025] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T19:56:28.688732] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-25T19:56:29.488735] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-25T19:56:29.561047] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T19:56:30.288697] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-25T19:56:30.353066] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T19:56:30.419921] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T19:56:31.088752] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-25T19:56:31.740233] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T19:56:31.888742] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-25T19:56:32.688733] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-25T19:56:32.939258] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T19:56:33.488698] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-25T19:56:33.806299] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T19:56:33.869130] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T19:56:34.288721] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-25T19:56:35.063258] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T19:56:35.088685] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-25T19:56:35.405847] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T19:56:35.888731] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-25T19:56:36.476739] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T19:56:36.688746] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-25T19:56:37.488703] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-25T19:56:37.573945] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T19:56:38.218415] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T19:56:38.288763] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-25T19:56:39.088695] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-25T19:56:39.140304] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T19:56:39.169486] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T19:56:39.888725] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-25T19:56:40.247348] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T19:56:40.254288] [INFO ] [REMOTE ] MEG: Full fetch complete (48188 records). [2025-09-25T19:56:40.254428] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-25T19:56:40.668629] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-25T19:56:40.668755] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-25T19:56:40.669748] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-25T19:56:40.669815] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-25T19:56:40.671062] [DEBUG] [LOCAL ] MEG: Trimmed 48188 records to 32202 (keeping 200 days of data) [2025-09-25T19:56:40.731722] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-25T19:56:40.886598] [DEBUG] [LOCAL ] MEG: Primary data saved (32202 records). [2025-09-25T19:56:40.886805] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-25T19:56:40.886982] [INFO ] [MAIN ] Update Progress: 1330/2372 symbols completed. MEG took 44.7s. Estimated remaining: 2h 18m 23s. Rate: 7.5 symbols/min [2025-09-25T19:56:41.084930] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:41.102890] [DEBUG] [LOCAL ] MFAN: Loaded 4265 existing records from primary storage. [2025-09-25T19:56:41.103073] [INFO ] [MAIN ] MFAN: Loaded 4265 existing records. [2025-09-25T19:56:41.286852] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:41.287364] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-25T19:56:41.287425] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-25T19:56:41.287761] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-25T19:56:41.287820] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-25T19:56:41.432437] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T19:56:41.506792] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-25T19:56:41.720167] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:42.288728] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-25T19:56:42.629854] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:56:42.981515] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T19:56:43.088744] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-25T19:56:43.540414] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-25T19:56:43.888688] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-25T19:56:44.061126] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T19:56:44.438811] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-25T19:56:44.688751] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-25T19:56:45.488880] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-25T19:56:45.949512] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T19:56:46.288708] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-25T19:56:46.390841] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T19:56:46.953366] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T19:56:47.088972] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-25T19:56:47.888797] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-25T19:56:48.511535] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:56:48.688800] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-25T19:56:48.754002] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T19:56:49.489082] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-25T19:56:50.288747] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-25T19:56:50.674409] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-25T19:56:50.798930] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T19:56:50.965223] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T19:56:50.984228] [INFO ] [REMOTE ] MEI: Full fetch complete (45665 records). [2025-09-25T19:56:50.984569] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-25T19:56:51.094769] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-25T19:56:51.442294] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-25T19:56:51.442457] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-25T19:56:51.443787] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-25T19:56:51.444015] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-25T19:56:51.445797] [DEBUG] [LOCAL ] MEI: Trimmed 45665 records to 32688 (keeping 200 days of data) [2025-09-25T19:56:51.692717] [DEBUG] [LOCAL ] MEI: Primary data saved (32688 records). [2025-09-25T19:56:51.692938] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-25T19:56:51.693186] [INFO ] [MAIN ] Update Progress: 1331/2372 symbols completed. MEI took 34.8s. Estimated remaining: 2h 18m 17s. Rate: 7.5 symbols/min [2025-09-25T19:56:51.748886] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-25T19:56:51.902700] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-25T19:56:51.910257] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:51.925609] [DEBUG] [LOCAL ] MFAO: Loaded 3798 existing records from primary storage. [2025-09-25T19:56:51.925839] [INFO ] [MAIN ] MFAO: Loaded 3798 existing records. [2025-09-25T19:56:52.129427] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:52.132982] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-25T19:56:52.133060] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-25T19:56:52.133797] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-25T19:56:52.133867] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-25T19:56:52.393276] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T19:56:52.553884] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:52.688774] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-25T19:56:53.488907] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-25T19:56:54.062311] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T19:56:54.288741] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-25T19:56:54.533617] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T19:56:54.548316] [INFO ] [REMOTE ] MET: Full fetch complete (77116 records). [2025-09-25T19:56:54.548537] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-25T19:56:54.992084] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-25T19:56:54.992272] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-25T19:56:54.993742] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-25T19:56:54.993812] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-25T19:56:54.995868] [DEBUG] [LOCAL ] MET: Trimmed 77116 records to 53702 (keeping 200 days of data) [2025-09-25T19:56:55.105390] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-25T19:56:55.365223] [DEBUG] [LOCAL ] MET: Primary data saved (53702 records). [2025-09-25T19:56:55.365412] [INFO ] [MAIN ] MET: Full history saved. [2025-09-25T19:56:55.365540] [INFO ] [MAIN ] Update Progress: 1332/2372 symbols completed. MET took 34.0s. Estimated remaining: 2h 18m 6s. Rate: 7.5 symbols/min [2025-09-25T19:56:55.546104] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:55.605586] [DEBUG] [LOCAL ] MFC: Loaded 51300 existing records from primary storage. [2025-09-25T19:56:55.605787] [INFO ] [MAIN ] MFC: Loaded 51300 existing records. [2025-09-25T19:56:55.791610] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T19:56:55.793502] [INFO ] [REMOTE ] MFAN: Full fetch complete (5584 records). [2025-09-25T19:56:55.793608] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-25T19:56:55.857667] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:56:55.872056] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-25T19:56:55.872137] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-25T19:56:55.872462] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-25T19:56:55.872538] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-25T19:56:55.889026] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-25T19:56:55.936086] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T19:56:56.536310] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T19:56:56.603221] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-25T19:56:56.603319] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-25T19:56:56.603521] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-25T19:56:56.603563] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-25T19:56:56.604028] [DEBUG] [LOCAL ] MFAN: Trimmed 5584 records to 4307 (keeping 200 days of data) [2025-09-25T19:56:56.692980] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-25T19:56:56.698216] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:56.700296] [DEBUG] [LOCAL ] MFAN: Primary data saved (4307 records). [2025-09-25T19:56:56.700368] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-25T19:56:56.700509] [INFO ] [MAIN ] Update Progress: 1333/2372 symbols completed. MFAN took 15.8s. Estimated remaining: 2h 17m 53s. Rate: 7.5 symbols/min [2025-09-25T19:56:56.884422] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:56:56.884758] [DEBUG] [LOCAL ] MFG: No existing data file found in primary storage. [2025-09-25T19:56:56.884815] [WARN ] [MAIN ] MFG: No existing data found, performing full refresh instead. [2025-09-25T19:56:56.885157] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-25T19:56:56.885216] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-25T19:56:56.885262] [DEBUG] [LOCAL ] MFG: No primary data file found to delete. [2025-09-25T19:56:56.885306] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-25T19:56:57.262359] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:56:57.488733] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-25T19:56:58.288791] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-25T19:56:58.411884] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:56:58.849100] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T19:56:59.088734] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-25T19:56:59.135905] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T19:56:59.888776] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-25T19:57:00.688692] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-25T19:57:00.789170] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T19:57:01.265071] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T19:57:01.281477] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T19:57:01.488746] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-25T19:57:02.288796] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-25T19:57:02.745918] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T19:57:03.097938] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-25T19:57:03.106265] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T19:57:03.715189] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T19:57:03.888750] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-25T19:57:04.480603] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T19:57:04.688759] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-25T19:57:05.312064] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T19:57:05.488748] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-25T19:57:06.288712] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-25T19:57:06.842788] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T19:57:07.082565] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T19:57:07.089443] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-25T19:57:07.888790] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-25T19:57:08.477363] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T19:57:08.689088] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-25T19:57:08.696710] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T19:57:09.488823] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-25T19:57:10.083318] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T19:57:10.084544] [INFO ] [REMOTE ] MFAO: Full fetch complete (5217 records). [2025-09-25T19:57:10.084713] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-25T19:57:10.289874] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-25T19:57:10.415211] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T19:57:10.537847] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-25T19:57:10.537954] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-25T19:57:10.538161] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-25T19:57:10.538202] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-25T19:57:10.538676] [DEBUG] [LOCAL ] MFAO: Trimmed 5217 records to 3826 (keeping 200 days of data) [2025-09-25T19:57:10.565786] [DEBUG] [LOCAL ] MFAO: Primary data saved (3826 records). [2025-09-25T19:57:10.565938] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-25T19:57:10.566094] [INFO ] [MAIN ] Update Progress: 1334/2372 symbols completed. MFAO took 18.9s. Estimated remaining: 2h 17m 49s. Rate: 7.5 symbols/min [2025-09-25T19:57:10.744450] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:10.770429] [DEBUG] [LOCAL ] MFM: Loaded 14184 existing records from primary storage. [2025-09-25T19:57:10.770586] [INFO ] [MAIN ] MFM: Loaded 14184 existing records. [2025-09-25T19:57:10.951317] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:57:10.951903] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-25T19:57:10.951965] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-25T19:57:10.952243] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-25T19:57:10.952303] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-25T19:57:11.094741] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-25T19:57:11.340907] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:11.888764] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-25T19:57:12.057678] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T19:57:12.688702] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-25T19:57:12.736163] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T19:57:13.488749] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-25T19:57:13.740826] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T19:57:13.751314] [INFO ] [REMOTE ] MFA: Full fetch complete (64881 records). [2025-09-25T19:57:13.751472] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-25T19:57:14.210953] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-25T19:57:14.211144] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-25T19:57:14.212556] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-25T19:57:14.212622] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-25T19:57:14.214408] [DEBUG] [LOCAL ] MFA: Trimmed 64881 records to 45667 (keeping 200 days of data) [2025-09-25T19:57:14.298443] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-25T19:57:14.447702] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T19:57:14.567789] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T19:57:14.602408] [DEBUG] [LOCAL ] MFA: Primary data saved (45667 records). [2025-09-25T19:57:14.602626] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-25T19:57:14.602877] [INFO ] [MAIN ] Update Progress: 1335/2372 symbols completed. MFA took 49.0s. Estimated remaining: 2h 17m 38s. Rate: 7.5 symbols/min [2025-09-25T19:57:14.785362] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:14.785594] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-25T19:57:14.785634] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-25T19:57:14.785870] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-25T19:57:14.785915] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-25T19:57:14.785958] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-25T19:57:14.785991] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-25T19:57:15.094753] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-25T19:57:15.182179] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:15.860986] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T19:57:15.888690] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-25T19:57:16.200551] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T19:57:16.688801] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-25T19:57:17.482263] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T19:57:17.501963] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-25T19:57:17.521504] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T19:57:18.288812] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-25T19:57:18.729539] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T19:57:19.088808] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-25T19:57:19.303683] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T19:57:19.425295] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-25T19:57:19.888784] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-25T19:57:20.688756] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-25T19:57:20.731978] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T19:57:21.488757] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-25T19:57:22.299771] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-25T19:57:22.335605] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T19:57:22.614870] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T19:57:23.088742] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-25T19:57:23.888699] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-25T19:57:23.993593] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T19:57:24.688767] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-25T19:57:24.735526] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T19:57:24.916479] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T19:57:24.950792] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-25T19:57:25.488788] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-25T19:57:25.760702] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-25T19:57:26.288761] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-25T19:57:26.646429] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-25T19:57:27.088868] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-25T19:57:27.888878] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-25T19:57:28.154505] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-25T19:57:28.688700] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-25T19:57:28.736278] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T19:57:29.488797] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-25T19:57:30.288682] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-25T19:57:30.450575] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:57:30.481693] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T19:57:30.624361] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-25T19:57:31.088873] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-25T19:57:31.888806] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-25T19:57:32.243609] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-25T19:57:32.688777] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-25T19:57:32.901233] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T19:57:32.911463] [INFO ] [REMOTE ] MFC: Full fetch complete (74263 records). [2025-09-25T19:57:32.911798] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-25T19:57:33.377255] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-25T19:57:33.377429] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-25T19:57:33.379199] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-25T19:57:33.379323] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-25T19:57:33.382412] [DEBUG] [LOCAL ] MFC: Trimmed 74263 records to 51660 (keeping 200 days of data) [2025-09-25T19:57:33.504210] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-25T19:57:33.749614] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T19:57:33.775021] [DEBUG] [LOCAL ] MFC: Primary data saved (51660 records). [2025-09-25T19:57:33.775198] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-25T19:57:33.775395] [INFO ] [MAIN ] Update Progress: 1336/2372 symbols completed. MFC took 38.4s. Estimated remaining: 2h 17m 39s. Rate: 7.5 symbols/min [2025-09-25T19:57:33.964012] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:33.979209] [DEBUG] [LOCAL ] MFSG: Loaded 5158 existing records from primary storage. [2025-09-25T19:57:33.979393] [INFO ] [MAIN ] MFSG: Loaded 5158 existing records. [2025-09-25T19:57:34.018086] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T19:57:34.172798] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:57:34.173602] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-25T19:57:34.173700] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-25T19:57:34.174031] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-25T19:57:34.174118] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-25T19:57:34.293785] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-25T19:57:34.587042] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:35.088693] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-25T19:57:35.268565] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T19:57:35.888739] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-25T19:57:36.690307] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-25T19:57:36.706779] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T19:57:36.792558] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T19:57:36.797046] [INFO ] [REMOTE ] MFM: Full fetch complete (19214 records). [2025-09-25T19:57:36.797141] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-25T19:57:37.130202] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T19:57:37.173513] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-25T19:57:37.173586] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-25T19:57:37.174165] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-25T19:57:37.174228] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-25T19:57:37.175741] [DEBUG] [LOCAL ] MFM: Trimmed 19214 records to 14330 (keeping 200 days of data) [2025-09-25T19:57:37.276964] [DEBUG] [LOCAL ] MFM: Primary data saved (14330 records). [2025-09-25T19:57:37.277142] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-25T19:57:37.277354] [INFO ] [MAIN ] Update Progress: 1337/2372 symbols completed. MFM took 26.7s. Estimated remaining: 2h 17m 28s. Rate: 7.5 symbols/min [2025-09-25T19:57:37.446609] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:37.468447] [DEBUG] [LOCAL ] MFSI: Loaded 11144 existing records from primary storage. [2025-09-25T19:57:37.468676] [INFO ] [MAIN ] MFSI: Loaded 11144 existing records. [2025-09-25T19:57:37.492702] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-25T19:57:37.656687] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:57:37.657190] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-25T19:57:37.657240] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-25T19:57:37.657605] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-25T19:57:37.657701] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-25T19:57:38.018510] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:38.288719] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-25T19:57:38.716942] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T19:57:39.088722] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-25T19:57:39.216175] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T19:57:39.225554] [INFO ] [REMOTE ] MFG: Full fetch complete (68590 records). [2025-09-25T19:57:39.225786] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-25T19:57:39.640503] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T19:57:39.738525] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-25T19:57:39.738635] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-25T19:57:39.739956] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-25T19:57:39.740023] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-25T19:57:39.741849] [DEBUG] [LOCAL ] MFG: Trimmed 68590 records to 49399 (keeping 200 days of data) [2025-09-25T19:57:39.923453] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-25T19:57:40.059724] [DEBUG] [LOCAL ] MFG: Primary data saved (49399 records). [2025-09-25T19:57:40.059940] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-25T19:57:40.060040] [INFO ] [MAIN ] Update Progress: 1338/2372 symbols completed. MFG took 43.4s. Estimated remaining: 2h 17m 16s. Rate: 7.5 symbols/min [2025-09-25T19:57:40.236620] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:40.244688] [DEBUG] [LOCAL ] MFSV: Loaded 2435 existing records from primary storage. [2025-09-25T19:57:40.244803] [INFO ] [MAIN ] MFSV: Loaded 2435 existing records. [2025-09-25T19:57:40.417839] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T19:57:40.439192] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:57:40.439537] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-25T19:57:40.439586] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-25T19:57:40.439891] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-25T19:57:40.439954] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-25T19:57:40.690979] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-25T19:57:40.817343] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:41.295899] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T19:57:41.297314] [INFO ] [REMOTE ] MFSB: Full fetch complete (1595 records). [2025-09-25T19:57:41.297388] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-25T19:57:41.493847] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-25T19:57:41.502290] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-25T19:57:41.502607] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:57:41.502845] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:57:41.502928] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-25T19:57:41.503015] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-25T19:57:41.503071] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-25T19:57:41.503129] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-25T19:57:41.503691] [INFO ] [MAIN ] Update Progress: 1339/2372 symbols completed. MFSB took 26.9s. Estimated remaining: 2h 17m 3s. Rate: 7.5 symbols/min [2025-09-25T19:57:41.688436] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:57:41.725851] [DEBUG] [LOCAL ] MG: Loaded 16674 existing records from primary storage. [2025-09-25T19:57:41.726020] [INFO ] [MAIN ] MG: Loaded 16674 existing records. [2025-09-25T19:57:41.917248] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:57:41.917603] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-25T19:57:41.917677] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-25T19:57:41.917983] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-25T19:57:41.918047] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-25T19:57:42.028479] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T19:57:42.299759] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-25T19:57:42.307326] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:57:42.646812] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-25T19:57:43.088712] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-25T19:57:43.433848] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T19:57:43.888748] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-25T19:57:44.316998] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T19:57:44.688768] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-25T19:57:45.258747] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T19:57:45.488747] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-25T19:57:46.069054] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T19:57:46.288751] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-25T19:57:46.728272] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T19:57:47.088733] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-25T19:57:47.525811] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T19:57:47.888764] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-25T19:57:48.455171] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T19:57:48.688743] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-25T19:57:49.263928] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T19:57:49.488740] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-25T19:57:50.288768] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-25T19:57:51.088964] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-25T19:57:51.671876] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T19:57:51.888711] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-25T19:57:51.914848] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-25T19:57:52.603629] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T19:57:52.688714] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-25T19:57:52.783772] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T19:57:52.966292] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-25T19:57:53.488743] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-25T19:57:54.244288] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T19:57:54.288681] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-25T19:57:55.088709] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-25T19:57:55.325268] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T19:57:55.558900] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T19:57:55.888727] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-25T19:57:56.496466] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T19:57:56.688798] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-25T19:57:57.488701] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-25T19:57:57.618848] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T19:57:57.944427] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T19:57:58.288721] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-25T19:57:58.920864] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T19:57:59.088716] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-25T19:57:59.736676] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T19:57:59.739149] [INFO ] [REMOTE ] MFSG: Full fetch complete (5899 records). [2025-09-25T19:57:59.739406] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-25T19:57:59.893823] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-25T19:58:00.157586] [DEBUG] [VALIDATOR ] MFSG: All expected trading days are present. [2025-09-25T19:58:00.157763] [DEBUG] [VALIDATOR ] MFSG: Primary data validation passed. [2025-09-25T19:58:00.158047] [INFO ] [MAIN ] MFSG: Fetched primary data is valid. [2025-09-25T19:58:00.158175] [DEBUG] [LOCAL ] MFSG: Saving primary data. [2025-09-25T19:58:00.158719] [DEBUG] [LOCAL ] MFSG: Trimmed 5899 records to 5222 (keeping 200 days of data) [2025-09-25T19:58:00.204698] [DEBUG] [LOCAL ] MFSG: Primary data saved (5222 records). [2025-09-25T19:58:00.204893] [INFO ] [MAIN ] MFSG: Full history saved. [2025-09-25T19:58:00.205170] [INFO ] [MAIN ] Update Progress: 1340/2372 symbols completed. MFSG took 26.4s. Estimated remaining: 2h 17m 3s. Rate: 7.5 symbols/min [2025-09-25T19:58:00.382209] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:00.497952] [DEBUG] [LOCAL ] MGA: Loaded 50648 existing records from primary storage. [2025-09-25T19:58:00.498163] [INFO ] [MAIN ] MGA: Loaded 50648 existing records. [2025-09-25T19:58:00.688747] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-25T19:58:00.688574] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:00.690932] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-25T19:58:00.691033] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-25T19:58:00.691458] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-25T19:58:00.691550] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-25T19:58:01.085755] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:01.089983] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T19:58:01.488756] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-25T19:58:02.288784] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-25T19:58:03.088789] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-25T19:58:03.227085] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-25T19:58:03.481716] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-25T19:58:03.516335] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T19:58:03.888701] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-25T19:58:04.149303] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-25T19:58:04.588759] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T19:58:04.591695] [INFO ] [REMOTE ] MFSV: Full fetch complete (3086 records). [2025-09-25T19:58:04.591951] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-25T19:58:04.689985] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-25T19:58:04.980218] [DEBUG] [VALIDATOR ] MFSV: All expected trading days are present. [2025-09-25T19:58:04.980352] [DEBUG] [VALIDATOR ] MFSV: Primary data validation passed. [2025-09-25T19:58:04.980522] [INFO ] [MAIN ] MFSV: Fetched primary data is valid. [2025-09-25T19:58:04.980564] [DEBUG] [LOCAL ] MFSV: Saving primary data. [2025-09-25T19:58:04.980961] [DEBUG] [LOCAL ] MFSV: Trimmed 3086 records to 2484 (keeping 200 days of data) [2025-09-25T19:58:04.998539] [DEBUG] [LOCAL ] MFSV: Primary data saved (2484 records). [2025-09-25T19:58:04.998603] [INFO ] [MAIN ] MFSV: Full history saved. [2025-09-25T19:58:04.998766] [INFO ] [MAIN ] Update Progress: 1341/2372 symbols completed. MFSV took 24.9s. Estimated remaining: 2h 16m 53s. Rate: 7.5 symbols/min [2025-09-25T19:58:05.173824] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:05.193438] [DEBUG] [LOCAL ] MGF: Loaded 4107 existing records from primary storage. [2025-09-25T19:58:05.193580] [INFO ] [MAIN ] MGF: Loaded 4107 existing records. [2025-09-25T19:58:05.374704] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:05.375208] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-25T19:58:05.375288] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-25T19:58:05.375515] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-25T19:58:05.375593] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-25T19:58:05.493787] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-25T19:58:05.675573] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T19:58:05.787607] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:06.288727] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-25T19:58:07.088720] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-25T19:58:07.216983] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T19:58:07.343973] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T19:58:07.347876] [INFO ] [REMOTE ] MFSI: Full fetch complete (13319 records). [2025-09-25T19:58:07.347958] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-25T19:58:07.573725] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-25T19:58:07.762787] [DEBUG] [VALIDATOR ] MFSI: All expected trading days are present. [2025-09-25T19:58:07.762884] [DEBUG] [VALIDATOR ] MFSI: Primary data validation passed. [2025-09-25T19:58:07.763356] [INFO ] [MAIN ] MFSI: Fetched primary data is valid. [2025-09-25T19:58:07.763417] [DEBUG] [LOCAL ] MFSI: Saving primary data. [2025-09-25T19:58:07.763989] [DEBUG] [LOCAL ] MFSI: Trimmed 13319 records to 11262 (keeping 200 days of data) [2025-09-25T19:58:07.876799] [DEBUG] [LOCAL ] MFSI: Primary data saved (11262 records). [2025-09-25T19:58:07.876974] [INFO ] [MAIN ] MFSI: Full history saved. [2025-09-25T19:58:07.877214] [INFO ] [MAIN ] Update Progress: 1342/2372 symbols completed. MFSI took 30.6s. Estimated remaining: 2h 16m 41s. Rate: 7.5 symbols/min [2025-09-25T19:58:07.893516] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-25T19:58:08.053347] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:08.159197] [DEBUG] [LOCAL ] MGM: Loaded 53608 existing records from primary storage. [2025-09-25T19:58:08.159427] [INFO ] [MAIN ] MGM: Loaded 53608 existing records. [2025-09-25T19:58:08.350081] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:08.352906] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-25T19:58:08.352969] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-25T19:58:08.353278] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-25T19:58:08.353338] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-25T19:58:08.713833] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-25T19:58:08.725114] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:09.300868] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T19:58:09.488718] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-25T19:58:09.529526] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T19:58:09.988377] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T19:58:10.288739] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-25T19:58:11.088711] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-25T19:58:11.807317] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T19:58:11.888754] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-25T19:58:12.688760] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-25T19:58:12.832421] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-25T19:58:13.451723] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T19:58:13.488795] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-25T19:58:14.288723] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-25T19:58:14.572213] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T19:58:14.819143] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-25T19:58:15.088751] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-25T19:58:15.888703] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-25T19:58:16.104549] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T19:58:16.181747] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T19:58:16.688740] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-25T19:58:17.488710] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-25T19:58:17.623488] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T19:58:18.099860] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T19:58:18.288745] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-25T19:58:18.581046] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T19:58:18.871681] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T19:58:19.088713] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-25T19:58:19.888736] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-25T19:58:20.688702] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-25T19:58:20.928289] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T19:58:21.070348] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T19:58:21.271209] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-25T19:58:21.488795] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-25T19:58:22.288718] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-25T19:58:23.088722] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-25T19:58:23.316153] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T19:58:23.341472] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T19:58:23.774864] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T19:58:23.888764] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-25T19:58:24.688875] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-25T19:58:25.388682] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T19:58:25.390962] [INFO ] [REMOTE ] MGF: Full fetch complete (5847 records). [2025-09-25T19:58:25.391264] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-25T19:58:25.491033] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-25T19:58:25.821200] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-25T19:58:25.821352] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-25T19:58:25.821570] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-25T19:58:25.821681] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-25T19:58:25.822104] [DEBUG] [LOCAL ] MGF: Trimmed 5847 records to 4173 (keeping 200 days of data) [2025-09-25T19:58:25.901726] [DEBUG] [LOCAL ] MGF: Primary data saved (4173 records). [2025-09-25T19:58:25.901936] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-25T19:58:25.902229] [INFO ] [MAIN ] Update Progress: 1343/2372 symbols completed. MGF took 20.9s. Estimated remaining: 2h 16m 40s. Rate: 7.5 symbols/min [2025-09-25T19:58:25.924965] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T19:58:26.126148] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:26.141268] [DEBUG] [LOCAL ] MGR: Loaded 5627 existing records from primary storage. [2025-09-25T19:58:26.141419] [INFO ] [MAIN ] MGR: Loaded 5627 existing records. [2025-09-25T19:58:26.300964] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-25T19:58:26.360059] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:26.360472] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-25T19:58:26.360544] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-25T19:58:26.361570] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-25T19:58:26.361690] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-25T19:58:26.748943] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:27.088948] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-25T19:58:27.314576] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T19:58:27.341581] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T19:58:27.802547] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T19:58:27.888698] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-25T19:58:28.688833] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-25T19:58:29.488784] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-25T19:58:29.689095] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T19:58:30.288889] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-25T19:58:30.376457] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T19:58:30.417500] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T19:58:31.088788] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-25T19:58:31.334203] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T19:58:31.338310] [INFO ] [REMOTE ] MG: Full fetch complete (24028 records). [2025-09-25T19:58:31.338478] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-25T19:58:31.758503] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-25T19:58:31.758637] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-25T19:58:31.759377] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-25T19:58:31.759441] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-25T19:58:31.761335] [DEBUG] [LOCAL ] MG: Trimmed 24028 records to 16756 (keeping 200 days of data) [2025-09-25T19:58:31.876194] [DEBUG] [LOCAL ] MG: Primary data saved (16756 records). [2025-09-25T19:58:31.876393] [INFO ] [MAIN ] MG: Full history saved. [2025-09-25T19:58:31.876628] [INFO ] [MAIN ] Update Progress: 1344/2372 symbols completed. MG took 50.4s. Estimated remaining: 2h 16m 31s. Rate: 7.5 symbols/min [2025-09-25T19:58:31.893121] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-25T19:58:32.070575] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:32.088323] [DEBUG] [LOCAL ] MGRB: Loaded 4080 existing records from primary storage. [2025-09-25T19:58:32.088439] [INFO ] [MAIN ] MGRB: Loaded 4080 existing records. [2025-09-25T19:58:32.268901] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:32.269353] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-25T19:58:32.269414] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-25T19:58:32.269773] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-25T19:58:32.269862] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-25T19:58:32.637101] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:32.688673] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-25T19:58:33.093764] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T19:58:33.113496] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-25T19:58:33.488703] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-25T19:58:33.586370] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T19:58:34.099168] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T19:58:34.288982] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-25T19:58:35.091876] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-25T19:58:35.094991] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T19:58:35.888821] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-25T19:58:36.485804] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T19:58:36.688740] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-25T19:58:36.803891] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T19:58:37.323528] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T19:58:37.488717] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-25T19:58:38.288726] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-25T19:58:38.853298] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T19:58:39.088731] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-25T19:58:39.404697] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T19:58:39.458819] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-25T19:58:39.888766] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-25T19:58:40.688759] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-25T19:58:41.488698] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-25T19:58:41.678712] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T19:58:41.690186] [INFO ] [REMOTE ] MGA: Full fetch complete (73697 records). [2025-09-25T19:58:41.690372] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-25T19:58:41.845069] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-25T19:58:42.099838] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-25T19:58:42.099954] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-25T19:58:42.101262] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-25T19:58:42.101330] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-25T19:58:42.103127] [DEBUG] [LOCAL ] MGA: Trimmed 73697 records to 51028 (keeping 200 days of data) [2025-09-25T19:58:42.298326] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-25T19:58:42.464502] [DEBUG] [LOCAL ] MGA: Primary data saved (51028 records). [2025-09-25T19:58:42.464696] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-25T19:58:42.464937] [INFO ] [MAIN ] Update Progress: 1345/2372 symbols completed. MGA took 42.3s. Estimated remaining: 2h 16m 25s. Rate: 7.5 symbols/min [2025-09-25T19:58:42.680227] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:42.698627] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T19:58:42.711927] [INFO ] [REMOTE ] MGM: Full fetch complete (77601 records). [2025-09-25T19:58:42.712230] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-25T19:58:42.723707] [DEBUG] [LOCAL ] MGRD: Loaded 2214 existing records from primary storage. [2025-09-25T19:58:42.723871] [INFO ] [MAIN ] MGRD: Loaded 2214 existing records. [2025-09-25T19:58:42.974423] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T19:58:43.105880] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-25T19:58:43.138045] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:43.138561] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-25T19:58:43.138888] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-25T19:58:43.139162] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-25T19:58:43.139246] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-25T19:58:43.658883] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-25T19:58:43.658991] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-25T19:58:43.660433] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-25T19:58:43.660513] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-25T19:58:43.671314] [DEBUG] [LOCAL ] MGM: Trimmed 77601 records to 53998 (keeping 200 days of data) [2025-09-25T19:58:43.854112] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T19:58:43.893047] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-25T19:58:43.918365] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:44.141539] [DEBUG] [LOCAL ] MGM: Primary data saved (53998 records). [2025-09-25T19:58:44.141736] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-25T19:58:44.143099] [INFO ] [MAIN ] Update Progress: 1346/2372 symbols completed. MGM took 36.3s. Estimated remaining: 2h 16m 12s. Rate: 7.5 symbols/min [2025-09-25T19:58:44.338476] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:44.353388] [DEBUG] [LOCAL ] MGRE: Loaded 6620 existing records from primary storage. [2025-09-25T19:58:44.353523] [INFO ] [MAIN ] MGRE: Loaded 6620 existing records. [2025-09-25T19:58:44.540938] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:44.541260] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-25T19:58:44.541306] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-25T19:58:44.541616] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-25T19:58:44.541706] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-25T19:58:44.673937] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T19:58:44.693787] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-25T19:58:44.924797] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:45.388746] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T19:58:45.488720] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-25T19:58:46.167703] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T19:58:46.288758] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-25T19:58:46.948413] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T19:58:47.088762] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-25T19:58:47.796047] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T19:58:47.798422] [INFO ] [REMOTE ] MGR: Full fetch complete (8342 records). [2025-09-25T19:58:47.798511] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-25T19:58:47.892125] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-25T19:58:48.207622] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-25T19:58:48.207751] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-25T19:58:48.208074] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-25T19:58:48.208115] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-25T19:58:48.208982] [DEBUG] [LOCAL ] MGR: Trimmed 8342 records to 5649 (keeping 200 days of data) [2025-09-25T19:58:48.245112] [DEBUG] [LOCAL ] MGR: Primary data saved (5649 records). [2025-09-25T19:58:48.245323] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-25T19:58:48.245459] [INFO ] [MAIN ] Update Progress: 1347/2372 symbols completed. MGR took 22.3s. Estimated remaining: 2h 16m 1s. Rate: 7.5 symbols/min [2025-09-25T19:58:48.431615] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:58:48.513171] [DEBUG] [LOCAL ] MGY: Loaded 52423 existing records from primary storage. [2025-09-25T19:58:48.513351] [INFO ] [MAIN ] MGY: Loaded 52423 existing records. [2025-09-25T19:58:48.599750] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T19:58:48.710356] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:58:48.710633] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-25T19:58:48.710838] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-25T19:58:48.711215] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-25T19:58:48.711275] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-25T19:58:48.705781] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-25T19:58:49.097501] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:58:49.488738] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-25T19:58:49.512915] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T19:58:49.963345] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T19:58:50.288729] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-25T19:58:50.881113] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T19:58:51.088766] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-25T19:58:51.813197] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T19:58:51.888692] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-25T19:58:52.486863] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T19:58:52.688936] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-25T19:58:53.375335] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T19:58:53.488722] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-25T19:58:54.199583] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T19:58:54.288729] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-25T19:58:54.765725] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T19:58:55.088730] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-25T19:58:55.558279] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-25T19:58:55.888802] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-25T19:58:56.688779] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-25T19:58:57.252313] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T19:58:57.488738] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-25T19:58:57.576407] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T19:58:57.840497] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-25T19:58:58.288743] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-25T19:58:59.088951] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-25T19:58:59.500846] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T19:58:59.572301] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-25T19:58:59.888827] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-25T19:59:00.688845] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-25T19:59:01.299227] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T19:59:01.488715] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-25T19:59:01.833538] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T19:59:01.997898] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T19:59:02.288813] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-25T19:59:02.949910] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T19:59:03.088785] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-25T19:59:03.644542] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T19:59:03.646395] [INFO ] [REMOTE ] MGRB: Full fetch complete (6291 records). [2025-09-25T19:59:03.646548] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-25T19:59:03.894984] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-25T19:59:04.078946] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-25T19:59:04.079072] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-25T19:59:04.079346] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-25T19:59:04.079464] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-25T19:59:04.080016] [DEBUG] [LOCAL ] MGRB: Trimmed 6291 records to 4096 (keeping 200 days of data) [2025-09-25T19:59:04.112203] [DEBUG] [LOCAL ] MGRB: Primary data saved (4096 records). [2025-09-25T19:59:04.112334] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-25T19:59:04.112702] [INFO ] [MAIN ] Update Progress: 1348/2372 symbols completed. MGRB took 32.2s. Estimated remaining: 2h 15m 59s. Rate: 7.5 symbols/min [2025-09-25T19:59:04.306580] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:04.306901] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-25T19:59:04.306958] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-25T19:59:04.307933] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-25T19:59:04.308022] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-25T19:59:04.308095] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-25T19:59:04.308168] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-25T19:59:04.449320] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T19:59:04.693803] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-25T19:59:04.728917] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:05.168488] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T19:59:05.488715] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-25T19:59:06.258604] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T19:59:06.288694] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-25T19:59:07.088729] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-25T19:59:07.612016] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-25T19:59:07.616128] [INFO ] [REMOTE ] MGRD: Full fetch complete (3482 records). [2025-09-25T19:59:07.616249] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-25T19:59:07.893826] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-25T19:59:08.064499] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T19:59:08.121662] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-25T19:59:08.121772] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-25T19:59:08.121928] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-25T19:59:08.121973] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-25T19:59:08.122347] [DEBUG] [LOCAL ] MGRD: Trimmed 3482 records to 2222 (keeping 200 days of data) [2025-09-25T19:59:08.140013] [DEBUG] [LOCAL ] MGRD: Primary data saved (2222 records). [2025-09-25T19:59:08.140109] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-25T19:59:08.140360] [INFO ] [MAIN ] Update Progress: 1349/2372 symbols completed. MGRD took 25.7s. Estimated remaining: 2h 15m 48s. Rate: 7.5 symbols/min [2025-09-25T19:59:08.315090] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:08.354567] [DEBUG] [LOCAL ] MHD: Loaded 12114 existing records from primary storage. [2025-09-25T19:59:08.354783] [INFO ] [MAIN ] MHD: Loaded 12114 existing records. [2025-09-25T19:59:08.570632] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:59:08.570968] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-25T19:59:08.571019] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-25T19:59:08.571370] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-25T19:59:08.571433] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-25T19:59:08.657813] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T19:59:08.775737] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-25T19:59:08.993524] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:08.994051] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-25T19:59:09.054233] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:09.488735] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-25T19:59:10.226043] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T19:59:10.230482] [INFO ] [REMOTE ] MGRE: Full fetch complete (9391 records). [2025-09-25T19:59:10.230561] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-25T19:59:10.291067] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-25T19:59:10.619074] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-25T19:59:10.619164] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-25T19:59:10.619476] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-25T19:59:10.619518] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-25T19:59:10.620385] [DEBUG] [LOCAL ] MGRE: Trimmed 9391 records to 6653 (keeping 200 days of data) [2025-09-25T19:59:10.668837] [DEBUG] [LOCAL ] MGRE: Primary data saved (6653 records). [2025-09-25T19:59:10.668974] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-25T19:59:10.669080] [INFO ] [MAIN ] Update Progress: 1350/2372 symbols completed. MGRE took 26.5s. Estimated remaining: 2h 15m 36s. Rate: 7.5 symbols/min [2025-09-25T19:59:10.849385] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:10.869587] [DEBUG] [LOCAL ] MHF: Loaded 8635 existing records from primary storage. [2025-09-25T19:59:10.869783] [INFO ] [MAIN ] MHF: Loaded 8635 existing records. [2025-09-25T19:59:11.058315] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:59:11.059510] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-25T19:59:11.059563] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-25T19:59:11.059895] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-25T19:59:11.059958] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-25T19:59:11.093844] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-25T19:59:11.345354] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:11.345814] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-25T19:59:11.454544] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:11.888738] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-25T19:59:12.089216] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:12.090802] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-25T19:59:12.131802] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T19:59:12.688730] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-25T19:59:13.488763] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-25T19:59:13.686666] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:13.687165] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-25T19:59:14.288695] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-25T19:59:14.482054] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T19:59:15.088770] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-25T19:59:15.123720] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T19:59:15.318537] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:15.318941] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-25T19:59:15.888727] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-25T19:59:16.101512] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:16.101921] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-25T19:59:16.688731] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-25T19:59:16.891202] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T19:59:16.891624] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-25T19:59:17.488745] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-25T19:59:18.288744] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-25T19:59:19.088737] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-25T19:59:19.163007] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T19:59:19.211407] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T19:59:19.888773] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-25T19:59:19.901057] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T19:59:20.688790] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-25T19:59:20.968110] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T19:59:21.488855] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-25T19:59:22.179211] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T19:59:22.293818] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-25T19:59:22.296747] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T19:59:23.088900] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-25T19:59:23.758962] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-25T19:59:23.767605] [INFO ] [REMOTE ] MH: Full fetch complete (12556 records). [2025-09-25T19:59:23.767786] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-25T19:59:23.889690] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-25T19:59:23.913203] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T19:59:24.030202] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-25T19:59:24.031016] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-25T19:59:24.031154] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-25T19:59:24.031331] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-25T19:59:24.031491] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-25T19:59:24.031566] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-25T19:59:24.031741] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-25T19:59:24.031951] [INFO ] [MAIN ] Update Progress: 1351/2372 symbols completed. MH took 19.9s. Estimated remaining: 2h 15m 32s. Rate: 7.5 symbols/min [2025-09-25T19:59:24.251566] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:24.333680] [DEBUG] [LOCAL ] MHK: Loaded 42535 existing records from primary storage. [2025-09-25T19:59:24.333877] [INFO ] [MAIN ] MHK: Loaded 42535 existing records. [2025-09-25T19:59:24.621026] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:59:24.621667] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-25T19:59:24.621749] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-25T19:59:24.622618] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-25T19:59:24.622737] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-25T19:59:24.690257] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-25T19:59:24.925185] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T19:59:25.189773] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:25.488725] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-25T19:59:25.535359] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T19:59:26.288706] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-25T19:59:26.987638] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T19:59:27.019089] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T19:59:27.088794] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-25T19:59:27.888819] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-25T19:59:28.690272] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-25T19:59:28.691688] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T19:59:28.807599] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T19:59:29.488752] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-25T19:59:29.575967] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T19:59:30.288756] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-25T19:59:31.078680] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T19:59:31.088694] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-25T19:59:31.253127] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T19:59:31.839755] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T19:59:31.888893] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-25T19:59:32.688840] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-25T19:59:32.837568] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T19:59:33.488820] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-25T19:59:34.279558] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T19:59:34.288982] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-25T19:59:35.088707] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-25T19:59:35.194247] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T19:59:35.197227] [INFO ] [REMOTE ] MHF: Full fetch complete (12789 records). [2025-09-25T19:59:35.197387] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-25T19:59:35.631012] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-25T19:59:35.631143] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-25T19:59:35.631605] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-25T19:59:35.631708] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-25T19:59:35.632697] [DEBUG] [LOCAL ] MHF: Trimmed 12789 records to 8678 (keeping 200 days of data) [2025-09-25T19:59:35.734694] [DEBUG] [LOCAL ] MHF: Primary data saved (8678 records). [2025-09-25T19:59:35.734841] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-25T19:59:35.734981] [INFO ] [MAIN ] Update Progress: 1352/2372 symbols completed. MHF took 25.1s. Estimated remaining: 2h 15m 27s. Rate: 7.5 symbols/min [2025-09-25T19:59:35.744286] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T19:59:35.755372] [INFO ] [REMOTE ] MGY: Full fetch complete (75552 records). [2025-09-25T19:59:35.755550] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-25T19:59:35.853735] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T19:59:35.896768] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-25T19:59:36.121944] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:36.122588] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-25T19:59:36.139161] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-25T19:59:36.139441] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-25T19:59:36.139535] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-25T19:59:36.139607] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-25T19:59:36.139718] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-25T19:59:36.686713] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-25T19:59:36.687139] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-25T19:59:36.688489] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-25T19:59:36.688568] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-25T19:59:36.688846] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-25T19:59:36.737974] [DEBUG] [LOCAL ] MGY: Trimmed 75552 records to 52808 (keeping 200 days of data) [2025-09-25T19:59:36.843828] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T19:59:37.204592] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:37.250363] [DEBUG] [LOCAL ] MGY: Primary data saved (52808 records). [2025-09-25T19:59:37.250609] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-25T19:59:37.252157] [INFO ] [MAIN ] Update Progress: 1353/2372 symbols completed. MGY took 49.0s. Estimated remaining: 2h 15m 15s. Rate: 7.5 symbols/min [2025-09-25T19:59:37.436708] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:37.459487] [DEBUG] [LOCAL ] MHN: Loaded 7802 existing records from primary storage. [2025-09-25T19:59:37.459713] [INFO ] [MAIN ] MHN: Loaded 7802 existing records. [2025-09-25T19:59:37.493829] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-25T19:59:37.667018] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:59:37.668461] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-25T19:59:37.668514] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-25T19:59:37.668824] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-25T19:59:37.668915] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-25T19:59:38.065475] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:38.211927] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T19:59:38.271635] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T19:59:38.288673] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-25T19:59:39.088987] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-25T19:59:39.096423] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T19:59:39.888738] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-25T19:59:39.959454] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T19:59:40.246973] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T19:59:40.688728] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-25T19:59:41.463774] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T19:59:41.488679] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-25T19:59:42.287797] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T19:59:42.288809] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-25T19:59:43.088767] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-25T19:59:43.829843] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T19:59:43.888709] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-25T19:59:43.930848] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T19:59:44.688727] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-25T19:59:45.438149] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T19:59:45.488717] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-25T19:59:45.577194] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T19:59:46.288725] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-25T19:59:46.641759] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T19:59:47.093832] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-25T19:59:47.111068] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T19:59:47.888712] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-25T19:59:47.988565] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T19:59:48.258047] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-25T19:59:48.688753] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-25T19:59:49.036250] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-25T19:59:49.488965] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-25T19:59:50.288882] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-25T19:59:50.377277] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T19:59:51.088868] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-25T19:59:51.798632] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T19:59:51.819577] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-25T19:59:51.888680] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-25T19:59:52.688740] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-25T19:59:53.302580] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T19:59:53.493193] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-25T19:59:53.503897] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T19:59:54.288763] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-25T19:59:54.299589] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T19:59:55.088950] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-25T19:59:55.887795] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T19:59:55.899709] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-25T19:59:55.943538] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T19:59:55.946025] [INFO ] [REMOTE ] MHN: Full fetch complete (11848 records). [2025-09-25T19:59:55.946160] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-25T19:59:56.379822] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-25T19:59:56.379917] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-25T19:59:56.382182] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-25T19:59:56.382375] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-25T19:59:56.382995] [DEBUG] [LOCAL ] MHN: Trimmed 11848 records to 7852 (keeping 200 days of data) [2025-09-25T19:59:56.444173] [DEBUG] [LOCAL ] MHN: Primary data saved (7852 records). [2025-09-25T19:59:56.444323] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-25T19:59:56.444672] [INFO ] [MAIN ] Update Progress: 1354/2372 symbols completed. MHN took 19.2s. Estimated remaining: 2h 15m 15s. Rate: 7.5 symbols/min [2025-09-25T19:59:56.625785] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:56.670525] [DEBUG] [LOCAL ] MHO: Loaded 24357 existing records from primary storage. [2025-09-25T19:59:56.670740] [INFO ] [MAIN ] MHO: Loaded 24357 existing records. [2025-09-25T19:59:56.693853] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-25T19:59:56.879148] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T19:59:56.879525] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-25T19:59:56.879591] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-25T19:59:56.880102] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-25T19:59:56.880174] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-25T19:59:57.243638] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T19:59:57.488746] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-25T19:59:57.539234] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T19:59:57.549039] [INFO ] [REMOTE ] MHK: Full fetch complete (60852 records). [2025-09-25T19:59:57.549241] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-25T19:59:57.692054] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T19:59:57.725383] [INFO ] [REMOTE ] MHD: Full fetch complete (18772 records). [2025-09-25T19:59:57.725666] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-25T19:59:58.297636] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-25T19:59:58.358688] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-25T19:59:58.358868] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-25T19:59:58.360343] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-25T19:59:58.360431] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-25T19:59:58.374020] [DEBUG] [LOCAL ] MHK: Trimmed 60852 records to 42816 (keeping 200 days of data) [2025-09-25T19:59:58.692443] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T19:59:58.693234] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-25T19:59:58.693284] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-25T19:59:58.693775] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-25T19:59:58.694767] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-25T19:59:58.695424] [DEBUG] [LOCAL ] MHD: Trimmed 18772 records to 12200 (keeping 200 days of data) [2025-09-25T19:59:58.890829] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T19:59:58.923318] [DEBUG] [LOCAL ] MHD: Primary data saved (12200 records). [2025-09-25T19:59:58.923546] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-25T19:59:58.923794] [INFO ] [MAIN ] Update Progress: 1355/2372 symbols completed. MHD took 50.8s. Estimated remaining: 2h 15m 3s. Rate: 7.5 symbols/min [2025-09-25T19:59:59.093112] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-25T19:59:59.166946] [DEBUG] [LOCAL ] MHK: Primary data saved (42816 records). [2025-09-25T19:59:59.167139] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-25T19:59:59.167275] [INFO ] [MAIN ] Update Progress: 1356/2372 symbols completed. MHK took 35.1s. Estimated remaining: 2h 14m 49s. Rate: 7.5 symbols/min [2025-09-25T19:59:59.233898] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:59.234188] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-25T19:59:59.234243] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-25T19:59:59.234451] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-25T19:59:59.234495] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-25T19:59:59.234537] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-25T19:59:59.234582] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-25T19:59:59.592225] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T19:59:59.709827] [DEBUG] [LOCAL ] MIN: Loaded 13147 existing records from primary storage. [2025-09-25T19:59:59.710136] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T19:59:59.755886] [INFO ] [MAIN ] MIN: Loaded 13147 existing records. [2025-09-25T19:59:59.894982] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-25T20:00:00.077350] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:00.163137] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:00.164126] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-25T20:00:00.164189] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-25T20:00:00.164680] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-25T20:00:00.164752] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-25T20:00:00.554697] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:00.688786] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-25T20:00:01.128386] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T20:00:01.318553] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T20:00:01.488741] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-25T20:00:02.288924] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-25T20:00:02.544784] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:02.545258] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-25T20:00:02.975871] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T20:00:03.088753] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-25T20:00:03.888758] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-25T20:00:04.475054] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T20:00:04.688791] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-25T20:00:04.923569] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T20:00:04.924548] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:04.930282] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-25T20:00:05.488734] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-25T20:00:06.288775] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-25T20:00:06.810919] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T20:00:07.061046] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T20:00:07.088735] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-25T20:00:07.888743] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-25T20:00:08.133739] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-25T20:00:08.234479] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T20:00:08.688740] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-25T20:00:09.488690] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-25T20:00:09.827695] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T20:00:09.855306] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-25T20:00:10.288748] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-25T20:00:11.088740] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-25T20:00:11.552665] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-25T20:00:11.553541] [INFO ] [REMOTE ] MHLA: Full fetch complete (1547 records). [2025-09-25T20:00:11.553629] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-25T20:00:11.554280] [FATAL] [VALIDATOR ] MHLA: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:00:11.554384] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:00:11.554499] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:00:11.554587] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-25T20:00:11.554750] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-25T20:00:11.554840] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-25T20:00:11.554950] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-25T20:00:11.555055] [INFO ] [MAIN ] Update Progress: 1357/2372 symbols completed. MHLA took 35.8s. Estimated remaining: 2h 14m 44s. Rate: 7.5 symbols/min [2025-09-25T20:00:11.645284] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T20:00:11.890727] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-25T20:00:12.635441] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T20:00:12.688737] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-25T20:00:12.919498] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:12.919905] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-25T20:00:13.488752] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-25T20:00:14.288781] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-25T20:00:14.494542] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:14.495027] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-25T20:00:14.785130] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T20:00:15.088732] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-25T20:00:15.888745] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-25T20:00:16.117668] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:16.118192] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-25T20:00:16.340281] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:00:16.345862] [INFO ] [REMOTE ] MHO: Full fetch complete (37452 records). [2025-09-25T20:00:16.346060] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-25T20:00:16.696664] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-25T20:00:16.753854] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-25T20:00:16.753974] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-25T20:00:16.755193] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-25T20:00:16.755260] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-25T20:00:16.758350] [DEBUG] [LOCAL ] MHO: Trimmed 37452 records to 24495 (keeping 200 days of data) [2025-09-25T20:00:16.930921] [DEBUG] [LOCAL ] MHO: Primary data saved (24495 records). [2025-09-25T20:00:16.931106] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-25T20:00:16.931256] [INFO ] [MAIN ] Update Progress: 1358/2372 symbols completed. MHO took 20.5s. Estimated remaining: 2h 14m 35s. Rate: 7.5 symbols/min [2025-09-25T20:00:16.955780] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:16.956183] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-25T20:00:17.488866] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-25T20:00:17.706301] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:17.706941] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-25T20:00:18.288937] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-25T20:00:19.088692] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-25T20:00:19.151881] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:00:19.298598] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:00:19.299048] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-25T20:00:19.888751] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-25T20:00:20.688715] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-25T20:00:20.789136] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T20:00:21.488733] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-25T20:00:22.053911] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T20:00:22.288687] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-25T20:00:22.370399] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T20:00:23.088831] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-25T20:00:23.951542] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T20:00:23.959067] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-25T20:00:24.132551] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T20:00:24.142008] [INFO ] [REMOTE ] MIAX: Full fetch complete (9124 records). [2025-09-25T20:00:24.142148] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-25T20:00:24.340999] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-25T20:00:24.342482] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:00:24.342808] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:00:24.343016] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-25T20:00:24.343139] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-25T20:00:24.343215] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-25T20:00:24.343286] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-25T20:00:24.347871] [INFO ] [MAIN ] Update Progress: 1359/2372 symbols completed. MIAX took 25.4s. Estimated remaining: 2h 14m 26s. Rate: 7.5 symbols/min [2025-09-25T20:00:25.054784] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T20:00:25.060453] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-25T20:00:26.002269] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T20:00:26.007208] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-25T20:00:26.931832] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T20:00:26.935573] [INFO ] [REMOTE ] MIN: Full fetch complete (17800 records). [2025-09-25T20:00:26.935705] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-25T20:00:27.323302] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-25T20:00:27.323442] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-25T20:00:27.323970] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-25T20:00:27.324051] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-25T20:00:27.325469] [DEBUG] [LOCAL ] MIN: Trimmed 17800 records to 13198 (keeping 200 days of data) [2025-09-25T20:00:27.415147] [DEBUG] [LOCAL ] MIN: Primary data saved (13198 records). [2025-09-25T20:00:27.415330] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-25T20:00:27.415517] [INFO ] [MAIN ] Update Progress: 1360/2372 symbols completed. MIN took 28.2s. Estimated remaining: 2h 14m 15s. Rate: 7.5 symbols/min [2025-09-25T20:00:28.254471] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:28.261322] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-25T20:00:28.261403] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-25T20:00:28.261598] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-25T20:00:28.263695] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-25T20:00:28.263929] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-25T20:00:28.263982] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-25T20:00:28.294570] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:28.343382] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:28.376882] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:28.449098] [DEBUG] [LOCAL ] MITT: Loaded 23064 existing records from primary storage. [2025-09-25T20:00:28.449336] [INFO ] [MAIN ] MITT: Loaded 23064 existing records. [2025-09-25T20:00:28.529460] [DEBUG] [LOCAL ] MITP: Loaded 2428 existing records from primary storage. [2025-09-25T20:00:28.529741] [INFO ] [MAIN ] MITP: Loaded 2428 existing records. [2025-09-25T20:00:28.693415] [DEBUG] [LOCAL ] MIR: Loaded 50842 existing records from primary storage. [2025-09-25T20:00:28.693697] [INFO ] [MAIN ] MIR: Loaded 50842 existing records. [2025-09-25T20:00:29.271816] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:29.277081] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-25T20:00:29.277151] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-25T20:00:29.277608] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-25T20:00:29.277710] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-25T20:00:29.292667] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:29.292957] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-25T20:00:29.293009] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-25T20:00:29.293275] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-25T20:00:29.293347] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-25T20:00:29.631699] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:29.632179] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-25T20:00:29.632240] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-25T20:00:29.632637] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-25T20:00:29.651027] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-25T20:00:29.729622] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:29.754113] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-25T20:00:30.214151] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T20:00:30.215479] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-25T20:00:30.592311] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:30.596963] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:30.597308] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-25T20:00:30.592865] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-25T20:00:30.699358] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T20:00:30.701409] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-25T20:00:30.810070] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:30.810600] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-25T20:00:31.167681] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T20:00:31.169846] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-25T20:00:31.242384] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T20:00:31.739336] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T20:00:31.757149] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T20:00:31.888776] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-25T20:00:32.382560] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T20:00:32.443574] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T20:00:32.688822] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-25T20:00:33.131340] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T20:00:33.488821] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-25T20:00:34.288743] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-25T20:00:34.721859] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-25T20:00:35.088743] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-25T20:00:35.152510] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:00:35.448456] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T20:00:35.888732] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-25T20:00:36.240846] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T20:00:36.688740] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-25T20:00:37.145297] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T20:00:37.488747] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-25T20:00:38.288751] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-25T20:00:38.643820] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-25T20:00:38.713485] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T20:00:39.088741] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-25T20:00:39.888769] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-25T20:00:40.240562] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T20:00:40.654298] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T20:00:40.688721] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-25T20:00:41.157502] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T20:00:41.160369] [INFO ] [REMOTE ] MITN: Full fetch complete (2311 records). [2025-09-25T20:00:41.160439] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-25T20:00:41.373830] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T20:00:41.374252] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:00:41.374352] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:00:41.374457] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-25T20:00:41.374582] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-25T20:00:41.374665] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-25T20:00:41.374792] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-25T20:00:41.374905] [INFO ] [MAIN ] Update Progress: 1361/2372 symbols completed. MITN took 14.0s. Estimated remaining: 2h 14m 11s. Rate: 7.5 symbols/min [2025-09-25T20:00:41.493853] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-25T20:00:41.558146] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:41.588608] [DEBUG] [LOCAL ] MIY: Loaded 6007 existing records from primary storage. [2025-09-25T20:00:41.588981] [INFO ] [MAIN ] MIY: Loaded 6007 existing records. [2025-09-25T20:00:41.775548] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:41.775924] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-25T20:00:41.775972] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-25T20:00:41.776369] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-25T20:00:41.776439] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-25T20:00:42.138331] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:42.139019] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T20:00:42.288719] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-25T20:00:43.085939] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T20:00:43.088767] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-25T20:00:43.735936] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T20:00:43.888678] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-25T20:00:44.486670] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T20:00:44.688805] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-25T20:00:45.488701] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-25T20:00:45.795702] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T20:00:46.177803] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T20:00:46.288714] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-25T20:00:47.088738] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-25T20:00:47.675175] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T20:00:47.888807] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-25T20:00:48.258446] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T20:00:48.378576] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T20:00:48.688790] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-25T20:00:49.301802] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T20:00:49.488769] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-25T20:00:50.229816] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T20:00:50.288748] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-25T20:00:51.088760] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-25T20:00:51.670686] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T20:00:51.888807] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-25T20:00:52.040752] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T20:00:52.168447] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-25T20:00:52.688789] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-25T20:00:53.408210] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T20:00:53.488702] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-25T20:00:53.935109] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T20:00:54.288829] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-25T20:00:54.942726] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T20:00:55.088738] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-25T20:00:55.888788] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-25T20:00:56.688721] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-25T20:00:56.798551] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:00:57.328062] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T20:00:57.425487] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T20:00:57.427526] [INFO ] [REMOTE ] MIY: Full fetch complete (9049 records). [2025-09-25T20:00:57.427746] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-25T20:00:57.488934] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-25T20:00:57.831366] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-25T20:00:57.831475] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-25T20:00:57.831811] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-25T20:00:57.831963] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-25T20:00:57.832720] [DEBUG] [LOCAL ] MIY: Trimmed 9049 records to 6046 (keeping 200 days of data) [2025-09-25T20:00:57.879420] [DEBUG] [LOCAL ] MIY: Primary data saved (6046 records). [2025-09-25T20:00:57.882796] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-25T20:00:57.883092] [INFO ] [MAIN ] Update Progress: 1362/2372 symbols completed. MIY took 16.5s. Estimated remaining: 2h 14m 9s. Rate: 7.5 symbols/min [2025-09-25T20:00:58.070232] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:00:58.166840] [DEBUG] [LOCAL ] MKC: Loaded 52430 existing records from primary storage. [2025-09-25T20:00:58.167090] [INFO ] [MAIN ] MKC: Loaded 52430 existing records. [2025-09-25T20:00:58.293902] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-25T20:00:58.370772] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:00:58.371289] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-25T20:00:58.371350] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-25T20:00:58.372276] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-25T20:00:58.372380] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-25T20:00:58.773850] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:00:59.088728] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-25T20:00:59.411009] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-25T20:00:59.428673] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T20:00:59.469224] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-25T20:00:59.888783] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-25T20:01:00.325577] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-25T20:01:00.326785] [INFO ] [REMOTE ] MITP: Full fetch complete (3357 records). [2025-09-25T20:01:00.326939] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-25T20:01:00.689191] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-25T20:01:00.722550] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-25T20:01:00.722628] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-25T20:01:00.722818] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-25T20:01:00.722879] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-25T20:01:00.723420] [DEBUG] [LOCAL ] MITP: Trimmed 3357 records to 2455 (keeping 200 days of data) [2025-09-25T20:01:00.740502] [DEBUG] [LOCAL ] MITP: Primary data saved (2455 records). [2025-09-25T20:01:00.740570] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-25T20:01:00.740709] [INFO ] [MAIN ] Update Progress: 1363/2372 symbols completed. MITP took 33.3s. Estimated remaining: 2h 13m 58s. Rate: 7.5 symbols/min [2025-09-25T20:01:00.927722] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:00.994565] [DEBUG] [LOCAL ] MKL: Loaded 34084 existing records from primary storage. [2025-09-25T20:01:00.994753] [INFO ] [MAIN ] MKL: Loaded 34084 existing records. [2025-09-25T20:01:01.173024] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:01.173404] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-25T20:01:01.173467] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-25T20:01:01.174312] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-25T20:01:01.175050] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-25T20:01:01.493796] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-25T20:01:01.559459] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:02.288719] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-25T20:01:02.505236] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T20:01:02.842867] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T20:01:03.088770] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-25T20:01:03.380015] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T20:01:03.888817] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-25T20:01:04.688926] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-25T20:01:04.905872] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:01:05.503945] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-25T20:01:05.532728] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T20:01:06.083396] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T20:01:06.288720] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-25T20:01:07.088784] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-25T20:01:07.218473] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T20:01:07.230902] [INFO ] [REMOTE ] MIR: Full fetch complete (73410 records). [2025-09-25T20:01:07.231092] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-25T20:01:07.429091] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T20:01:07.709859] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-25T20:01:07.709991] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-25T20:01:07.711251] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-25T20:01:07.711372] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-25T20:01:07.713406] [DEBUG] [LOCAL ] MIR: Trimmed 73410 records to 51232 (keeping 200 days of data) [2025-09-25T20:01:07.908435] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-25T20:01:08.072247] [DEBUG] [LOCAL ] MIR: Primary data saved (51232 records). [2025-09-25T20:01:08.072423] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-25T20:01:08.072578] [INFO ] [MAIN ] Update Progress: 1364/2372 symbols completed. MIR took 40.6s. Estimated remaining: 2h 13m 49s. Rate: 7.5 symbols/min [2025-09-25T20:01:08.255469] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:08.320348] [DEBUG] [LOCAL ] MLI: Loaded 43813 existing records from primary storage. [2025-09-25T20:01:08.320525] [INFO ] [MAIN ] MLI: Loaded 43813 existing records. [2025-09-25T20:01:08.519892] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:08.521954] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-25T20:01:08.522045] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-25T20:01:08.522799] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-25T20:01:08.522942] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-25T20:01:08.694957] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-25T20:01:08.838983] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T20:01:09.048358] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:09.161315] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T20:01:09.488717] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-25T20:01:10.255820] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T20:01:10.288756] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-25T20:01:10.813717] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T20:01:10.823313] [INFO ] [REMOTE ] MITT: Full fetch complete (35029 records). [2025-09-25T20:01:10.823463] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-25T20:01:11.093425] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-25T20:01:11.259818] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-25T20:01:11.259917] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-25T20:01:11.260734] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-25T20:01:11.260797] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-25T20:01:11.261592] [DEBUG] [LOCAL ] MITT: Trimmed 35029 records to 23213 (keeping 200 days of data) [2025-09-25T20:01:11.416784] [DEBUG] [LOCAL ] MITT: Primary data saved (23213 records). [2025-09-25T20:01:11.416941] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-25T20:01:11.417092] [INFO ] [MAIN ] Update Progress: 1365/2372 symbols completed. MITT took 43.9s. Estimated remaining: 2h 13m 38s. Rate: 7.5 symbols/min [2025-09-25T20:01:11.603556] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:11.659380] [DEBUG] [LOCAL ] MLM: Loaded 30687 existing records from primary storage. [2025-09-25T20:01:11.659554] [INFO ] [MAIN ] MLM: Loaded 30687 existing records. [2025-09-25T20:01:11.874461] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:11.875869] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-25T20:01:11.875926] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-25T20:01:11.876858] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-25T20:01:11.876922] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-25T20:01:11.899750] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-25T20:01:11.967818] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T20:01:12.320876] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:12.688700] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-25T20:01:12.782240] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:01:13.382150] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T20:01:13.488728] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-25T20:01:14.229758] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T20:01:14.288759] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-25T20:01:15.050890] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:01:15.088741] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-25T20:01:15.888757] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-25T20:01:15.937601] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T20:01:16.551699] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T20:01:16.688779] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-25T20:01:17.469699] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T20:01:17.488697] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-25T20:01:18.288737] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-25T20:01:18.364025] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T20:01:18.601835] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:01:19.088743] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-25T20:01:19.405076] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:01:19.888853] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-25T20:01:20.573994] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T20:01:20.688728] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-25T20:01:21.013631] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:01:21.488732] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-25T20:01:22.288727] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-25T20:01:22.421910] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T20:01:22.870815] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T20:01:23.088719] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-25T20:01:23.764575] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:01:23.888752] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-25T20:01:24.563324] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T20:01:24.688683] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-25T20:01:25.494781] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-25T20:01:25.512367] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T20:01:26.288850] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-25T20:01:26.341552] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:01:26.351289] [INFO ] [REMOTE ] MKL: Full fetch complete (49565 records). [2025-09-25T20:01:26.351425] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-25T20:01:26.882029] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-25T20:01:26.882139] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-25T20:01:26.883278] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-25T20:01:26.883370] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-25T20:01:26.891430] [DEBUG] [LOCAL ] MKL: Trimmed 49565 records to 34303 (keeping 200 days of data) [2025-09-25T20:01:27.105022] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-25T20:01:27.138506] [DEBUG] [LOCAL ] MKL: Primary data saved (34303 records). [2025-09-25T20:01:27.138637] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-25T20:01:27.138849] [INFO ] [MAIN ] Update Progress: 1366/2372 symbols completed. MKL took 26.4s. Estimated remaining: 2h 13m 36s. Rate: 7.5 symbols/min [2025-09-25T20:01:27.324906] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:27.386336] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T20:01:27.412775] [DEBUG] [LOCAL ] MLNK: Loaded 25614 existing records from primary storage. [2025-09-25T20:01:27.413030] [INFO ] [MAIN ] MLNK: Loaded 25614 existing records. [2025-09-25T20:01:27.641367] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:27.643917] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-25T20:01:27.644017] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-25T20:01:27.644446] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-25T20:01:27.644508] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-25T20:01:27.918740] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-25T20:01:27.956306] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T20:01:28.097074] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:28.306721] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T20:01:28.688802] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-25T20:01:29.498315] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-25T20:01:29.521699] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T20:01:30.288747] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-25T20:01:30.395913] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T20:01:30.597133] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T20:01:31.088763] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-25T20:01:31.888792] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-25T20:01:32.202278] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T20:01:32.212813] [INFO ] [REMOTE ] MKC: Full fetch complete (75503 records). [2025-09-25T20:01:32.212974] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-25T20:01:32.281889] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T20:01:32.687321] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-25T20:01:32.687495] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-25T20:01:32.689354] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-25T20:01:32.689296] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-25T20:01:32.691033] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-25T20:01:32.694637] [DEBUG] [LOCAL ] MKC: Trimmed 75503 records to 52820 (keeping 200 days of data) [2025-09-25T20:01:33.062164] [DEBUG] [LOCAL ] MKC: Primary data saved (52820 records). [2025-09-25T20:01:33.062333] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-25T20:01:33.064127] [INFO ] [MAIN ] Update Progress: 1367/2372 symbols completed. MKC took 35.2s. Estimated remaining: 2h 13m 26s. Rate: 7.5 symbols/min [2025-09-25T20:01:33.256895] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:33.285867] [DEBUG] [LOCAL ] MLP: Loaded 3093 existing records from primary storage. [2025-09-25T20:01:33.286043] [INFO ] [MAIN ] MLP: Loaded 3093 existing records. [2025-09-25T20:01:33.331085] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T20:01:33.494726] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-25T20:01:33.494173] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:33.496780] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-25T20:01:33.496866] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-25T20:01:33.497090] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-25T20:01:33.497168] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-25T20:01:33.900999] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:34.064944] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T20:01:34.288753] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-25T20:01:34.960626] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T20:01:35.088744] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-25T20:01:35.440431] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T20:01:35.888736] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-25T20:01:36.607435] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T20:01:36.688748] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-25T20:01:36.805879] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T20:01:37.488748] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-25T20:01:37.863875] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:01:38.288731] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-25T20:01:38.890562] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T20:01:39.088727] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-25T20:01:39.505114] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T20:01:39.888745] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-25T20:01:40.489704] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T20:01:40.688737] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-25T20:01:41.488713] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-25T20:01:41.643913] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T20:01:41.653427] [INFO ] [REMOTE ] MLI: Full fetch complete (63577 records). [2025-09-25T20:01:41.653575] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-25T20:01:41.998002] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T20:01:42.115820] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-25T20:01:42.116026] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-25T20:01:42.117539] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-25T20:01:42.117633] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-25T20:01:42.119636] [DEBUG] [LOCAL ] MLI: Trimmed 63577 records to 44135 (keeping 200 days of data) [2025-09-25T20:01:42.337976] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-25T20:01:42.453332] [DEBUG] [LOCAL ] MLI: Primary data saved (44135 records). [2025-09-25T20:01:42.453532] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-25T20:01:42.456497] [INFO ] [MAIN ] Update Progress: 1368/2372 symbols completed. MLI took 34.4s. Estimated remaining: 2h 13m 19s. Rate: 7.5 symbols/min [2025-09-25T20:01:42.659400] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:42.687207] [DEBUG] [LOCAL ] MLR: Loaded 12828 existing records from primary storage. [2025-09-25T20:01:42.687364] [INFO ] [MAIN ] MLR: Loaded 12828 existing records. [2025-09-25T20:01:42.821906] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:01:42.833468] [INFO ] [REMOTE ] MLM: Full fetch complete (45686 records). [2025-09-25T20:01:42.833724] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-25T20:01:43.090908] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:43.091216] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-25T20:01:43.091264] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-25T20:01:43.091581] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-25T20:01:43.091685] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-25T20:01:43.115883] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-25T20:01:43.125102] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T20:01:43.784379] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-25T20:01:43.784494] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-25T20:01:43.792624] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:43.785621] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-25T20:01:43.793758] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-25T20:01:43.795715] [DEBUG] [LOCAL ] MLM: Trimmed 45686 records to 30863 (keeping 200 days of data) [2025-09-25T20:01:43.907268] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-25T20:01:44.021917] [DEBUG] [LOCAL ] MLM: Primary data saved (30863 records). [2025-09-25T20:01:44.022099] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-25T20:01:44.022219] [INFO ] [MAIN ] Update Progress: 1369/2372 symbols completed. MLM took 32.6s. Estimated remaining: 2h 13m 7s. Rate: 7.5 symbols/min [2025-09-25T20:01:44.213812] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:01:44.234755] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T20:01:44.301342] [DEBUG] [LOCAL ] MMC: Loaded 51817 existing records from primary storage. [2025-09-25T20:01:44.301537] [INFO ] [MAIN ] MMC: Loaded 51817 existing records. [2025-09-25T20:01:44.504918] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:01:44.505239] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-25T20:01:44.505289] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-25T20:01:44.505634] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-25T20:01:44.505856] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-25T20:01:44.582309] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T20:01:44.693829] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-25T20:01:44.926060] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:01:45.488740] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-25T20:01:45.626546] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T20:01:45.992357] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-25T20:01:46.288713] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-25T20:01:47.088741] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-25T20:01:47.566069] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T20:01:47.888697] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-25T20:01:48.199306] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T20:01:48.259404] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-25T20:01:48.688742] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-25T20:01:49.488758] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-25T20:01:49.541371] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T20:01:50.288865] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-25T20:01:51.088787] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-25T20:01:51.274631] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T20:01:51.325225] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T20:01:51.888806] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-25T20:01:51.954949] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:01:52.496025] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T20:01:52.688745] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-25T20:01:53.189275] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-25T20:01:53.488800] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-25T20:01:54.043853] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-25T20:01:54.288803] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-25T20:01:55.088769] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-25T20:01:55.477187] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T20:01:55.888749] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-25T20:01:56.232295] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T20:01:56.688791] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-25T20:01:57.275126] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T20:01:57.324964] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:01:57.488754] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-25T20:01:58.288732] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-25T20:01:58.370015] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T20:01:59.088809] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-25T20:01:59.558305] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T20:01:59.560084] [INFO ] [REMOTE ] MLP: Full fetch complete (4599 records). [2025-09-25T20:01:59.560259] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-25T20:01:59.888764] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-25T20:02:00.024031] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:02:00.044038] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-25T20:02:00.044111] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-25T20:02:00.044330] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-25T20:02:00.044442] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-25T20:02:00.044974] [DEBUG] [LOCAL ] MLP: Trimmed 4599 records to 3117 (keeping 200 days of data) [2025-09-25T20:02:00.068708] [DEBUG] [LOCAL ] MLP: Primary data saved (3117 records). [2025-09-25T20:02:00.068811] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-25T20:02:00.068977] [INFO ] [MAIN ] Update Progress: 1370/2372 symbols completed. MLP took 27.0s. Estimated remaining: 2h 13m 5s. Rate: 7.5 symbols/min [2025-09-25T20:02:00.265849] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:00.309354] [DEBUG] [LOCAL ] MMD: Loaded 11203 existing records from primary storage. [2025-09-25T20:02:00.309520] [INFO ] [MAIN ] MMD: Loaded 11203 existing records. [2025-09-25T20:02:00.508181] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:00.508612] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-25T20:02:00.508709] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-25T20:02:00.509333] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-25T20:02:00.509435] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-25T20:02:00.689036] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-25T20:02:00.904863] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:01.376374] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T20:02:01.488675] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-25T20:02:02.288759] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-25T20:02:02.516608] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T20:02:02.705959] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T20:02:03.088764] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-25T20:02:03.216239] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:02:03.888823] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-25T20:02:04.688754] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-25T20:02:05.007021] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T20:02:05.188662] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T20:02:05.195406] [INFO ] [REMOTE ] MLNK: Full fetch complete (35857 records). [2025-09-25T20:02:05.195533] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-25T20:02:05.492932] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-25T20:02:05.507216] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T20:02:05.645072] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-25T20:02:05.645171] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-25T20:02:05.646092] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-25T20:02:05.646156] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-25T20:02:05.647201] [DEBUG] [LOCAL ] MLNK: Trimmed 35857 records to 25735 (keeping 200 days of data) [2025-09-25T20:02:05.830348] [DEBUG] [LOCAL ] MLNK: Primary data saved (25735 records). [2025-09-25T20:02:05.830505] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-25T20:02:05.830715] [INFO ] [MAIN ] Update Progress: 1371/2372 symbols completed. MLNK took 38.7s. Estimated remaining: 2h 12m 55s. Rate: 7.5 symbols/min [2025-09-25T20:02:06.009467] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:06.033939] [DEBUG] [LOCAL ] MMI: Loaded 15306 existing records from primary storage. [2025-09-25T20:02:06.034080] [INFO ] [MAIN ] MMI: Loaded 15306 existing records. [2025-09-25T20:02:06.215242] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:06.217528] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-25T20:02:06.217587] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-25T20:02:06.217914] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-25T20:02:06.217975] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-25T20:02:06.293785] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-25T20:02:06.483843] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T20:02:06.605817] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:07.083753] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T20:02:07.088672] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-25T20:02:07.888742] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-25T20:02:08.055516] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T20:02:08.688789] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-25T20:02:08.885370] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T20:02:09.488771] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-25T20:02:10.288702] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-25T20:02:10.322805] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T20:02:10.397306] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:02:11.064972] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:02:11.069339] [INFO ] [REMOTE ] MLR: Full fetch complete (18624 records). [2025-09-25T20:02:11.069429] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-25T20:02:11.093952] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-25T20:02:11.497738] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-25T20:02:11.497863] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-25T20:02:11.498677] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-25T20:02:11.498745] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-25T20:02:11.501331] [DEBUG] [LOCAL ] MLR: Trimmed 18624 records to 12887 (keeping 200 days of data) [2025-09-25T20:02:11.612789] [DEBUG] [LOCAL ] MLR: Primary data saved (12887 records). [2025-09-25T20:02:11.612994] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-25T20:02:11.613152] [INFO ] [MAIN ] Update Progress: 1372/2372 symbols completed. MLR took 29.2s. Estimated remaining: 2h 12m 45s. Rate: 7.5 symbols/min [2025-09-25T20:02:11.817858] [INFO ] [MAIN ] MMID: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:11.818243] [DEBUG] [LOCAL ] MMID: No existing data file found in primary storage. [2025-09-25T20:02:11.818329] [WARN ] [MAIN ] MMID: No existing data found, performing full refresh instead. [2025-09-25T20:02:11.820826] [INFO ] [MAIN ] MMID: Wiping existing primary data before full refresh. [2025-09-25T20:02:11.820912] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-25T20:02:11.820985] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-25T20:02:11.821038] [INFO ] [MAIN ] MMID: Starting full primary refresh. [2025-09-25T20:02:11.900999] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-25T20:02:12.189331] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T20:02:12.270035] [INFO ] [REMOTE ] MMID: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:12.688798] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-25T20:02:13.464365] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T20:02:13.488682] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-25T20:02:13.744722] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T20:02:14.043848] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-25T20:02:14.288753] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-25T20:02:15.088765] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-25T20:02:15.888730] [INFO ] [REMOTE ] MMID: Fetching primary data for 2024-12. [2025-09-25T20:02:16.131154] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T20:02:16.144563] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:16.150514] [WARN ] [REMOTE ] MMID: No data returned for month 2024-12 [2025-09-25T20:02:16.154677] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T20:02:16.688939] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-25T20:02:17.440613] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-25T20:02:17.488760] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-01. [2025-09-25T20:02:17.693786] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:17.694232] [WARN ] [REMOTE ] MMID: No data returned for month 2025-01 [2025-09-25T20:02:18.288852] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-02. [2025-09-25T20:02:18.549363] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:18.549827] [WARN ] [REMOTE ] MMID: No data returned for month 2025-02 [2025-09-25T20:02:19.088752] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-25T20:02:19.888868] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-03. [2025-09-25T20:02:19.923837] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T20:02:20.121571] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:20.122098] [WARN ] [REMOTE ] MMID: No data returned for month 2025-03 [2025-09-25T20:02:20.688797] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-25T20:02:21.488758] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-25T20:02:22.288893] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-04. [2025-09-25T20:02:22.464402] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T20:02:22.513087] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:22.513577] [WARN ] [REMOTE ] MMID: No data returned for month 2025-04 [2025-09-25T20:02:22.625316] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T20:02:22.644151] [INFO ] [REMOTE ] MMC: Full fetch complete (74713 records). [2025-09-25T20:02:22.644408] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-25T20:02:23.097459] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-25T20:02:23.103543] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-25T20:02:23.103603] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-25T20:02:23.104979] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-25T20:02:23.105107] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-25T20:02:23.114635] [DEBUG] [LOCAL ] MMC: Trimmed 74713 records to 52193 (keeping 200 days of data) [2025-09-25T20:02:23.486505] [DEBUG] [LOCAL ] MMC: Primary data saved (52193 records). [2025-09-25T20:02:23.486720] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-25T20:02:23.486932] [INFO ] [MAIN ] Update Progress: 1373/2372 symbols completed. MMC took 39.5s. Estimated remaining: 2h 12m 40s. Rate: 7.5 symbols/min [2025-09-25T20:02:23.674322] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:23.674616] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-25T20:02:23.674705] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-25T20:02:23.674929] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-25T20:02:23.674989] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-25T20:02:23.675042] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-25T20:02:23.675094] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-25T20:02:23.898899] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-05. [2025-09-25T20:02:24.103736] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T20:02:24.139208] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:24.139584] [WARN ] [REMOTE ] MMID: No data returned for month 2025-05 [2025-09-25T20:02:24.211598] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:24.688747] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-06. [2025-09-25T20:02:24.899559] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:24.900059] [WARN ] [REMOTE ] MMID: No data returned for month 2025-06 [2025-09-25T20:02:25.488825] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-25T20:02:25.948866] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T20:02:26.288968] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-25T20:02:27.088898] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-25T20:02:27.149589] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:02:27.888709] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-25T20:02:28.192109] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T20:02:28.688733] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-25T20:02:28.901456] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T20:02:28.906136] [INFO ] [REMOTE ] MMD: Full fetch complete (18107 records). [2025-09-25T20:02:28.906288] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-25T20:02:29.321701] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-25T20:02:29.321800] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-25T20:02:29.322407] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-25T20:02:29.322477] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-25T20:02:29.323175] [DEBUG] [LOCAL ] MMD: Trimmed 18107 records to 11356 (keeping 200 days of data) [2025-09-25T20:02:29.417087] [DEBUG] [LOCAL ] MMD: Primary data saved (11356 records). [2025-09-25T20:02:29.417283] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-25T20:02:29.417493] [INFO ] [MAIN ] Update Progress: 1374/2372 symbols completed. MMD took 29.3s. Estimated remaining: 2h 12m 31s. Rate: 7.5 symbols/min [2025-09-25T20:02:29.498739] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-25T20:02:29.652504] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:29.669618] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T20:02:29.782980] [DEBUG] [LOCAL ] MMM: Loaded 53229 existing records from primary storage. [2025-09-25T20:02:29.783181] [INFO ] [MAIN ] MMM: Loaded 53229 existing records. [2025-09-25T20:02:29.816735] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-25T20:02:29.983299] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:29.983804] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-25T20:02:29.983877] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-25T20:02:29.984442] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-25T20:02:29.984515] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-25T20:02:30.288856] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-25T20:02:30.396637] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:30.751250] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T20:02:31.088759] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-25T20:02:31.532580] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T20:02:31.888762] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-07. [2025-09-25T20:02:32.091063] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:32.091455] [WARN ] [REMOTE ] MMID: No data returned for month 2025-07 [2025-09-25T20:02:32.688788] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-25T20:02:33.488782] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-25T20:02:33.916479] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-25T20:02:34.288745] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-25T20:02:34.684458] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T20:02:34.740156] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T20:02:35.088755] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-25T20:02:35.440337] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T20:02:35.888764] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-08. [2025-09-25T20:02:36.110834] [DEBUG] [REMOTE ] MMID: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:02:36.111253] [WARN ] [REMOTE ] MMID: No data returned for month 2025-08 [2025-09-25T20:02:36.688738] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-25T20:02:37.488728] [INFO ] [REMOTE ] MMID: Fetching primary data for 2025-09. [2025-09-25T20:02:37.794296] [INFO ] [REMOTE ] MMID: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-25T20:02:37.795273] [INFO ] [REMOTE ] MMID: Full fetch complete (16 records). [2025-09-25T20:02:37.795364] [DEBUG] [VALIDATOR ] MMID: Validating primary data. [2025-09-25T20:02:37.992738] [WARN ] [VALIDATOR ] MMID: Validation failed - insufficient historical data. Have 2 unique days, need 200 days [2025-09-25T20:02:37.993111] [FATAL] [MAIN ] MMID: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:02:37.993190] [WARN ] [MAIN ] MMID: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:02:37.993271] [INFO ] [LOCAL ] MMID: Starting deletion of primary data. [2025-09-25T20:02:37.993420] [DEBUG] [LOCAL ] MMID: No primary data file found to delete. [2025-09-25T20:02:37.993491] [INFO ] [LOCAL ] MMID: Starting deletion of derivative data. [2025-09-25T20:02:37.993561] [DEBUG] [LOCAL ] MMID: No derivative data file found to delete. [2025-09-25T20:02:37.993697] [INFO ] [MAIN ] Update Progress: 1375/2372 symbols completed. MMID took 26.4s. Estimated remaining: 2h 12m 23s. Rate: 7.5 symbols/min [2025-09-25T20:02:38.189575] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:38.291483] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-25T20:02:38.300938] [DEBUG] [LOCAL ] MMS: Loaded 33878 existing records from primary storage. [2025-09-25T20:02:38.301069] [INFO ] [MAIN ] MMS: Loaded 33878 existing records. [2025-09-25T20:02:38.498356] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:38.498751] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-25T20:02:38.498811] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-25T20:02:38.499546] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-25T20:02:38.499610] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-25T20:02:38.713287] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T20:02:38.843211] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-25T20:02:39.069931] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:39.088679] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-25T20:02:39.888751] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-25T20:02:40.688747] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-25T20:02:41.242044] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-25T20:02:41.471745] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T20:02:41.488699] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-25T20:02:41.701442] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T20:02:42.288762] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-25T20:02:43.088744] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-25T20:02:43.527829] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T20:02:43.584188] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T20:02:43.888744] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-25T20:02:43.956281] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T20:02:44.321691] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-25T20:02:44.323095] [INFO ] [REMOTE ] MMKT: Full fetch complete (2114 records). [2025-09-25T20:02:44.323228] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-25T20:02:44.556320] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T20:02:44.556682] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:02:44.556776] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:02:44.556852] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-25T20:02:44.556963] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-25T20:02:44.557023] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-25T20:02:44.557069] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-25T20:02:44.557135] [INFO ] [MAIN ] Update Progress: 1376/2372 symbols completed. MMKT took 21.1s. Estimated remaining: 2h 12m 14s. Rate: 7.5 symbols/min [2025-09-25T20:02:44.703468] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-25T20:02:44.739970] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:44.764938] [DEBUG] [LOCAL ] MMT: Loaded 10920 existing records from primary storage. [2025-09-25T20:02:44.765152] [INFO ] [MAIN ] MMT: Loaded 10920 existing records. [2025-09-25T20:02:44.954092] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:44.954403] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-25T20:02:44.954451] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-25T20:02:44.955190] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-25T20:02:44.955256] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-25T20:02:45.342398] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:45.488739] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-25T20:02:45.618441] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T20:02:46.092941] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T20:02:46.288752] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-25T20:02:47.088750] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-25T20:02:47.770013] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:02:47.888761] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-25T20:02:48.122557] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T20:02:48.688879] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-25T20:02:49.488935] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-25T20:02:49.768401] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T20:02:49.774234] [INFO ] [REMOTE ] MMI: Full fetch complete (20987 records). [2025-09-25T20:02:49.774474] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-25T20:02:50.159039] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-25T20:02:50.292728] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-25T20:02:50.292909] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-25T20:02:50.294454] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-25T20:02:50.294687] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-25T20:02:50.295567] [DEBUG] [LOCAL ] MMI: Trimmed 20987 records to 15372 (keeping 200 days of data) [2025-09-25T20:02:50.298767] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-25T20:02:50.441305] [DEBUG] [LOCAL ] MMI: Primary data saved (15372 records). [2025-09-25T20:02:50.441495] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-25T20:02:50.441733] [INFO ] [MAIN ] Update Progress: 1377/2372 symbols completed. MMI took 44.6s. Estimated remaining: 2h 12m 5s. Rate: 7.5 symbols/min [2025-09-25T20:02:50.675738] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:02:50.711409] [DEBUG] [LOCAL ] MMU: Loaded 16934 existing records from primary storage. [2025-09-25T20:02:50.711589] [INFO ] [MAIN ] MMU: Loaded 16934 existing records. [2025-09-25T20:02:50.903364] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:02:50.904562] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-25T20:02:50.904611] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-25T20:02:50.905959] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-25T20:02:50.906070] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-25T20:02:51.103125] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T20:02:51.117942] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-25T20:02:51.186419] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T20:02:51.419548] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:02:51.888762] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-25T20:02:52.688714] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-25T20:02:53.146749] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T20:02:53.438082] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:02:53.488725] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-25T20:02:53.501979] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T20:02:54.288876] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-25T20:02:54.837600] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T20:02:55.088945] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-25T20:02:55.888696] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-25T20:02:56.157737] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T20:02:56.335726] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-25T20:02:56.688761] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-25T20:02:57.007201] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T20:02:57.488736] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-25T20:02:58.288763] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-25T20:02:58.479340] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T20:02:58.632361] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T20:02:59.089083] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-25T20:02:59.089764] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T20:02:59.888832] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-25T20:03:00.415360] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T20:03:00.688764] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-25T20:03:01.488717] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-25T20:03:01.641531] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T20:03:01.927372] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T20:03:02.288735] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-25T20:03:02.895092] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T20:03:03.086272] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T20:03:03.088747] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-25T20:03:03.888736] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-25T20:03:04.579683] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T20:03:04.688722] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-25T20:03:05.237596] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-25T20:03:05.259521] [INFO ] [REMOTE ] MMM: Full fetch complete (77139 records). [2025-09-25T20:03:05.259762] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-25T20:03:05.488816] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-25T20:03:05.733442] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-25T20:03:05.733569] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-25T20:03:05.735025] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-25T20:03:05.735133] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-25T20:03:05.738418] [DEBUG] [LOCAL ] MMM: Trimmed 77139 records to 53617 (keeping 200 days of data) [2025-09-25T20:03:06.171972] [DEBUG] [LOCAL ] MMM: Primary data saved (53617 records). [2025-09-25T20:03:06.172135] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-25T20:03:06.174228] [INFO ] [MAIN ] Update Progress: 1378/2372 symbols completed. MMM took 36.8s. Estimated remaining: 2h 12m 3s. Rate: 7.5 symbols/min [2025-09-25T20:03:06.293842] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-25T20:03:06.374725] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T20:03:06.433376] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:06.508918] [DEBUG] [LOCAL ] MNR: Loaded 24681 existing records from primary storage. [2025-09-25T20:03:06.509093] [INFO ] [MAIN ] MNR: Loaded 24681 existing records. [2025-09-25T20:03:06.631664] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T20:03:06.744935] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:03:06.745283] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-25T20:03:06.745377] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-25T20:03:06.745815] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-25T20:03:06.745937] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-25T20:03:07.094722] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-25T20:03:07.138421] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:07.385170] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:03:07.888749] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-25T20:03:08.688784] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-25T20:03:08.740539] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:03:08.749388] [INFO ] [REMOTE ] MMS: Full fetch complete (52161 records). [2025-09-25T20:03:08.749588] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-25T20:03:08.806505] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T20:03:09.191538] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-25T20:03:09.191669] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-25T20:03:09.192982] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-25T20:03:09.193049] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-25T20:03:09.196371] [DEBUG] [LOCAL ] MMS: Trimmed 52161 records to 34138 (keeping 200 days of data) [2025-09-25T20:03:09.436443] [DEBUG] [LOCAL ] MMS: Primary data saved (34138 records). [2025-09-25T20:03:09.436636] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-25T20:03:09.437747] [INFO ] [MAIN ] Update Progress: 1379/2372 symbols completed. MMS took 31.4s. Estimated remaining: 2h 11m 51s. Rate: 7.5 symbols/min [2025-09-25T20:03:09.493461] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-25T20:03:09.636080] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:09.693386] [DEBUG] [LOCAL ] MNSO: Loaded 44333 existing records from primary storage. [2025-09-25T20:03:09.693583] [INFO ] [MAIN ] MNSO: Loaded 44333 existing records. [2025-09-25T20:03:09.835793] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T20:03:09.924204] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:03:09.924743] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-25T20:03:09.924824] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-25T20:03:09.925476] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-25T20:03:09.925542] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-25T20:03:10.298750] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-25T20:03:10.355445] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:10.355812] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T20:03:10.359580] [INFO ] [REMOTE ] MMT: Full fetch complete (16283 records). [2025-09-25T20:03:10.359771] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-25T20:03:10.777042] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-25T20:03:10.777137] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-25T20:03:10.777570] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-25T20:03:10.777610] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-25T20:03:10.778278] [DEBUG] [LOCAL ] MMT: Trimmed 16283 records to 10959 (keeping 200 days of data) [2025-09-25T20:03:10.879676] [DEBUG] [LOCAL ] MMT: Primary data saved (10959 records). [2025-09-25T20:03:10.879844] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-25T20:03:10.879961] [INFO ] [MAIN ] Update Progress: 1380/2372 symbols completed. MMT took 26.3s. Estimated remaining: 2h 11m 39s. Rate: 7.5 symbols/min [2025-09-25T20:03:11.055210] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:11.055491] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-25T20:03:11.055550] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-25T20:03:11.055814] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-25T20:03:11.055917] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-25T20:03:11.055992] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-25T20:03:11.056029] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-25T20:03:11.089960] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-25T20:03:11.280689] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T20:03:11.464780] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:11.888759] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-25T20:03:12.381635] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:03:12.688744] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-25T20:03:13.488729] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-25T20:03:13.556787] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T20:03:13.864755] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T20:03:14.290937] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-25T20:03:14.439987] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T20:03:14.512615] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:03:14.513238] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-25T20:03:15.088760] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-25T20:03:15.888751] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-25T20:03:16.396357] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:03:16.397308] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-25T20:03:16.431388] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T20:03:16.688800] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-25T20:03:17.488732] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-25T20:03:17.803253] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T20:03:18.288773] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-25T20:03:19.088874] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-25T20:03:19.259675] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T20:03:19.306545] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T20:03:19.888743] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-25T20:03:20.089841] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T20:03:20.688843] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-25T20:03:21.216058] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T20:03:21.488766] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-25T20:03:21.530143] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T20:03:22.288758] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-25T20:03:22.770584] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T20:03:23.007929] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T20:03:23.013265] [INFO ] [REMOTE ] MMU: Full fetch complete (25764 records). [2025-09-25T20:03:23.013591] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-25T20:03:23.093810] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-25T20:03:23.489571] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-25T20:03:23.489799] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-25T20:03:23.491047] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-25T20:03:23.491237] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-25T20:03:23.492810] [DEBUG] [LOCAL ] MMU: Trimmed 25764 records to 17066 (keeping 200 days of data) [2025-09-25T20:03:23.649837] [DEBUG] [LOCAL ] MMU: Primary data saved (17066 records). [2025-09-25T20:03:23.650038] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-25T20:03:23.650289] [INFO ] [MAIN ] Update Progress: 1381/2372 symbols completed. MMU took 33.2s. Estimated remaining: 2h 11m 34s. Rate: 7.5 symbols/min [2025-09-25T20:03:23.846949] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:23.847216] [DEBUG] [LOCAL ] MO: No existing data file found in primary storage. [2025-09-25T20:03:23.847276] [WARN ] [MAIN ] MO: No existing data found, performing full refresh instead. [2025-09-25T20:03:23.847449] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-25T20:03:23.847494] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-25T20:03:23.847537] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-25T20:03:23.847582] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-25T20:03:23.891015] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-25T20:03:24.292341] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:24.342583] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:03:24.343045] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-25T20:03:24.362478] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T20:03:24.688751] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-25T20:03:25.489750] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-25T20:03:25.803805] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T20:03:26.288777] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-25T20:03:26.521513] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:03:26.521857] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-25T20:03:27.088749] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-25T20:03:27.330435] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:03:27.330841] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-25T20:03:27.893916] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-25T20:03:27.922330] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-25T20:03:28.688767] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-25T20:03:28.821486] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:03:29.488816] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-25T20:03:29.906870] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T20:03:29.914108] [INFO ] [REMOTE ] MNR: Full fetch complete (36965 records). [2025-09-25T20:03:29.914389] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-25T20:03:30.299798] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-25T20:03:30.350115] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-25T20:03:30.350242] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-25T20:03:30.351352] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-25T20:03:30.351442] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-25T20:03:30.353690] [DEBUG] [LOCAL ] MNR: Trimmed 36965 records to 24782 (keeping 200 days of data) [2025-09-25T20:03:30.571275] [DEBUG] [LOCAL ] MNR: Primary data saved (24782 records). [2025-09-25T20:03:30.571540] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-25T20:03:30.571800] [INFO ] [MAIN ] Update Progress: 1382/2372 symbols completed. MNR took 24.4s. Estimated remaining: 2h 11m 25s. Rate: 7.5 symbols/min [2025-09-25T20:03:30.784354] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:30.867513] [DEBUG] [LOCAL ] MOD: Loaded 45590 existing records from primary storage. [2025-09-25T20:03:30.867718] [INFO ] [MAIN ] MOD: Loaded 45590 existing records. [2025-09-25T20:03:31.071950] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T20:03:31.108801] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-25T20:03:31.114406] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:03:31.116439] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-25T20:03:31.116562] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-25T20:03:31.120038] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-25T20:03:31.120135] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-25T20:03:31.518869] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:31.888793] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-25T20:03:32.609091] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-25T20:03:32.688694] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-25T20:03:32.792422] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T20:03:33.488848] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-25T20:03:33.588554] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T20:03:34.288760] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-25T20:03:34.865406] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-25T20:03:35.044575] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T20:03:35.088761] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-25T20:03:35.888723] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-25T20:03:35.999381] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T20:03:36.688751] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-25T20:03:37.491212] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-25T20:03:37.507695] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-25T20:03:37.552378] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:03:38.192926] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T20:03:38.288739] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-25T20:03:39.088720] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-25T20:03:39.333477] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T20:03:39.634390] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T20:03:39.888718] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-25T20:03:40.688753] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-25T20:03:41.474139] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-25T20:03:41.488768] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-25T20:03:41.542416] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:03:41.550232] [INFO ] [REMOTE ] MNTN: Full fetch complete (25306 records). [2025-09-25T20:03:41.550325] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-25T20:03:41.740370] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 87 unique days, need 200 days [2025-09-25T20:03:41.741009] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:03:41.741106] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:03:41.741201] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-25T20:03:41.741332] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-25T20:03:41.741403] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-25T20:03:41.741493] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-25T20:03:41.741626] [INFO ] [MAIN ] Update Progress: 1383/2372 symbols completed. MNTN took 30.9s. Estimated remaining: 2h 11m 20s. Rate: 7.5 symbols/min [2025-09-25T20:03:41.932133] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:42.051704] [DEBUG] [LOCAL ] MODG: Loaded 51602 existing records from primary storage. [2025-09-25T20:03:42.055091] [INFO ] [MAIN ] MODG: Loaded 51602 existing records. [2025-09-25T20:03:42.077008] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T20:03:42.270819] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:03:42.271268] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-25T20:03:42.271334] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-25T20:03:42.271897] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-25T20:03:42.271962] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-25T20:03:42.289311] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-25T20:03:42.670768] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:03:43.088751] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-25T20:03:43.302621] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T20:03:43.888697] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-25T20:03:44.028292] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T20:03:44.688865] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-25T20:03:45.313384] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T20:03:45.488707] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-25T20:03:45.635153] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:03:46.288731] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-25T20:03:46.447293] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T20:03:47.088833] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-25T20:03:47.839635] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-25T20:03:47.880798] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T20:03:47.889693] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-25T20:03:48.688768] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-25T20:03:48.884525] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T20:03:49.428596] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:03:49.488704] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-25T20:03:50.187321] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T20:03:50.288758] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-25T20:03:51.088772] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-25T20:03:51.373906] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T20:03:51.888816] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-25T20:03:52.552534] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-25T20:03:52.688747] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-25T20:03:52.791273] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T20:03:53.257558] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T20:03:53.488754] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-25T20:03:54.288842] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-25T20:03:54.755594] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-25T20:03:55.088751] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-25T20:03:55.355005] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:03:55.888757] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-25T20:03:55.978537] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T20:03:56.688959] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-25T20:03:57.463273] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-25T20:03:57.477262] [INFO ] [REMOTE ] MO: Full fetch complete (77495 records). [2025-09-25T20:03:57.477498] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-25T20:03:57.533057] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-25T20:03:57.576400] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T20:03:57.585468] [INFO ] [REMOTE ] MOD: Full fetch complete (66294 records). [2025-09-25T20:03:57.585733] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-25T20:03:58.048744] [WARN ] [VALIDATOR ] MO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:03:58.056052] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:03:58.056130] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:03:58.056199] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-25T20:03:58.056372] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-25T20:03:58.056446] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-25T20:03:58.056526] [DEBUG] [LOCAL ] MO: No derivative data file found to delete. [2025-09-25T20:03:58.056685] [INFO ] [MAIN ] Update Progress: 1384/2372 symbols completed. MO took 34.4s. Estimated remaining: 2h 11m 18s. Rate: 7.5 symbols/min [2025-09-25T20:03:58.406843] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-25T20:03:58.407055] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-25T20:03:58.408765] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-25T20:03:58.408844] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-25T20:03:58.430962] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:03:58.442954] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T20:03:58.424606] [DEBUG] [LOCAL ] MOD: Trimmed 66294 records to 45879 (keeping 200 days of data) [2025-09-25T20:03:58.461162] [INFO ] [REMOTE ] MNSO: Full fetch complete (64242 records). [2025-09-25T20:03:58.461370] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-25T20:03:58.723837] [DEBUG] [LOCAL ] MOH: Loaded 41754 existing records from primary storage. [2025-09-25T20:03:58.724001] [INFO ] [MAIN ] MOH: Loaded 41754 existing records. [2025-09-25T20:03:59.241872] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T20:03:59.308868] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-25T20:03:59.383200] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:03:59.383476] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-25T20:03:59.383537] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-25T20:03:59.384259] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-25T20:03:59.392499] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-25T20:03:59.459832] [DEBUG] [LOCAL ] MOD: Primary data saved (45879 records). [2025-09-25T20:03:59.460011] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-25T20:03:59.462006] [INFO ] [MAIN ] Update Progress: 1385/2372 symbols completed. MOD took 28.9s. Estimated remaining: 2h 11m 5s. Rate: 7.5 symbols/min [2025-09-25T20:03:59.829814] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-25T20:03:59.918731] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-25T20:03:59.935461] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-25T20:03:59.938594] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-25T20:03:59.956478] [DEBUG] [LOCAL ] MNSO: Trimmed 64242 records to 44692 (keeping 200 days of data) [2025-09-25T20:04:00.196007] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:00.569346] [DEBUG] [LOCAL ] MOS: Loaded 53506 existing records from primary storage. [2025-09-25T20:04:00.569528] [INFO ] [MAIN ] MOS: Loaded 53506 existing records. [2025-09-25T20:04:00.578315] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:00.578596] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-25T20:04:00.740173] [DEBUG] [LOCAL ] MNSO: Primary data saved (44692 records). [2025-09-25T20:04:00.740396] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-25T20:04:00.742413] [INFO ] [MAIN ] Update Progress: 1386/2372 symbols completed. MNSO took 51.3s. Estimated remaining: 2h 10m 52s. Rate: 7.5 symbols/min [2025-09-25T20:04:00.938205] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:00.938578] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-25T20:04:00.938630] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-25T20:04:00.954778] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-25T20:04:00.954881] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-25T20:04:01.095458] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:01.191074] [DEBUG] [LOCAL ] MOV: Loaded 22172 existing records from primary storage. [2025-09-25T20:04:01.191302] [INFO ] [MAIN ] MOV: Loaded 22172 existing records. [2025-09-25T20:04:01.562860] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-25T20:04:01.610316] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-25T20:04:01.639895] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:01.640225] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-25T20:04:01.640278] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-25T20:04:01.640538] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-25T20:04:01.640601] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-25T20:04:01.788622] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:01.789467] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-25T20:04:02.158344] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:02.158785] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-25T20:04:03.988101] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T20:04:03.993032] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-25T20:04:04.299637] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-25T20:04:04.311794] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-25T20:04:04.389352] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (3.81 seconds). [2025-09-25T20:04:04.400804] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-25T20:04:05.044793] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T20:04:05.049126] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-25T20:04:05.144792] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (3.36 seconds). [2025-09-25T20:04:05.488768] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-25T20:04:05.906490] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T20:04:05.958781] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T20:04:05.980259] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T20:04:06.288770] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-25T20:04:07.088710] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-25T20:04:07.300909] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T20:04:07.888749] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-25T20:04:08.140722] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T20:04:08.186574] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T20:04:08.688826] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-25T20:04:09.471939] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:04:09.488673] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-25T20:04:10.058190] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T20:04:10.288717] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-25T20:04:11.088777] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-25T20:04:11.369758] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T20:04:11.888753] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-25T20:04:12.146812] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T20:04:12.160092] [INFO ] [REMOTE ] MODG: Full fetch complete (74767 records). [2025-09-25T20:04:12.160281] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-25T20:04:12.400091] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T20:04:12.692160] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-25T20:04:12.692272] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-25T20:04:12.693482] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-25T20:04:12.693431] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-25T20:04:12.694754] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-25T20:04:12.699419] [DEBUG] [LOCAL ] MODG: Trimmed 74767 records to 51979 (keeping 200 days of data) [2025-09-25T20:04:13.057674] [DEBUG] [LOCAL ] MODG: Primary data saved (51979 records). [2025-09-25T20:04:13.057889] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-25T20:04:13.058037] [INFO ] [MAIN ] Update Progress: 1387/2372 symbols completed. MODG took 31.3s. Estimated remaining: 2h 10m 47s. Rate: 7.5 symbols/min [2025-09-25T20:04:13.260499] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:13.341680] [DEBUG] [LOCAL ] MP: Loaded 53664 existing records from primary storage. [2025-09-25T20:04:13.341878] [INFO ] [MAIN ] MP: Loaded 53664 existing records. [2025-09-25T20:04:13.493856] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-25T20:04:13.578180] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:13.580293] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-25T20:04:13.580346] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-25T20:04:13.580762] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-25T20:04:13.580830] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-25T20:04:13.676460] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T20:04:13.823437] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T20:04:14.024503] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:14.288756] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-25T20:04:15.095176] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-25T20:04:15.107461] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T20:04:15.487757] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T20:04:15.888718] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-25T20:04:16.688736] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-25T20:04:17.488744] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-25T20:04:17.839481] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-25T20:04:18.293872] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-25T20:04:18.310049] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-25T20:04:18.623493] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T20:04:19.088764] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-25T20:04:19.496294] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T20:04:19.888745] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-25T20:04:20.309638] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-25T20:04:20.395424] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T20:04:20.626071] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:04:20.688711] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-25T20:04:21.488817] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-25T20:04:22.173869] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T20:04:22.288717] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-25T20:04:23.088762] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-25T20:04:23.412095] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T20:04:23.888725] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-25T20:04:24.236226] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T20:04:24.243049] [INFO ] [REMOTE ] MOV: Full fetch complete (30688 records). [2025-09-25T20:04:24.243286] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-25T20:04:24.383528] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T20:04:24.694738] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-25T20:04:24.754559] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-25T20:04:24.754713] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-25T20:04:24.761746] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-25T20:04:24.761911] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-25T20:04:24.767451] [DEBUG] [LOCAL ] MOV: Trimmed 30688 records to 22325 (keeping 200 days of data) [2025-09-25T20:04:24.946104] [DEBUG] [LOCAL ] MOV: Primary data saved (22325 records). [2025-09-25T20:04:24.946300] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-25T20:04:24.946504] [INFO ] [MAIN ] Update Progress: 1388/2372 symbols completed. MOV took 24.2s. Estimated remaining: 2h 10m 42s. Rate: 7.5 symbols/min [2025-09-25T20:04:25.166418] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:25.182668] [DEBUG] [LOCAL ] MPA: Loaded 5208 existing records from primary storage. [2025-09-25T20:04:25.182830] [INFO ] [MAIN ] MPA: Loaded 5208 existing records. [2025-09-25T20:04:25.393359] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:25.393768] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-25T20:04:25.393824] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-25T20:04:25.394217] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-25T20:04:25.394288] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-25T20:04:25.494283] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-25T20:04:25.841507] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:04:25.864777] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:26.288757] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-25T20:04:26.548888] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T20:04:27.088751] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-25T20:04:27.353135] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T20:04:27.888730] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-25T20:04:28.349073] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T20:04:28.365935] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-25T20:04:28.688730] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-25T20:04:29.062265] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T20:04:29.071633] [INFO ] [REMOTE ] MOH: Full fetch complete (58304 records). [2025-09-25T20:04:29.071868] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-25T20:04:29.162898] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T20:04:29.514729] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-25T20:04:29.536525] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-25T20:04:29.536639] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-25T20:04:29.537874] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-25T20:04:29.537985] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-25T20:04:29.539491] [DEBUG] [LOCAL ] MOH: Trimmed 58304 records to 42116 (keeping 200 days of data) [2025-09-25T20:04:29.834615] [DEBUG] [LOCAL ] MOH: Primary data saved (42116 records). [2025-09-25T20:04:29.834863] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-25T20:04:29.835128] [INFO ] [MAIN ] Update Progress: 1389/2372 symbols completed. MOH took 31.8s. Estimated remaining: 2h 10m 32s. Rate: 7.5 symbols/min [2025-09-25T20:04:30.017939] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:30.100238] [DEBUG] [LOCAL ] MPC: Loaded 52122 existing records from primary storage. [2025-09-25T20:04:30.100430] [INFO ] [MAIN ] MPC: Loaded 52122 existing records. [2025-09-25T20:04:30.286064] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:30.287484] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-25T20:04:30.287544] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-25T20:04:30.287928] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-25T20:04:30.287997] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-25T20:04:30.292924] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-25T20:04:30.671427] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:31.088773] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-25T20:04:31.582847] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-25T20:04:31.865193] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T20:04:31.888678] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-25T20:04:32.047845] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T20:04:32.063257] [INFO ] [REMOTE ] MOS: Full fetch complete (77453 records). [2025-09-25T20:04:32.063490] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-25T20:04:32.518280] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:04:32.518820] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-25T20:04:32.518866] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-25T20:04:32.520284] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-25T20:04:32.520352] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-25T20:04:32.525960] [DEBUG] [LOCAL ] MOS: Trimmed 77453 records to 53896 (keeping 200 days of data) [2025-09-25T20:04:32.730230] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-25T20:04:32.917006] [DEBUG] [LOCAL ] MOS: Primary data saved (53896 records). [2025-09-25T20:04:32.917311] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-25T20:04:32.917542] [INFO ] [MAIN ] Update Progress: 1390/2372 symbols completed. MOS took 33.5s. Estimated remaining: 2h 10m 21s. Rate: 7.5 symbols/min [2025-09-25T20:04:33.111096] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:33.177339] [DEBUG] [LOCAL ] MPLX: Loaded 50731 existing records from primary storage. [2025-09-25T20:04:33.177533] [INFO ] [MAIN ] MPLX: Loaded 50731 existing records. [2025-09-25T20:04:33.367367] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:33.367868] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-25T20:04:33.367934] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-25T20:04:33.368282] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-25T20:04:33.368355] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-25T20:04:33.493950] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-25T20:04:33.753230] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:34.288699] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-25T20:04:34.336709] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T20:04:34.631282] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T20:04:35.088763] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-25T20:04:35.888744] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-25T20:04:36.682434] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-25T20:04:36.693869] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-25T20:04:36.935121] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:04:37.303085] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T20:04:37.365672] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T20:04:37.488694] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-25T20:04:38.124480] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:04:38.288738] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-25T20:04:39.089804] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-25T20:04:39.091107] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T20:04:39.888755] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-25T20:04:40.688723] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-25T20:04:41.415558] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-25T20:04:41.469482] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T20:04:41.488674] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-25T20:04:42.021759] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:04:42.288756] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-25T20:04:42.749784] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T20:04:43.088738] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-25T20:04:43.888745] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-25T20:04:44.178713] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T20:04:44.496808] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T20:04:44.688724] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-25T20:04:45.004693] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T20:04:45.488744] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-25T20:04:46.288816] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-25T20:04:47.094167] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-25T20:04:47.111400] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-25T20:04:47.422609] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T20:04:47.743521] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T20:04:47.789342] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T20:04:47.791066] [INFO ] [REMOTE ] MPA: Full fetch complete (7092 records). [2025-09-25T20:04:47.791155] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-25T20:04:47.893916] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-25T20:04:48.250389] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-25T20:04:48.250496] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-25T20:04:48.250766] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-25T20:04:48.250832] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-25T20:04:48.251336] [DEBUG] [LOCAL ] MPA: Trimmed 7092 records to 5231 (keeping 200 days of data) [2025-09-25T20:04:48.287398] [DEBUG] [LOCAL ] MPA: Primary data saved (5231 records). [2025-09-25T20:04:48.287583] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-25T20:04:48.287725] [INFO ] [MAIN ] Update Progress: 1391/2372 symbols completed. MPA took 23.3s. Estimated remaining: 2h 10m 18s. Rate: 7.5 symbols/min [2025-09-25T20:04:48.486112] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:04:48.496116] [DEBUG] [LOCAL ] MPV: Loaded 5054 existing records from primary storage. [2025-09-25T20:04:48.496327] [INFO ] [MAIN ] MPV: Loaded 5054 existing records. [2025-09-25T20:04:48.690736] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-25T20:04:48.693783] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:04:48.694162] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-25T20:04:48.694213] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-25T20:04:48.694529] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-25T20:04:48.694589] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-25T20:04:49.087960] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:04:49.488757] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-25T20:04:49.943041] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T20:04:49.988802] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T20:04:50.046492] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T20:04:50.288742] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-25T20:04:51.088959] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-25T20:04:51.781094] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T20:04:51.888822] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-25T20:04:52.688748] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-25T20:04:53.005069] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T20:04:53.134593] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T20:04:53.488771] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-25T20:04:54.214744] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T20:04:54.288727] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-25T20:04:54.698559] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-25T20:04:55.088740] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-25T20:04:55.888968] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-25T20:04:55.903076] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T20:04:56.688770] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-25T20:04:57.488769] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-25T20:04:57.532487] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-25T20:04:57.681101] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T20:04:58.310130] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-25T20:04:58.278158] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T20:04:58.365095] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T20:04:59.088859] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-25T20:04:59.889016] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-25T20:05:00.514718] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T20:05:00.688825] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-25T20:05:01.121872] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T20:05:01.146384] [INFO ] [REMOTE ] MPC: Full fetch complete (75895 records). [2025-09-25T20:05:01.146788] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-25T20:05:01.155595] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T20:05:01.305741] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-25T20:05:01.371495] [INFO ] [REMOTE ] MP: Full fetch complete (77300 records). [2025-09-25T20:05:01.371859] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-25T20:05:01.490040] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-25T20:05:02.240138] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-25T20:05:02.240286] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-25T20:05:02.242401] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-25T20:05:02.242520] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-25T20:05:02.251452] [DEBUG] [LOCAL ] MPC: Trimmed 75895 records to 52505 (keeping 200 days of data) [2025-09-25T20:05:02.290728] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-25T20:05:02.711968] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-25T20:05:02.712070] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-25T20:05:02.712904] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-25T20:05:02.712977] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-25T20:05:02.726869] [DEBUG] [LOCAL ] MP: Trimmed 77300 records to 54054 (keeping 200 days of data) [2025-09-25T20:05:03.085308] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:05:03.094388] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-25T20:05:03.230516] [DEBUG] [LOCAL ] MPC: Primary data saved (52505 records). [2025-09-25T20:05:03.230760] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-25T20:05:03.230982] [INFO ] [MAIN ] Update Progress: 1392/2372 symbols completed. MPC took 33.4s. Estimated remaining: 2h 10m 15s. Rate: 7.5 symbols/min [2025-09-25T20:05:03.441129] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T20:05:03.443843] [DEBUG] [LOCAL ] MP: Primary data saved (54054 records). [2025-09-25T20:05:03.443938] [INFO ] [MAIN ] MP: Full history saved. [2025-09-25T20:05:03.444073] [INFO ] [MAIN ] Update Progress: 1393/2372 symbols completed. MP took 50.4s. Estimated remaining: 2h 10m 1s. Rate: 7.5 symbols/min [2025-09-25T20:05:03.632260] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:03.774089] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:03.780065] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:05:03.808222] [DEBUG] [LOCAL ] MPX: Loaded 4165 existing records from primary storage. [2025-09-25T20:05:03.808421] [INFO ] [MAIN ] MPX: Loaded 4165 existing records. [2025-09-25T20:05:03.811064] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-25T20:05:03.821687] [INFO ] [MAIN ] MPW: Loaded 53501 existing records. [2025-09-25T20:05:03.892794] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-25T20:05:04.228978] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:04.257370] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:04.257629] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-25T20:05:04.257743] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-25T20:05:04.258074] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-25T20:05:04.258148] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-25T20:05:04.258416] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-25T20:05:04.258509] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-25T20:05:04.263772] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-25T20:05:04.303936] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-25T20:05:04.714886] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-25T20:05:05.080639] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:05.086498] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:05.357738] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T20:05:05.488714] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-25T20:05:05.811635] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T20:05:05.828608] [INFO ] [REMOTE ] MPLX: Full fetch complete (74038 records). [2025-09-25T20:05:05.828839] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-25T20:05:06.239932] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-25T20:05:06.240036] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-25T20:05:06.241694] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-25T20:05:06.241773] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-25T20:05:06.243594] [DEBUG] [LOCAL ] MPLX: Trimmed 74038 records to 51120 (keeping 200 days of data) [2025-09-25T20:05:06.313135] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-25T20:05:06.610304] [DEBUG] [LOCAL ] MPLX: Primary data saved (51120 records). [2025-09-25T20:05:06.610507] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-25T20:05:06.612257] [INFO ] [MAIN ] Update Progress: 1394/2372 symbols completed. MPLX took 33.7s. Estimated remaining: 2h 9m 50s. Rate: 7.5 symbols/min [2025-09-25T20:05:06.787332] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:06.805412] [DEBUG] [LOCAL ] MQT: Loaded 8446 existing records from primary storage. [2025-09-25T20:05:06.805580] [INFO ] [MAIN ] MQT: Loaded 8446 existing records. [2025-09-25T20:05:07.006531] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:07.006998] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-25T20:05:07.007049] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-25T20:05:07.007272] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-25T20:05:07.007336] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-25T20:05:07.057493] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T20:05:07.060179] [INFO ] [REMOTE ] MPV: Full fetch complete (8047 records). [2025-09-25T20:05:07.089154] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-25T20:05:07.089736] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-25T20:05:07.699168] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-25T20:05:07.816040] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T20:05:07.901948] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-25T20:05:07.920363] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:07.983842] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-25T20:05:07.983959] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-25T20:05:07.984370] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-25T20:05:07.984436] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-25T20:05:07.984976] [DEBUG] [LOCAL ] MPV: Trimmed 8047 records to 5079 (keeping 200 days of data) [2025-09-25T20:05:08.026481] [DEBUG] [LOCAL ] MPV: Primary data saved (5079 records). [2025-09-25T20:05:08.026632] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-25T20:05:08.026818] [INFO ] [MAIN ] Update Progress: 1395/2372 symbols completed. MPV took 19.7s. Estimated remaining: 2h 9m 37s. Rate: 7.5 symbols/min [2025-09-25T20:05:08.225124] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:08.259981] [DEBUG] [LOCAL ] MQY: Loaded 16761 existing records from primary storage. [2025-09-25T20:05:08.260153] [INFO ] [MAIN ] MQY: Loaded 16761 existing records. [2025-09-25T20:05:08.460035] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:08.461325] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-25T20:05:08.461390] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-25T20:05:08.461707] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-25T20:05:08.461779] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-25T20:05:08.696775] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-25T20:05:08.868174] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:09.457710] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T20:05:09.488746] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-25T20:05:09.883319] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T20:05:10.288805] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-25T20:05:10.466082] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T20:05:11.014725] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T20:05:11.088715] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-25T20:05:11.591265] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T20:05:11.888741] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-25T20:05:12.688751] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-25T20:05:13.320165] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T20:05:13.488755] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-25T20:05:13.689266] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T20:05:14.288692] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-25T20:05:14.618054] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T20:05:15.088766] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-25T20:05:15.888792] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-25T20:05:16.085018] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T20:05:16.274613] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:05:16.515900] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T20:05:16.688751] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-25T20:05:17.488753] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-25T20:05:17.769430] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T20:05:18.288755] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-25T20:05:19.088751] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-25T20:05:19.378716] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:05:19.425867] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T20:05:19.775078] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T20:05:19.888740] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-25T20:05:20.538452] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T20:05:20.688743] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-25T20:05:21.488820] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-25T20:05:22.288750] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-25T20:05:22.356306] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T20:05:22.619156] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T20:05:22.740863] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T20:05:23.088740] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-25T20:05:23.691575] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T20:05:23.888746] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-25T20:05:24.482987] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T20:05:24.688762] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-25T20:05:25.488759] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-25T20:05:25.702417] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T20:05:26.288724] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-25T20:05:26.359049] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:05:27.084222] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T20:05:27.088686] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-25T20:05:27.888789] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-25T20:05:28.146401] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T20:05:28.688744] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-25T20:05:29.290834] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T20:05:29.292468] [INFO ] [REMOTE ] MPX: Full fetch complete (6817 records). [2025-09-25T20:05:29.296588] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-25T20:05:29.489078] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-25T20:05:29.755682] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-25T20:05:29.755831] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-25T20:05:29.756138] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-25T20:05:29.756240] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-25T20:05:29.756851] [DEBUG] [LOCAL ] MPX: Trimmed 6817 records to 4198 (keeping 200 days of data) [2025-09-25T20:05:29.794843] [DEBUG] [LOCAL ] MPX: Primary data saved (4198 records). [2025-09-25T20:05:29.795016] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-25T20:05:29.795247] [INFO ] [MAIN ] Update Progress: 1396/2372 symbols completed. MPX took 26.4s. Estimated remaining: 2h 9m 39s. Rate: 7.5 symbols/min [2025-09-25T20:05:29.971374] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-25T20:05:30.054892] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:30.123452] [DEBUG] [LOCAL ] MRC: Loaded 37590 existing records from primary storage. [2025-09-25T20:05:30.123716] [INFO ] [MAIN ] MRC: Loaded 37590 existing records. [2025-09-25T20:05:30.310753] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-25T20:05:30.320599] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:30.321024] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-25T20:05:30.321129] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-25T20:05:30.321764] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-25T20:05:30.321826] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-25T20:05:30.696475] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T20:05:30.707086] [INFO ] [REMOTE ] MQY: Full fetch complete (27122 records). [2025-09-25T20:05:30.707234] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-25T20:05:30.885081] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:31.094803] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-25T20:05:31.172813] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-25T20:05:31.172931] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-25T20:05:31.173960] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-25T20:05:31.174060] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-25T20:05:31.177785] [DEBUG] [LOCAL ] MQY: Trimmed 27122 records to 16881 (keeping 200 days of data) [2025-09-25T20:05:31.303217] [DEBUG] [LOCAL ] MQY: Primary data saved (16881 records). [2025-09-25T20:05:31.303397] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-25T20:05:31.303569] [INFO ] [MAIN ] Update Progress: 1397/2372 symbols completed. MQY took 23.3s. Estimated remaining: 2h 9m 27s. Rate: 7.5 symbols/min [2025-09-25T20:05:31.888787] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-25T20:05:31.903672] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T20:05:32.410304] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T20:05:32.688849] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-25T20:05:33.284692] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T20:05:33.488775] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-25T20:05:34.288758] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-25T20:05:34.567746] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:05:34.982360] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T20:05:35.088693] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-25T20:05:35.235243] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T20:05:35.888816] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-25T20:05:36.497268] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T20:05:36.572225] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T20:05:36.688742] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-25T20:05:37.272251] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T20:05:37.488832] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-25T20:05:38.288772] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-25T20:05:39.088714] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-25T20:05:39.562150] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-25T20:05:39.575602] [INFO ] [REMOTE ] MPW: Full fetch complete (77524 records). [2025-09-25T20:05:39.575859] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-25T20:05:39.860851] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-25T20:05:39.893305] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-25T20:05:40.056603] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-25T20:05:40.056825] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-25T20:05:40.058104] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-25T20:05:40.058209] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-25T20:05:40.071485] [DEBUG] [LOCAL ] MPW: Trimmed 77524 records to 53889 (keeping 200 days of data) [2025-09-25T20:05:40.116764] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:05:40.484610] [DEBUG] [LOCAL ] MPW: Primary data saved (53889 records). [2025-09-25T20:05:40.484825] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-25T20:05:40.485181] [INFO ] [MAIN ] Update Progress: 1398/2372 symbols completed. MPW took 37.3s. Estimated remaining: 2h 9m 20s. Rate: 7.5 symbols/min [2025-09-25T20:05:40.628716] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:05:40.688674] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-25T20:05:41.488775] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-25T20:05:41.506762] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T20:05:41.511709] [INFO ] [REMOTE ] MQT: Full fetch complete (13290 records). [2025-09-25T20:05:41.511814] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-25T20:05:41.948244] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-25T20:05:41.948433] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-25T20:05:41.948909] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-25T20:05:41.948995] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-25T20:05:41.949602] [DEBUG] [LOCAL ] MQT: Trimmed 13290 records to 8472 (keeping 200 days of data) [2025-09-25T20:05:42.013552] [DEBUG] [LOCAL ] MQT: Primary data saved (8472 records). [2025-09-25T20:05:42.013921] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-25T20:05:42.014132] [INFO ] [MAIN ] Update Progress: 1399/2372 symbols completed. MQT took 35.4s. Estimated remaining: 2h 9m 7s. Rate: 7.5 symbols/min [2025-09-25T20:05:42.977490] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T20:05:42.987044] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-25T20:05:44.370232] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T20:05:44.380932] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-25T20:05:45.821928] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T20:05:45.829872] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-25T20:05:47.345389] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T20:05:47.355542] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-25T20:05:48.694674] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T20:05:48.703461] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-25T20:05:50.270545] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T20:05:50.279080] [INFO ] [REMOTE ] MRC: Full fetch complete (54651 records). [2025-09-25T20:05:50.279210] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-25T20:05:50.753770] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-25T20:05:50.753883] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-25T20:05:50.755301] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-25T20:05:50.755403] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-25T20:05:50.756865] [DEBUG] [LOCAL ] MRC: Trimmed 54651 records to 37865 (keeping 200 days of data) [2025-09-25T20:05:51.018191] [DEBUG] [LOCAL ] MRC: Primary data saved (37865 records). [2025-09-25T20:05:51.018396] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-25T20:05:51.018569] [INFO ] [MAIN ] Update Progress: 1400/2372 symbols completed. MRC took 21.2s. Estimated remaining: 2h 8m 60s. Rate: 7.5 symbols/min [2025-09-25T20:05:51.763542] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:51.776149] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:51.776301] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-25T20:05:51.776360] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-25T20:05:51.776550] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-25T20:05:51.776594] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-25T20:05:51.776635] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-25T20:05:51.776712] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-25T20:05:51.786208] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:51.817790] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:05:51.925284] [DEBUG] [LOCAL ] MSA: Loaded 18776 existing records from primary storage. [2025-09-25T20:05:51.925486] [INFO ] [MAIN ] MSA: Loaded 18776 existing records. [2025-09-25T20:05:52.116329] [DEBUG] [LOCAL ] MS: Loaded 53693 existing records from primary storage. [2025-09-25T20:05:52.116637] [INFO ] [MAIN ] MS: Loaded 53693 existing records. [2025-09-25T20:05:52.184381] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-25T20:05:52.184638] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-09-25T20:05:52.879353] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:52.890921] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-25T20:05:52.890976] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-25T20:05:52.891384] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-25T20:05:52.891445] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-25T20:05:52.967183] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:52.967514] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-25T20:05:52.967563] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-25T20:05:52.967977] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-25T20:05:52.968041] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-25T20:05:53.019103] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:05:53.029175] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-25T20:05:53.029231] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-25T20:05:53.029554] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-25T20:05:53.029614] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-25T20:05:53.214749] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:53.228341] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-25T20:05:53.509969] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:05:53.510834] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-25T20:05:53.511629] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-25T20:05:53.841010] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:05:53.841570] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-25T20:05:53.842225] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-25T20:05:54.401821] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:54.436045] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-25T20:05:54.446718] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:54.464775] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-25T20:05:54.572442] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:05:54.572898] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-25T20:05:55.442588] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T20:05:55.447407] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:05:55.450666] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-25T20:05:55.460320] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-25T20:05:56.360685] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T20:05:56.376911] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-25T20:05:56.408032] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T20:05:56.412798] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-25T20:05:56.546257] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T20:05:56.562789] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-25T20:05:57.200035] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:05:57.211797] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-25T20:05:57.244990] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T20:05:57.249303] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-25T20:05:58.296168] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-25T20:05:58.303367] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-25T20:05:58.490265] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T20:05:58.503335] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-25T20:05:58.561722] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T20:05:58.573435] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-25T20:05:58.643818] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-25T20:05:59.088756] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-25T20:05:59.195477] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T20:05:59.824722] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T20:05:59.888754] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-25T20:06:00.363609] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T20:06:00.690758] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-25T20:06:00.694046] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:06:01.432127] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:06:01.488754] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-25T20:06:02.222899] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T20:06:02.288748] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-25T20:06:03.088752] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-25T20:06:03.366405] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T20:06:03.521826] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-25T20:06:03.888733] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-25T20:06:04.688890] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-25T20:06:05.050305] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:06:05.488812] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-25T20:06:06.288765] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-25T20:06:06.363874] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-25T20:06:06.469371] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T20:06:07.088775] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-25T20:06:07.419350] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:06:07.613381] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-25T20:06:07.888743] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-25T20:06:08.618746] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T20:06:08.688675] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-25T20:06:09.488691] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-25T20:06:10.017798] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T20:06:10.288718] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-25T20:06:10.550770] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T20:06:10.564176] [INFO ] [REMOTE ] MRP: Full fetch complete (54919 records). [2025-09-25T20:06:10.564497] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-25T20:06:10.793369] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-25T20:06:10.794526] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:06:10.794670] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:06:10.794813] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-25T20:06:10.794950] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-25T20:06:10.795045] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-25T20:06:10.795131] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-25T20:06:10.795294] [INFO ] [MAIN ] Update Progress: 1401/2372 symbols completed. MRP took 19.8s. Estimated remaining: 2h 9m 0s. Rate: 7.5 symbols/min [2025-09-25T20:06:10.983910] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:11.002474] [DEBUG] [LOCAL ] MSB: Loaded 7829 existing records from primary storage. [2025-09-25T20:06:11.002673] [INFO ] [MAIN ] MSB: Loaded 7829 existing records. [2025-09-25T20:06:11.093886] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-25T20:06:11.224218] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:06:11.224659] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-25T20:06:11.224726] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-25T20:06:11.225141] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-25T20:06:11.225204] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-25T20:06:11.627896] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T20:06:11.664035] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:11.732613] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-25T20:06:11.888718] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-25T20:06:12.688836] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-25T20:06:13.094268] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T20:06:13.237318] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T20:06:13.488751] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-25T20:06:14.125421] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-25T20:06:14.288705] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-25T20:06:14.493421] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T20:06:15.088690] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-25T20:06:15.462702] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T20:06:15.467108] [INFO ] [REMOTE ] MSA: Full fetch complete (25743 records). [2025-09-25T20:06:15.467264] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-25T20:06:15.868581] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-25T20:06:15.868700] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-25T20:06:15.869459] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-25T20:06:15.869539] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-25T20:06:15.877684] [DEBUG] [LOCAL ] MSA: Trimmed 25743 records to 18891 (keeping 200 days of data) [2025-09-25T20:06:15.888693] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-25T20:06:16.032131] [DEBUG] [LOCAL ] MSA: Primary data saved (18891 records). [2025-09-25T20:06:16.032335] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-25T20:06:16.032479] [INFO ] [MAIN ] Update Progress: 1402/2372 symbols completed. MSA took 25.0s. Estimated remaining: 2h 8m 50s. Rate: 7.5 symbols/min [2025-09-25T20:06:16.219632] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:16.219971] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-25T20:06:16.220045] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-25T20:06:16.220753] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-25T20:06:16.220817] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-25T20:06:16.220885] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-25T20:06:16.220932] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-25T20:06:16.598538] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:16.688709] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-25T20:06:16.830553] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T20:06:17.052300] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T20:06:17.488775] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-25T20:06:17.544838] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-25T20:06:18.288830] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-25T20:06:19.088760] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-25T20:06:19.426224] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T20:06:19.888741] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-25T20:06:19.914357] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T20:06:20.414574] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-25T20:06:20.679872] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-25T20:06:20.690870] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-25T20:06:21.271118] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T20:06:21.488739] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-25T20:06:22.288770] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-25T20:06:23.088753] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-25T20:06:23.115430] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:06:23.572320] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T20:06:23.751985] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-25T20:06:23.763327] [INFO ] [REMOTE ] MRK: Full fetch complete (77857 records). [2025-09-25T20:06:23.763513] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-25T20:06:23.893835] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-25T20:06:24.187345] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-25T20:06:24.187456] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-25T20:06:24.188934] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-25T20:06:24.189003] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-25T20:06:24.191741] [DEBUG] [LOCAL ] MRK: Trimmed 77857 records to 54179 (keeping 200 days of data) [2025-09-25T20:06:24.577620] [DEBUG] [LOCAL ] MRK: Primary data saved (54179 records). [2025-09-25T20:06:24.577813] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-25T20:06:24.577945] [INFO ] [MAIN ] Update Progress: 1403/2372 symbols completed. MRK took 33.6s. Estimated remaining: 2h 8m 43s. Rate: 7.5 symbols/min [2025-09-25T20:06:24.695375] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-25T20:06:24.772326] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:24.826549] [DEBUG] [LOCAL ] MSCI: Loaded 34828 existing records from primary storage. [2025-09-25T20:06:24.826762] [INFO ] [MAIN ] MSCI: Loaded 34828 existing records. [2025-09-25T20:06:25.010085] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:06:25.010659] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-25T20:06:25.010734] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-25T20:06:25.011107] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-25T20:06:25.011177] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-25T20:06:25.085434] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T20:06:25.374714] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:25.488699] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-25T20:06:25.850089] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T20:06:26.027145] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-25T20:06:26.288745] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-25T20:06:26.642093] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-25T20:06:27.088753] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-25T20:06:27.543463] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-25T20:06:27.888726] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-25T20:06:28.688750] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-25T20:06:29.426518] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T20:06:29.488675] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-25T20:06:30.073724] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-25T20:06:30.092587] [INFO ] [REMOTE ] MS: Full fetch complete (77718 records). [2025-09-25T20:06:30.094778] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-25T20:06:30.294448] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-25T20:06:30.309928] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T20:06:30.547865] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-25T20:06:30.547979] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-25T20:06:30.549555] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-25T20:06:30.549628] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-25T20:06:30.553783] [DEBUG] [LOCAL ] MS: Trimmed 77718 records to 54082 (keeping 200 days of data) [2025-09-25T20:06:30.935981] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T20:06:30.948294] [DEBUG] [LOCAL ] MS: Primary data saved (54082 records). [2025-09-25T20:06:30.948499] [INFO ] [MAIN ] MS: Full history saved. [2025-09-25T20:06:30.948670] [INFO ] [MAIN ] Update Progress: 1404/2372 symbols completed. MS took 39.9s. Estimated remaining: 2h 8m 34s. Rate: 7.5 symbols/min [2025-09-25T20:06:31.095170] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-25T20:06:31.137533] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:31.166596] [DEBUG] [LOCAL ] MSD: Loaded 15558 existing records from primary storage. [2025-09-25T20:06:31.168784] [INFO ] [MAIN ] MSD: Loaded 15558 existing records. [2025-09-25T20:06:31.352091] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:06:31.352864] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-25T20:06:31.352917] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-25T20:06:31.353193] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-25T20:06:31.353254] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-25T20:06:31.714088] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:31.786466] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T20:06:31.787847] [INFO ] [REMOTE ] MSC: Full fetch complete (2503 records). [2025-09-25T20:06:31.787924] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-25T20:06:31.894717] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-25T20:06:32.010414] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-25T20:06:32.010810] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:06:32.010902] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:06:32.010976] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-25T20:06:32.011082] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-25T20:06:32.011155] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-25T20:06:32.011228] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-25T20:06:32.011335] [INFO ] [MAIN ] Update Progress: 1405/2372 symbols completed. MSC took 16.0s. Estimated remaining: 2h 8m 21s. Rate: 7.5 symbols/min [2025-09-25T20:06:32.208917] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:32.274275] [DEBUG] [LOCAL ] MSDL: Loaded 38031 existing records from primary storage. [2025-09-25T20:06:32.274450] [INFO ] [MAIN ] MSDL: Loaded 38031 existing records. [2025-09-25T20:06:32.471856] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:06:32.472317] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-25T20:06:32.472384] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-25T20:06:32.472759] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-25T20:06:32.472819] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-25T20:06:32.694737] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-25T20:06:32.887508] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:33.392616] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T20:06:33.410779] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T20:06:33.488733] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-25T20:06:34.202361] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T20:06:34.288732] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-25T20:06:35.088753] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-25T20:06:35.730351] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T20:06:35.888722] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-25T20:06:36.414271] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T20:06:36.688742] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-25T20:06:37.264400] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T20:06:37.488742] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-25T20:06:38.047754] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:06:38.288713] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-25T20:06:39.010844] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T20:06:39.081044] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T20:06:39.088670] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-25T20:06:39.877373] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:06:39.879604] [INFO ] [REMOTE ] MSB: Full fetch complete (12847 records). [2025-09-25T20:06:39.879723] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-25T20:06:39.893915] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-25T20:06:40.293138] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-25T20:06:40.293440] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-25T20:06:40.293945] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-25T20:06:40.294087] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-25T20:06:40.295829] [DEBUG] [LOCAL ] MSB: Trimmed 12847 records to 7865 (keeping 200 days of data) [2025-09-25T20:06:40.355370] [DEBUG] [LOCAL ] MSB: Primary data saved (7865 records). [2025-09-25T20:06:40.355534] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-25T20:06:40.355769] [INFO ] [MAIN ] Update Progress: 1406/2372 symbols completed. MSB took 29.6s. Estimated remaining: 2h 8m 13s. Rate: 7.5 symbols/min [2025-09-25T20:06:40.536321] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:06:40.583512] [DEBUG] [LOCAL ] MSGE: Loaded 27077 existing records from primary storage. [2025-09-25T20:06:40.583758] [INFO ] [MAIN ] MSGE: Loaded 27077 existing records. [2025-09-25T20:06:40.700757] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-25T20:06:40.809888] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:06:40.813946] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-25T20:06:40.814019] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-25T20:06:40.817674] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-25T20:06:40.817753] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-25T20:06:40.960781] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T20:06:41.259221] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:06:41.488820] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-25T20:06:42.115600] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T20:06:42.288763] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-25T20:06:42.482608] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:06:43.088749] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-25T20:06:43.222028] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T20:06:43.888679] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-25T20:06:44.361723] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T20:06:44.688795] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-25T20:06:45.447813] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:06:45.488730] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-25T20:06:45.776018] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:06:46.288886] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-25T20:06:46.978705] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T20:06:47.088733] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-25T20:06:47.567842] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T20:06:47.888749] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-25T20:06:48.212114] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T20:06:48.688761] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-25T20:06:49.292039] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-25T20:06:49.488719] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-25T20:06:49.700334] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T20:06:50.288801] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-25T20:06:50.351574] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T20:06:51.088790] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-25T20:06:51.556784] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T20:06:51.888782] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-25T20:06:52.402550] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T20:06:52.688736] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-25T20:06:52.925328] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T20:06:53.488743] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-25T20:06:54.288748] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-25T20:06:54.410718] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T20:06:54.445130] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T20:06:55.088745] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-25T20:06:55.438458] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T20:06:55.888695] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-25T20:06:56.244829] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T20:06:56.688735] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-25T20:06:57.312638] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T20:06:57.488693] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-25T20:06:58.199915] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T20:06:58.288683] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-25T20:06:58.679262] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T20:06:59.088696] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-25T20:06:59.432215] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T20:06:59.888687] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-25T20:06:59.950007] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T20:07:00.688782] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-25T20:07:01.010256] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T20:07:01.016130] [INFO ] [REMOTE ] MSD: Full fetch complete (22195 records). [2025-09-25T20:07:01.016326] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-25T20:07:01.448685] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-25T20:07:01.448823] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-25T20:07:01.449576] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-25T20:07:01.449693] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-25T20:07:01.450776] [DEBUG] [LOCAL ] MSD: Trimmed 22195 records to 15655 (keeping 200 days of data) [2025-09-25T20:07:01.503058] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-25T20:07:01.575859] [DEBUG] [LOCAL ] MSD: Primary data saved (15655 records). [2025-09-25T20:07:01.576078] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-25T20:07:01.576335] [INFO ] [MAIN ] Update Progress: 1407/2372 symbols completed. MSD took 30.6s. Estimated remaining: 2h 8m 14s. Rate: 7.5 symbols/min [2025-09-25T20:07:01.775323] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:01.806916] [DEBUG] [LOCAL ] MSGS: Loaded 16903 existing records from primary storage. [2025-09-25T20:07:01.807149] [INFO ] [MAIN ] MSGS: Loaded 16903 existing records. [2025-09-25T20:07:02.014215] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:02.017671] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-25T20:07:02.017819] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-25T20:07:02.018188] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-25T20:07:02.018287] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-25T20:07:02.270225] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T20:07:02.294685] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-25T20:07:02.542854] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:02.891449] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T20:07:02.900920] [INFO ] [REMOTE ] MSCI: Full fetch complete (50402 records). [2025-09-25T20:07:02.901140] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-25T20:07:03.101733] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-25T20:07:03.329838] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-25T20:07:03.329931] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-25T20:07:03.330981] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-25T20:07:03.331046] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-25T20:07:03.332351] [DEBUG] [LOCAL ] MSCI: Trimmed 50402 records to 35077 (keeping 200 days of data) [2025-09-25T20:07:03.581141] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T20:07:03.609709] [DEBUG] [LOCAL ] MSCI: Primary data saved (35077 records). [2025-09-25T20:07:03.609875] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-25T20:07:03.611414] [INFO ] [MAIN ] Update Progress: 1408/2372 symbols completed. MSCI took 39.0s. Estimated remaining: 2h 8m 2s. Rate: 7.5 symbols/min [2025-09-25T20:07:03.786793] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:03.851626] [DEBUG] [LOCAL ] MSI: Loaded 40594 existing records from primary storage. [2025-09-25T20:07:03.851826] [INFO ] [MAIN ] MSI: Loaded 40594 existing records. [2025-09-25T20:07:03.890235] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-25T20:07:04.028062] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T20:07:04.060221] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:04.060503] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-25T20:07:04.060551] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-25T20:07:04.061111] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-25T20:07:04.061176] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-25T20:07:04.447367] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:04.688768] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-25T20:07:05.138568] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T20:07:05.488757] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-25T20:07:06.288722] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-25T20:07:06.348591] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T20:07:06.814607] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:07:06.822586] [INFO ] [REMOTE ] MSGE: Full fetch complete (40122 records). [2025-09-25T20:07:06.822759] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-25T20:07:07.093795] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-25T20:07:07.211118] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-25T20:07:07.211221] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-25T20:07:07.212336] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-25T20:07:07.212404] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-25T20:07:07.213768] [DEBUG] [LOCAL ] MSGE: Trimmed 40122 records to 27270 (keeping 200 days of data) [2025-09-25T20:07:07.404727] [DEBUG] [LOCAL ] MSGE: Primary data saved (27270 records). [2025-09-25T20:07:07.404961] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-25T20:07:07.405125] [INFO ] [MAIN ] Update Progress: 1409/2372 symbols completed. MSGE took 27.0s. Estimated remaining: 2h 7m 51s. Rate: 7.5 symbols/min [2025-09-25T20:07:07.603555] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:07.603783] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-25T20:07:07.603830] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-25T20:07:07.604606] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-25T20:07:07.604688] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-25T20:07:07.604754] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-25T20:07:07.604790] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-25T20:07:07.905443] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-25T20:07:07.981681] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:07:08.032215] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T20:07:08.077017] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:08.688776] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-25T20:07:09.367936] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T20:07:09.377938] [INFO ] [REMOTE ] MSDL: Full fetch complete (54392 records). [2025-09-25T20:07:09.378144] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-25T20:07:09.495330] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-25T20:07:09.748560] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:07:09.749039] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-25T20:07:09.861208] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-25T20:07:09.861368] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-25T20:07:09.862876] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-25T20:07:09.862966] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-25T20:07:09.865531] [DEBUG] [LOCAL ] MSDL: Trimmed 54392 records to 38380 (keeping 200 days of data) [2025-09-25T20:07:09.976500] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T20:07:10.179956] [DEBUG] [LOCAL ] MSDL: Primary data saved (38380 records). [2025-09-25T20:07:10.180158] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-25T20:07:10.180275] [INFO ] [MAIN ] Update Progress: 1410/2372 symbols completed. MSDL took 38.2s. Estimated remaining: 2h 7m 40s. Rate: 7.5 symbols/min [2025-09-25T20:07:10.293087] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-25T20:07:10.372464] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:10.419337] [DEBUG] [LOCAL ] MSM: Loaded 35344 existing records from primary storage. [2025-09-25T20:07:10.419511] [INFO ] [MAIN ] MSM: Loaded 35344 existing records. [2025-09-25T20:07:10.598629] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:10.599318] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-25T20:07:10.599369] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-25T20:07:10.599717] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-25T20:07:10.599786] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-25T20:07:10.959123] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:11.088726] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-25T20:07:11.832926] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T20:07:11.888742] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-25T20:07:12.016366] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T20:07:12.688751] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-25T20:07:13.420443] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T20:07:13.488685] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-25T20:07:13.784760] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T20:07:14.288865] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-25T20:07:15.088804] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-25T20:07:15.124388] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T20:07:15.675037] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T20:07:15.889117] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-25T20:07:15.900442] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T20:07:16.688827] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-25T20:07:16.769717] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T20:07:17.488849] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-25T20:07:18.180396] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T20:07:18.290011] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-25T20:07:18.590856] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T20:07:19.088779] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-25T20:07:19.888782] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-25T20:07:19.960934] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T20:07:20.149778] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:07:20.688773] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-25T20:07:20.983473] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T20:07:21.488853] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-25T20:07:21.800268] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T20:07:22.122962] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:07:22.288772] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-25T20:07:23.010781] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T20:07:23.088744] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-25T20:07:23.888781] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-25T20:07:24.527624] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T20:07:24.594122] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T20:07:24.688740] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-25T20:07:25.488938] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-25T20:07:26.081256] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T20:07:26.272620] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T20:07:26.288771] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-25T20:07:27.088825] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-25T20:07:27.890992] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-25T20:07:27.908256] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T20:07:28.194742] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T20:07:28.688743] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-25T20:07:29.483271] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T20:07:29.496714] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-25T20:07:29.974903] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T20:07:30.288757] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-25T20:07:30.876087] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T20:07:31.088733] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-25T20:07:31.249465] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T20:07:31.888748] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-25T20:07:32.688751] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-25T20:07:32.707696] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T20:07:32.891334] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T20:07:32.901146] [INFO ] [REMOTE ] MSI: Full fetch complete (58675 records). [2025-09-25T20:07:32.901420] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-25T20:07:33.350370] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-25T20:07:33.350531] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-25T20:07:33.351853] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-25T20:07:33.351970] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-25T20:07:33.353884] [DEBUG] [LOCAL ] MSI: Trimmed 58675 records to 40895 (keeping 200 days of data) [2025-09-25T20:07:33.488872] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-25T20:07:33.676961] [DEBUG] [LOCAL ] MSI: Primary data saved (40895 records). [2025-09-25T20:07:33.677140] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-25T20:07:33.679675] [INFO ] [MAIN ] Update Progress: 1411/2372 symbols completed. MSI took 30.1s. Estimated remaining: 2h 7m 43s. Rate: 7.5 symbols/min [2025-09-25T20:07:33.867618] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:33.944270] [DEBUG] [LOCAL ] MT: Loaded 50682 existing records from primary storage. [2025-09-25T20:07:33.944516] [INFO ] [MAIN ] MT: Loaded 50682 existing records. [2025-09-25T20:07:34.074214] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T20:07:34.201125] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:34.204881] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-25T20:07:34.204963] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-25T20:07:34.205407] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-25T20:07:34.205494] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-25T20:07:34.293848] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-25T20:07:34.613177] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:34.661227] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T20:07:35.088721] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-25T20:07:35.704747] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T20:07:35.711797] [INFO ] [REMOTE ] MSGS: Full fetch complete (22530 records). [2025-09-25T20:07:35.711888] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-25T20:07:35.891796] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-25T20:07:36.118074] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-25T20:07:36.118165] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-25T20:07:36.119485] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-25T20:07:36.119550] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-25T20:07:36.122733] [DEBUG] [LOCAL ] MSGS: Trimmed 22530 records to 17083 (keeping 200 days of data) [2025-09-25T20:07:36.262387] [DEBUG] [LOCAL ] MSGS: Primary data saved (17083 records). [2025-09-25T20:07:36.262592] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-25T20:07:36.262881] [INFO ] [MAIN ] Update Progress: 1412/2372 symbols completed. MSGS took 34.7s. Estimated remaining: 2h 7m 31s. Rate: 7.5 symbols/min [2025-09-25T20:07:36.454562] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:36.515757] [DEBUG] [LOCAL ] MTAL: Loaded 36387 existing records from primary storage. [2025-09-25T20:07:36.515925] [INFO ] [MAIN ] MTAL: Loaded 36387 existing records. [2025-09-25T20:07:36.700746] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-25T20:07:36.718400] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T20:07:36.763595] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:36.764220] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-25T20:07:36.764271] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-25T20:07:36.766439] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-25T20:07:36.766505] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-25T20:07:37.139023] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:37.468026] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T20:07:37.488671] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-25T20:07:37.832903] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T20:07:37.839991] [INFO ] [REMOTE ] MSIF: Full fetch complete (16392 records). [2025-09-25T20:07:37.840095] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-25T20:07:38.072578] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-25T20:07:38.073806] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:07:38.074040] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:07:38.074321] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-25T20:07:38.074418] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-25T20:07:38.074488] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-25T20:07:38.074580] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-25T20:07:38.074700] [INFO ] [MAIN ] Update Progress: 1413/2372 symbols completed. MSIF took 30.7s. Estimated remaining: 2h 7m 19s. Rate: 7.5 symbols/min [2025-09-25T20:07:38.259751] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:38.288711] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-25T20:07:38.341685] [DEBUG] [LOCAL ] MTB: Loaded 46971 existing records from primary storage. [2025-09-25T20:07:38.341908] [INFO ] [MAIN ] MTB: Loaded 46971 existing records. [2025-09-25T20:07:38.565466] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:38.565877] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-25T20:07:38.565931] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-25T20:07:38.572874] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-25T20:07:38.573150] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-25T20:07:38.628372] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T20:07:38.987948] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:39.088736] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-25T20:07:39.888746] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-25T20:07:40.127457] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T20:07:40.688936] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-25T20:07:40.688858] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T20:07:40.699961] [INFO ] [REMOTE ] MSM: Full fetch complete (52111 records). [2025-09-25T20:07:40.700164] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-25T20:07:41.054151] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T20:07:41.175245] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-25T20:07:41.175336] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-25T20:07:41.176483] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-25T20:07:41.176549] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-25T20:07:41.178607] [DEBUG] [LOCAL ] MSM: Trimmed 52111 records to 35693 (keeping 200 days of data) [2025-09-25T20:07:41.424274] [DEBUG] [LOCAL ] MSM: Primary data saved (35693 records). [2025-09-25T20:07:41.424463] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-25T20:07:41.424601] [INFO ] [MAIN ] Update Progress: 1414/2372 symbols completed. MSM took 31.2s. Estimated remaining: 2h 7m 8s. Rate: 7.5 symbols/min [2025-09-25T20:07:41.491379] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-25T20:07:41.611778] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:07:41.637350] [DEBUG] [LOCAL ] MTD: Loaded 15171 existing records from primary storage. [2025-09-25T20:07:41.637541] [INFO ] [MAIN ] MTD: Loaded 15171 existing records. [2025-09-25T20:07:41.821784] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:07:41.822225] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-25T20:07:41.822277] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-25T20:07:41.822551] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-25T20:07:41.822610] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-25T20:07:42.081552] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T20:07:42.231912] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:07:42.288695] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-25T20:07:42.613533] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:07:42.912016] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T20:07:43.088739] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-25T20:07:43.888747] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-25T20:07:44.001429] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:07:44.688831] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-25T20:07:45.488767] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-25T20:07:46.093717] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T20:07:46.288679] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-25T20:07:46.583762] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-25T20:07:47.088761] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-25T20:07:47.888792] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-25T20:07:48.952367] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-25T20:07:48.962340] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-25T20:07:49.122994] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (3.63 seconds). [2025-09-25T20:07:49.236946] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T20:07:49.488684] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-25T20:07:50.288756] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-25T20:07:50.566555] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (3.48 seconds). [2025-09-25T20:07:50.749603] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T20:07:50.951265] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T20:07:51.088722] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-25T20:07:51.303389] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T20:07:51.888822] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-25T20:07:52.378358] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T20:07:52.688847] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-25T20:07:53.467195] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:07:53.488677] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-25T20:07:54.122805] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T20:07:54.288810] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-25T20:07:55.088716] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-25T20:07:55.345117] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:07:55.739359] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T20:07:55.888787] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-25T20:07:56.021838] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:07:56.688839] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-25T20:07:57.150630] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T20:07:57.488758] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-25T20:07:58.265114] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T20:07:58.288703] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-25T20:07:58.490361] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T20:07:59.088889] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-25T20:07:59.888836] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-25T20:08:00.688733] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-25T20:08:01.038565] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-25T20:08:01.481200] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T20:08:01.488681] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-25T20:08:01.530278] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-25T20:08:02.228976] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T20:08:02.288741] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-25T20:08:02.449993] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T20:08:03.088753] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-25T20:08:03.825977] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:08:03.888724] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-25T20:08:04.688773] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-25T20:08:05.488746] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-25T20:08:05.593627] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:08:06.020351] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-25T20:08:06.029516] [INFO ] [REMOTE ] MTAL: Full fetch complete (46890 records). [2025-09-25T20:08:06.029671] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-25T20:08:06.250595] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T20:08:06.256388] [INFO ] [REMOTE ] MTD: Full fetch complete (21047 records). [2025-09-25T20:08:06.256537] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-25T20:08:06.291674] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-25T20:08:06.860566] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-25T20:08:06.860803] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-25T20:08:06.862115] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-25T20:08:06.862196] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-25T20:08:06.868971] [DEBUG] [LOCAL ] MTAL: Trimmed 46890 records to 36633 (keeping 200 days of data) [2025-09-25T20:08:07.087298] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-25T20:08:07.087418] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-25T20:08:07.087706] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-25T20:08:07.087778] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-25T20:08:07.091729] [DEBUG] [LOCAL ] MTD: Trimmed 21047 records to 15274 (keeping 200 days of data) [2025-09-25T20:08:07.316528] [DEBUG] [LOCAL ] MTD: Primary data saved (15274 records). [2025-09-25T20:08:07.316766] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-25T20:08:07.317133] [INFO ] [MAIN ] Update Progress: 1415/2372 symbols completed. MTD took 25.9s. Estimated remaining: 2h 7m 12s. Rate: 7.5 symbols/min [2025-09-25T20:08:07.451894] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T20:08:07.476684] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-25T20:08:07.567194] [DEBUG] [LOCAL ] MTAL: Primary data saved (36633 records). [2025-09-25T20:08:07.567380] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-25T20:08:07.567518] [INFO ] [MAIN ] Update Progress: 1416/2372 symbols completed. MTAL took 31.3s. Estimated remaining: 2h 6m 59s. Rate: 7.5 symbols/min [2025-09-25T20:08:07.619127] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:07.834204] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:07.855888] [DEBUG] [LOCAL ] MTDR: Loaded 51547 existing records from primary storage. [2025-09-25T20:08:07.856067] [INFO ] [MAIN ] MTDR: Loaded 51547 existing records. [2025-09-25T20:08:07.976120] [DEBUG] [LOCAL ] MTG: Loaded 51372 existing records from primary storage. [2025-09-25T20:08:07.976472] [INFO ] [MAIN ] MTG: Loaded 51372 existing records. [2025-09-25T20:08:08.220626] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T20:08:08.325143] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:08.325599] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-25T20:08:08.337105] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-25T20:08:08.337754] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-25T20:08:08.337838] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-25T20:08:08.346687] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-25T20:08:08.423545] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:08.466878] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-25T20:08:08.472697] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-25T20:08:08.488675] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-25T20:08:08.495730] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-25T20:08:09.217860] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:09.218301] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-25T20:08:09.243213] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:09.249940] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T20:08:09.488772] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-25T20:08:10.056815] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T20:08:10.288746] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-25T20:08:11.020167] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T20:08:11.088710] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-25T20:08:11.200345] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T20:08:11.888715] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-25T20:08:12.059271] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T20:08:12.074960] [INFO ] [REMOTE ] MTB: Full fetch complete (68324 records). [2025-09-25T20:08:12.075181] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-25T20:08:12.522458] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T20:08:12.555706] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-25T20:08:12.555788] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-25T20:08:12.557162] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-25T20:08:12.557228] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-25T20:08:12.558868] [DEBUG] [LOCAL ] MTB: Trimmed 68324 records to 47284 (keeping 200 days of data) [2025-09-25T20:08:12.688827] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-25T20:08:12.889475] [DEBUG] [LOCAL ] MTB: Primary data saved (47284 records). [2025-09-25T20:08:12.889678] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-25T20:08:12.889804] [INFO ] [MAIN ] Update Progress: 1417/2372 symbols completed. MTB took 34.8s. Estimated remaining: 2h 6m 49s. Rate: 7.5 symbols/min [2025-09-25T20:08:13.061446] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:13.129315] [DEBUG] [LOCAL ] MTH: Loaded 43867 existing records from primary storage. [2025-09-25T20:08:13.129486] [INFO ] [MAIN ] MTH: Loaded 43867 existing records. [2025-09-25T20:08:13.309918] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:13.310182] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-25T20:08:13.310229] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-25T20:08:13.310806] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-25T20:08:13.310871] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-25T20:08:13.489812] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-25T20:08:13.696613] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:13.890867] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T20:08:13.902867] [INFO ] [REMOTE ] MT: Full fetch complete (73438 records). [2025-09-25T20:08:13.903084] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-25T20:08:14.308591] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-25T20:08:14.356537] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:08:14.412033] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-25T20:08:14.412168] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-25T20:08:14.413856] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-25T20:08:14.413938] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-25T20:08:14.418336] [DEBUG] [LOCAL ] MT: Trimmed 73438 records to 51034 (keeping 200 days of data) [2025-09-25T20:08:14.824188] [DEBUG] [LOCAL ] MT: Primary data saved (51034 records). [2025-09-25T20:08:14.824387] [INFO ] [MAIN ] MT: Full history saved. [2025-09-25T20:08:14.826683] [INFO ] [MAIN ] Update Progress: 1418/2372 symbols completed. MT took 41.1s. Estimated remaining: 2h 6m 37s. Rate: 7.5 symbols/min [2025-09-25T20:08:15.002522] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T20:08:15.063318] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:15.088719] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-25T20:08:15.126887] [DEBUG] [LOCAL ] MTN: Loaded 39051 existing records from primary storage. [2025-09-25T20:08:15.127079] [INFO ] [MAIN ] MTN: Loaded 39051 existing records. [2025-09-25T20:08:15.304800] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:15.305177] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-25T20:08:15.305227] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-25T20:08:15.305506] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-25T20:08:15.305564] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-25T20:08:15.685459] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T20:08:15.682261] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:15.888730] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-25T20:08:16.688726] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-25T20:08:16.763835] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T20:08:17.488705] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-25T20:08:17.539817] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T20:08:18.288757] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-25T20:08:18.775697] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-25T20:08:19.088757] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-25T20:08:19.244114] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T20:08:19.511381] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T20:08:19.889006] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-25T20:08:20.688733] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-25T20:08:20.809446] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T20:08:21.306900] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T20:08:21.488745] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-25T20:08:22.168203] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:08:22.288781] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-25T20:08:23.088930] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-25T20:08:23.402686] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T20:08:23.851802] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T20:08:23.888718] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-25T20:08:24.688769] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-25T20:08:24.892040] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T20:08:25.486033] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T20:08:25.497774] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-25T20:08:26.001223] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T20:08:26.288773] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-25T20:08:27.056841] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:08:27.088756] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-25T20:08:27.630192] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T20:08:27.888825] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-25T20:08:28.696978] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-25T20:08:28.705806] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T20:08:29.489010] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-25T20:08:29.584823] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:08:30.288830] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-25T20:08:30.648048] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:08:31.095396] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-25T20:08:31.119174] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T20:08:31.888748] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-25T20:08:31.976874] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T20:08:32.688787] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-25T20:08:33.108532] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T20:08:33.430909] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:08:33.488747] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-25T20:08:34.288774] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-25T20:08:34.367419] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T20:08:35.096771] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T20:08:35.106201] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-25T20:08:35.888694] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-25T20:08:36.067381] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:08:36.675337] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T20:08:36.688675] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-25T20:08:37.168543] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T20:08:37.488719] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-25T20:08:38.292010] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-25T20:08:38.305687] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T20:08:39.088754] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-25T20:08:39.357388] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T20:08:39.725562] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T20:08:39.735431] [INFO ] [REMOTE ] MTG: Full fetch complete (74031 records). [2025-09-25T20:08:39.735608] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-25T20:08:39.891695] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-25T20:08:40.158854] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-25T20:08:40.158968] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-25T20:08:40.160014] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-25T20:08:40.160124] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-25T20:08:40.162397] [DEBUG] [LOCAL ] MTG: Trimmed 74031 records to 51745 (keeping 200 days of data) [2025-09-25T20:08:40.511511] [DEBUG] [LOCAL ] MTG: Primary data saved (51745 records). [2025-09-25T20:08:40.512760] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-25T20:08:40.514388] [INFO ] [MAIN ] Update Progress: 1419/2372 symbols completed. MTG took 32.9s. Estimated remaining: 2h 6m 41s. Rate: 7.5 symbols/min [2025-09-25T20:08:40.608785] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T20:08:40.642455] [INFO ] [REMOTE ] MTDR: Full fetch complete (73420 records). [2025-09-25T20:08:40.642690] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-25T20:08:40.693406] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-25T20:08:40.902661] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:40.902923] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-25T20:08:40.902979] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-25T20:08:40.903380] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-25T20:08:40.903443] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-25T20:08:40.903511] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-25T20:08:40.903575] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-25T20:08:41.396916] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-25T20:08:41.397015] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-25T20:08:41.398848] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-25T20:08:41.398917] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-25T20:08:41.405055] [DEBUG] [LOCAL ] MTDR: Trimmed 73420 records to 51936 (keeping 200 days of data) [2025-09-25T20:08:41.616072] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:08:41.635732] [INFO ] [REMOTE ] MTN: Full fetch complete (56021 records). [2025-09-25T20:08:41.635872] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-25T20:08:41.950735] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:41.951299] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-25T20:08:42.088347] [DEBUG] [LOCAL ] MTDR: Primary data saved (51936 records). [2025-09-25T20:08:42.088535] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-25T20:08:42.088717] [INFO ] [MAIN ] Update Progress: 1420/2372 symbols completed. MTDR took 34.8s. Estimated remaining: 2h 6m 29s. Rate: 7.5 symbols/min [2025-09-25T20:08:42.398415] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T20:08:42.483379] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-25T20:08:42.496720] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-25T20:08:42.542917] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:42.675869] [DEBUG] [LOCAL ] MTRN: Loaded 18116 existing records from primary storage. [2025-09-25T20:08:42.676139] [INFO ] [MAIN ] MTRN: Loaded 18116 existing records. [2025-09-25T20:08:42.801835] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-25T20:08:42.808687] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-25T20:08:42.810219] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-25T20:08:42.810303] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-25T20:08:42.819769] [DEBUG] [LOCAL ] MTN: Trimmed 56021 records to 39319 (keeping 200 days of data) [2025-09-25T20:08:43.033721] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:43.033978] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-25T20:08:43.034024] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-25T20:08:43.034988] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-25T20:08:43.035063] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-25T20:08:43.107961] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-25T20:08:43.393107] [DEBUG] [LOCAL ] MTN: Primary data saved (39319 records). [2025-09-25T20:08:43.393270] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-25T20:08:43.393418] [INFO ] [MAIN ] Update Progress: 1421/2372 symbols completed. MTN took 28.6s. Estimated remaining: 2h 6m 16s. Rate: 7.5 symbols/min [2025-09-25T20:08:43.783551] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T20:08:43.889781] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-25T20:08:43.935161] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:43.956268] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:43.984562] [DEBUG] [LOCAL ] MTUS: Loaded 28641 existing records from primary storage. [2025-09-25T20:08:43.984766] [INFO ] [MAIN ] MTUS: Loaded 28641 existing records. [2025-09-25T20:08:44.186767] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:44.187731] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-25T20:08:44.187794] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-25T20:08:44.188353] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-25T20:08:44.188425] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-25T20:08:44.247429] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T20:08:44.331303] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T20:08:44.350101] [INFO ] [REMOTE ] MTH: Full fetch complete (62853 records). [2025-09-25T20:08:44.350270] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-25T20:08:44.704813] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-25T20:08:44.894961] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:45.049803] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-25T20:08:45.049899] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-25T20:08:45.051093] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-25T20:08:45.051159] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-25T20:08:45.052816] [DEBUG] [LOCAL ] MTH: Trimmed 62853 records to 44201 (keeping 200 days of data) [2025-09-25T20:08:45.356705] [DEBUG] [LOCAL ] MTH: Primary data saved (44201 records). [2025-09-25T20:08:45.356868] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-25T20:08:45.356978] [INFO ] [MAIN ] Update Progress: 1422/2372 symbols completed. MTH took 32.5s. Estimated remaining: 2h 6m 4s. Rate: 7.5 symbols/min [2025-09-25T20:08:45.504305] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-25T20:08:45.542022] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:45.571978] [DEBUG] [LOCAL ] MTW: Loaded 26513 existing records from primary storage. [2025-09-25T20:08:45.572138] [INFO ] [MAIN ] MTW: Loaded 26513 existing records. [2025-09-25T20:08:45.647521] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T20:08:45.766682] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:45.767588] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-25T20:08:45.767638] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-25T20:08:45.767963] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-25T20:08:45.768023] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-25T20:08:45.952353] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-25T20:08:46.139961] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:46.288740] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-25T20:08:46.661469] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-25T20:08:47.088750] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-25T20:08:47.888751] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-25T20:08:47.915347] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T20:08:48.293427] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T20:08:48.688751] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-25T20:08:49.489180] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-25T20:08:50.052010] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:08:50.288697] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-25T20:08:50.519630] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-25T20:08:51.072322] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T20:08:51.088682] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-25T20:08:51.888776] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-25T20:08:52.179580] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:08:52.688840] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-25T20:08:53.170185] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T20:08:53.488718] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-25T20:08:53.752271] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T20:08:54.288725] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-25T20:08:54.721450] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T20:08:55.088700] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-25T20:08:55.389188] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T20:08:55.574620] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T20:08:55.888717] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-25T20:08:56.394252] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T20:08:56.688762] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-25T20:08:57.175857] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T20:08:57.176783] [INFO ] [REMOTE ] MTR: Full fetch complete (2573 records). [2025-09-25T20:08:57.176857] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-25T20:08:57.177247] [FATAL] [VALIDATOR ] MTR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:08:57.177319] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:08:57.177354] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:08:57.177389] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-25T20:08:57.177474] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-25T20:08:57.177530] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-25T20:08:57.177571] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-25T20:08:57.177629] [INFO ] [MAIN ] Update Progress: 1423/2372 symbols completed. MTR took 16.7s. Estimated remaining: 2h 5m 59s. Rate: 7.5 symbols/min [2025-09-25T20:08:57.383039] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:08:57.411637] [DEBUG] [LOCAL ] MTX: Loaded 22844 existing records from primary storage. [2025-09-25T20:08:57.411824] [INFO ] [MAIN ] MTX: Loaded 22844 existing records. [2025-09-25T20:08:57.494708] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-25T20:08:57.596293] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:08:57.596635] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-25T20:08:57.596717] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-25T20:08:57.596957] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-25T20:08:57.597017] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-25T20:08:57.958045] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:08:58.288695] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-25T20:08:58.483041] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T20:08:59.088743] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-25T20:08:59.419383] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:08:59.888745] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-25T20:09:00.375331] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:09:00.688750] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-25T20:09:01.130378] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T20:09:01.488732] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-25T20:09:02.059629] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T20:09:02.137480] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T20:09:02.288759] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-25T20:09:03.088710] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-25T20:09:03.449576] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T20:09:03.888764] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-25T20:09:04.543619] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T20:09:04.688738] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-25T20:09:04.969826] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T20:09:05.488753] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-25T20:09:05.948181] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T20:09:06.288763] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-25T20:09:06.779041] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T20:09:07.088775] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-25T20:09:07.633517] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T20:09:07.888698] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-25T20:09:08.167685] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T20:09:08.688749] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-25T20:09:09.134466] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T20:09:09.488766] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-25T20:09:10.025059] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T20:09:10.288777] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-25T20:09:10.565932] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T20:09:11.088846] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-25T20:09:11.706355] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T20:09:11.888713] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-25T20:09:12.121437] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T20:09:12.689014] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-25T20:09:13.210495] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T20:09:13.214948] [INFO ] [REMOTE ] MTRN: Full fetch complete (23396 records). [2025-09-25T20:09:13.215118] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-25T20:09:13.502837] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-25T20:09:13.657207] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-25T20:09:13.657312] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-25T20:09:13.658257] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-25T20:09:13.658421] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-25T20:09:13.659582] [DEBUG] [LOCAL ] MTRN: Trimmed 23396 records to 18210 (keeping 200 days of data) [2025-09-25T20:09:13.807703] [DEBUG] [LOCAL ] MTRN: Primary data saved (18210 records). [2025-09-25T20:09:13.807890] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-25T20:09:13.808087] [INFO ] [MAIN ] Update Progress: 1424/2372 symbols completed. MTRN took 31.7s. Estimated remaining: 2h 5m 57s. Rate: 7.5 symbols/min [2025-09-25T20:09:13.866356] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T20:09:14.036880] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:14.103412] [DEBUG] [LOCAL ] MTZ: Loaded 43360 existing records from primary storage. [2025-09-25T20:09:14.103580] [INFO ] [MAIN ] MTZ: Loaded 43360 existing records. [2025-09-25T20:09:14.293871] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-25T20:09:14.298088] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:14.298397] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-25T20:09:14.298460] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-25T20:09:14.301509] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-25T20:09:14.301624] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-25T20:09:14.800389] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T20:09:14.812161] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:15.088725] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-25T20:09:15.588138] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:09:15.594735] [INFO ] [REMOTE ] MTUS: Full fetch complete (42647 records). [2025-09-25T20:09:15.594918] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-25T20:09:15.894764] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-25T20:09:16.054935] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-25T20:09:16.055055] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-25T20:09:16.056339] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-25T20:09:16.056408] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-25T20:09:16.057710] [DEBUG] [LOCAL ] MTUS: Trimmed 42647 records to 28828 (keeping 200 days of data) [2025-09-25T20:09:16.278687] [DEBUG] [LOCAL ] MTUS: Primary data saved (28828 records). [2025-09-25T20:09:16.278932] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-25T20:09:16.279146] [INFO ] [MAIN ] Update Progress: 1425/2372 symbols completed. MTUS took 32.9s. Estimated remaining: 2h 5m 45s. Rate: 7.5 symbols/min [2025-09-25T20:09:16.481126] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T20:09:16.508268] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:16.529281] [DEBUG] [LOCAL ] MUA: Loaded 12246 existing records from primary storage. [2025-09-25T20:09:16.529445] [INFO ] [MAIN ] MUA: Loaded 12246 existing records. [2025-09-25T20:09:16.689800] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-25T20:09:16.716272] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:16.716787] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-25T20:09:16.716844] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-25T20:09:16.717155] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-25T20:09:16.717237] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-25T20:09:17.112235] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:17.299582] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T20:09:17.491774] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:09:17.496363] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-25T20:09:18.288748] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-25T20:09:18.405451] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T20:09:19.088775] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-25T20:09:19.649226] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T20:09:19.888703] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-25T20:09:20.041444] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T20:09:20.688730] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-25T20:09:21.063850] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T20:09:21.488764] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-25T20:09:21.607614] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T20:09:22.288747] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-25T20:09:22.463248] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T20:09:22.468371] [INFO ] [REMOTE ] MTX: Full fetch complete (31115 records). [2025-09-25T20:09:22.468703] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-25T20:09:22.903749] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-25T20:09:22.903872] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-25T20:09:22.904853] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-25T20:09:22.904921] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-25T20:09:22.906006] [DEBUG] [LOCAL ] MTX: Trimmed 31115 records to 22995 (keeping 200 days of data) [2025-09-25T20:09:23.068609] [DEBUG] [LOCAL ] MTX: Primary data saved (22995 records). [2025-09-25T20:09:23.068815] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-25T20:09:23.069002] [INFO ] [MAIN ] Update Progress: 1426/2372 symbols completed. MTX took 25.9s. Estimated remaining: 2h 5m 36s. Rate: 7.5 symbols/min [2025-09-25T20:09:23.091897] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-25T20:09:23.270719] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:23.306669] [DEBUG] [LOCAL ] MUC: Loaded 20230 existing records from primary storage. [2025-09-25T20:09:23.306879] [INFO ] [MAIN ] MUC: Loaded 20230 existing records. [2025-09-25T20:09:23.403011] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:09:23.542833] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:23.543667] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-25T20:09:23.543768] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-25T20:09:23.544897] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-25T20:09:23.544966] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-25T20:09:23.894796] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-25T20:09:23.974535] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:24.648768] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T20:09:24.688675] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-25T20:09:25.177158] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T20:09:25.488762] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-25T20:09:26.288716] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-25T20:09:26.364882] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T20:09:26.424850] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T20:09:27.088725] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-25T20:09:27.274465] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T20:09:27.888747] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-25T20:09:28.647565] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T20:09:28.688672] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-25T20:09:29.061037] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T20:09:29.488709] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-25T20:09:30.288782] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-25T20:09:30.372433] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T20:09:30.396814] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T20:09:31.088846] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-25T20:09:31.484710] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T20:09:31.495886] [INFO ] [REMOTE ] MTW: Full fetch complete (38425 records). [2025-09-25T20:09:31.496051] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-25T20:09:31.897827] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-25T20:09:31.956377] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-25T20:09:31.956494] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-25T20:09:31.957612] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-25T20:09:31.957777] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-25T20:09:31.965154] [DEBUG] [LOCAL ] MTW: Trimmed 38425 records to 26735 (keeping 200 days of data) [2025-09-25T20:09:32.170963] [DEBUG] [LOCAL ] MTW: Primary data saved (26735 records). [2025-09-25T20:09:32.171129] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-25T20:09:32.171290] [INFO ] [MAIN ] Update Progress: 1427/2372 symbols completed. MTW took 46.8s. Estimated remaining: 2h 5m 29s. Rate: 7.5 symbols/min [2025-09-25T20:09:32.182339] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:09:32.357923] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:32.378756] [DEBUG] [LOCAL ] MUE: Loaded 11992 existing records from primary storage. [2025-09-25T20:09:32.378882] [INFO ] [MAIN ] MUE: Loaded 11992 existing records. [2025-09-25T20:09:32.570128] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:32.571741] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-25T20:09:32.571843] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-25T20:09:32.573173] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-25T20:09:32.573268] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-25T20:09:32.693852] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-25T20:09:32.955997] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:33.488818] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-25T20:09:33.583941] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T20:09:33.807058] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T20:09:34.288713] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-25T20:09:34.423484] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T20:09:35.076042] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T20:09:35.088686] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-25T20:09:35.888801] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-25T20:09:36.131140] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T20:09:36.688795] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-25T20:09:37.488892] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-25T20:09:37.576443] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T20:09:37.814022] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:09:38.255222] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T20:09:38.288753] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-25T20:09:39.088702] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-25T20:09:39.471726] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T20:09:39.858068] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T20:09:39.888713] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-25T20:09:40.688719] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-25T20:09:40.720504] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T20:09:41.488840] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-25T20:09:42.216119] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T20:09:42.288702] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-25T20:09:42.365870] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T20:09:43.089942] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-25T20:09:43.488176] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T20:09:43.498893] [INFO ] [REMOTE ] MUC: Full fetch complete (30273 records). [2025-09-25T20:09:43.499242] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-25T20:09:43.895759] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-25T20:09:43.946284] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-25T20:09:43.946403] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-25T20:09:43.947682] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-25T20:09:43.947770] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-25T20:09:43.948904] [DEBUG] [LOCAL ] MUC: Trimmed 30273 records to 20556 (keeping 200 days of data) [2025-09-25T20:09:44.139967] [DEBUG] [LOCAL ] MUC: Primary data saved (20556 records). [2025-09-25T20:09:44.140139] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-25T20:09:44.140376] [INFO ] [MAIN ] Update Progress: 1428/2372 symbols completed. MUC took 21.1s. Estimated remaining: 2h 5m 24s. Rate: 7.5 symbols/min [2025-09-25T20:09:44.372187] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:44.485691] [DEBUG] [LOCAL ] MUFG: Loaded 52608 existing records from primary storage. [2025-09-25T20:09:44.485958] [INFO ] [MAIN ] MUFG: Loaded 52608 existing records. [2025-09-25T20:09:44.568904] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T20:09:44.689612] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-25T20:09:44.862447] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:44.862898] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-25T20:09:44.863059] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-25T20:09:44.868209] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T20:09:44.872722] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-25T20:09:44.873064] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-25T20:09:44.873218] [INFO ] [REMOTE ] MUA: Full fetch complete (18801 records). [2025-09-25T20:09:44.873444] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-25T20:09:45.497108] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-25T20:09:45.659378] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T20:09:45.780211] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:45.895568] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-25T20:09:45.895755] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-25T20:09:45.896630] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-25T20:09:45.896721] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-25T20:09:45.898617] [DEBUG] [LOCAL ] MUA: Trimmed 18801 records to 12338 (keeping 200 days of data) [2025-09-25T20:09:46.006985] [DEBUG] [LOCAL ] MUA: Primary data saved (12338 records). [2025-09-25T20:09:46.007173] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-25T20:09:46.007303] [INFO ] [MAIN ] Update Progress: 1429/2372 symbols completed. MUA took 29.7s. Estimated remaining: 2h 5m 12s. Rate: 7.5 symbols/min [2025-09-25T20:09:46.192700] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:46.220524] [DEBUG] [LOCAL ] MUJ: Loaded 13328 existing records from primary storage. [2025-09-25T20:09:46.220756] [INFO ] [MAIN ] MUJ: Loaded 13328 existing records. [2025-09-25T20:09:46.294054] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-25T20:09:46.428366] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:46.428962] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-25T20:09:46.429018] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-25T20:09:46.429425] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-25T20:09:46.429490] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-25T20:09:46.855486] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:47.088724] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-25T20:09:47.147252] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T20:09:47.382109] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T20:09:47.888730] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-25T20:09:48.140248] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T20:09:48.688739] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-25T20:09:49.488711] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-25T20:09:49.672380] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T20:09:49.751877] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T20:09:50.288775] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-25T20:09:50.316568] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T20:09:51.088754] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-25T20:09:51.888754] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-25T20:09:52.086241] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T20:09:52.688705] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-25T20:09:52.780466] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T20:09:52.875574] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T20:09:52.887221] [INFO ] [REMOTE ] MTZ: Full fetch complete (63396 records). [2025-09-25T20:09:52.887553] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-25T20:09:53.313264] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-25T20:09:53.313376] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-25T20:09:53.314521] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-25T20:09:53.314619] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-25T20:09:53.316378] [DEBUG] [LOCAL ] MTZ: Trimmed 63396 records to 43650 (keeping 200 days of data) [2025-09-25T20:09:53.509163] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-25T20:09:53.608255] [DEBUG] [LOCAL ] MTZ: Primary data saved (43650 records). [2025-09-25T20:09:53.608424] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-25T20:09:53.608591] [INFO ] [MAIN ] Update Progress: 1430/2372 symbols completed. MTZ took 39.8s. Estimated remaining: 2h 5m 3s. Rate: 7.5 symbols/min [2025-09-25T20:09:53.782941] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:09:53.854547] [DEBUG] [LOCAL ] MUR: Loaded 52929 existing records from primary storage. [2025-09-25T20:09:53.854751] [INFO ] [MAIN ] MUR: Loaded 52929 existing records. [2025-09-25T20:09:54.044588] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:09:54.044996] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-25T20:09:54.045048] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-25T20:09:54.045316] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-25T20:09:54.045376] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-25T20:09:54.267291] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:09:54.293216] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-25T20:09:54.405008] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T20:09:54.486292] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:09:55.059529] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T20:09:55.088725] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-25T20:09:55.888745] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-25T20:09:56.688740] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-25T20:09:56.751535] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:09:57.045722] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:09:57.488722] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-25T20:09:58.288703] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-25T20:09:58.388750] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T20:09:58.452815] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T20:09:59.088700] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-25T20:09:59.888762] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-25T20:09:59.970399] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T20:10:00.239251] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T20:10:00.688752] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-25T20:10:01.488753] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-25T20:10:01.643458] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T20:10:02.288753] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-25T20:10:02.367786] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T20:10:02.604210] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T20:10:03.088824] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-25T20:10:03.888745] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-25T20:10:03.948569] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T20:10:04.185149] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T20:10:04.526750] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:10:04.688748] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-25T20:10:05.488772] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-25T20:10:05.586002] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T20:10:06.288758] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-25T20:10:07.088727] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-25T20:10:07.312618] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T20:10:07.352787] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:10:07.888778] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-25T20:10:08.688762] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-25T20:10:08.891064] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T20:10:09.488727] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-25T20:10:09.640289] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T20:10:09.698412] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T20:10:10.288717] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-25T20:10:10.776537] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:10:10.779370] [INFO ] [REMOTE ] MUE: Full fetch complete (16218 records). [2025-09-25T20:10:10.779456] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-25T20:10:11.093839] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-25T20:10:11.215159] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-25T20:10:11.215270] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-25T20:10:11.215790] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-25T20:10:11.215856] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-25T20:10:11.216854] [DEBUG] [LOCAL ] MUE: Trimmed 16218 records to 12072 (keeping 200 days of data) [2025-09-25T20:10:11.304328] [DEBUG] [LOCAL ] MUE: Primary data saved (12072 records). [2025-09-25T20:10:11.304539] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-25T20:10:11.304724] [INFO ] [MAIN ] Update Progress: 1431/2372 symbols completed. MUE took 39.1s. Estimated remaining: 2h 5m 2s. Rate: 7.5 symbols/min [2025-09-25T20:10:11.494480] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:11.525576] [DEBUG] [LOCAL ] MUSA: Loaded 24915 existing records from primary storage. [2025-09-25T20:10:11.525782] [INFO ] [MAIN ] MUSA: Loaded 24915 existing records. [2025-09-25T20:10:11.766849] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:10:11.767320] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-25T20:10:11.767374] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-25T20:10:11.767698] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-25T20:10:11.767803] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-25T20:10:11.894910] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-25T20:10:12.294997] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:12.324756] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T20:10:12.688721] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-25T20:10:12.972568] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T20:10:13.008361] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T20:10:13.488798] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-25T20:10:14.288808] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-25T20:10:14.604907] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T20:10:14.728590] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T20:10:14.732212] [INFO ] [REMOTE ] MUJ: Full fetch complete (20346 records). [2025-09-25T20:10:14.732296] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-25T20:10:15.093938] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-25T20:10:15.176233] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-25T20:10:15.176343] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-25T20:10:15.177041] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-25T20:10:15.177215] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-25T20:10:15.178065] [DEBUG] [LOCAL ] MUJ: Trimmed 20346 records to 13414 (keeping 200 days of data) [2025-09-25T20:10:15.270427] [DEBUG] [LOCAL ] MUJ: Primary data saved (13414 records). [2025-09-25T20:10:15.270619] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-25T20:10:15.270755] [INFO ] [MAIN ] Update Progress: 1432/2372 symbols completed. MUJ took 29.3s. Estimated remaining: 2h 4m 51s. Rate: 7.5 symbols/min [2025-09-25T20:10:15.512265] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T20:10:15.522679] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:15.523004] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-25T20:10:15.523072] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-25T20:10:15.523247] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-25T20:10:15.523291] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-25T20:10:15.523334] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-25T20:10:15.523368] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-25T20:10:15.890182] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-25T20:10:15.915399] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:16.688777] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-25T20:10:16.947798] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T20:10:17.462208] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T20:10:17.488689] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-25T20:10:17.971300] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T20:10:17.991804] [INFO ] [REMOTE ] MUFG: Full fetch complete (75444 records). [2025-09-25T20:10:17.992095] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-25T20:10:18.293211] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-25T20:10:18.458524] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-25T20:10:18.469694] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-25T20:10:18.471138] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-25T20:10:18.471287] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-25T20:10:18.480467] [DEBUG] [LOCAL ] MUFG: Trimmed 75444 records to 52971 (keeping 200 days of data) [2025-09-25T20:10:18.476530] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T20:10:18.858823] [DEBUG] [LOCAL ] MUFG: Primary data saved (52971 records). [2025-09-25T20:10:18.859161] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-25T20:10:18.861097] [INFO ] [MAIN ] Update Progress: 1433/2372 symbols completed. MUFG took 34.7s. Estimated remaining: 2h 4m 40s. Rate: 7.5 symbols/min [2025-09-25T20:10:19.047746] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:19.098577] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-25T20:10:19.128003] [DEBUG] [LOCAL ] MUX: Loaded 42544 existing records from primary storage. [2025-09-25T20:10:19.128199] [INFO ] [MAIN ] MUX: Loaded 42544 existing records. [2025-09-25T20:10:19.331375] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:10:19.333214] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-25T20:10:19.333278] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-25T20:10:19.333713] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-25T20:10:19.333795] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-25T20:10:19.747169] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:19.888689] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-25T20:10:20.287115] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T20:10:20.321808] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T20:10:20.688743] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-25T20:10:21.271540] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T20:10:21.488731] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-25T20:10:22.288807] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-25T20:10:22.534193] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T20:10:22.682617] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T20:10:23.088792] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-25T20:10:23.344601] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T20:10:23.888792] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-25T20:10:24.503351] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T20:10:24.688748] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-25T20:10:25.330047] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:10:25.488756] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-25T20:10:26.298359] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-25T20:10:26.324128] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T20:10:26.346092] [INFO ] [REMOTE ] MUR: Full fetch complete (76442 records). [2025-09-25T20:10:26.346384] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-25T20:10:26.811221] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T20:10:26.888724] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-25T20:10:26.888846] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-25T20:10:26.890709] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-25T20:10:26.890791] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-25T20:10:26.897244] [DEBUG] [LOCAL ] MUR: Trimmed 76442 records to 53315 (keeping 200 days of data) [2025-09-25T20:10:27.110908] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-25T20:10:27.281479] [DEBUG] [LOCAL ] MUR: Primary data saved (53315 records). [2025-09-25T20:10:27.281712] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-25T20:10:27.282010] [INFO ] [MAIN ] Update Progress: 1434/2372 symbols completed. MUR took 33.7s. Estimated remaining: 2h 4m 33s. Rate: 7.5 symbols/min [2025-09-25T20:10:27.481777] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:27.507509] [DEBUG] [LOCAL ] MVF: Loaded 12751 existing records from primary storage. [2025-09-25T20:10:27.507753] [INFO ] [MAIN ] MVF: Loaded 12751 existing records. [2025-09-25T20:10:27.671267] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T20:10:27.740708] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:10:27.741300] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-25T20:10:27.741988] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-25T20:10:27.742324] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-25T20:10:27.742407] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-25T20:10:27.901148] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-25T20:10:28.152951] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:28.525068] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T20:10:28.688750] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-25T20:10:29.234000] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T20:10:29.488748] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-25T20:10:29.671100] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T20:10:30.288746] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-25T20:10:30.823986] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T20:10:31.088768] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-25T20:10:31.265358] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T20:10:31.383608] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-25T20:10:31.888745] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-25T20:10:32.116421] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:10:32.116866] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-25T20:10:32.688810] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-25T20:10:33.093632] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:10:33.094156] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-25T20:10:33.488708] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-25T20:10:33.755679] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-25T20:10:34.288716] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-25T20:10:35.089143] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T20:10:35.088683] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-25T20:10:35.442455] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-25T20:10:35.888708] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-25T20:10:36.121972] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-25T20:10:36.688755] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-25T20:10:36.941202] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-25T20:10:37.488721] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-25T20:10:37.732177] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-25T20:10:38.288770] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-25T20:10:39.088748] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-25T20:10:39.164741] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T20:10:39.888746] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-25T20:10:40.138463] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.25 seconds). [2025-09-25T20:10:40.596684] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T20:10:40.688764] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-25T20:10:41.169891] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:10:41.170328] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-25T20:10:41.170461] [INFO ] [REMOTE ] MUSE: Full fetch complete (104 records). [2025-09-25T20:10:41.170554] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-25T20:10:41.171633] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:10:41.171753] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:10:41.171823] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:10:41.171913] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-25T20:10:41.172074] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-25T20:10:41.172145] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-25T20:10:41.172233] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-25T20:10:41.172369] [INFO ] [MAIN ] Update Progress: 1435/2372 symbols completed. MUSE took 25.9s. Estimated remaining: 2h 4m 29s. Rate: 7.5 symbols/min [2025-09-25T20:10:41.368018] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:41.392096] [DEBUG] [LOCAL ] MVO: Loaded 9065 existing records from primary storage. [2025-09-25T20:10:41.392265] [INFO ] [MAIN ] MVO: Loaded 9065 existing records. [2025-09-25T20:10:41.494741] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-25T20:10:41.584304] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:10:41.584698] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-25T20:10:41.584755] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-25T20:10:41.585047] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-25T20:10:41.585106] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-25T20:10:41.939854] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:42.288710] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-25T20:10:42.485545] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T20:10:43.078226] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T20:10:43.088679] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-25T20:10:43.888681] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-25T20:10:44.214163] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T20:10:44.688689] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-25T20:10:44.709549] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T20:10:45.488736] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-25T20:10:45.686943] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T20:10:46.289060] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-25T20:10:46.765634] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T20:10:46.772276] [INFO ] [REMOTE ] MUSA: Full fetch complete (35028 records). [2025-09-25T20:10:46.772522] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-25T20:10:47.093889] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-25T20:10:47.225365] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-25T20:10:47.225476] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-25T20:10:47.227549] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-25T20:10:47.227678] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-25T20:10:47.232047] [DEBUG] [LOCAL ] MUSA: Trimmed 35028 records to 25043 (keeping 200 days of data) [2025-09-25T20:10:47.436308] [DEBUG] [LOCAL ] MUSA: Primary data saved (25043 records). [2025-09-25T20:10:47.436469] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-25T20:10:47.436636] [INFO ] [MAIN ] Update Progress: 1436/2372 symbols completed. MUSA took 36.1s. Estimated remaining: 2h 4m 20s. Rate: 7.5 symbols/min [2025-09-25T20:10:47.623612] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:10:47.646806] [DEBUG] [LOCAL ] MVT: Loaded 10084 existing records from primary storage. [2025-09-25T20:10:47.647030] [INFO ] [MAIN ] MVT: Loaded 10084 existing records. [2025-09-25T20:10:47.860057] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:10:47.860526] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-25T20:10:47.860590] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-25T20:10:47.861001] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-25T20:10:47.861065] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-25T20:10:47.892890] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-25T20:10:48.004933] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T20:10:48.035260] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T20:10:48.308300] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:10:48.688860] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-25T20:10:48.766281] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T20:10:49.303493] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T20:10:49.488792] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-25T20:10:50.288784] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-25T20:10:50.341819] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:10:51.088774] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-25T20:10:51.637897] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T20:10:51.873876] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T20:10:51.888683] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-25T20:10:52.688829] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-25T20:10:52.718092] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T20:10:53.488724] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-25T20:10:53.679257] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:10:54.288745] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-25T20:10:54.900297] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T20:10:55.088709] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-25T20:10:55.407843] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T20:10:55.419171] [INFO ] [REMOTE ] MUX: Full fetch complete (58839 records). [2025-09-25T20:10:55.419491] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-25T20:10:55.866823] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-25T20:10:55.866955] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-25T20:10:55.868174] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-25T20:10:55.868324] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-25T20:10:55.869971] [DEBUG] [LOCAL ] MUX: Trimmed 58839 records to 42890 (keeping 200 days of data) [2025-09-25T20:10:55.888749] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-25T20:10:56.171114] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T20:10:56.258785] [DEBUG] [LOCAL ] MUX: Primary data saved (42890 records). [2025-09-25T20:10:56.259020] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-25T20:10:56.259349] [INFO ] [MAIN ] Update Progress: 1437/2372 symbols completed. MUX took 37.4s. Estimated remaining: 2h 4m 12s. Rate: 7.5 symbols/min [2025-09-25T20:10:56.688730] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-25T20:10:56.834696] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T20:10:57.488721] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-25T20:10:57.779996] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T20:10:57.785396] [INFO ] [REMOTE ] MVF: Full fetch complete (19161 records). [2025-09-25T20:10:57.785621] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-25T20:10:58.091452] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-25T20:10:58.234853] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-25T20:10:58.234948] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-25T20:10:58.235389] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-25T20:10:58.235430] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-25T20:10:58.236410] [DEBUG] [LOCAL ] MVF: Trimmed 19161 records to 12867 (keeping 200 days of data) [2025-09-25T20:10:58.300073] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-25T20:10:58.360755] [DEBUG] [LOCAL ] MVF: Primary data saved (12867 records). [2025-09-25T20:10:58.360930] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-25T20:10:58.361112] [INFO ] [MAIN ] Update Progress: 1438/2372 symbols completed. MVF took 31.1s. Estimated remaining: 2h 4m 0s. Rate: 7.5 symbols/min [2025-09-25T20:10:59.088743] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-25T20:10:59.108968] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T20:10:59.745135] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T20:10:59.888756] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-25T20:11:00.475570] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T20:11:00.688767] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-25T20:11:01.488806] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-25T20:11:01.569253] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T20:11:01.575972] [INFO ] [REMOTE ] MVO: Full fetch complete (14470 records). [2025-09-25T20:11:01.576114] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-25T20:11:01.991893] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-25T20:11:01.992063] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-25T20:11:01.992546] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-25T20:11:01.993430] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-25T20:11:01.994822] [DEBUG] [LOCAL ] MVO: Trimmed 14470 records to 9106 (keeping 200 days of data) [2025-09-25T20:11:02.075790] [DEBUG] [LOCAL ] MVO: Primary data saved (9106 records). [2025-09-25T20:11:02.075992] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-25T20:11:02.076253] [INFO ] [MAIN ] Update Progress: 1439/2372 symbols completed. MVO took 20.9s. Estimated remaining: 2h 3m 50s. Rate: 7.5 symbols/min [2025-09-25T20:11:02.402967] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T20:11:02.406572] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-25T20:11:03.337035] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:11:03.340010] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-25T20:11:04.251864] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T20:11:04.257016] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-25T20:11:04.984513] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T20:11:04.987265] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-25T20:11:05.755685] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T20:11:05.759616] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-25T20:11:07.315113] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T20:11:07.320262] [INFO ] [REMOTE ] MVT: Full fetch complete (14700 records). [2025-09-25T20:11:07.320453] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-25T20:11:07.716932] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-25T20:11:07.717053] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-25T20:11:07.717566] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-25T20:11:07.717609] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-25T20:11:07.718203] [DEBUG] [LOCAL ] MVT: Trimmed 14700 records to 10252 (keeping 200 days of data) [2025-09-25T20:11:07.788138] [DEBUG] [LOCAL ] MVT: Primary data saved (10252 records). [2025-09-25T20:11:07.788298] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-25T20:11:07.788424] [INFO ] [MAIN ] Update Progress: 1440/2372 symbols completed. MVT took 20.4s. Estimated remaining: 2h 3m 40s. Rate: 7.5 symbols/min [2025-09-25T20:11:08.507348] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:08.527863] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-25T20:11:08.528063] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-25T20:11:08.528277] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-25T20:11:08.528374] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-25T20:11:08.528446] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-25T20:11:08.528511] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-25T20:11:08.591465] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:08.602483] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:08.577910] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:08.626763] [DEBUG] [LOCAL ] MXF: Loaded 5969 existing records from primary storage. [2025-09-25T20:11:08.626956] [INFO ] [MAIN ] MXF: Loaded 5969 existing records. [2025-09-25T20:11:08.726344] [DEBUG] [LOCAL ] MX: Loaded 23108 existing records from primary storage. [2025-09-25T20:11:08.726523] [INFO ] [MAIN ] MX: Loaded 23108 existing records. [2025-09-25T20:11:08.828344] [DEBUG] [LOCAL ] MWA: Loaded 47050 existing records from primary storage. [2025-09-25T20:11:08.834676] [INFO ] [MAIN ] MWA: Loaded 47050 existing records. [2025-09-25T20:11:09.508574] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:09.523437] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-25T20:11:09.523503] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-25T20:11:09.534830] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-25T20:11:09.534930] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-25T20:11:09.667519] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:09.673331] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-25T20:11:09.673387] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-25T20:11:09.673669] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-25T20:11:09.673745] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-25T20:11:09.773905] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:09.774241] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-25T20:11:09.774289] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-25T20:11:09.774606] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-25T20:11:09.774716] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-25T20:11:09.928352] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:09.938709] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-25T20:11:10.482051] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T20:11:10.488838] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-25T20:11:10.882422] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:10.882836] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-25T20:11:10.939717] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:10.940135] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-25T20:11:11.011372] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:11.011845] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-25T20:11:11.013909] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-25T20:11:11.015778] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-25T20:11:11.506141] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T20:11:11.507429] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-25T20:11:11.783996] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T20:11:11.888735] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-25T20:11:11.947975] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T20:11:11.961725] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-25T20:11:12.428495] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T20:11:12.688710] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-25T20:11:12.715269] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T20:11:13.071209] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-25T20:11:13.488726] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-25T20:11:14.288775] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-25T20:11:14.455311] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T20:11:15.088732] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-25T20:11:15.478312] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-25T20:11:15.888749] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-25T20:11:16.055002] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T20:11:16.641954] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T20:11:16.688687] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-25T20:11:17.424996] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T20:11:17.488689] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-25T20:11:18.293090] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T20:11:18.294178] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-25T20:11:19.088776] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-25T20:11:19.488173] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T20:11:19.888942] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-25T20:11:19.929917] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T20:11:20.692922] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-25T20:11:20.698843] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T20:11:21.488781] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-25T20:11:21.879048] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:11:21.910821] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T20:11:22.288763] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-25T20:11:23.015307] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-25T20:11:23.088690] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-25T20:11:23.766457] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T20:11:23.888794] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-25T20:11:24.368841] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T20:11:24.688854] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-25T20:11:25.227436] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T20:11:25.229083] [INFO ] [REMOTE ] MXE: Full fetch complete (2662 records). [2025-09-25T20:11:25.229231] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-25T20:11:25.472601] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T20:11:25.473410] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:11:25.473536] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:11:25.473690] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-25T20:11:25.473892] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-25T20:11:25.474015] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-25T20:11:25.474138] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-25T20:11:25.474466] [INFO ] [MAIN ] Update Progress: 1441/2372 symbols completed. MXE took 17.7s. Estimated remaining: 2h 3m 39s. Rate: 7.5 symbols/min [2025-09-25T20:11:25.490129] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-25T20:11:25.679136] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:25.715476] [DEBUG] [LOCAL ] MYD: Loaded 13773 existing records from primary storage. [2025-09-25T20:11:25.715639] [INFO ] [MAIN ] MYD: Loaded 13773 existing records. [2025-09-25T20:11:25.901940] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:25.902386] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-25T20:11:25.902438] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-25T20:11:25.902949] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-25T20:11:25.903009] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-25T20:11:26.284955] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:26.288694] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-25T20:11:26.785411] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T20:11:26.798893] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T20:11:27.088727] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-25T20:11:27.738614] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T20:11:27.740017] [INFO ] [REMOTE ] MXF: Full fetch complete (10439 records). [2025-09-25T20:11:27.740127] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-25T20:11:27.893791] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-25T20:11:28.142736] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-25T20:11:28.142890] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-25T20:11:28.143356] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-25T20:11:28.143437] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-25T20:11:28.144118] [DEBUG] [LOCAL ] MXF: Trimmed 10439 records to 5972 (keeping 200 days of data) [2025-09-25T20:11:28.189537] [DEBUG] [LOCAL ] MXF: Primary data saved (5972 records). [2025-09-25T20:11:28.189731] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-25T20:11:28.189918] [INFO ] [MAIN ] Update Progress: 1442/2372 symbols completed. MXF took 20.4s. Estimated remaining: 2h 3m 27s. Rate: 7.5 symbols/min [2025-09-25T20:11:28.360562] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:28.405886] [DEBUG] [LOCAL ] MYE: Loaded 25021 existing records from primary storage. [2025-09-25T20:11:28.406069] [INFO ] [MAIN ] MYE: Loaded 25021 existing records. [2025-09-25T20:11:28.589247] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:28.590991] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-25T20:11:28.591060] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-25T20:11:28.591408] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-25T20:11:28.591468] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-25T20:11:28.694929] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-25T20:11:28.990584] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:29.495929] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-25T20:11:29.519269] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:11:29.754965] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T20:11:30.288887] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-25T20:11:30.657211] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T20:11:31.088769] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-25T20:11:31.113043] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T20:11:31.888880] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-25T20:11:32.186099] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T20:11:32.688782] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-25T20:11:32.817238] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T20:11:33.488732] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-25T20:11:33.831995] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T20:11:34.288694] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-25T20:11:34.623951] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T20:11:35.088761] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-25T20:11:35.803588] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T20:11:35.888714] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-25T20:11:36.688770] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-25T20:11:36.818070] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T20:11:37.048967] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:11:37.488712] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-25T20:11:38.097517] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T20:11:38.288713] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-25T20:11:39.088702] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-25T20:11:39.229483] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T20:11:39.406058] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T20:11:39.789496] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T20:11:39.888669] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-25T20:11:40.688684] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-25T20:11:40.887073] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T20:11:41.488740] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-25T20:11:42.002765] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T20:11:42.288677] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-25T20:11:42.615181] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T20:11:43.088748] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-25T20:11:43.556710] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T20:11:43.888741] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-25T20:11:43.968191] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T20:11:44.688735] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-25T20:11:44.998797] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:11:45.488740] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-25T20:11:45.586788] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-25T20:11:46.288940] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-25T20:11:47.024046] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T20:11:47.052159] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T20:11:47.088682] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-25T20:11:47.888785] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-25T20:11:48.701248] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-25T20:11:48.741911] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T20:11:49.000300] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:11:49.488742] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-25T20:11:49.947519] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T20:11:50.288750] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-25T20:11:50.914367] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T20:11:51.088744] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-25T20:11:51.682046] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T20:11:51.687086] [INFO ] [REMOTE ] MYE: Full fetch complete (36704 records). [2025-09-25T20:11:51.687219] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-25T20:11:51.894372] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-25T20:11:52.172939] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-25T20:11:52.173072] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-25T20:11:52.174082] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-25T20:11:52.174185] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-25T20:11:52.175527] [DEBUG] [LOCAL ] MYE: Trimmed 36704 records to 25165 (keeping 200 days of data) [2025-09-25T20:11:52.355403] [DEBUG] [LOCAL ] MYE: Primary data saved (25165 records). [2025-09-25T20:11:52.355571] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-25T20:11:52.355722] [INFO ] [MAIN ] Update Progress: 1443/2372 symbols completed. MYE took 24.2s. Estimated remaining: 2h 3m 30s. Rate: 7.5 symbols/min [2025-09-25T20:11:52.568547] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:52.599675] [DEBUG] [LOCAL ] MYI: Loaded 19328 existing records from primary storage. [2025-09-25T20:11:52.599992] [INFO ] [MAIN ] MYI: Loaded 19328 existing records. [2025-09-25T20:11:52.694630] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-25T20:11:52.742919] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T20:11:52.828325] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:52.829278] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-25T20:11:52.829443] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-25T20:11:52.829918] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-25T20:11:52.830000] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-25T20:11:52.970255] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T20:11:52.996891] [INFO ] [REMOTE ] MWA: Full fetch complete (67806 records). [2025-09-25T20:11:52.997328] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-25T20:11:53.497755] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-25T20:11:53.637943] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:53.767209] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-25T20:11:53.767351] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-25T20:11:53.769369] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-25T20:11:53.769467] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-25T20:11:53.773671] [DEBUG] [LOCAL ] MWA: Trimmed 67806 records to 47339 (keeping 200 days of data) [2025-09-25T20:11:54.025624] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:11:54.037027] [INFO ] [REMOTE ] MX: Full fetch complete (31920 records). [2025-09-25T20:11:54.037121] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-25T20:11:54.197481] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T20:11:54.210555] [INFO ] [REMOTE ] MYD: Full fetch complete (20804 records). [2025-09-25T20:11:54.210687] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-25T20:11:54.250267] [DEBUG] [LOCAL ] MWA: Primary data saved (47339 records). [2025-09-25T20:11:54.250364] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-25T20:11:54.250506] [INFO ] [MAIN ] Update Progress: 1444/2372 symbols completed. MWA took 46.5s. Estimated remaining: 2h 3m 18s. Rate: 7.5 symbols/min [2025-09-25T20:11:54.292730] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-25T20:11:54.932138] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:55.026425] [DEBUG] [LOCAL ] MYN: Loaded 10238 existing records from primary storage. [2025-09-25T20:11:55.026605] [INFO ] [MAIN ] MYN: Loaded 10238 existing records. [2025-09-25T20:11:55.263672] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-25T20:11:55.263811] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-25T20:11:55.265310] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-25T20:11:55.265409] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-25T20:11:55.280396] [DEBUG] [LOCAL ] MX: Trimmed 31920 records to 23261 (keeping 200 days of data) [2025-09-25T20:11:55.284624] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-25T20:11:55.284801] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-25T20:11:55.285253] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-25T20:11:55.285322] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-25T20:11:55.370992] [DEBUG] [LOCAL ] MYD: Trimmed 20804 records to 13867 (keeping 200 days of data) [2025-09-25T20:11:55.581451] [DEBUG] [LOCAL ] MYD: Primary data saved (13867 records). [2025-09-25T20:11:55.589810] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-25T20:11:55.590098] [INFO ] [MAIN ] Update Progress: 1445/2372 symbols completed. MYD took 30.1s. Estimated remaining: 2h 3m 6s. Rate: 7.5 symbols/min [2025-09-25T20:11:55.712810] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T20:11:55.748441] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-25T20:11:55.795066] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:55.795400] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-25T20:11:55.795459] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-25T20:11:55.796673] [DEBUG] [LOCAL ] MX: Primary data saved (23261 records). [2025-09-25T20:11:55.802691] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-25T20:11:55.802808] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-25T20:11:55.824058] [INFO ] [MAIN ] MX: Full history saved. [2025-09-25T20:11:55.824342] [INFO ] [MAIN ] Update Progress: 1446/2372 symbols completed. MX took 48.0s. Estimated remaining: 2h 2m 53s. Rate: 7.5 symbols/min [2025-09-25T20:11:56.049436] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:56.303299] [DEBUG] [LOCAL ] NABL: Loaded 39814 existing records from primary storage. [2025-09-25T20:11:56.303501] [INFO ] [MAIN ] NABL: Loaded 39814 existing records. [2025-09-25T20:11:56.409081] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:11:56.523180] [DEBUG] [LOCAL ] NAC: Loaded 24631 existing records from primary storage. [2025-09-25T20:11:56.523359] [INFO ] [MAIN ] NAC: Loaded 24631 existing records. [2025-09-25T20:11:56.870133] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:11:56.885510] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:56.888582] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-25T20:11:56.897981] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-25T20:11:56.898059] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-25T20:11:56.898419] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-25T20:11:56.898482] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-25T20:11:57.005436] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:57.005792] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-25T20:11:57.088025] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:11:57.088339] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-25T20:11:57.088389] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-25T20:11:57.088720] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-25T20:11:57.088783] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-25T20:11:57.701005] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:57.701614] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-25T20:11:57.793919] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:11:57.941610] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T20:11:58.092367] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T20:11:58.288741] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-25T20:11:58.957724] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T20:11:59.088743] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-25T20:11:59.252518] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T20:11:59.888745] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-25T20:11:59.932354] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T20:12:00.688786] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-25T20:12:00.810380] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T20:12:01.309432] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T20:12:01.488766] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-25T20:12:02.288820] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-25T20:12:02.710332] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T20:12:03.088757] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-25T20:12:03.313199] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T20:12:03.866570] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T20:12:03.888682] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-25T20:12:04.688779] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-25T20:12:04.714328] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T20:12:05.488714] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-25T20:12:05.556923] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T20:12:05.986376] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-25T20:12:06.288780] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-25T20:12:07.088734] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-25T20:12:07.214486] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T20:12:07.888689] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-25T20:12:08.207618] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:12:08.425225] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T20:12:08.688781] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-25T20:12:09.488733] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-25T20:12:10.013167] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-25T20:12:10.288761] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-25T20:12:10.384709] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:12:10.387633] [INFO ] [REMOTE ] MYN: Full fetch complete (15512 records). [2025-09-25T20:12:10.387747] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-25T20:12:10.766975] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-25T20:12:10.767097] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-25T20:12:10.767798] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-25T20:12:10.767869] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-25T20:12:10.768537] [DEBUG] [LOCAL ] MYN: Trimmed 15512 records to 10294 (keeping 200 days of data) [2025-09-25T20:12:10.837377] [DEBUG] [LOCAL ] MYN: Primary data saved (10294 records). [2025-09-25T20:12:10.837568] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-25T20:12:10.837873] [INFO ] [MAIN ] Update Progress: 1447/2372 symbols completed. MYN took 16.6s. Estimated remaining: 2h 2m 49s. Rate: 7.5 symbols/min [2025-09-25T20:12:11.011557] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:11.062376] [DEBUG] [LOCAL ] NAD: Loaded 33965 existing records from primary storage. [2025-09-25T20:12:11.062561] [INFO ] [MAIN ] NAD: Loaded 33965 existing records. [2025-09-25T20:12:11.088831] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-25T20:12:11.254974] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:11.255619] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-25T20:12:11.255728] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-25T20:12:11.257852] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-25T20:12:11.257934] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-25T20:12:11.305786] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T20:12:11.660897] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:11.888761] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-25T20:12:12.522685] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T20:12:12.688724] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-25T20:12:13.057287] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T20:12:13.488715] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-25T20:12:13.562393] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T20:12:14.288759] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-25T20:12:15.094669] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-25T20:12:15.113549] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T20:12:15.898751] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-25T20:12:15.907206] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T20:12:16.365401] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T20:12:16.688752] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-25T20:12:17.282147] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T20:12:17.488758] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-25T20:12:17.945440] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T20:12:18.288741] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-25T20:12:18.839593] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T20:12:19.088920] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-25T20:12:19.623994] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T20:12:19.888719] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-25T20:12:20.243505] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T20:12:20.688716] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-25T20:12:21.029447] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T20:12:21.036291] [INFO ] [REMOTE ] MYI: Full fetch complete (29591 records). [2025-09-25T20:12:21.036478] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-25T20:12:21.493369] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-25T20:12:21.493605] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-25T20:12:21.494741] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-25T20:12:21.494879] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-25T20:12:21.495726] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-25T20:12:21.502195] [DEBUG] [LOCAL ] MYI: Trimmed 29591 records to 19516 (keeping 200 days of data) [2025-09-25T20:12:21.658127] [DEBUG] [LOCAL ] MYI: Primary data saved (19516 records). [2025-09-25T20:12:21.661887] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-25T20:12:21.662152] [INFO ] [MAIN ] Update Progress: 1448/2372 symbols completed. MYI took 29.3s. Estimated remaining: 2h 2m 43s. Rate: 7.5 symbols/min [2025-09-25T20:12:21.888332] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:21.905745] [DEBUG] [LOCAL ] NAN: Loaded 9041 existing records from primary storage. [2025-09-25T20:12:21.906211] [INFO ] [MAIN ] NAN: Loaded 9041 existing records. [2025-09-25T20:12:22.106425] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:22.106937] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-25T20:12:22.107019] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-25T20:12:22.108144] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-25T20:12:22.108234] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-25T20:12:22.223234] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T20:12:22.294324] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-25T20:12:22.568151] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:22.667197] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T20:12:23.088745] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-25T20:12:23.466529] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:12:23.888701] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-25T20:12:23.924120] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T20:12:24.688780] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-25T20:12:25.466753] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T20:12:25.488703] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-25T20:12:25.526619] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T20:12:26.288823] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-25T20:12:26.713784] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T20:12:27.088878] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-25T20:12:27.702184] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T20:12:27.888760] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-25T20:12:28.643806] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:12:28.688701] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-25T20:12:28.745174] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:12:29.284675] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T20:12:29.488727] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-25T20:12:30.288821] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-25T20:12:30.838808] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T20:12:31.088705] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-25T20:12:31.108811] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T20:12:31.888816] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-25T20:12:32.691393] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-25T20:12:32.696448] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T20:12:33.276250] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T20:12:33.488719] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-25T20:12:33.540034] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T20:12:34.288867] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-25T20:12:35.016493] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T20:12:35.088729] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-25T20:12:35.647033] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T20:12:35.659529] [INFO ] [REMOTE ] NAC: Full fetch complete (36309 records). [2025-09-25T20:12:35.659816] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-25T20:12:35.892201] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-25T20:12:36.139831] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T20:12:36.165993] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-25T20:12:36.166107] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-25T20:12:36.167481] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-25T20:12:36.167573] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-25T20:12:36.169054] [DEBUG] [LOCAL ] NAC: Trimmed 36309 records to 24882 (keeping 200 days of data) [2025-09-25T20:12:36.357022] [DEBUG] [LOCAL ] NAC: Primary data saved (24882 records). [2025-09-25T20:12:36.357232] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-25T20:12:36.357423] [INFO ] [MAIN ] Update Progress: 1449/2372 symbols completed. NAC took 40.5s. Estimated remaining: 2h 2m 39s. Rate: 7.5 symbols/min [2025-09-25T20:12:36.628077] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:36.690083] [DEBUG] [LOCAL ] NAT: Loaded 49103 existing records from primary storage. [2025-09-25T20:12:36.690254] [INFO ] [MAIN ] NAT: Loaded 49103 existing records. [2025-09-25T20:12:36.695358] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-25T20:12:36.910980] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:36.912513] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-25T20:12:36.912576] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-25T20:12:36.913120] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-25T20:12:36.913182] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-25T20:12:37.241281] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T20:12:37.346351] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:37.488795] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-25T20:12:37.990147] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:12:37.996882] [INFO ] [REMOTE ] NAD: Full fetch complete (50053 records). [2025-09-25T20:12:37.997020] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-25T20:12:38.295971] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-25T20:12:38.348784] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T20:12:38.449736] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-25T20:12:38.449890] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-25T20:12:38.451740] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-25T20:12:38.451822] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-25T20:12:38.453634] [DEBUG] [LOCAL ] NAD: Trimmed 50053 records to 34139 (keeping 200 days of data) [2025-09-25T20:12:38.692148] [DEBUG] [LOCAL ] NAD: Primary data saved (34139 records). [2025-09-25T20:12:38.692342] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-25T20:12:38.692472] [INFO ] [MAIN ] Update Progress: 1450/2372 symbols completed. NAD took 27.9s. Estimated remaining: 2h 2m 28s. Rate: 7.5 symbols/min [2025-09-25T20:12:38.880685] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:38.936503] [DEBUG] [LOCAL ] NATL: Loaded 32862 existing records from primary storage. [2025-09-25T20:12:38.936708] [INFO ] [MAIN ] NATL: Loaded 32862 existing records. [2025-09-25T20:12:39.092102] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-25T20:12:39.135492] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:39.135887] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-25T20:12:39.135939] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-25T20:12:39.137065] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-25T20:12:39.137130] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-25T20:12:39.537774] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:39.885192] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T20:12:39.895735] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-25T20:12:39.902904] [INFO ] [REMOTE ] NABL: Full fetch complete (56723 records). [2025-09-25T20:12:39.903058] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-25T20:12:40.308712] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-25T20:12:40.308828] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-25T20:12:40.310219] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-25T20:12:40.310285] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-25T20:12:40.311924] [DEBUG] [LOCAL ] NABL: Trimmed 56723 records to 40059 (keeping 200 days of data) [2025-09-25T20:12:40.591287] [DEBUG] [LOCAL ] NABL: Primary data saved (40059 records). [2025-09-25T20:12:40.591473] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-25T20:12:40.591594] [INFO ] [MAIN ] Update Progress: 1451/2372 symbols completed. NABL took 45.0s. Estimated remaining: 2h 2m 16s. Rate: 7.5 symbols/min [2025-09-25T20:12:40.700432] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-25T20:12:40.774116] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:40.783061] [DEBUG] [LOCAL ] NAZ: Loaded 2671 existing records from primary storage. [2025-09-25T20:12:40.783252] [INFO ] [MAIN ] NAZ: Loaded 2671 existing records. [2025-09-25T20:12:40.981820] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:40.982149] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-25T20:12:40.982197] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-25T20:12:40.982468] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-25T20:12:40.982529] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-25T20:12:41.112027] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T20:12:41.386756] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T20:12:41.388671] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T20:12:41.491317] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-25T20:12:41.495715] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:42.288733] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-25T20:12:42.767550] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T20:12:43.088759] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-25T20:12:43.150107] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:12:43.888754] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-25T20:12:44.144455] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T20:12:44.685539] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:12:44.688672] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-25T20:12:45.488695] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-25T20:12:45.598939] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T20:12:45.601386] [INFO ] [REMOTE ] NAN: Full fetch complete (13943 records). [2025-09-25T20:12:45.601484] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-25T20:12:45.981834] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-25T20:12:45.981942] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-25T20:12:45.982684] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-25T20:12:45.982754] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-25T20:12:45.983379] [DEBUG] [LOCAL ] NAN: Trimmed 13943 records to 9060 (keeping 200 days of data) [2025-09-25T20:12:46.049632] [DEBUG] [LOCAL ] NAN: Primary data saved (9060 records). [2025-09-25T20:12:46.049840] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-25T20:12:46.049992] [INFO ] [MAIN ] Update Progress: 1452/2372 symbols completed. NAN took 24.4s. Estimated remaining: 2h 2m 6s. Rate: 7.5 symbols/min [2025-09-25T20:12:46.223261] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:12:46.244321] [DEBUG] [LOCAL ] NBB: Loaded 8877 existing records from primary storage. [2025-09-25T20:12:46.244540] [INFO ] [MAIN ] NBB: Loaded 8877 existing records. [2025-09-25T20:12:46.294053] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-25T20:12:46.449032] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:12:46.450535] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-25T20:12:46.450585] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-25T20:12:46.450824] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-25T20:12:46.450884] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-25T20:12:46.754686] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T20:12:46.878091] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:12:46.925791] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T20:12:47.088758] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-25T20:12:47.888765] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-25T20:12:48.288125] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T20:12:48.369863] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T20:12:48.688761] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-25T20:12:49.488766] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-25T20:12:49.616985] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T20:12:50.065434] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T20:12:50.288732] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-25T20:12:51.088736] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-25T20:12:51.888683] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-25T20:12:52.137567] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:12:52.319851] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T20:12:52.517835] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:12:52.688757] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-25T20:12:53.488715] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-25T20:12:53.925290] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T20:12:54.288713] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-25T20:12:54.351307] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T20:12:54.885514] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-25T20:12:55.088737] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-25T20:12:55.813155] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T20:12:55.888769] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-25T20:12:56.688825] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-25T20:12:57.304428] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T20:12:57.335371] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:12:57.488745] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-25T20:12:58.288788] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-25T20:12:58.314566] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:12:59.088777] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-25T20:12:59.562475] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-25T20:12:59.788976] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T20:12:59.888750] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-25T20:13:00.688781] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-25T20:13:01.488733] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-25T20:13:01.613248] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T20:13:01.748356] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T20:13:02.288733] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-25T20:13:02.875107] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T20:13:03.082690] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T20:13:03.089204] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-25T20:13:03.091403] [INFO ] [REMOTE ] NATL: Full fetch complete (45699 records). [2025-09-25T20:13:03.091566] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-25T20:13:03.545358] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-25T20:13:03.545475] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-25T20:13:03.546490] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-25T20:13:03.546616] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-25T20:13:03.548101] [DEBUG] [LOCAL ] NATL: Trimmed 45699 records to 33145 (keeping 200 days of data) [2025-09-25T20:13:03.700342] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T20:13:03.795970] [DEBUG] [LOCAL ] NATL: Primary data saved (33145 records). [2025-09-25T20:13:03.796176] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-25T20:13:03.796469] [INFO ] [MAIN ] Update Progress: 1453/2372 symbols completed. NATL took 25.1s. Estimated remaining: 2h 2m 5s. Rate: 7.5 symbols/min [2025-09-25T20:13:03.895763] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-25T20:13:04.004284] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:04.034697] [DEBUG] [LOCAL ] NBHC: Loaded 23172 existing records from primary storage. [2025-09-25T20:13:04.034875] [INFO ] [MAIN ] NBHC: Loaded 23172 existing records. [2025-09-25T20:13:04.223094] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:04.223449] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-25T20:13:04.223499] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-25T20:13:04.227698] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-25T20:13:04.227785] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-25T20:13:04.565291] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T20:13:04.630950] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:04.688725] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-25T20:13:05.365942] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T20:13:05.367987] [INFO ] [REMOTE ] NAZ: Full fetch complete (4428 records). [2025-09-25T20:13:05.368103] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-25T20:13:05.493820] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-25T20:13:05.754066] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-25T20:13:05.754208] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-25T20:13:05.754402] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-25T20:13:05.754444] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-25T20:13:05.754930] [DEBUG] [LOCAL ] NAZ: Trimmed 4428 records to 2685 (keeping 200 days of data) [2025-09-25T20:13:05.774831] [DEBUG] [LOCAL ] NAZ: Primary data saved (2685 records). [2025-09-25T20:13:05.774931] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-25T20:13:05.775079] [INFO ] [MAIN ] Update Progress: 1454/2372 symbols completed. NAZ took 25.2s. Estimated remaining: 2h 1m 53s. Rate: 7.5 symbols/min [2025-09-25T20:13:05.948307] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:06.041592] [DEBUG] [LOCAL ] NBR: Loaded 34854 existing records from primary storage. [2025-09-25T20:13:06.041820] [INFO ] [MAIN ] NBR: Loaded 34854 existing records. [2025-09-25T20:13:06.222787] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:06.223982] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-25T20:13:06.224047] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-25T20:13:06.226968] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-25T20:13:06.227031] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-25T20:13:06.296826] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-25T20:13:06.629169] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T20:13:06.671145] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:07.086285] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:13:07.090526] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-25T20:13:07.829798] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T20:13:07.888696] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-25T20:13:08.688748] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-25T20:13:08.974474] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T20:13:09.488802] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-25T20:13:10.288765] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-25T20:13:10.432427] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:13:10.625835] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T20:13:11.088745] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-25T20:13:11.684571] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T20:13:11.888716] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-25T20:13:11.952159] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:13:12.688685] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-25T20:13:12.969929] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T20:13:13.488745] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-25T20:13:14.288722] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-25T20:13:14.358279] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T20:13:14.498733] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T20:13:14.501293] [INFO ] [REMOTE ] NBB: Full fetch complete (13867 records). [2025-09-25T20:13:14.501413] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-25T20:13:14.895328] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-25T20:13:14.895450] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-25T20:13:14.895992] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-25T20:13:14.896056] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-25T20:13:14.897743] [DEBUG] [LOCAL ] NBB: Trimmed 13867 records to 8917 (keeping 200 days of data) [2025-09-25T20:13:14.977605] [DEBUG] [LOCAL ] NBB: Primary data saved (8917 records). [2025-09-25T20:13:14.977804] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-25T20:13:14.978044] [INFO ] [MAIN ] Update Progress: 1455/2372 symbols completed. NBB took 28.9s. Estimated remaining: 2h 1m 46s. Rate: 7.5 symbols/min [2025-09-25T20:13:15.093800] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-25T20:13:15.159864] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:15.197762] [DEBUG] [LOCAL ] NBXG: Loaded 22519 existing records from primary storage. [2025-09-25T20:13:15.197943] [INFO ] [MAIN ] NBXG: Loaded 22519 existing records. [2025-09-25T20:13:15.406430] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:13:15.394355] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:15.412583] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-25T20:13:15.412669] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-25T20:13:15.414273] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-25T20:13:15.414354] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-25T20:13:15.776311] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:15.888687] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-25T20:13:16.688743] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-25T20:13:17.023213] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T20:13:17.279252] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T20:13:17.456359] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T20:13:17.488699] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-25T20:13:18.288764] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-25T20:13:18.739247] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T20:13:19.088755] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-25T20:13:19.388734] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T20:13:19.888691] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-25T20:13:20.290158] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T20:13:20.688693] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-25T20:13:20.956463] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T20:13:21.488765] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-25T20:13:22.101618] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T20:13:22.288729] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-25T20:13:22.613291] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T20:13:23.088745] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-25T20:13:23.715912] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T20:13:23.888790] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-25T20:13:24.688845] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-25T20:13:24.916477] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T20:13:25.050147] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T20:13:25.488748] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-25T20:13:25.779103] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T20:13:26.288860] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-25T20:13:26.698635] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T20:13:27.088808] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-25T20:13:27.888803] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-25T20:13:27.943465] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T20:13:28.224386] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T20:13:28.688812] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-25T20:13:29.488892] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-25T20:13:29.741044] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T20:13:29.751544] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:13:30.288723] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-25T20:13:31.090027] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-25T20:13:31.104039] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T20:13:31.289495] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T20:13:31.888802] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-25T20:13:32.223626] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:13:32.688815] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-25T20:13:33.100465] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T20:13:33.488820] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-25T20:13:34.288713] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-25T20:13:34.474429] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T20:13:34.570046] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T20:13:35.088846] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-25T20:13:35.406235] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T20:13:35.888915] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-25T20:13:36.376114] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:13:36.381862] [INFO ] [REMOTE ] NBXG: Full fetch complete (32985 records). [2025-09-25T20:13:36.382065] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-25T20:13:36.703789] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-25T20:13:36.851742] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-25T20:13:36.851851] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-25T20:13:36.852885] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-25T20:13:36.853056] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-25T20:13:36.854122] [DEBUG] [LOCAL ] NBXG: Trimmed 32985 records to 22677 (keeping 200 days of data) [2025-09-25T20:13:37.026992] [DEBUG] [LOCAL ] NBXG: Primary data saved (22677 records). [2025-09-25T20:13:37.027185] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-25T20:13:37.027435] [INFO ] [MAIN ] Update Progress: 1456/2372 symbols completed. NBXG took 22.0s. Estimated remaining: 2h 1m 47s. Rate: 7.5 symbols/min [2025-09-25T20:13:37.211311] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:37.222136] [DEBUG] [LOCAL ] NC: Loaded 1909 existing records from primary storage. [2025-09-25T20:13:37.222270] [INFO ] [MAIN ] NC: Loaded 1909 existing records. [2025-09-25T20:13:37.443717] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:37.444099] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-25T20:13:37.444163] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-25T20:13:37.444699] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-25T20:13:37.444808] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-25T20:13:37.502893] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-25T20:13:37.882204] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:37.917530] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T20:13:37.930788] [INFO ] [REMOTE ] NAT: Full fetch complete (72140 records). [2025-09-25T20:13:37.931120] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-25T20:13:37.997994] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:13:38.030160] [INFO ] [REMOTE ] NBHC: Full fetch complete (31956 records). [2025-09-25T20:13:38.030318] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-25T20:13:38.389831] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-25T20:13:38.936199] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-25T20:13:38.936338] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-25T20:13:38.937883] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-25T20:13:38.937976] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-25T20:13:38.962285] [DEBUG] [LOCAL ] NAT: Trimmed 72140 records to 49478 (keeping 200 days of data) [2025-09-25T20:13:39.049124] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T20:13:39.111067] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-25T20:13:39.256199] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T20:13:39.259877] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-25T20:13:39.259925] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-25T20:13:39.260275] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-25T20:13:39.260319] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-25T20:13:39.266331] [DEBUG] [LOCAL ] NBHC: Trimmed 31956 records to 23359 (keeping 200 days of data) [2025-09-25T20:13:39.377979] [INFO ] [REMOTE ] NBR: Full fetch complete (49505 records). [2025-09-25T20:13:39.388466] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-25T20:13:39.498373] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T20:13:39.840843] [DEBUG] [LOCAL ] NAT: Primary data saved (49478 records). [2025-09-25T20:13:39.841041] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-25T20:13:39.841168] [INFO ] [MAIN ] Update Progress: 1457/2372 symbols completed. NAT took 1m 3s. Estimated remaining: 2h 1m 35s. Rate: 7.5 symbols/min [2025-09-25T20:13:39.854699] [DEBUG] [LOCAL ] NBHC: Primary data saved (23359 records). [2025-09-25T20:13:39.854944] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-25T20:13:39.855100] [INFO ] [MAIN ] Update Progress: 1458/2372 symbols completed. NBHC took 36.1s. Estimated remaining: 2h 1m 22s. Rate: 7.5 symbols/min [2025-09-25T20:13:39.966496] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-25T20:13:40.367629] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:40.454131] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T20:13:40.474132] [DEBUG] [LOCAL ] NCA: Loaded 10054 existing records from primary storage. [2025-09-25T20:13:40.474320] [INFO ] [MAIN ] NCA: Loaded 10054 existing records. [2025-09-25T20:13:40.501308] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-25T20:13:40.501407] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-25T20:13:40.503135] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-25T20:13:40.503218] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-25T20:13:40.558095] [DEBUG] [LOCAL ] NBR: Trimmed 49505 records to 35065 (keeping 200 days of data) [2025-09-25T20:13:40.584434] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:40.703758] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-25T20:13:40.812398] [DEBUG] [LOCAL ] NCDL: Loaded 21524 existing records from primary storage. [2025-09-25T20:13:40.812553] [INFO ] [MAIN ] NCDL: Loaded 21524 existing records. [2025-09-25T20:13:41.102953] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:41.103243] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-25T20:13:41.103299] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-25T20:13:41.103525] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-25T20:13:41.103584] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-25T20:13:41.199846] [DEBUG] [LOCAL ] NBR: Primary data saved (35065 records). [2025-09-25T20:13:41.226018] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-25T20:13:41.238248] [INFO ] [MAIN ] Update Progress: 1459/2372 symbols completed. NBR took 35.5s. Estimated remaining: 2h 1m 10s. Rate: 7.5 symbols/min [2025-09-25T20:13:41.277063] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T20:13:41.297768] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:41.329843] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-25T20:13:41.330006] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-25T20:13:41.330239] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-25T20:13:41.330299] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-25T20:13:41.503889] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-25T20:13:41.877291] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:13:42.086635] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T20:13:42.141429] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:42.255054] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-25T20:13:42.255269] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-09-25T20:13:42.295975] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-25T20:13:42.351529] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:42.475144] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:13:42.475422] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-25T20:13:42.475471] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-25T20:13:42.475885] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-25T20:13:42.475950] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-25T20:13:42.802710] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T20:13:42.880512] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:13:43.088751] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-25T20:13:43.888745] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-25T20:13:44.364578] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T20:13:44.444029] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:13:44.688771] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-25T20:13:45.167531] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T20:13:45.488823] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-25T20:13:46.288721] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-25T20:13:46.649775] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T20:13:47.088754] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-25T20:13:47.888703] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-25T20:13:48.164981] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T20:13:48.399617] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-25T20:13:48.688716] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-25T20:13:48.966858] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T20:13:49.479233] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T20:13:49.488671] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-25T20:13:50.288812] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-25T20:13:50.314735] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T20:13:51.088796] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-25T20:13:51.722399] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T20:13:51.738936] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:13:51.888751] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-25T20:13:52.400306] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T20:13:52.688730] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-25T20:13:53.488732] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-25T20:13:53.898525] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T20:13:54.288799] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-25T20:13:55.088695] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-25T20:13:55.184946] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T20:13:55.590123] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-25T20:13:55.888740] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-25T20:13:56.193832] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:13:56.684155] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T20:13:56.688676] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-25T20:13:57.488688] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-25T20:13:57.713808] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T20:13:58.288762] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-25T20:13:59.088689] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-25T20:13:59.391663] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-25T20:13:59.456831] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:13:59.742700] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T20:13:59.743804] [INFO ] [REMOTE ] NC: Full fetch complete (2723 records). [2025-09-25T20:13:59.743883] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-25T20:13:59.897970] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-25T20:14:00.186926] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-25T20:14:00.187043] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-25T20:14:00.187222] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-25T20:14:00.187269] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-25T20:14:00.187639] [DEBUG] [LOCAL ] NC: Trimmed 2723 records to 1925 (keeping 200 days of data) [2025-09-25T20:14:00.201758] [DEBUG] [LOCAL ] NC: Primary data saved (1925 records). [2025-09-25T20:14:00.201818] [INFO ] [MAIN ] NC: Full history saved. [2025-09-25T20:14:00.201926] [INFO ] [MAIN ] Update Progress: 1460/2372 symbols completed. NC took 23.2s. Estimated remaining: 2h 1m 9s. Rate: 7.5 symbols/min [2025-09-25T20:14:00.374529] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:00.394149] [DEBUG] [LOCAL ] NCV: Loaded 13371 existing records from primary storage. [2025-09-25T20:14:00.394299] [INFO ] [MAIN ] NCV: Loaded 13371 existing records. [2025-09-25T20:14:00.570851] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:00.571238] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-25T20:14:00.571299] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-25T20:14:00.571689] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-25T20:14:00.571749] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-25T20:14:00.693844] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-25T20:14:00.929556] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:01.062143] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T20:14:01.488756] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-25T20:14:02.288712] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-25T20:14:02.360758] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T20:14:02.972139] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-25T20:14:03.056271] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T20:14:03.088745] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-25T20:14:03.888738] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-25T20:14:04.629364] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:14:04.688739] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-25T20:14:05.455267] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-25T20:14:05.488679] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-25T20:14:05.842037] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T20:14:05.849482] [INFO ] [REMOTE ] NCDL: Full fetch complete (33190 records). [2025-09-25T20:14:05.849638] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-25T20:14:06.268432] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-25T20:14:06.268525] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-25T20:14:06.269269] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-25T20:14:06.269334] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-25T20:14:06.271463] [DEBUG] [LOCAL ] NCDL: Trimmed 33190 records to 21698 (keeping 200 days of data) [2025-09-25T20:14:06.337867] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-25T20:14:06.452188] [DEBUG] [LOCAL ] NCDL: Primary data saved (21698 records). [2025-09-25T20:14:06.452502] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-25T20:14:06.452895] [INFO ] [MAIN ] Update Progress: 1461/2372 symbols completed. NCDL took 26.6s. Estimated remaining: 2h 1m 0s. Rate: 7.5 symbols/min [2025-09-25T20:14:06.667033] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:06.690994] [DEBUG] [LOCAL ] NCZ: Loaded 11770 existing records from primary storage. [2025-09-25T20:14:06.691216] [INFO ] [MAIN ] NCZ: Loaded 11770 existing records. [2025-09-25T20:14:06.874828] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:06.875205] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-25T20:14:06.875265] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-25T20:14:06.875726] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-25T20:14:06.875786] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-25T20:14:07.112868] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-25T20:14:07.303935] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:07.362020] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T20:14:07.366633] [INFO ] [REMOTE ] NCA: Full fetch complete (15597 records). [2025-09-25T20:14:07.366857] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-25T20:14:07.715378] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-25T20:14:07.841058] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-25T20:14:07.841283] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-25T20:14:07.842136] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-25T20:14:07.842234] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-25T20:14:07.846760] [DEBUG] [LOCAL ] NCA: Trimmed 15597 records to 10134 (keeping 200 days of data) [2025-09-25T20:14:07.900375] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-25T20:14:07.939357] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T20:14:07.952155] [DEBUG] [LOCAL ] NCA: Primary data saved (10134 records). [2025-09-25T20:14:07.952345] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-25T20:14:07.952527] [INFO ] [MAIN ] Update Progress: 1462/2372 symbols completed. NCA took 28.1s. Estimated remaining: 2h 0m 48s. Rate: 7.5 symbols/min [2025-09-25T20:14:08.131000] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:08.157270] [DEBUG] [LOCAL ] NDMO: Loaded 16693 existing records from primary storage. [2025-09-25T20:14:08.157489] [INFO ] [MAIN ] NDMO: Loaded 16693 existing records. [2025-09-25T20:14:08.345914] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:08.346288] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-25T20:14:08.346343] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-25T20:14:08.346985] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-25T20:14:08.347060] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-25T20:14:08.694830] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-25T20:14:08.773970] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:09.488745] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-25T20:14:09.927182] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T20:14:10.206793] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-25T20:14:10.288703] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-25T20:14:10.603387] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T20:14:10.997887] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T20:14:11.088682] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-25T20:14:11.888698] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-25T20:14:11.992709] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T20:14:12.688912] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-25T20:14:13.200567] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T20:14:13.488731] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-25T20:14:14.288728] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-25T20:14:14.557956] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T20:14:14.588679] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T20:14:14.874223] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-25T20:14:15.088782] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-25T20:14:15.860359] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T20:14:15.888699] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-25T20:14:16.688741] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-25T20:14:16.861049] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-25T20:14:17.488760] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-25T20:14:17.895326] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T20:14:18.288706] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-25T20:14:18.354759] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T20:14:19.088727] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-25T20:14:19.165074] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T20:14:19.888719] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-25T20:14:20.027253] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T20:14:20.688760] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-25T20:14:21.466980] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T20:14:21.488678] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-25T20:14:21.799215] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T20:14:22.288758] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-25T20:14:22.467252] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T20:14:23.088754] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-25T20:14:23.201355] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T20:14:23.888746] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-25T20:14:23.998194] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T20:14:24.688812] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-25T20:14:25.488753] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-25T20:14:25.741510] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T20:14:25.745402] [INFO ] [REMOTE ] NCV: Full fetch complete (23043 records). [2025-09-25T20:14:25.745535] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-25T20:14:26.230284] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-25T20:14:26.230462] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-25T20:14:26.231256] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-25T20:14:26.231359] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-25T20:14:26.234141] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-25T20:14:26.244636] [DEBUG] [LOCAL ] NCV: Trimmed 23043 records to 13501 (keeping 200 days of data) [2025-09-25T20:14:26.247887] [INFO ] [REMOTE ] NCLH: Full fetch complete (77809 records). [2025-09-25T20:14:26.248122] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-25T20:14:26.300024] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-25T20:14:26.431061] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T20:14:26.508887] [DEBUG] [LOCAL ] NCV: Primary data saved (13501 records). [2025-09-25T20:14:26.509101] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-25T20:14:26.509342] [INFO ] [MAIN ] Update Progress: 1463/2372 symbols completed. NCV took 26.3s. Estimated remaining: 2h 0m 47s. Rate: 7.5 symbols/min [2025-09-25T20:14:26.932077] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:27.076921] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-25T20:14:27.077111] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-25T20:14:27.078794] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-25T20:14:27.081832] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-25T20:14:27.107233] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-25T20:14:27.088794] [DEBUG] [LOCAL ] NCLH: Trimmed 77809 records to 54143 (keeping 200 days of data) [2025-09-25T20:14:27.125451] [DEBUG] [LOCAL ] NE: Loaded 52384 existing records from primary storage. [2025-09-25T20:14:27.125631] [INFO ] [MAIN ] NE: Loaded 52384 existing records. [2025-09-25T20:14:27.133536] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T20:14:27.582002] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:27.592932] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-25T20:14:27.600709] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-25T20:14:27.601682] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-25T20:14:27.602715] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-25T20:14:27.811308] [DEBUG] [LOCAL ] NCLH: Primary data saved (54143 records). [2025-09-25T20:14:27.814392] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-25T20:14:27.814552] [INFO ] [MAIN ] Update Progress: 1464/2372 symbols completed. NCLH took 46.6s. Estimated remaining: 2h 0m 35s. Rate: 7.5 symbols/min [2025-09-25T20:14:27.889777] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-25T20:14:28.180495] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:28.190678] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T20:14:28.405673] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:28.408165] [DEBUG] [LOCAL ] NEA: Loaded 35277 existing records from primary storage. [2025-09-25T20:14:28.408604] [INFO ] [MAIN ] NEA: Loaded 35277 existing records. [2025-09-25T20:14:28.644191] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:28.644558] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-25T20:14:28.644615] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-25T20:14:28.645166] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-25T20:14:28.645232] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-25T20:14:28.694927] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-25T20:14:28.971417] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T20:14:29.140589] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:29.488755] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-25T20:14:29.699469] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T20:14:30.288748] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-25T20:14:30.983786] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T20:14:31.088705] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-25T20:14:31.175515] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:14:31.868053] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T20:14:31.888681] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-25T20:14:32.688878] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-25T20:14:33.241237] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T20:14:33.248766] [INFO ] [REMOTE ] NCZ: Full fetch complete (21538 records). [2025-09-25T20:14:33.248925] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-25T20:14:33.490750] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-25T20:14:33.674253] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-25T20:14:33.674350] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-25T20:14:33.674934] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-25T20:14:33.675011] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-25T20:14:33.675638] [DEBUG] [LOCAL ] NCZ: Trimmed 21538 records to 11900 (keeping 200 days of data) [2025-09-25T20:14:33.760402] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T20:14:33.780294] [DEBUG] [LOCAL ] NCZ: Primary data saved (11900 records). [2025-09-25T20:14:33.780484] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-25T20:14:33.780629] [INFO ] [MAIN ] Update Progress: 1465/2372 symbols completed. NCZ took 27.3s. Estimated remaining: 2h 0m 26s. Rate: 7.5 symbols/min [2025-09-25T20:14:33.963491] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:34.048638] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-25T20:14:34.048860] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-09-25T20:14:34.243041] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:34.243783] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-25T20:14:34.243862] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-25T20:14:34.244411] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-25T20:14:34.244480] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-25T20:14:34.293009] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-25T20:14:34.653468] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:34.934414] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T20:14:35.088803] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-25T20:14:35.152177] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:14:35.888870] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-25T20:14:36.688750] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-25T20:14:36.864340] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T20:14:37.248732] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T20:14:37.488787] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-25T20:14:38.288744] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-25T20:14:38.551514] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T20:14:39.088750] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-25T20:14:39.265045] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T20:14:39.597376] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T20:14:39.888748] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-25T20:14:40.219137] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T20:14:40.224459] [INFO ] [REMOTE ] NDMO: Full fetch complete (25093 records). [2025-09-25T20:14:40.224602] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-25T20:14:40.671594] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-25T20:14:40.671735] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-25T20:14:40.672395] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-25T20:14:40.672567] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-25T20:14:40.674365] [DEBUG] [LOCAL ] NDMO: Trimmed 25093 records to 16814 (keeping 200 days of data) [2025-09-25T20:14:40.688791] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-25T20:14:40.807256] [DEBUG] [LOCAL ] NDMO: Primary data saved (16814 records). [2025-09-25T20:14:40.807502] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-25T20:14:40.807759] [INFO ] [MAIN ] Update Progress: 1466/2372 symbols completed. NDMO took 32.9s. Estimated remaining: 2h 0m 17s. Rate: 7.5 symbols/min [2025-09-25T20:14:40.997608] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:14:41.095670] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-25T20:14:41.095885] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-09-25T20:14:41.294320] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:14:41.294899] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-25T20:14:41.294968] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-25T20:14:41.296079] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-25T20:14:41.296195] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-25T20:14:41.465742] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T20:14:41.506778] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-25T20:14:41.747690] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:14:42.288749] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-25T20:14:42.754840] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T20:14:43.090142] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-25T20:14:43.432409] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T20:14:43.477297] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-25T20:14:43.888774] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-25T20:14:44.688763] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-25T20:14:44.891510] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T20:14:45.488791] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-25T20:14:45.965985] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T20:14:46.167256] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T20:14:46.288746] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-25T20:14:47.089064] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-25T20:14:47.582992] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-25T20:14:47.888821] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-25T20:14:48.012138] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T20:14:48.688754] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-25T20:14:48.942228] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T20:14:49.488744] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-25T20:14:50.000123] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-25T20:14:50.288747] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-25T20:14:50.785671] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-25T20:14:51.088747] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-25T20:14:51.443331] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T20:14:51.888737] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-25T20:14:52.031249] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T20:14:52.688797] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-25T20:14:52.931190] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:14:53.341556] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:14:53.488765] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-25T20:14:54.288742] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-25T20:14:54.725217] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-25T20:14:55.088800] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-25T20:14:55.714877] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T20:14:55.786251] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-25T20:14:55.888689] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-25T20:14:56.688740] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-25T20:14:57.470300] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-25T20:14:57.488679] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-25T20:14:58.200902] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-25T20:14:58.288711] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-25T20:14:58.485100] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T20:14:59.088737] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-25T20:14:59.342813] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T20:14:59.888759] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-25T20:14:59.973693] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T20:15:00.130445] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:15:00.142329] [INFO ] [REMOTE ] NEA: Full fetch complete (52252 records). [2025-09-25T20:15:00.142613] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-25T20:15:00.611415] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-25T20:15:00.611557] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-25T20:15:00.612759] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-25T20:15:00.612827] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-25T20:15:00.616024] [DEBUG] [LOCAL ] NEA: Trimmed 52252 records to 35520 (keeping 200 days of data) [2025-09-25T20:15:00.699727] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-25T20:15:00.915334] [DEBUG] [LOCAL ] NEA: Primary data saved (35520 records). [2025-09-25T20:15:00.915570] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-25T20:15:00.915795] [INFO ] [MAIN ] Update Progress: 1467/2372 symbols completed. NEA took 33.1s. Estimated remaining: 2h 0m 16s. Rate: 7.5 symbols/min [2025-09-25T20:15:01.113743] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:01.210370] [DEBUG] [LOCAL ] NET: Loaded 53059 existing records from primary storage. [2025-09-25T20:15:01.210564] [INFO ] [MAIN ] NET: Loaded 53059 existing records. [2025-09-25T20:15:01.411943] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:01.412348] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-25T20:15:01.412420] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-25T20:15:01.412925] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-25T20:15:01.413011] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-25T20:15:01.488952] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-25T20:15:01.884674] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T20:15:01.942142] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:02.288893] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-25T20:15:03.089749] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-25T20:15:03.419282] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-25T20:15:03.443726] [INFO ] [REMOTE ] NEE: Full fetch complete (77759 records). [2025-09-25T20:15:03.444076] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-25T20:15:03.920666] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-25T20:15:03.920814] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-25T20:15:03.922245] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-25T20:15:03.922360] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-25T20:15:03.924374] [DEBUG] [LOCAL ] NEE: Trimmed 77759 records to 54097 (keeping 200 days of data) [2025-09-25T20:15:04.116093] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-25T20:15:04.150035] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-25T20:15:04.412815] [DEBUG] [LOCAL ] NEE: Primary data saved (54097 records). [2025-09-25T20:15:04.413137] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-25T20:15:04.414662] [INFO ] [MAIN ] Update Progress: 1468/2372 symbols completed. NEE took 30.6s. Estimated remaining: 2h 0m 6s. Rate: 7.5 symbols/min [2025-09-25T20:15:04.519454] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-25T20:15:04.664979] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:04.685973] [DEBUG] [LOCAL ] NEU: Loaded 8119 existing records from primary storage. [2025-09-25T20:15:04.686182] [INFO ] [MAIN ] NEU: Loaded 8119 existing records. [2025-09-25T20:15:04.692416] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-25T20:15:04.911880] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:04.913044] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-25T20:15:04.913132] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-25T20:15:04.913996] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-25T20:15:04.914085] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-25T20:15:05.079121] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T20:15:05.432252] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:05.488833] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-25T20:15:06.132171] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:15:06.288846] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-25T20:15:06.948483] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-25T20:15:07.088736] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-25T20:15:07.539768] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T20:15:07.888781] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-25T20:15:08.323823] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T20:15:08.589772] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-25T20:15:08.601723] [INFO ] [REMOTE ] NEM: Full fetch complete (77749 records). [2025-09-25T20:15:08.601967] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-25T20:15:08.693857] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-25T20:15:08.919556] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T20:15:09.139350] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-25T20:15:09.139487] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-25T20:15:09.141058] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-25T20:15:09.141179] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-25T20:15:09.146230] [DEBUG] [LOCAL ] NEM: Trimmed 77749 records to 54098 (keeping 200 days of data) [2025-09-25T20:15:09.504037] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-25T20:15:09.534163] [DEBUG] [LOCAL ] NEM: Primary data saved (54098 records). [2025-09-25T20:15:09.534381] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-25T20:15:09.534559] [INFO ] [MAIN ] Update Progress: 1469/2372 symbols completed. NEM took 28.7s. Estimated remaining: 1h 59m 56s. Rate: 7.5 symbols/min [2025-09-25T20:15:09.744895] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:09.751797] [DEBUG] [LOCAL ] NEUE: Loaded 2237 existing records from primary storage. [2025-09-25T20:15:09.752011] [INFO ] [MAIN ] NEUE: Loaded 2237 existing records. [2025-09-25T20:15:09.942106] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:09.942410] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-25T20:15:09.942466] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-25T20:15:09.942879] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-25T20:15:09.942941] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-25T20:15:10.300844] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-25T20:15:10.353416] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:10.706830] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T20:15:10.717484] [INFO ] [REMOTE ] NE: Full fetch complete (75412 records). [2025-09-25T20:15:10.717790] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-25T20:15:11.097799] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-25T20:15:11.160630] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-25T20:15:11.160795] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-25T20:15:11.162308] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-25T20:15:11.162383] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-25T20:15:11.175105] [DEBUG] [LOCAL ] NE: Trimmed 75412 records to 52771 (keeping 200 days of data) [2025-09-25T20:15:11.398170] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T20:15:11.559571] [DEBUG] [LOCAL ] NE: Primary data saved (52771 records). [2025-09-25T20:15:11.559779] [INFO ] [MAIN ] NE: Full history saved. [2025-09-25T20:15:11.559929] [INFO ] [MAIN ] Update Progress: 1470/2372 symbols completed. NE took 45.1s. Estimated remaining: 1h 59m 44s. Rate: 7.5 symbols/min [2025-09-25T20:15:11.776367] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:11.785329] [DEBUG] [LOCAL ] NEXA: Loaded 4133 existing records from primary storage. [2025-09-25T20:15:11.785459] [INFO ] [MAIN ] NEXA: Loaded 4133 existing records. [2025-09-25T20:15:11.839829] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T20:15:11.870053] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-25T20:15:11.895705] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-25T20:15:12.042684] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:12.043131] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-25T20:15:12.043211] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-25T20:15:12.043481] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-25T20:15:12.044004] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-25T20:15:12.417863] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:12.530161] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T20:15:12.688733] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-25T20:15:13.130051] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T20:15:13.488764] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-25T20:15:14.160892] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T20:15:14.288757] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-25T20:15:15.088826] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-25T20:15:15.888744] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-25T20:15:15.900703] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T20:15:16.563093] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-25T20:15:16.607281] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T20:15:16.688726] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-25T20:15:17.144169] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-25T20:15:17.488718] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-25T20:15:17.931305] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T20:15:18.288741] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-25T20:15:18.990116] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T20:15:19.088776] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-25T20:15:19.528056] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-25T20:15:19.888746] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-25T20:15:20.326571] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T20:15:20.688758] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-25T20:15:21.488781] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-25T20:15:21.978692] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T20:15:21.979786] [INFO ] [REMOTE ] NEUE: Full fetch complete (4033 records). [2025-09-25T20:15:21.979885] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-25T20:15:22.289167] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-25T20:15:22.385967] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-25T20:15:22.386090] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-25T20:15:22.386310] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-25T20:15:22.386378] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-25T20:15:22.386963] [DEBUG] [LOCAL ] NEUE: Trimmed 4033 records to 2255 (keeping 200 days of data) [2025-09-25T20:15:22.401989] [DEBUG] [LOCAL ] NEUE: Primary data saved (2255 records). [2025-09-25T20:15:22.402124] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-25T20:15:22.402299] [INFO ] [MAIN ] Update Progress: 1471/2372 symbols completed. NEUE took 12.9s. Estimated remaining: 1h 59m 38s. Rate: 7.5 symbols/min [2025-09-25T20:15:22.592670] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:22.646170] [DEBUG] [LOCAL ] NFG: Loaded 38534 existing records from primary storage. [2025-09-25T20:15:22.646362] [INFO ] [MAIN ] NFG: Loaded 38534 existing records. [2025-09-25T20:15:22.852379] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-25T20:15:22.898701] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:22.901417] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-25T20:15:22.901509] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-25T20:15:22.902017] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-25T20:15:22.902097] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-25T20:15:23.182534] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-25T20:15:23.200114] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:15:23.418807] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:23.888718] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-25T20:15:23.970581] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T20:15:24.688738] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-25T20:15:25.403584] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T20:15:25.488737] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-25T20:15:25.957553] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-25T20:15:26.288748] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-25T20:15:26.850592] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:15:26.887847] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T20:15:27.088771] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-25T20:15:27.888762] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-25T20:15:28.447027] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-25T20:15:28.688740] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-25T20:15:29.196600] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-25T20:15:29.488824] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-25T20:15:29.810918] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:15:30.288737] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-25T20:15:31.088726] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-25T20:15:31.583698] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T20:15:31.628295] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T20:15:31.824477] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T20:15:31.888735] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-25T20:15:32.688812] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-25T20:15:33.488941] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-25T20:15:34.071134] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T20:15:34.164602] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T20:15:34.187666] [INFO ] [REMOTE ] NET: Full fetch complete (76863 records). [2025-09-25T20:15:34.188143] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-25T20:15:34.288700] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-25T20:15:34.328833] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T20:15:34.714520] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-25T20:15:34.714638] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-25T20:15:34.716060] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-25T20:15:34.716233] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-25T20:15:34.720986] [DEBUG] [LOCAL ] NET: Trimmed 76863 records to 53435 (keeping 200 days of data) [2025-09-25T20:15:35.092050] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-25T20:15:35.103074] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T20:15:35.134668] [DEBUG] [LOCAL ] NET: Primary data saved (53435 records). [2025-09-25T20:15:35.134856] [INFO ] [MAIN ] NET: Full history saved. [2025-09-25T20:15:35.137252] [INFO ] [MAIN ] Update Progress: 1472/2372 symbols completed. NET took 34.2s. Estimated remaining: 1h 59m 33s. Rate: 7.5 symbols/min [2025-09-25T20:15:35.316722] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:35.352681] [DEBUG] [LOCAL ] NFJ: Loaded 20212 existing records from primary storage. [2025-09-25T20:15:35.352833] [INFO ] [MAIN ] NFJ: Loaded 20212 existing records. [2025-09-25T20:15:35.535685] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:35.535949] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-25T20:15:35.535997] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-25T20:15:35.536410] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-25T20:15:35.536481] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-25T20:15:35.900509] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-25T20:15:35.949066] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:36.570487] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T20:15:36.688743] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-25T20:15:36.937107] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T20:15:37.488717] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-25T20:15:37.725879] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T20:15:38.118765] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T20:15:38.288736] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-25T20:15:38.759094] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T20:15:39.088739] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-25T20:15:39.888994] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-25T20:15:40.688719] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-25T20:15:40.689587] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T20:15:41.069413] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T20:15:41.459358] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T20:15:41.463833] [INFO ] [REMOTE ] NEXA: Full fetch complete (7568 records). [2025-09-25T20:15:41.463970] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-25T20:15:41.494784] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-25T20:15:41.877836] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-25T20:15:41.877943] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-25T20:15:41.878183] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-25T20:15:41.878254] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-25T20:15:41.878954] [DEBUG] [LOCAL ] NEXA: Trimmed 7568 records to 4210 (keeping 200 days of data) [2025-09-25T20:15:41.915446] [DEBUG] [LOCAL ] NEXA: Primary data saved (4210 records). [2025-09-25T20:15:41.915631] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-25T20:15:41.915935] [INFO ] [MAIN ] Update Progress: 1473/2372 symbols completed. NEXA took 30.4s. Estimated remaining: 1h 59m 24s. Rate: 7.5 symbols/min [2025-09-25T20:15:42.129165] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:42.239506] [DEBUG] [LOCAL ] NGG: Loaded 46191 existing records from primary storage. [2025-09-25T20:15:42.239685] [INFO ] [MAIN ] NGG: Loaded 46191 existing records. [2025-09-25T20:15:42.298187] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-25T20:15:42.333258] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T20:15:42.453359] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:42.454967] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-25T20:15:42.455034] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-25T20:15:42.455379] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-25T20:15:42.455441] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-25T20:15:42.845992] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:43.088740] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-25T20:15:43.829143] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T20:15:43.888703] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-25T20:15:44.688840] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-25T20:15:44.753796] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T20:15:45.435043] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T20:15:45.488734] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-25T20:15:45.955446] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T20:15:46.288745] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-25T20:15:46.311607] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-25T20:15:47.088891] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-25T20:15:47.741172] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T20:15:47.888735] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-25T20:15:48.077997] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T20:15:48.080414] [INFO ] [REMOTE ] NEU: Full fetch complete (10291 records). [2025-09-25T20:15:48.080504] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-25T20:15:48.489542] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-25T20:15:48.489677] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-25T20:15:48.489997] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-25T20:15:48.490855] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-25T20:15:48.491500] [DEBUG] [LOCAL ] NEU: Trimmed 10291 records to 8200 (keeping 200 days of data) [2025-09-25T20:15:48.555950] [DEBUG] [LOCAL ] NEU: Primary data saved (8200 records). [2025-09-25T20:15:48.556121] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-25T20:15:48.556348] [INFO ] [MAIN ] Update Progress: 1474/2372 symbols completed. NEU took 44.1s. Estimated remaining: 1h 59m 16s. Rate: 7.5 symbols/min [2025-09-25T20:15:48.693791] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-25T20:15:48.763932] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:48.833889] [DEBUG] [LOCAL ] NGL: Loaded 30421 existing records from primary storage. [2025-09-25T20:15:48.834061] [INFO ] [MAIN ] NGL: Loaded 30421 existing records. [2025-09-25T20:15:49.031225] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:49.031706] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-25T20:15:49.031776] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-25T20:15:49.034319] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-25T20:15:49.034410] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-25T20:15:49.431731] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:49.488783] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-25T20:15:49.628749] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T20:15:49.642324] [INFO ] [REMOTE ] NFG: Full fetch complete (56749 records). [2025-09-25T20:15:49.642544] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-25T20:15:49.744973] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T20:15:50.129770] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-25T20:15:50.129882] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-25T20:15:50.131162] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-25T20:15:50.131233] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-25T20:15:50.132629] [DEBUG] [LOCAL ] NFG: Trimmed 56749 records to 38809 (keeping 200 days of data) [2025-09-25T20:15:50.289538] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-25T20:15:50.422036] [DEBUG] [LOCAL ] NFG: Primary data saved (38809 records). [2025-09-25T20:15:50.422259] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-25T20:15:50.422420] [INFO ] [MAIN ] Update Progress: 1475/2372 symbols completed. NFG took 28.0s. Estimated remaining: 1h 59m 4s. Rate: 7.5 symbols/min [2025-09-25T20:15:50.605074] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:15:50.627895] [DEBUG] [LOCAL ] NGS: Loaded 11534 existing records from primary storage. [2025-09-25T20:15:50.628055] [INFO ] [MAIN ] NGS: Loaded 11534 existing records. [2025-09-25T20:15:50.813112] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:15:50.813413] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-25T20:15:50.813465] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-25T20:15:50.814018] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-25T20:15:50.814080] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-25T20:15:51.093316] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-25T20:15:51.149736] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:15:51.264552] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:15:51.455518] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T20:15:51.872911] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T20:15:51.888671] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-25T20:15:52.688799] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-25T20:15:53.160238] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T20:15:53.488766] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-25T20:15:54.275092] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T20:15:54.288679] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-25T20:15:54.620503] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T20:15:55.088770] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-25T20:15:55.618926] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T20:15:55.888747] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-25T20:15:56.260530] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T20:15:56.688753] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-25T20:15:57.451795] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T20:15:57.488739] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-25T20:15:57.924043] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T20:15:58.288688] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-25T20:15:58.380850] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T20:15:59.088742] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-25T20:15:59.413276] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T20:15:59.888753] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-25T20:16:00.219804] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T20:16:00.688748] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-25T20:16:01.488729] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-25T20:16:01.744953] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T20:16:01.873364] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T20:16:02.288731] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-25T20:16:03.024886] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:16:03.088745] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-25T20:16:03.143021] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T20:16:03.888732] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-25T20:16:04.627356] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T20:16:04.688679] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-25T20:16:04.913833] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T20:16:05.488808] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-25T20:16:06.103047] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T20:16:06.288780] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-25T20:16:07.088859] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-25T20:16:07.202220] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:16:07.709928] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T20:16:07.719202] [INFO ] [REMOTE ] NGL: Full fetch complete (41132 records). [2025-09-25T20:16:07.719398] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-25T20:16:07.839945] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T20:16:07.893892] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-25T20:16:08.213617] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-25T20:16:08.213765] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-25T20:16:08.214751] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-25T20:16:08.214880] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-25T20:16:08.219544] [DEBUG] [LOCAL ] NGL: Trimmed 41132 records to 30631 (keeping 200 days of data) [2025-09-25T20:16:08.422696] [DEBUG] [LOCAL ] NGL: Primary data saved (30631 records). [2025-09-25T20:16:08.422867] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-25T20:16:08.423153] [INFO ] [MAIN ] Update Progress: 1476/2372 symbols completed. NGL took 19.9s. Estimated remaining: 1h 59m 2s. Rate: 7.5 symbols/min [2025-09-25T20:16:08.639343] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:08.676896] [DEBUG] [LOCAL ] NGVC: Loaded 22321 existing records from primary storage. [2025-09-25T20:16:08.677064] [INFO ] [MAIN ] NGVC: Loaded 22321 existing records. [2025-09-25T20:16:08.694833] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-25T20:16:08.894285] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:08.894579] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-25T20:16:08.894629] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-25T20:16:08.896947] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-25T20:16:08.897032] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-25T20:16:09.026982] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T20:16:09.374196] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:09.488767] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-25T20:16:10.288793] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-25T20:16:10.386616] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T20:16:10.652980] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T20:16:11.088728] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-25T20:16:11.392782] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T20:16:11.888896] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-25T20:16:12.688773] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-25T20:16:12.866199] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:16:13.013840] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T20:16:13.488773] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-25T20:16:13.869053] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T20:16:14.288759] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-25T20:16:14.311639] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T20:16:15.088766] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-25T20:16:15.888737] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-25T20:16:15.964527] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T20:16:15.997261] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T20:16:16.007437] [INFO ] [REMOTE ] NGG: Full fetch complete (66382 records). [2025-09-25T20:16:16.007759] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-25T20:16:16.456445] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-25T20:16:16.456557] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-25T20:16:16.457729] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-25T20:16:16.457863] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-25T20:16:16.459292] [DEBUG] [LOCAL ] NGG: Trimmed 66382 records to 46497 (keeping 200 days of data) [2025-09-25T20:16:16.711701] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-25T20:16:16.804237] [DEBUG] [LOCAL ] NGG: Primary data saved (46497 records). [2025-09-25T20:16:16.804420] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-25T20:16:16.804756] [INFO ] [MAIN ] Update Progress: 1477/2372 symbols completed. NGG took 34.9s. Estimated remaining: 1h 58m 54s. Rate: 7.5 symbols/min [2025-09-25T20:16:16.902458] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T20:16:17.488756] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-25T20:16:17.614278] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:16:18.288755] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-25T20:16:18.624589] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T20:16:19.088759] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-25T20:16:19.135854] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T20:16:19.139450] [INFO ] [REMOTE ] NGS: Full fetch complete (17212 records). [2025-09-25T20:16:19.139544] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-25T20:16:19.562665] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-25T20:16:19.562765] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-25T20:16:19.563186] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-25T20:16:19.563230] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-25T20:16:19.564172] [DEBUG] [LOCAL ] NGS: Trimmed 17212 records to 11597 (keeping 200 days of data) [2025-09-25T20:16:19.649844] [DEBUG] [LOCAL ] NGS: Primary data saved (11597 records). [2025-09-25T20:16:19.650002] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-25T20:16:19.650144] [INFO ] [MAIN ] Update Progress: 1478/2372 symbols completed. NGS took 29.2s. Estimated remaining: 1h 58m 43s. Rate: 7.5 symbols/min [2025-09-25T20:16:19.888742] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-25T20:16:20.237672] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T20:16:20.653406] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T20:16:20.657375] [INFO ] [REMOTE ] NFJ: Full fetch complete (30402 records). [2025-09-25T20:16:20.657591] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-25T20:16:20.694235] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-25T20:16:21.060810] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-25T20:16:21.061052] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-25T20:16:21.062085] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-25T20:16:21.062149] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-25T20:16:21.063119] [DEBUG] [LOCAL ] NFJ: Trimmed 30402 records to 20362 (keeping 200 days of data) [2025-09-25T20:16:21.217250] [DEBUG] [LOCAL ] NFJ: Primary data saved (20362 records). [2025-09-25T20:16:21.217438] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-25T20:16:21.217616] [INFO ] [MAIN ] Update Progress: 1479/2372 symbols completed. NFJ took 46.1s. Estimated remaining: 1h 58m 32s. Rate: 7.5 symbols/min [2025-09-25T20:16:22.152423] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T20:16:22.159771] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-25T20:16:23.323518] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T20:16:23.328786] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-25T20:16:24.522468] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T20:16:24.527989] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-25T20:16:25.832016] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T20:16:25.837821] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-25T20:16:27.056178] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T20:16:27.063194] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-25T20:16:28.367931] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T20:16:28.373793] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-25T20:16:29.556363] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T20:16:29.561298] [INFO ] [REMOTE ] NGVC: Full fetch complete (30357 records). [2025-09-25T20:16:29.561402] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-25T20:16:29.932987] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-25T20:16:29.933092] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-25T20:16:29.933954] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-25T20:16:29.934017] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-25T20:16:29.934996] [DEBUG] [LOCAL ] NGVC: Trimmed 30357 records to 22506 (keeping 200 days of data) [2025-09-25T20:16:30.079718] [DEBUG] [LOCAL ] NGVC: Primary data saved (22506 records). [2025-09-25T20:16:30.079899] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-25T20:16:30.080025] [INFO ] [MAIN ] Update Progress: 1480/2372 symbols completed. NGVC took 21.7s. Estimated remaining: 1h 58m 24s. Rate: 7.5 symbols/min [2025-09-25T20:16:30.654790] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:30.655061] [DEBUG] [LOCAL ] NI: No existing data file found in primary storage. [2025-09-25T20:16:30.655116] [WARN ] [MAIN ] NI: No existing data found, performing full refresh instead. [2025-09-25T20:16:30.662006] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-25T20:16:30.662081] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-25T20:16:30.662150] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-25T20:16:30.662208] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-25T20:16:30.813513] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:30.922776] [DEBUG] [LOCAL ] NIC: Loaded 8889 existing records from primary storage. [2025-09-25T20:16:30.922972] [INFO ] [MAIN ] NIC: Loaded 8889 existing records. [2025-09-25T20:16:30.988065] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:31.029142] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:31.164449] [DEBUG] [LOCAL ] NHI: Loaded 21990 existing records from primary storage. [2025-09-25T20:16:31.164630] [INFO ] [MAIN ] NHI: Loaded 21990 existing records. [2025-09-25T20:16:31.228634] [DEBUG] [LOCAL ] NGVT: Loaded 24353 existing records from primary storage. [2025-09-25T20:16:31.228916] [INFO ] [MAIN ] NGVT: Loaded 24353 existing records. [2025-09-25T20:16:31.838129] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:31.854220] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-25T20:16:31.854486] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-25T20:16:31.867960] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-25T20:16:31.868167] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-25T20:16:32.034804] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:32.035204] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-25T20:16:32.035262] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-25T20:16:32.035558] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-25T20:16:32.035622] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-25T20:16:32.076436] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:32.099300] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-25T20:16:32.099413] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-25T20:16:32.147036] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-25T20:16:32.147294] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-25T20:16:32.660082] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:32.677748] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-25T20:16:33.568102] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:33.634003] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-25T20:16:33.691284] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:33.691709] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-25T20:16:33.770935] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:33.771331] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-25T20:16:34.520521] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T20:16:34.522971] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-25T20:16:34.731624] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-25T20:16:34.751009] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-25T20:16:34.759843] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:16:34.768157] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-25T20:16:34.896939] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T20:16:34.902359] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-25T20:16:35.410371] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T20:16:35.413041] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-25T20:16:35.669580] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T20:16:35.674853] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-25T20:16:36.015191] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T20:16:36.018617] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-25T20:16:36.098587] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T20:16:36.103623] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-25T20:16:36.614359] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T20:16:36.618426] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-25T20:16:36.669372] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T20:16:36.688677] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-25T20:16:36.871787] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T20:16:36.895573] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T20:16:37.202710] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T20:16:37.488863] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-25T20:16:38.288737] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-25T20:16:38.323626] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T20:16:38.624096] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T20:16:39.088767] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-25T20:16:39.180362] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T20:16:39.888869] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-25T20:16:40.625199] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T20:16:40.688692] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-25T20:16:41.033351] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T20:16:41.488845] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-25T20:16:42.288801] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-25T20:16:42.631123] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T20:16:42.735689] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T20:16:43.088778] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-25T20:16:43.198860] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T20:16:43.888726] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-25T20:16:44.265615] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T20:16:44.688755] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-25T20:16:44.836364] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-25T20:16:45.488781] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-25T20:16:45.709224] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T20:16:46.288761] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-25T20:16:47.088791] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-25T20:16:47.390354] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T20:16:47.421759] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:16:47.888867] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-25T20:16:48.387426] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T20:16:48.688731] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-25T20:16:48.773274] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T20:16:49.488779] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-25T20:16:49.990022] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T20:16:50.288760] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-25T20:16:50.956313] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T20:16:51.088741] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-25T20:16:51.224583] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:16:51.888772] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-25T20:16:52.132175] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:16:52.139193] [INFO ] [REMOTE ] NHI: Full fetch complete (31563 records). [2025-09-25T20:16:52.139559] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-25T20:16:52.581487] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-25T20:16:52.581629] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-25T20:16:52.583032] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-25T20:16:52.583173] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-25T20:16:52.584284] [DEBUG] [LOCAL ] NHI: Trimmed 31563 records to 22129 (keeping 200 days of data) [2025-09-25T20:16:52.695737] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-25T20:16:52.759366] [DEBUG] [LOCAL ] NHI: Primary data saved (22129 records). [2025-09-25T20:16:52.759568] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-25T20:16:52.759799] [INFO ] [MAIN ] Update Progress: 1481/2372 symbols completed. NHI took 22.6s. Estimated remaining: 1h 58m 25s. Rate: 7.5 symbols/min [2025-09-25T20:16:52.939100] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:52.964098] [DEBUG] [LOCAL ] NIE: Loaded 11620 existing records from primary storage. [2025-09-25T20:16:52.964361] [INFO ] [MAIN ] NIE: Loaded 11620 existing records. [2025-09-25T20:16:53.165498] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:53.168912] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-25T20:16:53.168983] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-25T20:16:53.169367] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-25T20:16:53.169506] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-25T20:16:53.516749] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-25T20:16:53.550032] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:53.768993] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T20:16:53.862769] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:16:54.288761] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-25T20:16:54.311048] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:16:54.313307] [INFO ] [REMOTE ] NIC: Full fetch complete (12161 records). [2025-09-25T20:16:54.313380] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-25T20:16:54.687528] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-25T20:16:54.687616] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-25T20:16:54.687979] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-25T20:16:54.688037] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-25T20:16:54.689350] [DEBUG] [LOCAL ] NIC: Trimmed 12161 records to 8966 (keeping 200 days of data) [2025-09-25T20:16:54.756825] [DEBUG] [LOCAL ] NIC: Primary data saved (8966 records). [2025-09-25T20:16:54.756980] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-25T20:16:54.757117] [INFO ] [MAIN ] Update Progress: 1482/2372 symbols completed. NIC took 24.7s. Estimated remaining: 1h 58m 13s. Rate: 7.5 symbols/min [2025-09-25T20:16:54.940322] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:16:54.958497] [DEBUG] [LOCAL ] NIM: Loaded 4103 existing records from primary storage. [2025-09-25T20:16:54.958702] [INFO ] [MAIN ] NIM: Loaded 4103 existing records. [2025-09-25T20:16:55.093811] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-25T20:16:55.159230] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:16:55.159617] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-25T20:16:55.159696] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-25T20:16:55.159964] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-25T20:16:55.160024] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-25T20:16:55.277798] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:16:55.538686] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:16:55.888749] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-25T20:16:56.261993] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T20:16:56.448262] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T20:16:56.688718] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-25T20:16:57.488709] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-25T20:16:57.557068] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:16:58.288761] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-25T20:16:58.874176] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T20:16:59.050217] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T20:16:59.088738] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-25T20:16:59.888747] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-25T20:17:00.237693] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T20:17:00.246678] [INFO ] [REMOTE ] NGVT: Full fetch complete (34556 records). [2025-09-25T20:17:00.246787] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-25T20:17:00.650218] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-25T20:17:00.650335] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-25T20:17:00.651479] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-25T20:17:00.651545] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-25T20:17:00.652583] [DEBUG] [LOCAL ] NGVT: Trimmed 34556 records to 24491 (keeping 200 days of data) [2025-09-25T20:17:00.718036] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-25T20:17:00.826852] [DEBUG] [LOCAL ] NGVT: Primary data saved (24491 records). [2025-09-25T20:17:00.827048] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-25T20:17:00.827176] [INFO ] [MAIN ] Update Progress: 1483/2372 symbols completed. NGVT took 30.7s. Estimated remaining: 1h 58m 4s. Rate: 7.5 symbols/min [2025-09-25T20:17:00.997596] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:01.037273] [DEBUG] [LOCAL ] NINE: Loaded 28346 existing records from primary storage. [2025-09-25T20:17:01.037467] [INFO ] [MAIN ] NINE: Loaded 28346 existing records. [2025-09-25T20:17:01.226447] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:17:01.227595] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-25T20:17:01.227696] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-25T20:17:01.228313] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-25T20:17:01.228380] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-25T20:17:01.499241] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-25T20:17:01.506336] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T20:17:01.666288] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:01.864622] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:17:02.288695] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-25T20:17:02.513577] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T20:17:03.088690] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-25T20:17:03.092688] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T20:17:03.103726] [INFO ] [REMOTE ] NI: Full fetch complete (76875 records). [2025-09-25T20:17:03.103931] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-25T20:17:03.106286] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:17:03.106391] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:17:03.106447] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:17:03.106525] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-25T20:17:03.106594] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-25T20:17:03.106732] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-25T20:17:03.106820] [DEBUG] [LOCAL ] NI: No derivative data file found to delete. [2025-09-25T20:17:03.106912] [INFO ] [MAIN ] Update Progress: 1484/2372 symbols completed. NI took 33.0s. Estimated remaining: 1h 57m 53s. Rate: 7.5 symbols/min [2025-09-25T20:17:03.317602] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:03.420309] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-25T20:17:03.420514] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-09-25T20:17:03.607142] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:17:03.607909] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-25T20:17:03.607964] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-25T20:17:03.608372] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-25T20:17:03.608436] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-25T20:17:03.846732] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T20:17:03.893182] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-25T20:17:04.048016] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:04.688855] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-25T20:17:04.705463] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T20:17:05.488754] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-25T20:17:06.182800] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T20:17:06.208578] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T20:17:06.288680] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-25T20:17:06.985131] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T20:17:07.088725] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-25T20:17:07.599716] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T20:17:07.888751] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-25T20:17:08.688960] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-25T20:17:09.488816] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-25T20:17:09.745739] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T20:17:09.754065] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T20:17:10.118410] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T20:17:10.288737] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-25T20:17:10.739120] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-25T20:17:11.088741] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-25T20:17:11.888748] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-25T20:17:11.936772] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:17:12.688920] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-25T20:17:13.488843] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-25T20:17:13.542380] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:17:13.867895] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-25T20:17:13.869418] [INFO ] [REMOTE ] NIM: Full fetch complete (6817 records). [2025-09-25T20:17:13.869538] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-25T20:17:14.292904] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-25T20:17:14.366552] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-25T20:17:14.366965] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-25T20:17:14.367361] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-25T20:17:14.367485] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-25T20:17:14.368482] [DEBUG] [LOCAL ] NIM: Trimmed 6817 records to 4117 (keeping 200 days of data) [2025-09-25T20:17:14.404261] [DEBUG] [LOCAL ] NIM: Primary data saved (4117 records). [2025-09-25T20:17:14.404437] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-25T20:17:14.404755] [INFO ] [MAIN ] Update Progress: 1485/2372 symbols completed. NIM took 19.6s. Estimated remaining: 1h 57m 47s. Rate: 7.5 symbols/min [2025-09-25T20:17:14.676099] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:14.676338] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-25T20:17:14.679979] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-25T20:17:14.676383] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-25T20:17:14.692861] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-25T20:17:14.692914] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-25T20:17:14.692958] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-25T20:17:14.693002] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-25T20:17:15.093076] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-25T20:17:15.138348] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:15.417200] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T20:17:15.888730] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-25T20:17:16.206768] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:17:16.688762] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-25T20:17:17.082237] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T20:17:17.488731] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-25T20:17:17.555626] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T20:17:17.751626] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:17.752102] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-25T20:17:18.288869] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-25T20:17:19.088743] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-25T20:17:19.192446] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:17:19.195259] [INFO ] [REMOTE ] NIE: Full fetch complete (16354 records). [2025-09-25T20:17:19.195379] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-25T20:17:19.352547] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:19.366284] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-25T20:17:19.618777] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-25T20:17:19.618919] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-25T20:17:19.619501] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-25T20:17:19.619546] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-25T20:17:19.620999] [DEBUG] [LOCAL ] NIE: Trimmed 16354 records to 11696 (keeping 200 days of data) [2025-09-25T20:17:19.720874] [DEBUG] [LOCAL ] NIE: Primary data saved (11696 records). [2025-09-25T20:17:19.721093] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-25T20:17:19.721283] [INFO ] [MAIN ] Update Progress: 1486/2372 symbols completed. NIE took 27.0s. Estimated remaining: 1h 57m 37s. Rate: 7.5 symbols/min [2025-09-25T20:17:19.894809] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-25T20:17:19.900364] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:19.959014] [DEBUG] [LOCAL ] NJR: Loaded 38112 existing records from primary storage. [2025-09-25T20:17:19.959215] [INFO ] [MAIN ] NJR: Loaded 38112 existing records. [2025-09-25T20:17:20.141957] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:17:20.142372] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-25T20:17:20.143171] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-25T20:17:20.143584] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-25T20:17:20.143704] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-25T20:17:20.178578] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:20.179069] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-25T20:17:20.530782] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:20.688726] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-25T20:17:21.488742] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-25T20:17:22.288735] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-25T20:17:22.537147] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:22.537612] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-25T20:17:22.945230] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T20:17:23.088715] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-25T20:17:23.342897] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-25T20:17:23.888742] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-25T20:17:24.146312] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:24.146890] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-25T20:17:24.227899] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T20:17:24.688709] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-25T20:17:25.488758] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-25T20:17:25.752104] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:25.752708] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-25T20:17:26.159278] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T20:17:26.288746] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-25T20:17:27.088741] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-25T20:17:27.729914] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T20:17:27.888730] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-25T20:17:28.540002] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T20:17:28.688710] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-25T20:17:29.488715] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-25T20:17:30.289663] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-25T20:17:30.294963] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T20:17:30.394549] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-25T20:17:30.546372] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:17:30.546830] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-25T20:17:31.088700] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-25T20:17:31.370625] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T20:17:31.888767] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-25T20:17:32.665007] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T20:17:32.688702] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-25T20:17:32.932920] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T20:17:33.488767] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-25T20:17:34.159435] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T20:17:34.288728] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-25T20:17:35.088749] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-25T20:17:35.888692] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-25T20:17:35.889919] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T20:17:36.081786] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-25T20:17:36.370601] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T20:17:36.688730] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-25T20:17:37.488775] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-25T20:17:37.665065] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:17:38.288836] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-25T20:17:38.965662] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T20:17:39.088765] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-25T20:17:39.414216] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-25T20:17:39.470477] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T20:17:39.481838] [INFO ] [REMOTE ] NIQ: Full fetch complete (15738 records). [2025-09-25T20:17:39.482137] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-25T20:17:39.702056] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 46 unique days, need 200 days [2025-09-25T20:17:39.702858] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:17:39.702989] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:17:39.703148] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-25T20:17:39.703331] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-25T20:17:39.703412] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-25T20:17:39.703500] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-25T20:17:39.703665] [INFO ] [MAIN ] Update Progress: 1487/2372 symbols completed. NIQ took 25.3s. Estimated remaining: 1h 57m 37s. Rate: 7.5 symbols/min [2025-09-25T20:17:39.893890] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:39.894271] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-25T20:17:39.894328] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-25T20:17:39.894541] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-25T20:17:39.894582] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-25T20:17:39.894622] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-25T20:17:39.895023] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-25T20:17:39.894759] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-25T20:17:40.315178] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:40.688935] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-25T20:17:40.702033] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T20:17:41.489035] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-25T20:17:42.288720] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-25T20:17:42.545033] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T20:17:42.561737] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-25T20:17:42.573344] [INFO ] [REMOTE ] NINE: Full fetch complete (44231 records). [2025-09-25T20:17:42.574082] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-25T20:17:43.025666] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-25T20:17:43.025809] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-25T20:17:43.027197] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-25T20:17:43.027313] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-25T20:17:43.061432] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-25T20:17:43.061785] [DEBUG] [LOCAL ] NINE: Trimmed 44231 records to 28502 (keeping 200 days of data) [2025-09-25T20:17:43.088684] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-25T20:17:43.295875] [DEBUG] [LOCAL ] NINE: Primary data saved (28502 records). [2025-09-25T20:17:43.296073] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-25T20:17:43.296276] [INFO ] [MAIN ] Update Progress: 1488/2372 symbols completed. NINE took 42.5s. Estimated remaining: 1h 57m 26s. Rate: 7.5 symbols/min [2025-09-25T20:17:43.480578] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:43.511411] [DEBUG] [LOCAL ] NKX: Loaded 13619 existing records from primary storage. [2025-09-25T20:17:43.511584] [INFO ] [MAIN ] NKX: Loaded 13619 existing records. [2025-09-25T20:17:43.612023] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T20:17:43.753899] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:17:43.754211] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-25T20:17:43.754259] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-25T20:17:43.754986] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-25T20:17:43.755053] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-25T20:17:43.899509] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-25T20:17:44.171035] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:44.688788] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-25T20:17:45.488790] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-25T20:17:45.694948] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T20:17:45.741692] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-25T20:17:46.288763] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-25T20:17:46.406278] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-25T20:17:46.891240] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T20:17:46.901395] [INFO ] [REMOTE ] NJR: Full fetch complete (54462 records). [2025-09-25T20:17:46.901599] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-25T20:17:47.089139] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-25T20:17:47.371606] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-25T20:17:47.371754] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-25T20:17:47.373416] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-25T20:17:47.373487] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-25T20:17:47.375217] [DEBUG] [LOCAL ] NJR: Trimmed 54462 records to 38433 (keeping 200 days of data) [2025-09-25T20:17:47.677156] [DEBUG] [LOCAL ] NJR: Primary data saved (38433 records). [2025-09-25T20:17:47.677420] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-25T20:17:47.677697] [INFO ] [MAIN ] Update Progress: 1489/2372 symbols completed. NJR took 28.0s. Estimated remaining: 1h 57m 16s. Rate: 7.5 symbols/min [2025-09-25T20:17:47.854028] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:47.854263] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-25T20:17:47.854304] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-25T20:17:47.855366] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-25T20:17:47.855472] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-25T20:17:47.855545] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-25T20:17:47.855582] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-25T20:17:47.903938] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-25T20:17:48.042765] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-25T20:17:48.278168] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:48.688764] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-25T20:17:48.892629] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-25T20:17:49.285800] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T20:17:49.488728] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-25T20:17:50.151452] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T20:17:50.288803] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-25T20:17:50.647711] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-25T20:17:51.088809] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-25T20:17:51.888782] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-25T20:17:52.008335] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T20:17:52.688775] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-25T20:17:52.798303] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-25T20:17:53.342105] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T20:17:53.488761] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-25T20:17:54.206278] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-25T20:17:54.288713] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-25T20:17:55.073420] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:17:55.088793] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-25T20:17:55.089141] [INFO ] [REMOTE ] NIO: Full fetch complete (77974 records). [2025-09-25T20:17:55.090629] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-25T20:17:55.576409] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-25T20:17:55.576614] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-25T20:17:55.578053] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-25T20:17:55.579272] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-25T20:17:55.582057] [DEBUG] [LOCAL ] NIO: Trimmed 77974 records to 54192 (keeping 200 days of data) [2025-09-25T20:17:55.895280] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-25T20:17:55.958379] [DEBUG] [LOCAL ] NIO: Primary data saved (54192 records). [2025-09-25T20:17:55.958566] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-25T20:17:55.960580] [INFO ] [MAIN ] Update Progress: 1490/2372 symbols completed. NIO took 52.9s. Estimated remaining: 1h 57m 8s. Rate: 7.5 symbols/min [2025-09-25T20:17:56.086576] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T20:17:56.179259] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:17:56.202610] [DEBUG] [LOCAL ] NLOP: Loaded 11843 existing records from primary storage. [2025-09-25T20:17:56.202784] [INFO ] [MAIN ] NLOP: Loaded 11843 existing records. [2025-09-25T20:17:56.408705] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:17:56.437349] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-25T20:17:56.440687] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-25T20:17:56.441251] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-25T20:17:56.441735] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-25T20:17:56.443341] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.95 seconds). [2025-09-25T20:17:56.678399] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T20:17:56.693787] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-25T20:17:56.835528] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:17:57.488733] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-25T20:17:58.288737] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-25T20:17:58.482061] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T20:17:59.088710] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-25T20:17:59.133741] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-25T20:17:59.153099] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T20:17:59.888733] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-25T20:17:59.913000] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T20:18:00.688769] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-25T20:18:01.488787] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-25T20:18:01.945503] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T20:18:02.199476] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T20:18:02.288700] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-25T20:18:02.530138] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-25T20:18:02.998402] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T20:18:03.088741] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-25T20:18:03.888771] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-25T20:18:04.002180] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T20:18:04.688739] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-25T20:18:05.488719] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-25T20:18:05.594462] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T20:18:06.207554] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-25T20:18:06.288687] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-25T20:18:06.659714] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-25T20:18:07.084107] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T20:18:07.088749] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-25T20:18:07.875614] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T20:18:07.888752] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-25T20:18:08.688741] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-25T20:18:09.488734] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-25T20:18:09.859166] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:18:10.293263] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-25T20:18:10.293166] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-25T20:18:10.381790] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T20:18:10.948799] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T20:18:11.088795] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-25T20:18:11.732774] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T20:18:11.734379] [INFO ] [REMOTE ] NL: Full fetch complete (6946 records). [2025-09-25T20:18:11.734461] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-25T20:18:11.895146] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-25T20:18:11.949170] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:18:11.949610] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:18:11.949734] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:18:11.949836] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-25T20:18:11.949943] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-25T20:18:11.950014] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-25T20:18:11.950099] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-25T20:18:11.950197] [INFO ] [MAIN ] Update Progress: 1491/2372 symbols completed. NL took 24.3s. Estimated remaining: 1h 57m 5s. Rate: 7.5 symbols/min [2025-09-25T20:18:12.142721] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:12.222813] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-25T20:18:12.223008] [INFO ] [MAIN ] NLY: Loaded 53581 existing records. [2025-09-25T20:18:12.406679] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:12.407586] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-25T20:18:12.407667] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-25T20:18:12.408115] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-25T20:18:12.408173] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-25T20:18:12.693952] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-25T20:18:12.775908] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:13.488713] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-25T20:18:13.800475] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:18:14.288756] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-25T20:18:14.438721] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-25T20:18:14.449158] [INFO ] [REMOTE ] NKE: Full fetch complete (77197 records). [2025-09-25T20:18:14.449355] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-25T20:18:14.574062] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T20:18:14.712457] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T20:18:14.713313] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:18:14.713406] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:18:14.713475] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-25T20:18:14.713540] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-25T20:18:14.713575] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-25T20:18:14.713613] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-25T20:18:14.713729] [INFO ] [MAIN ] Update Progress: 1492/2372 symbols completed. NKE took 35.0s. Estimated remaining: 1h 56m 54s. Rate: 7.5 symbols/min [2025-09-25T20:18:14.892568] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:14.921115] [DEBUG] [LOCAL ] NMAI: Loaded 13047 existing records from primary storage. [2025-09-25T20:18:14.921316] [INFO ] [MAIN ] NMAI: Loaded 13047 existing records. [2025-09-25T20:18:15.116403] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:15.110842] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-25T20:18:15.116954] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-25T20:18:15.117017] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-25T20:18:15.117340] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-25T20:18:15.117405] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-25T20:18:15.181441] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T20:18:15.520266] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:15.888740] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-25T20:18:16.688754] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-25T20:18:16.945579] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T20:18:17.260833] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-25T20:18:17.488718] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-25T20:18:17.779994] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T20:18:18.289010] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-25T20:18:19.088929] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-25T20:18:19.384316] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T20:18:19.390414] [INFO ] [REMOTE ] NKX: Full fetch complete (19452 records). [2025-09-25T20:18:19.390556] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-25T20:18:19.755329] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T20:18:19.851436] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-25T20:18:19.889626] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-25T20:18:19.891073] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-25T20:18:19.891195] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-25T20:18:19.891778] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-25T20:18:19.892283] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-25T20:18:19.893548] [DEBUG] [LOCAL ] NKX: Trimmed 19452 records to 13747 (keeping 200 days of data) [2025-09-25T20:18:20.002898] [DEBUG] [LOCAL ] NKX: Primary data saved (13747 records). [2025-09-25T20:18:20.003083] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-25T20:18:20.003266] [INFO ] [MAIN ] Update Progress: 1493/2372 symbols completed. NKX took 36.7s. Estimated remaining: 1h 56m 44s. Rate: 7.5 symbols/min [2025-09-25T20:18:20.274974] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:20.275201] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-25T20:18:20.275245] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-25T20:18:20.275638] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-25T20:18:20.275722] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-25T20:18:20.275770] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-25T20:18:20.275808] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-25T20:18:20.668963] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:20.688700] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-25T20:18:20.787936] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:18:20.793177] [INFO ] [REMOTE ] NLOP: Full fetch complete (17703 records). [2025-09-25T20:18:20.793415] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-25T20:18:21.263395] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-25T20:18:21.263510] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-25T20:18:21.264428] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-25T20:18:21.264498] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-25T20:18:21.265548] [DEBUG] [LOCAL ] NLOP: Trimmed 17703 records to 11904 (keeping 200 days of data) [2025-09-25T20:18:21.361976] [DEBUG] [LOCAL ] NLOP: Primary data saved (11904 records). [2025-09-25T20:18:21.362190] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-25T20:18:21.362323] [INFO ] [MAIN ] Update Progress: 1494/2372 symbols completed. NLOP took 25.4s. Estimated remaining: 1h 56m 32s. Rate: 7.5 symbols/min [2025-09-25T20:18:21.493897] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-25T20:18:21.585110] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:21.617784] [DEBUG] [LOCAL ] NMCO: Loaded 16552 existing records from primary storage. [2025-09-25T20:18:21.617995] [INFO ] [MAIN ] NMCO: Loaded 16552 existing records. [2025-09-25T20:18:21.752629] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:18:21.753182] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-25T20:18:21.764440] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T20:18:21.869034] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:21.869445] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-25T20:18:21.869503] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-25T20:18:21.869878] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-25T20:18:21.869938] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-25T20:18:22.244678] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:22.288744] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-25T20:18:23.088835] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-25T20:18:23.657322] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T20:18:23.888812] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-25T20:18:24.688766] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-25T20:18:24.775118] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:18:24.842418] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T20:18:24.953206] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:18:24.953690] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-25T20:18:25.488792] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-25T20:18:26.288757] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-25T20:18:26.556100] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T20:18:27.088746] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-25T20:18:27.307397] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T20:18:27.729152] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T20:18:27.888746] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-25T20:18:28.152464] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:18:28.152940] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-25T20:18:28.688800] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-25T20:18:29.488776] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-25T20:18:29.658477] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T20:18:30.288789] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-25T20:18:31.088807] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-25T20:18:31.136305] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:18:31.607489] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-25T20:18:31.667390] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T20:18:31.888742] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-25T20:18:32.688738] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-25T20:18:32.807053] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T20:18:33.488710] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-25T20:18:33.571267] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T20:18:34.288718] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-25T20:18:34.484107] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T20:18:35.088688] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-25T20:18:35.497626] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T20:18:35.888705] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-25T20:18:36.095483] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T20:18:36.688708] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-25T20:18:36.904853] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T20:18:37.488778] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-25T20:18:37.592011] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:18:37.597698] [INFO ] [REMOTE ] NMAI: Full fetch complete (19990 records). [2025-09-25T20:18:37.597979] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-25T20:18:38.145035] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-25T20:18:38.145159] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-25T20:18:38.146006] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-25T20:18:38.146075] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-25T20:18:38.146826] [DEBUG] [LOCAL ] NMAI: Trimmed 19990 records to 13127 (keeping 200 days of data) [2025-09-25T20:18:38.246961] [DEBUG] [LOCAL ] NMAI: Primary data saved (13127 records). [2025-09-25T20:18:38.247173] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-25T20:18:38.247395] [INFO ] [MAIN ] Update Progress: 1495/2372 symbols completed. NMAI took 23.5s. Estimated remaining: 1h 56m 30s. Rate: 7.5 symbols/min [2025-09-25T20:18:38.294688] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-25T20:18:38.457264] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:38.478031] [DEBUG] [LOCAL ] NMG: Loaded 7741 existing records from primary storage. [2025-09-25T20:18:38.478202] [INFO ] [MAIN ] NMG: Loaded 7741 existing records. [2025-09-25T20:18:38.670331] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:38.672585] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-25T20:18:38.672717] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-25T20:18:38.673019] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-25T20:18:38.673156] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-25T20:18:39.088119] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:39.088681] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-25T20:18:39.684053] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-25T20:18:39.888731] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-25T20:18:40.024030] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T20:18:40.688793] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-25T20:18:40.833114] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-25T20:18:41.426062] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T20:18:41.488712] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-25T20:18:42.061414] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-25T20:18:42.288754] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-25T20:18:42.330548] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T20:18:43.088757] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-25T20:18:43.831168] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T20:18:43.888744] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-25T20:18:44.280257] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T20:18:44.688748] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-25T20:18:45.488751] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-25T20:18:45.897953] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T20:18:46.288770] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-25T20:18:46.565833] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T20:18:47.037327] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-25T20:18:47.088738] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-25T20:18:47.469835] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T20:18:47.889007] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-25T20:18:48.688826] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-25T20:18:48.698694] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T20:18:49.071941] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:18:49.488759] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-25T20:18:49.800568] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:18:50.162329] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T20:18:50.288786] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-25T20:18:51.088842] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-25T20:18:51.888977] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-25T20:18:52.022274] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T20:18:52.284406] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T20:18:52.688708] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-25T20:18:52.948897] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T20:18:53.488740] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-25T20:18:53.502418] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T20:18:54.288750] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-25T20:18:54.469896] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T20:18:54.474749] [INFO ] [REMOTE ] NMCO: Full fetch complete (24560 records). [2025-09-25T20:18:54.474906] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-25T20:18:54.927723] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-25T20:18:54.927836] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-25T20:18:54.928469] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-25T20:18:54.928591] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-25T20:18:54.929838] [DEBUG] [LOCAL ] NMCO: Trimmed 24560 records to 16751 (keeping 200 days of data) [2025-09-25T20:18:55.075723] [DEBUG] [LOCAL ] NMCO: Primary data saved (16751 records). [2025-09-25T20:18:55.075974] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-25T20:18:55.076214] [INFO ] [MAIN ] Update Progress: 1496/2372 symbols completed. NMCO took 33.7s. Estimated remaining: 1h 56m 27s. Rate: 7.5 symbols/min [2025-09-25T20:18:55.092344] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-25T20:18:55.159686] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:18:55.168621] [INFO ] [REMOTE ] NMG: Full fetch complete (13061 records). [2025-09-25T20:18:55.168731] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-25T20:18:55.363593] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:55.394696] [DEBUG] [LOCAL ] NMI: Loaded 4058 existing records from primary storage. [2025-09-25T20:18:55.394903] [INFO ] [MAIN ] NMI: Loaded 4058 existing records. [2025-09-25T20:18:55.749859] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:55.750270] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-25T20:18:55.750329] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-25T20:18:55.750606] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-25T20:18:55.750713] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-25T20:18:55.909753] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-25T20:18:55.952238] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-25T20:18:55.952356] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-25T20:18:55.952932] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-25T20:18:55.953010] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-25T20:18:55.959074] [DEBUG] [LOCAL ] NMG: Trimmed 13061 records to 7841 (keeping 200 days of data) [2025-09-25T20:18:56.101539] [DEBUG] [LOCAL ] NMG: Primary data saved (7841 records). [2025-09-25T20:18:56.101755] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-25T20:18:56.101946] [INFO ] [MAIN ] Update Progress: 1497/2372 symbols completed. NMG took 17.9s. Estimated remaining: 1h 56m 15s. Rate: 7.5 symbols/min [2025-09-25T20:18:56.503863] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:56.530726] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:56.542918] [DEBUG] [LOCAL ] NMM: Loaded 14317 existing records from primary storage. [2025-09-25T20:18:56.543010] [INFO ] [MAIN ] NMM: Loaded 14317 existing records. [2025-09-25T20:18:56.693022] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-25T20:18:56.737388] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:56.737762] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-25T20:18:56.737835] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-25T20:18:56.738187] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-25T20:18:56.738249] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-25T20:18:57.179536] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T20:18:57.214233] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:57.240493] [INFO ] [REMOTE ] NLY: Full fetch complete (77557 records). [2025-09-25T20:18:57.257508] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-25T20:18:57.263898] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T20:18:57.421367] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T20:18:57.504002] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-25T20:18:57.734768] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-25T20:18:57.734881] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-25T20:18:57.736200] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-25T20:18:57.736268] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-25T20:18:57.745082] [DEBUG] [LOCAL ] NLY: Trimmed 77557 records to 53967 (keeping 200 days of data) [2025-09-25T20:18:58.121333] [DEBUG] [LOCAL ] NLY: Primary data saved (53967 records). [2025-09-25T20:18:58.121539] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-25T20:18:58.124804] [INFO ] [MAIN ] Update Progress: 1498/2372 symbols completed. NLY took 46.2s. Estimated remaining: 1h 56m 3s. Rate: 7.5 symbols/min [2025-09-25T20:18:58.314748] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-25T20:18:58.317768] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:18:58.362515] [DEBUG] [LOCAL ] NMR: Loaded 35034 existing records from primary storage. [2025-09-25T20:18:58.362752] [INFO ] [MAIN ] NMR: Loaded 35034 existing records. [2025-09-25T20:18:58.547862] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:18:58.548286] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-25T20:18:58.548348] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-25T20:18:58.548624] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-25T20:18:58.548839] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-25T20:18:58.919147] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:18:59.088751] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-25T20:18:59.344364] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T20:18:59.490908] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T20:18:59.604218] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T20:18:59.888778] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-25T20:19:00.550615] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T20:19:00.688731] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-25T20:19:01.291522] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T20:19:01.488756] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-25T20:19:02.288814] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-25T20:19:03.088747] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-25T20:19:03.187987] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T20:19:03.197911] [INFO ] [REMOTE ] NMAX: Full fetch complete (40512 records). [2025-09-25T20:19:03.198129] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-25T20:19:03.450364] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T20:19:03.471843] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 124 unique days, need 200 days [2025-09-25T20:19:03.472763] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:19:03.472881] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:19:03.473002] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-25T20:19:03.473222] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-25T20:19:03.473307] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-25T20:19:03.473391] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-25T20:19:03.473546] [INFO ] [MAIN ] Update Progress: 1499/2372 symbols completed. NMAX took 43.5s. Estimated remaining: 1h 55m 54s. Rate: 7.5 symbols/min [2025-09-25T20:19:03.681261] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:03.692050] [DEBUG] [LOCAL ] NMS: Loaded 2883 existing records from primary storage. [2025-09-25T20:19:03.692202] [INFO ] [MAIN ] NMS: Loaded 2883 existing records. [2025-09-25T20:19:03.884757] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:03.885109] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-25T20:19:03.885157] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-25T20:19:03.885460] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-25T20:19:03.885530] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-25T20:19:03.897810] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-25T20:19:04.268952] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:04.467884] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T20:19:04.634067] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T20:19:04.688742] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-25T20:19:05.488732] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-25T20:19:05.729262] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T20:19:06.288741] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-25T20:19:07.008810] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T20:19:07.009152] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T20:19:07.088738] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-25T20:19:07.888764] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-25T20:19:08.540631] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T20:19:08.688737] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-25T20:19:08.947260] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T20:19:09.488721] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-25T20:19:10.124154] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T20:19:10.288746] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-25T20:19:10.613510] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T20:19:11.088742] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-25T20:19:11.659815] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T20:19:11.888703] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-25T20:19:12.028134] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T20:19:12.688707] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-25T20:19:12.904338] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T20:19:13.077127] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T20:19:13.488739] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-25T20:19:14.288735] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-25T20:19:14.955325] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-25T20:19:15.088742] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-25T20:19:15.280842] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T20:19:15.888743] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-25T20:19:16.336018] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T20:19:16.441727] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T20:19:16.688838] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-25T20:19:17.488798] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-25T20:19:17.614283] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T20:19:18.028785] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T20:19:18.288804] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-25T20:19:19.088745] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-25T20:19:19.393496] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T20:19:19.756187] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T20:19:19.888747] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-25T20:19:20.402391] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T20:19:20.688749] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-25T20:19:21.488748] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-25T20:19:21.560926] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:19:21.565682] [INFO ] [REMOTE ] NMM: Full fetch complete (22214 records). [2025-09-25T20:19:21.565813] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-25T20:19:21.999281] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-25T20:19:21.999427] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-25T20:19:22.000415] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-25T20:19:22.000543] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-25T20:19:22.002233] [DEBUG] [LOCAL ] NMM: Trimmed 22214 records to 14402 (keeping 200 days of data) [2025-09-25T20:19:22.107069] [DEBUG] [LOCAL ] NMM: Primary data saved (14402 records). [2025-09-25T20:19:22.107265] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-25T20:19:22.107577] [INFO ] [MAIN ] Update Progress: 1500/2372 symbols completed. NMM took 26.0s. Estimated remaining: 1h 55m 52s. Rate: 7.5 symbols/min [2025-09-25T20:19:22.175818] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:19:22.288766] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-25T20:19:22.306607] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:22.324854] [DEBUG] [LOCAL ] NMT: Loaded 2853 existing records from primary storage. [2025-09-25T20:19:22.325029] [INFO ] [MAIN ] NMT: Loaded 2853 existing records. [2025-09-25T20:19:22.521996] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:22.522424] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-25T20:19:22.522479] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-25T20:19:22.522917] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-25T20:19:22.522990] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-25T20:19:22.911371] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:23.006580] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T20:19:23.088781] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-25T20:19:23.758988] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T20:19:23.888747] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-25T20:19:24.419719] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T20:19:24.688748] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-25T20:19:25.226055] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T20:19:25.488749] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-25T20:19:26.066924] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T20:19:26.288768] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-25T20:19:27.088896] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-25T20:19:27.745475] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T20:19:27.748840] [INFO ] [REMOTE ] NMI: Full fetch complete (6208 records). [2025-09-25T20:19:27.749086] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-25T20:19:27.888729] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-25T20:19:27.908028] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T20:19:28.331310] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-25T20:19:28.331455] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-25T20:19:28.331722] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-25T20:19:28.331788] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-25T20:19:28.332368] [DEBUG] [LOCAL ] NMI: Trimmed 6208 records to 4078 (keeping 200 days of data) [2025-09-25T20:19:28.365514] [DEBUG] [LOCAL ] NMI: Primary data saved (4078 records). [2025-09-25T20:19:28.365718] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-25T20:19:28.365873] [INFO ] [MAIN ] Update Progress: 1501/2372 symbols completed. NMI took 33.3s. Estimated remaining: 1h 55m 43s. Rate: 7.5 symbols/min [2025-09-25T20:19:28.481808] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T20:19:28.483393] [INFO ] [REMOTE ] NMS: Full fetch complete (4046 records). [2025-09-25T20:19:28.483565] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-25T20:19:28.703364] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-25T20:19:28.720916] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:28.853222] [DEBUG] [LOCAL ] NMZ: Loaded 21602 existing records from primary storage. [2025-09-25T20:19:28.853451] [INFO ] [MAIN ] NMZ: Loaded 21602 existing records. [2025-09-25T20:19:29.254568] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:29.273310] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-25T20:19:29.273389] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-25T20:19:29.289357] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-25T20:19:29.289484] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-25T20:19:29.334550] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-25T20:19:29.346894] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-25T20:19:29.347212] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-25T20:19:29.347260] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-25T20:19:29.348038] [DEBUG] [LOCAL ] NMS: Trimmed 4046 records to 2889 (keeping 200 days of data) [2025-09-25T20:19:29.423943] [DEBUG] [LOCAL ] NMS: Primary data saved (2889 records). [2025-09-25T20:19:29.424071] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-25T20:19:29.424200] [INFO ] [MAIN ] Update Progress: 1502/2372 symbols completed. NMS took 26.0s. Estimated remaining: 1h 55m 31s. Rate: 7.5 symbols/min [2025-09-25T20:19:29.422164] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T20:19:29.493890] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-25T20:19:29.970970] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:30.034590] [DEBUG] [LOCAL ] NNI: Loaded 9996 existing records from primary storage. [2025-09-25T20:19:30.043083] [INFO ] [MAIN ] NNI: Loaded 9996 existing records. [2025-09-25T20:19:30.294031] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-25T20:19:30.406637] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:30.529297] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:30.530957] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-25T20:19:30.531050] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-25T20:19:30.531328] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-25T20:19:30.531442] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-25T20:19:30.998967] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T20:19:31.029490] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:31.088749] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-25T20:19:31.158705] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T20:19:31.746999] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T20:19:31.888789] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-25T20:19:32.655143] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T20:19:32.688714] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-25T20:19:33.384276] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T20:19:33.488708] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-25T20:19:34.288767] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-25T20:19:34.349566] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:19:34.826341] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T20:19:35.088761] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-25T20:19:35.586548] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T20:19:35.888753] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-25T20:19:36.494625] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T20:19:36.688766] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-25T20:19:37.488751] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-25T20:19:38.164484] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T20:19:38.178386] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T20:19:38.183232] [INFO ] [REMOTE ] NMR: Full fetch complete (50307 records). [2025-09-25T20:19:38.183435] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-25T20:19:38.293207] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-25T20:19:38.642008] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-25T20:19:38.642116] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-25T20:19:38.643207] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-25T20:19:38.643320] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-25T20:19:38.644753] [DEBUG] [LOCAL ] NMR: Trimmed 50307 records to 35332 (keeping 200 days of data) [2025-09-25T20:19:38.896326] [DEBUG] [LOCAL ] NMR: Primary data saved (35332 records). [2025-09-25T20:19:38.896515] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-25T20:19:38.896693] [INFO ] [MAIN ] Update Progress: 1503/2372 symbols completed. NMR took 40.8s. Estimated remaining: 1h 55m 24s. Rate: 7.5 symbols/min [2025-09-25T20:19:39.088454] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:39.088743] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-25T20:19:39.168457] [DEBUG] [LOCAL ] NNN: Loaded 48412 existing records from primary storage. [2025-09-25T20:19:39.168682] [INFO ] [MAIN ] NNN: Loaded 48412 existing records. [2025-09-25T20:19:39.373734] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:39.374318] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-25T20:19:39.374381] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-25T20:19:39.374883] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-25T20:19:39.374970] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-25T20:19:39.569966] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:19:39.753102] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T20:19:39.846581] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:39.888690] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-25T20:19:40.688748] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-25T20:19:41.275237] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T20:19:41.488748] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-25T20:19:41.604997] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T20:19:42.288752] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-25T20:19:42.422929] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:19:42.687389] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-25T20:19:43.088761] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-25T20:19:43.888691] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-25T20:19:44.291577] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T20:19:44.688753] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-25T20:19:44.741963] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:19:45.488733] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-25T20:19:46.288728] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-25T20:19:46.430334] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T20:19:46.504141] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T20:19:46.973292] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T20:19:47.088736] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-25T20:19:47.629355] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T20:19:47.630817] [INFO ] [REMOTE ] NMT: Full fetch complete (4233 records). [2025-09-25T20:19:47.630891] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-25T20:19:47.890296] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-25T20:19:48.057096] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-25T20:19:48.057214] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-25T20:19:48.057396] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-25T20:19:48.057459] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-25T20:19:48.057988] [DEBUG] [LOCAL ] NMT: Trimmed 4233 records to 2867 (keeping 200 days of data) [2025-09-25T20:19:48.077528] [DEBUG] [LOCAL ] NMT: Primary data saved (2867 records). [2025-09-25T20:19:48.077673] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-25T20:19:48.077789] [INFO ] [MAIN ] Update Progress: 1504/2372 symbols completed. NMT took 26.0s. Estimated remaining: 1h 55m 17s. Rate: 7.5 symbols/min [2025-09-25T20:19:48.260353] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:48.278775] [DEBUG] [LOCAL ] NNY: Loaded 5703 existing records from primary storage. [2025-09-25T20:19:48.278922] [INFO ] [MAIN ] NNY: Loaded 5703 existing records. [2025-09-25T20:19:48.470863] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:48.471136] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-25T20:19:48.471181] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-25T20:19:48.471451] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-25T20:19:48.471510] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-25T20:19:48.690159] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-25T20:19:48.865895] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:49.488729] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-25T20:19:49.556840] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:19:49.599331] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T20:19:50.288886] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-25T20:19:50.532073] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T20:19:51.088709] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-25T20:19:51.156359] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T20:19:51.888846] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-25T20:19:52.688820] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-25T20:19:52.782217] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T20:19:52.785815] [INFO ] [REMOTE ] NNI: Full fetch complete (12692 records). [2025-09-25T20:19:52.785922] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-25T20:19:53.166719] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-25T20:19:53.166815] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-25T20:19:53.167149] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-25T20:19:53.167236] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-25T20:19:53.167892] [DEBUG] [LOCAL ] NNI: Trimmed 12692 records to 10071 (keeping 200 days of data) [2025-09-25T20:19:53.277363] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-25T20:19:53.308964] [DEBUG] [LOCAL ] NNI: Primary data saved (10071 records). [2025-09-25T20:19:53.309110] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-25T20:19:53.309327] [INFO ] [MAIN ] Update Progress: 1505/2372 symbols completed. NNI took 23.9s. Estimated remaining: 1h 55m 7s. Rate: 7.5 symbols/min [2025-09-25T20:19:53.490025] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-25T20:19:53.505788] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:19:53.541309] [DEBUG] [LOCAL ] NOA: Loaded 16255 existing records from primary storage. [2025-09-25T20:19:53.541473] [INFO ] [MAIN ] NOA: Loaded 16255 existing records. [2025-09-25T20:19:53.741594] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:19:53.742146] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-25T20:19:53.742205] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-25T20:19:53.743189] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-25T20:19:53.743265] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-25T20:19:53.881893] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T20:19:54.161532] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:19:54.288896] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-25T20:19:55.037563] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T20:19:55.095064] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-25T20:19:55.129058] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T20:19:55.888732] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-25T20:19:55.897764] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T20:19:56.688765] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-25T20:19:57.217024] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:19:57.488808] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-25T20:19:58.288745] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-25T20:19:58.410980] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T20:19:58.583089] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:19:59.088731] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-25T20:19:59.370699] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T20:19:59.742182] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:19:59.888730] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-25T20:20:00.665002] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T20:20:00.688739] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-25T20:20:01.488756] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-25T20:20:01.801258] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T20:20:02.270790] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T20:20:02.288769] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-25T20:20:02.930147] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:20:03.088772] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-25T20:20:03.888787] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-25T20:20:04.688724] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-25T20:20:04.876177] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T20:20:04.890461] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T20:20:05.233538] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-25T20:20:05.488728] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-25T20:20:06.224547] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:20:06.288739] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-25T20:20:07.011531] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T20:20:07.013682] [INFO ] [REMOTE ] NNY: Full fetch complete (8882 records). [2025-09-25T20:20:07.013833] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-25T20:20:07.095876] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-25T20:20:07.470414] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-25T20:20:07.470544] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-25T20:20:07.471024] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-25T20:20:07.471108] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-25T20:20:07.471759] [DEBUG] [LOCAL ] NNY: Trimmed 8882 records to 5728 (keeping 200 days of data) [2025-09-25T20:20:07.524011] [DEBUG] [LOCAL ] NNY: Primary data saved (5728 records). [2025-09-25T20:20:07.524190] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-25T20:20:07.524468] [INFO ] [MAIN ] Update Progress: 1506/2372 symbols completed. NNY took 19.4s. Estimated remaining: 1h 55m 3s. Rate: 7.5 symbols/min [2025-09-25T20:20:07.712003] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:07.744220] [DEBUG] [LOCAL ] NOAH: Loaded 20175 existing records from primary storage. [2025-09-25T20:20:07.744424] [INFO ] [MAIN ] NOAH: Loaded 20175 existing records. [2025-09-25T20:20:07.893853] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-25T20:20:07.960151] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:07.960506] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-25T20:20:07.960576] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-25T20:20:07.962134] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-25T20:20:07.962380] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-25T20:20:08.254866] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:20:08.362683] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:08.688693] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-25T20:20:09.073587] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:20:09.488738] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-25T20:20:10.059222] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T20:20:10.288734] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-25T20:20:11.088733] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-25T20:20:11.175417] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T20:20:11.441308] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T20:20:11.888750] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-25T20:20:12.140170] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T20:20:12.688699] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-25T20:20:12.775711] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T20:20:13.412785] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T20:20:13.488753] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-25T20:20:14.288701] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-25T20:20:14.600803] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:20:15.088780] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-25T20:20:15.150113] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T20:20:15.158587] [INFO ] [REMOTE ] NMZ: Full fetch complete (31957 records). [2025-09-25T20:20:15.158975] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-25T20:20:15.622208] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-25T20:20:15.622343] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-25T20:20:15.623397] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-25T20:20:15.623469] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-25T20:20:15.624820] [DEBUG] [LOCAL ] NMZ: Trimmed 31957 records to 21768 (keeping 200 days of data) [2025-09-25T20:20:15.790049] [DEBUG] [LOCAL ] NMZ: Primary data saved (21768 records). [2025-09-25T20:20:15.790234] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-25T20:20:15.790389] [INFO ] [MAIN ] Update Progress: 1507/2372 symbols completed. NMZ took 47.4s. Estimated remaining: 1h 54m 55s. Rate: 7.5 symbols/min [2025-09-25T20:20:15.892742] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-25T20:20:15.969053] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:16.049277] [DEBUG] [LOCAL ] NOC: Loaded 42606 existing records from primary storage. [2025-09-25T20:20:16.049456] [INFO ] [MAIN ] NOC: Loaded 42606 existing records. [2025-09-25T20:20:16.240460] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:16.240915] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-25T20:20:16.240964] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-25T20:20:16.241306] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-25T20:20:16.241364] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-25T20:20:16.656915] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:16.688733] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-25T20:20:17.009036] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T20:20:17.056735] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-25T20:20:17.488729] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-25T20:20:17.680991] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T20:20:18.288756] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-25T20:20:19.088769] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-25T20:20:19.350477] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T20:20:19.372292] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T20:20:19.888699] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-25T20:20:20.004338] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T20:20:20.688732] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-25T20:20:21.488800] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-25T20:20:21.769192] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T20:20:22.043945] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T20:20:22.288748] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-25T20:20:23.088944] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-25T20:20:23.206710] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:20:23.232079] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T20:20:23.239755] [INFO ] [REMOTE ] NNN: Full fetch complete (70201 records). [2025-09-25T20:20:23.239984] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-25T20:20:23.858240] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-25T20:20:23.858585] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-25T20:20:23.860540] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-25T20:20:23.860676] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-25T20:20:23.862747] [DEBUG] [LOCAL ] NNN: Trimmed 70201 records to 48783 (keeping 200 days of data) [2025-09-25T20:20:23.937140] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-25T20:20:24.253762] [DEBUG] [LOCAL ] NNN: Primary data saved (48783 records). [2025-09-25T20:20:24.253987] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-25T20:20:24.254174] [INFO ] [MAIN ] Update Progress: 1508/2372 symbols completed. NNN took 45.4s. Estimated remaining: 1h 54m 47s. Rate: 7.5 symbols/min [2025-09-25T20:20:24.430603] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:24.500773] [DEBUG] [LOCAL ] NOG: Loaded 51167 existing records from primary storage. [2025-09-25T20:20:24.501012] [INFO ] [MAIN ] NOG: Loaded 51167 existing records. [2025-09-25T20:20:24.711200] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-25T20:20:24.719703] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:24.720127] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-25T20:20:24.720179] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-25T20:20:24.723682] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-25T20:20:24.723771] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-25T20:20:24.922056] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T20:20:25.164478] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:25.206487] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T20:20:25.488743] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-25T20:20:25.764477] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T20:20:26.288777] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-25T20:20:27.088750] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-25T20:20:27.369244] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T20:20:27.409582] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T20:20:27.888762] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-25T20:20:28.694720] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-25T20:20:28.720301] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T20:20:28.892968] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T20:20:28.900372] [INFO ] [REMOTE ] NOA: Full fetch complete (21850 records). [2025-09-25T20:20:28.900487] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-25T20:20:29.297980] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-25T20:20:29.298082] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-25T20:20:29.298840] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-25T20:20:29.298912] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-25T20:20:29.299636] [DEBUG] [LOCAL ] NOA: Trimmed 21850 records to 16401 (keeping 200 days of data) [2025-09-25T20:20:29.420677] [DEBUG] [LOCAL ] NOA: Primary data saved (16401 records). [2025-09-25T20:20:29.420887] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-25T20:20:29.421024] [INFO ] [MAIN ] Update Progress: 1509/2372 symbols completed. NOA took 36.1s. Estimated remaining: 1h 54m 38s. Rate: 7.5 symbols/min [2025-09-25T20:20:29.489497] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-25T20:20:29.603368] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:29.683482] [DEBUG] [LOCAL ] NOK: Loaded 53620 existing records from primary storage. [2025-09-25T20:20:29.683720] [INFO ] [MAIN ] NOK: Loaded 53620 existing records. [2025-09-25T20:20:29.869109] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:29.869500] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-25T20:20:29.869546] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-25T20:20:29.869890] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-25T20:20:29.869951] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-25T20:20:29.924891] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T20:20:30.291319] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-25T20:20:30.298019] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:31.088821] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-25T20:20:31.331541] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T20:20:31.496213] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T20:20:31.501325] [INFO ] [REMOTE ] NOAH: Full fetch complete (28831 records). [2025-09-25T20:20:31.501436] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-25T20:20:31.889971] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-25T20:20:31.915148] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-25T20:20:31.915223] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-25T20:20:31.916274] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-25T20:20:31.916357] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-25T20:20:31.920521] [DEBUG] [LOCAL ] NOAH: Trimmed 28831 records to 20272 (keeping 200 days of data) [2025-09-25T20:20:32.083880] [DEBUG] [LOCAL ] NOAH: Primary data saved (20272 records). [2025-09-25T20:20:32.084102] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-25T20:20:32.084289] [INFO ] [MAIN ] Update Progress: 1510/2372 symbols completed. NOAH took 24.6s. Estimated remaining: 1h 54m 27s. Rate: 7.5 symbols/min [2025-09-25T20:20:32.257659] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:32.257979] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-25T20:20:32.258052] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-25T20:20:32.258186] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-25T20:20:32.258226] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-25T20:20:32.258267] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-25T20:20:32.258349] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-25T20:20:32.636190] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:32.688735] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-25T20:20:33.354279] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-25T20:20:33.488763] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-25T20:20:33.967554] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T20:20:34.110196] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T20:20:34.288702] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-25T20:20:35.088875] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-25T20:20:35.660561] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-25T20:20:35.888811] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-25T20:20:36.175123] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:20:36.411441] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T20:20:36.688713] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-25T20:20:36.980435] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T20:20:37.488759] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-25T20:20:37.913408] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-25T20:20:38.288696] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-25T20:20:38.568910] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T20:20:39.089436] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-25T20:20:39.888761] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-25T20:20:40.023220] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T20:20:40.217796] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-25T20:20:40.688709] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-25T20:20:40.872255] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T20:20:41.130983] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T20:20:41.488815] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-25T20:20:42.288740] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-25T20:20:43.088754] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-25T20:20:43.567286] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T20:20:43.803913] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T20:20:43.888754] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-25T20:20:44.688743] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-25T20:20:44.908010] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:20:45.488768] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-25T20:20:46.184344] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-25T20:20:46.231758] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:20:46.288738] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-25T20:20:47.088718] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-25T20:20:47.158392] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T20:20:47.166851] [INFO ] [REMOTE ] NOC: Full fetch complete (62152 records). [2025-09-25T20:20:47.167168] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-25T20:20:47.593580] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-25T20:20:47.593719] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-25T20:20:47.595052] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-25T20:20:47.595143] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-25T20:20:47.596826] [DEBUG] [LOCAL ] NOC: Trimmed 62152 records to 42916 (keeping 200 days of data) [2025-09-25T20:20:47.888901] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-25T20:20:47.936717] [DEBUG] [LOCAL ] NOC: Primary data saved (42916 records). [2025-09-25T20:20:47.936900] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-25T20:20:47.940411] [INFO ] [MAIN ] Update Progress: 1511/2372 symbols completed. NOC took 32.1s. Estimated remaining: 1h 54m 23s. Rate: 7.5 symbols/min [2025-09-25T20:20:48.216630] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:48.288815] [DEBUG] [LOCAL ] NOMD: Loaded 41326 existing records from primary storage. [2025-09-25T20:20:48.288989] [INFO ] [MAIN ] NOMD: Loaded 41326 existing records. [2025-09-25T20:20:48.319882] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-25T20:20:48.398206] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-25T20:20:48.536222] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:48.539901] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-25T20:20:48.539953] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-25T20:20:48.540274] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-25T20:20:48.540336] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-25T20:20:48.693122] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-25T20:20:48.980335] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T20:20:48.989044] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:49.488715] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-25T20:20:49.907594] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T20:20:50.288709] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-25T20:20:51.032613] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-25T20:20:51.088676] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-25T20:20:51.888750] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-25T20:20:52.151418] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T20:20:52.688726] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-25T20:20:52.800398] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:20:53.371734] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T20:20:53.488729] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-25T20:20:54.288749] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-25T20:20:54.343143] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:20:54.353098] [INFO ] [REMOTE ] NOG: Full fetch complete (73692 records). [2025-09-25T20:20:54.353254] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-25T20:20:54.776665] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-25T20:20:54.776797] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-25T20:20:54.778866] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-25T20:20:54.778944] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-25T20:20:54.781330] [DEBUG] [LOCAL ] NOG: Trimmed 73692 records to 51547 (keeping 200 days of data) [2025-09-25T20:20:55.101022] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-25T20:20:55.154896] [DEBUG] [LOCAL ] NOG: Primary data saved (51547 records). [2025-09-25T20:20:55.155080] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-25T20:20:55.155213] [INFO ] [MAIN ] Update Progress: 1512/2372 symbols completed. NOG took 30.9s. Estimated remaining: 1h 54m 15s. Rate: 7.5 symbols/min [2025-09-25T20:20:55.354845] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:20:55.411266] [DEBUG] [LOCAL ] NOTE: Loaded 42812 existing records from primary storage. [2025-09-25T20:20:55.411467] [INFO ] [MAIN ] NOTE: Loaded 42812 existing records. [2025-09-25T20:20:55.534411] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-25T20:20:55.614097] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:20:55.614398] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-25T20:20:55.614448] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-25T20:20:55.614804] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-25T20:20:55.614869] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-25T20:20:55.918823] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-25T20:20:55.902415] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-25T20:20:55.991376] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T20:20:56.125273] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:20:56.523100] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T20:20:56.688724] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-25T20:20:57.488735] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-25T20:20:58.000333] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T20:20:58.288737] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-25T20:20:58.712301] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T20:20:59.088768] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-25T20:20:59.724468] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:20:59.888738] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-25T20:21:00.688767] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-25T20:21:01.117682] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T20:21:01.488735] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-25T20:21:01.998624] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T20:21:02.167410] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-25T20:21:02.288730] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-25T20:21:03.092705] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-25T20:21:03.100333] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:21:03.647715] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-25T20:21:03.649407] [INFO ] [REMOTE ] NOM: Full fetch complete (1632 records). [2025-09-25T20:21:03.649599] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-25T20:21:03.889778] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-25T20:21:03.897267] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-25T20:21:03.897600] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:21:03.898040] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:21:03.898192] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-25T20:21:03.898302] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-25T20:21:03.898378] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-25T20:21:03.898460] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-25T20:21:03.898667] [INFO ] [MAIN ] Update Progress: 1513/2372 symbols completed. NOM took 31.8s. Estimated remaining: 1h 54m 8s. Rate: 7.5 symbols/min [2025-09-25T20:21:04.114529] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:04.219503] [DEBUG] [LOCAL ] NOV: Loaded 53183 existing records from primary storage. [2025-09-25T20:21:04.219715] [INFO ] [MAIN ] NOV: Loaded 53183 existing records. [2025-09-25T20:21:04.389547] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T20:21:04.412485] [INFO ] [REMOTE ] NOK: Full fetch complete (77635 records). [2025-09-25T20:21:04.418750] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-25T20:21:04.548856] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:21:04.549140] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-25T20:21:04.549190] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-25T20:21:04.555116] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-25T20:21:04.555188] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-25T20:21:04.696750] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-25T20:21:05.328921] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-25T20:21:05.329500] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-25T20:21:05.331622] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-25T20:21:05.341013] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-25T20:21:05.355297] [DEBUG] [LOCAL ] NOK: Trimmed 77635 records to 54011 (keeping 200 days of data) [2025-09-25T20:21:05.552923] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:05.553348] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-25T20:21:05.846368] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:21:05.870446] [DEBUG] [LOCAL ] NOK: Primary data saved (54011 records). [2025-09-25T20:21:05.870605] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-25T20:21:05.870770] [INFO ] [MAIN ] Update Progress: 1514/2372 symbols completed. NOK took 36.4s. Estimated remaining: 1h 53m 56s. Rate: 7.5 symbols/min [2025-09-25T20:21:06.050480] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:06.050740] [DEBUG] [LOCAL ] NOW: No existing data file found in primary storage. [2025-09-25T20:21:06.050796] [WARN ] [MAIN ] NOW: No existing data found, performing full refresh instead. [2025-09-25T20:21:06.050932] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-25T20:21:06.050983] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-25T20:21:06.051052] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-25T20:21:06.051157] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-25T20:21:06.294750] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-25T20:21:06.502623] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:06.504965] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T20:21:07.088737] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-25T20:21:07.183406] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T20:21:07.888765] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-25T20:21:08.064611] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:21:08.688714] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-25T20:21:08.772496] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T20:21:09.488790] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-25T20:21:09.828032] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T20:21:10.288715] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-25T20:21:10.550578] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T20:21:11.088730] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-25T20:21:11.395551] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T20:21:11.888802] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-25T20:21:11.950069] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T20:21:12.674509] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T20:21:12.688682] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-25T20:21:13.488701] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-25T20:21:14.011541] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T20:21:14.058592] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T20:21:14.288751] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-25T20:21:15.088698] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-25T20:21:15.271289] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T20:21:15.888824] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-25T20:21:16.419252] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-25T20:21:16.521817] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T20:21:16.688817] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-25T20:21:17.490429] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-25T20:21:17.490279] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T20:21:18.254442] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T20:21:18.288694] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-25T20:21:18.934464] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T20:21:19.088749] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-25T20:21:19.888743] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-25T20:21:20.176261] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:21:20.688791] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-25T20:21:21.040157] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:21:21.488777] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-25T20:21:21.579624] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T20:21:21.592830] [INFO ] [REMOTE ] NOMD: Full fetch complete (58926 records). [2025-09-25T20:21:21.592996] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-25T20:21:22.030802] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-25T20:21:22.031000] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-25T20:21:22.032068] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-25T20:21:22.032135] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-25T20:21:22.040741] [DEBUG] [LOCAL ] NOMD: Trimmed 58926 records to 41665 (keeping 200 days of data) [2025-09-25T20:21:22.317733] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-25T20:21:22.338599] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T20:21:22.399947] [DEBUG] [LOCAL ] NOMD: Primary data saved (41665 records). [2025-09-25T20:21:22.400117] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-25T20:21:22.402426] [INFO ] [MAIN ] Update Progress: 1515/2372 symbols completed. NOMD took 34.5s. Estimated remaining: 1h 53m 53s. Rate: 7.5 symbols/min [2025-09-25T20:21:22.588877] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:22.589091] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-25T20:21:22.589149] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-25T20:21:22.589827] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-25T20:21:22.589907] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-25T20:21:22.589980] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-25T20:21:22.590046] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-25T20:21:22.982385] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:23.088692] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-25T20:21:23.150501] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T20:21:23.347588] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:21:23.348412] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-25T20:21:23.888785] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-25T20:21:24.688988] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-25T20:21:24.733996] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-25T20:21:25.306268] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T20:21:25.313488] [INFO ] [REMOTE ] NOTE: Full fetch complete (64371 records). [2025-09-25T20:21:25.313755] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-25T20:21:25.494701] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-25T20:21:25.803550] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-25T20:21:25.803695] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-25T20:21:25.805305] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-25T20:21:25.805382] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-25T20:21:25.807352] [DEBUG] [LOCAL ] NOTE: Trimmed 64371 records to 43022 (keeping 200 days of data) [2025-09-25T20:21:26.153813] [DEBUG] [LOCAL ] NOTE: Primary data saved (43022 records). [2025-09-25T20:21:26.154025] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-25T20:21:26.154323] [INFO ] [MAIN ] Update Progress: 1516/2372 symbols completed. NOTE took 31.0s. Estimated remaining: 1h 53m 43s. Rate: 7.5 symbols/min [2025-09-25T20:21:26.293873] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-25T20:21:26.348084] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:26.379382] [DEBUG] [LOCAL ] NPCT: Loaded 16797 existing records from primary storage. [2025-09-25T20:21:26.379561] [INFO ] [MAIN ] NPCT: Loaded 16797 existing records. [2025-09-25T20:21:26.613983] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:21:26.656910] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T20:21:26.651351] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:21:26.651469] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-25T20:21:26.670817] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-25T20:21:26.670943] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-25T20:21:26.671460] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-25T20:21:26.671527] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-25T20:21:27.070411] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:27.088846] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-25T20:21:27.552228] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T20:21:27.888825] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-25T20:21:28.094072] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T20:21:28.688885] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-25T20:21:29.488702] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-25T20:21:29.691669] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T20:21:29.878670] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T20:21:30.295743] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T20:21:30.291475] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-25T20:21:31.088820] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-25T20:21:31.888917] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-25T20:21:32.077593] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T20:21:32.184724] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T20:21:32.195819] [INFO ] [REMOTE ] NOV: Full fetch complete (76986 records). [2025-09-25T20:21:32.196091] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-25T20:21:32.662544] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-25T20:21:32.662708] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-25T20:21:32.664211] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-25T20:21:32.664339] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-25T20:21:32.667231] [DEBUG] [LOCAL ] NOV: Trimmed 76986 records to 53572 (keeping 200 days of data) [2025-09-25T20:21:32.688778] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-25T20:21:33.063994] [DEBUG] [LOCAL ] NOV: Primary data saved (53572 records). [2025-09-25T20:21:33.064187] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-25T20:21:33.065862] [INFO ] [MAIN ] Update Progress: 1517/2372 symbols completed. NOV took 29.2s. Estimated remaining: 1h 53m 34s. Rate: 7.5 symbols/min [2025-09-25T20:21:33.488742] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-25T20:21:33.778935] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:21:33.832608] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T20:21:34.288813] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-25T20:21:34.527457] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T20:21:35.088806] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-25T20:21:35.888701] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-25T20:21:36.052045] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T20:21:36.090254] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T20:21:36.688733] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-25T20:21:36.760360] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-25T20:21:37.488766] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-25T20:21:37.801028] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:21:38.288802] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-25T20:21:39.088743] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-25T20:21:39.102673] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T20:21:39.704095] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-25T20:21:39.875353] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:21:39.888730] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-25T20:21:40.697378] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-25T20:21:40.719178] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:21:40.732950] [INFO ] [REMOTE ] NOW: Full fetch complete (70452 records). [2025-09-25T20:21:40.733165] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-25T20:21:40.734764] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:21:40.735267] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:21:40.735345] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:21:40.735428] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-25T20:21:40.735583] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-25T20:21:40.735686] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-25T20:21:40.735784] [DEBUG] [LOCAL ] NOW: No derivative data file found to delete. [2025-09-25T20:21:40.735922] [INFO ] [MAIN ] Update Progress: 1518/2372 symbols completed. NOW took 34.9s. Estimated remaining: 1h 53m 26s. Rate: 7.5 symbols/min [2025-09-25T20:21:41.488767] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-25T20:21:41.563081] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T20:21:42.288835] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-25T20:21:42.659214] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T20:21:43.088745] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-25T20:21:43.399516] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:21:43.888719] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-25T20:21:44.103609] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T20:21:44.629326] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:21:44.688734] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-25T20:21:45.488755] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-25T20:21:45.607220] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T20:21:45.610604] [INFO ] [REMOTE ] NPCT: Full fetch complete (25105 records). [2025-09-25T20:21:45.610710] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-25T20:21:46.045597] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-25T20:21:46.045737] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-25T20:21:46.046558] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-25T20:21:46.046877] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-25T20:21:46.048710] [DEBUG] [LOCAL ] NPCT: Trimmed 25105 records to 16872 (keeping 200 days of data) [2025-09-25T20:21:46.176241] [DEBUG] [LOCAL ] NPCT: Primary data saved (16872 records). [2025-09-25T20:21:46.176426] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-25T20:21:46.176553] [INFO ] [MAIN ] Update Progress: 1519/2372 symbols completed. NPCT took 20.0s. Estimated remaining: 1h 53m 17s. Rate: 7.5 symbols/min [2025-09-25T20:21:46.239844] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T20:21:46.243802] [INFO ] [REMOTE ] NPB: Full fetch complete (16320 records). [2025-09-25T20:21:46.243897] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-25T20:21:46.462988] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-25T20:21:46.463444] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:21:46.463521] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:21:46.463589] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-25T20:21:46.463678] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-25T20:21:46.463735] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-25T20:21:46.463813] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-25T20:21:46.463919] [INFO ] [MAIN ] Update Progress: 1520/2372 symbols completed. NPB took 24.1s. Estimated remaining: 1h 53m 4s. Rate: 7.5 symbols/min [2025-09-25T20:21:47.167476] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:47.239984] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:47.266455] [DEBUG] [LOCAL ] NPK: Loaded 8028 existing records from primary storage. [2025-09-25T20:21:47.266689] [INFO ] [MAIN ] NPK: Loaded 8028 existing records. [2025-09-25T20:21:47.327885] [DEBUG] [LOCAL ] NPO: Loaded 12821 existing records from primary storage. [2025-09-25T20:21:47.328074] [INFO ] [MAIN ] NPO: Loaded 12821 existing records. [2025-09-25T20:21:47.355576] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:47.376735] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-25T20:21:47.376795] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-25T20:21:47.376935] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-25T20:21:47.376975] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-25T20:21:47.377016] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-25T20:21:47.377064] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-25T20:21:47.383530] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:21:47.460382] [DEBUG] [LOCAL ] NPFD: Loaded 9643 existing records from primary storage. [2025-09-25T20:21:47.460718] [INFO ] [MAIN ] NPFD: Loaded 9643 existing records. [2025-09-25T20:21:48.098885] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:21:48.099260] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-25T20:21:48.099318] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-25T20:21:48.099839] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-25T20:21:48.099904] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-25T20:21:48.302431] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:21:48.330137] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-25T20:21:48.330205] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-25T20:21:48.330533] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-25T20:21:48.330596] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-25T20:21:48.432079] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:21:48.436430] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-25T20:21:48.436516] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-25T20:21:48.450798] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-25T20:21:48.450900] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-25T20:21:49.055373] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:49.055781] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-25T20:21:49.600465] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:49.600886] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-25T20:21:49.685795] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:49.689083] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-25T20:21:49.714317] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:21:49.714764] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-25T20:21:49.966086] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T20:21:49.969470] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-25T20:21:50.642619] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T20:21:50.647210] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-25T20:21:50.656370] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T20:21:50.690946] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T20:21:50.906960] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T20:21:51.088760] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-25T20:21:51.437800] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T20:21:51.888743] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-25T20:21:52.192967] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T20:21:52.437310] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T20:21:52.688739] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-25T20:21:53.488739] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-25T20:21:53.571598] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T20:21:54.288791] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-25T20:21:55.083250] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T20:21:55.097027] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-25T20:21:55.113725] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:21:55.888834] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-25T20:21:56.058826] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T20:21:56.688730] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-25T20:21:57.434155] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:21:57.488698] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-25T20:21:57.551944] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T20:21:58.288748] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-25T20:21:58.498841] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T20:21:58.877846] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T20:21:59.088706] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-25T20:21:59.886391] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T20:21:59.889859] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-25T20:22:00.604515] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T20:22:00.688764] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-25T20:22:01.488761] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-25T20:22:01.701384] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T20:22:02.288800] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-25T20:22:02.583094] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:22:03.088840] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-25T20:22:03.089232] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T20:22:03.888880] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-25T20:22:04.688772] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-25T20:22:04.723604] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:22:04.759861] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T20:22:05.488839] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-25T20:22:05.829037] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T20:22:06.288736] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-25T20:22:06.995997] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T20:22:07.088709] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-25T20:22:07.408288] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T20:22:07.888707] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-25T20:22:08.688707] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-25T20:22:08.739455] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T20:22:08.861422] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T20:22:09.488744] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-25T20:22:09.576703] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-25T20:22:10.182187] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:22:10.288676] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-25T20:22:11.088730] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-25T20:22:11.208004] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T20:22:11.888769] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-25T20:22:11.986611] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:22:11.989720] [INFO ] [REMOTE ] NPFD: Full fetch complete (14757 records). [2025-09-25T20:22:11.989884] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-25T20:22:12.403591] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-25T20:22:12.403732] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-25T20:22:12.404211] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-25T20:22:12.404355] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-25T20:22:12.405007] [DEBUG] [LOCAL ] NPFD: Trimmed 14757 records to 9713 (keeping 200 days of data) [2025-09-25T20:22:12.476460] [DEBUG] [LOCAL ] NPFD: Primary data saved (9713 records). [2025-09-25T20:22:12.476628] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-25T20:22:12.476942] [INFO ] [MAIN ] Update Progress: 1521/2372 symbols completed. NPFD took 26.0s. Estimated remaining: 1h 53m 6s. Rate: 7.5 symbols/min [2025-09-25T20:22:12.550558] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T20:22:12.668694] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:12.688758] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-25T20:22:12.711881] [DEBUG] [LOCAL ] NPV: Loaded 5018 existing records from primary storage. [2025-09-25T20:22:12.712031] [INFO ] [MAIN ] NPV: Loaded 5018 existing records. [2025-09-25T20:22:12.915883] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:12.916815] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-25T20:22:12.916923] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-25T20:22:12.917407] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-25T20:22:12.917499] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-25T20:22:13.299137] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:13.488743] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-25T20:22:14.294520] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-25T20:22:14.306497] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T20:22:14.393922] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T20:22:14.398844] [INFO ] [REMOTE ] NPO: Full fetch complete (17990 records). [2025-09-25T20:22:14.398992] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-25T20:22:14.828109] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-25T20:22:14.828201] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-25T20:22:14.828613] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-25T20:22:14.828685] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-25T20:22:14.829373] [DEBUG] [LOCAL ] NPO: Trimmed 17990 records to 12914 (keeping 200 days of data) [2025-09-25T20:22:14.930267] [DEBUG] [LOCAL ] NPO: Primary data saved (12914 records). [2025-09-25T20:22:14.930541] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-25T20:22:14.930723] [INFO ] [MAIN ] Update Progress: 1522/2372 symbols completed. NPO took 28.5s. Estimated remaining: 1h 52m 55s. Rate: 7.5 symbols/min [2025-09-25T20:22:14.957013] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T20:22:15.093974] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-25T20:22:15.127860] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:15.222270] [DEBUG] [LOCAL ] NPWR: Loaded 43218 existing records from primary storage. [2025-09-25T20:22:15.222442] [INFO ] [MAIN ] NPWR: Loaded 43218 existing records. [2025-09-25T20:22:15.418161] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:15.418524] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-25T20:22:15.418572] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-25T20:22:15.418953] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-25T20:22:15.419014] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-25T20:22:15.804179] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:15.888730] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-25T20:22:16.556954] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T20:22:16.563800] [INFO ] [REMOTE ] NPKI: Full fetch complete (53259 records). [2025-09-25T20:22:16.563944] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-25T20:22:16.693800] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-25T20:22:16.760022] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T20:22:16.799182] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-25T20:22:16.800696] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:22:16.800891] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:22:16.801119] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-25T20:22:16.801207] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-25T20:22:16.801275] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-25T20:22:16.801376] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-25T20:22:16.801470] [INFO ] [MAIN ] Update Progress: 1523/2372 symbols completed. NPKI took 30.3s. Estimated remaining: 1h 52m 44s. Rate: 7.5 symbols/min [2025-09-25T20:22:16.990508] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:17.016870] [DEBUG] [LOCAL ] NQP: Loaded 9317 existing records from primary storage. [2025-09-25T20:22:17.017045] [INFO ] [MAIN ] NQP: Loaded 9317 existing records. [2025-09-25T20:22:17.217460] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:17.218118] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-25T20:22:17.218178] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-25T20:22:17.218499] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-25T20:22:17.218562] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-25T20:22:17.490306] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-25T20:22:17.639805] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:18.149259] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T20:22:18.291802] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-25T20:22:18.298624] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:22:19.088685] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-25T20:22:19.322328] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T20:22:19.888738] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-25T20:22:20.460915] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-25T20:22:20.485420] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:22:20.688738] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-25T20:22:21.488844] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-25T20:22:21.586256] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T20:22:22.288788] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-25T20:22:22.850183] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T20:22:22.904617] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T20:22:23.088722] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-25T20:22:23.888764] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-25T20:22:24.535483] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T20:22:24.688718] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-25T20:22:24.889240] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T20:22:25.321267] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:22:25.488947] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-25T20:22:26.182230] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T20:22:26.288731] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-25T20:22:26.977998] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T20:22:27.088761] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-25T20:22:27.888728] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-25T20:22:28.038850] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T20:22:28.688791] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-25T20:22:29.384821] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T20:22:29.388743] [INFO ] [REMOTE ] NPK: Full fetch complete (10877 records). [2025-09-25T20:22:29.388918] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-25T20:22:29.494907] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-25T20:22:29.545701] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T20:22:29.889087] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-25T20:22:29.892805] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-25T20:22:29.893498] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-25T20:22:29.898696] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-25T20:22:29.900268] [DEBUG] [LOCAL ] NPK: Trimmed 10877 records to 8072 (keeping 200 days of data) [2025-09-25T20:22:29.982116] [DEBUG] [LOCAL ] NPK: Primary data saved (8072 records). [2025-09-25T20:22:29.982297] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-25T20:22:29.982512] [INFO ] [MAIN ] Update Progress: 1524/2372 symbols completed. NPK took 43.5s. Estimated remaining: 1h 52m 39s. Rate: 7.5 symbols/min [2025-09-25T20:22:30.176844] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T20:22:30.211013] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:30.287970] [DEBUG] [LOCAL ] NRDY: Loaded 33011 existing records from primary storage. [2025-09-25T20:22:30.288190] [INFO ] [MAIN ] NRDY: Loaded 33011 existing records. [2025-09-25T20:22:30.293859] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-25T20:22:30.549884] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:30.550521] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-25T20:22:30.550582] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-25T20:22:30.551190] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-25T20:22:30.551288] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-25T20:22:31.078044] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:31.088759] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-25T20:22:31.888697] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-25T20:22:31.937637] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T20:22:31.979675] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T20:22:32.581072] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:22:32.688727] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-25T20:22:33.386409] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-25T20:22:33.488739] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-25T20:22:34.174505] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T20:22:34.176834] [INFO ] [REMOTE ] NPV: Full fetch complete (6879 records). [2025-09-25T20:22:34.176927] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-25T20:22:34.294710] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-25T20:22:34.598453] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-25T20:22:34.598544] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-25T20:22:34.598809] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-25T20:22:34.598873] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-25T20:22:34.599307] [DEBUG] [LOCAL ] NPV: Trimmed 6879 records to 5042 (keeping 200 days of data) [2025-09-25T20:22:34.638168] [DEBUG] [LOCAL ] NPV: Primary data saved (5042 records). [2025-09-25T20:22:34.638388] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-25T20:22:34.638533] [INFO ] [MAIN ] Update Progress: 1525/2372 symbols completed. NPV took 22.2s. Estimated remaining: 1h 52m 29s. Rate: 7.5 symbols/min [2025-09-25T20:22:34.829499] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:34.849138] [DEBUG] [LOCAL ] NREF: Loaded 7845 existing records from primary storage. [2025-09-25T20:22:34.849277] [INFO ] [MAIN ] NREF: Loaded 7845 existing records. [2025-09-25T20:22:35.057288] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:35.057603] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-25T20:22:35.057697] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-25T20:22:35.058011] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-25T20:22:35.058072] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-25T20:22:35.094712] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-25T20:22:35.205785] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T20:22:35.486963] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:35.888743] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-25T20:22:36.688755] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-25T20:22:36.759727] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T20:22:36.797382] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T20:22:37.488813] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-25T20:22:37.584034] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T20:22:38.288764] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-25T20:22:38.378013] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:22:39.088787] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-25T20:22:39.801811] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T20:22:39.888762] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-25T20:22:40.177532] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T20:22:40.688700] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-25T20:22:40.749241] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:22:41.488758] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-25T20:22:42.288695] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-25T20:22:42.343003] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T20:22:42.368320] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T20:22:42.977623] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T20:22:43.088736] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-25T20:22:43.888758] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-25T20:22:43.999474] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T20:22:44.688734] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-25T20:22:45.488710] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-25T20:22:45.534088] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T20:22:45.845101] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T20:22:46.288741] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-25T20:22:46.460718] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T20:22:46.467967] [INFO ] [REMOTE ] NQP: Full fetch complete (13507 records). [2025-09-25T20:22:46.468092] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-25T20:22:46.866100] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-25T20:22:46.866258] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-25T20:22:46.867130] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-25T20:22:46.867206] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-25T20:22:46.868089] [DEBUG] [LOCAL ] NQP: Trimmed 13507 records to 9373 (keeping 200 days of data) [2025-09-25T20:22:46.944120] [DEBUG] [LOCAL ] NQP: Primary data saved (9373 records). [2025-09-25T20:22:46.944289] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-25T20:22:46.944440] [INFO ] [MAIN ] Update Progress: 1526/2372 symbols completed. NQP took 30.1s. Estimated remaining: 1h 52m 24s. Rate: 7.5 symbols/min [2025-09-25T20:22:47.096339] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-25T20:22:47.136117] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:47.136365] [DEBUG] [LOCAL ] NRG: No existing data file found in primary storage. [2025-09-25T20:22:47.136422] [WARN ] [MAIN ] NRG: No existing data found, performing full refresh instead. [2025-09-25T20:22:47.136586] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-25T20:22:47.137000] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-25T20:22:47.137086] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-25T20:22:47.137143] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-25T20:22:47.531788] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:47.858996] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T20:22:47.867869] [INFO ] [REMOTE ] NPWR: Full fetch complete (59164 records). [2025-09-25T20:22:47.868047] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-25T20:22:47.893808] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-25T20:22:48.283944] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-25T20:22:48.284031] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-25T20:22:48.285018] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-25T20:22:48.285087] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-25T20:22:48.288807] [DEBUG] [LOCAL ] NPWR: Trimmed 59164 records to 43581 (keeping 200 days of data) [2025-09-25T20:22:48.596047] [DEBUG] [LOCAL ] NPWR: Primary data saved (43581 records). [2025-09-25T20:22:48.596210] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-25T20:22:48.597332] [INFO ] [MAIN ] Update Progress: 1527/2372 symbols completed. NPWR took 33.7s. Estimated remaining: 1h 52m 12s. Rate: 7.5 symbols/min [2025-09-25T20:22:48.699266] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-25T20:22:48.790272] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:22:48.856075] [DEBUG] [LOCAL ] NRGV: Loaded 42987 existing records from primary storage. [2025-09-25T20:22:48.856267] [INFO ] [MAIN ] NRGV: Loaded 42987 existing records. [2025-09-25T20:22:48.905895] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T20:22:49.102901] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:22:49.103249] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-25T20:22:49.103303] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-25T20:22:49.103728] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-25T20:22:49.103789] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-25T20:22:49.383519] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T20:22:49.499706] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-25T20:22:49.505983] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:22:49.539959] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T20:22:50.288686] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-25T20:22:50.392001] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:22:51.088749] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-25T20:22:51.885248] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:22:51.894566] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-25T20:22:52.688746] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-25T20:22:53.488797] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-25T20:23:06.631769] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (13.94 seconds). [2025-09-25T20:23:06.648791] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-25T20:23:06.735365] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (13.25 seconds). [2025-09-25T20:23:06.745668] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-25T20:23:06.843097] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (14.95 seconds). [2025-09-25T20:23:06.847163] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-25T20:23:07.647756] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:23:07.651199] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-25T20:23:07.814798] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T20:23:07.823249] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-25T20:23:08.197923] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-25T20:23:08.200336] [INFO ] [REMOTE ] NREF: Full fetch complete (10848 records). [2025-09-25T20:23:08.200535] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-25T20:23:08.501966] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T20:23:08.526827] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-25T20:23:08.578324] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (17.49 seconds). [2025-09-25T20:23:08.593331] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-25T20:23:08.848076] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-25T20:23:08.848190] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-25T20:23:08.848493] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-25T20:23:08.848540] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-25T20:23:08.849071] [DEBUG] [LOCAL ] NREF: Trimmed 10848 records to 7893 (keeping 200 days of data) [2025-09-25T20:23:08.904150] [DEBUG] [LOCAL ] NREF: Primary data saved (7893 records). [2025-09-25T20:23:08.904279] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-25T20:23:08.904394] [INFO ] [MAIN ] Update Progress: 1528/2372 symbols completed. NREF took 34.3s. Estimated remaining: 1h 52m 11s. Rate: 7.5 symbols/min [2025-09-25T20:23:09.098785] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:09.138944] [DEBUG] [LOCAL ] NRK: Loaded 19685 existing records from primary storage. [2025-09-25T20:23:09.139096] [INFO ] [MAIN ] NRK: Loaded 19685 existing records. [2025-09-25T20:23:09.345324] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:09.346266] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-25T20:23:09.346337] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-25T20:23:09.346751] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-25T20:23:09.346813] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-25T20:23:09.475377] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T20:23:09.508588] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-25T20:23:09.772395] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:09.772864] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-25T20:23:10.962375] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-25T20:23:10.975303] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-25T20:23:11.707376] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-09-25T20:23:11.720547] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-25T20:23:12.233922] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-25T20:23:12.240068] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-25T20:23:12.418723] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-25T20:23:12.433053] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-25T20:23:12.952408] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T20:23:12.959962] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-25T20:23:13.456695] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T20:23:13.478926] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T20:23:13.483605] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-25T20:23:13.486139] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-25T20:23:13.643333] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T20:23:13.656415] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-25T20:23:13.909984] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T20:23:13.917934] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-25T20:23:14.552030] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T20:23:14.555977] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-25T20:23:15.312634] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T20:23:15.325588] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-25T20:23:15.374776] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T20:23:15.384435] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-25T20:23:15.496703] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T20:23:15.513021] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-25T20:23:15.807479] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T20:23:15.811347] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-25T20:23:16.912140] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T20:23:16.920337] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-25T20:23:17.006967] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T20:23:17.015784] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-25T20:23:17.068826] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T20:23:17.074076] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-25T20:23:17.261710] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T20:23:17.278083] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-25T20:23:17.963524] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T20:23:17.973363] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-25T20:23:17.988563] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T20:23:17.993902] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-25T20:23:18.501913] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T20:23:18.515115] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-25T20:23:19.054013] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T20:23:19.058301] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-25T20:23:19.343336] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T20:23:19.356070] [INFO ] [REMOTE ] NRDY: Full fetch complete (52216 records). [2025-09-25T20:23:19.356300] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-25T20:23:19.369029] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T20:23:19.393280] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-25T20:23:19.794285] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-25T20:23:19.794390] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-25T20:23:19.795425] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-25T20:23:19.795490] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-25T20:23:19.800774] [DEBUG] [LOCAL ] NRDY: Trimmed 52216 records to 33222 (keeping 200 days of data) [2025-09-25T20:23:20.063363] [DEBUG] [LOCAL ] NRDY: Primary data saved (33222 records). [2025-09-25T20:23:20.063538] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-25T20:23:20.063710] [INFO ] [MAIN ] Update Progress: 1529/2372 symbols completed. NRDY took 50.1s. Estimated remaining: 1h 52m 5s. Rate: 7.5 symbols/min [2025-09-25T20:23:20.184840] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T20:23:20.210170] [INFO ] [REMOTE ] NRGV: Full fetch complete (61908 records). [2025-09-25T20:23:20.210361] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-25T20:23:20.306639] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T20:23:20.312703] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-25T20:23:20.414297] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:20.450983] [DEBUG] [LOCAL ] NRP: Loaded 4082 existing records from primary storage. [2025-09-25T20:23:20.451206] [INFO ] [MAIN ] NRP: Loaded 4082 existing records. [2025-09-25T20:23:20.970343] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:20.971149] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-25T20:23:20.971233] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-25T20:23:20.971465] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-25T20:23:20.971527] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-25T20:23:21.113984] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-25T20:23:21.114101] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-25T20:23:21.115664] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-25T20:23:21.120451] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-25T20:23:21.135786] [DEBUG] [LOCAL ] NRGV: Trimmed 61908 records to 43355 (keeping 200 days of data) [2025-09-25T20:23:21.854589] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T20:23:21.868579] [DEBUG] [LOCAL ] NRGV: Primary data saved (43355 records). [2025-09-25T20:23:21.873940] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:21.874357] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-25T20:23:21.879335] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-25T20:23:21.879497] [INFO ] [MAIN ] Update Progress: 1530/2372 symbols completed. NRGV took 33.3s. Estimated remaining: 1h 51m 53s. Rate: 7.5 symbols/min [2025-09-25T20:23:21.881279] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-25T20:23:21.858236] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-25T20:23:22.080844] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:22.089506] [DEBUG] [LOCAL ] NRT: Loaded 4882 existing records from primary storage. [2025-09-25T20:23:22.089663] [INFO ] [MAIN ] NRT: Loaded 4882 existing records. [2025-09-25T20:23:22.275215] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:22.275603] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-25T20:23:22.275680] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-25T20:23:22.275887] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-25T20:23:22.275945] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-25T20:23:22.292238] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-25T20:23:22.660949] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:22.781786] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T20:23:22.938765] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T20:23:22.945500] [INFO ] [REMOTE ] NRK: Full fetch complete (27780 records). [2025-09-25T20:23:22.945674] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-25T20:23:23.091815] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-25T20:23:23.167727] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T20:23:23.195182] [INFO ] [REMOTE ] NRG: Full fetch complete (76182 records). [2025-09-25T20:23:23.195453] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-25T20:23:23.204937] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:23:23.205137] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:23:23.205177] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:23:23.205218] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-25T20:23:23.205319] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-25T20:23:23.205399] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-25T20:23:23.205511] [DEBUG] [LOCAL ] NRG: No derivative data file found to delete. [2025-09-25T20:23:23.205634] [INFO ] [MAIN ] Update Progress: 1531/2372 symbols completed. NRG took 36.3s. Estimated remaining: 1h 51m 42s. Rate: 7.5 symbols/min [2025-09-25T20:23:23.637194] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:23.671190] [DEBUG] [LOCAL ] NRUC: Loaded 3096 existing records from primary storage. [2025-09-25T20:23:23.671387] [INFO ] [MAIN ] NRUC: Loaded 3096 existing records. [2025-09-25T20:23:23.809351] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-25T20:23:23.809493] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-25T20:23:23.811085] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-25T20:23:23.811188] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-25T20:23:23.831785] [DEBUG] [LOCAL ] NRK: Trimmed 27780 records to 19862 (keeping 200 days of data) [2025-09-25T20:23:23.933353] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T20:23:23.929771] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-25T20:23:24.215081] [DEBUG] [LOCAL ] NRK: Primary data saved (19862 records). [2025-09-25T20:23:24.215390] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-25T20:23:24.215632] [INFO ] [MAIN ] Update Progress: 1532/2372 symbols completed. NRK took 15.3s. Estimated remaining: 1h 51m 30s. Rate: 7.5 symbols/min [2025-09-25T20:23:24.320046] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:24.320436] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-25T20:23:24.320510] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-25T20:23:24.326681] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-25T20:23:24.326820] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-25T20:23:24.696321] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-25T20:23:24.771122] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:24.773941] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T20:23:24.913913] [DEBUG] [LOCAL ] NSA: Loaded 44875 existing records from primary storage. [2025-09-25T20:23:24.914147] [INFO ] [MAIN ] NSA: Loaded 44875 existing records. [2025-09-25T20:23:25.235170] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:25.235634] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:25.235812] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-25T20:23:25.235859] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-25T20:23:25.236147] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-25T20:23:25.236232] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-25T20:23:25.494756] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-25T20:23:25.627126] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:25.687140] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T20:23:26.137748] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T20:23:26.288751] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-25T20:23:27.058410] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T20:23:27.088677] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-25T20:23:27.784247] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T20:23:27.888765] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-25T20:23:28.640996] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T20:23:28.688669] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-25T20:23:29.351557] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T20:23:29.488709] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-25T20:23:30.288748] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-25T20:23:30.969277] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T20:23:31.081028] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T20:23:31.088901] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-25T20:23:31.752260] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T20:23:31.888734] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-25T20:23:32.688728] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-25T20:23:33.355537] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T20:23:33.452362] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T20:23:33.488757] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-25T20:23:34.166336] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T20:23:34.288948] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-25T20:23:35.026883] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T20:23:35.088683] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-25T20:23:35.731901] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:23:35.888829] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-25T20:23:36.688768] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-25T20:23:37.318013] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T20:23:37.383178] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T20:23:37.488743] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-25T20:23:38.198353] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T20:23:38.288759] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-25T20:23:39.088784] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-25T20:23:39.634131] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-25T20:23:39.899612] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-25T20:23:39.926049] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T20:23:40.688767] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-25T20:23:40.692071] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T20:23:41.488713] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-25T20:23:41.556622] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T20:23:42.288888] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-25T20:23:42.927120] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T20:23:43.046410] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T20:23:43.088682] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-25T20:23:43.888810] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-25T20:23:44.437163] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T20:23:44.688764] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-25T20:23:44.789562] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T20:23:45.313982] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T20:23:45.488798] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-25T20:23:46.140296] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T20:23:46.288793] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-25T20:23:46.841098] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T20:23:47.088779] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-25T20:23:47.745139] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T20:23:47.747512] [INFO ] [REMOTE ] NRT: Full fetch complete (8037 records). [2025-09-25T20:23:47.747627] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-25T20:23:47.895751] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-25T20:23:48.144675] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-25T20:23:48.144820] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-25T20:23:48.145265] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-25T20:23:48.145387] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-25T20:23:48.145984] [DEBUG] [LOCAL ] NRT: Trimmed 8037 records to 4906 (keeping 200 days of data) [2025-09-25T20:23:48.185159] [DEBUG] [LOCAL ] NRT: Primary data saved (4906 records). [2025-09-25T20:23:48.185357] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-25T20:23:48.185584] [INFO ] [MAIN ] Update Progress: 1533/2372 symbols completed. NRT took 26.3s. Estimated remaining: 1h 51m 31s. Rate: 7.5 symbols/min [2025-09-25T20:23:48.372962] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:48.373280] [DEBUG] [LOCAL ] NSC: No existing data file found in primary storage. [2025-09-25T20:23:48.373341] [WARN ] [MAIN ] NSC: No existing data found, performing full refresh instead. [2025-09-25T20:23:48.374035] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-25T20:23:48.374106] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-25T20:23:48.374175] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-25T20:23:48.374239] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-25T20:23:48.541253] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T20:23:48.547056] [INFO ] [REMOTE ] NRP: Full fetch complete (6492 records). [2025-09-25T20:23:48.547155] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-25T20:23:48.698863] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-25T20:23:49.010304] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:49.211029] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-25T20:23:49.211175] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-25T20:23:49.211479] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-25T20:23:49.212220] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-25T20:23:49.212739] [DEBUG] [LOCAL ] NRP: Trimmed 6492 records to 4098 (keeping 200 days of data) [2025-09-25T20:23:49.245130] [DEBUG] [LOCAL ] NRP: Primary data saved (4098 records). [2025-09-25T20:23:49.245284] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-25T20:23:49.245471] [INFO ] [MAIN ] Update Progress: 1534/2372 symbols completed. NRP took 29.2s. Estimated remaining: 1h 51m 19s. Rate: 7.5 symbols/min [2025-09-25T20:23:49.328121] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T20:23:49.440347] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:49.494704] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-25T20:23:49.517616] [DEBUG] [LOCAL ] NSP: Loaded 34932 existing records from primary storage. [2025-09-25T20:23:49.518381] [INFO ] [MAIN ] NSP: Loaded 34932 existing records. [2025-09-25T20:23:49.707356] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:49.707805] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-25T20:23:49.707861] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-25T20:23:49.708272] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-25T20:23:49.708334] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-25T20:23:50.078844] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:50.288744] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-25T20:23:51.088752] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-25T20:23:51.324242] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T20:23:51.384309] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T20:23:51.888748] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-25T20:23:52.478533] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T20:23:52.688746] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-25T20:23:52.807250] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T20:23:53.488750] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-25T20:23:54.146285] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T20:23:54.147862] [INFO ] [REMOTE ] NRUC: Full fetch complete (5569 records). [2025-09-25T20:23:54.147936] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-25T20:23:54.293897] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-25T20:23:54.588104] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-25T20:23:54.588216] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-25T20:23:54.588411] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-25T20:23:54.588452] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-25T20:23:54.589065] [DEBUG] [LOCAL ] NRUC: Trimmed 5569 records to 3116 (keeping 200 days of data) [2025-09-25T20:23:54.609755] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T20:23:54.638388] [DEBUG] [LOCAL ] NRUC: Primary data saved (3116 records). [2025-09-25T20:23:54.638613] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-25T20:23:54.638858] [INFO ] [MAIN ] Update Progress: 1535/2372 symbols completed. NRUC took 31.4s. Estimated remaining: 1h 51m 10s. Rate: 7.5 symbols/min [2025-09-25T20:23:54.812865] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:23:54.851345] [DEBUG] [LOCAL ] NTB: Loaded 20700 existing records from primary storage. [2025-09-25T20:23:54.851630] [INFO ] [MAIN ] NTB: Loaded 20700 existing records. [2025-09-25T20:23:55.033045] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:23:55.033603] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-25T20:23:55.033679] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-25T20:23:55.034164] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-25T20:23:55.034245] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-25T20:23:55.100333] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-25T20:23:55.438516] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:23:55.783187] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T20:23:55.888696] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-25T20:23:56.688736] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-25T20:23:56.768398] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T20:23:57.344883] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T20:23:57.488819] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-25T20:23:57.821838] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:23:58.288754] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-25T20:23:59.088739] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-25T20:23:59.249085] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T20:23:59.421483] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T20:23:59.888709] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-25T20:24:00.688716] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-25T20:24:00.764467] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T20:24:01.079076] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:24:01.488760] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-25T20:24:01.873035] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:24:02.288739] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-25T20:24:02.669955] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:24:03.088726] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-25T20:24:03.888723] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-25T20:24:03.945833] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T20:24:04.333145] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T20:24:04.688749] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-25T20:24:05.488757] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-25T20:24:05.904116] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-25T20:24:05.915359] [INFO ] [REMOTE ] NSA: Full fetch complete (61849 records). [2025-09-25T20:24:05.915548] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-25T20:24:06.295036] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-25T20:24:06.315536] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T20:24:06.454711] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-25T20:24:06.454854] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-25T20:24:06.456291] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-25T20:24:06.456406] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-25T20:24:06.460609] [DEBUG] [LOCAL ] NSA: Trimmed 61849 records to 45202 (keeping 200 days of data) [2025-09-25T20:24:06.616598] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-25T20:24:06.830578] [DEBUG] [LOCAL ] NSA: Primary data saved (45202 records). [2025-09-25T20:24:06.830760] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-25T20:24:06.830933] [INFO ] [MAIN ] Update Progress: 1536/2372 symbols completed. NSA took 42.6s. Estimated remaining: 1h 51m 4s. Rate: 7.5 symbols/min [2025-09-25T20:24:07.023429] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:07.023678] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-25T20:24:07.023736] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-25T20:24:07.023965] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-25T20:24:07.024005] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-25T20:24:07.024046] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-25T20:24:07.024093] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-25T20:24:07.094827] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-25T20:24:07.431389] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:07.888783] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-25T20:24:08.291950] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T20:24:08.303764] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T20:24:08.688770] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-25T20:24:09.309939] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T20:24:09.488707] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-25T20:24:10.288794] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-25T20:24:10.726374] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T20:24:10.757971] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T20:24:10.799418] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-25T20:24:11.088750] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-25T20:24:11.888870] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-25T20:24:12.562437] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T20:24:12.688825] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-25T20:24:12.979175] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:24:13.488781] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-25T20:24:14.034583] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T20:24:14.289295] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-25T20:24:15.094023] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-25T20:24:15.118002] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T20:24:15.148534] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T20:24:15.153212] [INFO ] [REMOTE ] NTB: Full fetch complete (30879 records). [2025-09-25T20:24:15.153340] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-25T20:24:15.673930] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-25T20:24:15.674098] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-25T20:24:15.675311] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-25T20:24:15.675401] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-25T20:24:15.678111] [DEBUG] [LOCAL ] NTB: Trimmed 30879 records to 20819 (keeping 200 days of data) [2025-09-25T20:24:15.756586] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T20:24:15.845113] [DEBUG] [LOCAL ] NTB: Primary data saved (20819 records). [2025-09-25T20:24:15.845333] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-25T20:24:15.845595] [INFO ] [MAIN ] Update Progress: 1537/2372 symbols completed. NTB took 21.2s. Estimated remaining: 1h 50m 57s. Rate: 7.5 symbols/min [2025-09-25T20:24:15.893793] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-25T20:24:16.046600] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:16.135503] [DEBUG] [LOCAL ] NTR: Loaded 52579 existing records from primary storage. [2025-09-25T20:24:16.135750] [INFO ] [MAIN ] NTR: Loaded 52579 existing records. [2025-09-25T20:24:16.348942] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:16.349945] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-25T20:24:16.350031] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-25T20:24:16.350723] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-25T20:24:16.350809] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-25T20:24:16.690269] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-25T20:24:16.947187] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:17.488787] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-25T20:24:18.047576] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-25T20:24:18.217802] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T20:24:18.288681] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-25T20:24:19.088736] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-25T20:24:19.362982] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T20:24:19.582060] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T20:24:19.888711] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-25T20:24:19.978565] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T20:24:20.688724] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-25T20:24:21.189288] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T20:24:21.488713] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-25T20:24:21.706127] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T20:24:22.288760] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-25T20:24:23.088704] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-25T20:24:23.326693] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T20:24:23.353204] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:24:23.888769] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-25T20:24:24.592815] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T20:24:24.688732] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-25T20:24:25.266200] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T20:24:25.273674] [INFO ] [REMOTE ] NSP: Full fetch complete (49526 records). [2025-09-25T20:24:25.273858] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-25T20:24:25.327316] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:24:25.500757] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-25T20:24:25.728334] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-25T20:24:25.728431] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-25T20:24:25.729508] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-25T20:24:25.729605] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-25T20:24:25.731827] [DEBUG] [LOCAL ] NSP: Trimmed 49526 records to 35210 (keeping 200 days of data) [2025-09-25T20:24:25.999812] [DEBUG] [LOCAL ] NSP: Primary data saved (35210 records). [2025-09-25T20:24:25.999993] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-25T20:24:26.000133] [INFO ] [MAIN ] Update Progress: 1538/2372 symbols completed. NSP took 36.8s. Estimated remaining: 1h 50m 50s. Rate: 7.5 symbols/min [2025-09-25T20:24:26.088523] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T20:24:26.189090] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:26.245688] [DEBUG] [LOCAL ] NTST: Loaded 43575 existing records from primary storage. [2025-09-25T20:24:26.245854] [INFO ] [MAIN ] NTST: Loaded 43575 existing records. [2025-09-25T20:24:26.293901] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-25T20:24:26.460979] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:26.462924] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-25T20:24:26.462982] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-25T20:24:26.463253] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-25T20:24:26.463316] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-25T20:24:26.884855] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:26.925935] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T20:24:27.088745] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-25T20:24:27.874630] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:24:27.884437] [INFO ] [REMOTE ] NSC: Full fetch complete (70674 records). [2025-09-25T20:24:27.884612] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-25T20:24:27.885926] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:24:27.886021] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:24:27.886077] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:24:27.886153] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-25T20:24:27.886274] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-25T20:24:27.886366] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-25T20:24:27.886514] [DEBUG] [LOCAL ] NSC: No derivative data file found to delete. [2025-09-25T20:24:27.886614] [INFO ] [MAIN ] Update Progress: 1539/2372 symbols completed. NSC took 39.7s. Estimated remaining: 1h 50m 38s. Rate: 7.5 symbols/min [2025-09-25T20:24:27.898052] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-25T20:24:28.102402] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:28.177118] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-25T20:24:28.177288] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-25T20:24:28.367107] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:28.367369] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-25T20:24:28.367413] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-25T20:24:28.367823] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-25T20:24:28.367887] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-25T20:24:28.469690] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T20:24:28.470473] [INFO ] [REMOTE ] NTEST: Full fetch complete (1985 records). [2025-09-25T20:24:28.470548] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-25T20:24:28.693864] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-25T20:24:28.822363] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-25T20:24:28.865033] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:24:28.888435] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:24:28.914700] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-25T20:24:28.927700] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-25T20:24:28.939705] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-25T20:24:28.958713] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-25T20:24:28.998149] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:28.991825] [INFO ] [MAIN ] Update Progress: 1540/2372 symbols completed. NTEST took 22.2s. Estimated remaining: 1h 50m 27s. Rate: 7.5 symbols/min [2025-09-25T20:24:29.193030] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:29.193290] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-25T20:24:29.193347] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-25T20:24:29.193941] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-25T20:24:29.193988] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-25T20:24:29.194033] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-25T20:24:29.194067] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-25T20:24:29.499712] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-25T20:24:29.584895] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:30.235270] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T20:24:30.288672] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-25T20:24:31.088672] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-25T20:24:31.449370] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:24:31.772048] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:24:31.888675] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-25T20:24:32.688733] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-25T20:24:33.451561] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-25T20:24:33.488670] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-25T20:24:33.680102] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T20:24:34.095963] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-25T20:24:34.288692] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-25T20:24:35.088808] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-25T20:24:35.778048] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-25T20:24:35.888687] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-25T20:24:36.556618] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-25T20:24:36.688775] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-25T20:24:36.791408] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T20:24:37.488725] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-25T20:24:38.194939] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-25T20:24:38.288710] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-25T20:24:38.677737] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T20:24:39.088707] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-25T20:24:39.190834] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T20:24:39.888772] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-25T20:24:40.624800] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-25T20:24:40.692841] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T20:24:40.703748] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-25T20:24:41.488685] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-25T20:24:41.903365] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T20:24:42.287625] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T20:24:42.298021] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-25T20:24:43.088951] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-25T20:24:43.771720] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-25T20:24:43.888766] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-25T20:24:44.106744] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T20:24:44.696882] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-25T20:24:44.702863] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T20:24:45.488742] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-25T20:24:46.111936] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-25T20:24:46.288747] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-25T20:24:47.095331] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-25T20:24:47.119605] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-25T20:24:47.165817] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T20:24:47.888787] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-25T20:24:48.124900] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T20:24:48.688711] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-25T20:24:49.147602] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T20:24:49.488742] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-25T20:24:50.099268] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-25T20:24:50.289892] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-25T20:24:50.534064] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T20:24:51.088756] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-25T20:24:51.551490] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-25T20:24:51.888793] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-25T20:24:52.680849] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-25T20:24:52.693046] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-25T20:24:52.806737] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T20:24:53.489034] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-25T20:24:53.742182] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T20:24:54.288792] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-25T20:24:54.494476] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T20:24:55.088779] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-25T20:24:55.194576] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T20:24:55.209048] [INFO ] [REMOTE ] NTST: Full fetch complete (60860 records). [2025-09-25T20:24:55.209227] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-25T20:24:55.655283] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-25T20:24:55.655457] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-25T20:24:55.658926] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-25T20:24:55.659056] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-25T20:24:55.663465] [DEBUG] [LOCAL ] NTST: Trimmed 60860 records to 43910 (keeping 200 days of data) [2025-09-25T20:24:55.910066] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-25T20:24:56.011522] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:24:56.014676] [DEBUG] [LOCAL ] NTST: Primary data saved (43910 records). [2025-09-25T20:24:56.014765] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-25T20:24:56.014977] [INFO ] [MAIN ] Update Progress: 1541/2372 symbols completed. NTST took 30.0s. Estimated remaining: 1h 50m 29s. Rate: 7.5 symbols/min [2025-09-25T20:24:56.051930] [INFO ] [REMOTE ] NTR: Full fetch complete (76292 records). [2025-09-25T20:24:56.052201] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-25T20:24:56.399686] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:56.521838] [DEBUG] [LOCAL ] NUS: Loaded 36465 existing records from primary storage. [2025-09-25T20:24:56.522013] [INFO ] [MAIN ] NUS: Loaded 36465 existing records. [2025-09-25T20:24:56.839956] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T20:24:56.864442] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-25T20:24:56.889450] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-25T20:24:56.889561] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-25T20:24:56.891172] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-25T20:24:56.891420] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-25T20:24:56.921381] [DEBUG] [LOCAL ] NTR: Trimmed 76292 records to 52969 (keeping 200 days of data) [2025-09-25T20:24:57.126677] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:57.127057] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-25T20:24:57.127127] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-25T20:24:57.127695] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-25T20:24:57.127775] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-25T20:24:57.648246] [DEBUG] [LOCAL ] NTR: Primary data saved (52969 records). [2025-09-25T20:24:57.648523] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-25T20:24:57.648790] [INFO ] [MAIN ] Update Progress: 1542/2372 symbols completed. NTR took 41.8s. Estimated remaining: 1h 50m 18s. Rate: 7.5 symbols/min [2025-09-25T20:24:57.787385] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T20:24:57.862762] [INFO ] [REMOTE ] NUE: Full fetch complete (74533 records). [2025-09-25T20:24:57.862980] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-25T20:24:57.877682] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:24:57.877807] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:24:57.877859] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:24:57.877925] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-25T20:24:57.877992] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-25T20:24:57.878048] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-25T20:24:57.878132] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-25T20:24:57.878234] [INFO ] [MAIN ] Update Progress: 1543/2372 symbols completed. NUE took 28.9s. Estimated remaining: 1h 50m 6s. Rate: 7.5 symbols/min [2025-09-25T20:24:58.077507] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:58.093447] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-25T20:24:58.161837] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:58.262118] [DEBUG] [LOCAL ] NUV: Loaded 23234 existing records from primary storage. [2025-09-25T20:24:58.262306] [INFO ] [MAIN ] NUV: Loaded 23234 existing records. [2025-09-25T20:24:58.269019] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:24:58.515497] [DEBUG] [LOCAL ] NUVB: Loaded 51241 existing records from primary storage. [2025-09-25T20:24:58.515765] [INFO ] [MAIN ] NUVB: Loaded 51241 existing records. [2025-09-25T20:24:58.594667] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:58.595137] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-25T20:24:58.595198] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-25T20:24:58.595501] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-25T20:24:58.595563] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-25T20:24:58.968830] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:24:58.969145] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-25T20:24:58.969196] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-25T20:24:58.969533] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-25T20:24:58.969596] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-25T20:24:59.099827] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (3.19 seconds). [2025-09-25T20:24:59.151361] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-25T20:24:59.410272] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:59.415902] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-25T20:24:59.593002] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:24:59.889805] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-25T20:25:01.443968] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (3.35 seconds). [2025-09-25T20:25:01.454325] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-25T20:25:01.784364] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-25T20:25:01.794065] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-25T20:25:01.943623] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-25T20:25:02.288789] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-25T20:25:02.508248] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (3.36 seconds). [2025-09-25T20:25:02.522347] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-25T20:25:02.522575] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-25T20:25:02.811356] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T20:25:02.874031] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T20:25:03.096212] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-25T20:25:03.103575] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-25T20:25:03.103713] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-25T20:25:03.106086] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-25T20:25:03.106251] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-25T20:25:03.113718] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 54136 (keeping 200 days of data) [2025-09-25T20:25:03.509750] [DEBUG] [LOCAL ] NU: Primary data saved (54136 records). [2025-09-25T20:25:03.509973] [INFO ] [MAIN ] NU: Full history saved. [2025-09-25T20:25:03.513915] [INFO ] [MAIN ] Update Progress: 1544/2372 symbols completed. NU took 35.6s. Estimated remaining: 1h 49m 56s. Rate: 7.5 symbols/min [2025-09-25T20:25:03.694660] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:03.715745] [DEBUG] [LOCAL ] NUW: Loaded 7437 existing records from primary storage. [2025-09-25T20:25:03.715923] [INFO ] [MAIN ] NUW: Loaded 7437 existing records. [2025-09-25T20:25:03.890754] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-25T20:25:03.926273] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:03.926638] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-25T20:25:03.926943] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-25T20:25:03.927287] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-25T20:25:03.927349] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-25T20:25:04.147675] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T20:25:04.391174] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:04.421961] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:25:04.688742] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-25T20:25:04.785882] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T20:25:05.488753] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-25T20:25:06.288713] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-25T20:25:06.383096] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:25:06.667985] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:25:07.088771] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-25T20:25:07.892623] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-25T20:25:07.896324] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T20:25:08.298699] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T20:25:08.688727] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-25T20:25:09.488725] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-25T20:25:09.539272] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-25T20:25:09.756861] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:25:10.288750] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-25T20:25:10.340223] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:25:11.089737] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-25T20:25:11.401767] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T20:25:11.888745] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-25T20:25:12.688750] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-25T20:25:13.488800] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-25T20:25:13.790943] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T20:25:13.949141] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-25T20:25:14.138826] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T20:25:14.288744] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-25T20:25:14.457676] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-25T20:25:15.088701] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-25T20:25:15.491791] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T20:25:15.888741] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-25T20:25:16.415148] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T20:25:16.688713] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-25T20:25:16.724355] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T20:25:17.488715] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-25T20:25:17.933622] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T20:25:18.035508] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T20:25:18.288744] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-25T20:25:19.089837] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-25T20:25:19.092021] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T20:25:19.888688] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-25T20:25:20.246526] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T20:25:20.254621] [INFO ] [REMOTE ] NUV: Full fetch complete (34451 records). [2025-09-25T20:25:20.254824] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-25T20:25:20.689570] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-25T20:25:20.716144] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-25T20:25:20.716288] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-25T20:25:20.717167] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-25T20:25:20.717245] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-25T20:25:20.719315] [DEBUG] [LOCAL ] NUV: Trimmed 34451 records to 23442 (keeping 200 days of data) [2025-09-25T20:25:20.880138] [DEBUG] [LOCAL ] NUV: Primary data saved (23442 records). [2025-09-25T20:25:20.880304] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-25T20:25:20.880434] [INFO ] [MAIN ] Update Progress: 1545/2372 symbols completed. NUV took 23.2s. Estimated remaining: 1h 49m 53s. Rate: 7.5 symbols/min [2025-09-25T20:25:21.071189] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:21.112846] [DEBUG] [LOCAL ] NVG: Loaded 27288 existing records from primary storage. [2025-09-25T20:25:21.113014] [INFO ] [MAIN ] NVG: Loaded 27288 existing records. [2025-09-25T20:25:21.311321] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:21.312394] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-25T20:25:21.312457] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-25T20:25:21.312776] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-25T20:25:21.312837] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-25T20:25:21.506819] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-25T20:25:21.545938] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T20:25:21.579490] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T20:25:21.764720] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:22.288765] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-25T20:25:22.993431] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T20:25:23.088733] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-25T20:25:23.888944] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-25T20:25:24.295079] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T20:25:24.582114] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:25:24.661453] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T20:25:24.688767] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-25T20:25:25.488855] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-25T20:25:26.222474] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T20:25:26.288702] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-25T20:25:27.088782] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-25T20:25:27.650843] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T20:25:27.805536] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T20:25:27.814871] [INFO ] [REMOTE ] NUS: Full fetch complete (53941 records). [2025-09-25T20:25:27.815051] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-25T20:25:27.829334] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:25:27.889937] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-25T20:25:28.271463] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-25T20:25:28.271560] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-25T20:25:28.272749] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-25T20:25:28.272893] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-25T20:25:28.276505] [DEBUG] [LOCAL ] NUS: Trimmed 53941 records to 36728 (keeping 200 days of data) [2025-09-25T20:25:28.532438] [DEBUG] [LOCAL ] NUS: Primary data saved (36728 records). [2025-09-25T20:25:28.532713] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-25T20:25:28.532959] [INFO ] [MAIN ] Update Progress: 1546/2372 symbols completed. NUS took 32.5s. Estimated remaining: 1h 49m 45s. Rate: 7.5 symbols/min [2025-09-25T20:25:28.621595] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T20:25:28.650014] [INFO ] [REMOTE ] NUW: Full fetch complete (11753 records). [2025-09-25T20:25:28.650136] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-25T20:25:28.692786] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-25T20:25:28.856243] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:29.111814] [DEBUG] [LOCAL ] NVGS: Loaded 31109 existing records from primary storage. [2025-09-25T20:25:29.117864] [INFO ] [MAIN ] NVGS: Loaded 31109 existing records. [2025-09-25T20:25:29.558302] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-25T20:25:29.600743] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-25T20:25:29.625727] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-25T20:25:29.626379] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-25T20:25:29.626454] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-25T20:25:29.628153] [DEBUG] [LOCAL ] NUW: Trimmed 11753 records to 7466 (keeping 200 days of data) [2025-09-25T20:25:29.645815] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:29.646293] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-25T20:25:29.646380] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-25T20:25:29.665697] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-25T20:25:29.665890] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-25T20:25:30.053458] [DEBUG] [LOCAL ] NUW: Primary data saved (7466 records). [2025-09-25T20:25:30.053768] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-25T20:25:30.053949] [INFO ] [MAIN ] Update Progress: 1547/2372 symbols completed. NUW took 26.5s. Estimated remaining: 1h 49m 34s. Rate: 7.5 symbols/min [2025-09-25T20:25:30.217560] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:30.294712] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-25T20:25:30.336301] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:30.403477] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-25T20:25:30.403823] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-25T20:25:30.596871] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:30.597685] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-25T20:25:30.597745] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-25T20:25:30.598133] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-25T20:25:30.598207] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-25T20:25:30.693137] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T20:25:31.060960] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:31.091345] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-25T20:25:31.107900] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T20:25:31.419239] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T20:25:31.888781] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-25T20:25:32.688697] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-25T20:25:33.169556] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T20:25:33.182525] [INFO ] [REMOTE ] NUVB: Full fetch complete (72636 records). [2025-09-25T20:25:33.182756] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-25T20:25:33.493794] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-25T20:25:33.630158] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-25T20:25:33.630255] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-25T20:25:33.631513] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-25T20:25:33.631583] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-25T20:25:33.633404] [DEBUG] [LOCAL ] NUVB: Trimmed 72636 records to 51622 (keeping 200 days of data) [2025-09-25T20:25:33.980157] [DEBUG] [LOCAL ] NUVB: Primary data saved (51622 records). [2025-09-25T20:25:33.980421] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-25T20:25:33.980719] [INFO ] [MAIN ] Update Progress: 1548/2372 symbols completed. NUVB took 36.1s. Estimated remaining: 1h 49m 24s. Rate: 7.5 symbols/min [2025-09-25T20:25:34.094096] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T20:25:34.231329] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:34.292391] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-25T20:25:34.295533] [DEBUG] [LOCAL ] NVR: Loaded 19120 existing records from primary storage. [2025-09-25T20:25:34.295628] [INFO ] [MAIN ] NVR: Loaded 19120 existing records. [2025-09-25T20:25:34.325342] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-25T20:25:34.526002] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:34.527823] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-25T20:25:34.527907] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-25T20:25:34.528254] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-25T20:25:34.528335] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-25T20:25:34.851921] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:25:34.943707] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:35.088717] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-25T20:25:35.479933] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:25:35.888786] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-25T20:25:36.688776] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-25T20:25:37.174992] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:25:37.488696] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-25T20:25:37.684079] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-25T20:25:38.080466] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T20:25:38.288692] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-25T20:25:38.406933] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T20:25:39.089726] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-25T20:25:39.676809] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T20:25:39.888741] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-25T20:25:40.308579] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T20:25:40.688726] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-25T20:25:41.488744] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-25T20:25:42.106501] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T20:25:42.258703] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-25T20:25:42.288674] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-25T20:25:42.912130] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T20:25:43.088673] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-25T20:25:43.888763] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-25T20:25:44.262022] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T20:25:44.688709] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-25T20:25:44.899756] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-25T20:25:45.158221] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T20:25:45.488702] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-25T20:25:45.871976] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T20:25:46.288691] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-25T20:25:46.638984] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T20:25:47.088815] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-25T20:25:47.662280] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T20:25:47.888751] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-25T20:25:48.123791] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T20:25:48.688721] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-25T20:25:49.488753] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-25T20:25:50.218812] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T20:25:50.288866] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-25T20:25:50.609241] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-25T20:25:50.748015] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T20:25:51.088805] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-25T20:25:51.826431] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T20:25:51.888742] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-25T20:25:52.688807] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-25T20:25:53.339794] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T20:25:53.488758] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-25T20:25:53.725881] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:25:53.737204] [INFO ] [REMOTE ] NVG: Full fetch complete (40736 records). [2025-09-25T20:25:53.737399] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-25T20:25:53.974114] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-25T20:25:54.290774] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-25T20:25:54.301689] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-25T20:25:54.301828] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-25T20:25:54.303220] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-25T20:25:54.303368] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-25T20:25:54.316668] [DEBUG] [LOCAL ] NVG: Trimmed 40736 records to 27503 (keeping 200 days of data) [2025-09-25T20:25:54.331618] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T20:25:54.343510] [INFO ] [REMOTE ] NVGS: Full fetch complete (41562 records). [2025-09-25T20:25:54.343695] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-25T20:25:54.803757] [DEBUG] [LOCAL ] NVG: Primary data saved (27503 records). [2025-09-25T20:25:54.803926] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-25T20:25:54.804136] [INFO ] [MAIN ] Update Progress: 1549/2372 symbols completed. NVG took 33.9s. Estimated remaining: 1h 49m 23s. Rate: 7.5 symbols/min [2025-09-25T20:25:55.092753] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-25T20:25:55.216765] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-25T20:25:55.216874] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-25T20:25:55.218032] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-25T20:25:55.218111] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-25T20:25:55.222960] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:55.224815] [DEBUG] [LOCAL ] NVGS: Trimmed 41562 records to 31272 (keeping 200 days of data) [2025-09-25T20:25:55.396538] [DEBUG] [LOCAL ] NVRI: Loaded 38754 existing records from primary storage. [2025-09-25T20:25:55.399877] [INFO ] [MAIN ] NVRI: Loaded 38754 existing records. [2025-09-25T20:25:55.618386] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:25:55.669891] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:55.671897] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-25T20:25:55.671972] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-25T20:25:55.672545] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-25T20:25:55.672629] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-25T20:25:55.836506] [DEBUG] [LOCAL ] NVGS: Primary data saved (31272 records). [2025-09-25T20:25:55.838698] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-25T20:25:55.846752] [INFO ] [MAIN ] Update Progress: 1550/2372 symbols completed. NVGS took 27.3s. Estimated remaining: 1h 49m 11s. Rate: 7.5 symbols/min [2025-09-25T20:25:55.900867] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-25T20:25:56.219510] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:25:56.429087] [DEBUG] [LOCAL ] NVS: Loaded 51610 existing records from primary storage. [2025-09-25T20:25:56.429373] [INFO ] [MAIN ] NVS: Loaded 51610 existing records. [2025-09-25T20:25:56.539132] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:56.656943] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:25:56.657293] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-25T20:25:56.657349] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-25T20:25:56.660687] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-25T20:25:56.660800] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-25T20:25:56.688708] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-25T20:25:56.843849] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T20:25:57.071288] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:25:57.411501] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-25T20:25:57.488739] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-25T20:25:58.285046] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:25:58.293907] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-25T20:25:59.088833] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-25T20:25:59.200160] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T20:25:59.888785] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-25T20:26:00.378961] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T20:26:00.693415] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-25T20:26:00.715833] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-25T20:26:01.454318] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T20:26:01.488709] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-25T20:26:01.893138] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T20:26:02.288800] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-25T20:26:03.088758] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-25T20:26:03.142605] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T20:26:03.722495] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T20:26:03.888791] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-25T20:26:04.688845] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-25T20:26:05.458964] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T20:26:05.488679] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-25T20:26:05.606231] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-25T20:26:05.619313] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T20:26:06.288739] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-25T20:26:07.088705] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-25T20:26:07.152290] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T20:26:07.311744] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T20:26:07.888747] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-25T20:26:08.688731] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-25T20:26:09.489694] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-25T20:26:09.857542] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T20:26:09.869678] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.78 seconds). [2025-09-25T20:26:09.881546] [INFO ] [REMOTE ] NVO: Full fetch complete (77955 records). [2025-09-25T20:26:09.881783] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-25T20:26:09.912247] [INFO ] [REMOTE ] NVR: Full fetch complete (29833 records). [2025-09-25T20:26:09.912499] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-25T20:26:10.095425] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-25T20:26:10.293788] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-25T20:26:10.854763] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-25T20:26:10.854892] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-25T20:26:10.855367] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-25T20:26:10.855434] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-25T20:26:10.874170] [DEBUG] [LOCAL ] NVR: Trimmed 29833 records to 19212 (keeping 200 days of data) [2025-09-25T20:26:10.885339] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-25T20:26:10.885488] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-25T20:26:10.890828] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-25T20:26:10.891034] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-25T20:26:10.896970] [DEBUG] [LOCAL ] NVO: Trimmed 77955 records to 54174 (keeping 200 days of data) [2025-09-25T20:26:11.084441] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T20:26:11.099623] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-25T20:26:11.190069] [DEBUG] [LOCAL ] NVR: Primary data saved (19212 records). [2025-09-25T20:26:11.190286] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-25T20:26:11.190439] [INFO ] [MAIN ] Update Progress: 1551/2372 symbols completed. NVR took 37.2s. Estimated remaining: 1h 49m 7s. Rate: 7.5 symbols/min [2025-09-25T20:26:11.580506] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:11.633475] [DEBUG] [LOCAL ] NVO: Primary data saved (54174 records). [2025-09-25T20:26:11.633727] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-25T20:26:11.633942] [INFO ] [MAIN ] Update Progress: 1552/2372 symbols completed. NVO took 41.6s. Estimated remaining: 1h 48m 55s. Rate: 7.5 symbols/min [2025-09-25T20:26:11.867496] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:11.893812] [DEBUG] [LOCAL ] NVST: Loaded 51623 existing records from primary storage. [2025-09-25T20:26:11.894012] [INFO ] [MAIN ] NVST: Loaded 51623 existing records. [2025-09-25T20:26:12.112428] [DEBUG] [LOCAL ] NVT: Loaded 51587 existing records from primary storage. [2025-09-25T20:26:12.112634] [INFO ] [MAIN ] NVT: Loaded 51587 existing records. [2025-09-25T20:26:12.171420] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:12.171878] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-25T20:26:12.171968] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-25T20:26:12.172498] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-25T20:26:12.172621] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-25T20:26:12.453232] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-25T20:26:12.577101] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-25T20:26:12.533540] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T20:26:12.638214] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:12.638713] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-25T20:26:12.638773] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-25T20:26:12.639101] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-25T20:26:12.639161] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-25T20:26:12.718037] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-25T20:26:13.197730] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:13.301848] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:13.488744] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-25T20:26:14.181253] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T20:26:14.299201] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-25T20:26:14.322571] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T20:26:14.771018] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:26:15.088743] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-25T20:26:15.888719] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-25T20:26:16.239232] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T20:26:16.336816] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T20:26:16.688771] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-25T20:26:17.436445] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T20:26:17.488748] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-25T20:26:18.288746] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-25T20:26:18.665240] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T20:26:19.089766] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-25T20:26:19.121717] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T20:26:19.131765] [INFO ] [REMOTE ] NVRI: Full fetch complete (55863 records). [2025-09-25T20:26:19.132000] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-25T20:26:19.551958] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-25T20:26:19.552133] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-25T20:26:19.553179] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-25T20:26:19.553283] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-25T20:26:19.555969] [DEBUG] [LOCAL ] NVRI: Trimmed 55863 records to 39056 (keeping 200 days of data) [2025-09-25T20:26:19.824478] [DEBUG] [LOCAL ] NVRI: Primary data saved (39056 records). [2025-09-25T20:26:19.824676] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-25T20:26:19.824822] [INFO ] [MAIN ] Update Progress: 1553/2372 symbols completed. NVRI took 25.0s. Estimated remaining: 1h 48m 47s. Rate: 7.5 symbols/min [2025-09-25T20:26:19.907716] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-25T20:26:19.983090] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:26:20.103450] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:20.182794] [DEBUG] [LOCAL ] NWG: Loaded 51589 existing records from primary storage. [2025-09-25T20:26:20.182977] [INFO ] [MAIN ] NWG: Loaded 51589 existing records. [2025-09-25T20:26:20.371582] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:20.371948] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-25T20:26:20.372001] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-25T20:26:20.372377] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-25T20:26:20.372437] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-25T20:26:20.694784] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-25T20:26:20.882983] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:21.053487] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T20:26:21.488822] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-25T20:26:21.663541] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T20:26:22.294144] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-25T20:26:22.328314] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:26:23.088829] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-25T20:26:23.440727] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:26:23.888815] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-25T20:26:24.288260] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T20:26:24.688759] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-25T20:26:24.854090] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:26:25.488726] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-25T20:26:25.595302] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T20:26:26.129413] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T20:26:26.288741] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-25T20:26:27.088802] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-25T20:26:27.264315] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T20:26:27.888839] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-25T20:26:28.083677] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T20:26:28.093185] [INFO ] [REMOTE ] NVS: Full fetch complete (74763 records). [2025-09-25T20:26:28.093409] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-25T20:26:28.526746] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-25T20:26:28.526880] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-25T20:26:28.528510] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-25T20:26:28.528598] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-25T20:26:28.537143] [DEBUG] [LOCAL ] NVS: Trimmed 74763 records to 51965 (keeping 200 days of data) [2025-09-25T20:26:28.689878] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-25T20:26:28.937333] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T20:26:28.983356] [DEBUG] [LOCAL ] NVS: Primary data saved (51965 records). [2025-09-25T20:26:28.983537] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-25T20:26:28.983730] [INFO ] [MAIN ] Update Progress: 1554/2372 symbols completed. NVS took 33.1s. Estimated remaining: 1h 48m 40s. Rate: 7.5 symbols/min [2025-09-25T20:26:29.172335] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:29.216558] [DEBUG] [LOCAL ] NWN: Loaded 26910 existing records from primary storage. [2025-09-25T20:26:29.216750] [INFO ] [MAIN ] NWN: Loaded 26910 existing records. [2025-09-25T20:26:29.416238] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:29.417026] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-25T20:26:29.417090] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-25T20:26:29.417633] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-25T20:26:29.417726] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-25T20:26:29.492587] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-25T20:26:29.707624] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T20:26:29.878489] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:30.288713] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-25T20:26:30.506374] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T20:26:31.088735] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-25T20:26:31.255521] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T20:26:31.888774] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-25T20:26:31.930005] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T20:26:32.688814] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-25T20:26:32.794940] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T20:26:33.488838] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-25T20:26:34.012677] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T20:26:34.288743] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-25T20:26:34.439203] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T20:26:34.626754] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T20:26:35.088753] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-25T20:26:35.838932] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T20:26:35.888728] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-25T20:26:36.344705] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T20:26:36.688796] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-25T20:26:37.170174] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T20:26:37.183384] [INFO ] [REMOTE ] NVT: Full fetch complete (74532 records). [2025-09-25T20:26:37.183545] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-25T20:26:37.493935] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-25T20:26:37.673846] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-25T20:26:37.673967] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-25T20:26:37.675279] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-25T20:26:37.675361] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-25T20:26:37.677313] [DEBUG] [LOCAL ] NVT: Trimmed 74532 records to 51970 (keeping 200 days of data) [2025-09-25T20:26:38.042953] [DEBUG] [LOCAL ] NVT: Primary data saved (51970 records). [2025-09-25T20:26:38.043157] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-25T20:26:38.044846] [INFO ] [MAIN ] Update Progress: 1555/2372 symbols completed. NVT took 26.4s. Estimated remaining: 1h 48m 32s. Rate: 7.5 symbols/min [2025-09-25T20:26:38.245629] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:38.293308] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-25T20:26:38.333900] [DEBUG] [LOCAL ] NX: Loaded 33367 existing records from primary storage. [2025-09-25T20:26:38.334122] [INFO ] [MAIN ] NX: Loaded 33367 existing records. [2025-09-25T20:26:38.348702] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T20:26:38.542759] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:38.543135] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-25T20:26:38.543198] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-25T20:26:38.543626] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-25T20:26:38.543730] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-25T20:26:38.759841] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T20:26:38.976736] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:39.088718] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-25T20:26:39.888722] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-25T20:26:40.121636] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T20:26:40.139573] [INFO ] [REMOTE ] NVST: Full fetch complete (74034 records). [2025-09-25T20:26:40.139838] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-25T20:26:40.577424] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-25T20:26:40.577547] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-25T20:26:40.578788] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-25T20:26:40.578870] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-25T20:26:40.580928] [DEBUG] [LOCAL ] NVST: Trimmed 74034 records to 51987 (keeping 200 days of data) [2025-09-25T20:26:40.688853] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-25T20:26:40.961495] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:26:40.986072] [DEBUG] [LOCAL ] NVST: Primary data saved (51987 records). [2025-09-25T20:26:40.986238] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-25T20:26:40.989218] [INFO ] [MAIN ] Update Progress: 1556/2372 symbols completed. NVST took 29.8s. Estimated remaining: 1h 48m 22s. Rate: 7.5 symbols/min [2025-09-25T20:26:41.067695] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T20:26:41.221299] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:26:41.239081] [DEBUG] [LOCAL ] NXC: Loaded 4227 existing records from primary storage. [2025-09-25T20:26:41.239233] [INFO ] [MAIN ] NXC: Loaded 4227 existing records. [2025-09-25T20:26:41.435224] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:26:41.436130] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-25T20:26:41.436285] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-25T20:26:41.437598] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-25T20:26:41.437713] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-25T20:26:41.490162] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-25T20:26:41.842476] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:26:42.210565] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T20:26:42.288719] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-25T20:26:43.088703] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-25T20:26:43.455244] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T20:26:43.674111] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T20:26:43.888709] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-25T20:26:43.979693] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T20:26:44.688773] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-25T20:26:45.470698] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T20:26:45.488692] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-25T20:26:45.638201] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T20:26:45.858403] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-25T20:26:46.288766] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-25T20:26:47.088754] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-25T20:26:47.888760] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-25T20:26:48.071218] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T20:26:48.515613] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-25T20:26:48.528252] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:26:48.688729] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-25T20:26:49.335469] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:26:49.488756] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-25T20:26:50.289036] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-25T20:26:51.018693] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T20:26:51.048338] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:26:51.088695] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-25T20:26:51.768525] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T20:26:51.888766] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-25T20:26:52.688794] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-25T20:26:53.238430] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T20:26:53.344445] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T20:26:53.488777] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-25T20:26:54.289035] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-25T20:26:54.923355] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T20:26:55.088728] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-25T20:26:55.464568] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T20:26:55.888711] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-25T20:26:56.442112] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T20:26:56.688772] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-25T20:26:57.231144] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T20:26:57.488750] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-25T20:26:57.711970] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:26:58.160991] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T20:26:58.163246] [INFO ] [REMOTE ] NXC: Full fetch complete (6089 records). [2025-09-25T20:26:58.163372] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-25T20:26:58.295767] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-25T20:26:58.628884] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-25T20:26:58.628984] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-25T20:26:58.629209] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-25T20:26:58.629335] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-25T20:26:58.629903] [DEBUG] [LOCAL ] NXC: Trimmed 6089 records to 4285 (keeping 200 days of data) [2025-09-25T20:26:58.663320] [DEBUG] [LOCAL ] NXC: Primary data saved (4285 records). [2025-09-25T20:26:58.663539] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-25T20:26:58.663791] [INFO ] [MAIN ] Update Progress: 1557/2372 symbols completed. NXC took 17.7s. Estimated remaining: 1h 48m 19s. Rate: 7.5 symbols/min [2025-09-25T20:26:59.088823] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-25T20:26:59.781592] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T20:26:59.888698] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-25T20:27:00.628861] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T20:27:00.688719] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-25T20:27:01.159513] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T20:27:01.488725] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-25T20:27:02.147261] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T20:27:02.269136] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:27:02.275250] [INFO ] [REMOTE ] NWN: Full fetch complete (37136 records). [2025-09-25T20:27:02.275491] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-25T20:27:02.293703] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-25T20:27:02.719875] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-25T20:27:02.720003] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-25T20:27:02.721017] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-25T20:27:02.721091] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-25T20:27:02.722500] [DEBUG] [LOCAL ] NWN: Trimmed 37136 records to 27059 (keeping 200 days of data) [2025-09-25T20:27:02.929113] [DEBUG] [LOCAL ] NWN: Primary data saved (27059 records). [2025-09-25T20:27:02.929310] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-25T20:27:02.929502] [INFO ] [MAIN ] Update Progress: 1558/2372 symbols completed. NWN took 33.9s. Estimated remaining: 1h 48m 9s. Rate: 7.5 symbols/min [2025-09-25T20:27:03.088795] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-25T20:27:04.172514] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T20:27:04.188158] [INFO ] [REMOTE ] NWG: Full fetch complete (73150 records). [2025-09-25T20:27:04.188336] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-25T20:27:04.656215] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-25T20:27:04.656339] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-25T20:27:04.657668] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-25T20:27:04.657744] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-25T20:27:04.659935] [DEBUG] [LOCAL ] NWG: Trimmed 73150 records to 51950 (keeping 200 days of data) [2025-09-25T20:27:04.807026] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T20:27:04.828497] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-25T20:27:05.072384] [DEBUG] [LOCAL ] NWG: Primary data saved (51950 records). [2025-09-25T20:27:05.072557] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-25T20:27:05.072697] [INFO ] [MAIN ] Update Progress: 1559/2372 symbols completed. NWG took 45.2s. Estimated remaining: 1h 47m 58s. Rate: 7.5 symbols/min [2025-09-25T20:27:06.316843] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T20:27:06.326682] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-25T20:27:07.751159] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T20:27:07.761735] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-25T20:27:09.304617] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T20:27:09.316821] [INFO ] [REMOTE ] NX: Full fetch complete (48311 records). [2025-09-25T20:27:09.316974] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-25T20:27:09.771577] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-25T20:27:09.771715] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-25T20:27:09.773096] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-25T20:27:09.773161] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-25T20:27:09.775438] [DEBUG] [LOCAL ] NX: Trimmed 48311 records to 33642 (keeping 200 days of data) [2025-09-25T20:27:10.032861] [DEBUG] [LOCAL ] NX: Primary data saved (33642 records). [2025-09-25T20:27:10.033077] [INFO ] [MAIN ] NX: Full history saved. [2025-09-25T20:27:10.034529] [INFO ] [MAIN ] Update Progress: 1560/2372 symbols completed. NX took 32.0s. Estimated remaining: 1h 47m 48s. Rate: 7.5 symbols/min [2025-09-25T20:27:10.754417] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:10.817414] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:10.820382] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:10.820486] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-25T20:27:10.820523] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-25T20:27:10.820765] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-25T20:27:10.820838] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-25T20:27:10.820907] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-25T20:27:10.820974] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-25T20:27:10.768639] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:10.906062] [DEBUG] [LOCAL ] NXG: Loaded 10450 existing records from primary storage. [2025-09-25T20:27:10.906310] [INFO ] [MAIN ] NXG: Loaded 10450 existing records. [2025-09-25T20:27:10.949506] [DEBUG] [LOCAL ] NXDT: Loaded 16404 existing records from primary storage. [2025-09-25T20:27:10.955707] [INFO ] [MAIN ] NXDT: Loaded 16404 existing records. [2025-09-25T20:27:11.148827] [DEBUG] [LOCAL ] NXE: Loaded 52985 existing records from primary storage. [2025-09-25T20:27:11.149096] [INFO ] [MAIN ] NXE: Loaded 52985 existing records. [2025-09-25T20:27:11.736878] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:11.737204] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-25T20:27:11.737259] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-25T20:27:11.748440] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:11.748716] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-25T20:27:11.748776] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-25T20:27:11.749182] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-25T20:27:11.749246] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-25T20:27:11.754315] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-25T20:27:11.754402] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-25T20:27:11.957944] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:11.967555] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-25T20:27:11.967609] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-25T20:27:12.009263] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-25T20:27:12.009436] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-25T20:27:12.398137] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:12.403771] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-25T20:27:12.809262] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:12.832367] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-25T20:27:12.854401] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-25T20:27:13.075866] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:13.082082] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-25T20:27:13.137730] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:13.138150] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-25T20:27:13.153427] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:13.162080] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-25T20:27:13.162801] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-25T20:27:13.240196] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:13.240590] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-25T20:27:13.477421] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:13.478035] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-25T20:27:13.478668] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-25T20:27:13.730947] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:13.731438] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-25T20:27:13.731985] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-25T20:27:14.002507] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:14.003009] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-25T20:27:14.003518] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-25T20:27:14.015862] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T20:27:14.018725] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-25T20:27:14.279984] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:14.280759] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-25T20:27:14.284112] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T20:27:14.290041] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-25T20:27:14.558705] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:27:14.559274] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-25T20:27:14.648356] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T20:27:14.934450] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:27:15.088848] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-25T20:27:15.888752] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-25T20:27:16.272849] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T20:27:16.490616] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T20:27:16.688741] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-25T20:27:17.488759] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-25T20:27:18.288771] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-25T20:27:18.450343] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T20:27:19.088753] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-25T20:27:19.888745] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-25T20:27:21.063682] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-25T20:27:21.078618] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-25T20:27:21.587423] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T20:27:21.599840] [INFO ] [REMOTE ] NXDR: Full fetch complete (17298 records). [2025-09-25T20:27:21.599930] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-25T20:27:21.823935] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 48 unique days, need 200 days [2025-09-25T20:27:21.824765] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:27:21.824971] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:27:21.825034] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-25T20:27:21.825147] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-25T20:27:21.825207] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-25T20:27:21.825290] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-25T20:27:21.825391] [INFO ] [MAIN ] Update Progress: 1561/2372 symbols completed. NXDR took 11.8s. Estimated remaining: 1h 47m 42s. Rate: 7.5 symbols/min [2025-09-25T20:27:22.010014] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:22.039357] [DEBUG] [LOCAL ] NXJ: Loaded 14949 existing records from primary storage. [2025-09-25T20:27:22.039513] [INFO ] [MAIN ] NXJ: Loaded 14949 existing records. [2025-09-25T20:27:22.126042] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (4.64 seconds). [2025-09-25T20:27:22.130441] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-25T20:27:22.268987] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:22.269719] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-25T20:27:22.269888] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-25T20:27:22.270373] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-25T20:27:22.270439] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-25T20:27:22.381566] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (4.09 seconds). [2025-09-25T20:27:22.400168] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-25T20:27:22.718841] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:22.943335] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T20:27:23.088750] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-25T20:27:23.100681] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-25T20:27:23.390630] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T20:27:23.888793] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-25T20:27:24.191921] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T20:27:24.688818] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-25T20:27:24.804722] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T20:27:25.488788] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-25T20:27:25.585573] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T20:27:26.288722] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-25T20:27:26.686316] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T20:27:26.930040] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T20:27:27.088845] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-25T20:27:27.888750] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-25T20:27:28.004756] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T20:27:28.688749] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-25T20:27:29.488878] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-25T20:27:29.541996] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T20:27:29.829780] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T20:27:30.196160] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T20:27:30.288762] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-25T20:27:31.088788] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-25T20:27:31.142113] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:27:31.888843] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-25T20:27:32.136633] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T20:27:32.633458] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T20:27:32.688699] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-25T20:27:33.488721] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-25T20:27:33.710546] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T20:27:34.288791] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-25T20:27:35.088768] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-25T20:27:35.162743] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:27:35.165846] [INFO ] [REMOTE ] NXDT: Full fetch complete (25621 records). [2025-09-25T20:27:35.166027] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-25T20:27:35.451324] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T20:27:35.657592] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-25T20:27:35.657774] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-25T20:27:35.658732] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-25T20:27:35.658877] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-25T20:27:35.660479] [DEBUG] [LOCAL ] NXDT: Trimmed 25621 records to 16464 (keeping 200 days of data) [2025-09-25T20:27:35.780638] [DEBUG] [LOCAL ] NXDT: Primary data saved (16464 records). [2025-09-25T20:27:35.780833] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-25T20:27:35.781063] [INFO ] [MAIN ] Update Progress: 1562/2372 symbols completed. NXDT took 25.7s. Estimated remaining: 1h 47m 38s. Rate: 7.5 symbols/min [2025-09-25T20:27:35.889856] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-25T20:27:35.900917] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T20:27:36.003766] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:36.015398] [DEBUG] [LOCAL ] NXN: Loaded 2363 existing records from primary storage. [2025-09-25T20:27:36.015540] [INFO ] [MAIN ] NXN: Loaded 2363 existing records. [2025-09-25T20:27:36.200863] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:36.203359] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-25T20:27:36.203420] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-25T20:27:36.203736] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-25T20:27:36.203813] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-25T20:27:36.587906] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:36.688691] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-25T20:27:37.338239] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T20:27:37.488729] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-25T20:27:37.678242] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T20:27:38.001261] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T20:27:38.288769] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-25T20:27:39.088765] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-25T20:27:39.348754] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:27:39.624968] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T20:27:39.888749] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-25T20:27:40.432135] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-25T20:27:40.688748] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-25T20:27:41.488765] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-25T20:27:42.288709] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-25T20:27:42.444586] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T20:27:42.561838] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T20:27:42.642054] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-25T20:27:43.088760] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-25T20:27:43.600158] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T20:27:43.888701] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-25T20:27:44.511076] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T20:27:44.688746] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-25T20:27:45.488742] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-25T20:27:46.288772] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-25T20:27:46.386787] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:27:46.715031] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T20:27:47.088733] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-25T20:27:47.182722] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:27:47.888752] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-25T20:27:48.004070] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T20:27:48.007748] [INFO ] [REMOTE ] NXG: Full fetch complete (14332 records). [2025-09-25T20:27:48.007835] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-25T20:27:48.407756] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-25T20:27:48.407870] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-25T20:27:48.408454] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-25T20:27:48.408496] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-25T20:27:48.409126] [DEBUG] [LOCAL ] NXG: Trimmed 14332 records to 10539 (keeping 200 days of data) [2025-09-25T20:27:48.498147] [DEBUG] [LOCAL ] NXG: Primary data saved (10539 records). [2025-09-25T20:27:48.498382] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-25T20:27:48.498539] [INFO ] [MAIN ] Update Progress: 1563/2372 symbols completed. NXG took 38.5s. Estimated remaining: 1h 47m 32s. Rate: 7.5 symbols/min [2025-09-25T20:27:48.695741] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-25T20:27:48.729693] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:48.750762] [DEBUG] [LOCAL ] NXP: Loaded 12326 existing records from primary storage. [2025-09-25T20:27:48.750925] [INFO ] [MAIN ] NXP: Loaded 12326 existing records. [2025-09-25T20:27:48.952445] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:48.952928] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-25T20:27:48.953002] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-25T20:27:48.953360] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-25T20:27:48.953435] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-25T20:27:49.017745] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:27:49.318727] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T20:27:49.392739] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:49.488698] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-25T20:27:50.029743] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T20:27:50.288738] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-25T20:27:50.867114] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T20:27:50.868178] [INFO ] [REMOTE ] NXN: Full fetch complete (3681 records). [2025-09-25T20:27:50.868249] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-25T20:27:51.088883] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-25T20:27:51.282366] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-25T20:27:51.282506] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-25T20:27:51.282679] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-25T20:27:51.282742] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-25T20:27:51.283239] [DEBUG] [LOCAL ] NXN: Trimmed 3681 records to 2368 (keeping 200 days of data) [2025-09-25T20:27:51.299550] [DEBUG] [LOCAL ] NXN: Primary data saved (2368 records). [2025-09-25T20:27:51.299710] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-25T20:27:51.299837] [INFO ] [MAIN ] Update Progress: 1564/2372 symbols completed. NXN took 15.5s. Estimated remaining: 1h 47m 21s. Rate: 7.5 symbols/min [2025-09-25T20:27:51.499919] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:51.534796] [DEBUG] [LOCAL ] NXRT: Loaded 19042 existing records from primary storage. [2025-09-25T20:27:51.534979] [INFO ] [MAIN ] NXRT: Loaded 19042 existing records. [2025-09-25T20:27:51.727348] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:51.727756] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-25T20:27:51.727817] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-25T20:27:51.728189] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-25T20:27:51.728250] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-25T20:27:51.889158] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-25T20:27:52.120227] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:52.688776] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-25T20:27:52.774737] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T20:27:52.982770] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T20:27:53.488744] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-25T20:27:53.778534] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T20:27:54.288712] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-25T20:27:54.403373] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:27:55.088863] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-25T20:27:55.888705] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-25T20:27:55.978348] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T20:27:55.982011] [INFO ] [REMOTE ] NXJ: Full fetch complete (20966 records). [2025-09-25T20:27:55.982098] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-25T20:27:56.383042] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-25T20:27:56.430082] [INFO ] [REMOTE ] NXE: Full fetch complete (76645 records). [2025-09-25T20:27:56.430283] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-25T20:27:56.561467] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T20:27:56.565506] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-25T20:27:56.565605] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-25T20:27:56.566289] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-25T20:27:56.566378] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-25T20:27:56.567287] [DEBUG] [LOCAL ] NXJ: Trimmed 20966 records to 15011 (keeping 200 days of data) [2025-09-25T20:27:56.693738] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-25T20:27:56.829823] [DEBUG] [LOCAL ] NXJ: Primary data saved (15011 records). [2025-09-25T20:27:56.830111] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-25T20:27:56.830249] [INFO ] [MAIN ] Update Progress: 1565/2372 symbols completed. NXJ took 35.0s. Estimated remaining: 1h 47m 12s. Rate: 7.5 symbols/min [2025-09-25T20:27:57.262353] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:57.262552] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-25T20:27:57.262590] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-25T20:27:57.262805] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-25T20:27:57.262848] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-25T20:27:57.262896] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-25T20:27:57.262929] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-25T20:27:57.393413] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-25T20:27:57.393512] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-25T20:27:57.394770] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-25T20:27:57.394855] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-25T20:27:57.418168] [DEBUG] [LOCAL ] NXE: Trimmed 76645 records to 53375 (keeping 200 days of data) [2025-09-25T20:27:57.497774] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-25T20:27:57.655984] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T20:27:58.016555] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:58.118028] [DEBUG] [LOCAL ] NXE: Primary data saved (53375 records). [2025-09-25T20:27:58.118268] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-25T20:27:58.118502] [INFO ] [MAIN ] Update Progress: 1566/2372 symbols completed. NXE took 48.1s. Estimated remaining: 1h 47m 1s. Rate: 7.5 symbols/min [2025-09-25T20:27:58.294731] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-25T20:27:58.297465] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:27:58.365362] [DEBUG] [LOCAL ] NYT: Loaded 49899 existing records from primary storage. [2025-09-25T20:27:58.365543] [INFO ] [MAIN ] NYT: Loaded 49899 existing records. [2025-09-25T20:27:58.501301] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T20:27:58.606714] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:27:58.607095] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-25T20:27:58.607188] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-25T20:27:58.608671] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-25T20:27:58.613749] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-25T20:27:58.838244] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T20:27:59.027594] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:27:59.088707] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-25T20:27:59.888772] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-25T20:28:00.688763] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-25T20:28:00.851173] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T20:28:00.924224] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T20:28:01.061446] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-25T20:28:01.488779] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-25T20:28:02.288691] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-25T20:28:02.498899] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T20:28:03.088767] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-25T20:28:03.601338] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T20:28:03.883839] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T20:28:03.893975] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-25T20:28:04.688702] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-25T20:28:04.853677] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T20:28:05.488788] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-25T20:28:05.546622] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T20:28:05.991511] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T20:28:06.288814] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-25T20:28:06.786847] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T20:28:07.088786] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-25T20:28:07.888777] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-25T20:28:08.197383] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T20:28:08.688711] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-25T20:28:09.488728] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-25T20:28:09.618049] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T20:28:09.653522] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T20:28:10.288745] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-25T20:28:10.631340] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T20:28:11.088774] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-25T20:28:11.888738] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-25T20:28:12.042376] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T20:28:12.152601] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:28:12.297530] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T20:28:12.688746] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-25T20:28:13.400471] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T20:28:13.488743] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-25T20:28:14.288732] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-25T20:28:14.498246] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T20:28:15.088745] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-25T20:28:15.888715] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-25T20:28:16.059258] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:28:16.082525] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T20:28:16.399988] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T20:28:16.688754] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-25T20:28:17.096589] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-25T20:28:17.488743] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-25T20:28:18.288737] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-25T20:28:18.393022] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:28:19.088710] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-25T20:28:19.439131] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T20:28:19.888829] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-25T20:28:20.688709] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-25T20:28:20.739599] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T20:28:20.743610] [INFO ] [REMOTE ] NXP: Full fetch complete (16710 records). [2025-09-25T20:28:20.743759] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-25T20:28:20.888324] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T20:28:21.099033] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-25T20:28:21.214470] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-25T20:28:21.214580] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-25T20:28:21.215074] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-25T20:28:21.215192] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-25T20:28:21.216141] [DEBUG] [LOCAL ] NXP: Trimmed 16710 records to 12391 (keeping 200 days of data) [2025-09-25T20:28:21.311295] [DEBUG] [LOCAL ] NXP: Primary data saved (12391 records). [2025-09-25T20:28:21.311462] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-25T20:28:21.311675] [INFO ] [MAIN ] Update Progress: 1567/2372 symbols completed. NXP took 32.8s. Estimated remaining: 1h 47m 1s. Rate: 7.5 symbols/min [2025-09-25T20:28:21.498902] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-25T20:28:21.542262] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:21.610931] [DEBUG] [LOCAL ] NZF: Loaded 29014 existing records from primary storage. [2025-09-25T20:28:21.611093] [INFO ] [MAIN ] NZF: Loaded 29014 existing records. [2025-09-25T20:28:21.802364] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:28:21.805821] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-25T20:28:21.805913] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-25T20:28:21.806426] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-25T20:28:21.808931] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-25T20:28:22.182956] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:22.288862] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-25T20:28:22.637000] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T20:28:22.642024] [INFO ] [REMOTE ] NXRT: Full fetch complete (25202 records). [2025-09-25T20:28:22.642115] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-25T20:28:23.092730] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-25T20:28:23.092634] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-25T20:28:23.093987] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-25T20:28:23.094761] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-25T20:28:23.094823] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-25T20:28:23.097258] [DEBUG] [LOCAL ] NXRT: Trimmed 25202 records to 19162 (keeping 200 days of data) [2025-09-25T20:28:23.243312] [DEBUG] [LOCAL ] NXRT: Primary data saved (19162 records). [2025-09-25T20:28:23.243531] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-25T20:28:23.243681] [INFO ] [MAIN ] Update Progress: 1568/2372 symbols completed. NXRT took 31.9s. Estimated remaining: 1h 46m 50s. Rate: 7.5 symbols/min [2025-09-25T20:28:23.426947] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:23.427203] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-25T20:28:23.427260] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-25T20:28:23.427509] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-25T20:28:23.427549] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-25T20:28:23.427590] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-25T20:28:23.427622] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-25T20:28:23.562370] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T20:28:23.610800] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-25T20:28:23.612510] [INFO ] [REMOTE ] NYC: Full fetch complete (1918 records). [2025-09-25T20:28:23.612762] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-25T20:28:23.893853] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-25T20:28:24.118877] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:24.135624] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-25T20:28:24.135908] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:28:24.135955] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:28:24.135997] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-25T20:28:24.136072] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-25T20:28:24.136112] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-25T20:28:24.136192] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-25T20:28:24.136320] [INFO ] [MAIN ] Update Progress: 1569/2372 symbols completed. NYC took 27.3s. Estimated remaining: 1h 46m 38s. Rate: 7.5 symbols/min [2025-09-25T20:28:24.323235] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:24.424470] [DEBUG] [LOCAL ] OBDC: Loaded 51654 existing records from primary storage. [2025-09-25T20:28:24.424696] [INFO ] [MAIN ] OBDC: Loaded 51654 existing records. [2025-09-25T20:28:24.608838] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:28:24.609267] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-25T20:28:24.609318] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-25T20:28:24.609737] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-25T20:28:24.609800] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-25T20:28:24.693837] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-25T20:28:24.998953] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:25.225534] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T20:28:25.488767] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-25T20:28:26.066279] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T20:28:26.288752] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-25T20:28:26.818785] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:28:27.088740] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-25T20:28:27.888746] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-25T20:28:28.504788] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T20:28:28.688714] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-25T20:28:29.062221] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-25T20:28:29.400308] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T20:28:29.488719] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-25T20:28:30.163339] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T20:28:30.288773] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-25T20:28:31.088709] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-25T20:28:31.308543] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:28:31.434163] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T20:28:31.888795] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-25T20:28:32.688759] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-25T20:28:33.271339] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T20:28:33.488876] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-25T20:28:33.765161] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-25T20:28:34.288799] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-25T20:28:34.434045] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T20:28:34.445570] [INFO ] [REMOTE ] NYT: Full fetch complete (72068 records). [2025-09-25T20:28:34.445821] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-25T20:28:34.863898] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-25T20:28:34.864035] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-25T20:28:34.865806] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-25T20:28:34.865939] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-25T20:28:34.868136] [DEBUG] [LOCAL ] NYT: Trimmed 72068 records to 50259 (keeping 200 days of data) [2025-09-25T20:28:35.094037] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-25T20:28:35.265903] [DEBUG] [LOCAL ] NYT: Primary data saved (50259 records). [2025-09-25T20:28:35.266155] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-25T20:28:35.267575] [INFO ] [MAIN ] Update Progress: 1570/2372 symbols completed. NYT took 37.1s. Estimated remaining: 1h 46m 32s. Rate: 7.5 symbols/min [2025-09-25T20:28:35.399119] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T20:28:35.526421] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:35.526700] [DEBUG] [LOCAL ] OBK: No existing data file found in primary storage. [2025-09-25T20:28:35.526757] [WARN ] [MAIN ] OBK: No existing data found, performing full refresh instead. [2025-09-25T20:28:35.526898] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-25T20:28:35.526936] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-25T20:28:35.526977] [DEBUG] [LOCAL ] OBK: No primary data file found to delete. [2025-09-25T20:28:35.527022] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-25T20:28:35.892784] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-25T20:28:35.898387] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:36.331841] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T20:28:36.462359] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-25T20:28:36.688736] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-25T20:28:37.488758] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-25T20:28:37.805071] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T20:28:37.845489] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T20:28:38.288825] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-25T20:28:39.088882] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-25T20:28:39.618067] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:28:39.626531] [INFO ] [REMOTE ] NZF: Full fetch complete (43653 records). [2025-09-25T20:28:39.626706] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-25T20:28:39.859180] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-25T20:28:39.899735] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-25T20:28:40.166567] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-25T20:28:40.166741] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-25T20:28:40.168215] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-25T20:28:40.168298] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-25T20:28:40.170935] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T20:28:40.175776] [DEBUG] [LOCAL ] NZF: Trimmed 43653 records to 29224 (keeping 200 days of data) [2025-09-25T20:28:40.409380] [DEBUG] [LOCAL ] NZF: Primary data saved (29224 records). [2025-09-25T20:28:40.409555] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-25T20:28:40.409691] [INFO ] [MAIN ] Update Progress: 1571/2372 symbols completed. NZF took 19.1s. Estimated remaining: 1h 46m 22s. Rate: 7.5 symbols/min [2025-09-25T20:28:40.597283] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:40.677190] [DEBUG] [LOCAL ] OC: Loaded 44705 existing records from primary storage. [2025-09-25T20:28:40.677369] [INFO ] [MAIN ] OC: Loaded 44705 existing records. [2025-09-25T20:28:40.693249] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-25T20:28:40.881749] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:28:40.882318] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-25T20:28:40.882487] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-25T20:28:40.882914] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-25T20:28:40.882975] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-25T20:28:41.269810] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:41.493903] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-25T20:28:41.512403] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:28:42.288764] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-25T20:28:42.608973] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:28:43.012195] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-25T20:28:43.088745] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-25T20:28:43.743458] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T20:28:43.888752] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-25T20:28:44.108789] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T20:28:44.688758] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-25T20:28:44.991194] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T20:28:45.488805] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-25T20:28:46.288703] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-25T20:28:46.598371] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T20:28:46.638073] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T20:28:47.088736] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-25T20:28:47.892123] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-25T20:28:48.047403] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T20:28:48.121921] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T20:28:48.688739] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-25T20:28:49.488709] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-25T20:28:49.714700] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T20:28:50.288742] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-25T20:28:50.696995] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.80 seconds). [2025-09-25T20:28:51.088696] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-25T20:28:51.198113] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T20:28:51.888728] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-25T20:28:52.111707] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T20:28:52.688743] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-25T20:28:53.488720] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-25T20:28:53.562945] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:28:53.686552] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-25T20:28:53.724912] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T20:28:54.288743] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-25T20:28:54.980976] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T20:28:55.003259] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T20:28:55.088734] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-25T20:28:55.888795] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-25T20:28:56.688711] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-25T20:28:56.885280] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T20:28:57.488741] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-25T20:28:57.739391] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T20:28:57.744888] [INFO ] [REMOTE ] OBK: Full fetch complete (24025 records). [2025-09-25T20:28:57.745034] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-25T20:28:58.182436] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-25T20:28:58.182568] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-25T20:28:58.183245] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-25T20:28:58.183313] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-25T20:28:58.184325] [DEBUG] [LOCAL ] OBK: Trimmed 24025 records to 16432 (keeping 200 days of data) [2025-09-25T20:28:58.288818] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-25T20:28:58.312825] [DEBUG] [LOCAL ] OBK: Primary data saved (16432 records). [2025-09-25T20:28:58.313009] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-25T20:28:58.313164] [INFO ] [MAIN ] Update Progress: 1572/2372 symbols completed. OBK took 23.0s. Estimated remaining: 1h 46m 19s. Rate: 7.5 symbols/min [2025-09-25T20:28:58.497251] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-25T20:28:58.595843] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:28:58.608888] [DEBUG] [LOCAL ] OCFT: Loaded 8892 existing records from primary storage. [2025-09-25T20:28:58.609069] [INFO ] [MAIN ] OCFT: Loaded 8892 existing records. [2025-09-25T20:28:58.796541] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:28:58.797607] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-25T20:28:58.797702] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-25T20:28:58.797975] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-25T20:28:58.798055] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-25T20:28:59.094953] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-25T20:28:59.184480] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:28:59.531931] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T20:28:59.888737] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-25T20:29:00.034255] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T20:29:00.533298] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T20:29:00.688808] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-25T20:29:01.488742] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-25T20:29:01.621524] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-25T20:29:02.052767] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T20:29:02.288732] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-25T20:29:02.842911] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-25T20:29:03.088761] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-25T20:29:03.357775] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T20:29:03.888857] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-25T20:29:04.688838] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-25T20:29:04.768330] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T20:29:05.488785] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-25T20:29:05.609268] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T20:29:05.729467] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T20:29:05.746080] [INFO ] [REMOTE ] OBDC: Full fetch complete (74881 records). [2025-09-25T20:29:05.746310] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-25T20:29:06.179912] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-25T20:29:06.180015] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-25T20:29:06.181170] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-25T20:29:06.181282] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-25T20:29:06.186427] [DEBUG] [LOCAL ] OBDC: Trimmed 74881 records to 52042 (keeping 200 days of data) [2025-09-25T20:29:06.294202] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-25T20:29:06.563440] [DEBUG] [LOCAL ] OBDC: Primary data saved (52042 records). [2025-09-25T20:29:06.563737] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-25T20:29:06.566404] [INFO ] [MAIN ] Update Progress: 1573/2372 symbols completed. OBDC took 42.4s. Estimated remaining: 1h 46m 11s. Rate: 7.5 symbols/min [2025-09-25T20:29:06.773444] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:06.794290] [DEBUG] [LOCAL ] ODC: Loaded 8547 existing records from primary storage. [2025-09-25T20:29:06.794443] [INFO ] [MAIN ] ODC: Loaded 8547 existing records. [2025-09-25T20:29:06.989340] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:06.989993] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-25T20:29:06.990047] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-25T20:29:06.990483] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-25T20:29:06.990553] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-25T20:29:07.094739] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-25T20:29:07.414901] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:07.432986] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T20:29:07.888735] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-25T20:29:08.040955] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-25T20:29:08.055529] [INFO ] [REMOTE ] O: Full fetch complete (77558 records). [2025-09-25T20:29:08.055755] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-25T20:29:08.268327] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:29:08.269387] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:29:08.269517] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:29:08.269664] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-25T20:29:08.269761] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-25T20:29:08.269812] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-25T20:29:08.270470] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-25T20:29:08.270625] [INFO ] [MAIN ] Update Progress: 1574/2372 symbols completed. O took 45.0s. Estimated remaining: 1h 46m 0s. Rate: 7.5 symbols/min [2025-09-25T20:29:08.471530] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:08.504121] [DEBUG] [LOCAL ] ODV: Loaded 25728 existing records from primary storage. [2025-09-25T20:29:08.504317] [INFO ] [MAIN ] ODV: Loaded 25728 existing records. [2025-09-25T20:29:08.690129] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T20:29:08.704728] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-25T20:29:08.750190] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:08.750573] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-25T20:29:08.750634] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-25T20:29:08.756678] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-25T20:29:08.756837] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-25T20:29:08.785435] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T20:29:09.178480] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:09.466749] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T20:29:09.488676] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-25T20:29:10.205286] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T20:29:10.288755] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-25T20:29:11.088744] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-25T20:29:11.220249] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T20:29:11.833554] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-25T20:29:11.888807] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-25T20:29:12.655052] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T20:29:12.688739] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-25T20:29:13.488784] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-25T20:29:13.579538] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T20:29:14.288748] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-25T20:29:14.477786] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T20:29:15.070990] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T20:29:15.088675] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-25T20:29:15.734754] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T20:29:15.738824] [INFO ] [REMOTE ] OCFT: Full fetch complete (11829 records). [2025-09-25T20:29:15.738944] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-25T20:29:15.893856] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-25T20:29:16.166010] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-25T20:29:16.166121] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-25T20:29:16.166451] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-25T20:29:16.166512] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-25T20:29:16.167094] [DEBUG] [LOCAL ] OCFT: Trimmed 11829 records to 8902 (keeping 200 days of data) [2025-09-25T20:29:16.227507] [DEBUG] [LOCAL ] OCFT: Primary data saved (8902 records). [2025-09-25T20:29:16.227679] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-25T20:29:16.227883] [INFO ] [MAIN ] Update Progress: 1575/2372 symbols completed. OCFT took 17.9s. Estimated remaining: 1h 45m 52s. Rate: 7.5 symbols/min [2025-09-25T20:29:16.500053] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:16.572587] [DEBUG] [LOCAL ] OEC: Loaded 37158 existing records from primary storage. [2025-09-25T20:29:16.574774] [INFO ] [MAIN ] OEC: Loaded 37158 existing records. [2025-09-25T20:29:16.631454] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T20:29:16.693884] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-25T20:29:16.779031] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:16.780618] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-25T20:29:16.780711] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-25T20:29:16.781024] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-25T20:29:16.781087] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-25T20:29:17.156896] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:17.490089] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-25T20:29:18.288723] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-25T20:29:18.361717] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T20:29:18.410802] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T20:29:19.088694] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-25T20:29:19.136196] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T20:29:19.888714] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-25T20:29:20.034672] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T20:29:20.688758] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-25T20:29:21.241785] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T20:29:21.488821] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-25T20:29:22.288754] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-25T20:29:22.361863] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T20:29:22.372161] [INFO ] [REMOTE ] OC: Full fetch complete (64119 records). [2025-09-25T20:29:22.372399] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-25T20:29:22.847408] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-25T20:29:22.847556] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-25T20:29:22.849255] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-25T20:29:22.849325] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-25T20:29:22.851388] [DEBUG] [LOCAL ] OC: Trimmed 64119 records to 45024 (keeping 200 days of data) [2025-09-25T20:29:23.021890] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T20:29:23.127534] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-25T20:29:23.259707] [DEBUG] [LOCAL ] OC: Primary data saved (45024 records). [2025-09-25T20:29:23.259927] [INFO ] [MAIN ] OC: Full history saved. [2025-09-25T20:29:23.261708] [INFO ] [MAIN ] Update Progress: 1576/2372 symbols completed. OC took 42.9s. Estimated remaining: 1h 45m 44s. Rate: 7.5 symbols/min [2025-09-25T20:29:23.485676] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T20:29:23.493913] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:23.527042] [DEBUG] [LOCAL ] OFG: Loaded 22099 existing records from primary storage. [2025-09-25T20:29:23.527211] [INFO ] [MAIN ] OFG: Loaded 22099 existing records. [2025-09-25T20:29:23.720906] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:23.721207] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-25T20:29:23.721271] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-25T20:29:23.721635] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-25T20:29:23.721808] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-25T20:29:23.893803] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-25T20:29:24.132385] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:24.565032] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:29:24.688745] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-25T20:29:25.049350] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T20:29:25.488736] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-25T20:29:26.183349] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T20:29:26.288695] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-25T20:29:26.602738] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T20:29:27.088734] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-25T20:29:27.460018] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T20:29:27.888745] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-25T20:29:28.419573] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:29:28.688697] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-25T20:29:28.698736] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T20:29:29.488748] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-25T20:29:30.050869] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:29:30.288818] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-25T20:29:30.313554] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T20:29:31.088717] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-25T20:29:31.508572] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T20:29:31.740023] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-25T20:29:31.888729] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-25T20:29:32.688743] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-25T20:29:33.430629] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T20:29:33.488686] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-25T20:29:33.988779] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T20:29:34.288783] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-25T20:29:34.349146] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:29:35.088735] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-25T20:29:35.523002] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T20:29:35.661359] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T20:29:35.888868] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-25T20:29:36.688739] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-25T20:29:37.433984] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T20:29:37.488741] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-25T20:29:38.034763] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T20:29:38.288749] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-25T20:29:38.702856] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T20:29:39.088773] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-25T20:29:39.164501] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T20:29:39.167850] [INFO ] [REMOTE ] ODC: Full fetch complete (10955 records). [2025-09-25T20:29:39.167943] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-25T20:29:39.549930] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-25T20:29:39.550021] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-25T20:29:39.550350] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-25T20:29:39.550442] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-25T20:29:39.551512] [DEBUG] [LOCAL ] ODC: Trimmed 10955 records to 8582 (keeping 200 days of data) [2025-09-25T20:29:39.611344] [DEBUG] [LOCAL ] ODC: Primary data saved (8582 records). [2025-09-25T20:29:39.611533] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-25T20:29:39.611824] [INFO ] [MAIN ] Update Progress: 1577/2372 symbols completed. ODC took 33.0s. Estimated remaining: 1h 45m 40s. Rate: 7.5 symbols/min [2025-09-25T20:29:39.806707] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:39.806948] [DEBUG] [LOCAL ] OGE: No existing data file found in primary storage. [2025-09-25T20:29:39.807004] [WARN ] [MAIN ] OGE: No existing data found, performing full refresh instead. [2025-09-25T20:29:39.808111] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-25T20:29:39.808186] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-25T20:29:39.808238] [DEBUG] [LOCAL ] OGE: No primary data file found to delete. [2025-09-25T20:29:39.808277] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-25T20:29:39.893287] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-25T20:29:40.195447] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:40.688743] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-25T20:29:40.807563] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:29:40.815882] [INFO ] [REMOTE ] ODV: Full fetch complete (32091 records). [2025-09-25T20:29:40.816055] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-25T20:29:41.129151] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T20:29:41.284404] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T20:29:41.316526] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-25T20:29:41.316626] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-25T20:29:41.318336] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-25T20:29:41.318452] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-25T20:29:41.319515] [DEBUG] [LOCAL ] ODV: Trimmed 32091 records to 25988 (keeping 200 days of data) [2025-09-25T20:29:41.488689] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-25T20:29:41.492510] [DEBUG] [LOCAL ] ODV: Primary data saved (25988 records). [2025-09-25T20:29:41.492586] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-25T20:29:41.492721] [INFO ] [MAIN ] Update Progress: 1578/2372 symbols completed. ODV took 33.2s. Estimated remaining: 1h 45m 29s. Rate: 7.5 symbols/min [2025-09-25T20:29:41.679334] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:41.762334] [DEBUG] [LOCAL ] OGN: Loaded 53116 existing records from primary storage. [2025-09-25T20:29:41.762498] [INFO ] [MAIN ] OGN: Loaded 53116 existing records. [2025-09-25T20:29:41.965598] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:41.966048] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-25T20:29:41.966139] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-25T20:29:41.966738] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-25T20:29:41.966821] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-25T20:29:42.295561] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-25T20:29:42.343596] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:43.088740] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-25T20:29:43.160564] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T20:29:43.208408] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T20:29:43.888940] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-25T20:29:44.522000] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T20:29:44.535925] [INFO ] [REMOTE ] OEC: Full fetch complete (52631 records). [2025-09-25T20:29:44.536163] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-25T20:29:44.693853] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-25T20:29:45.022910] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-25T20:29:45.023034] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-25T20:29:45.024392] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-25T20:29:45.024479] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-25T20:29:45.026158] [DEBUG] [LOCAL ] OEC: Trimmed 52631 records to 37431 (keeping 200 days of data) [2025-09-25T20:29:45.285932] [DEBUG] [LOCAL ] OEC: Primary data saved (37431 records). [2025-09-25T20:29:45.286107] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-25T20:29:45.286334] [INFO ] [MAIN ] Update Progress: 1579/2372 symbols completed. OEC took 29.1s. Estimated remaining: 1h 45m 19s. Rate: 7.5 symbols/min [2025-09-25T20:29:45.470071] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:45.488841] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-25T20:29:45.523699] [DEBUG] [LOCAL ] OGS: Loaded 33933 existing records from primary storage. [2025-09-25T20:29:45.523965] [INFO ] [MAIN ] OGS: Loaded 33933 existing records. [2025-09-25T20:29:45.721720] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:45.722214] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-25T20:29:45.722272] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-25T20:29:45.722631] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-25T20:29:45.722721] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-25T20:29:45.857798] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T20:29:46.189032] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:46.288746] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-25T20:29:46.338698] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T20:29:46.626618] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T20:29:47.088842] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-25T20:29:47.610371] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T20:29:47.888770] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-25T20:29:48.688708] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-25T20:29:48.719075] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T20:29:48.783806] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T20:29:49.488897] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-25T20:29:50.164544] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:29:50.288777] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-25T20:29:50.560306] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T20:29:51.088764] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-25T20:29:51.888743] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-25T20:29:52.038988] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T20:29:52.090962] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T20:29:52.097860] [INFO ] [REMOTE ] OFG: Full fetch complete (34461 records). [2025-09-25T20:29:52.097984] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-25T20:29:52.504593] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-25T20:29:52.504745] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-25T20:29:52.505526] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-25T20:29:52.505598] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-25T20:29:52.506766] [DEBUG] [LOCAL ] OFG: Trimmed 34461 records to 22255 (keeping 200 days of data) [2025-09-25T20:29:52.680549] [DEBUG] [LOCAL ] OFG: Primary data saved (22255 records). [2025-09-25T20:29:52.680882] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-25T20:29:52.681034] [INFO ] [MAIN ] Update Progress: 1580/2372 symbols completed. OFG took 29.4s. Estimated remaining: 1h 45m 11s. Rate: 7.5 symbols/min [2025-09-25T20:29:52.689681] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-25T20:29:52.867552] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:29:52.941057] [DEBUG] [LOCAL ] OHI: Loaded 52100 existing records from primary storage. [2025-09-25T20:29:52.941257] [INFO ] [MAIN ] OHI: Loaded 52100 existing records. [2025-09-25T20:29:53.132437] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:29:53.132989] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-25T20:29:53.133069] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-25T20:29:53.133479] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-25T20:29:53.134087] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-25T20:29:53.488756] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-25T20:29:53.520583] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:29:53.607574] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T20:29:54.288731] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-25T20:29:54.564753] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T20:29:54.900731] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T20:29:55.088757] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-25T20:29:55.795610] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T20:29:55.888742] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-25T20:29:56.461686] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T20:29:56.688759] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-25T20:29:57.440869] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T20:29:57.488716] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-25T20:29:58.170426] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T20:29:58.288748] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-25T20:29:59.088761] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-25T20:29:59.327315] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T20:29:59.516365] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T20:29:59.888741] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-25T20:30:00.642739] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T20:30:00.688707] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-25T20:30:01.488787] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-25T20:30:01.607459] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T20:30:02.288806] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-25T20:30:02.577356] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T20:30:03.088742] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-25T20:30:03.300554] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T20:30:03.448798] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:30:03.888710] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-25T20:30:04.688698] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-25T20:30:04.889773] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T20:30:05.342628] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:30:05.488793] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-25T20:30:06.288730] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-25T20:30:06.587335] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T20:30:07.068810] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T20:30:07.088719] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-25T20:30:07.888698] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-25T20:30:08.084098] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T20:30:08.321230] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T20:30:08.329260] [INFO ] [REMOTE ] OGS: Full fetch complete (47946 records). [2025-09-25T20:30:08.329405] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-25T20:30:08.688930] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-25T20:30:08.749546] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-25T20:30:08.749695] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-25T20:30:08.750753] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-25T20:30:08.750824] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-25T20:30:08.754622] [DEBUG] [LOCAL ] OGS: Trimmed 47946 records to 34239 (keeping 200 days of data) [2025-09-25T20:30:08.984422] [DEBUG] [LOCAL ] OGS: Primary data saved (34239 records). [2025-09-25T20:30:08.984598] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-25T20:30:08.984751] [INFO ] [MAIN ] Update Progress: 1581/2372 symbols completed. OGS took 23.7s. Estimated remaining: 1h 45m 7s. Rate: 7.5 symbols/min [2025-09-25T20:30:09.167995] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:09.225537] [DEBUG] [LOCAL ] OI: Loaded 47344 existing records from primary storage. [2025-09-25T20:30:09.225742] [INFO ] [MAIN ] OI: Loaded 47344 existing records. [2025-09-25T20:30:09.421154] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:09.422355] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-25T20:30:09.422404] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-25T20:30:09.422758] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-25T20:30:09.422819] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-25T20:30:09.499009] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-25T20:30:09.833858] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T20:30:09.858299] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:10.288755] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-25T20:30:10.550996] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T20:30:11.088753] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-25T20:30:11.259350] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T20:30:11.888813] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-25T20:30:12.023738] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T20:30:12.688807] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-25T20:30:13.019662] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T20:30:13.488721] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-25T20:30:13.555286] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T20:30:14.288778] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-25T20:30:14.790085] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T20:30:15.088833] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-25T20:30:15.531310] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T20:30:15.598713] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T20:30:15.607997] [INFO ] [REMOTE ] OGE: Full fetch complete (66690 records). [2025-09-25T20:30:15.608196] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-25T20:30:15.896835] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-25T20:30:16.039694] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-25T20:30:16.039807] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-25T20:30:16.041052] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-25T20:30:16.041142] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-25T20:30:16.042810] [DEBUG] [LOCAL ] OGE: Trimmed 66690 records to 46726 (keeping 200 days of data) [2025-09-25T20:30:16.374474] [DEBUG] [LOCAL ] OGE: Primary data saved (46726 records). [2025-09-25T20:30:16.374662] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-25T20:30:16.374808] [INFO ] [MAIN ] Update Progress: 1582/2372 symbols completed. OGE took 36.8s. Estimated remaining: 1h 44m 59s. Rate: 7.5 symbols/min [2025-09-25T20:30:16.587788] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:16.611291] [DEBUG] [LOCAL ] OIA: Loaded 14019 existing records from primary storage. [2025-09-25T20:30:16.611461] [INFO ] [MAIN ] OIA: Loaded 14019 existing records. [2025-09-25T20:30:16.694716] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-25T20:30:16.846578] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:16.847534] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-25T20:30:16.847615] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-25T20:30:16.848069] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-25T20:30:16.848151] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-25T20:30:17.105051] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T20:30:17.316913] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:17.488741] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-25T20:30:17.761146] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T20:30:18.288695] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-25T20:30:18.478134] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:30:18.562974] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T20:30:19.088785] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-25T20:30:19.888736] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-25T20:30:20.003916] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:30:20.016091] [INFO ] [REMOTE ] OHI: Full fetch complete (75111 records). [2025-09-25T20:30:20.016362] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-25T20:30:20.453145] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-25T20:30:20.453256] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-25T20:30:20.454581] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-25T20:30:20.454693] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-25T20:30:20.456571] [DEBUG] [LOCAL ] OHI: Trimmed 75111 records to 52459 (keeping 200 days of data) [2025-09-25T20:30:20.706217] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-25T20:30:20.845665] [DEBUG] [LOCAL ] OHI: Primary data saved (52459 records). [2025-09-25T20:30:20.845883] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-25T20:30:20.848118] [INFO ] [MAIN ] Update Progress: 1583/2372 symbols completed. OHI took 28.2s. Estimated remaining: 1h 44m 49s. Rate: 7.5 symbols/min [2025-09-25T20:30:20.996120] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T20:30:21.028823] [INFO ] [REMOTE ] OGN: Full fetch complete (76813 records). [2025-09-25T20:30:21.029054] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-25T20:30:21.228796] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:21.372129] [DEBUG] [LOCAL ] OII: Loaded 42843 existing records from primary storage. [2025-09-25T20:30:21.372285] [INFO ] [MAIN ] OII: Loaded 42843 existing records. [2025-09-25T20:30:21.653999] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T20:30:21.769931] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-25T20:30:21.826787] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:30:21.879236] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:21.879794] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-25T20:30:21.879884] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-25T20:30:21.880639] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-25T20:30:21.880764] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-25T20:30:22.277061] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-25T20:30:22.277273] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-25T20:30:22.279699] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-25T20:30:22.288106] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-25T20:30:22.296136] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-25T20:30:22.347237] [DEBUG] [LOCAL ] OGN: Trimmed 76813 records to 53493 (keeping 200 days of data) [2025-09-25T20:30:22.924205] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:23.045012] [DEBUG] [LOCAL ] OGN: Primary data saved (53493 records). [2025-09-25T20:30:23.045353] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-25T20:30:23.045758] [INFO ] [MAIN ] Update Progress: 1584/2372 symbols completed. OGN took 41.6s. Estimated remaining: 1h 44m 38s. Rate: 7.5 symbols/min [2025-09-25T20:30:23.125542] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-25T20:30:23.256962] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:23.314000] [DEBUG] [LOCAL ] OIS: Loaded 40610 existing records from primary storage. [2025-09-25T20:30:23.314168] [INFO ] [MAIN ] OIS: Loaded 40610 existing records. [2025-09-25T20:30:23.396754] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T20:30:23.536245] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:23.537741] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-25T20:30:23.537801] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-25T20:30:23.538221] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-25T20:30:23.538451] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-25T20:30:23.676215] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T20:30:23.893796] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-25T20:30:23.973816] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:24.602243] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T20:30:24.688689] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-25T20:30:24.927914] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T20:30:25.488816] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-25T20:30:26.266120] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T20:30:26.288756] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-25T20:30:26.495955] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T20:30:27.088789] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-25T20:30:27.742921] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T20:30:27.888766] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-25T20:30:28.093504] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T20:30:28.688726] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-25T20:30:29.438404] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T20:30:29.488672] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-25T20:30:29.796300] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T20:30:30.288694] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-25T20:30:30.489960] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T20:30:31.088751] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-25T20:30:31.888775] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-25T20:30:32.069894] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T20:30:32.095130] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T20:30:32.688808] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-25T20:30:33.164241] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-25T20:30:33.488725] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-25T20:30:34.293918] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-25T20:30:34.312181] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T20:30:35.088746] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-25T20:30:35.257765] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T20:30:35.620044] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:30:35.888755] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-25T20:30:36.688714] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-25T20:30:36.794767] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T20:30:36.816059] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T20:30:37.488751] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-25T20:30:38.238938] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:30:38.288763] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-25T20:30:38.370353] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T20:30:39.088743] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-25T20:30:39.888637] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-25T20:30:40.086774] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T20:30:40.177296] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T20:30:40.688747] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-25T20:30:41.216821] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T20:30:41.488740] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-25T20:30:42.289447] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-25T20:30:42.296339] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T20:30:43.031213] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-25T20:30:43.088748] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-25T20:30:43.589387] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T20:30:43.888767] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-25T20:30:44.545143] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T20:30:44.688738] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-25T20:30:45.360278] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T20:30:45.488776] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-25T20:30:46.288734] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-25T20:30:46.476212] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T20:30:46.561613] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T20:30:47.088740] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-25T20:30:47.274066] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T20:30:47.279069] [INFO ] [REMOTE ] OIA: Full fetch complete (21291 records). [2025-09-25T20:30:47.279176] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-25T20:30:47.712808] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-25T20:30:47.712937] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-25T20:30:47.713522] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-25T20:30:47.713589] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-25T20:30:47.714563] [DEBUG] [LOCAL ] OIA: Trimmed 21291 records to 14159 (keeping 200 days of data) [2025-09-25T20:30:47.808026] [DEBUG] [LOCAL ] OIA: Primary data saved (14159 records). [2025-09-25T20:30:47.808205] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-25T20:30:47.808421] [INFO ] [MAIN ] Update Progress: 1585/2372 symbols completed. OIA took 31.4s. Estimated remaining: 1h 44m 39s. Rate: 7.5 symbols/min [2025-09-25T20:30:47.897699] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-25T20:30:48.013548] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:48.108945] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-25T20:30:48.109115] [INFO ] [MAIN ] OKE: Loaded 53536 existing records. [2025-09-25T20:30:48.307934] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:48.311214] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-25T20:30:48.316743] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-25T20:30:48.317224] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-25T20:30:48.317305] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-25T20:30:48.681930] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T20:30:48.702335] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-25T20:30:48.729267] [INFO ] [REMOTE ] OI: Full fetch complete (68236 records). [2025-09-25T20:30:48.729479] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-25T20:30:48.817957] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:49.239321] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-25T20:30:49.239430] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-25T20:30:49.240620] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-25T20:30:49.240715] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-25T20:30:49.242334] [DEBUG] [LOCAL ] OI: Trimmed 68236 records to 47657 (keeping 200 days of data) [2025-09-25T20:30:49.494600] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-25T20:30:49.626970] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T20:30:49.648435] [DEBUG] [LOCAL ] OI: Primary data saved (47657 records). [2025-09-25T20:30:49.648679] [INFO ] [MAIN ] OI: Full history saved. [2025-09-25T20:30:49.648908] [INFO ] [MAIN ] Update Progress: 1586/2372 symbols completed. OI took 40.7s. Estimated remaining: 1h 44m 27s. Rate: 7.5 symbols/min [2025-09-25T20:30:49.769151] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T20:30:49.804083] [INFO ] [REMOTE ] OIS: Full fetch complete (57041 records). [2025-09-25T20:30:49.804273] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-25T20:30:49.921426] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:49.921610] [DEBUG] [LOCAL ] OKLO: No existing data file found in primary storage. [2025-09-25T20:30:49.921672] [WARN ] [MAIN ] OKLO: No existing data found, performing full refresh instead. [2025-09-25T20:30:49.921902] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-25T20:30:49.921976] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-25T20:30:49.922057] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-25T20:30:49.922127] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-25T20:30:50.295998] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-25T20:30:50.665874] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-25T20:30:50.666002] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-25T20:30:50.667233] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-25T20:30:50.667318] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-25T20:30:50.677166] [DEBUG] [LOCAL ] OIS: Trimmed 57041 records to 40891 (keeping 200 days of data) [2025-09-25T20:30:50.918322] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:51.080879] [DEBUG] [LOCAL ] OIS: Primary data saved (40891 records). [2025-09-25T20:30:51.081038] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-25T20:30:51.081168] [INFO ] [MAIN ] Update Progress: 1587/2372 symbols completed. OIS took 28.0s. Estimated remaining: 1h 44m 16s. Rate: 7.5 symbols/min [2025-09-25T20:30:51.118740] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-25T20:30:51.305311] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:51.362145] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T20:30:51.434348] [DEBUG] [LOCAL ] OLN: Loaded 51739 existing records from primary storage. [2025-09-25T20:30:51.434549] [INFO ] [MAIN ] OLN: Loaded 51739 existing records. [2025-09-25T20:30:51.657246] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:51.657898] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-25T20:30:51.657958] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-25T20:30:51.658669] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-25T20:30:51.658744] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-25T20:30:51.891238] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-25T20:30:51.955060] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T20:30:51.975756] [INFO ] [REMOTE ] OII: Full fetch complete (62067 records). [2025-09-25T20:30:51.976053] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-25T20:30:52.357447] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:52.602951] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-25T20:30:52.603082] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-25T20:30:52.604245] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-25T20:30:52.604326] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-25T20:30:52.606588] [DEBUG] [LOCAL ] OII: Trimmed 62067 records to 43123 (keeping 200 days of data) [2025-09-25T20:30:52.707430] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-25T20:30:52.944617] [DEBUG] [LOCAL ] OII: Primary data saved (43123 records). [2025-09-25T20:30:52.944862] [INFO ] [MAIN ] OII: Full history saved. [2025-09-25T20:30:52.945064] [INFO ] [MAIN ] Update Progress: 1588/2372 symbols completed. OII took 32.1s. Estimated remaining: 1h 44m 5s. Rate: 7.5 symbols/min [2025-09-25T20:30:53.128637] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:30:53.146106] [DEBUG] [LOCAL ] OLP: Loaded 9752 existing records from primary storage. [2025-09-25T20:30:53.146291] [INFO ] [MAIN ] OLP: Loaded 9752 existing records. [2025-09-25T20:30:53.339331] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:30:53.339774] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-25T20:30:53.339856] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-25T20:30:53.340159] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-25T20:30:53.340217] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-25T20:30:53.732138] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-25T20:30:53.743752] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-25T20:30:53.807925] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:30:53.961639] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T20:30:54.288739] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-25T20:30:54.391601] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T20:30:55.088702] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-25T20:30:55.170097] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T20:30:55.888796] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-25T20:30:56.041380] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.30 seconds). [2025-09-25T20:30:56.618882] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T20:30:56.688747] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-25T20:30:57.210152] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T20:30:57.488810] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-25T20:30:58.288839] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-25T20:30:59.088694] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-25T20:30:59.165878] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T20:30:59.268894] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T20:30:59.401402] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-25T20:30:59.888777] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-25T20:31:00.688787] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-25T20:31:01.193330] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T20:31:01.488761] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-25T20:31:01.582718] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T20:31:02.119386] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-25T20:31:02.288734] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-25T20:31:03.088870] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-25T20:31:03.494187] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T20:31:03.888832] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-25T20:31:04.446249] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-25T20:31:04.688728] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-25T20:31:05.486050] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-25T20:31:05.499874] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-25T20:31:05.512292] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T20:31:05.815311] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T20:31:06.288730] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-25T20:31:07.088745] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-25T20:31:07.175990] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T20:31:07.554078] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T20:31:07.888725] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-25T20:31:08.688708] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-25T20:31:08.833547] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T20:31:09.488697] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-25T20:31:10.009138] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.92 seconds). [2025-09-25T20:31:10.288722] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-25T20:31:10.377978] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:31:10.652293] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T20:31:11.088758] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-25T20:31:11.888720] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-25T20:31:11.946938] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:31:12.058911] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T20:31:12.688739] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-25T20:31:13.488700] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-25T20:31:13.551495] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:31:13.849732] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T20:31:14.288740] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-25T20:31:15.088706] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-25T20:31:15.188451] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:31:15.193703] [INFO ] [REMOTE ] OLP: Full fetch complete (14059 records). [2025-09-25T20:31:15.193842] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-25T20:31:15.394995] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T20:31:15.709692] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-25T20:31:15.709808] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-25T20:31:15.710188] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-25T20:31:15.710252] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-25T20:31:15.710965] [DEBUG] [LOCAL ] OLP: Trimmed 14059 records to 9853 (keeping 200 days of data) [2025-09-25T20:31:15.789293] [DEBUG] [LOCAL ] OLP: Primary data saved (9853 records). [2025-09-25T20:31:15.789473] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-25T20:31:15.789704] [INFO ] [MAIN ] Update Progress: 1589/2372 symbols completed. OLP took 22.8s. Estimated remaining: 1h 44m 5s. Rate: 7.5 symbols/min [2025-09-25T20:31:15.893816] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-25T20:31:16.009235] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:16.089846] [DEBUG] [LOCAL ] OMC: Loaded 53292 existing records from primary storage. [2025-09-25T20:31:16.090037] [INFO ] [MAIN ] OMC: Loaded 53292 existing records. [2025-09-25T20:31:16.293959] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:16.294591] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-25T20:31:16.294677] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-25T20:31:16.295079] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-25T20:31:16.295161] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-25T20:31:16.697779] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-25T20:31:16.707216] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:17.437281] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-25T20:31:17.488717] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-25T20:31:18.288759] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-25T20:31:18.540023] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.65 seconds). [2025-09-25T20:31:18.722556] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-25T20:31:19.088751] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-25T20:31:19.322345] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T20:31:19.888692] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-25T20:31:20.011812] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:31:20.023594] [INFO ] [REMOTE ] OKE: Full fetch complete (77485 records). [2025-09-25T20:31:20.023779] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-25T20:31:20.431514] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-25T20:31:20.431617] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-25T20:31:20.432897] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-25T20:31:20.432968] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-25T20:31:20.434591] [DEBUG] [LOCAL ] OKE: Trimmed 77485 records to 53926 (keeping 200 days of data) [2025-09-25T20:31:20.691532] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-25T20:31:20.826472] [DEBUG] [LOCAL ] OKE: Primary data saved (53926 records). [2025-09-25T20:31:20.826692] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-25T20:31:20.829101] [INFO ] [MAIN ] Update Progress: 1590/2372 symbols completed. OKE took 33.0s. Estimated remaining: 1h 43m 55s. Rate: 7.5 symbols/min [2025-09-25T20:31:20.953577] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T20:31:21.073582] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:21.135819] [DEBUG] [LOCAL ] OMF: Loaded 46213 existing records from primary storage. [2025-09-25T20:31:21.135998] [INFO ] [MAIN ] OMF: Loaded 46213 existing records. [2025-09-25T20:31:21.367349] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:21.369399] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-25T20:31:21.369453] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-25T20:31:21.369852] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-25T20:31:21.369949] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-25T20:31:21.489780] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-25T20:31:21.655301] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T20:31:21.823491] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:22.288839] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-25T20:31:23.088767] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-25T20:31:23.427907] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-25T20:31:23.455423] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T20:31:23.472014] [INFO ] [REMOTE ] OLN: Full fetch complete (74573 records). [2025-09-25T20:31:23.472236] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-25T20:31:23.706737] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T20:31:23.897739] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-25T20:31:24.022888] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-25T20:31:24.022989] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-25T20:31:24.024230] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-25T20:31:24.024348] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-25T20:31:24.026696] [DEBUG] [LOCAL ] OLN: Trimmed 74573 records to 52126 (keeping 200 days of data) [2025-09-25T20:31:24.384488] [DEBUG] [LOCAL ] OLN: Primary data saved (52126 records). [2025-09-25T20:31:24.385001] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-25T20:31:24.385212] [INFO ] [MAIN ] Update Progress: 1591/2372 symbols completed. OLN took 33.3s. Estimated remaining: 1h 43m 45s. Rate: 7.5 symbols/min [2025-09-25T20:31:24.603174] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:24.649405] [DEBUG] [LOCAL ] OMI: Loaded 45840 existing records from primary storage. [2025-09-25T20:31:24.649585] [INFO ] [MAIN ] OMI: Loaded 45840 existing records. [2025-09-25T20:31:24.711685] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-25T20:31:24.886606] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:24.887154] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-25T20:31:24.887261] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-25T20:31:24.888208] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-25T20:31:24.888315] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-25T20:31:25.050423] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T20:31:25.311903] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:25.488733] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-25T20:31:26.288712] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-25T20:31:26.513273] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-25T20:31:26.666244] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:31:26.724487] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T20:31:27.088779] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-25T20:31:27.888792] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-25T20:31:27.978608] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T20:31:28.673074] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:31:28.689707] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-25T20:31:28.692980] [INFO ] [REMOTE ] OKLO: Full fetch complete (77603 records). [2025-09-25T20:31:28.693084] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-25T20:31:28.694531] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:31:28.695901] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:31:28.696027] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:31:28.696139] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-25T20:31:28.696273] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-25T20:31:28.696344] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-25T20:31:28.696484] [DEBUG] [LOCAL ] OKLO: No derivative data file found to delete. [2025-09-25T20:31:28.696635] [INFO ] [MAIN ] Update Progress: 1592/2372 symbols completed. OKLO took 39.0s. Estimated remaining: 1h 43m 35s. Rate: 7.5 symbols/min [2025-09-25T20:31:28.899374] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:28.919064] [DEBUG] [LOCAL ] ONIT: Loaded 7800 existing records from primary storage. [2025-09-25T20:31:28.919272] [INFO ] [MAIN ] ONIT: Loaded 7800 existing records. [2025-09-25T20:31:29.163509] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T20:31:29.172706] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:29.176630] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-25T20:31:29.176712] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-25T20:31:29.176995] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-25T20:31:29.177053] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-25T20:31:29.494052] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-25T20:31:29.590071] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:30.119494] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T20:31:30.288786] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-25T20:31:31.088706] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-25T20:31:31.131496] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T20:31:31.155599] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T20:31:31.888862] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-25T20:31:32.688720] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-25T20:31:32.732969] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T20:31:32.881431] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T20:31:33.488804] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-25T20:31:34.288800] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-25T20:31:34.365138] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T20:31:34.445118] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T20:31:35.088727] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-25T20:31:35.888725] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-25T20:31:36.160152] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:31:36.465764] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-25T20:31:36.688758] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-25T20:31:36.896407] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T20:31:37.488764] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-25T20:31:38.288701] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-25T20:31:38.420081] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T20:31:38.432854] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:31:39.088721] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-25T20:31:39.888728] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-25T20:31:40.033743] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T20:31:40.688733] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-25T20:31:41.088629] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T20:31:41.201627] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T20:31:41.488700] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-25T20:31:41.749306] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T20:31:42.288748] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-25T20:31:43.088738] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-25T20:31:43.124686] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T20:31:43.292614] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T20:31:43.888735] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-25T20:31:44.461580] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T20:31:44.688746] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-25T20:31:44.836622] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T20:31:45.488757] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-25T20:31:45.585384] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:31:46.288741] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-25T20:31:47.045421] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T20:31:47.047487] [INFO ] [REMOTE ] ONIT: Full fetch complete (11206 records). [2025-09-25T20:31:47.047577] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-25T20:31:47.101962] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-25T20:31:47.130240] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T20:31:47.488418] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-25T20:31:47.488529] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-25T20:31:47.488848] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-25T20:31:47.488914] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-25T20:31:47.489482] [DEBUG] [LOCAL ] ONIT: Trimmed 11206 records to 7831 (keeping 200 days of data) [2025-09-25T20:31:47.539482] [DEBUG] [LOCAL ] ONIT: Primary data saved (7831 records). [2025-09-25T20:31:47.539663] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-25T20:31:47.539797] [INFO ] [MAIN ] Update Progress: 1593/2372 symbols completed. ONIT took 18.8s. Estimated remaining: 1h 43m 33s. Rate: 7.5 symbols/min [2025-09-25T20:31:47.722029] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:47.776100] [DEBUG] [LOCAL ] ONL: Loaded 31583 existing records from primary storage. [2025-09-25T20:31:47.776345] [INFO ] [MAIN ] ONL: Loaded 31583 existing records. [2025-09-25T20:31:47.893790] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-25T20:31:48.061961] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:48.062600] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-25T20:31:48.062706] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-25T20:31:48.063081] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-25T20:31:48.063142] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-25T20:31:48.458488] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:48.688699] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-25T20:31:48.937015] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T20:31:48.948233] [INFO ] [REMOTE ] OMC: Full fetch complete (76906 records). [2025-09-25T20:31:48.948436] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-25T20:31:49.105077] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T20:31:49.420917] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-25T20:31:49.421024] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-25T20:31:49.423073] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-25T20:31:49.423150] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-25T20:31:49.424964] [DEBUG] [LOCAL ] OMC: Trimmed 76906 records to 53680 (keeping 200 days of data) [2025-09-25T20:31:49.499553] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-25T20:31:49.809888] [DEBUG] [LOCAL ] OMC: Primary data saved (53680 records). [2025-09-25T20:31:49.810059] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-25T20:31:49.812578] [INFO ] [MAIN ] Update Progress: 1594/2372 symbols completed. OMC took 34.0s. Estimated remaining: 1h 43m 22s. Rate: 7.5 symbols/min [2025-09-25T20:31:50.008159] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:50.098021] [DEBUG] [LOCAL ] ONON: Loaded 53612 existing records from primary storage. [2025-09-25T20:31:50.098197] [INFO ] [MAIN ] ONON: Loaded 53612 existing records. [2025-09-25T20:31:50.107001] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T20:31:50.296076] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-25T20:31:50.303274] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:50.303539] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-25T20:31:50.303585] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-25T20:31:50.303951] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-25T20:31:50.304021] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-25T20:31:50.683726] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:51.094086] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-25T20:31:51.111101] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T20:31:51.552548] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T20:31:51.659806] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T20:31:51.888743] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-25T20:31:52.688748] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-25T20:31:53.152369] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T20:31:53.488752] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-25T20:31:54.216330] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T20:31:54.227599] [INFO ] [REMOTE ] OMI: Full fetch complete (63948 records). [2025-09-25T20:31:54.228756] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-25T20:31:54.288792] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-25T20:31:54.643485] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-25T20:31:54.643585] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-25T20:31:54.644623] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-25T20:31:54.644712] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-25T20:31:54.646307] [DEBUG] [LOCAL ] OMI: Trimmed 63948 records to 46205 (keeping 200 days of data) [2025-09-25T20:31:54.946471] [DEBUG] [LOCAL ] OMI: Primary data saved (46205 records). [2025-09-25T20:31:54.946794] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-25T20:31:54.946916] [INFO ] [MAIN ] Update Progress: 1595/2372 symbols completed. OMI took 30.6s. Estimated remaining: 1h 43m 13s. Rate: 7.5 symbols/min [2025-09-25T20:31:55.096566] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-25T20:31:55.133594] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:31:55.166380] [DEBUG] [LOCAL ] ONTF: Loaded 22934 existing records from primary storage. [2025-09-25T20:31:55.166561] [INFO ] [MAIN ] ONTF: Loaded 22934 existing records. [2025-09-25T20:31:55.268724] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T20:31:55.400615] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:31:55.401234] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-25T20:31:55.401283] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-25T20:31:55.401749] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-25T20:31:55.401808] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-25T20:31:55.781603] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:31:55.895003] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-25T20:31:55.918444] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:31:56.688743] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-25T20:31:57.032262] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T20:31:57.179779] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T20:31:57.488756] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-25T20:31:58.259030] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T20:31:58.288736] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-25T20:31:58.632977] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T20:31:59.088760] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-25T20:31:59.888903] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-25T20:32:00.073428] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T20:32:00.688776] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-25T20:32:00.885060] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-25T20:32:01.492068] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-25T20:32:01.512924] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T20:32:01.914773] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T20:32:02.288738] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-25T20:32:03.088768] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-25T20:32:03.411457] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T20:32:03.865888] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T20:32:03.888714] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-25T20:32:04.332217] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T20:32:04.688791] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-25T20:32:05.264864] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T20:32:05.395015] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T20:32:05.488776] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-25T20:32:06.288825] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-25T20:32:07.089198] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-25T20:32:07.806026] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-25T20:32:07.836476] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T20:32:07.888728] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-25T20:32:08.001722] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T20:32:08.688762] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-25T20:32:08.871247] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T20:32:09.488766] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-25T20:32:09.917147] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T20:32:10.288848] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-25T20:32:10.727634] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T20:32:10.735685] [INFO ] [REMOTE ] ONL: Full fetch complete (43520 records). [2025-09-25T20:32:10.735859] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-25T20:32:11.090106] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-25T20:32:11.197083] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-25T20:32:11.197258] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-25T20:32:11.198239] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-25T20:32:11.198470] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-25T20:32:11.199725] [DEBUG] [LOCAL ] ONL: Trimmed 43520 records to 31704 (keeping 200 days of data) [2025-09-25T20:32:11.445753] [DEBUG] [LOCAL ] ONL: Primary data saved (31704 records). [2025-09-25T20:32:11.445915] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-25T20:32:11.446145] [INFO ] [MAIN ] Update Progress: 1596/2372 symbols completed. ONL took 23.9s. Estimated remaining: 1h 43m 9s. Rate: 7.5 symbols/min [2025-09-25T20:32:11.515108] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T20:32:11.673407] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:11.728135] [DEBUG] [LOCAL ] ONTO: Loaded 46659 existing records from primary storage. [2025-09-25T20:32:11.728313] [INFO ] [MAIN ] ONTO: Loaded 46659 existing records. [2025-09-25T20:32:11.896750] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-25T20:32:11.927475] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:11.929003] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-25T20:32:11.929078] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-25T20:32:11.929882] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-25T20:32:11.929968] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-25T20:32:12.316453] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:12.688722] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-25T20:32:12.718854] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T20:32:12.727418] [INFO ] [REMOTE ] OMF: Full fetch complete (66700 records). [2025-09-25T20:32:12.727618] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-25T20:32:13.154573] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-25T20:32:13.154704] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-25T20:32:13.155884] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-25T20:32:13.155954] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-25T20:32:13.157470] [DEBUG] [LOCAL ] OMF: Trimmed 66700 records to 46577 (keeping 200 days of data) [2025-09-25T20:32:13.476341] [DEBUG] [LOCAL ] OMF: Primary data saved (46577 records). [2025-09-25T20:32:13.476566] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-25T20:32:13.478296] [INFO ] [MAIN ] Update Progress: 1597/2372 symbols completed. OMF took 52.6s. Estimated remaining: 1h 42m 58s. Rate: 7.5 symbols/min [2025-09-25T20:32:13.488738] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-25T20:32:13.866753] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T20:32:14.174263] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-25T20:32:14.288726] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-25T20:32:15.088751] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-25T20:32:15.208096] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T20:32:15.888745] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-25T20:32:16.134409] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T20:32:16.162607] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T20:32:16.170941] [INFO ] [REMOTE ] ONTF: Full fetch complete (31736 records). [2025-09-25T20:32:16.171087] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-25T20:32:16.632454] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-25T20:32:16.632566] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-25T20:32:16.633464] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-25T20:32:16.633531] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-25T20:32:16.634574] [DEBUG] [LOCAL ] ONTF: Trimmed 31736 records to 23075 (keeping 200 days of data) [2025-09-25T20:32:16.697727] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-25T20:32:16.778215] [DEBUG] [LOCAL ] ONTF: Primary data saved (23075 records). [2025-09-25T20:32:16.778371] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-25T20:32:16.778501] [INFO ] [MAIN ] Update Progress: 1598/2372 symbols completed. ONTF took 21.8s. Estimated remaining: 1h 42m 48s. Rate: 7.5 symbols/min [2025-09-25T20:32:17.616338] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T20:32:17.625829] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-25T20:32:18.545951] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T20:32:18.557774] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-25T20:32:18.951543] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:32:19.088727] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-25T20:32:20.659272] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T20:32:20.678269] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-25T20:32:20.841099] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T20:32:20.851465] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-25T20:32:22.621692] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:32:22.634422] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-25T20:32:22.852904] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-25T20:32:22.871874] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-25T20:32:24.612199] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T20:32:24.623526] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-25T20:32:24.968972] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T20:32:24.983446] [INFO ] [REMOTE ] ONON: Full fetch complete (77564 records). [2025-09-25T20:32:24.983614] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-25T20:32:25.425859] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-25T20:32:25.425957] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-25T20:32:25.427132] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-25T20:32:25.427203] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-25T20:32:25.429781] [DEBUG] [LOCAL ] ONON: Trimmed 77564 records to 54002 (keeping 200 days of data) [2025-09-25T20:32:25.777055] [DEBUG] [LOCAL ] ONON: Primary data saved (54002 records). [2025-09-25T20:32:25.777218] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-25T20:32:25.779812] [INFO ] [MAIN ] Update Progress: 1599/2372 symbols completed. ONON took 36.0s. Estimated remaining: 1h 42m 40s. Rate: 7.5 symbols/min [2025-09-25T20:32:26.458333] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T20:32:26.468428] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-25T20:32:28.246155] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T20:32:28.260583] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-25T20:32:30.203856] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T20:32:30.215687] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-25T20:32:31.834688] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T20:32:31.848349] [INFO ] [REMOTE ] ONTO: Full fetch complete (65691 records). [2025-09-25T20:32:31.848577] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-25T20:32:32.294365] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-25T20:32:32.294503] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-25T20:32:32.295896] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-25T20:32:32.296051] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-25T20:32:32.299717] [DEBUG] [LOCAL ] ONTO: Trimmed 65691 records to 46992 (keeping 200 days of data) [2025-09-25T20:32:32.611748] [DEBUG] [LOCAL ] ONTO: Primary data saved (46992 records). [2025-09-25T20:32:32.611945] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-25T20:32:32.612128] [INFO ] [MAIN ] Update Progress: 1600/2372 symbols completed. ONTO took 21.2s. Estimated remaining: 1h 42m 32s. Rate: 7.5 symbols/min [2025-09-25T20:32:33.294823] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:33.327261] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:33.327560] [DEBUG] [LOCAL ] OPP: No existing data file found in primary storage. [2025-09-25T20:32:33.327617] [WARN ] [MAIN ] OPP: No existing data found, performing full refresh instead. [2025-09-25T20:32:33.347134] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-25T20:32:33.347199] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-25T20:32:33.347248] [DEBUG] [LOCAL ] OPP: No primary data file found to delete. [2025-09-25T20:32:33.347318] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-25T20:32:33.356819] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:33.531668] [DEBUG] [LOCAL ] OPAD: Loaded 20033 existing records from primary storage. [2025-09-25T20:32:33.531856] [INFO ] [MAIN ] OPAD: Loaded 20033 existing records. [2025-09-25T20:32:33.548687] [DEBUG] [LOCAL ] OPFI: Loaded 46589 existing records from primary storage. [2025-09-25T20:32:33.562522] [INFO ] [MAIN ] OPFI: Loaded 46589 existing records. [2025-09-25T20:32:33.583750] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:33.739807] [DEBUG] [LOCAL ] OOMA: Loaded 19065 existing records from primary storage. [2025-09-25T20:32:33.744242] [INFO ] [MAIN ] OOMA: Loaded 19065 existing records. [2025-09-25T20:32:34.237175] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:34.237576] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-25T20:32:34.237661] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-25T20:32:34.238160] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-25T20:32:34.238222] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-25T20:32:34.333897] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:34.334184] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-25T20:32:34.334232] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-25T20:32:34.366457] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-25T20:32:34.375427] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-25T20:32:34.678938] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:34.679235] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-25T20:32:34.679284] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-25T20:32:34.679547] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-25T20:32:34.679608] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-25T20:32:35.122137] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:35.122610] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-25T20:32:35.502331] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:35.502797] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-25T20:32:35.868196] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:35.868745] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-25T20:32:35.955444] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:35.955839] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-25T20:32:36.333927] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T20:32:36.338696] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-25T20:32:36.486351] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T20:32:36.490334] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-25T20:32:36.956226] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T20:32:36.962338] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-25T20:32:37.025695] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T20:32:37.029613] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-25T20:32:37.323436] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-25T20:32:37.325753] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-25T20:32:37.435863] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T20:32:37.444952] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-25T20:32:37.910993] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T20:32:37.914307] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-25T20:32:37.955756] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-25T20:32:37.959257] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-25T20:32:37.987681] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T20:32:37.989545] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-25T20:32:38.666254] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T20:32:38.669053] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-25T20:32:38.790626] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T20:32:38.795916] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-25T20:32:38.819540] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T20:32:38.823190] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-25T20:32:39.180749] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T20:32:39.183566] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-25T20:32:39.494540] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T20:32:39.848233] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T20:32:39.888774] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-25T20:32:39.889092] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T20:32:39.939128] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T20:32:40.688795] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-25T20:32:40.882894] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T20:32:41.488726] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-25T20:32:41.838878] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T20:32:41.997202] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T20:32:42.288726] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-25T20:32:43.088741] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-25T20:32:43.352421] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:32:43.888742] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-25T20:32:43.949103] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T20:32:44.688723] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-25T20:32:44.973473] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T20:32:45.488761] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-25T20:32:46.068033] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T20:32:46.288686] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-25T20:32:46.529371] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T20:32:47.088774] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-25T20:32:47.888756] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-25T20:32:48.206293] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T20:32:48.262473] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-25T20:32:48.688729] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-25T20:32:48.766583] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T20:32:49.488837] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-25T20:32:49.821562] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T20:32:49.828573] [INFO ] [REMOTE ] OOMA: Full fetch complete (26263 records). [2025-09-25T20:32:49.828880] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-25T20:32:50.294750] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-25T20:32:50.412974] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-25T20:32:50.413112] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-25T20:32:50.414202] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-25T20:32:50.414279] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-25T20:32:50.415681] [DEBUG] [LOCAL ] OOMA: Trimmed 26263 records to 19157 (keeping 200 days of data) [2025-09-25T20:32:50.567282] [DEBUG] [LOCAL ] OOMA: Primary data saved (19157 records). [2025-09-25T20:32:50.567518] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-25T20:32:50.567700] [INFO ] [MAIN ] Update Progress: 1601/2372 symbols completed. OOMA took 17.9s. Estimated remaining: 1h 42m 29s. Rate: 7.5 symbols/min [2025-09-25T20:32:50.761366] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:50.761671] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-25T20:32:50.761731] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-25T20:32:50.762223] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-25T20:32:50.762281] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-25T20:32:50.762351] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-25T20:32:50.762414] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-25T20:32:51.093814] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-25T20:32:51.165605] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:51.192394] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:32:51.404364] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T20:32:51.888732] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-25T20:32:52.460283] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T20:32:52.688733] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-25T20:32:53.088704] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-25T20:32:53.292748] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T20:32:53.488734] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-25T20:32:54.288740] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-25T20:32:54.998394] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T20:32:55.088740] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-25T20:32:55.846889] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-25T20:32:55.857441] [INFO ] [REMOTE ] OPAD: Full fetch complete (23525 records). [2025-09-25T20:32:55.862590] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T20:32:55.864751] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-25T20:32:55.897690] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-25T20:32:56.271681] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-25T20:32:56.271784] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-25T20:32:56.272357] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-25T20:32:56.272403] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-25T20:32:56.273347] [DEBUG] [LOCAL ] OPAD: Trimmed 23525 records to 20422 (keeping 200 days of data) [2025-09-25T20:32:56.406354] [DEBUG] [LOCAL ] OPAD: Primary data saved (20422 records). [2025-09-25T20:32:56.406505] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-25T20:32:56.406614] [INFO ] [MAIN ] Update Progress: 1602/2372 symbols completed. OPAD took 23.8s. Estimated remaining: 1h 42m 20s. Rate: 7.5 symbols/min [2025-09-25T20:32:56.594126] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:56.656432] [DEBUG] [LOCAL ] OR: Loaded 46062 existing records from primary storage. [2025-09-25T20:32:56.656601] [INFO ] [MAIN ] OR: Loaded 46062 existing records. [2025-09-25T20:32:56.697706] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-25T20:32:56.865697] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:56.866138] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-25T20:32:56.866226] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-25T20:32:56.866577] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-25T20:32:56.866670] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-25T20:32:56.940003] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:32:56.947449] [INFO ] [REMOTE ] OPP: Full fetch complete (17546 records). [2025-09-25T20:32:56.947600] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-25T20:32:57.493814] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-25T20:32:57.675006] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T20:32:57.694756] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:57.748205] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-25T20:32:57.748362] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-25T20:32:57.748805] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-25T20:32:57.748869] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-25T20:32:57.749569] [DEBUG] [LOCAL ] OPP: Trimmed 17546 records to 11630 (keeping 200 days of data) [2025-09-25T20:32:57.830183] [DEBUG] [LOCAL ] OPP: Primary data saved (11630 records). [2025-09-25T20:32:57.830330] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-25T20:32:57.830413] [INFO ] [MAIN ] Update Progress: 1603/2372 symbols completed. OPP took 25.2s. Estimated remaining: 1h 42m 8s. Rate: 7.5 symbols/min [2025-09-25T20:32:58.007942] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:32:58.055420] [DEBUG] [LOCAL ] ORA: Loaded 32542 existing records from primary storage. [2025-09-25T20:32:58.055766] [INFO ] [MAIN ] ORA: Loaded 32542 existing records. [2025-09-25T20:32:58.292762] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-25T20:32:58.297099] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:32:58.297539] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-25T20:32:58.297589] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-25T20:32:58.297942] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-25T20:32:58.298003] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-25T20:32:58.675838] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:32:59.088712] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-25T20:32:59.186039] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T20:32:59.208915] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T20:32:59.888813] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-25T20:33:00.688791] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-25T20:33:00.777696] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:33:00.794380] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T20:33:01.488831] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-25T20:33:02.288723] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-25T20:33:02.637376] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T20:33:03.095565] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-25T20:33:03.099305] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T20:33:03.123874] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T20:33:03.888780] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-25T20:33:04.674540] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T20:33:04.688673] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-25T20:33:04.945836] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T20:33:05.488781] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-25T20:33:05.561617] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:33:05.565576] [INFO ] [REMOTE ] OPY: Full fetch complete (10040 records). [2025-09-25T20:33:05.565713] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-25T20:33:05.798634] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:33:05.799194] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:33:05.799366] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:33:05.799502] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-25T20:33:05.799718] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-25T20:33:05.799794] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-25T20:33:05.799865] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-25T20:33:05.800095] [INFO ] [MAIN ] Update Progress: 1604/2372 symbols completed. OPY took 15.2s. Estimated remaining: 1h 42m 0s. Rate: 7.5 symbols/min [2025-09-25T20:33:05.992571] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:06.100626] [DEBUG] [LOCAL ] ORC: Loaded 52315 existing records from primary storage. [2025-09-25T20:33:06.101556] [INFO ] [MAIN ] ORC: Loaded 52315 existing records. [2025-09-25T20:33:06.289778] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-25T20:33:06.310130] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:33:06.310405] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-25T20:33:06.310467] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-25T20:33:06.311047] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-25T20:33:06.311112] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-25T20:33:06.716049] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:07.088845] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-25T20:33:07.336158] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T20:33:07.658868] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T20:33:07.888723] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-25T20:33:08.688757] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-25T20:33:09.099198] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T20:33:09.395521] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T20:33:09.488783] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-25T20:33:10.294769] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-25T20:33:10.311800] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T20:33:11.088738] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-25T20:33:11.355515] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T20:33:11.735304] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T20:33:11.888835] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-25T20:33:12.688726] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-25T20:33:13.025067] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T20:33:13.174414] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:33:13.185608] [INFO ] [REMOTE ] OPFI: Full fetch complete (67564 records). [2025-09-25T20:33:13.185859] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-25T20:33:13.496800] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-25T20:33:13.705243] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-25T20:33:13.705391] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-25T20:33:13.707630] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-25T20:33:13.708012] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-25T20:33:13.713062] [DEBUG] [LOCAL ] OPFI: Trimmed 67564 records to 46918 (keeping 200 days of data) [2025-09-25T20:33:14.043127] [DEBUG] [LOCAL ] OPFI: Primary data saved (46918 records). [2025-09-25T20:33:14.043375] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-25T20:33:14.043575] [INFO ] [MAIN ] Update Progress: 1605/2372 symbols completed. OPFI took 41.4s. Estimated remaining: 1h 41m 53s. Rate: 7.5 symbols/min [2025-09-25T20:33:14.245055] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:14.245419] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-25T20:33:14.245504] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-25T20:33:14.246306] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-25T20:33:14.246422] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-25T20:33:14.246523] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-25T20:33:14.246601] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-25T20:33:14.290716] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-25T20:33:14.328137] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T20:33:14.685101] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:15.099177] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-25T20:33:15.128064] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T20:33:15.891329] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-25T20:33:15.907266] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T20:33:16.691415] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-25T20:33:16.699945] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T20:33:17.488770] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-25T20:33:18.202059] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T20:33:18.288697] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-25T20:33:18.371069] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-25T20:33:18.810477] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T20:33:19.088737] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-25T20:33:19.888735] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-25T20:33:19.926267] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T20:33:20.688700] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-25T20:33:21.108973] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T20:33:21.488754] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-25T20:33:21.699479] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T20:33:22.288754] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-25T20:33:23.088762] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-25T20:33:23.294996] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-25T20:33:23.683492] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-25T20:33:23.888734] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-25T20:33:23.969933] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T20:33:24.337729] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T20:33:24.688740] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-25T20:33:25.488692] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-25T20:33:25.653588] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T20:33:25.939825] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T20:33:26.288771] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-25T20:33:27.088735] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-25T20:33:27.736666] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-25T20:33:27.888760] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-25T20:33:27.978749] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T20:33:28.148051] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T20:33:28.155871] [INFO ] [REMOTE ] ORA: Full fetch complete (49287 records). [2025-09-25T20:33:28.156025] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-25T20:33:28.566351] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-25T20:33:28.566466] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-25T20:33:28.568252] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-25T20:33:28.568320] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-25T20:33:28.569744] [DEBUG] [LOCAL ] ORA: Trimmed 49287 records to 32800 (keeping 200 days of data) [2025-09-25T20:33:28.699101] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-25T20:33:28.863844] [DEBUG] [LOCAL ] ORA: Primary data saved (32800 records). [2025-09-25T20:33:28.864190] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-25T20:33:28.864567] [INFO ] [MAIN ] Update Progress: 1606/2372 symbols completed. ORA took 31.0s. Estimated remaining: 1h 41m 48s. Rate: 7.5 symbols/min [2025-09-25T20:33:29.069230] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:29.069513] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-25T20:33:29.069571] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-25T20:33:29.070050] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-25T20:33:29.070095] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-25T20:33:29.070138] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-25T20:33:29.070182] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-25T20:33:29.498311] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-25T20:33:29.508744] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:29.910960] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T20:33:30.288787] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-25T20:33:30.344573] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T20:33:31.088802] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-25T20:33:31.888783] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-25T20:33:31.981629] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-25T20:33:32.467377] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T20:33:32.688741] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-25T20:33:32.843477] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:33:33.222779] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:33:33.234141] [INFO ] [REMOTE ] OR: Full fetch complete (65064 records). [2025-09-25T20:33:33.234345] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-25T20:33:33.489044] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-25T20:33:33.672177] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-25T20:33:33.672421] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-25T20:33:33.674051] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-25T20:33:33.674188] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-25T20:33:33.679293] [DEBUG] [LOCAL ] OR: Trimmed 65064 records to 46423 (keeping 200 days of data) [2025-09-25T20:33:34.015343] [DEBUG] [LOCAL ] OR: Primary data saved (46423 records). [2025-09-25T20:33:34.015510] [INFO ] [MAIN ] OR: Full history saved. [2025-09-25T20:33:34.015691] [INFO ] [MAIN ] Update Progress: 1607/2372 symbols completed. OR took 37.6s. Estimated remaining: 1h 41m 39s. Rate: 7.5 symbols/min [2025-09-25T20:33:34.216661] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:34.259684] [DEBUG] [LOCAL ] ORN: Loaded 31573 existing records from primary storage. [2025-09-25T20:33:34.259850] [INFO ] [MAIN ] ORN: Loaded 31573 existing records. [2025-09-25T20:33:34.293923] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-25T20:33:34.468530] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:33:34.469148] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-25T20:33:34.469229] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-25T20:33:34.469779] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-25T20:33:34.469849] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-25T20:33:34.877542] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:35.088737] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-25T20:33:35.168579] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-25T20:33:35.395724] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T20:33:35.888725] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-25T20:33:36.072041] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T20:33:36.129210] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T20:33:36.688756] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-25T20:33:37.488808] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-25T20:33:38.288770] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-25T20:33:38.456784] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-25T20:33:38.742450] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-25T20:33:38.752809] [INFO ] [REMOTE ] ORC: Full fetch complete (75236 records). [2025-09-25T20:33:38.753004] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-25T20:33:38.903430] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T20:33:39.091552] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-25T20:33:39.252423] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-25T20:33:39.252528] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-25T20:33:39.253678] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-25T20:33:39.253754] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-25T20:33:39.255410] [DEBUG] [LOCAL ] ORC: Trimmed 75236 records to 52702 (keeping 200 days of data) [2025-09-25T20:33:39.644935] [DEBUG] [LOCAL ] ORC: Primary data saved (52702 records). [2025-09-25T20:33:39.645185] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-25T20:33:39.647576] [INFO ] [MAIN ] Update Progress: 1608/2372 symbols completed. ORC took 33.8s. Estimated remaining: 1h 41m 29s. Rate: 7.5 symbols/min [2025-09-25T20:33:39.852003] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:39.891387] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-25T20:33:39.902607] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:33:39.959283] [DEBUG] [LOCAL ] OSCR: Loaded 53722 existing records from primary storage. [2025-09-25T20:33:39.959445] [INFO ] [MAIN ] OSCR: Loaded 53722 existing records. [2025-09-25T20:33:40.171270] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:33:40.171633] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-25T20:33:40.171727] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-25T20:33:40.172112] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-25T20:33:40.172191] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-25T20:33:40.393749] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T20:33:40.591205] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:40.688729] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-25T20:33:41.488780] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-25T20:33:42.299396] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-25T20:33:42.326140] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T20:33:42.434528] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-25T20:33:43.088771] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-25T20:33:43.333811] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T20:33:43.797187] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T20:33:43.888727] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-25T20:33:44.688744] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-25T20:33:44.950250] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T20:33:45.433246] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T20:33:45.488745] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-25T20:33:46.288752] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-25T20:33:46.887555] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-25T20:33:47.088735] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-25T20:33:47.641243] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-25T20:33:47.888742] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-25T20:33:48.688734] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-25T20:33:49.012856] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T20:33:49.269211] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-25T20:33:49.477042] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T20:33:49.489718] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-25T20:33:50.248288] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T20:33:50.288690] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-25T20:33:51.088690] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-25T20:33:51.491539] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-25T20:33:51.814402] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-25T20:33:51.888678] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-25T20:33:52.688726] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-25T20:33:53.074035] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T20:33:53.488727] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-25T20:33:54.288767] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-25T20:33:54.643473] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:33:54.802382] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (2.91 seconds). [2025-09-25T20:33:55.088695] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-25T20:33:55.445513] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T20:33:55.460317] [INFO ] [REMOTE ] ORCL: Full fetch complete (77142 records). [2025-09-25T20:33:55.460542] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-25T20:33:55.462159] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:33:55.462559] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:33:55.462707] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:33:55.462873] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-25T20:33:55.463075] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-25T20:33:55.463181] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-25T20:33:55.463290] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-25T20:33:55.463530] [INFO ] [MAIN ] Update Progress: 1609/2372 symbols completed. ORCL took 41.4s. Estimated remaining: 1h 41m 25s. Rate: 7.5 symbols/min [2025-09-25T20:33:55.685099] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:55.685317] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-25T20:33:55.685366] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-25T20:33:55.685681] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-25T20:33:55.685742] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-25T20:33:55.685786] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-25T20:33:55.685858] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-25T20:33:55.888812] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-25T20:33:56.081137] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:33:56.327717] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-25T20:33:56.403084] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T20:33:56.688715] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-25T20:33:57.328467] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T20:33:57.488766] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-25T20:33:58.288757] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-25T20:33:58.657054] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T20:33:58.712157] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T20:33:58.719167] [INFO ] [REMOTE ] ORN: Full fetch complete (45783 records). [2025-09-25T20:33:58.719347] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-25T20:33:59.103735] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-25T20:33:59.137277] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-25T20:33:59.137370] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-25T20:33:59.138341] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-25T20:33:59.138407] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-25T20:33:59.139857] [DEBUG] [LOCAL ] ORN: Trimmed 45783 records to 31831 (keeping 200 days of data) [2025-09-25T20:33:59.337812] [DEBUG] [LOCAL ] ORN: Primary data saved (31831 records). [2025-09-25T20:33:59.337977] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-25T20:33:59.338067] [INFO ] [MAIN ] Update Progress: 1610/2372 symbols completed. ORN took 25.3s. Estimated remaining: 1h 41m 15s. Rate: 7.5 symbols/min [2025-09-25T20:33:59.516663] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:33:59.516859] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-25T20:33:59.516896] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-25T20:33:59.517029] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-25T20:33:59.517068] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-25T20:33:59.517108] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-25T20:33:59.517140] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-25T20:33:59.893803] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-25T20:33:59.981014] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:00.563807] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-25T20:34:00.621614] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T20:34:00.688709] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-25T20:34:01.493318] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-25T20:34:01.499813] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T20:34:01.513473] [INFO ] [REMOTE ] ORI: Full fetch complete (70200 records). [2025-09-25T20:34:01.513686] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-25T20:34:01.752943] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:34:01.755030] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:34:01.755257] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:34:01.755416] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-25T20:34:01.755562] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-25T20:34:01.755668] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-25T20:34:01.755762] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-25T20:34:01.755926] [INFO ] [MAIN ] Update Progress: 1611/2372 symbols completed. ORI took 32.9s. Estimated remaining: 1h 41m 5s. Rate: 7.5 symbols/min [2025-09-25T20:34:01.823843] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:01.851815] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-25T20:34:02.058621] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:02.162517] [DEBUG] [LOCAL ] OTIS: Loaded 52712 existing records from primary storage. [2025-09-25T20:34:02.162847] [INFO ] [MAIN ] OTIS: Loaded 52712 existing records. [2025-09-25T20:34:02.288699] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-25T20:34:02.361459] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:34:02.504473] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:34:02.505033] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-25T20:34:02.505122] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-25T20:34:02.506051] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-25T20:34:02.506128] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-25T20:34:02.664918] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:02.665338] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-25T20:34:03.037717] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:03.088758] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-25T20:34:03.888710] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-25T20:34:04.163439] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:04.163855] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-25T20:34:04.688748] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-25T20:34:04.926274] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T20:34:05.488729] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-25T20:34:05.752107] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:05.752492] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-25T20:34:06.288736] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-25T20:34:06.343681] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T20:34:07.088766] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-25T20:34:07.888703] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-25T20:34:08.161180] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T20:34:08.191023] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:08.191378] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-25T20:34:08.688759] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-25T20:34:09.488759] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-25T20:34:10.288898] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-25T20:34:10.687091] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:34:10.687516] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-25T20:34:10.861931] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (3.77 seconds). [2025-09-25T20:34:11.088900] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-25T20:34:11.888858] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-25T20:34:12.926700] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-25T20:34:12.938262] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-25T20:34:13.018527] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (3.53 seconds). [2025-09-25T20:34:13.271107] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T20:34:13.488805] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-25T20:34:14.196991] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-25T20:34:14.288727] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-25T20:34:14.652210] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:34:15.088741] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-25T20:34:15.445137] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:34:15.611866] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T20:34:15.888735] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-25T20:34:16.688786] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-25T20:34:16.880830] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-25T20:34:17.488695] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-25T20:34:17.660794] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T20:34:17.900290] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T20:34:18.288730] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-25T20:34:19.084142] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T20:34:19.090233] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-25T20:34:19.652078] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T20:34:19.659245] [INFO ] [REMOTE ] OTF: Full fetch complete (8961 records). [2025-09-25T20:34:19.659394] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-25T20:34:19.874237] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-25T20:34:19.876895] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:34:19.876982] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:34:19.877081] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-25T20:34:19.877214] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-25T20:34:19.877292] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-25T20:34:19.877366] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-25T20:34:19.877509] [INFO ] [MAIN ] Update Progress: 1612/2372 symbols completed. OTF took 20.5s. Estimated remaining: 1h 41m 2s. Rate: 7.5 symbols/min [2025-09-25T20:34:19.893829] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-25T20:34:20.065824] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:20.135663] [DEBUG] [LOCAL ] OUT: Loaded 48046 existing records from primary storage. [2025-09-25T20:34:20.135846] [INFO ] [MAIN ] OUT: Loaded 48046 existing records. [2025-09-25T20:34:20.330442] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:34:20.330825] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-25T20:34:20.330876] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-25T20:34:20.331418] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-25T20:34:20.331488] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-25T20:34:20.692608] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-25T20:34:20.730615] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:20.981371] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:34:21.488757] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-25T20:34:22.288744] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-25T20:34:22.907387] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (3.01 seconds). [2025-09-25T20:34:22.922157] [INFO ] [REMOTE ] OSCR: Full fetch complete (77489 records). [2025-09-25T20:34:22.922359] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-25T20:34:23.068007] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-25T20:34:23.088674] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-25T20:34:23.180391] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:34:23.475269] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-25T20:34:23.475376] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-25T20:34:23.476529] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-25T20:34:23.476618] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-25T20:34:23.478328] [DEBUG] [LOCAL ] OSCR: Trimmed 77489 records to 54112 (keeping 200 days of data) [2025-09-25T20:34:23.764545] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T20:34:23.888766] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-25T20:34:23.895774] [DEBUG] [LOCAL ] OSCR: Primary data saved (54112 records). [2025-09-25T20:34:23.895889] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-25T20:34:23.897743] [INFO ] [MAIN ] Update Progress: 1613/2372 symbols completed. OSCR took 44.2s. Estimated remaining: 1h 40m 52s. Rate: 7.5 symbols/min [2025-09-25T20:34:24.087602] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:24.164325] [DEBUG] [LOCAL ] OVV: Loaded 53515 existing records from primary storage. [2025-09-25T20:34:24.164493] [INFO ] [MAIN ] OVV: Loaded 53515 existing records. [2025-09-25T20:34:24.355317] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:34:24.355763] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-25T20:34:24.355822] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-25T20:34:24.356207] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-25T20:34:24.356266] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-25T20:34:24.693768] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-25T20:34:24.774901] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:24.866451] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:34:25.488731] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-25T20:34:26.011315] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-25T20:34:26.288789] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-25T20:34:26.441620] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T20:34:27.088735] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-25T20:34:27.343603] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T20:34:27.888746] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-25T20:34:28.188357] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T20:34:28.254518] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T20:34:28.263377] [INFO ] [REMOTE ] OSK: Full fetch complete (61561 records). [2025-09-25T20:34:28.263527] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-25T20:34:28.501295] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:34:28.502822] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:34:28.503100] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:34:28.503318] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-25T20:34:28.503413] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-25T20:34:28.503474] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-25T20:34:28.503525] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-25T20:34:28.503672] [INFO ] [MAIN ] Update Progress: 1614/2372 symbols completed. OSK took 33.0s. Estimated remaining: 1h 40m 42s. Rate: 7.5 symbols/min [2025-09-25T20:34:28.689435] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-25T20:34:28.704315] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:28.793252] [DEBUG] [LOCAL ] OWL: Loaded 53555 existing records from primary storage. [2025-09-25T20:34:28.793465] [INFO ] [MAIN ] OWL: Loaded 53555 existing records. [2025-09-25T20:34:28.990881] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:34:28.991525] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-25T20:34:28.991576] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-25T20:34:28.991853] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-25T20:34:28.991914] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-25T20:34:29.370286] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:29.488746] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-25T20:34:29.712793] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T20:34:29.944434] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T20:34:30.288741] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-25T20:34:31.088700] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-25T20:34:31.396295] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T20:34:31.407958] [INFO ] [REMOTE ] OTIS: Full fetch complete (75847 records). [2025-09-25T20:34:31.408192] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-25T20:34:31.848469] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-25T20:34:31.848555] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-25T20:34:31.849684] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-25T20:34:31.849758] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-25T20:34:31.854145] [DEBUG] [LOCAL ] OTIS: Trimmed 75847 records to 53093 (keeping 200 days of data) [2025-09-25T20:34:31.922925] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-25T20:34:32.147117] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T20:34:32.262808] [DEBUG] [LOCAL ] OTIS: Primary data saved (53093 records). [2025-09-25T20:34:32.262983] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-25T20:34:32.263076] [INFO ] [MAIN ] Update Progress: 1615/2372 symbols completed. OTIS took 30.5s. Estimated remaining: 1h 40m 32s. Rate: 7.5 symbols/min [2025-09-25T20:34:32.441194] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:32.455981] [DEBUG] [LOCAL ] OWLT: Loaded 8978 existing records from primary storage. [2025-09-25T20:34:32.456116] [INFO ] [MAIN ] OWLT: Loaded 8978 existing records. [2025-09-25T20:34:32.655057] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:34:32.655318] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-25T20:34:32.655363] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-25T20:34:32.655697] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-25T20:34:32.655758] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-25T20:34:32.693962] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-25T20:34:32.951496] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:34:33.112138] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:33.488727] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-25T20:34:33.663292] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T20:34:34.288696] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-25T20:34:34.405326] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T20:34:34.580925] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T20:34:35.088736] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-25T20:34:35.721606] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T20:34:35.888692] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-25T20:34:36.069967] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T20:34:36.688754] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-25T20:34:37.369935] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-25T20:34:37.488747] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-25T20:34:37.725076] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T20:34:38.288749] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-25T20:34:39.088735] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-25T20:34:39.176354] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T20:34:39.201574] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T20:34:39.888778] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-25T20:34:40.553806] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-25T20:34:40.688765] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-25T20:34:41.069194] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T20:34:41.488743] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-25T20:34:42.131808] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T20:34:42.288772] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-25T20:34:43.088693] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-25T20:34:43.215110] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T20:34:43.888732] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-25T20:34:43.912277] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T20:34:44.110454] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T20:34:44.688741] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-25T20:34:45.488785] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-25T20:34:45.538768] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:34:45.623449] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T20:34:46.288727] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-25T20:34:46.989151] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T20:34:47.088701] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-25T20:34:47.168482] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T20:34:47.888728] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-25T20:34:48.688697] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-25T20:34:48.805107] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T20:34:48.909501] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T20:34:49.488727] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-25T20:34:50.288721] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-25T20:34:50.430455] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T20:34:51.088728] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-25T20:34:51.115721] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:34:51.118210] [INFO ] [REMOTE ] OWLT: Full fetch complete (11616 records). [2025-09-25T20:34:51.118284] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-25T20:34:51.468158] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T20:34:51.593124] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-25T20:34:51.593220] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-25T20:34:51.593542] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-25T20:34:51.593615] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-25T20:34:51.594553] [DEBUG] [LOCAL ] OWLT: Trimmed 11616 records to 9023 (keeping 200 days of data) [2025-09-25T20:34:51.651268] [DEBUG] [LOCAL ] OWLT: Primary data saved (9023 records). [2025-09-25T20:34:51.651403] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-25T20:34:51.651528] [INFO ] [MAIN ] Update Progress: 1616/2372 symbols completed. OWLT took 19.4s. Estimated remaining: 1h 40m 30s. Rate: 7.5 symbols/min [2025-09-25T20:34:51.832165] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:51.832406] [DEBUG] [LOCAL ] OXM: No existing data file found in primary storage. [2025-09-25T20:34:51.832462] [WARN ] [MAIN ] OXM: No existing data found, performing full refresh instead. [2025-09-25T20:34:51.832757] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-25T20:34:51.832811] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-25T20:34:51.832856] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-09-25T20:34:51.832893] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-25T20:34:51.893858] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-25T20:34:52.251399] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:52.688762] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-25T20:34:52.729631] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T20:34:53.344837] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T20:34:53.488823] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-25T20:34:54.288838] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-25T20:34:54.499768] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T20:34:55.088748] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-25T20:34:55.484109] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T20:34:55.891261] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-25T20:34:55.898692] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T20:34:56.329391] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T20:34:56.688733] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-25T20:34:57.488735] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-25T20:34:57.539463] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:34:57.551723] [INFO ] [REMOTE ] OUT: Full fetch complete (69024 records). [2025-09-25T20:34:57.551955] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-25T20:34:58.015490] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-25T20:34:58.015596] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-25T20:34:58.016962] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-25T20:34:58.017124] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-25T20:34:58.019263] [DEBUG] [LOCAL ] OUT: Trimmed 69024 records to 48342 (keeping 200 days of data) [2025-09-25T20:34:58.039251] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T20:34:58.296700] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-25T20:34:58.425503] [DEBUG] [LOCAL ] OUT: Primary data saved (48342 records). [2025-09-25T20:34:58.425703] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-25T20:34:58.425883] [INFO ] [MAIN ] Update Progress: 1617/2372 symbols completed. OUT took 38.5s. Estimated remaining: 1h 40m 21s. Rate: 7.5 symbols/min [2025-09-25T20:34:58.610334] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:34:58.610522] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-25T20:34:58.610561] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-25T20:34:58.611224] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-25T20:34:58.611318] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-25T20:34:58.611386] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-25T20:34:58.611557] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-25T20:34:59.081742] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:34:59.088689] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-25T20:34:59.280777] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T20:34:59.888735] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-25T20:35:00.179206] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:35:00.688751] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-25T20:35:01.336885] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T20:35:01.460772] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-25T20:35:01.488695] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-25T20:35:02.288725] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-25T20:35:02.381921] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T20:35:02.396477] [INFO ] [REMOTE ] OVV: Full fetch complete (77306 records). [2025-09-25T20:35:02.398731] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-25T20:35:02.887702] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-25T20:35:02.887807] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-25T20:35:02.889109] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-25T20:35:02.889176] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-25T20:35:02.892248] [DEBUG] [LOCAL ] OVV: Trimmed 77306 records to 53905 (keeping 200 days of data) [2025-09-25T20:35:03.097671] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-25T20:35:03.268068] [DEBUG] [LOCAL ] OVV: Primary data saved (53905 records). [2025-09-25T20:35:03.268219] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-25T20:35:03.269046] [INFO ] [MAIN ] Update Progress: 1618/2372 symbols completed. OVV took 39.4s. Estimated remaining: 1h 40m 12s. Rate: 7.5 symbols/min [2025-09-25T20:35:03.461601] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:03.536366] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-25T20:35:03.536521] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-25T20:35:03.707202] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-25T20:35:03.800075] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:03.800319] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-25T20:35:03.800365] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-25T20:35:03.801341] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-25T20:35:03.801407] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-25T20:35:03.895735] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-25T20:35:04.134263] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T20:35:04.261771] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:04.647109] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T20:35:04.661065] [INFO ] [REMOTE ] OWL: Full fetch complete (77528 records). [2025-09-25T20:35:04.661279] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-25T20:35:04.695737] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-25T20:35:05.118455] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-25T20:35:05.118561] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-25T20:35:05.119849] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-25T20:35:05.119923] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-25T20:35:05.122566] [DEBUG] [LOCAL ] OWL: Trimmed 77528 records to 53945 (keeping 200 days of data) [2025-09-25T20:35:05.488836] [DEBUG] [LOCAL ] OWL: Primary data saved (53945 records). [2025-09-25T20:35:05.489005] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-25T20:35:05.490516] [INFO ] [MAIN ] Update Progress: 1619/2372 symbols completed. OWL took 37.0s. Estimated remaining: 1h 40m 1s. Rate: 7.5 symbols/min [2025-09-25T20:35:05.523726] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-25T20:35:05.695554] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:05.723974] [DEBUG] [LOCAL ] PAC: Loaded 11566 existing records from primary storage. [2025-09-25T20:35:05.724135] [INFO ] [MAIN ] PAC: Loaded 11566 existing records. [2025-09-25T20:35:05.906697] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:05.907595] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-25T20:35:05.907675] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-25T20:35:05.907899] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-25T20:35:05.907958] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-25T20:35:06.350944] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:06.351349] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-25T20:35:06.629661] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.73 seconds). [2025-09-25T20:35:06.692153] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T20:35:07.088789] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-25T20:35:07.131597] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T20:35:07.451440] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T20:35:07.888822] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-25T20:35:08.688853] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-25T20:35:09.175031] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T20:35:09.488781] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-25T20:35:10.190170] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T20:35:10.288773] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-25T20:35:10.491543] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T20:35:10.510743] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-25T20:35:11.089729] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-25T20:35:11.849287] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T20:35:11.888687] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-25T20:35:12.688786] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-25T20:35:13.210910] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T20:35:13.397163] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-25T20:35:13.488733] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-25T20:35:14.288794] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-25T20:35:14.547885] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T20:35:15.047874] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T20:35:15.058150] [INFO ] [REMOTE ] OXM: Full fetch complete (45976 records). [2025-09-25T20:35:15.058361] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-25T20:35:15.059676] [FATAL] [VALIDATOR ] OXM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:35:15.059813] [FATAL] [MAIN ] OXM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:35:15.059860] [WARN ] [MAIN ] OXM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:35:15.059934] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-25T20:35:15.060095] [DEBUG] [LOCAL ] OXM: No primary data file found to delete. [2025-09-25T20:35:15.060171] [INFO ] [LOCAL ] OXM: Starting deletion of derivative data. [2025-09-25T20:35:15.060257] [DEBUG] [LOCAL ] OXM: No derivative data file found to delete. [2025-09-25T20:35:15.060521] [INFO ] [MAIN ] Update Progress: 1620/2372 symbols completed. OXM took 23.4s. Estimated remaining: 1h 39m 54s. Rate: 7.5 symbols/min [2025-09-25T20:35:15.095374] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-25T20:35:15.278347] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:15.278556] [DEBUG] [LOCAL ] PACK: No existing data file found in primary storage. [2025-09-25T20:35:15.278610] [WARN ] [MAIN ] PACK: No existing data found, performing full refresh instead. [2025-09-25T20:35:15.278859] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-25T20:35:15.278903] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-25T20:35:15.278946] [DEBUG] [LOCAL ] PACK: No primary data file found to delete. [2025-09-25T20:35:15.279705] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-25T20:35:15.666917] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:15.888736] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-25T20:35:16.078853] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-25T20:35:16.688764] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-25T20:35:16.783500] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T20:35:17.334280] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-25T20:35:17.488768] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-25T20:35:18.288741] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-25T20:35:19.088741] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-25T20:35:19.197125] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-25T20:35:19.526262] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T20:35:19.634286] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-25T20:35:19.888768] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-25T20:35:20.009185] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T20:35:20.688731] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-25T20:35:21.156784] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T20:35:21.488701] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-25T20:35:21.763365] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T20:35:22.288687] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-25T20:35:22.682712] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:35:23.088688] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-25T20:35:23.392327] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T20:35:23.888746] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-25T20:35:24.562262] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T20:35:24.688734] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-25T20:35:25.488699] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-25T20:35:25.642356] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T20:35:26.171260] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-25T20:35:26.288754] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-25T20:35:26.972914] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T20:35:27.088746] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-25T20:35:27.888740] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-25T20:35:28.065563] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T20:35:28.369800] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T20:35:28.688765] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-25T20:35:28.793850] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T20:35:29.488714] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-25T20:35:30.288750] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-25T20:35:30.734756] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T20:35:30.725718] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T20:35:31.088744] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-25T20:35:31.888709] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-25T20:35:32.205992] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:35:32.688386] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-25T20:35:32.694537] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-25T20:35:32.718358] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:35:32.720605] [INFO ] [REMOTE ] PAC: Full fetch complete (16404 records). [2025-09-25T20:35:32.720815] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-25T20:35:33.114894] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-25T20:35:33.114993] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-25T20:35:33.115436] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-25T20:35:33.115498] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-25T20:35:33.116118] [DEBUG] [LOCAL ] PAC: Trimmed 16404 records to 11651 (keeping 200 days of data) [2025-09-25T20:35:33.204932] [DEBUG] [LOCAL ] PAC: Primary data saved (11651 records). [2025-09-25T20:35:33.205102] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-25T20:35:33.205251] [INFO ] [MAIN ] Update Progress: 1621/2372 symbols completed. PAC took 27.7s. Estimated remaining: 1h 39m 50s. Rate: 7.5 symbols/min [2025-09-25T20:35:33.387180] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:33.435815] [DEBUG] [LOCAL ] PACS: Loaded 34103 existing records from primary storage. [2025-09-25T20:35:33.436023] [INFO ] [MAIN ] PACS: Loaded 34103 existing records. [2025-09-25T20:35:33.494823] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-25T20:35:33.629147] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:33.629484] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-25T20:35:33.629535] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-25T20:35:33.629896] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-25T20:35:33.629959] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-25T20:35:33.987044] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T20:35:34.059172] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:34.288728] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-25T20:35:35.088733] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-25T20:35:35.625337] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-25T20:35:35.739743] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T20:35:35.888768] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-25T20:35:36.688752] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-25T20:35:37.420214] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-25T20:35:37.460379] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T20:35:37.477555] [INFO ] [REMOTE ] PACK: Full fetch complete (43527 records). [2025-09-25T20:35:37.477757] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-25T20:35:37.494765] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-25T20:35:37.892887] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-25T20:35:37.893008] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-25T20:35:37.894525] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-25T20:35:37.894593] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-25T20:35:37.896163] [DEBUG] [LOCAL ] PACK: Trimmed 43527 records to 32207 (keeping 200 days of data) [2025-09-25T20:35:38.107240] [DEBUG] [LOCAL ] PACK: Primary data saved (32207 records). [2025-09-25T20:35:38.107460] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-25T20:35:38.107558] [INFO ] [MAIN ] Update Progress: 1622/2372 symbols completed. PACK took 23.0s. Estimated remaining: 1h 39m 41s. Rate: 7.5 symbols/min [2025-09-25T20:35:38.283302] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:38.290694] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-25T20:35:38.323981] [DEBUG] [LOCAL ] PAG: Loaded 21917 existing records from primary storage. [2025-09-25T20:35:38.324172] [INFO ] [MAIN ] PAG: Loaded 21917 existing records. [2025-09-25T20:35:38.506329] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:38.506808] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-25T20:35:38.506864] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-25T20:35:38.507173] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-25T20:35:38.507233] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-25T20:35:38.961861] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:38.997709] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-25T20:35:39.007384] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T20:35:39.028946] [INFO ] [REMOTE ] PAAS: Full fetch complete (77376 records). [2025-09-25T20:35:39.029137] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-25T20:35:39.089383] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-25T20:35:39.451058] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-25T20:35:39.451156] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-25T20:35:39.452448] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-25T20:35:39.452520] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-25T20:35:39.454342] [DEBUG] [LOCAL ] PAAS: Trimmed 77376 records to 53993 (keeping 200 days of data) [2025-09-25T20:35:39.826911] [DEBUG] [LOCAL ] PAAS: Primary data saved (53993 records). [2025-09-25T20:35:39.827220] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-25T20:35:39.828745] [INFO ] [MAIN ] Update Progress: 1623/2372 symbols completed. PAAS took 36.6s. Estimated remaining: 1h 39m 30s. Rate: 7.5 symbols/min [2025-09-25T20:35:39.904970] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-25T20:35:40.036055] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:40.102991] [DEBUG] [LOCAL ] PAGS: Loaded 52679 existing records from primary storage. [2025-09-25T20:35:40.103165] [INFO ] [MAIN ] PAGS: Loaded 52679 existing records. [2025-09-25T20:35:40.304777] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:40.305220] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-25T20:35:40.305278] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-25T20:35:40.305781] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-25T20:35:40.305843] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-25T20:35:40.515705] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T20:35:40.692788] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-25T20:35:40.713932] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-25T20:35:40.759950] [INFO ] [REMOTE ] OXY: Full fetch complete (77570 records). [2025-09-25T20:35:40.760217] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-25T20:35:40.876243] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:40.971168] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T20:35:41.065294] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T20:35:41.066794] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:35:41.067072] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:35:41.067274] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-25T20:35:41.067366] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-25T20:35:41.067406] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-25T20:35:41.067446] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-25T20:35:41.067560] [INFO ] [MAIN ] Update Progress: 1624/2372 symbols completed. OXY took 42.6s. Estimated remaining: 1h 39m 19s. Rate: 7.5 symbols/min [2025-09-25T20:35:41.268962] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:35:41.279932] [DEBUG] [LOCAL ] PAI: Loaded 2706 existing records from primary storage. [2025-09-25T20:35:41.280053] [INFO ] [MAIN ] PAI: Loaded 2706 existing records. [2025-09-25T20:35:41.462581] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:35:41.463885] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-25T20:35:41.463947] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-25T20:35:41.464223] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-25T20:35:41.464283] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-25T20:35:41.489771] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-25T20:35:41.802293] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T20:35:41.903802] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:35:42.288800] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-25T20:35:43.089787] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-25T20:35:43.319605] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T20:35:43.344992] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T20:35:43.888843] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-25T20:35:44.158683] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T20:35:44.688764] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-25T20:35:45.484033] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T20:35:45.491342] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-25T20:35:45.825901] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T20:35:46.150994] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T20:35:46.288736] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-25T20:35:47.088810] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-25T20:35:47.888976] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-25T20:35:48.001938] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T20:35:48.431361] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T20:35:48.469588] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T20:35:48.688748] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-25T20:35:49.244073] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T20:35:49.488739] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-25T20:35:50.288735] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-25T20:35:51.088770] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-25T20:35:51.202705] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T20:35:51.734241] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T20:35:51.888750] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-25T20:35:52.418557] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:35:52.688760] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-25T20:35:53.325406] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T20:35:53.488741] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-25T20:35:54.288726] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-25T20:35:54.463779] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T20:35:54.593616] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T20:35:54.717772] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-25T20:35:55.088729] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-25T20:35:55.888770] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-25T20:35:56.507949] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T20:35:56.688729] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-25T20:35:56.847458] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T20:35:57.479786] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:35:57.489375] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-25T20:35:58.004312] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T20:35:58.288735] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-25T20:35:59.088799] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-25T20:35:59.615588] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T20:35:59.696348] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T20:35:59.888735] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-25T20:36:00.688751] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-25T20:36:01.112831] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T20:36:01.488736] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-25T20:36:01.789108] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T20:36:02.003880] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T20:36:02.288738] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-25T20:36:03.088741] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-25T20:36:03.578761] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T20:36:03.888754] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-25T20:36:04.129412] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T20:36:04.688721] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-25T20:36:05.488757] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-25T20:36:05.590755] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:36:05.807441] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T20:36:05.816742] [INFO ] [REMOTE ] PACS: Full fetch complete (50742 records). [2025-09-25T20:36:05.816944] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-25T20:36:06.026115] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T20:36:06.258314] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-25T20:36:06.258424] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-25T20:36:06.259503] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-25T20:36:06.259612] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-25T20:36:06.263620] [DEBUG] [LOCAL ] PACS: Trimmed 50742 records to 34425 (keeping 200 days of data) [2025-09-25T20:36:06.288734] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-25T20:36:06.521668] [DEBUG] [LOCAL ] PACS: Primary data saved (34425 records). [2025-09-25T20:36:06.521897] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-25T20:36:06.522174] [INFO ] [MAIN ] Update Progress: 1625/2372 symbols completed. PACS took 33.3s. Estimated remaining: 1h 39m 19s. Rate: 7.5 symbols/min [2025-09-25T20:36:06.695540] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:06.695833] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-25T20:36:06.695891] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-25T20:36:06.698833] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-25T20:36:06.698897] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-25T20:36:06.698974] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-25T20:36:06.699037] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-25T20:36:07.018183] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T20:36:07.020288] [INFO ] [REMOTE ] PAI: Full fetch complete (4127 records). [2025-09-25T20:36:07.020383] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-25T20:36:07.095706] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-25T20:36:07.181176] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:07.488809] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-25T20:36:07.488989] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-25T20:36:07.489214] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-25T20:36:07.489259] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-25T20:36:07.489729] [DEBUG] [LOCAL ] PAI: Trimmed 4127 records to 2741 (keeping 200 days of data) [2025-09-25T20:36:07.514508] [DEBUG] [LOCAL ] PAI: Primary data saved (2741 records). [2025-09-25T20:36:07.514579] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-25T20:36:07.514713] [INFO ] [MAIN ] Update Progress: 1626/2372 symbols completed. PAI took 26.4s. Estimated remaining: 1h 39m 8s. Rate: 7.5 symbols/min [2025-09-25T20:36:07.686603] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:07.730548] [DEBUG] [LOCAL ] PAM: Loaded 27952 existing records from primary storage. [2025-09-25T20:36:07.730807] [INFO ] [MAIN ] PAM: Loaded 27952 existing records. [2025-09-25T20:36:07.894750] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-25T20:36:07.942835] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:07.944115] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-25T20:36:07.944217] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-25T20:36:07.944729] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-25T20:36:07.944793] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-25T20:36:08.267363] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:08.289743] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-25T20:36:08.364120] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:08.688711] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-25T20:36:08.895310] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T20:36:09.488743] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-25T20:36:09.970916] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:36:10.288745] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-25T20:36:11.088746] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-25T20:36:11.363861] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:36:11.441728] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-25T20:36:11.888730] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-25T20:36:12.038977] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T20:36:12.043161] [INFO ] [REMOTE ] PAG: Full fetch complete (30060 records). [2025-09-25T20:36:12.043267] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-25T20:36:12.449719] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-25T20:36:12.449837] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-25T20:36:12.450577] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-25T20:36:12.450625] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-25T20:36:12.452499] [DEBUG] [LOCAL ] PAG: Trimmed 30060 records to 22087 (keeping 200 days of data) [2025-09-25T20:36:12.625142] [DEBUG] [LOCAL ] PAG: Primary data saved (22087 records). [2025-09-25T20:36:12.625283] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-25T20:36:12.625390] [INFO ] [MAIN ] Update Progress: 1627/2372 symbols completed. PAG took 34.5s. Estimated remaining: 1h 38m 59s. Rate: 7.5 symbols/min [2025-09-25T20:36:12.697763] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-25T20:36:12.832268] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:12.883331] [DEBUG] [LOCAL ] PAR: Loaded 32612 existing records from primary storage. [2025-09-25T20:36:12.883495] [INFO ] [MAIN ] PAR: Loaded 32612 existing records. [2025-09-25T20:36:13.091592] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:13.092084] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-25T20:36:13.092170] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-25T20:36:13.092580] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-25T20:36:13.094321] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-25T20:36:13.181437] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T20:36:13.496940] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-25T20:36:13.534893] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:13.812282] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:13.812816] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-25T20:36:14.288702] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-25T20:36:14.456941] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T20:36:14.471731] [INFO ] [REMOTE ] PAGS: Full fetch complete (76323 records). [2025-09-25T20:36:14.471915] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-25T20:36:14.697557] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:14.698072] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-25T20:36:14.880796] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-25T20:36:14.880901] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-25T20:36:14.882496] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-25T20:36:14.882585] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-25T20:36:14.885207] [DEBUG] [LOCAL ] PAGS: Trimmed 76323 records to 53058 (keeping 200 days of data) [2025-09-25T20:36:15.097698] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-25T20:36:15.252791] [DEBUG] [LOCAL ] PAGS: Primary data saved (53058 records). [2025-09-25T20:36:15.253007] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-25T20:36:15.254734] [INFO ] [MAIN ] Update Progress: 1628/2372 symbols completed. PAGS took 35.4s. Estimated remaining: 1h 38m 48s. Rate: 7.5 symbols/min [2025-09-25T20:36:15.434790] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:15.501560] [DEBUG] [LOCAL ] PARR: Loaded 48352 existing records from primary storage. [2025-09-25T20:36:15.501790] [INFO ] [MAIN ] PARR: Loaded 48352 existing records. [2025-09-25T20:36:15.783124] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:15.786516] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-25T20:36:15.786591] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-25T20:36:15.788325] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-25T20:36:15.788397] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-25T20:36:15.893819] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-25T20:36:16.166236] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:16.370987] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T20:36:16.688763] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-25T20:36:16.942447] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:16.944555] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-25T20:36:17.488786] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-25T20:36:17.560724] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T20:36:17.741279] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:17.741777] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-25T20:36:18.288749] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-25T20:36:19.088777] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-25T20:36:19.894749] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-25T20:36:19.910940] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T20:36:20.179340] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:20.179883] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-25T20:36:20.491588] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:36:20.688829] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-25T20:36:21.488828] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-25T20:36:22.077244] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T20:36:22.288739] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-25T20:36:22.824816] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T20:36:23.088750] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-25T20:36:23.520002] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:23.520477] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-25T20:36:23.707372] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T20:36:23.888698] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-25T20:36:24.688842] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-25T20:36:25.373289] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T20:36:25.488853] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-25T20:36:25.813988] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:36:26.288795] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-25T20:36:26.704975] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T20:36:27.088802] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-25T20:36:27.888725] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-25T20:36:28.071839] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T20:36:28.144741] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T20:36:28.688744] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-25T20:36:28.923457] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T20:36:29.488766] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-25T20:36:29.736423] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:29.737364] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-25T20:36:29.875335] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T20:36:30.288753] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-25T20:36:31.088741] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-25T20:36:31.853114] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T20:36:31.888682] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-25T20:36:32.688744] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-25T20:36:32.779302] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:36:32.936774] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:36:32.937170] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-25T20:36:33.454666] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T20:36:33.466245] [INFO ] [REMOTE ] PAR: Full fetch complete (47316 records). [2025-09-25T20:36:33.466496] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-25T20:36:33.494757] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-25T20:36:33.941907] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-25T20:36:33.942056] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-25T20:36:33.943171] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-25T20:36:33.943266] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-25T20:36:33.944753] [DEBUG] [LOCAL ] PAR: Trimmed 47316 records to 32920 (keeping 200 days of data) [2025-09-25T20:36:34.017362] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-25T20:36:34.018380] [INFO ] [REMOTE ] PAII: Full fetch complete (90 records). [2025-09-25T20:36:34.018455] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-25T20:36:34.289453] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-25T20:36:34.359077] [DEBUG] [LOCAL ] PAR: Primary data saved (32920 records). [2025-09-25T20:36:34.359259] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-25T20:36:34.359441] [INFO ] [MAIN ] Update Progress: 1629/2372 symbols completed. PAR took 21.7s. Estimated remaining: 1h 38m 45s. Rate: 7.5 symbols/min [2025-09-25T20:36:34.521924] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 12 unique days, need 200 days [2025-09-25T20:36:34.548994] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:36:34.563592] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:36:34.569852] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-25T20:36:34.575269] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-25T20:36:34.580535] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-25T20:36:34.645921] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:34.607773] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-25T20:36:34.647977] [INFO ] [MAIN ] Update Progress: 1630/2372 symbols completed. PAII took 28.1s. Estimated remaining: 1h 38m 34s. Rate: 7.5 symbols/min [2025-09-25T20:36:34.883396] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:34.904381] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-25T20:36:34.904602] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-09-25T20:36:35.047321] [DEBUG] [LOCAL ] PAXS: Loaded 20964 existing records from primary storage. [2025-09-25T20:36:35.047560] [INFO ] [MAIN ] PAXS: Loaded 20964 existing records. [2025-09-25T20:36:35.103955] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-25T20:36:35.211041] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:35.211349] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-25T20:36:35.211398] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-25T20:36:35.225213] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-25T20:36:35.225390] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-25T20:36:35.532527] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:35.532918] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-25T20:36:35.532983] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-25T20:36:35.533345] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-25T20:36:35.533409] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-25T20:36:35.753800] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T20:36:35.890984] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-25T20:36:36.146989] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:36.228037] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:36.688769] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-25T20:36:36.840943] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:36:36.904831] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T20:36:37.488752] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-25T20:36:37.973442] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:36:38.288732] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-25T20:36:38.982368] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T20:36:38.995851] [INFO ] [REMOTE ] PAM: Full fetch complete (41891 records). [2025-09-25T20:36:38.996027] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-25T20:36:39.095537] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-25T20:36:39.438694] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-25T20:36:39.438802] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-25T20:36:39.439627] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-25T20:36:39.439707] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-25T20:36:39.441228] [DEBUG] [LOCAL ] PAM: Trimmed 41891 records to 28151 (keeping 200 days of data) [2025-09-25T20:36:39.630697] [DEBUG] [LOCAL ] PAM: Primary data saved (28151 records). [2025-09-25T20:36:39.630862] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-25T20:36:39.631021] [INFO ] [MAIN ] Update Progress: 1631/2372 symbols completed. PAM took 32.1s. Estimated remaining: 1h 38m 25s. Rate: 7.5 symbols/min [2025-09-25T20:36:39.821977] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:36:39.874919] [DEBUG] [LOCAL ] PAY: Loaded 38400 existing records from primary storage. [2025-09-25T20:36:39.875147] [INFO ] [MAIN ] PAY: Loaded 38400 existing records. [2025-09-25T20:36:39.911041] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-25T20:36:40.099577] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:36:40.100000] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-25T20:36:40.100107] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-25T20:36:40.100476] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-25T20:36:40.100537] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-25T20:36:40.377960] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T20:36:40.536270] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:36:40.688744] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-25T20:36:40.901677] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-25T20:36:41.253609] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T20:36:41.488908] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-25T20:36:41.841142] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T20:36:42.288737] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-25T20:36:43.088734] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-25T20:36:43.276319] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-25T20:36:43.891016] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-25T20:36:43.895502] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-25T20:36:44.223192] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:36:44.688738] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-25T20:36:45.032746] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T20:36:45.488782] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-25T20:36:46.261191] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T20:36:46.288695] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-25T20:36:46.411726] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T20:36:47.088784] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-25T20:36:47.675468] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T20:36:47.888808] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-25T20:36:48.688837] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-25T20:36:48.918516] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T20:36:49.449895] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:36:49.495519] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-25T20:36:49.500468] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T20:36:50.288767] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-25T20:36:50.976416] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-25T20:36:51.088755] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-25T20:36:51.888802] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-25T20:36:52.598209] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T20:36:52.695715] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-25T20:36:52.716276] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-25T20:36:53.101515] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T20:36:53.488862] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-25T20:36:53.537576] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T20:36:54.288811] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-25T20:36:55.011303] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T20:36:55.088746] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-25T20:36:55.888853] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-25T20:36:56.688881] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-25T20:36:56.790721] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-25T20:36:56.845313] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T20:36:56.868378] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T20:36:57.488761] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-25T20:36:57.943576] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T20:36:58.288790] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-25T20:36:59.088714] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-25T20:36:59.422903] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T20:36:59.888755] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-25T20:36:59.976067] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T20:37:00.343028] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:37:00.349174] [INFO ] [REMOTE ] PAXS: Full fetch complete (31273 records). [2025-09-25T20:37:00.349369] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-25T20:37:00.690984] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-25T20:37:00.793498] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-25T20:37:00.793618] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-25T20:37:00.794443] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-25T20:37:00.794571] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-25T20:37:00.795795] [DEBUG] [LOCAL ] PAXS: Trimmed 31273 records to 21098 (keeping 200 days of data) [2025-09-25T20:37:00.954217] [DEBUG] [LOCAL ] PAXS: Primary data saved (21098 records). [2025-09-25T20:37:00.954378] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-25T20:37:00.954561] [INFO ] [MAIN ] Update Progress: 1632/2372 symbols completed. PAXS took 26.3s. Estimated remaining: 1h 38m 23s. Rate: 7.5 symbols/min [2025-09-25T20:37:01.140379] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:01.203197] [DEBUG] [LOCAL ] PAYC: Loaded 36272 existing records from primary storage. [2025-09-25T20:37:01.203431] [INFO ] [MAIN ] PAYC: Loaded 36272 existing records. [2025-09-25T20:37:01.392041] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:01.392402] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-25T20:37:01.392561] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-25T20:37:01.394334] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-25T20:37:01.394426] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-25T20:37:01.491187] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-25T20:37:01.773914] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:02.288745] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-25T20:37:03.641198] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-25T20:37:03.650267] [INFO ] [REMOTE ] PAY: Full fetch complete (53357 records). [2025-09-25T20:37:03.650424] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-25T20:37:03.863047] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (3.97 seconds). [2025-09-25T20:37:03.884243] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-25T20:37:04.081687] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-25T20:37:04.100529] [INFO ] [REMOTE ] PARR: Full fetch complete (68650 records). [2025-09-25T20:37:04.123191] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-25T20:37:04.226696] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-25T20:37:04.235892] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-25T20:37:04.237029] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-25T20:37:04.237098] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-25T20:37:04.244205] [DEBUG] [LOCAL ] PAY: Trimmed 53357 records to 38647 (keeping 200 days of data) [2025-09-25T20:37:04.697547] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-25T20:37:04.727410] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-25T20:37:04.792487] [DEBUG] [LOCAL ] PAY: Primary data saved (38647 records). [2025-09-25T20:37:04.792701] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-25T20:37:04.798722] [INFO ] [MAIN ] Update Progress: 1633/2372 symbols completed. PAY took 25.2s. Estimated remaining: 1h 38m 13s. Rate: 7.5 symbols/min [2025-09-25T20:37:05.131878] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-25T20:37:05.131987] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-25T20:37:05.133414] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-25T20:37:05.133486] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-25T20:37:05.136937] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:05.139366] [DEBUG] [LOCAL ] PARR: Trimmed 68650 records to 48708 (keeping 200 days of data) [2025-09-25T20:37:05.272594] [DEBUG] [LOCAL ] PB: Loaded 41367 existing records from primary storage. [2025-09-25T20:37:05.275940] [INFO ] [MAIN ] PB: Loaded 41367 existing records. [2025-09-25T20:37:05.689231] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:05.689515] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-25T20:37:05.689565] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-25T20:37:05.689995] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-25T20:37:05.690061] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-25T20:37:05.709341] [DEBUG] [LOCAL ] PARR: Primary data saved (48708 records). [2025-09-25T20:37:05.709499] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-25T20:37:05.711148] [INFO ] [MAIN ] Update Progress: 1634/2372 symbols completed. PARR took 50.5s. Estimated remaining: 1h 38m 2s. Rate: 7.5 symbols/min [2025-09-25T20:37:06.180622] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:06.344590] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T20:37:06.390872] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-25T20:37:06.415147] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.53 seconds). [2025-09-25T20:37:06.451379] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-25T20:37:06.456853] [DEBUG] [LOCAL ] PBA: Loaded 48938 existing records from primary storage. [2025-09-25T20:37:06.457045] [INFO ] [MAIN ] PBA: Loaded 48938 existing records. [2025-09-25T20:37:06.514161] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:06.525146] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-25T20:37:06.702942] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:06.703884] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-25T20:37:06.703933] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-25T20:37:06.704414] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-25T20:37:06.704475] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-25T20:37:07.066377] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:07.088670] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-25T20:37:08.096255] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T20:37:08.104552] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-25T20:37:08.172728] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T20:37:08.688696] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-25T20:37:08.874729] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-25T20:37:09.179874] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T20:37:09.488730] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-25T20:37:09.578870] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T20:37:09.941968] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T20:37:10.288787] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-25T20:37:11.088701] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-25T20:37:11.338299] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:37:11.888705] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-25T20:37:12.012257] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T20:37:12.688729] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-25T20:37:13.260090] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T20:37:13.351135] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-25T20:37:13.488682] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-25T20:37:14.169212] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:37:14.288749] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-25T20:37:14.748435] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T20:37:15.088741] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-25T20:37:15.888723] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-25T20:37:16.490864] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-25T20:37:16.688743] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-25T20:37:17.488804] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-25T20:37:17.788464] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-25T20:37:18.007034] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T20:37:18.288762] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-25T20:37:19.088747] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-25T20:37:19.728787] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-25T20:37:19.877930] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T20:37:19.888699] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-25T20:37:20.026357] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (3.34 seconds). [2025-09-25T20:37:20.042466] [INFO ] [REMOTE ] PATH: Full fetch complete (77764 records). [2025-09-25T20:37:20.042706] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-25T20:37:20.501229] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-25T20:37:20.502230] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-25T20:37:20.503567] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-25T20:37:20.503762] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-25T20:37:20.506545] [DEBUG] [LOCAL ] PATH: Trimmed 77764 records to 54067 (keeping 200 days of data) [2025-09-25T20:37:20.711487] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-25T20:37:20.882088] [DEBUG] [LOCAL ] PATH: Primary data saved (54067 records). [2025-09-25T20:37:20.882271] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-25T20:37:20.882422] [INFO ] [MAIN ] Update Progress: 1635/2372 symbols completed. PATH took 46.5s. Estimated remaining: 1h 37m 57s. Rate: 7.5 symbols/min [2025-09-25T20:37:21.091213] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T20:37:21.141908] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:21.206111] [DEBUG] [LOCAL ] PBF: Loaded 53090 existing records from primary storage. [2025-09-25T20:37:21.206323] [INFO ] [MAIN ] PBF: Loaded 53090 existing records. [2025-09-25T20:37:21.418545] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T20:37:21.449305] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:21.450057] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-25T20:37:21.450125] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-25T20:37:21.451060] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-25T20:37:21.451135] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-25T20:37:21.489941] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-25T20:37:21.837081] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:22.288778] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-25T20:37:22.393989] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T20:37:23.020087] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T20:37:23.088736] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-25T20:37:23.888781] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-25T20:37:24.329871] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-25T20:37:24.637964] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T20:37:24.688778] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-25T20:37:25.488756] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-25T20:37:25.585289] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T20:37:26.286201] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T20:37:26.296025] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-25T20:37:27.088746] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-25T20:37:27.119348] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T20:37:27.888771] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-25T20:37:27.968055] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T20:37:28.688747] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-25T20:37:28.862224] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T20:37:29.411449] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T20:37:29.420052] [INFO ] [REMOTE ] PAYC: Full fetch complete (52929 records). [2025-09-25T20:37:29.420241] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-25T20:37:29.498808] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-25T20:37:29.865787] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-25T20:37:29.865938] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-25T20:37:29.867567] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-25T20:37:29.867665] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-25T20:37:29.869295] [DEBUG] [LOCAL ] PAYC: Trimmed 52929 records to 36598 (keeping 200 days of data) [2025-09-25T20:37:30.037872] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T20:37:30.058114] [INFO ] [REMOTE ] PB: Full fetch complete (58019 records). [2025-09-25T20:37:30.058324] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-25T20:37:30.293850] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-25T20:37:30.383566] [DEBUG] [LOCAL ] PAYC: Primary data saved (36598 records). [2025-09-25T20:37:30.428775] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-25T20:37:30.468427] [INFO ] [MAIN ] Update Progress: 1636/2372 symbols completed. PAYC took 29.5s. Estimated remaining: 1h 37m 50s. Rate: 7.5 symbols/min [2025-09-25T20:37:30.833835] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:30.940337] [DEBUG] [LOCAL ] PBH: Loaded 31589 existing records from primary storage. [2025-09-25T20:37:30.940538] [INFO ] [MAIN ] PBH: Loaded 31589 existing records. [2025-09-25T20:37:30.952833] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-25T20:37:30.952903] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-25T20:37:30.954292] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-25T20:37:30.954371] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-25T20:37:30.961972] [DEBUG] [LOCAL ] PB: Trimmed 58019 records to 41683 (keeping 200 days of data) [2025-09-25T20:37:31.354096] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T20:37:31.402316] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-25T20:37:31.540600] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:31.540958] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-25T20:37:31.541012] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-25T20:37:31.541357] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-25T20:37:31.541436] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-25T20:37:31.673901] [DEBUG] [LOCAL ] PB: Primary data saved (41683 records). [2025-09-25T20:37:31.674079] [INFO ] [MAIN ] PB: Full history saved. [2025-09-25T20:37:31.674206] [INFO ] [MAIN ] Update Progress: 1637/2372 symbols completed. PB took 26.9s. Estimated remaining: 1h 37m 39s. Rate: 7.5 symbols/min [2025-09-25T20:37:31.997994] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:31.998402] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-25T20:37:32.514314] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-25T20:37:32.688751] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-25T20:37:33.465951] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T20:37:33.471698] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-25T20:37:33.488683] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-25T20:37:34.288777] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-25T20:37:34.618266] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T20:37:34.771732] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T20:37:35.088739] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-25T20:37:35.888737] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-25T20:37:36.023429] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T20:37:36.036247] [INFO ] [REMOTE ] PBA: Full fetch complete (71461 records). [2025-09-25T20:37:36.036448] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-25T20:37:36.491446] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-25T20:37:36.491558] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-25T20:37:36.493171] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-25T20:37:36.493253] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-25T20:37:36.491213] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T20:37:36.498237] [DEBUG] [LOCAL ] PBA: Trimmed 71461 records to 49297 (keeping 200 days of data) [2025-09-25T20:37:36.709418] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-25T20:37:36.852220] [DEBUG] [LOCAL ] PBA: Primary data saved (49297 records). [2025-09-25T20:37:36.852407] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-25T20:37:36.852531] [INFO ] [MAIN ] Update Progress: 1638/2372 symbols completed. PBA took 31.1s. Estimated remaining: 1h 37m 30s. Rate: 7.5 symbols/min [2025-09-25T20:37:37.777335] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:37:37.788873] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-25T20:37:38.137922] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T20:37:38.288753] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-25T20:37:39.708894] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T20:37:39.718572] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-25T20:37:39.798520] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T20:37:39.888725] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-25T20:37:41.149369] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T20:37:41.159540] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-25T20:37:41.707129] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T20:37:41.724509] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-25T20:37:42.165360] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T20:37:42.288757] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-25T20:37:43.585928] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T20:37:43.598497] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-25T20:37:43.739455] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:37:43.888736] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-25T20:37:45.324067] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T20:37:45.335997] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-25T20:37:45.469598] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T20:37:45.488707] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-25T20:37:46.886239] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T20:37:46.896352] [INFO ] [REMOTE ] PBH: Full fetch complete (43018 records). [2025-09-25T20:37:46.896500] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-25T20:37:47.151956] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T20:37:47.167494] [INFO ] [REMOTE ] PBF: Full fetch complete (76576 records). [2025-09-25T20:37:47.167701] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-25T20:37:47.624058] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-25T20:37:47.624152] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-25T20:37:47.625154] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-25T20:37:47.632376] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-25T20:37:47.638452] [DEBUG] [LOCAL ] PBH: Trimmed 43018 records to 31888 (keeping 200 days of data) [2025-09-25T20:37:48.042846] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-25T20:37:48.042942] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-25T20:37:48.043709] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-25T20:37:48.043778] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-25T20:37:48.050359] [DEBUG] [LOCAL ] PBF: Trimmed 76576 records to 53478 (keeping 200 days of data) [2025-09-25T20:37:48.136004] [DEBUG] [LOCAL ] PBH: Primary data saved (31888 records). [2025-09-25T20:37:48.136232] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-25T20:37:48.136350] [INFO ] [MAIN ] Update Progress: 1639/2372 symbols completed. PBH took 17.7s. Estimated remaining: 1h 37m 23s. Rate: 7.5 symbols/min [2025-09-25T20:37:48.416055] [DEBUG] [LOCAL ] PBF: Primary data saved (53478 records). [2025-09-25T20:37:48.416311] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-25T20:37:48.416443] [INFO ] [MAIN ] Update Progress: 1640/2372 symbols completed. PBF took 27.5s. Estimated remaining: 1h 37m 12s. Rate: 7.5 symbols/min [2025-09-25T20:37:49.180223] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:49.187845] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:49.177569] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:49.231279] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:37:49.257118] [DEBUG] [LOCAL ] PCF: Loaded 8630 existing records from primary storage. [2025-09-25T20:37:49.257287] [INFO ] [MAIN ] PCF: Loaded 8630 existing records. [2025-09-25T20:37:49.256061] [DEBUG] [LOCAL ] PBT: Loaded 17360 existing records from primary storage. [2025-09-25T20:37:49.262786] [INFO ] [MAIN ] PBT: Loaded 17360 existing records. [2025-09-25T20:37:49.387171] [DEBUG] [LOCAL ] PBI: Loaded 50024 existing records from primary storage. [2025-09-25T20:37:49.387421] [INFO ] [MAIN ] PBI: Loaded 50024 existing records. [2025-09-25T20:37:49.621501] [DEBUG] [LOCAL ] PBR: Loaded 53713 existing records from primary storage. [2025-09-25T20:37:49.632217] [INFO ] [MAIN ] PBR: Loaded 53713 existing records. [2025-09-25T20:37:50.000771] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:50.001081] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-25T20:37:50.001191] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-25T20:37:50.001531] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-25T20:37:50.001591] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-25T20:37:50.158688] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:50.158989] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-25T20:37:50.159038] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-25T20:37:50.159328] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-25T20:37:50.159391] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-25T20:37:50.343193] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:50.343461] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-25T20:37:50.343517] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-25T20:37:50.356228] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-25T20:37:50.374139] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-25T20:37:50.387198] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:37:50.387419] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-25T20:37:50.387461] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-25T20:37:50.408692] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-25T20:37:50.468877] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-25T20:37:51.648912] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:51.698706] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-25T20:37:51.715236] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:51.751026] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-25T20:37:51.927792] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:51.928201] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-25T20:37:51.970342] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:37:51.970794] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-25T20:37:53.073594] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T20:37:53.080142] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-25T20:37:53.179966] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T20:37:53.186800] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-25T20:37:53.891755] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T20:37:53.894921] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-25T20:37:53.906785] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T20:37:53.929343] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-25T20:37:53.970127] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T20:37:53.974344] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-25T20:37:54.020987] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T20:37:54.035079] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-25T20:37:54.559968] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T20:37:54.563315] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-25T20:37:54.639816] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T20:37:55.088747] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-25T20:37:55.452251] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T20:37:55.469739] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T20:37:55.852605] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T20:37:55.888703] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-25T20:37:56.050951] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T20:37:56.688705] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-25T20:37:56.716306] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:37:57.488719] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-25T20:37:58.291699] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T20:37:58.294397] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-25T20:37:58.881147] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-25T20:37:59.088714] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-25T20:37:59.123205] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T20:37:59.888799] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-25T20:38:00.688872] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-25T20:38:01.170389] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T20:38:01.449598] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-25T20:38:01.488697] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-25T20:38:02.288717] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-25T20:38:02.616559] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T20:38:03.088752] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-25T20:38:03.438527] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T20:38:03.849583] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-25T20:38:03.888735] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-25T20:38:04.629046] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T20:38:04.688737] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-25T20:38:05.054534] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:38:05.488735] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-25T20:38:06.288760] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-25T20:38:06.614309] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T20:38:06.726741] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T20:38:07.088760] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-25T20:38:07.888696] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-25T20:38:08.224731] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T20:38:08.504680] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T20:38:08.653316] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-25T20:38:08.688715] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-25T20:38:09.488771] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-25T20:38:09.573341] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T20:38:10.288827] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-25T20:38:11.088772] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-25T20:38:11.745593] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-25T20:38:11.888716] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-25T20:38:12.181432] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:38:12.227481] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T20:38:12.233782] [INFO ] [REMOTE ] PBT: Full fetch complete (25359 records). [2025-09-25T20:38:12.234000] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-25T20:38:12.700880] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-25T20:38:12.703998] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-25T20:38:12.704059] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-25T20:38:12.704878] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-25T20:38:12.705188] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-25T20:38:12.706887] [DEBUG] [LOCAL ] PBT: Trimmed 25359 records to 17462 (keeping 200 days of data) [2025-09-25T20:38:12.840698] [DEBUG] [LOCAL ] PBT: Primary data saved (17462 records). [2025-09-25T20:38:12.840892] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-25T20:38:12.841121] [INFO ] [MAIN ] Update Progress: 1641/2372 symbols completed. PBT took 24.4s. Estimated remaining: 1h 37m 11s. Rate: 7.5 symbols/min [2025-09-25T20:38:13.026992] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:13.027250] [DEBUG] [LOCAL ] PCG: No existing data file found in primary storage. [2025-09-25T20:38:13.027309] [WARN ] [MAIN ] PCG: No existing data found, performing full refresh instead. [2025-09-25T20:38:13.027774] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-25T20:38:13.027841] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-25T20:38:13.027912] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-25T20:38:13.027980] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-25T20:38:13.408959] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:13.488735] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-25T20:38:14.255311] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-25T20:38:14.288685] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-25T20:38:14.441714] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:38:15.048975] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T20:38:15.088735] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-25T20:38:15.888732] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-25T20:38:16.601006] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-25T20:38:16.688695] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-25T20:38:17.136939] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:38:17.147316] [INFO ] [REMOTE ] PCF: Full fetch complete (14337 records). [2025-09-25T20:38:17.147476] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-25T20:38:17.169905] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-25T20:38:17.494734] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-25T20:38:17.618116] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-25T20:38:17.618230] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-25T20:38:17.618635] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-25T20:38:17.618720] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-25T20:38:17.619292] [DEBUG] [LOCAL ] PCF: Trimmed 14337 records to 8669 (keeping 200 days of data) [2025-09-25T20:38:17.684383] [DEBUG] [LOCAL ] PCF: Primary data saved (8669 records). [2025-09-25T20:38:17.684547] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-25T20:38:17.684759] [INFO ] [MAIN ] Update Progress: 1642/2372 symbols completed. PCF took 29.3s. Estimated remaining: 1h 37m 2s. Rate: 7.5 symbols/min [2025-09-25T20:38:17.888155] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:17.908342] [DEBUG] [LOCAL ] PCM: Loaded 6803 existing records from primary storage. [2025-09-25T20:38:17.908489] [INFO ] [MAIN ] PCM: Loaded 6803 existing records. [2025-09-25T20:38:18.119859] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:38:18.120220] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-25T20:38:18.120270] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-25T20:38:18.120897] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-25T20:38:18.120961] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-25T20:38:18.302741] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-25T20:38:18.514483] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:18.819724] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-25T20:38:18.829846] [INFO ] [REMOTE ] PBR: Full fetch complete (77777 records). [2025-09-25T20:38:18.829993] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-25T20:38:19.095726] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-25T20:38:19.292474] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T20:38:19.333477] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-25T20:38:19.333565] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-25T20:38:19.334803] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-25T20:38:19.334893] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-25T20:38:19.337758] [DEBUG] [LOCAL ] PBR: Trimmed 77777 records to 54103 (keeping 200 days of data) [2025-09-25T20:38:19.709751] [DEBUG] [LOCAL ] PBR: Primary data saved (54103 records). [2025-09-25T20:38:19.709922] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-25T20:38:19.710117] [INFO ] [MAIN ] Update Progress: 1643/2372 symbols completed. PBR took 31.3s. Estimated remaining: 1h 36m 51s. Rate: 7.5 symbols/min [2025-09-25T20:38:19.893001] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-25T20:38:19.899061] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:19.935200] [DEBUG] [LOCAL ] PCN: Loaded 24313 existing records from primary storage. [2025-09-25T20:38:19.935347] [INFO ] [MAIN ] PCN: Loaded 24313 existing records. [2025-09-25T20:38:20.181351] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:38:20.174898] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:38:20.193537] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-25T20:38:20.193593] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-25T20:38:20.193937] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-25T20:38:20.193999] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-25T20:38:20.225865] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:38:20.639384] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:20.688682] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-25T20:38:21.488690] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-25T20:38:21.602564] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:38:21.856547] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T20:38:22.288733] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-25T20:38:23.067740] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T20:38:23.088289] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:38:23.093203] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-25T20:38:23.885388] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T20:38:23.890319] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-25T20:38:24.531316] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T20:38:24.688742] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-25T20:38:25.488746] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-25T20:38:26.288731] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-25T20:38:26.689953] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T20:38:26.728185] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T20:38:27.007804] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T20:38:27.088746] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-25T20:38:27.888718] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-25T20:38:28.185668] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T20:38:28.688768] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-25T20:38:29.478894] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:38:29.488710] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-25T20:38:29.900718] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T20:38:30.288738] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-25T20:38:30.975603] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T20:38:30.986956] [INFO ] [REMOTE ] PBI: Full fetch complete (71963 records). [2025-09-25T20:38:30.987135] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-25T20:38:31.094759] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-25T20:38:31.135387] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T20:38:31.427195] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-25T20:38:31.427288] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-25T20:38:31.428546] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-25T20:38:31.428619] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-25T20:38:31.430264] [DEBUG] [LOCAL ] PBI: Trimmed 71963 records to 50410 (keeping 200 days of data) [2025-09-25T20:38:31.762174] [DEBUG] [LOCAL ] PBI: Primary data saved (50410 records). [2025-09-25T20:38:31.762343] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-25T20:38:31.762437] [INFO ] [MAIN ] Update Progress: 1644/2372 symbols completed. PBI took 43.3s. Estimated remaining: 1h 36m 45s. Rate: 7.5 symbols/min [2025-09-25T20:38:31.893833] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-25T20:38:31.960277] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:32.012387] [DEBUG] [LOCAL ] PCOR: Loaded 48193 existing records from primary storage. [2025-09-25T20:38:32.012551] [INFO ] [MAIN ] PCOR: Loaded 48193 existing records. [2025-09-25T20:38:32.202743] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:38:32.203038] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-25T20:38:32.203085] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-25T20:38:32.203444] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-25T20:38:32.203505] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-25T20:38:32.450812] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T20:38:32.664231] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:32.688679] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-25T20:38:33.488718] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-25T20:38:34.004674] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-25T20:38:34.036387] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T20:38:34.288815] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-25T20:38:34.441675] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:38:35.088693] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-25T20:38:35.136261] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T20:38:35.138959] [INFO ] [REMOTE ] PCM: Full fetch complete (10408 records). [2025-09-25T20:38:35.139040] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-25T20:38:35.531382] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-25T20:38:35.531480] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-25T20:38:35.531837] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-25T20:38:35.531901] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-25T20:38:35.532397] [DEBUG] [LOCAL ] PCM: Trimmed 10408 records to 6827 (keeping 200 days of data) [2025-09-25T20:38:35.574043] [DEBUG] [LOCAL ] PCM: Primary data saved (6827 records). [2025-09-25T20:38:35.574219] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-25T20:38:35.574327] [INFO ] [MAIN ] Update Progress: 1645/2372 symbols completed. PCM took 17.9s. Estimated remaining: 1h 36m 35s. Rate: 7.5 symbols/min [2025-09-25T20:38:35.753278] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:35.773101] [DEBUG] [LOCAL ] PCQ: Loaded 11972 existing records from primary storage. [2025-09-25T20:38:35.773254] [INFO ] [MAIN ] PCQ: Loaded 11972 existing records. [2025-09-25T20:38:35.894740] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-25T20:38:35.976345] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:38:35.977535] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-25T20:38:35.977595] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-25T20:38:35.977906] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-25T20:38:35.977969] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-25T20:38:36.372222] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T20:38:36.384987] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:36.688730] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-25T20:38:37.488817] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-25T20:38:37.901001] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T20:38:37.980788] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T20:38:38.288736] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-25T20:38:38.844151] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:38:39.088729] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-25T20:38:39.888733] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-25T20:38:40.003377] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T20:38:40.688694] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-25T20:38:41.154818] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T20:38:41.246436] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T20:38:41.488797] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-25T20:38:42.163790] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:38:42.288738] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-25T20:38:42.796530] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T20:38:43.088703] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-25T20:38:43.888743] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-25T20:38:44.268950] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:38:44.299433] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T20:38:44.688753] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-25T20:38:44.746518] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T20:38:45.488887] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-25T20:38:46.288747] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-25T20:38:46.517823] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T20:38:46.529081] [INFO ] [REMOTE ] PCG: Full fetch complete (77345 records). [2025-09-25T20:38:46.529332] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-25T20:38:46.531110] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:38:46.531214] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:38:46.531300] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:38:46.531425] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-25T20:38:46.531749] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-25T20:38:46.531847] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-25T20:38:46.531961] [DEBUG] [LOCAL ] PCG: No derivative data file found to delete. [2025-09-25T20:38:46.532200] [INFO ] [MAIN ] Update Progress: 1646/2372 symbols completed. PCG took 33.7s. Estimated remaining: 1h 36m 28s. Rate: 7.5 symbols/min [2025-09-25T20:38:46.724663] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T20:38:46.845562] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:46.921976] [DEBUG] [LOCAL ] PD: Loaded 47875 existing records from primary storage. [2025-09-25T20:38:46.922148] [INFO ] [MAIN ] PD: Loaded 47875 existing records. [2025-09-25T20:38:47.095968] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-25T20:38:47.134268] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:38:47.134535] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-25T20:38:47.134582] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-25T20:38:47.135087] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-25T20:38:47.135147] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-25T20:38:47.158518] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:38:47.519754] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:47.888721] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-25T20:38:48.688718] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-25T20:38:48.751584] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:38:48.912093] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T20:38:49.488801] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-25T20:38:49.825211] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T20:38:49.833130] [INFO ] [REMOTE ] PCN: Full fetch complete (33996 records). [2025-09-25T20:38:49.833295] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-25T20:38:50.264990] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-25T20:38:50.265105] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-25T20:38:50.266031] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-25T20:38:50.266134] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-25T20:38:50.267665] [DEBUG] [LOCAL ] PCN: Trimmed 33996 records to 24500 (keeping 200 days of data) [2025-09-25T20:38:50.341506] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-25T20:38:50.455405] [DEBUG] [LOCAL ] PCN: Primary data saved (24500 records). [2025-09-25T20:38:50.455552] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-25T20:38:50.455686] [INFO ] [MAIN ] Update Progress: 1647/2372 symbols completed. PCN took 30.7s. Estimated remaining: 1h 36m 19s. Rate: 7.5 symbols/min [2025-09-25T20:38:50.650062] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:38:50.650272] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-25T20:38:50.650312] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-25T20:38:50.650445] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-25T20:38:50.650486] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-25T20:38:50.650529] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-25T20:38:50.650758] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-25T20:38:51.053554] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:38:51.088703] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-25T20:38:51.130682] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T20:38:51.450760] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T20:38:51.569265] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T20:38:51.888729] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-25T20:38:52.688727] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-25T20:38:52.741415] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:38:53.488734] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-25T20:38:54.246857] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T20:38:54.288740] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-25T20:38:54.337390] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T20:38:55.088693] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-25T20:38:55.122450] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T20:38:55.888800] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-25T20:38:56.679099] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T20:38:56.688922] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-25T20:38:57.460245] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T20:38:57.488676] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-25T20:38:57.822999] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T20:38:58.288775] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-25T20:38:59.088721] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-25T20:38:59.179878] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T20:38:59.342146] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T20:38:59.888780] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-25T20:39:00.688852] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-25T20:39:00.763936] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T20:39:01.488763] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-25T20:39:01.671959] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:39:01.714600] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T20:39:01.721251] [INFO ] [REMOTE ] PCQ: Full fetch complete (17576 records). [2025-09-25T20:39:01.721518] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-25T20:39:02.144275] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-25T20:39:02.144407] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-25T20:39:02.144978] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-25T20:39:02.145047] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-25T20:39:02.146121] [DEBUG] [LOCAL ] PCQ: Trimmed 17576 records to 12229 (keeping 200 days of data) [2025-09-25T20:39:02.236155] [DEBUG] [LOCAL ] PCQ: Primary data saved (12229 records). [2025-09-25T20:39:02.236356] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-25T20:39:02.236530] [INFO ] [MAIN ] Update Progress: 1648/2372 symbols completed. PCQ took 26.7s. Estimated remaining: 1h 36m 12s. Rate: 7.5 symbols/min [2025-09-25T20:39:02.293807] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-25T20:39:02.454130] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:02.529232] [DEBUG] [LOCAL ] PDI: Loaded 50205 existing records from primary storage. [2025-09-25T20:39:02.529401] [INFO ] [MAIN ] PDI: Loaded 50205 existing records. [2025-09-25T20:39:02.736631] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:02.737073] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-25T20:39:02.737144] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-25T20:39:02.737528] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-25T20:39:02.737590] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-25T20:39:03.078359] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T20:39:03.100827] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-25T20:39:03.217397] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:03.411581] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-25T20:39:03.888725] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-25T20:39:04.032889] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T20:39:04.044166] [INFO ] [REMOTE ] PCOR: Full fetch complete (69668 records). [2025-09-25T20:39:04.044380] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-25T20:39:04.510499] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-25T20:39:04.510603] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-25T20:39:04.511862] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-25T20:39:04.511938] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-25T20:39:04.513527] [DEBUG] [LOCAL ] PCOR: Trimmed 69668 records to 48522 (keeping 200 days of data) [2025-09-25T20:39:04.704923] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-25T20:39:04.849724] [DEBUG] [LOCAL ] PCOR: Primary data saved (48522 records). [2025-09-25T20:39:04.849886] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-25T20:39:04.850144] [INFO ] [MAIN ] Update Progress: 1649/2372 symbols completed. PCOR took 33.1s. Estimated remaining: 1h 36m 2s. Rate: 7.5 symbols/min [2025-09-25T20:39:05.041235] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:05.093027] [DEBUG] [LOCAL ] PDM: Loaded 39873 existing records from primary storage. [2025-09-25T20:39:05.093208] [INFO ] [MAIN ] PDM: Loaded 39873 existing records. [2025-09-25T20:39:05.213395] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T20:39:05.305390] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:05.305842] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-25T20:39:05.305893] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-25T20:39:05.306148] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-25T20:39:05.306261] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-25T20:39:05.494838] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-25T20:39:05.667100] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T20:39:05.743313] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:05.841814] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-25T20:39:06.288801] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-25T20:39:07.088759] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-25T20:39:07.816235] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T20:39:07.888747] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-25T20:39:08.688810] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-25T20:39:08.743032] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T20:39:09.488754] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-25T20:39:10.085533] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T20:39:10.165799] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:39:10.288785] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-25T20:39:11.088805] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-25T20:39:11.154988] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T20:39:11.888698] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-25T20:39:12.069594] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T20:39:12.103894] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T20:39:12.420777] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-25T20:39:12.688760] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-25T20:39:13.488784] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-25T20:39:14.288762] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-25T20:39:14.780230] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-25T20:39:14.917842] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T20:39:15.088734] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-25T20:39:15.888709] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-25T20:39:15.940796] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T20:39:16.303926] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T20:39:16.688762] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-25T20:39:16.980968] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T20:39:16.990610] [INFO ] [REMOTE ] PD: Full fetch complete (67535 records). [2025-09-25T20:39:16.990795] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-25T20:39:17.412545] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-25T20:39:17.413412] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-25T20:39:17.414516] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-25T20:39:17.414585] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-25T20:39:17.416117] [DEBUG] [LOCAL ] PD: Trimmed 67535 records to 48235 (keeping 200 days of data) [2025-09-25T20:39:17.512834] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-25T20:39:17.730115] [DEBUG] [LOCAL ] PD: Primary data saved (48235 records). [2025-09-25T20:39:17.730281] [INFO ] [MAIN ] PD: Full history saved. [2025-09-25T20:39:17.732132] [INFO ] [MAIN ] Update Progress: 1650/2372 symbols completed. PD took 31.2s. Estimated remaining: 1h 35m 56s. Rate: 7.5 symbols/min [2025-09-25T20:39:17.908534] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T20:39:17.919028] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:17.959555] [DEBUG] [LOCAL ] PDO: Loaded 31740 existing records from primary storage. [2025-09-25T20:39:17.959805] [INFO ] [MAIN ] PDO: Loaded 31740 existing records. [2025-09-25T20:39:18.158857] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:18.159178] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-25T20:39:18.159247] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-25T20:39:18.159565] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-25T20:39:18.159638] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-25T20:39:18.293811] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-25T20:39:18.419442] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T20:39:18.629375] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:18.712932] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T20:39:19.088734] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-25T20:39:19.483556] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-25T20:39:19.888725] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-25T20:39:20.688777] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-25T20:39:21.488744] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-25T20:39:21.846928] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:39:22.288734] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-25T20:39:22.476377] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T20:39:22.895949] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T20:39:23.088747] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-25T20:39:23.888690] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-25T20:39:24.271154] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-25T20:39:24.272441] [INFO ] [REMOTE ] PDCC: Full fetch complete (1345 records). [2025-09-25T20:39:24.272580] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-25T20:39:24.364792] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T20:39:24.533599] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-25T20:39:24.533909] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:39:24.533989] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:39:24.534058] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-25T20:39:24.534121] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-25T20:39:24.534158] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-25T20:39:24.534264] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-25T20:39:24.534353] [INFO ] [MAIN ] Update Progress: 1651/2372 symbols completed. PDCC took 34.1s. Estimated remaining: 1h 35m 48s. Rate: 7.5 symbols/min [2025-09-25T20:39:24.694023] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-25T20:39:24.720571] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T20:39:24.747470] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:24.793609] [DEBUG] [LOCAL ] PDS: Loaded 18126 existing records from primary storage. [2025-09-25T20:39:24.793793] [INFO ] [MAIN ] PDS: Loaded 18126 existing records. [2025-09-25T20:39:24.998128] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:24.998502] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-25T20:39:24.998552] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-25T20:39:24.998973] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-25T20:39:24.999034] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-25T20:39:25.400976] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:25.488721] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-25T20:39:26.288697] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-25T20:39:26.603382] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T20:39:26.924698] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:39:27.088709] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-25T20:39:27.403116] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T20:39:27.888753] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-25T20:39:28.087598] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T20:39:28.688868] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-25T20:39:29.353269] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T20:39:29.488685] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-25T20:39:29.773013] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T20:39:30.288729] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-25T20:39:30.938676] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T20:39:31.088764] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-25T20:39:31.754729] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T20:39:31.888758] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-25T20:39:32.510059] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T20:39:32.688689] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-25T20:39:33.488709] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-25T20:39:33.886401] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T20:39:33.919752] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T20:39:34.182084] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T20:39:34.288732] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-25T20:39:35.088795] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-25T20:39:35.709785] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T20:39:35.888708] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-25T20:39:36.562127] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T20:39:36.688737] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-25T20:39:37.570599] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-25T20:39:37.594412] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T20:39:38.245769] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T20:39:38.288740] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-25T20:39:39.090721] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-25T20:39:39.588705] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T20:39:39.596024] [INFO ] [REMOTE ] PDO: Full fetch complete (47976 records). [2025-09-25T20:39:39.596320] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-25T20:39:39.738791] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-25T20:39:39.888834] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-25T20:39:40.161563] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-25T20:39:40.161690] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-25T20:39:40.162608] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-25T20:39:40.162692] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-25T20:39:40.167530] [DEBUG] [LOCAL ] PDO: Trimmed 47976 records to 31936 (keeping 200 days of data) [2025-09-25T20:39:40.406074] [DEBUG] [LOCAL ] PDO: Primary data saved (31936 records). [2025-09-25T20:39:40.406321] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-25T20:39:40.407264] [INFO ] [MAIN ] Update Progress: 1652/2372 symbols completed. PDO took 22.7s. Estimated remaining: 1h 35m 43s. Rate: 7.5 symbols/min [2025-09-25T20:39:40.645280] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T20:39:40.653343] [INFO ] [REMOTE ] PDM: Full fetch complete (57359 records). [2025-09-25T20:39:40.653553] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-25T20:39:40.692776] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-25T20:39:40.658595] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:40.818502] [DEBUG] [LOCAL ] PDT: Loaded 17234 existing records from primary storage. [2025-09-25T20:39:40.818688] [INFO ] [MAIN ] PDT: Loaded 17234 existing records. [2025-09-25T20:39:41.249511] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:41.249920] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-25T20:39:41.249973] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-25T20:39:41.250478] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-25T20:39:41.250553] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-25T20:39:41.445922] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-25T20:39:41.446021] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-25T20:39:41.447102] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-25T20:39:41.447167] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-25T20:39:41.448399] [DEBUG] [LOCAL ] PDM: Trimmed 57359 records to 40139 (keeping 200 days of data) [2025-09-25T20:39:42.010242] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T20:39:42.035407] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-25T20:39:42.052023] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:42.057628] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T20:39:42.081772] [INFO ] [REMOTE ] PDI: Full fetch complete (73090 records). [2025-09-25T20:39:42.081954] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-25T20:39:42.125245] [DEBUG] [LOCAL ] PDM: Primary data saved (40139 records). [2025-09-25T20:39:42.125379] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-25T20:39:42.125478] [INFO ] [MAIN ] Update Progress: 1653/2372 symbols completed. PDM took 37.3s. Estimated remaining: 1h 35m 32s. Rate: 7.5 symbols/min [2025-09-25T20:39:42.303852] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-25T20:39:42.455495] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:42.652507] [DEBUG] [LOCAL ] PDX: Loaded 14310 existing records from primary storage. [2025-09-25T20:39:42.663809] [INFO ] [MAIN ] PDX: Loaded 14310 existing records. [2025-09-25T20:39:42.947979] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-25T20:39:42.948068] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-25T20:39:42.949188] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-25T20:39:42.949260] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-25T20:39:42.954432] [DEBUG] [LOCAL ] PDI: Trimmed 73090 records to 50558 (keeping 200 days of data) [2025-09-25T20:39:43.060524] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:43.090938] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-25T20:39:43.091017] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-25T20:39:43.091345] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-25T20:39:43.091408] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-25T20:39:43.567433] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-25T20:39:43.597158] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-25T20:39:43.776762] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:43.781893] [DEBUG] [LOCAL ] PDI: Primary data saved (50558 records). [2025-09-25T20:39:43.781980] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-25T20:39:43.782094] [INFO ] [MAIN ] Update Progress: 1654/2372 symbols completed. PDI took 41.5s. Estimated remaining: 1h 35m 22s. Rate: 7.5 symbols/min [2025-09-25T20:39:43.846054] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T20:39:43.895732] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-25T20:39:43.993868] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:44.054604] [DEBUG] [LOCAL ] PEB: Loaded 50706 existing records from primary storage. [2025-09-25T20:39:44.054791] [INFO ] [MAIN ] PEB: Loaded 50706 existing records. [2025-09-25T20:39:44.237345] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:39:44.237720] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-25T20:39:44.237776] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-25T20:39:44.238121] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-25T20:39:44.238180] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-25T20:39:44.618417] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:44.688751] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-25T20:39:44.780174] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T20:39:45.087262] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T20:39:45.488700] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-25T20:39:45.697801] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T20:39:46.288733] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-25T20:39:47.065180] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T20:39:47.088681] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-25T20:39:47.481852] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T20:39:47.888743] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-25T20:39:48.457618] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T20:39:48.688767] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-25T20:39:49.312772] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T20:39:49.488690] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-25T20:39:49.700295] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T20:39:50.288734] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-25T20:39:51.088749] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-25T20:39:51.127065] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T20:39:51.373943] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:39:51.863058] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T20:39:51.888747] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-25T20:39:52.688873] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-25T20:39:52.910178] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T20:39:53.488786] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-25T20:39:53.754842] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T20:39:54.256607] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T20:39:54.288710] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-25T20:39:55.088843] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-25T20:39:55.206047] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T20:39:55.888758] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-25T20:39:56.066346] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T20:39:56.688740] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-25T20:39:57.111126] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T20:39:57.488710] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-25T20:39:57.622135] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T20:39:57.625881] [INFO ] [REMOTE ] PDS: Full fetch complete (25660 records). [2025-09-25T20:39:57.625983] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-25T20:39:58.024023] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-25T20:39:58.024137] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-25T20:39:58.024799] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-25T20:39:58.024891] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-25T20:39:58.025768] [DEBUG] [LOCAL ] PDS: Trimmed 25660 records to 18211 (keeping 200 days of data) [2025-09-25T20:39:58.151369] [DEBUG] [LOCAL ] PDS: Primary data saved (18211 records). [2025-09-25T20:39:58.151531] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-25T20:39:58.151689] [INFO ] [MAIN ] Update Progress: 1655/2372 symbols completed. PDS took 33.6s. Estimated remaining: 1h 35m 17s. Rate: 7.5 symbols/min [2025-09-25T20:39:58.293788] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-25T20:39:58.358528] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:39:58.358989] [DEBUG] [LOCAL ] PEG: No existing data file found in primary storage. [2025-09-25T20:39:58.359047] [WARN ] [MAIN ] PEG: No existing data found, performing full refresh instead. [2025-09-25T20:39:58.359303] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-25T20:39:58.359439] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-25T20:39:58.359512] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-25T20:39:58.359569] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-25T20:39:58.682573] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T20:39:58.773825] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:39:59.088750] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-25T20:39:59.888709] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-25T20:40:00.132989] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:40:00.252314] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T20:40:00.688696] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-25T20:40:00.886870] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T20:40:01.488751] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-25T20:40:01.828394] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T20:40:02.288729] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-25T20:40:03.088703] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-25T20:40:03.324689] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T20:40:03.345273] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T20:40:03.349538] [INFO ] [REMOTE ] PDT: Full fetch complete (25046 records). [2025-09-25T20:40:03.349707] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-25T20:40:03.764117] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T20:40:03.767081] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-25T20:40:03.767143] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-25T20:40:03.767758] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-25T20:40:03.767823] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-25T20:40:03.768597] [DEBUG] [LOCAL ] PDT: Trimmed 25046 records to 17362 (keeping 200 days of data) [2025-09-25T20:40:03.886740] [DEBUG] [LOCAL ] PDT: Primary data saved (17362 records). [2025-09-25T20:40:03.888684] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-25T20:40:03.886910] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-25T20:40:03.891822] [INFO ] [MAIN ] Update Progress: 1656/2372 symbols completed. PDT took 23.5s. Estimated remaining: 1h 35m 8s. Rate: 7.5 symbols/min [2025-09-25T20:40:04.091169] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:04.130423] [DEBUG] [LOCAL ] PEN: Loaded 30504 existing records from primary storage. [2025-09-25T20:40:04.130636] [INFO ] [MAIN ] PEN: Loaded 30504 existing records. [2025-09-25T20:40:04.330770] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:40:04.331037] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-25T20:40:04.331086] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-25T20:40:04.331456] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-25T20:40:04.331519] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-25T20:40:04.699318] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-25T20:40:04.750975] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:05.488732] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-25T20:40:05.719055] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T20:40:05.812668] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:40:06.288739] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-25T20:40:06.483538] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:40:07.088772] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-25T20:40:07.888793] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-25T20:40:08.162041] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T20:40:08.470990] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T20:40:08.688788] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-25T20:40:08.927465] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T20:40:09.488741] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-25T20:40:09.686260] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T20:40:09.690311] [INFO ] [REMOTE ] PDX: Full fetch complete (24577 records). [2025-09-25T20:40:09.690414] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-25T20:40:10.104029] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-25T20:40:10.104117] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-25T20:40:10.104725] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-25T20:40:10.104788] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-25T20:40:10.105448] [DEBUG] [LOCAL ] PDX: Trimmed 24577 records to 14398 (keeping 200 days of data) [2025-09-25T20:40:10.200226] [DEBUG] [LOCAL ] PDX: Primary data saved (14398 records). [2025-09-25T20:40:10.200387] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-25T20:40:10.200511] [INFO ] [MAIN ] Update Progress: 1657/2372 symbols completed. PDX took 28.1s. Estimated remaining: 1h 34m 59s. Rate: 7.5 symbols/min [2025-09-25T20:40:10.293267] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-25T20:40:10.399519] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:10.417620] [DEBUG] [LOCAL ] PEO: Loaded 10831 existing records from primary storage. [2025-09-25T20:40:10.417803] [INFO ] [MAIN ] PEO: Loaded 10831 existing records. [2025-09-25T20:40:10.613546] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:40:10.615967] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-25T20:40:10.616038] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-25T20:40:10.616422] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-25T20:40:10.616492] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-25T20:40:10.844520] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:40:11.045895] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:11.088721] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-25T20:40:11.888946] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-25T20:40:12.060201] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T20:40:12.640898] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T20:40:12.688750] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-25T20:40:12.781108] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T20:40:13.488974] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-25T20:40:14.198423] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T20:40:14.288781] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-25T20:40:15.088804] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-25T20:40:15.357231] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:40:15.888712] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-25T20:40:16.208056] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T20:40:16.269301] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T20:40:16.688777] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-25T20:40:17.488727] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-25T20:40:17.538032] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T20:40:17.805058] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T20:40:18.288752] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-25T20:40:19.031885] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T20:40:19.088762] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-25T20:40:19.888834] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-25T20:40:20.310127] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T20:40:20.690270] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-25T20:40:20.694232] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T20:40:20.762701] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T20:40:21.488846] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-25T20:40:22.288752] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-25T20:40:22.660123] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-25T20:40:22.852478] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T20:40:23.088778] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-25T20:40:23.888759] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-25T20:40:24.243089] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:40:24.276834] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T20:40:24.688719] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-25T20:40:24.994761] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T20:40:25.488755] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-25T20:40:26.288708] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-25T20:40:26.349424] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T20:40:26.740882] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T20:40:27.088744] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-25T20:40:27.806123] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T20:40:27.888688] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-25T20:40:28.150853] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T20:40:28.688742] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-25T20:40:29.488744] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-25T20:40:29.586089] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T20:40:29.599777] [INFO ] [REMOTE ] PEB: Full fetch complete (72748 records). [2025-09-25T20:40:29.600115] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-25T20:40:29.976632] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:40:30.006874] [INFO ] [REMOTE ] PEN: Full fetch complete (44138 records). [2025-09-25T20:40:30.007059] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-25T20:40:30.130428] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T20:40:30.177090] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-25T20:40:30.177226] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-25T20:40:30.178775] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-25T20:40:30.178941] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-25T20:40:30.189153] [DEBUG] [LOCAL ] PEB: Trimmed 72748 records to 51087 (keeping 200 days of data) [2025-09-25T20:40:30.297354] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-25T20:40:31.001578] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-25T20:40:31.001744] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-25T20:40:31.006415] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-25T20:40:31.006566] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-25T20:40:31.008374] [DEBUG] [LOCAL ] PEN: Trimmed 44138 records to 30702 (keeping 200 days of data) [2025-09-25T20:40:31.158720] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-25T20:40:31.323777] [DEBUG] [LOCAL ] PEB: Primary data saved (51087 records). [2025-09-25T20:40:31.323965] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-25T20:40:31.324103] [INFO ] [MAIN ] Update Progress: 1658/2372 symbols completed. PEB took 47.5s. Estimated remaining: 1h 34m 57s. Rate: 7.5 symbols/min [2025-09-25T20:40:31.497390] [DEBUG] [LOCAL ] PEN: Primary data saved (30702 records). [2025-09-25T20:40:31.497566] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-25T20:40:31.499727] [INFO ] [MAIN ] Update Progress: 1659/2372 symbols completed. PEN took 27.6s. Estimated remaining: 1h 34m 45s. Rate: 7.5 symbols/min [2025-09-25T20:40:31.882602] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:31.882812] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-25T20:40:31.885988] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:31.882857] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-25T20:40:31.886990] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-25T20:40:31.887037] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-25T20:40:31.887080] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-25T20:40:31.887113] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-25T20:40:31.959443] [DEBUG] [LOCAL ] PERF: Loaded 14031 existing records from primary storage. [2025-09-25T20:40:31.959589] [INFO ] [MAIN ] PERF: Loaded 14031 existing records. [2025-09-25T20:40:32.344011] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:40:32.382703] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-25T20:40:32.382822] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-25T20:40:32.383178] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-25T20:40:32.383238] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-25T20:40:32.422832] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-25T20:40:32.476763] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-25T20:40:32.478780] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T20:40:32.720752] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-25T20:40:32.786008] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:33.041804] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:33.311392] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:40:33.322135] [INFO ] [REMOTE ] PEG: Full fetch complete (76282 records). [2025-09-25T20:40:33.322309] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-25T20:40:33.327121] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:40:33.327294] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:40:33.327588] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:40:33.327788] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-25T20:40:33.335253] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-25T20:40:33.336469] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T20:40:33.335472] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-25T20:40:33.339997] [DEBUG] [LOCAL ] PEG: No derivative data file found to delete. [2025-09-25T20:40:33.340102] [INFO ] [MAIN ] Update Progress: 1660/2372 symbols completed. PEG took 35.2s. Estimated remaining: 1h 34m 35s. Rate: 7.5 symbols/min [2025-09-25T20:40:33.493754] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-25T20:40:33.561808] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:33.572569] [DEBUG] [LOCAL ] PFD: Loaded 5133 existing records from primary storage. [2025-09-25T20:40:33.572742] [INFO ] [MAIN ] PFD: Loaded 5133 existing records. [2025-09-25T20:40:33.756679] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:40:33.757273] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-25T20:40:33.757322] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-25T20:40:33.757596] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-25T20:40:33.760734] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-25T20:40:34.158915] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:34.288749] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-25T20:40:34.454874] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T20:40:34.457846] [INFO ] [REMOTE ] PEO: Full fetch complete (16413 records). [2025-09-25T20:40:34.457953] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-25T20:40:34.922230] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-25T20:40:34.922314] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-25T20:40:34.922748] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-25T20:40:34.922811] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-25T20:40:34.924021] [DEBUG] [LOCAL ] PEO: Trimmed 16413 records to 10897 (keeping 200 days of data) [2025-09-25T20:40:35.003500] [DEBUG] [LOCAL ] PEO: Primary data saved (10897 records). [2025-09-25T20:40:35.003707] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-25T20:40:35.003825] [INFO ] [MAIN ] Update Progress: 1661/2372 symbols completed. PEO took 24.8s. Estimated remaining: 1h 34m 24s. Rate: 7.5 symbols/min [2025-09-25T20:40:35.060412] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T20:40:35.089810] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-25T20:40:35.197518] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:35.197748] [DEBUG] [LOCAL ] PFE: No existing data file found in primary storage. [2025-09-25T20:40:35.197805] [WARN ] [MAIN ] PFE: No existing data found, performing full refresh instead. [2025-09-25T20:40:35.198618] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-25T20:40:35.198703] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-25T20:40:35.198763] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-25T20:40:35.198800] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-25T20:40:35.580540] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:35.759070] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T20:40:35.888739] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-25T20:40:36.175708] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:36.176080] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-25T20:40:36.688723] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-25T20:40:37.488746] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-25T20:40:37.751050] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:37.751416] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-25T20:40:38.288774] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-25T20:40:38.861591] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T20:40:39.088695] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-25T20:40:39.206130] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-25T20:40:39.888748] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-25T20:40:40.136017] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:40.136403] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-25T20:40:40.285007] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T20:40:40.688732] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-25T20:40:41.488842] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-25T20:40:42.124035] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T20:40:42.288761] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-25T20:40:42.927294] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-25T20:40:43.088841] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-25T20:40:43.392777] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-25T20:40:43.747987] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T20:40:43.888785] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-25T20:40:44.191157] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:44.191730] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-25T20:40:44.688831] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-25T20:40:44.989301] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:44.989697] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-25T20:40:45.488830] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-25T20:40:46.288873] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-25T20:40:46.551215] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:46.551687] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-25T20:40:47.088772] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-25T20:40:47.695246] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T20:40:47.888760] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-25T20:40:47.981479] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-25T20:40:48.688751] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-25T20:40:49.010932] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:40:49.488826] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-25T20:40:49.582869] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T20:40:50.288896] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-25T20:40:51.036714] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T20:40:51.088675] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-25T20:40:51.765845] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T20:40:51.768237] [INFO ] [REMOTE ] PFD: Full fetch complete (7372 records). [2025-09-25T20:40:51.768411] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-25T20:40:51.893900] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-25T20:40:52.183659] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-25T20:40:52.183793] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-25T20:40:52.184127] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-25T20:40:52.184354] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-25T20:40:52.188969] [DEBUG] [LOCAL ] PFD: Trimmed 7372 records to 5163 (keeping 200 days of data) [2025-09-25T20:40:52.246666] [DEBUG] [LOCAL ] PFD: Primary data saved (5163 records). [2025-09-25T20:40:52.246883] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-25T20:40:52.247119] [INFO ] [MAIN ] Update Progress: 1662/2372 symbols completed. PFD took 18.9s. Estimated remaining: 1h 34m 20s. Rate: 7.5 symbols/min [2025-09-25T20:40:52.454006] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-25T20:40:52.515326] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:40:52.596154] [DEBUG] [LOCAL ] PFGC: Loaded 46955 existing records from primary storage. [2025-09-25T20:40:52.596447] [INFO ] [MAIN ] PFGC: Loaded 46955 existing records. [2025-09-25T20:40:52.693896] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-25T20:40:52.806867] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:40:52.807734] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-25T20:40:52.807871] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-25T20:40:52.808298] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-25T20:40:52.808368] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-25T20:40:53.070875] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:40:53.071462] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-25T20:40:53.098608] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T20:40:53.225526] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:40:53.488754] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-25T20:40:54.288747] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-25T20:40:55.088774] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-25T20:40:55.235436] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:40:55.889478] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-25T20:40:56.060704] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T20:40:56.489438] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T20:40:56.688740] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-25T20:40:57.488747] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-25T20:40:57.603410] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T20:40:57.834420] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-25T20:40:58.288742] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-25T20:40:59.088709] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-25T20:40:59.465299] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:40:59.888722] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-25T20:41:00.688751] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-25T20:41:00.723425] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T20:41:00.845793] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-25T20:41:01.398824] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T20:41:01.409703] [INFO ] [REMOTE ] PEW: Full fetch complete (15998 records). [2025-09-25T20:41:01.409866] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-25T20:41:01.489784] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-25T20:41:01.608131] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T20:41:01.656027] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 51 unique days, need 200 days [2025-09-25T20:41:01.656608] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:41:01.656748] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:41:01.656855] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-25T20:41:01.656981] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-25T20:41:01.657059] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-25T20:41:01.657139] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-25T20:41:01.657285] [INFO ] [MAIN ] Update Progress: 1663/2372 symbols completed. PEW took 30.2s. Estimated remaining: 1h 34m 13s. Rate: 7.5 symbols/min [2025-09-25T20:41:01.833297] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:01.854620] [DEBUG] [LOCAL ] PFH: Loaded 6842 existing records from primary storage. [2025-09-25T20:41:01.854785] [INFO ] [MAIN ] PFH: Loaded 6842 existing records. [2025-09-25T20:41:02.037284] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:02.037667] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-25T20:41:02.037728] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-25T20:41:02.038149] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-25T20:41:02.038212] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-25T20:41:02.296812] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-25T20:41:02.432077] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:03.088724] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-25T20:41:03.313363] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T20:41:03.470511] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T20:41:03.787355] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-25T20:41:03.888713] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-25T20:41:04.688697] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-25T20:41:04.698623] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T20:41:05.488731] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-25T20:41:06.288729] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-25T20:41:06.513907] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:41:07.088736] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-25T20:41:07.553184] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T20:41:07.888691] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-25T20:41:08.071420] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-09-25T20:41:08.693791] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-25T20:41:08.699827] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T20:41:08.909618] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T20:41:09.488750] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-25T20:41:10.248428] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T20:41:10.288715] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-25T20:41:11.082421] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T20:41:11.088687] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-25T20:41:11.579723] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-25T20:41:11.888709] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-25T20:41:12.671795] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T20:41:12.688687] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-25T20:41:12.908748] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T20:41:13.488739] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-25T20:41:14.288756] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-25T20:41:14.989702] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-25T20:41:15.082807] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:41:15.086121] [INFO ] [REMOTE ] PERF: Full fetch complete (21954 records). [2025-09-25T20:41:15.086260] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-25T20:41:15.092945] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-25T20:41:15.160461] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T20:41:15.554369] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-25T20:41:15.554470] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-25T20:41:15.554990] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-25T20:41:15.555054] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-25T20:41:15.556630] [DEBUG] [LOCAL ] PERF: Trimmed 21954 records to 14123 (keeping 200 days of data) [2025-09-25T20:41:15.657507] [DEBUG] [LOCAL ] PERF: Primary data saved (14123 records). [2025-09-25T20:41:15.657702] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-25T20:41:15.657851] [INFO ] [MAIN ] Update Progress: 1664/2372 symbols completed. PERF took 44.3s. Estimated remaining: 1h 34m 7s. Rate: 7.5 symbols/min [2025-09-25T20:41:15.861205] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:15.888774] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-25T20:41:15.888711] [DEBUG] [LOCAL ] PFL: Loaded 13824 existing records from primary storage. [2025-09-25T20:41:15.891747] [INFO ] [MAIN ] PFL: Loaded 13824 existing records. [2025-09-25T20:41:16.026987] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:41:16.117380] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:16.117718] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-25T20:41:16.117777] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-25T20:41:16.118039] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-25T20:41:16.118102] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-25T20:41:16.507137] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:16.688713] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-25T20:41:17.470395] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T20:41:17.488728] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-25T20:41:17.728521] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T20:41:18.096028] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T20:41:18.288730] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-25T20:41:19.088736] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-25T20:41:19.565897] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:41:19.805969] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T20:41:19.819584] [INFO ] [REMOTE ] PFE: Full fetch complete (77589 records). [2025-09-25T20:41:19.819855] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-25T20:41:19.820938] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:41:19.821147] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:41:19.821214] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:41:19.821281] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-25T20:41:19.821409] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-25T20:41:19.821462] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-25T20:41:19.821518] [DEBUG] [LOCAL ] PFE: No derivative data file found to delete. [2025-09-25T20:41:19.821633] [INFO ] [MAIN ] Update Progress: 1665/2372 symbols completed. PFE took 44.8s. Estimated remaining: 1h 33m 58s. Rate: 7.5 symbols/min [2025-09-25T20:41:19.890535] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-25T20:41:20.032414] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:20.082570] [DEBUG] [LOCAL ] PFLT: Loaded 43621 existing records from primary storage. [2025-09-25T20:41:20.082769] [INFO ] [MAIN ] PFLT: Loaded 43621 existing records. [2025-09-25T20:41:20.288413] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:20.288834] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-25T20:41:20.288891] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-25T20:41:20.289298] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-25T20:41:20.289360] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-25T20:41:20.654105] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T20:41:20.683922] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:20.688670] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-25T20:41:21.297827] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-25T20:41:21.299463] [INFO ] [REMOTE ] PFH: Full fetch complete (10674 records). [2025-09-25T20:41:21.299621] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-25T20:41:21.490861] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-25T20:41:21.720801] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-25T20:41:21.720888] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-25T20:41:21.721165] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-25T20:41:21.721206] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-25T20:41:21.721760] [DEBUG] [LOCAL ] PFH: Trimmed 10674 records to 6888 (keeping 200 days of data) [2025-09-25T20:41:21.767091] [DEBUG] [LOCAL ] PFH: Primary data saved (6888 records). [2025-09-25T20:41:21.767247] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-25T20:41:21.767361] [INFO ] [MAIN ] Update Progress: 1666/2372 symbols completed. PFH took 20.1s. Estimated remaining: 1h 33m 47s. Rate: 7.5 symbols/min [2025-09-25T20:41:21.943385] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:21.975512] [DEBUG] [LOCAL ] PFN: Loaded 21637 existing records from primary storage. [2025-09-25T20:41:21.975734] [INFO ] [MAIN ] PFN: Loaded 21637 existing records. [2025-09-25T20:41:22.160058] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:22.160289] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-25T20:41:22.160333] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-25T20:41:22.160598] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-25T20:41:22.160752] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-25T20:41:22.304186] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-25T20:41:22.547411] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:22.552197] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T20:41:23.088723] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-25T20:41:23.853986] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T20:41:23.888672] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-25T20:41:24.247495] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T20:41:24.688738] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-25T20:41:25.488739] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-25T20:41:25.526435] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T20:41:25.545990] [INFO ] [REMOTE ] PFGC: Full fetch complete (67272 records). [2025-09-25T20:41:25.546237] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-25T20:41:25.970210] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-25T20:41:25.970324] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-25T20:41:25.972024] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-25T20:41:25.972098] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-25T20:41:25.983675] [DEBUG] [LOCAL ] PFGC: Trimmed 67272 records to 47328 (keeping 200 days of data) [2025-09-25T20:41:26.297707] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-25T20:41:26.332410] [DEBUG] [LOCAL ] PFGC: Primary data saved (47328 records). [2025-09-25T20:41:26.332567] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-25T20:41:26.332698] [INFO ] [MAIN ] Update Progress: 1667/2372 symbols completed. PFGC took 34.1s. Estimated remaining: 1h 33m 38s. Rate: 7.5 symbols/min [2025-09-25T20:41:26.528799] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T20:41:26.538172] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-25T20:41:26.580189] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:26.596464] [DEBUG] [LOCAL ] PFO: Loaded 5878 existing records from primary storage. [2025-09-25T20:41:26.596668] [INFO ] [MAIN ] PFO: Loaded 5878 existing records. [2025-09-25T20:41:26.868457] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:26.869504] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-25T20:41:26.869564] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-25T20:41:26.870061] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-25T20:41:26.870121] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-25T20:41:27.096872] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-25T20:41:27.257865] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:27.434810] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T20:41:27.888711] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-25T20:41:28.030072] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T20:41:28.611988] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T20:41:28.688751] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-25T20:41:29.488758] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-25T20:41:30.288746] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-25T20:41:30.330370] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T20:41:30.769566] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-25T20:41:31.088696] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-25T20:41:31.456547] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T20:41:31.888714] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-25T20:41:31.940886] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:41:32.688755] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-25T20:41:33.156799] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T20:41:33.488751] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-25T20:41:33.604786] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T20:41:34.288899] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-25T20:41:34.602329] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:41:35.088714] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-25T20:41:35.311843] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T20:41:35.888699] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-25T20:41:36.204090] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:41:36.688753] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-25T20:41:36.796997] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T20:41:37.099544] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-25T20:41:37.488774] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-25T20:41:38.288690] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-25T20:41:38.515710] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T20:41:39.088740] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-25T20:41:39.568687] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T20:41:39.705200] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T20:41:39.708639] [INFO ] [REMOTE ] PFL: Full fetch complete (20112 records). [2025-09-25T20:41:39.708751] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-25T20:41:39.891232] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-25T20:41:40.145995] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-25T20:41:40.146083] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-25T20:41:40.146573] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-25T20:41:40.146638] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-25T20:41:40.150356] [DEBUG] [LOCAL ] PFL: Trimmed 20112 records to 13885 (keeping 200 days of data) [2025-09-25T20:41:40.240951] [DEBUG] [LOCAL ] PFL: Primary data saved (13885 records). [2025-09-25T20:41:40.241113] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-25T20:41:40.241206] [INFO ] [MAIN ] Update Progress: 1668/2372 symbols completed. PFL took 24.6s. Estimated remaining: 1h 33m 32s. Rate: 7.5 symbols/min [2025-09-25T20:41:40.291873] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T20:41:40.431831] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:40.487139] [DEBUG] [LOCAL ] PFS: Loaded 35685 existing records from primary storage. [2025-09-25T20:41:40.487291] [INFO ] [MAIN ] PFS: Loaded 35685 existing records. [2025-09-25T20:41:40.681974] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:40.683141] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-25T20:41:40.683203] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-25T20:41:40.683531] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-25T20:41:40.683591] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-25T20:41:40.689578] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-25T20:41:41.083502] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:41.316765] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:41:41.488905] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-25T20:41:42.288781] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-25T20:41:42.990737] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T20:41:43.088728] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-25T20:41:43.888835] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-25T20:41:44.206512] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T20:41:44.587421] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T20:41:44.688680] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-25T20:41:45.488737] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-25T20:41:45.687457] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T20:41:46.149284] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T20:41:46.288732] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-25T20:41:46.433625] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:41:47.088790] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-25T20:41:47.174031] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T20:41:47.888779] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-25T20:41:48.417474] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T20:41:48.688795] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-25T20:41:49.079759] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T20:41:49.390347] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-25T20:41:49.488732] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-25T20:41:50.288840] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-25T20:41:51.007409] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T20:41:51.012753] [INFO ] [REMOTE ] PFN: Full fetch complete (30716 records). [2025-09-25T20:41:51.012939] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-25T20:41:51.093860] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-25T20:41:51.491018] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-25T20:41:51.491148] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-25T20:41:51.492075] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-25T20:41:51.492196] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-25T20:41:51.493341] [DEBUG] [LOCAL ] PFN: Trimmed 30716 records to 21856 (keeping 200 days of data) [2025-09-25T20:41:51.670891] [DEBUG] [LOCAL ] PFN: Primary data saved (21856 records). [2025-09-25T20:41:51.671036] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-25T20:41:51.671241] [INFO ] [MAIN ] Update Progress: 1669/2372 symbols completed. PFN took 29.9s. Estimated remaining: 1h 33m 26s. Rate: 7.5 symbols/min [2025-09-25T20:41:51.888761] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-25T20:41:51.916131] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:51.981590] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:41:52.002319] [DEBUG] [LOCAL ] PFSI: Loaded 28903 existing records from primary storage. [2025-09-25T20:41:52.002512] [INFO ] [MAIN ] PFSI: Loaded 28903 existing records. [2025-09-25T20:41:52.196836] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:41:52.197471] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-25T20:41:52.197542] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-25T20:41:52.198060] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-25T20:41:52.198181] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-25T20:41:52.598953] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:52.688719] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-25T20:41:52.801276] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T20:41:53.068377] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T20:41:53.488707] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-25T20:41:53.882150] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T20:41:54.288779] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-25T20:41:55.088759] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-25T20:41:55.295059] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T20:41:55.888761] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-25T20:41:56.012309] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T20:41:56.643921] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T20:41:56.653311] [INFO ] [REMOTE ] PFO: Full fetch complete (7881 records). [2025-09-25T20:41:56.653462] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-25T20:41:56.680944] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T20:41:56.699731] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-25T20:41:57.086659] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-25T20:41:57.089736] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-25T20:41:57.089995] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-25T20:41:57.090038] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-25T20:41:57.090573] [DEBUG] [LOCAL ] PFO: Trimmed 7881 records to 5922 (keeping 200 days of data) [2025-09-25T20:41:57.135883] [DEBUG] [LOCAL ] PFO: Primary data saved (5922 records). [2025-09-25T20:41:57.136115] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-25T20:41:57.136333] [INFO ] [MAIN ] Update Progress: 1670/2372 symbols completed. PFO took 30.8s. Estimated remaining: 1h 33m 17s. Rate: 7.5 symbols/min [2025-09-25T20:41:57.310716] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:41:57.310978] [DEBUG] [LOCAL ] PG: No existing data file found in primary storage. [2025-09-25T20:41:57.311033] [WARN ] [MAIN ] PG: No existing data found, performing full refresh instead. [2025-09-25T20:41:57.311276] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-25T20:41:57.311330] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-25T20:41:57.311398] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-25T20:41:57.311444] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-25T20:41:57.498751] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-25T20:41:57.708579] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:41:58.288720] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-25T20:41:58.503522] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T20:41:59.088713] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-25T20:41:59.259831] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T20:41:59.584742] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T20:41:59.888739] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-25T20:42:00.192166] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T20:42:00.688738] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-25T20:42:01.488735] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-25T20:42:02.110269] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T20:42:02.290997] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-25T20:42:02.301142] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-25T20:42:03.088745] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-25T20:42:03.306544] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:42:03.526044] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T20:42:03.888734] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-25T20:42:04.182313] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:42:04.688763] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-25T20:42:05.334994] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T20:42:05.488738] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-25T20:42:06.288765] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-25T20:42:06.938038] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T20:42:06.946360] [INFO ] [REMOTE ] PFS: Full fetch complete (51550 records). [2025-09-25T20:42:06.946543] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-25T20:42:07.090812] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-25T20:42:07.216676] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-25T20:42:07.427502] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-25T20:42:07.427617] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-25T20:42:07.428631] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-25T20:42:07.428722] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-25T20:42:07.430054] [DEBUG] [LOCAL ] PFS: Trimmed 51550 records to 35929 (keeping 200 days of data) [2025-09-25T20:42:07.683729] [DEBUG] [LOCAL ] PFS: Primary data saved (35929 records). [2025-09-25T20:42:07.683896] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-25T20:42:07.684017] [INFO ] [MAIN ] Update Progress: 1671/2372 symbols completed. PFS took 27.4s. Estimated remaining: 1h 33m 10s. Rate: 7.5 symbols/min [2025-09-25T20:42:07.867696] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:07.881717] [DEBUG] [LOCAL ] PGP: Loaded 5465 existing records from primary storage. [2025-09-25T20:42:07.881868] [INFO ] [MAIN ] PGP: Loaded 5465 existing records. [2025-09-25T20:42:07.890836] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-25T20:42:08.008020] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T20:42:08.127593] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:42:08.128904] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-25T20:42:08.128954] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-25T20:42:08.129201] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-25T20:42:08.129261] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-25T20:42:08.516245] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:08.688756] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-25T20:42:08.795011] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T20:42:08.808152] [INFO ] [REMOTE ] PFLT: Full fetch complete (63412 records). [2025-09-25T20:42:08.808348] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-25T20:42:09.167376] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-25T20:42:09.402057] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-25T20:42:09.402213] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-25T20:42:09.403582] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-25T20:42:09.403713] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-25T20:42:09.409545] [DEBUG] [LOCAL ] PFLT: Trimmed 63412 records to 43976 (keeping 200 days of data) [2025-09-25T20:42:09.494563] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-25T20:42:09.814032] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T20:42:09.834205] [DEBUG] [LOCAL ] PFLT: Primary data saved (43976 records). [2025-09-25T20:42:09.834387] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-25T20:42:09.834560] [INFO ] [MAIN ] Update Progress: 1672/2372 symbols completed. PFLT took 50.0s. Estimated remaining: 1h 32m 59s. Rate: 7.5 symbols/min [2025-09-25T20:42:10.027933] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:10.029389] [DEBUG] [LOCAL ] PGR: No existing data file found in primary storage. [2025-09-25T20:42:10.029455] [WARN ] [MAIN ] PGR: No existing data found, performing full refresh instead. [2025-09-25T20:42:10.029745] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-25T20:42:10.029804] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-25T20:42:10.029851] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-25T20:42:10.029885] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-25T20:42:10.294290] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-25T20:42:10.362236] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T20:42:10.435182] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:11.088778] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-25T20:42:11.888857] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-25T20:42:12.589979] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T20:42:12.688678] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-25T20:42:12.748310] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-25T20:42:12.843579] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:42:13.459558] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T20:42:13.489503] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-25T20:42:14.288788] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-25T20:42:14.859737] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T20:42:15.088753] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-25T20:42:15.888838] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-25T20:42:15.981062] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-25T20:42:16.461060] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-25T20:42:16.688719] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-25T20:42:17.488715] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-25T20:42:17.944522] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-25T20:42:18.292520] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-25T20:42:18.300045] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T20:42:18.777720] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-25T20:42:19.088802] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-25T20:42:19.794744] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T20:42:19.888727] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-25T20:42:20.046441] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T20:42:20.688753] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-25T20:42:20.709048] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T20:42:21.488841] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-25T20:42:22.126031] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T20:42:22.288728] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-25T20:42:23.088739] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-25T20:42:23.652358] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T20:42:23.739930] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:42:23.888735] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-25T20:42:24.578406] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-25T20:42:24.693917] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-25T20:42:24.720142] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:42:25.488756] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-25T20:42:26.015099] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T20:42:26.017470] [INFO ] [REMOTE ] PGP: Full fetch complete (7816 records). [2025-09-25T20:42:26.017590] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-25T20:42:26.145632] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T20:42:26.296832] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-25T20:42:26.475010] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-25T20:42:26.475112] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-25T20:42:26.475373] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-25T20:42:26.475484] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-25T20:42:26.476148] [DEBUG] [LOCAL ] PGP: Trimmed 7816 records to 5491 (keeping 200 days of data) [2025-09-25T20:42:26.516918] [DEBUG] [LOCAL ] PGP: Primary data saved (5491 records). [2025-09-25T20:42:26.517064] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-25T20:42:26.517290] [INFO ] [MAIN ] Update Progress: 1673/2372 symbols completed. PGP took 18.8s. Estimated remaining: 1h 32m 55s. Rate: 7.5 symbols/min [2025-09-25T20:42:26.697776] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:26.777863] [DEBUG] [LOCAL ] PGRE: Loaded 46473 existing records from primary storage. [2025-09-25T20:42:26.778040] [INFO ] [MAIN ] PGRE: Loaded 46473 existing records. [2025-09-25T20:42:26.970301] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:42:26.971021] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-25T20:42:26.971100] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-25T20:42:26.971587] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-25T20:42:26.971716] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-25T20:42:27.094718] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-25T20:42:27.370296] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:27.888737] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-25T20:42:28.543771] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T20:42:28.551745] [INFO ] [REMOTE ] PFSI: Full fetch complete (40708 records). [2025-09-25T20:42:28.551870] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-25T20:42:28.699827] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-25T20:42:28.946008] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-25T20:42:29.056968] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-25T20:42:29.057074] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-25T20:42:29.058079] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-25T20:42:29.058921] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-25T20:42:29.065088] [DEBUG] [LOCAL ] PFSI: Trimmed 40708 records to 29071 (keeping 200 days of data) [2025-09-25T20:42:29.295627] [DEBUG] [LOCAL ] PFSI: Primary data saved (29071 records). [2025-09-25T20:42:29.295909] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-25T20:42:29.296074] [INFO ] [MAIN ] Update Progress: 1674/2372 symbols completed. PFSI took 37.6s. Estimated remaining: 1h 32m 45s. Rate: 7.5 symbols/min [2025-09-25T20:42:29.475605] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:29.491093] [DEBUG] [LOCAL ] PGZ: Loaded 5385 existing records from primary storage. [2025-09-25T20:42:29.491261] [INFO ] [MAIN ] PGZ: Loaded 5385 existing records. [2025-09-25T20:42:29.526918] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-25T20:42:29.777331] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:42:29.778143] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-25T20:42:29.778196] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-25T20:42:29.778494] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-25T20:42:29.778553] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-25T20:42:30.117616] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-25T20:42:30.215826] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:30.289440] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-25T20:42:30.295968] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:42:31.088763] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-25T20:42:31.315153] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T20:42:31.888759] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-25T20:42:32.597630] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T20:42:32.613179] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-25T20:42:32.688753] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-25T20:42:33.160206] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T20:42:33.514882] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:42:33.493885] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-25T20:42:33.538768] [INFO ] [REMOTE ] PG: Full fetch complete (77395 records). [2025-09-25T20:42:33.539003] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-25T20:42:33.545320] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:42:33.545489] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:42:33.545536] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:42:33.545576] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-25T20:42:33.545748] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-25T20:42:33.545810] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-25T20:42:33.545868] [DEBUG] [LOCAL ] PG: No derivative data file found to delete. [2025-09-25T20:42:33.545964] [INFO ] [MAIN ] Update Progress: 1675/2372 symbols completed. PG took 36.4s. Estimated remaining: 1h 32m 35s. Rate: 7.5 symbols/min [2025-09-25T20:42:33.729402] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:33.794229] [DEBUG] [LOCAL ] PH: Loaded 38807 existing records from primary storage. [2025-09-25T20:42:33.794428] [INFO ] [MAIN ] PH: Loaded 38807 existing records. [2025-09-25T20:42:33.991604] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:42:33.992003] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-25T20:42:33.992053] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-25T20:42:33.993016] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-25T20:42:33.993079] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-25T20:42:34.291722] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-25T20:42:34.400534] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:35.088697] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-25T20:42:35.480776] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T20:42:35.711047] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T20:42:35.888741] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-25T20:42:36.544326] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T20:42:36.688847] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-25T20:42:37.173785] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T20:42:37.488778] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-25T20:42:37.594711] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:42:38.288760] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-25T20:42:39.088768] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-25T20:42:39.254260] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:42:39.845497] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T20:42:39.888688] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-25T20:42:39.955835] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T20:42:40.688828] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-25T20:42:41.494219] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-25T20:42:41.518415] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T20:42:42.288725] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-25T20:42:42.742340] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T20:42:42.785469] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T20:42:42.941719] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:42:43.088753] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-25T20:42:43.888771] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-25T20:42:43.913790] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:42:44.688781] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-25T20:42:45.488770] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-25T20:42:45.986636] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T20:42:46.032047] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T20:42:46.288733] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-25T20:42:47.101752] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-25T20:42:47.108261] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T20:42:47.888707] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-25T20:42:47.930250] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:42:47.942966] [INFO ] [REMOTE ] PGR: Full fetch complete (76225 records). [2025-09-25T20:42:47.943210] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-25T20:42:47.948952] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:42:47.949089] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:42:47.949185] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:42:47.949290] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-25T20:42:47.949413] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-25T20:42:47.949498] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-25T20:42:47.949629] [DEBUG] [LOCAL ] PGR: No derivative data file found to delete. [2025-09-25T20:42:47.949805] [INFO ] [MAIN ] Update Progress: 1676/2372 symbols completed. PGR took 38.1s. Estimated remaining: 1h 32m 30s. Rate: 7.5 symbols/min [2025-09-25T20:42:48.163767] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T20:42:48.246801] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:42:48.266831] [DEBUG] [LOCAL ] PHD: Loaded 9775 existing records from primary storage. [2025-09-25T20:42:48.266984] [INFO ] [MAIN ] PHD: Loaded 9775 existing records. [2025-09-25T20:42:48.495664] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:42:48.496044] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-25T20:42:48.496116] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-25T20:42:48.496635] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-25T20:42:48.497811] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-25T20:42:48.689452] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-25T20:42:48.802407] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T20:42:48.913789] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:42:49.488736] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-25T20:42:50.288794] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-25T20:42:50.538359] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T20:42:50.594755] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T20:42:51.027793] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T20:42:51.088719] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-25T20:42:51.888725] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-25T20:42:51.991929] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T20:42:52.688806] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-25T20:42:53.396812] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T20:42:53.488696] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-25T20:42:53.574783] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T20:42:54.288782] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-25T20:42:54.462002] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T20:42:55.088801] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-25T20:42:55.888774] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-25T20:42:56.016248] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T20:42:56.372928] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T20:42:56.552252] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T20:42:56.567091] [INFO ] [REMOTE ] PGRE: Full fetch complete (63522 records). [2025-09-25T20:42:56.567264] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-25T20:42:56.694347] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-25T20:42:57.006850] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-25T20:42:57.006967] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-25T20:42:57.008046] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-25T20:42:57.008131] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-25T20:42:57.012308] [DEBUG] [LOCAL ] PGRE: Trimmed 63522 records to 46830 (keeping 200 days of data) [2025-09-25T20:42:57.304074] [DEBUG] [LOCAL ] PGRE: Primary data saved (46830 records). [2025-09-25T20:42:57.304240] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-25T20:42:57.304413] [INFO ] [MAIN ] Update Progress: 1677/2372 symbols completed. PGRE took 30.8s. Estimated remaining: 1h 32m 23s. Rate: 7.5 symbols/min [2025-09-25T20:42:57.368977] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T20:42:57.371362] [INFO ] [REMOTE ] PGZ: Full fetch complete (8976 records). [2025-09-25T20:42:57.371439] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-25T20:42:57.493825] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-25T20:42:57.768788] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-25T20:42:57.768962] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-25T20:42:57.769250] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-25T20:42:57.769292] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-25T20:42:57.769785] [DEBUG] [LOCAL ] PGZ: Trimmed 8976 records to 5409 (keeping 200 days of data) [2025-09-25T20:42:57.810014] [DEBUG] [LOCAL ] PGZ: Primary data saved (5409 records). [2025-09-25T20:42:57.810169] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-25T20:42:57.810338] [INFO ] [MAIN ] Update Progress: 1678/2372 symbols completed. PGZ took 28.5s. Estimated remaining: 1h 32m 12s. Rate: 7.5 symbols/min [2025-09-25T20:42:58.288744] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-25T20:42:58.320037] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T20:42:59.088738] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-25T20:42:59.840910] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T20:42:59.899339] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-25T20:42:59.901686] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T20:43:00.688735] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-25T20:43:00.828509] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:43:01.488736] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-25T20:43:02.237874] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T20:43:02.288704] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-25T20:43:02.315224] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T20:43:03.088728] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-25T20:43:03.200516] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T20:43:03.888738] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-25T20:43:04.807130] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T20:43:04.817598] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-25T20:43:04.865895] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T20:43:05.488749] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-25T20:43:06.142382] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T20:43:06.148868] [INFO ] [REMOTE ] PH: Full fetch complete (56659 records). [2025-09-25T20:43:06.149007] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-25T20:43:06.370748] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T20:43:06.379431] [INFO ] [REMOTE ] PHD: Full fetch complete (13996 records). [2025-09-25T20:43:06.379526] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-25T20:43:06.950010] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-25T20:43:06.950142] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-25T20:43:06.951513] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-25T20:43:06.951588] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-25T20:43:06.953284] [DEBUG] [LOCAL ] PH: Trimmed 56659 records to 39003 (keeping 200 days of data) [2025-09-25T20:43:07.370077] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-25T20:43:07.370162] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-25T20:43:07.370353] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-25T20:43:07.370397] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-25T20:43:07.371165] [DEBUG] [LOCAL ] PHD: Trimmed 13996 records to 9913 (keeping 200 days of data) [2025-09-25T20:43:07.449181] [DEBUG] [LOCAL ] PH: Primary data saved (39003 records). [2025-09-25T20:43:07.449349] [INFO ] [MAIN ] PH: Full history saved. [2025-09-25T20:43:07.449476] [INFO ] [MAIN ] Update Progress: 1679/2372 symbols completed. PH took 33.9s. Estimated remaining: 1h 32m 4s. Rate: 7.5 symbols/min [2025-09-25T20:43:07.455358] [DEBUG] [LOCAL ] PHD: Primary data saved (9913 records). [2025-09-25T20:43:07.455430] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-25T20:43:07.455528] [INFO ] [MAIN ] Update Progress: 1680/2372 symbols completed. PHD took 19.5s. Estimated remaining: 1h 31m 53s. Rate: 7.5 symbols/min [2025-09-25T20:43:08.182485] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:08.186023] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:08.222116] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:08.232023] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:08.353294] [DEBUG] [LOCAL ] PHG: Loaded 46176 existing records from primary storage. [2025-09-25T20:43:08.353465] [INFO ] [MAIN ] PHG: Loaded 46176 existing records. [2025-09-25T20:43:08.374738] [DEBUG] [LOCAL ] PHI: Loaded 14977 existing records from primary storage. [2025-09-25T20:43:08.374870] [INFO ] [MAIN ] PHI: Loaded 14977 existing records. [2025-09-25T20:43:08.383838] [DEBUG] [LOCAL ] PHIN: Loaded 33111 existing records from primary storage. [2025-09-25T20:43:08.384035] [INFO ] [MAIN ] PHIN: Loaded 33111 existing records. [2025-09-25T20:43:08.412192] [DEBUG] [LOCAL ] PHK: Loaded 26387 existing records from primary storage. [2025-09-25T20:43:08.412297] [INFO ] [MAIN ] PHK: Loaded 26387 existing records. [2025-09-25T20:43:09.097203] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:09.111251] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-25T20:43:09.111399] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-25T20:43:09.121034] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-25T20:43:09.121193] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-25T20:43:09.184691] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:09.184927] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-25T20:43:09.184977] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-25T20:43:09.185357] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-25T20:43:09.185421] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-25T20:43:09.257584] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:09.257946] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-25T20:43:09.257997] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-25T20:43:09.258405] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-25T20:43:09.258467] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-25T20:43:09.335378] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:09.335774] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-25T20:43:09.335834] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-25T20:43:09.336302] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-25T20:43:09.336366] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-25T20:43:10.669052] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:10.684257] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-25T20:43:10.739856] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:10.742158] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-25T20:43:10.801793] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:10.802195] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-25T20:43:10.840884] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:10.841288] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-25T20:43:12.081119] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T20:43:12.085137] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-25T20:43:12.186508] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T20:43:12.194563] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-25T20:43:12.248011] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T20:43:12.254312] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-25T20:43:12.293086] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T20:43:12.302318] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-25T20:43:12.710991] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T20:43:12.715728] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-25T20:43:13.589800] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:43:13.594221] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-25T20:43:13.613913] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:43:13.648955] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T20:43:13.705950] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:43:14.288802] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-25T20:43:14.421891] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T20:43:15.088735] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-25T20:43:15.308057] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T20:43:15.888740] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-25T20:43:16.276150] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T20:43:16.688741] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-25T20:43:17.466905] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:43:17.488731] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-25T20:43:17.921742] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T20:43:18.288729] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-25T20:43:18.532578] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T20:43:19.088723] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-25T20:43:19.888758] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-25T20:43:20.072105] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T20:43:20.107400] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T20:43:20.688787] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-25T20:43:21.238372] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T20:43:21.488749] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-25T20:43:22.288758] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-25T20:43:22.418436] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T20:43:23.088737] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-25T20:43:23.579059] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T20:43:23.843300] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:43:23.888732] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-25T20:43:24.069953] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T20:43:24.688780] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-25T20:43:25.488745] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-25T20:43:25.774740] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T20:43:25.836142] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T20:43:26.288739] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-25T20:43:27.034775] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:43:27.088726] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-25T20:43:27.888757] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-25T20:43:27.985813] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:43:28.697710] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-25T20:43:28.715759] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T20:43:29.067408] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T20:43:29.488828] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-25T20:43:30.037378] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T20:43:30.288829] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-25T20:43:30.615084] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T20:43:30.619897] [INFO ] [REMOTE ] PHI: Full fetch complete (20784 records). [2025-09-25T20:43:30.620143] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-25T20:43:31.088786] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-25T20:43:31.120731] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-25T20:43:31.120857] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-25T20:43:31.121329] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-25T20:43:31.121437] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-25T20:43:31.123121] [DEBUG] [LOCAL ] PHI: Trimmed 20784 records to 15126 (keeping 200 days of data) [2025-09-25T20:43:31.236283] [DEBUG] [LOCAL ] PHI: Primary data saved (15126 records). [2025-09-25T20:43:31.236468] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-25T20:43:31.236783] [INFO ] [MAIN ] Update Progress: 1681/2372 symbols completed. PHI took 23.8s. Estimated remaining: 1h 31m 52s. Rate: 7.5 symbols/min [2025-09-25T20:43:31.497510] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:31.497727] [DEBUG] [LOCAL ] PHM: No existing data file found in primary storage. [2025-09-25T20:43:31.497777] [WARN ] [MAIN ] PHM: No existing data found, performing full refresh instead. [2025-09-25T20:43:31.498095] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-25T20:43:31.498146] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-25T20:43:31.498189] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-25T20:43:31.498222] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-25T20:43:31.905758] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-25T20:43:31.915580] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:32.157009] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T20:43:32.308950] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T20:43:32.688771] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-25T20:43:33.279731] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T20:43:33.488825] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-25T20:43:34.288715] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-25T20:43:34.497471] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T20:43:34.533137] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T20:43:35.088793] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-25T20:43:35.888737] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-25T20:43:36.347238] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-25T20:43:36.390866] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T20:43:36.408790] [INFO ] [REMOTE ] PHG: Full fetch complete (65758 records). [2025-09-25T20:43:36.408960] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-25T20:43:36.692486] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-25T20:43:36.838786] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-25T20:43:36.838891] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-25T20:43:36.839922] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-25T20:43:36.839989] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-25T20:43:36.842089] [DEBUG] [LOCAL ] PHG: Trimmed 65758 records to 46531 (keeping 200 days of data) [2025-09-25T20:43:37.175388] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T20:43:37.187082] [DEBUG] [LOCAL ] PHG: Primary data saved (46531 records). [2025-09-25T20:43:37.187278] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-25T20:43:37.187452] [INFO ] [MAIN ] Update Progress: 1682/2372 symbols completed. PHG took 29.7s. Estimated remaining: 1h 31m 43s. Rate: 7.5 symbols/min [2025-09-25T20:43:37.406295] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:37.452115] [DEBUG] [LOCAL ] PHR: Loaded 37469 existing records from primary storage. [2025-09-25T20:43:37.452322] [INFO ] [MAIN ] PHR: Loaded 37469 existing records. [2025-09-25T20:43:37.497717] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-25T20:43:37.657302] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:37.658358] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-25T20:43:37.658421] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-25T20:43:37.659227] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-25T20:43:37.659303] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-25T20:43:38.062558] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:38.095446] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T20:43:38.288678] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-25T20:43:39.089126] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-25T20:43:39.093345] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T20:43:39.099797] [INFO ] [REMOTE ] PHK: Full fetch complete (39213 records). [2025-09-25T20:43:39.099944] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-25T20:43:39.516760] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-25T20:43:39.516856] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-25T20:43:39.517742] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-25T20:43:39.517810] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-25T20:43:39.519275] [DEBUG] [LOCAL ] PHK: Trimmed 39213 records to 26530 (keeping 200 days of data) [2025-09-25T20:43:39.696815] [DEBUG] [LOCAL ] PHK: Primary data saved (26530 records). [2025-09-25T20:43:39.696974] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-25T20:43:39.697095] [INFO ] [MAIN ] Update Progress: 1683/2372 symbols completed. PHK took 32.2s. Estimated remaining: 1h 31m 33s. Rate: 7.5 symbols/min [2025-09-25T20:43:39.891109] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T20:43:39.896939] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-25T20:43:39.920138] [INFO ] [REMOTE ] PHIN: Full fetch complete (48207 records). [2025-09-25T20:43:39.920325] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-25T20:43:39.923213] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:39.995728] [DEBUG] [LOCAL ] PHT: Loaded 15601 existing records from primary storage. [2025-09-25T20:43:39.995916] [INFO ] [MAIN ] PHT: Loaded 15601 existing records. [2025-09-25T20:43:40.392140] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:40.468844] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-25T20:43:40.483139] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-25T20:43:40.513718] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-25T20:43:40.570322] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-25T20:43:40.570461] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-25T20:43:40.571745] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-25T20:43:40.571847] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-25T20:43:40.573239] [DEBUG] [LOCAL ] PHIN: Trimmed 48207 records to 33373 (keeping 200 days of data) [2025-09-25T20:43:40.573740] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-25T20:43:41.020161] [DEBUG] [LOCAL ] PHIN: Primary data saved (33373 records). [2025-09-25T20:43:41.020372] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-25T20:43:41.020531] [INFO ] [MAIN ] Update Progress: 1684/2372 symbols completed. PHIN took 33.6s. Estimated remaining: 1h 31m 22s. Rate: 7.5 symbols/min [2025-09-25T20:43:41.291778] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T20:43:41.345263] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-25T20:43:41.344204] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-25T20:43:41.469304] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:43:41.489024] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-25T20:43:41.528086] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:41.581584] [DEBUG] [LOCAL ] PII: Loaded 49159 existing records from primary storage. [2025-09-25T20:43:41.584796] [INFO ] [MAIN ] PII: Loaded 49159 existing records. [2025-09-25T20:43:41.790551] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:43:41.790974] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-25T20:43:41.791027] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-25T20:43:41.791712] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-25T20:43:41.791792] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-25T20:43:42.151784] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:43:42.288680] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-25T20:43:42.900280] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T20:43:43.088757] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-25T20:43:43.638030] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T20:43:43.888747] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-25T20:43:44.043573] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-25T20:43:44.290197] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T20:43:44.688736] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-25T20:43:45.488748] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-25T20:43:45.535379] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T20:43:46.288754] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-25T20:43:47.088865] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-25T20:43:47.168629] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-25T20:43:47.339736] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:43:47.689014] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T20:43:47.721168] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T20:43:47.888749] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-25T20:43:48.688759] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-25T20:43:48.758294] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:43:49.488764] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-25T20:43:50.003437] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T20:43:50.288743] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-25T20:43:51.088764] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-25T20:43:51.458215] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T20:43:51.785141] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T20:43:51.888738] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-25T20:43:52.688761] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-25T20:43:52.837795] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T20:43:53.488722] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-25T20:43:53.633060] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-25T20:43:53.981739] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-25T20:43:54.288748] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-25T20:43:54.849861] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T20:43:55.088697] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-25T20:43:55.243735] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T20:43:55.888754] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-25T20:43:56.688802] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-25T20:43:57.037798] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T20:43:57.399639] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T20:43:57.488738] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-25T20:43:58.168902] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T20:43:58.288761] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-25T20:43:59.088834] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-25T20:43:59.409862] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T20:43:59.888772] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-25T20:44:00.428151] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-25T20:44:00.688869] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-25T20:44:00.891580] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T20:44:01.172219] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-25T20:44:01.488729] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-25T20:44:02.288706] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-25T20:44:02.505349] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:44:03.088731] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-25T20:44:03.889773] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-25T20:44:03.937044] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T20:44:03.948665] [INFO ] [REMOTE ] PHR: Full fetch complete (52469 records). [2025-09-25T20:44:03.948916] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-25T20:44:04.031910] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-25T20:44:04.258790] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T20:44:04.472452] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-25T20:44:04.472561] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-25T20:44:04.473691] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-25T20:44:04.473817] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-25T20:44:04.475358] [DEBUG] [LOCAL ] PHR: Trimmed 52469 records to 37787 (keeping 200 days of data) [2025-09-25T20:44:04.704233] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-25T20:44:04.755854] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:44:04.769707] [INFO ] [REMOTE ] PHM: Full fetch complete (74699 records). [2025-09-25T20:44:04.770626] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-25T20:44:04.773144] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:44:04.777017] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:44:04.817580] [DEBUG] [LOCAL ] PHR: Primary data saved (37787 records). [2025-09-25T20:44:04.817849] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-25T20:44:04.818108] [INFO ] [MAIN ] Update Progress: 1685/2372 symbols completed. PHR took 27.6s. Estimated remaining: 1h 31m 20s. Rate: 7.5 symbols/min [2025-09-25T20:44:04.777978] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:44:04.818832] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-25T20:44:04.818989] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-25T20:44:04.819074] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-25T20:44:04.819166] [DEBUG] [LOCAL ] PHM: No derivative data file found to delete. [2025-09-25T20:44:04.819315] [INFO ] [MAIN ] Update Progress: 1686/2372 symbols completed. PHM took 33.6s. Estimated remaining: 1h 31m 9s. Rate: 7.5 symbols/min [2025-09-25T20:44:05.201323] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:05.206209] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:05.224996] [DEBUG] [LOCAL ] PIM: Loaded 4764 existing records from primary storage. [2025-09-25T20:44:05.225197] [INFO ] [MAIN ] PIM: Loaded 4764 existing records. [2025-09-25T20:44:05.256697] [DEBUG] [LOCAL ] PINE: Loaded 14211 existing records from primary storage. [2025-09-25T20:44:05.256846] [INFO ] [MAIN ] PINE: Loaded 14211 existing records. [2025-09-25T20:44:05.494934] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-25T20:44:05.633995] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T20:44:05.676448] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:05.680917] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-25T20:44:05.680982] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-25T20:44:05.681394] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-25T20:44:05.681455] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-25T20:44:05.712755] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:05.717758] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-25T20:44:05.717814] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-25T20:44:05.718117] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-25T20:44:05.718177] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-25T20:44:06.290806] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-25T20:44:06.578933] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:06.573574] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:07.088733] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-25T20:44:07.310576] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T20:44:07.543061] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:44:07.546844] [INFO ] [REMOTE ] PHT: Full fetch complete (19733 records). [2025-09-25T20:44:07.546934] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-25T20:44:07.767809] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T20:44:07.902740] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-25T20:44:07.961880] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-25T20:44:07.961981] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-25T20:44:07.962420] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-25T20:44:07.962491] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-25T20:44:07.963278] [DEBUG] [LOCAL ] PHT: Trimmed 19733 records to 15751 (keeping 200 days of data) [2025-09-25T20:44:08.074001] [DEBUG] [LOCAL ] PHT: Primary data saved (15751 records). [2025-09-25T20:44:08.074205] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-25T20:44:08.074367] [INFO ] [MAIN ] Update Progress: 1687/2372 symbols completed. PHT took 28.4s. Estimated remaining: 1h 30m 59s. Rate: 7.5 symbols/min [2025-09-25T20:44:08.260816] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:08.341412] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-25T20:44:08.341611] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-25T20:44:08.527334] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:08.527813] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-25T20:44:08.527878] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-25T20:44:08.528232] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-25T20:44:08.528311] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-25T20:44:08.688978] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-25T20:44:08.925661] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:08.966628] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T20:44:09.197266] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-25T20:44:09.488742] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-25T20:44:10.102548] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T20:44:10.288749] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-25T20:44:11.088815] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-25T20:44:11.888704] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-25T20:44:11.999665] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:44:12.183433] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T20:44:12.345129] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T20:44:12.688734] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-25T20:44:13.488762] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-25T20:44:13.547448] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T20:44:14.288739] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-25T20:44:15.088693] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-25T20:44:15.256708] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T20:44:15.473809] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T20:44:15.888739] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-25T20:44:16.688767] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-25T20:44:16.982377] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T20:44:17.197003] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T20:44:17.265969] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T20:44:17.488747] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-25T20:44:18.288749] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-25T20:44:19.090833] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-25T20:44:19.097616] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T20:44:19.126098] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T20:44:19.888736] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-25T20:44:20.028088] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T20:44:20.688732] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-25T20:44:21.315248] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T20:44:21.488729] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-25T20:44:22.153493] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T20:44:22.166507] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-25T20:44:22.178588] [INFO ] [REMOTE ] PII: Full fetch complete (71118 records). [2025-09-25T20:44:22.178870] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-25T20:44:22.293911] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-25T20:44:22.778886] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-25T20:44:22.779023] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-25T20:44:22.781104] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-25T20:44:22.781980] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-25T20:44:22.787771] [DEBUG] [LOCAL ] PII: Trimmed 71118 records to 49499 (keeping 200 days of data) [2025-09-25T20:44:23.116716] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-25T20:44:23.267703] [DEBUG] [LOCAL ] PII: Primary data saved (49499 records). [2025-09-25T20:44:23.267911] [INFO ] [MAIN ] PII: Full history saved. [2025-09-25T20:44:23.268097] [INFO ] [MAIN ] Update Progress: 1688/2372 symbols completed. PII took 42.2s. Estimated remaining: 1h 30m 54s. Rate: 7.5 symbols/min [2025-09-25T20:44:23.311067] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-25T20:44:23.543512] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:23.571772] [DEBUG] [LOCAL ] PIPR: Loaded 15197 existing records from primary storage. [2025-09-25T20:44:23.571916] [INFO ] [MAIN ] PIPR: Loaded 15197 existing records. [2025-09-25T20:44:23.689202] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T20:44:23.838116] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:23.838976] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-25T20:44:23.839027] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-25T20:44:23.839343] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-25T20:44:23.839404] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-25T20:44:23.891330] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-25T20:44:24.255895] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:24.688735] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-25T20:44:25.471937] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:44:25.474471] [INFO ] [REMOTE ] PIM: Full fetch complete (6567 records). [2025-09-25T20:44:25.474549] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-25T20:44:25.497823] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-25T20:44:25.954573] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-25T20:44:25.969574] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-25T20:44:25.969753] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-25T20:44:25.969985] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-25T20:44:25.970032] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-25T20:44:25.971136] [DEBUG] [LOCAL ] PIM: Trimmed 6567 records to 4785 (keeping 200 days of data) [2025-09-25T20:44:26.007084] [DEBUG] [LOCAL ] PIM: Primary data saved (4785 records). [2025-09-25T20:44:26.007252] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-25T20:44:26.007389] [INFO ] [MAIN ] Update Progress: 1689/2372 symbols completed. PIM took 21.2s. Estimated remaining: 1h 30m 44s. Rate: 7.5 symbols/min [2025-09-25T20:44:26.198039] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:26.234070] [DEBUG] [LOCAL ] PJT: Loaded 22399 existing records from primary storage. [2025-09-25T20:44:26.234240] [INFO ] [MAIN ] PJT: Loaded 22399 existing records. [2025-09-25T20:44:26.293450] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-25T20:44:26.358347] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:44:26.449385] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:26.449741] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-25T20:44:26.449797] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-25T20:44:26.450142] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-25T20:44:26.450202] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-25T20:44:26.845717] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:27.088728] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-25T20:44:27.888744] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-25T20:44:27.991604] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T20:44:28.246137] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-25T20:44:28.688762] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-25T20:44:28.792067] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T20:44:29.488732] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-25T20:44:29.816292] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:44:30.288721] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-25T20:44:30.358429] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T20:44:31.088718] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-25T20:44:31.689740] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:44:31.888698] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-25T20:44:31.975802] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T20:44:31.978797] [INFO ] [REMOTE ] PINE: Full fetch complete (21073 records). [2025-09-25T20:44:31.978911] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-25T20:44:32.419507] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-25T20:44:32.419593] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-25T20:44:32.420140] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-25T20:44:32.420218] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-25T20:44:32.420888] [DEBUG] [LOCAL ] PINE: Trimmed 21073 records to 14283 (keeping 200 days of data) [2025-09-25T20:44:32.524980] [DEBUG] [LOCAL ] PINE: Primary data saved (14283 records). [2025-09-25T20:44:32.525186] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-25T20:44:32.525303] [INFO ] [MAIN ] Update Progress: 1690/2372 symbols completed. PINE took 27.7s. Estimated remaining: 1h 30m 36s. Rate: 7.5 symbols/min [2025-09-25T20:44:32.704741] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-25T20:44:32.707466] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:32.787368] [DEBUG] [LOCAL ] PK: Loaded 52860 existing records from primary storage. [2025-09-25T20:44:32.787571] [INFO ] [MAIN ] PK: Loaded 52860 existing records. [2025-09-25T20:44:32.987116] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:33.008463] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-25T20:44:33.009395] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T20:44:33.009500] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-25T20:44:33.017102] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-25T20:44:33.017342] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-25T20:44:33.397984] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:33.488734] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-25T20:44:34.288786] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-25T20:44:34.686282] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T20:44:35.088779] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-25T20:44:35.259744] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T20:44:35.288699] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T20:44:35.888763] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-25T20:44:36.688817] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-25T20:44:36.996184] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T20:44:37.488747] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-25T20:44:37.900123] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-25T20:44:38.288720] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-25T20:44:38.326185] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T20:44:39.088720] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-25T20:44:39.157858] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T20:44:39.202114] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T20:44:39.888777] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-25T20:44:40.688748] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-25T20:44:40.926974] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T20:44:41.304571] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T20:44:41.488807] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-25T20:44:41.700521] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T20:44:42.288734] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-25T20:44:42.470474] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T20:44:43.088738] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-25T20:44:43.394901] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T20:44:43.888794] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-25T20:44:44.192693] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T20:44:44.678008] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T20:44:44.688670] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-25T20:44:45.488821] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-25T20:44:46.288697] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-25T20:44:46.477480] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T20:44:46.664251] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T20:44:47.088697] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-25T20:44:47.240530] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T20:44:47.888749] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-25T20:44:48.167487] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T20:44:48.688748] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-25T20:44:48.792784] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:44:48.796590] [INFO ] [REMOTE ] PIPR: Full fetch complete (20407 records). [2025-09-25T20:44:48.796792] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-25T20:44:49.228838] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-25T20:44:49.228972] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-25T20:44:49.229585] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-25T20:44:49.229723] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-25T20:44:49.230514] [DEBUG] [LOCAL ] PIPR: Trimmed 20407 records to 15270 (keeping 200 days of data) [2025-09-25T20:44:49.347577] [DEBUG] [LOCAL ] PIPR: Primary data saved (15270 records). [2025-09-25T20:44:49.347765] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-25T20:44:49.347977] [INFO ] [MAIN ] Update Progress: 1691/2372 symbols completed. PIPR took 26.1s. Estimated remaining: 1h 30m 31s. Rate: 7.5 symbols/min [2025-09-25T20:44:49.499500] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-25T20:44:49.538623] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:49.560803] [DEBUG] [LOCAL ] PKE: Loaded 12555 existing records from primary storage. [2025-09-25T20:44:49.560945] [INFO ] [MAIN ] PKE: Loaded 12555 existing records. [2025-09-25T20:44:49.754269] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:49.754985] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-25T20:44:49.755058] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-25T20:44:49.755417] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-25T20:44:49.755524] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-25T20:44:50.166451] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:50.288742] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-25T20:44:50.532419] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T20:44:51.000579] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T20:44:51.004430] [INFO ] [REMOTE ] PJT: Full fetch complete (32082 records). [2025-09-25T20:44:51.004569] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-25T20:44:51.094315] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-25T20:44:51.323618] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T20:44:51.491227] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-25T20:44:51.491380] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-25T20:44:51.493148] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-25T20:44:51.493236] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-25T20:44:51.494983] [DEBUG] [LOCAL ] PJT: Trimmed 32082 records to 22488 (keeping 200 days of data) [2025-09-25T20:44:51.680841] [DEBUG] [LOCAL ] PJT: Primary data saved (22488 records). [2025-09-25T20:44:51.681029] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-25T20:44:51.681167] [INFO ] [MAIN ] Update Progress: 1692/2372 symbols completed. PJT took 25.7s. Estimated remaining: 1h 30m 21s. Rate: 7.5 symbols/min [2025-09-25T20:44:51.898240] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:44:51.895756] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-25T20:44:51.961817] [DEBUG] [LOCAL ] PKG: Loaded 39209 existing records from primary storage. [2025-09-25T20:44:51.962037] [INFO ] [MAIN ] PKG: Loaded 39209 existing records. [2025-09-25T20:44:52.146407] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:44:52.146888] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-25T20:44:52.146959] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-25T20:44:52.147322] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-25T20:44:52.147396] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-25T20:44:52.524825] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:44:52.688709] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-25T20:44:52.714926] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T20:44:53.277748] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T20:44:53.488744] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-25T20:44:54.288752] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-25T20:44:54.386930] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T20:44:55.088740] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-25T20:44:55.199850] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-25T20:44:55.887696] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T20:44:55.896448] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-25T20:44:56.063610] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T20:44:56.688761] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-25T20:44:57.488759] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-25T20:44:57.640953] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T20:44:58.288769] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-25T20:44:58.631332] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T20:44:59.088722] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-25T20:44:59.516635] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T20:44:59.615310] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:44:59.888768] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-25T20:45:00.688818] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-25T20:45:00.929416] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T20:45:01.488746] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-25T20:45:01.961900] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-25T20:45:02.288709] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-25T20:45:02.410894] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T20:45:02.747947] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T20:45:02.758499] [INFO ] [REMOTE ] PINS: Full fetch complete (77738 records). [2025-09-25T20:45:02.758751] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-25T20:45:03.091583] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-25T20:45:03.201182] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-25T20:45:03.201292] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-25T20:45:03.202629] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-25T20:45:03.202724] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-25T20:45:03.204416] [DEBUG] [LOCAL ] PINS: Trimmed 77738 records to 54083 (keeping 200 days of data) [2025-09-25T20:45:03.579468] [DEBUG] [LOCAL ] PINS: Primary data saved (54083 records). [2025-09-25T20:45:03.579669] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-25T20:45:03.579839] [INFO ] [MAIN ] Update Progress: 1693/2372 symbols completed. PINS took 55.5s. Estimated remaining: 1h 30m 15s. Rate: 7.5 symbols/min [2025-09-25T20:45:03.786944] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:03.814969] [DEBUG] [LOCAL ] PKST: Loaded 19242 existing records from primary storage. [2025-09-25T20:45:03.815167] [INFO ] [MAIN ] PKST: Loaded 19242 existing records. [2025-09-25T20:45:03.889761] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-25T20:45:03.967907] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-25T20:45:04.039785] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:04.040199] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-25T20:45:04.040249] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-25T20:45:04.040804] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-25T20:45:04.040867] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-25T20:45:04.255419] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T20:45:04.473552] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:04.688728] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-25T20:45:05.488690] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-25T20:45:05.510234] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T20:45:05.777469] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:45:06.288740] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-25T20:45:06.740953] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T20:45:07.088716] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-25T20:45:07.721739] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T20:45:07.888732] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-25T20:45:08.691060] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-25T20:45:08.695791] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T20:45:09.487699] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T20:45:09.491458] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-25T20:45:09.499929] [INFO ] [REMOTE ] PK: Full fetch complete (76358 records). [2025-09-25T20:45:09.500130] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-25T20:45:09.742211] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T20:45:10.005821] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-25T20:45:10.005932] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-25T20:45:10.007141] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-25T20:45:10.007216] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-25T20:45:10.009571] [DEBUG] [LOCAL ] PK: Trimmed 76358 records to 53243 (keeping 200 days of data) [2025-09-25T20:45:10.305724] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-25T20:45:10.362568] [DEBUG] [LOCAL ] PK: Primary data saved (53243 records). [2025-09-25T20:45:10.362893] [INFO ] [MAIN ] PK: Full history saved. [2025-09-25T20:45:10.364704] [INFO ] [MAIN ] Update Progress: 1694/2372 symbols completed. PK took 37.8s. Estimated remaining: 1h 30m 6s. Rate: 7.5 symbols/min [2025-09-25T20:45:10.557505] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:10.588939] [DEBUG] [LOCAL ] PKX: Loaded 24908 existing records from primary storage. [2025-09-25T20:45:10.589095] [INFO ] [MAIN ] PKX: Loaded 24908 existing records. [2025-09-25T20:45:10.725296] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T20:45:10.807277] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:10.807900] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-25T20:45:10.807949] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-25T20:45:10.808230] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-25T20:45:10.808292] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-25T20:45:11.088877] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-25T20:45:11.198037] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:11.605521] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T20:45:11.888726] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-25T20:45:12.589454] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T20:45:12.688769] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-25T20:45:12.962409] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T20:45:13.488750] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-25T20:45:13.926251] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T20:45:14.288765] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-25T20:45:15.030321] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T20:45:15.088736] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-25T20:45:15.675565] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T20:45:15.888753] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-25T20:45:16.490764] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:45:16.688748] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-25T20:45:17.114313] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T20:45:17.488700] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-25T20:45:17.687875] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T20:45:17.691354] [INFO ] [REMOTE ] PKE: Full fetch complete (16986 records). [2025-09-25T20:45:17.691461] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-25T20:45:18.069693] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-25T20:45:18.069791] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-25T20:45:18.070219] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-25T20:45:18.070260] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-25T20:45:18.070917] [DEBUG] [LOCAL ] PKE: Trimmed 16986 records to 12677 (keeping 200 days of data) [2025-09-25T20:45:18.161759] [DEBUG] [LOCAL ] PKE: Primary data saved (12677 records). [2025-09-25T20:45:18.161940] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-25T20:45:18.162045] [INFO ] [MAIN ] Update Progress: 1695/2372 symbols completed. PKE took 28.8s. Estimated remaining: 1h 29m 58s. Rate: 7.5 symbols/min [2025-09-25T20:45:18.293806] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-25T20:45:18.354435] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:18.430860] [DEBUG] [LOCAL ] PL: Loaded 53114 existing records from primary storage. [2025-09-25T20:45:18.431025] [INFO ] [MAIN ] PL: Loaded 53114 existing records. [2025-09-25T20:45:18.551875] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T20:45:18.627786] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:18.628151] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-25T20:45:18.628200] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-25T20:45:18.628551] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-25T20:45:18.628614] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-25T20:45:18.986878] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:19.088729] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-25T20:45:19.376681] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T20:45:19.888693] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-25T20:45:20.151164] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T20:45:20.688732] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-25T20:45:21.488879] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-25T20:45:22.288780] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-25T20:45:22.485244] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T20:45:22.761282] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-09-25T20:45:23.088706] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-25T20:45:23.131704] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T20:45:23.323056] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T20:45:23.888762] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-25T20:45:24.688894] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-25T20:45:25.287477] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-25T20:45:25.453537] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T20:45:25.488683] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-25T20:45:25.783517] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T20:45:26.288742] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-25T20:45:26.774034] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T20:45:26.785904] [INFO ] [REMOTE ] PKG: Full fetch complete (57480 records). [2025-09-25T20:45:26.786199] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-25T20:45:27.088858] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-25T20:45:27.247825] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-25T20:45:27.247945] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-25T20:45:27.249764] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-25T20:45:27.249918] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-25T20:45:27.254114] [DEBUG] [LOCAL ] PKG: Trimmed 57480 records to 39494 (keeping 200 days of data) [2025-09-25T20:45:27.392003] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T20:45:27.403310] [INFO ] [REMOTE ] PKST: Full fetch complete (29632 records). [2025-09-25T20:45:27.403497] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-25T20:45:27.822097] [DEBUG] [LOCAL ] PKG: Primary data saved (39494 records). [2025-09-25T20:45:27.822259] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-25T20:45:27.822486] [INFO ] [MAIN ] Update Progress: 1696/2372 symbols completed. PKG took 36.1s. Estimated remaining: 1h 29m 51s. Rate: 7.5 symbols/min [2025-09-25T20:45:27.901405] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-25T20:45:28.223163] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-25T20:45:28.223293] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-25T20:45:28.224181] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-25T20:45:28.224256] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-25T20:45:28.225396] [DEBUG] [LOCAL ] PKST: Trimmed 29632 records to 19342 (keeping 200 days of data) [2025-09-25T20:45:28.231958] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:28.411059] [DEBUG] [LOCAL ] PKST: Primary data saved (19342 records). [2025-09-25T20:45:28.411232] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-25T20:45:28.411367] [INFO ] [MAIN ] Update Progress: 1697/2372 symbols completed. PKST took 24.8s. Estimated remaining: 1h 29m 40s. Rate: 7.5 symbols/min [2025-09-25T20:45:28.496045] [DEBUG] [LOCAL ] PLD: Loaded 53466 existing records from primary storage. [2025-09-25T20:45:28.496234] [INFO ] [MAIN ] PLD: Loaded 53466 existing records. [2025-09-25T20:45:28.841359] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:28.867715] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:28.867968] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-25T20:45:28.868025] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-25T20:45:28.868427] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-25T20:45:28.868499] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-25T20:45:29.070563] [DEBUG] [LOCAL ] PLNT: Loaded 48440 existing records from primary storage. [2025-09-25T20:45:29.076055] [INFO ] [MAIN ] PLNT: Loaded 48440 existing records. [2025-09-25T20:45:29.329622] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-25T20:45:29.473240] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T20:45:29.514941] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-25T20:45:29.517219] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-25T20:45:29.746703] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:29.747094] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-25T20:45:29.747166] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-25T20:45:29.747489] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-25T20:45:29.747550] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-25T20:45:29.771199] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:30.131258] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:30.288730] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-25T20:45:31.088749] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-25T20:45:31.126607] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T20:45:31.775074] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-25T20:45:31.888731] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-25T20:45:32.438576] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T20:45:32.600267] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-25T20:45:32.688715] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-25T20:45:33.081737] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T20:45:33.488752] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-25T20:45:34.288779] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-25T20:45:34.535668] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:45:34.571805] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-25T20:45:35.088733] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-25T20:45:35.888720] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-25T20:45:36.333800] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T20:45:36.683359] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T20:45:36.688691] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-25T20:45:37.087050] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T20:45:37.488764] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-25T20:45:38.288730] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-25T20:45:38.348342] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T20:45:38.983022] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T20:45:39.088744] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-25T20:45:39.888776] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-25T20:45:40.213333] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T20:45:40.276925] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:45:40.688794] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-25T20:45:41.488784] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-25T20:45:42.258934] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-25T20:45:42.288710] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-25T20:45:42.335167] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T20:45:42.341757] [INFO ] [REMOTE ] PKX: Full fetch complete (37683 records). [2025-09-25T20:45:42.341912] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-25T20:45:42.450342] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T20:45:42.795467] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-25T20:45:42.795581] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-25T20:45:42.796525] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-25T20:45:42.796590] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-25T20:45:42.797606] [DEBUG] [LOCAL ] PKX: Trimmed 37683 records to 25041 (keeping 200 days of data) [2025-09-25T20:45:42.977053] [DEBUG] [LOCAL ] PKX: Primary data saved (25041 records). [2025-09-25T20:45:42.977199] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-25T20:45:42.977344] [INFO ] [MAIN ] Update Progress: 1698/2372 symbols completed. PKX took 32.6s. Estimated remaining: 1h 29m 35s. Rate: 7.5 symbols/min [2025-09-25T20:45:43.093791] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-25T20:45:43.164919] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:43.194405] [DEBUG] [LOCAL ] PLOW: Loaded 20546 existing records from primary storage. [2025-09-25T20:45:43.194556] [INFO ] [MAIN ] PLOW: Loaded 20546 existing records. [2025-09-25T20:45:43.394359] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:43.394894] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-25T20:45:43.395002] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-25T20:45:43.395351] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-25T20:45:43.395435] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-25T20:45:43.765264] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:43.888760] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-25T20:45:44.200420] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T20:45:44.694876] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-25T20:45:44.729144] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T20:45:45.011751] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T20:45:45.488723] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-25T20:45:46.288735] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-25T20:45:47.088701] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-25T20:45:47.182210] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-25T20:45:47.277778] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T20:45:47.322432] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T20:45:47.888712] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-25T20:45:48.688744] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-25T20:45:48.814409] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T20:45:49.450383] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T20:45:49.488733] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-25T20:45:49.628415] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T20:45:49.643785] [INFO ] [REMOTE ] PL: Full fetch complete (76946 records). [2025-09-25T20:45:49.643992] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-25T20:45:50.065489] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-25T20:45:50.065723] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-25T20:45:50.067541] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-25T20:45:50.067613] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-25T20:45:50.069724] [DEBUG] [LOCAL ] PL: Trimmed 76946 records to 53504 (keeping 200 days of data) [2025-09-25T20:45:50.288737] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-25T20:45:50.424136] [DEBUG] [LOCAL ] PL: Primary data saved (53504 records). [2025-09-25T20:45:50.424361] [INFO ] [MAIN ] PL: Full history saved. [2025-09-25T20:45:50.426089] [INFO ] [MAIN ] Update Progress: 1699/2372 symbols completed. PL took 32.3s. Estimated remaining: 1h 29m 26s. Rate: 7.5 symbols/min [2025-09-25T20:45:50.618369] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:45:50.666861] [DEBUG] [LOCAL ] PLYM: Loaded 33329 existing records from primary storage. [2025-09-25T20:45:50.667052] [INFO ] [MAIN ] PLYM: Loaded 33329 existing records. [2025-09-25T20:45:50.860384] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T20:45:50.892774] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:45:50.893055] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-25T20:45:50.893105] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-25T20:45:50.893464] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-25T20:45:50.893523] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-25T20:45:51.089946] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-25T20:45:51.298546] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:45:51.888760] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-25T20:45:52.112086] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T20:45:52.332700] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T20:45:52.688741] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-25T20:45:53.488690] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-25T20:45:53.963839] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T20:45:53.997371] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T20:45:54.288747] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-25T20:45:54.550672] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T20:45:55.088731] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-25T20:45:55.888706] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-25T20:45:56.021792] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T20:45:56.072370] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T20:45:56.688700] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-25T20:45:56.987046] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T20:45:57.488733] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-25T20:45:58.288741] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-25T20:45:58.440469] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T20:45:58.743697] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T20:45:59.088759] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-25T20:45:59.888734] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-25T20:46:00.256847] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-25T20:46:00.330032] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T20:46:00.688741] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-25T20:46:01.488711] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-25T20:46:01.550737] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T20:46:02.288737] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-25T20:46:02.747572] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T20:46:02.761488] [INFO ] [REMOTE ] PLD: Full fetch complete (77404 records). [2025-09-25T20:46:02.761756] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-25T20:46:03.026597] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T20:46:03.095740] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-25T20:46:03.288408] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-25T20:46:03.288547] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-25T20:46:03.290021] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-25T20:46:03.290144] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-25T20:46:03.293730] [DEBUG] [LOCAL ] PLD: Trimmed 77404 records to 53850 (keeping 200 days of data) [2025-09-25T20:46:03.441089] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T20:46:03.708584] [DEBUG] [LOCAL ] PLD: Primary data saved (53850 records). [2025-09-25T20:46:03.708769] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-25T20:46:03.708916] [INFO ] [MAIN ] Update Progress: 1700/2372 symbols completed. PLD took 35.9s. Estimated remaining: 1h 29m 20s. Rate: 7.5 symbols/min [2025-09-25T20:46:03.884767] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:03.884971] [DEBUG] [LOCAL ] PM: No existing data file found in primary storage. [2025-09-25T20:46:03.885025] [WARN ] [MAIN ] PM: No existing data found, performing full refresh instead. [2025-09-25T20:46:03.886636] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-25T20:46:03.886724] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-25T20:46:03.886773] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-25T20:46:03.886817] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-25T20:46:03.899210] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-25T20:46:04.297825] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:04.688730] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-25T20:46:04.755754] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T20:46:05.483186] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T20:46:05.495911] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-25T20:46:06.288753] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-25T20:46:06.793398] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T20:46:06.890880] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T20:46:07.088692] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-25T20:46:07.192178] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:46:07.205757] [INFO ] [REMOTE ] PLNT: Full fetch complete (70218 records). [2025-09-25T20:46:07.205976] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-25T20:46:07.657375] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-25T20:46:07.657519] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-25T20:46:07.659054] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-25T20:46:07.659164] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-25T20:46:07.660833] [DEBUG] [LOCAL ] PLNT: Trimmed 70218 records to 48791 (keeping 200 days of data) [2025-09-25T20:46:07.900409] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-25T20:46:08.001868] [DEBUG] [LOCAL ] PLNT: Primary data saved (48791 records). [2025-09-25T20:46:08.002028] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-25T20:46:08.002173] [INFO ] [MAIN ] Update Progress: 1701/2372 symbols completed. PLNT took 39.6s. Estimated remaining: 1h 29m 11s. Rate: 7.5 symbols/min [2025-09-25T20:46:08.186088] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:08.223138] [DEBUG] [LOCAL ] PML: Loaded 20566 existing records from primary storage. [2025-09-25T20:46:08.223308] [INFO ] [MAIN ] PML: Loaded 20566 existing records. [2025-09-25T20:46:08.421377] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:46:08.421857] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-25T20:46:08.421933] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-25T20:46:08.422338] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-25T20:46:08.422398] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-25T20:46:08.692870] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-25T20:46:08.804999] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:46:08.837320] [INFO ] [REMOTE ] PLOW: Full fetch complete (28805 records). [2025-09-25T20:46:08.837512] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-25T20:46:08.843154] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:09.204569] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T20:46:09.327795] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-25T20:46:09.327897] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-25T20:46:09.328759] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-25T20:46:09.328827] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-25T20:46:09.329748] [DEBUG] [LOCAL ] PLOW: Trimmed 28805 records to 20661 (keeping 200 days of data) [2025-09-25T20:46:09.479028] [DEBUG] [LOCAL ] PLOW: Primary data saved (20661 records). [2025-09-25T20:46:09.479166] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-25T20:46:09.479277] [INFO ] [MAIN ] Update Progress: 1702/2372 symbols completed. PLOW took 26.5s. Estimated remaining: 1h 29m 0s. Rate: 7.5 symbols/min [2025-09-25T20:46:09.493865] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-25T20:46:09.667064] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:09.688306] [DEBUG] [LOCAL ] PMM: Loaded 10586 existing records from primary storage. [2025-09-25T20:46:09.688474] [INFO ] [MAIN ] PMM: Loaded 10586 existing records. [2025-09-25T20:46:09.892740] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:46:09.893121] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-25T20:46:09.893717] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-25T20:46:09.893984] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-25T20:46:09.894086] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-25T20:46:10.201367] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T20:46:10.289612] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-25T20:46:10.338247] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:10.612148] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T20:46:11.088798] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-25T20:46:11.888755] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-25T20:46:11.939168] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T20:46:12.105368] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-25T20:46:12.690735] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-25T20:46:12.694005] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T20:46:13.488738] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-25T20:46:13.755879] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T20:46:14.288802] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-25T20:46:14.545319] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T20:46:15.088733] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-25T20:46:15.888745] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-25T20:46:16.070096] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-25T20:46:16.278784] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-25T20:46:16.688729] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-25T20:46:17.042524] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T20:46:17.488721] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-25T20:46:18.059311] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T20:46:18.288746] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-25T20:46:19.060284] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T20:46:19.071523] [INFO ] [REMOTE ] PLYM: Full fetch complete (46815 records). [2025-09-25T20:46:19.071710] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-25T20:46:19.093989] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-25T20:46:19.461502] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T20:46:19.560511] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-25T20:46:19.560614] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-25T20:46:19.561616] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-25T20:46:19.561705] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-25T20:46:19.563092] [DEBUG] [LOCAL ] PLYM: Trimmed 46815 records to 33657 (keeping 200 days of data) [2025-09-25T20:46:19.794405] [DEBUG] [LOCAL ] PLYM: Primary data saved (33657 records). [2025-09-25T20:46:19.794580] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-25T20:46:19.794764] [INFO ] [MAIN ] Update Progress: 1703/2372 symbols completed. PLYM took 29.4s. Estimated remaining: 1h 28m 53s. Rate: 7.5 symbols/min [2025-09-25T20:46:19.899775] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-25T20:46:19.978510] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:20.001582] [DEBUG] [LOCAL ] PMO: Loaded 10360 existing records from primary storage. [2025-09-25T20:46:20.001816] [INFO ] [MAIN ] PMO: Loaded 10360 existing records. [2025-09-25T20:46:20.195189] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:46:20.195788] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-25T20:46:20.195860] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-25T20:46:20.196337] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-25T20:46:20.196416] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-25T20:46:20.566823] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:20.688702] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-25T20:46:20.983815] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T20:46:21.257905] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-25T20:46:21.488727] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-25T20:46:21.733015] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T20:46:22.288737] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-25T20:46:23.088739] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-25T20:46:23.369706] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T20:46:23.519313] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T20:46:23.718756] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-25T20:46:23.888748] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-25T20:46:24.688735] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-25T20:46:25.137344] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T20:46:25.488691] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-25T20:46:25.651471] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T20:46:26.288717] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-25T20:46:26.547234] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T20:46:27.088779] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-25T20:46:27.509774] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T20:46:27.888786] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-25T20:46:27.939618] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T20:46:28.688727] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-25T20:46:29.488736] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-25T20:46:29.709429] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T20:46:29.715537] [INFO ] [REMOTE ] PML: Full fetch complete (29699 records). [2025-09-25T20:46:29.715700] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-25T20:46:30.066254] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T20:46:30.108284] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T20:46:30.238100] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-25T20:46:30.238253] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-25T20:46:30.239254] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-25T20:46:30.239326] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-25T20:46:30.240835] [DEBUG] [LOCAL ] PML: Trimmed 29699 records to 20794 (keeping 200 days of data) [2025-09-25T20:46:30.301285] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-25T20:46:30.391082] [DEBUG] [LOCAL ] PML: Primary data saved (20794 records). [2025-09-25T20:46:30.391281] [INFO ] [MAIN ] PML: Full history saved. [2025-09-25T20:46:30.391411] [INFO ] [MAIN ] Update Progress: 1704/2372 symbols completed. PML took 22.4s. Estimated remaining: 1h 28m 47s. Rate: 7.5 symbols/min [2025-09-25T20:46:30.592689] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:30.663536] [DEBUG] [LOCAL ] PMT: Loaded 40293 existing records from primary storage. [2025-09-25T20:46:30.663811] [INFO ] [MAIN ] PMT: Loaded 40293 existing records. [2025-09-25T20:46:30.865139] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:46:30.865603] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-25T20:46:30.865685] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-25T20:46:30.866113] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-25T20:46:30.866202] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-25T20:46:31.098828] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-25T20:46:31.252176] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T20:46:31.276736] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:31.888705] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-25T20:46:32.027919] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T20:46:32.688758] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-25T20:46:33.497408] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-25T20:46:33.499258] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T20:46:34.288740] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-25T20:46:34.595833] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T20:46:34.802429] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-25T20:46:35.088728] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-25T20:46:35.754026] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T20:46:35.921372] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-25T20:46:35.944614] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:46:36.688909] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-25T20:46:37.488723] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-25T20:46:38.289491] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-25T20:46:38.323776] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-25T20:46:38.344783] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T20:46:38.361160] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T20:46:39.088723] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-25T20:46:39.123045] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T20:46:39.888724] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-25T20:46:40.688722] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-25T20:46:41.032577] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T20:46:41.488683] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-25T20:46:41.987057] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T20:46:42.288733] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-25T20:46:43.049878] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-25T20:46:43.088683] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-25T20:46:43.842403] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-25T20:46:43.888665] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-25T20:46:43.920235] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:46:43.923126] [INFO ] [REMOTE ] PMM: Full fetch complete (18271 records). [2025-09-25T20:46:43.923209] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-25T20:46:44.338124] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-25T20:46:44.338211] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-25T20:46:44.338685] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-25T20:46:44.338749] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-25T20:46:44.339327] [DEBUG] [LOCAL ] PMM: Trimmed 18271 records to 10692 (keeping 200 days of data) [2025-09-25T20:46:44.412552] [DEBUG] [LOCAL ] PMM: Primary data saved (10692 records). [2025-09-25T20:46:44.412725] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-25T20:46:44.412823] [INFO ] [MAIN ] Update Progress: 1705/2372 symbols completed. PMM took 34.9s. Estimated remaining: 1h 28m 41s. Rate: 7.5 symbols/min [2025-09-25T20:46:44.601698] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:44.601909] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-25T20:46:44.627937] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T20:46:44.601946] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-25T20:46:44.631037] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-25T20:46:44.631088] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-25T20:46:44.631135] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-25T20:46:44.631167] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-25T20:46:44.657871] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-25T20:46:44.691451] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-25T20:46:45.034927] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:45.488686] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-25T20:46:45.635830] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T20:46:45.639257] [INFO ] [REMOTE ] PMO: Full fetch complete (17400 records). [2025-09-25T20:46:45.639367] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-25T20:46:46.020418] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-25T20:46:46.020537] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-25T20:46:46.021061] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-25T20:46:46.021139] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-25T20:46:46.022692] [DEBUG] [LOCAL ] PMO: Trimmed 17400 records to 10470 (keeping 200 days of data) [2025-09-25T20:46:46.099445] [DEBUG] [LOCAL ] PMO: Primary data saved (10470 records). [2025-09-25T20:46:46.099606] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-25T20:46:46.099729] [INFO ] [MAIN ] Update Progress: 1706/2372 symbols completed. PMO took 26.3s. Estimated remaining: 1h 28m 30s. Rate: 7.5 symbols/min [2025-09-25T20:46:46.281412] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:46.281627] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-25T20:46:46.281762] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-25T20:46:46.282000] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-25T20:46:46.282043] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-25T20:46:46.282086] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-25T20:46:46.282121] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-25T20:46:46.296168] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-25T20:46:46.584315] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-25T20:46:46.710661] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:46.776718] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T20:46:46.789245] [INFO ] [REMOTE ] PM: Full fetch complete (77312 records). [2025-09-25T20:46:46.789412] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-25T20:46:46.790345] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:46:46.790449] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:46:46.790518] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:46:46.790568] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-25T20:46:46.790636] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-25T20:46:46.790715] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-25T20:46:46.790763] [DEBUG] [LOCAL ] PM: No derivative data file found to delete. [2025-09-25T20:46:46.790843] [INFO ] [MAIN ] Update Progress: 1707/2372 symbols completed. PM took 43.1s. Estimated remaining: 1h 28m 20s. Rate: 7.5 symbols/min [2025-09-25T20:46:46.970120] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:46.970343] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-25T20:46:46.970382] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-25T20:46:46.970600] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-25T20:46:46.970661] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-25T20:46:46.970733] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-25T20:46:46.970768] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-25T20:46:47.093822] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-25T20:46:47.350571] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:47.888820] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-25T20:46:48.140456] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:48.140939] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-25T20:46:48.313107] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T20:46:48.688740] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-25T20:46:49.488818] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-25T20:46:49.949936] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T20:46:50.288769] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-25T20:46:50.412730] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T20:46:50.540296] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:50.540793] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-25T20:46:51.088769] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-25T20:46:51.888749] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-25T20:46:52.197733] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:52.198138] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-25T20:46:52.674795] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T20:46:52.688673] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-25T20:46:53.488793] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-25T20:46:54.288801] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-25T20:46:54.678186] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:54.678593] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-25T20:46:54.685315] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:54.685545] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-25T20:46:54.745764] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T20:46:54.753203] [INFO ] [REMOTE ] PMT: Full fetch complete (58171 records). [2025-09-25T20:46:54.753359] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-25T20:46:55.093868] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-25T20:46:55.199628] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-25T20:46:55.199761] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-25T20:46:55.200835] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-25T20:46:55.200943] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-25T20:46:55.202297] [DEBUG] [LOCAL ] PMT: Trimmed 58171 records to 40570 (keeping 200 days of data) [2025-09-25T20:46:55.489024] [DEBUG] [LOCAL ] PMT: Primary data saved (40570 records). [2025-09-25T20:46:55.489203] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-25T20:46:55.489417] [INFO ] [MAIN ] Update Progress: 1708/2372 symbols completed. PMT took 25.1s. Estimated remaining: 1h 28m 12s. Rate: 7.5 symbols/min [2025-09-25T20:46:55.698965] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:46:55.699259] [DEBUG] [LOCAL ] PNC: No existing data file found in primary storage. [2025-09-25T20:46:55.699333] [WARN ] [MAIN ] PNC: No existing data found, performing full refresh instead. [2025-09-25T20:46:55.700148] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-25T20:46:55.700205] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-25T20:46:55.700277] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-25T20:46:55.700324] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-25T20:46:55.889512] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-25T20:46:56.024838] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T20:46:56.135780] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:46:56.189607] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:56.190085] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-25T20:46:56.688814] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-25T20:46:57.072454] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-25T20:46:57.488800] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-25T20:46:58.290027] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-25T20:46:58.686900] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T20:46:59.088711] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-25T20:46:59.152581] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T20:46:59.536664] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:46:59.537056] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-25T20:46:59.888759] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-25T20:47:00.002293] [DEBUG] [REMOTE ] PMTU: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-25T20:47:00.002935] [WARN ] [REMOTE ] PMTU: No data returned for month 2025-03 [2025-09-25T20:47:00.688755] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-25T20:47:01.488817] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-25T20:47:02.136936] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:47:02.288749] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-25T20:47:02.451625] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T20:47:02.610209] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-25T20:47:03.088747] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-25T20:47:03.518168] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T20:47:03.888734] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-25T20:47:04.688729] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-25T20:47:05.434769] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T20:47:05.488717] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-25T20:47:05.885507] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T20:47:05.889832] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T20:47:06.288753] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-25T20:47:06.752594] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T20:47:07.088737] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-25T20:47:07.801620] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T20:47:07.888740] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-25T20:47:08.272627] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-25T20:47:08.688731] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-25T20:47:09.074913] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-25T20:47:09.488746] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-25T20:47:10.288727] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-25T20:47:10.662758] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-25T20:47:10.664194] [INFO ] [REMOTE ] PMTU: Full fetch complete (1080 records). [2025-09-25T20:47:10.664341] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-25T20:47:10.870452] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 171 unique days, need 200 days [2025-09-25T20:47:10.870898] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:47:10.870982] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:47:10.871056] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-25T20:47:10.871171] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-25T20:47:10.871251] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-25T20:47:10.871321] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-25T20:47:10.871466] [INFO ] [MAIN ] Update Progress: 1709/2372 symbols completed. PMTU took 26.5s. Estimated remaining: 1h 28m 7s. Rate: 7.5 symbols/min [2025-09-25T20:47:11.090379] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-25T20:47:11.128232] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:11.155192] [DEBUG] [LOCAL ] PNI: Loaded 6684 existing records from primary storage. [2025-09-25T20:47:11.155395] [INFO ] [MAIN ] PNI: Loaded 6684 existing records. [2025-09-25T20:47:11.326136] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:47:11.429472] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:47:11.469928] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:11.470740] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-25T20:47:11.470807] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-25T20:47:11.471182] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-25T20:47:11.471262] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-25T20:47:11.505769] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-25T20:47:11.893848] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-25T20:47:11.980159] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:12.688754] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-25T20:47:13.488749] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-25T20:47:13.550986] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T20:47:13.814305] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T20:47:14.288700] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-25T20:47:14.299549] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T20:47:15.088746] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-25T20:47:15.888698] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-25T20:47:15.908582] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T20:47:16.296985] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-25T20:47:16.321020] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T20:47:16.688721] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-25T20:47:17.488757] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-25T20:47:18.210944] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T20:47:18.288737] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-25T20:47:18.429242] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:47:19.073909] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T20:47:19.088689] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-25T20:47:19.857055] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T20:47:19.888816] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-25T20:47:20.534601] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:47:20.688776] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-25T20:47:21.488721] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-25T20:47:21.502935] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T20:47:22.135933] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T20:47:22.288733] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-25T20:47:23.003067] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T20:47:23.088750] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-25T20:47:23.888751] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-25T20:47:24.472747] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T20:47:24.474054] [INFO ] [REMOTE ] PMTW: Full fetch complete (3680 records). [2025-09-25T20:47:24.474129] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-25T20:47:24.682320] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 73 unique days, need 200 days [2025-09-25T20:47:24.682696] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:47:24.682809] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:47:24.682884] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-25T20:47:24.682967] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-25T20:47:24.683026] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-25T20:47:24.683086] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-25T20:47:24.683179] [INFO ] [MAIN ] Update Progress: 1710/2372 symbols completed. PMTW took 37.9s. Estimated remaining: 1h 28m 1s. Rate: 7.5 symbols/min [2025-09-25T20:47:24.696715] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-25T20:47:24.918552] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:24.934819] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T20:47:25.000221] [DEBUG] [LOCAL ] PNNT: Loaded 32877 existing records from primary storage. [2025-09-25T20:47:25.000418] [INFO ] [MAIN ] PNNT: Loaded 32877 existing records. [2025-09-25T20:47:25.189821] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:25.190516] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-25T20:47:25.190566] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-25T20:47:25.190919] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-25T20:47:25.190979] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-25T20:47:25.388515] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T20:47:25.493759] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-25T20:47:25.594826] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:26.178902] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T20:47:26.288869] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-25T20:47:26.858314] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-25T20:47:26.859560] [INFO ] [REMOTE ] PMTV: Full fetch complete (6136 records). [2025-09-25T20:47:26.859634] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-25T20:47:27.054266] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-25T20:47:27.054819] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:47:27.054929] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:47:27.055035] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-25T20:47:27.055121] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-25T20:47:27.055179] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-25T20:47:27.055225] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-25T20:47:27.055316] [INFO ] [MAIN ] Update Progress: 1711/2372 symbols completed. PMTV took 41.0s. Estimated remaining: 1h 27m 51s. Rate: 7.5 symbols/min [2025-09-25T20:47:27.093828] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-25T20:47:27.241443] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:27.241740] [DEBUG] [LOCAL ] PNR: No existing data file found in primary storage. [2025-09-25T20:47:27.241802] [WARN ] [MAIN ] PNR: No existing data found, performing full refresh instead. [2025-09-25T20:47:27.242359] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-25T20:47:27.242408] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-25T20:47:27.242458] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-25T20:47:27.242498] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-25T20:47:27.621846] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:27.888744] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-25T20:47:28.570495] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T20:47:28.656695] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T20:47:28.688745] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-25T20:47:29.488748] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-25T20:47:30.066373] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T20:47:30.288710] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-25T20:47:31.051259] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T20:47:31.055614] [INFO ] [REMOTE ] PNI: Full fetch complete (9937 records). [2025-09-25T20:47:31.055728] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-25T20:47:31.093916] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-25T20:47:31.312781] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:47:31.518428] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-25T20:47:31.518522] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-25T20:47:31.518793] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-25T20:47:31.518854] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-25T20:47:31.519306] [DEBUG] [LOCAL ] PNI: Trimmed 9937 records to 6775 (keeping 200 days of data) [2025-09-25T20:47:31.564686] [DEBUG] [LOCAL ] PNI: Primary data saved (6775 records). [2025-09-25T20:47:31.564844] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-25T20:47:31.564947] [INFO ] [MAIN ] Update Progress: 1712/2372 symbols completed. PNI took 20.7s. Estimated remaining: 1h 27m 42s. Rate: 7.5 symbols/min [2025-09-25T20:47:31.761521] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:31.842763] [DEBUG] [LOCAL ] PNW: Loaded 45836 existing records from primary storage. [2025-09-25T20:47:31.842992] [INFO ] [MAIN ] PNW: Loaded 45836 existing records. [2025-09-25T20:47:31.901365] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-25T20:47:32.045941] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:32.046397] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-25T20:47:32.046451] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-25T20:47:32.047060] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-25T20:47:32.047326] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-25T20:47:32.439942] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:32.624632] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T20:47:32.688734] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-25T20:47:33.237627] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T20:47:33.472365] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T20:47:33.487131] [INFO ] [REMOTE ] PNC: Full fetch complete (75136 records). [2025-09-25T20:47:33.487304] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-25T20:47:33.488224] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:47:33.488390] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:47:33.488464] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:47:33.488533] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-25T20:47:33.488733] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-25T20:47:33.488620] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-25T20:47:33.489800] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-25T20:47:33.489864] [DEBUG] [LOCAL ] PNC: No derivative data file found to delete. [2025-09-25T20:47:33.489932] [INFO ] [MAIN ] Update Progress: 1713/2372 symbols completed. PNC took 38.0s. Estimated remaining: 1h 27m 31s. Rate: 7.5 symbols/min [2025-09-25T20:47:33.700595] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:33.758204] [DEBUG] [LOCAL ] POR: Loaded 47037 existing records from primary storage. [2025-09-25T20:47:33.758406] [INFO ] [MAIN ] POR: Loaded 47037 existing records. [2025-09-25T20:47:33.957206] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:33.957531] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-25T20:47:33.957577] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-25T20:47:33.957843] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-25T20:47:33.957902] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-25T20:47:34.294993] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-25T20:47:34.346383] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:35.097521] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-25T20:47:35.118086] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T20:47:35.888836] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-25T20:47:35.975998] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T20:47:36.688749] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-25T20:47:36.787667] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:47:37.488717] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-25T20:47:37.693843] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T20:47:38.134920] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T20:47:38.288855] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-25T20:47:38.887518] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:47:39.088761] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-25T20:47:39.888773] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-25T20:47:39.966089] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T20:47:40.688771] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-25T20:47:40.958089] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:47:41.488793] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-25T20:47:41.591098] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T20:47:42.207244] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T20:47:42.288934] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-25T20:47:43.088733] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-25T20:47:43.435923] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T20:47:43.554831] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T20:47:43.888731] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-25T20:47:44.688726] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-25T20:47:44.732534] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T20:47:45.488702] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-25T20:47:45.770833] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T20:47:46.288757] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-25T20:47:46.363162] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:47:46.778195] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T20:47:47.088737] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-25T20:47:47.888781] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-25T20:47:48.384690] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T20:47:48.483483] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T20:47:48.688736] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-25T20:47:49.488764] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-25T20:47:49.664448] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T20:47:50.288739] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-25T20:47:50.490454] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T20:47:51.088708] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-25T20:47:51.170973] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T20:47:51.278113] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T20:47:51.888763] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-25T20:47:52.688756] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-25T20:47:52.829569] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T20:47:53.093445] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-25T20:47:53.106969] [INFO ] [REMOTE ] PNNT: Full fetch complete (47184 records). [2025-09-25T20:47:53.107186] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-25T20:47:53.509761] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-25T20:47:53.533300] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-25T20:47:53.533401] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-25T20:47:53.534347] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-25T20:47:53.534461] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-25T20:47:53.535821] [DEBUG] [LOCAL ] PNNT: Trimmed 47184 records to 33086 (keeping 200 days of data) [2025-09-25T20:47:53.770749] [DEBUG] [LOCAL ] PNNT: Primary data saved (33086 records). [2025-09-25T20:47:53.770959] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-25T20:47:53.771210] [INFO ] [MAIN ] Update Progress: 1714/2372 symbols completed. PNNT took 29.1s. Estimated remaining: 1h 27m 28s. Rate: 7.5 symbols/min [2025-09-25T20:47:53.958363] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:54.022914] [DEBUG] [LOCAL ] POST: Loaded 38921 existing records from primary storage. [2025-09-25T20:47:54.023071] [INFO ] [MAIN ] POST: Loaded 38921 existing records. [2025-09-25T20:47:54.223180] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:54.223494] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-25T20:47:54.223566] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-25T20:47:54.224074] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-25T20:47:54.224176] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-25T20:47:54.291790] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-25T20:47:54.447153] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T20:47:54.733218] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:55.088725] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-25T20:47:55.387995] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:47:55.892480] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-25T20:47:55.910844] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T20:47:56.419327] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T20:47:56.709017] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T20:47:56.719676] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-25T20:47:56.723363] [INFO ] [REMOTE ] PNR: Full fetch complete (68866 records). [2025-09-25T20:47:56.723680] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-25T20:47:56.726526] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:47:56.727299] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:47:56.727411] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:47:56.727493] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-25T20:47:56.727583] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-25T20:47:56.727672] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-25T20:47:56.727755] [DEBUG] [LOCAL ] PNR: No derivative data file found to delete. [2025-09-25T20:47:56.727868] [INFO ] [MAIN ] Update Progress: 1715/2372 symbols completed. PNR took 29.7s. Estimated remaining: 1h 27m 18s. Rate: 7.5 symbols/min [2025-09-25T20:47:56.916635] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:47:56.992415] [DEBUG] [LOCAL ] PPG: Loaded 50693 existing records from primary storage. [2025-09-25T20:47:56.992597] [INFO ] [MAIN ] PPG: Loaded 50693 existing records. [2025-09-25T20:47:57.181838] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:47:57.182496] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-25T20:47:57.182545] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-25T20:47:57.182888] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-25T20:47:57.182949] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-25T20:47:57.494729] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-25T20:47:57.579951] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:47:58.288734] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-25T20:47:58.634083] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T20:47:59.088757] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-25T20:47:59.225175] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T20:47:59.868913] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T20:47:59.888684] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-25T20:48:00.688705] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-25T20:48:01.107294] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-25T20:48:01.366113] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:48:01.488748] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-25T20:48:02.178323] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T20:48:02.288747] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-25T20:48:03.033403] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T20:48:03.088738] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-25T20:48:03.888734] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-25T20:48:04.099983] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T20:48:04.651333] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T20:48:04.688707] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-25T20:48:05.375994] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T20:48:05.385897] [INFO ] [REMOTE ] POR: Full fetch complete (68156 records). [2025-09-25T20:48:05.386135] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-25T20:48:05.494783] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-25T20:48:05.847684] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-25T20:48:05.847790] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-25T20:48:05.848967] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-25T20:48:05.849038] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-25T20:48:05.850550] [DEBUG] [LOCAL ] POR: Trimmed 68156 records to 47392 (keeping 200 days of data) [2025-09-25T20:48:05.996426] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T20:48:06.208764] [DEBUG] [LOCAL ] POR: Primary data saved (47392 records). [2025-09-25T20:48:06.209620] [INFO ] [MAIN ] POR: Full history saved. [2025-09-25T20:48:06.209792] [INFO ] [MAIN ] Update Progress: 1716/2372 symbols completed. POR took 32.7s. Estimated remaining: 1h 27m 11s. Rate: 7.5 symbols/min [2025-09-25T20:48:06.293775] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-25T20:48:06.400253] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:06.400489] [DEBUG] [LOCAL ] PPL: No existing data file found in primary storage. [2025-09-25T20:48:06.400545] [WARN ] [MAIN ] PPL: No existing data found, performing full refresh instead. [2025-09-25T20:48:06.400874] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-25T20:48:06.400941] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-25T20:48:06.400989] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-25T20:48:06.401024] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-25T20:48:06.797899] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:07.088740] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-25T20:48:07.138502] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T20:48:07.883962] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T20:48:07.889604] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-25T20:48:08.688715] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-25T20:48:08.790131] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T20:48:08.891923] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T20:48:08.903821] [INFO ] [REMOTE ] PNW: Full fetch complete (66098 records). [2025-09-25T20:48:08.903986] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-25T20:48:09.295178] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-25T20:48:09.295304] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-25T20:48:09.296906] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-25T20:48:09.296977] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-25T20:48:09.298907] [DEBUG] [LOCAL ] PNW: Trimmed 66098 records to 46164 (keeping 200 days of data) [2025-09-25T20:48:09.502229] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-25T20:48:09.631410] [DEBUG] [LOCAL ] PNW: Primary data saved (46164 records). [2025-09-25T20:48:09.631620] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-25T20:48:09.633521] [INFO ] [MAIN ] Update Progress: 1717/2372 symbols completed. PNW took 38.1s. Estimated remaining: 1h 27m 1s. Rate: 7.5 symbols/min [2025-09-25T20:48:10.288753] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-25T20:48:10.414429] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T20:48:11.068411] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T20:48:11.088697] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-25T20:48:11.654101] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T20:48:11.888753] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-25T20:48:12.688744] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-25T20:48:12.882946] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T20:48:13.490405] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-25T20:48:13.493745] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-25T20:48:14.295922] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-25T20:48:14.302899] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:48:14.800860] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T20:48:15.088740] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-25T20:48:15.847516] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T20:48:15.888687] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-25T20:48:16.688740] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-25T20:48:16.748592] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T20:48:17.098699] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T20:48:17.109059] [INFO ] [REMOTE ] POST: Full fetch complete (55853 records). [2025-09-25T20:48:17.109221] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-25T20:48:17.495742] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-25T20:48:17.555675] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-25T20:48:17.555777] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-25T20:48:17.556876] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-25T20:48:17.556944] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-25T20:48:17.558345] [DEBUG] [LOCAL ] POST: Trimmed 55853 records to 39228 (keeping 200 days of data) [2025-09-25T20:48:17.802579] [DEBUG] [LOCAL ] POST: Primary data saved (39228 records). [2025-09-25T20:48:17.802784] [INFO ] [MAIN ] POST: Full history saved. [2025-09-25T20:48:17.802892] [INFO ] [MAIN ] Update Progress: 1718/2372 symbols completed. POST took 24.0s. Estimated remaining: 1h 26m 53s. Rate: 7.5 symbols/min [2025-09-25T20:48:18.446367] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T20:48:18.460778] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-25T20:48:19.411830] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T20:48:19.425502] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-25T20:48:20.793065] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-25T20:48:20.810816] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-25T20:48:21.285953] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T20:48:21.297630] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-25T20:48:22.780812] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T20:48:22.792294] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-25T20:48:22.873825] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T20:48:22.885941] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-25T20:48:24.445672] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T20:48:24.457216] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-25T20:48:24.778419] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T20:48:24.790286] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-25T20:48:25.263690] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T20:48:25.283489] [INFO ] [REMOTE ] PPL: Full fetch complete (77026 records). [2025-09-25T20:48:25.283703] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-25T20:48:25.287826] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:48:25.288250] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:48:25.288473] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:48:25.288681] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-25T20:48:25.288768] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-25T20:48:25.288808] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-25T20:48:25.288874] [DEBUG] [LOCAL ] PPL: No derivative data file found to delete. [2025-09-25T20:48:25.288964] [INFO ] [MAIN ] Update Progress: 1719/2372 symbols completed. PPL took 19.1s. Estimated remaining: 1h 26m 45s. Rate: 7.5 symbols/min [2025-09-25T20:48:26.091727] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T20:48:26.106454] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-25T20:48:27.820493] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T20:48:27.839599] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-25T20:48:29.497113] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T20:48:29.506816] [INFO ] [REMOTE ] PPG: Full fetch complete (73781 records). [2025-09-25T20:48:29.506971] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-25T20:48:29.933985] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-25T20:48:29.934071] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-25T20:48:29.935166] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-25T20:48:29.935236] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-25T20:48:29.936802] [DEBUG] [LOCAL ] PPG: Trimmed 73781 records to 51078 (keeping 200 days of data) [2025-09-25T20:48:30.279318] [DEBUG] [LOCAL ] PPG: Primary data saved (51078 records). [2025-09-25T20:48:30.279486] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-25T20:48:30.280821] [INFO ] [MAIN ] Update Progress: 1720/2372 symbols completed. PPG took 33.6s. Estimated remaining: 1h 26m 36s. Rate: 7.5 symbols/min [2025-09-25T20:48:30.980723] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:30.989032] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:30.989153] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-25T20:48:30.989191] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-25T20:48:30.989313] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-25T20:48:30.989354] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-25T20:48:30.989396] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-25T20:48:30.989429] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-25T20:48:31.029963] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:31.129937] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:31.154396] [DEBUG] [LOCAL ] PPT: Loaded 20056 existing records from primary storage. [2025-09-25T20:48:31.154551] [INFO ] [MAIN ] PPT: Loaded 20056 existing records. [2025-09-25T20:48:31.270579] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-25T20:48:31.284618] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-25T20:48:31.334406] [DEBUG] [LOCAL ] PRA: Loaded 34901 existing records from primary storage. [2025-09-25T20:48:31.334547] [INFO ] [MAIN ] PRA: Loaded 34901 existing records. [2025-09-25T20:48:31.901480] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:48:31.901767] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-25T20:48:31.901821] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-25T20:48:31.902077] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-25T20:48:31.902136] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-25T20:48:32.065964] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:48:32.066257] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-25T20:48:32.066316] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-25T20:48:32.066596] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-25T20:48:32.066693] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-25T20:48:32.199003] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:48:32.215021] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-25T20:48:32.215079] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-25T20:48:32.215294] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-25T20:48:32.215354] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-25T20:48:32.605409] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:32.625147] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-25T20:48:33.229982] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T20:48:33.231266] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-25T20:48:33.428155] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:33.428518] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-25T20:48:33.468037] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:33.468418] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-25T20:48:33.487415] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:33.487846] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-25T20:48:33.815711] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T20:48:33.817143] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-25T20:48:34.337908] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T20:48:34.340092] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-25T20:48:34.674334] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T20:48:34.679731] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-25T20:48:34.759694] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:48:34.766221] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-25T20:48:34.872933] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T20:48:34.874528] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-25T20:48:35.408718] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T20:48:35.419860] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-25T20:48:35.458003] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T20:48:35.459889] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-25T20:48:35.593114] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T20:48:35.617555] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T20:48:35.840466] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-25T20:48:35.888707] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-25T20:48:36.688795] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-25T20:48:36.916102] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T20:48:36.969168] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T20:48:37.488705] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-25T20:48:37.558698] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:48:38.288788] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-25T20:48:38.904141] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T20:48:39.062753] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T20:48:39.088713] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-25T20:48:39.888822] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-25T20:48:40.688793] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-25T20:48:41.010718] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T20:48:41.036718] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T20:48:41.221466] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T20:48:41.488726] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-25T20:48:42.004197] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-25T20:48:42.288731] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-25T20:48:43.088730] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-25T20:48:43.430562] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T20:48:43.888749] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-25T20:48:44.688808] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-25T20:48:44.829325] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:48:45.055497] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-25T20:48:45.488789] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-25T20:48:45.580218] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T20:48:45.971774] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T20:48:45.973091] [INFO ] [REMOTE ] PRCS: Full fetch complete (3796 records). [2025-09-25T20:48:45.973225] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-25T20:48:46.189061] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-25T20:48:46.189572] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:48:46.189731] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:48:46.189929] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-25T20:48:46.190051] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-25T20:48:46.190133] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-25T20:48:46.190205] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-25T20:48:46.190374] [INFO ] [MAIN ] Update Progress: 1721/2372 symbols completed. PRCS took 15.9s. Estimated remaining: 1h 26m 31s. Rate: 7.5 symbols/min [2025-09-25T20:48:46.294973] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-25T20:48:46.387874] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:46.456914] [DEBUG] [LOCAL ] PRG: Loaded 30048 existing records from primary storage. [2025-09-25T20:48:46.457094] [INFO ] [MAIN ] PRG: Loaded 30048 existing records. [2025-09-25T20:48:46.648934] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:48:46.649265] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-25T20:48:46.649313] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-25T20:48:46.649679] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-25T20:48:46.649754] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-25T20:48:47.031905] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:47.088772] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-25T20:48:47.888772] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-25T20:48:48.096856] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T20:48:48.428539] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T20:48:48.688765] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-25T20:48:49.086757] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T20:48:49.488771] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-25T20:48:49.853617] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:48:50.288757] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-25T20:48:50.892625] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T20:48:51.088782] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-25T20:48:51.496915] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T20:48:51.888679] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-25T20:48:52.352844] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T20:48:52.688757] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-25T20:48:53.426119] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T20:48:53.488747] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-25T20:48:54.288710] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-25T20:48:54.630766] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T20:48:54.927052] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T20:48:55.088736] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-25T20:48:55.682965] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T20:48:55.888710] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-25T20:48:56.401270] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T20:48:56.409252] [INFO ] [REMOTE ] PRA: Full fetch complete (43429 records). [2025-09-25T20:48:56.409350] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-25T20:48:56.688700] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-25T20:48:56.867868] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-25T20:48:56.867964] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-25T20:48:56.868917] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-25T20:48:56.869022] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-25T20:48:56.873163] [DEBUG] [LOCAL ] PRA: Trimmed 43429 records to 35061 (keeping 200 days of data) [2025-09-25T20:48:56.945342] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T20:48:57.121135] [DEBUG] [LOCAL ] PRA: Primary data saved (35061 records). [2025-09-25T20:48:57.121289] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-25T20:48:57.121425] [INFO ] [MAIN ] Update Progress: 1722/2372 symbols completed. PRA took 26.8s. Estimated remaining: 1h 26m 24s. Rate: 7.5 symbols/min [2025-09-25T20:48:57.303123] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:48:57.358843] [DEBUG] [LOCAL ] PRGO: Loaded 46894 existing records from primary storage. [2025-09-25T20:48:57.359010] [INFO ] [MAIN ] PRGO: Loaded 46894 existing records. [2025-09-25T20:48:57.489268] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-25T20:48:57.595485] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:48:57.596372] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-25T20:48:57.596564] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-25T20:48:57.597535] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-25T20:48:57.597632] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-25T20:48:58.050089] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:48:58.288796] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-25T20:48:58.355242] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T20:48:59.088758] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-25T20:48:59.281790] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T20:48:59.409109] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T20:48:59.413121] [INFO ] [REMOTE ] PPT: Full fetch complete (29267 records). [2025-09-25T20:48:59.413237] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-25T20:48:59.802473] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-25T20:48:59.802575] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-25T20:48:59.803291] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-25T20:48:59.803357] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-25T20:48:59.804339] [DEBUG] [LOCAL ] PPT: Trimmed 29267 records to 20177 (keeping 200 days of data) [2025-09-25T20:48:59.899734] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-25T20:48:59.946421] [DEBUG] [LOCAL ] PPT: Primary data saved (20177 records). [2025-09-25T20:48:59.946580] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-25T20:48:59.946754] [INFO ] [MAIN ] Update Progress: 1723/2372 symbols completed. PPT took 29.7s. Estimated remaining: 1h 26m 14s. Rate: 7.5 symbols/min [2025-09-25T20:49:00.132344] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:00.143114] [DEBUG] [LOCAL ] PRH: Loaded 4870 existing records from primary storage. [2025-09-25T20:49:00.143265] [INFO ] [MAIN ] PRH: Loaded 4870 existing records. [2025-09-25T20:49:00.335798] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:00.336125] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-25T20:49:00.336209] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-25T20:49:00.336523] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-25T20:49:00.336583] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-25T20:49:00.699741] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-25T20:49:00.734618] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:01.092448] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-25T20:49:01.488710] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-25T20:49:01.654390] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T20:49:02.288750] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-25T20:49:02.914679] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-25T20:49:02.933424] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T20:49:03.088696] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-25T20:49:03.314050] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T20:49:03.758144] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-25T20:49:03.888729] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-25T20:49:04.655730] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T20:49:04.688689] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-25T20:49:05.325943] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T20:49:05.488746] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-25T20:49:06.288749] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-25T20:49:06.988692] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T20:49:07.088744] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-25T20:49:07.122326] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:49:07.888748] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-25T20:49:08.441204] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T20:49:08.663888] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T20:49:08.688786] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-25T20:49:09.384443] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T20:49:09.488742] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-25T20:49:10.113868] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T20:49:10.288769] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-25T20:49:10.963501] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T20:49:11.088766] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-25T20:49:11.888727] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-25T20:49:12.689737] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-25T20:49:12.848447] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T20:49:13.373578] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T20:49:13.466059] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T20:49:13.488682] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-25T20:49:14.288759] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-25T20:49:14.815798] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-25T20:49:14.817362] [INFO ] [REMOTE ] PRH: Full fetch complete (7652 records). [2025-09-25T20:49:14.817454] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-25T20:49:15.093205] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-25T20:49:15.225877] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:49:15.334288] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-25T20:49:15.334377] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-25T20:49:15.334563] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-25T20:49:15.334602] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-25T20:49:15.335047] [DEBUG] [LOCAL ] PRH: Trimmed 7652 records to 4885 (keeping 200 days of data) [2025-09-25T20:49:15.368514] [DEBUG] [LOCAL ] PRH: Primary data saved (4885 records). [2025-09-25T20:49:15.368723] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-25T20:49:15.368903] [INFO ] [MAIN ] Update Progress: 1724/2372 symbols completed. PRH took 15.4s. Estimated remaining: 1h 26m 9s. Rate: 7.5 symbols/min [2025-09-25T20:49:15.554546] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:15.587987] [DEBUG] [LOCAL ] PRI: Loaded 18455 existing records from primary storage. [2025-09-25T20:49:15.588148] [INFO ] [MAIN ] PRI: Loaded 18455 existing records. [2025-09-25T20:49:15.783192] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:15.783459] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-25T20:49:15.783503] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-25T20:49:15.783932] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-25T20:49:15.783994] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-25T20:49:15.896820] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-25T20:49:16.175861] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:16.688686] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-25T20:49:17.017980] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T20:49:17.030827] [INFO ] [REMOTE ] PR: Full fetch complete (77594 records). [2025-09-25T20:49:17.030974] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-25T20:49:17.546903] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-25T20:49:17.554283] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-25T20:49:17.554389] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-25T20:49:17.555863] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-25T20:49:17.555954] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-25T20:49:17.561295] [DEBUG] [LOCAL ] PR: Trimmed 77594 records to 53999 (keeping 200 days of data) [2025-09-25T20:49:17.737293] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T20:49:17.752888] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T20:49:18.014346] [DEBUG] [LOCAL ] PR: Primary data saved (53999 records). [2025-09-25T20:49:18.014509] [INFO ] [MAIN ] PR: Full history saved. [2025-09-25T20:49:18.014604] [INFO ] [MAIN ] Update Progress: 1725/2372 symbols completed. PR took 47.7s. Estimated remaining: 1h 25m 59s. Rate: 7.5 symbols/min [2025-09-25T20:49:18.194788] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:18.244684] [DEBUG] [LOCAL ] PRIM: Loaded 44489 existing records from primary storage. [2025-09-25T20:49:18.244844] [INFO ] [MAIN ] PRIM: Loaded 44489 existing records. [2025-09-25T20:49:18.292587] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-25T20:49:18.444046] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:18.444328] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-25T20:49:18.444380] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-25T20:49:18.444807] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-25T20:49:18.444936] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-25T20:49:18.774927] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T20:49:18.850843] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:19.088737] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-25T20:49:19.888708] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-25T20:49:20.023015] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T20:49:20.335711] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:49:20.341408] [INFO ] [REMOTE ] PRG: Full fetch complete (44075 records). [2025-09-25T20:49:20.341561] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-25T20:49:20.694131] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-25T20:49:20.778615] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-25T20:49:20.778751] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-25T20:49:20.779813] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-25T20:49:20.779878] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-25T20:49:20.780932] [DEBUG] [LOCAL ] PRG: Trimmed 44075 records to 30222 (keeping 200 days of data) [2025-09-25T20:49:20.995495] [DEBUG] [LOCAL ] PRG: Primary data saved (30222 records). [2025-09-25T20:49:20.995697] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-25T20:49:20.995821] [INFO ] [MAIN ] Update Progress: 1726/2372 symbols completed. PRG took 34.8s. Estimated remaining: 1h 25m 49s. Rate: 7.5 symbols/min [2025-09-25T20:49:21.174254] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:21.228099] [DEBUG] [LOCAL ] PRKS: Loaded 42703 existing records from primary storage. [2025-09-25T20:49:21.228285] [INFO ] [MAIN ] PRKS: Loaded 42703 existing records. [2025-09-25T20:49:21.441690] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:21.442020] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-25T20:49:21.442078] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-25T20:49:21.442347] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-25T20:49:21.442406] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-25T20:49:21.510122] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-25T20:49:21.628238] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T20:49:21.921697] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:22.036508] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-25T20:49:22.288728] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-25T20:49:22.683733] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T20:49:23.088724] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-25T20:49:23.817694] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T20:49:23.888745] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-25T20:49:24.250210] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T20:49:24.688756] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-25T20:49:25.165209] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T20:49:25.488734] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-25T20:49:25.570070] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T20:49:26.288763] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-25T20:49:27.088799] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-25T20:49:27.144631] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:49:27.888728] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-25T20:49:27.944053] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T20:49:28.383084] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T20:49:28.688734] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-25T20:49:29.404499] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T20:49:29.488830] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-25T20:49:30.046344] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T20:49:30.288839] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-25T20:49:30.886874] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T20:49:31.088906] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-25T20:49:31.890880] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-25T20:49:31.894781] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T20:49:32.688764] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-25T20:49:32.792345] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T20:49:33.488826] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-25T20:49:33.638098] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T20:49:33.649305] [INFO ] [REMOTE ] PRGO: Full fetch complete (68403 records). [2025-09-25T20:49:33.649531] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-25T20:49:34.094061] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-25T20:49:34.094166] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-25T20:49:34.095239] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-25T20:49:34.095351] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-25T20:49:34.096840] [DEBUG] [LOCAL ] PRGO: Trimmed 68403 records to 47266 (keeping 200 days of data) [2025-09-25T20:49:34.311618] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-25T20:49:34.399263] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T20:49:34.497912] [DEBUG] [LOCAL ] PRGO: Primary data saved (47266 records). [2025-09-25T20:49:34.498076] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-25T20:49:34.498305] [INFO ] [MAIN ] Update Progress: 1727/2372 symbols completed. PRGO took 37.4s. Estimated remaining: 1h 25m 43s. Rate: 7.5 symbols/min [2025-09-25T20:49:34.704440] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:34.746921] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T20:49:34.786381] [DEBUG] [LOCAL ] PRLB: Loaded 20688 existing records from primary storage. [2025-09-25T20:49:34.786544] [INFO ] [MAIN ] PRLB: Loaded 20688 existing records. [2025-09-25T20:49:34.979899] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:34.980355] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-25T20:49:34.980443] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-25T20:49:34.980965] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-25T20:49:34.981053] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-25T20:49:35.098207] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-25T20:49:35.386993] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:35.634205] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T20:49:35.888747] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-25T20:49:36.320695] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T20:49:36.688709] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-25T20:49:36.981625] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T20:49:37.488863] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-25T20:49:38.210332] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T20:49:38.288685] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-25T20:49:38.402661] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:49:39.088732] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-25T20:49:39.436191] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T20:49:39.888764] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-25T20:49:40.688763] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-25T20:49:40.720270] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T20:49:40.951102] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T20:49:40.954971] [INFO ] [REMOTE ] PRI: Full fetch complete (25728 records). [2025-09-25T20:49:40.955062] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-25T20:49:41.361380] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-25T20:49:41.361517] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-25T20:49:41.362426] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-25T20:49:41.362491] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-25T20:49:41.363772] [DEBUG] [LOCAL ] PRI: Trimmed 25728 records to 18543 (keeping 200 days of data) [2025-09-25T20:49:41.488946] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-25T20:49:41.504887] [DEBUG] [LOCAL ] PRI: Primary data saved (18543 records). [2025-09-25T20:49:41.505048] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-25T20:49:41.505244] [INFO ] [MAIN ] Update Progress: 1728/2372 symbols completed. PRI took 26.1s. Estimated remaining: 1h 25m 35s. Rate: 7.5 symbols/min [2025-09-25T20:49:41.687123] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:41.778383] [DEBUG] [LOCAL ] PRM: Loaded 44602 existing records from primary storage. [2025-09-25T20:49:41.778613] [INFO ] [MAIN ] PRM: Loaded 44602 existing records. [2025-09-25T20:49:42.014194] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:42.014625] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-25T20:49:42.014724] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-25T20:49:42.015270] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-25T20:49:42.015338] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-25T20:49:42.298101] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-25T20:49:42.359118] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T20:49:42.453822] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:43.000531] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T20:49:43.088692] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-25T20:49:43.260815] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T20:49:43.888723] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-25T20:49:44.688747] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-25T20:49:44.754481] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T20:49:45.111024] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T20:49:45.488692] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-25T20:49:45.799396] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T20:49:46.288738] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-25T20:49:47.088710] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-25T20:49:47.157939] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T20:49:47.491600] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T20:49:47.888735] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-25T20:49:48.573325] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:49:48.688757] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-25T20:49:49.488765] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-25T20:49:49.628600] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T20:49:49.637005] [INFO ] [REMOTE ] PRIM: Full fetch complete (63267 records). [2025-09-25T20:49:49.637183] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-25T20:49:49.838880] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-25T20:49:50.082978] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-25T20:49:50.083063] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-25T20:49:50.084193] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-25T20:49:50.084262] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-25T20:49:50.086836] [DEBUG] [LOCAL ] PRIM: Trimmed 63267 records to 44756 (keeping 200 days of data) [2025-09-25T20:49:50.295735] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-25T20:49:50.401668] [DEBUG] [LOCAL ] PRIM: Primary data saved (44756 records). [2025-09-25T20:49:50.401824] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-25T20:49:50.401948] [INFO ] [MAIN ] Update Progress: 1729/2372 symbols completed. PRIM took 32.4s. Estimated remaining: 1h 25m 27s. Rate: 7.5 symbols/min [2025-09-25T20:49:50.591416] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:50.663289] [DEBUG] [LOCAL ] PRMB: Loaded 53167 existing records from primary storage. [2025-09-25T20:49:50.663677] [INFO ] [MAIN ] PRMB: Loaded 53167 existing records. [2025-09-25T20:49:50.853045] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:50.853393] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-25T20:49:50.853447] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-25T20:49:50.853962] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-25T20:49:50.854027] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-25T20:49:51.118916] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-25T20:49:51.207253] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T20:49:51.292363] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:51.888703] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-25T20:49:51.941367] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T20:49:52.377037] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T20:49:52.688748] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-25T20:49:53.299804] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T20:49:53.312835] [INFO ] [REMOTE ] PRKS: Full fetch complete (61105 records). [2025-09-25T20:49:53.313049] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-25T20:49:53.493805] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-25T20:49:53.788509] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-25T20:49:53.788634] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-25T20:49:53.790957] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-25T20:49:53.791030] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-25T20:49:53.795724] [DEBUG] [LOCAL ] PRKS: Trimmed 61105 records to 42999 (keeping 200 days of data) [2025-09-25T20:49:54.106341] [DEBUG] [LOCAL ] PRKS: Primary data saved (42999 records). [2025-09-25T20:49:54.106518] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-25T20:49:54.106679] [INFO ] [MAIN ] Update Progress: 1730/2372 symbols completed. PRKS took 33.1s. Estimated remaining: 1h 25m 18s. Rate: 7.5 symbols/min [2025-09-25T20:49:54.286718] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:49:54.288812] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-25T20:49:54.352554] [DEBUG] [LOCAL ] PRO: Loaded 37725 existing records from primary storage. [2025-09-25T20:49:54.352790] [INFO ] [MAIN ] PRO: Loaded 37725 existing records. [2025-09-25T20:49:54.510418] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T20:49:54.594700] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:49:54.595443] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-25T20:49:54.595497] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-25T20:49:54.595934] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-25T20:49:54.595996] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-25T20:49:54.759748] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T20:49:54.988575] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:49:55.088745] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-25T20:49:55.888784] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-25T20:49:55.983247] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:49:56.170551] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T20:49:56.688739] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-25T20:49:57.404996] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T20:49:57.488681] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-25T20:49:58.288824] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-25T20:49:58.429088] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T20:49:59.073348] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T20:49:59.088675] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-25T20:49:59.721137] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T20:49:59.888754] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-25T20:50:00.684311] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T20:50:00.696433] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-25T20:50:01.214627] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T20:50:01.488800] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-25T20:50:02.294048] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-25T20:50:02.312603] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T20:50:02.704205] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T20:50:03.088819] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-25T20:50:03.890402] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T20:50:03.889058] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-25T20:50:04.688772] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-25T20:50:04.901830] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T20:50:05.119100] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T20:50:05.488768] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-25T20:50:06.288775] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-25T20:50:06.486009] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T20:50:06.806197] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-25T20:50:07.088758] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-25T20:50:07.888740] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-25T20:50:07.958396] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T20:50:07.968307] [INFO ] [REMOTE ] PRM: Full fetch complete (64437 records). [2025-09-25T20:50:07.968501] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-25T20:50:08.419559] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-25T20:50:08.419738] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-25T20:50:08.420991] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-25T20:50:08.421131] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-25T20:50:08.423739] [DEBUG] [LOCAL ] PRM: Trimmed 64437 records to 44963 (keeping 200 days of data) [2025-09-25T20:50:08.692719] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-25T20:50:08.728945] [DEBUG] [LOCAL ] PRM: Primary data saved (44963 records). [2025-09-25T20:50:08.729100] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-25T20:50:08.730540] [INFO ] [MAIN ] Update Progress: 1731/2372 symbols completed. PRM took 27.2s. Estimated remaining: 1h 25m 12s. Rate: 7.5 symbols/min [2025-09-25T20:50:08.947868] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:08.948081] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-25T20:50:08.948166] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-25T20:50:08.948406] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-25T20:50:08.948470] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-25T20:50:08.948583] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-25T20:50:08.948696] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-25T20:50:09.094612] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T20:50:09.442364] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T20:50:09.476296] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:09.488689] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-25T20:50:09.845283] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T20:50:09.849168] [INFO ] [REMOTE ] PRLB: Full fetch complete (30963 records). [2025-09-25T20:50:09.849289] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-25T20:50:10.255153] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-25T20:50:10.255245] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-25T20:50:10.255941] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-25T20:50:10.256038] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-25T20:50:10.256999] [DEBUG] [LOCAL ] PRLB: Trimmed 30963 records to 20788 (keeping 200 days of data) [2025-09-25T20:50:10.322732] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-25T20:50:10.408892] [DEBUG] [LOCAL ] PRLB: Primary data saved (20788 records). [2025-09-25T20:50:10.409049] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-25T20:50:10.409260] [INFO ] [MAIN ] Update Progress: 1732/2372 symbols completed. PRLB took 35.9s. Estimated remaining: 1h 25m 2s. Rate: 7.5 symbols/min [2025-09-25T20:50:10.584481] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:10.597868] [DEBUG] [LOCAL ] PRT: Loaded 5333 existing records from primary storage. [2025-09-25T20:50:10.598011] [INFO ] [MAIN ] PRT: Loaded 5333 existing records. [2025-09-25T20:50:10.603738] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:50:10.603984] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-25T20:50:10.790411] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:50:10.790732] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-25T20:50:10.790790] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-25T20:50:10.791117] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-25T20:50:10.791218] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-25T20:50:10.990219] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T20:50:11.089518] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-25T20:50:11.228331] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:11.888727] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-25T20:50:12.279158] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T20:50:12.688754] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-25T20:50:13.488747] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-25T20:50:13.699753] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T20:50:13.984533] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T20:50:14.014750] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-25T20:50:14.288741] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-25T20:50:15.088726] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-25T20:50:15.706169] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T20:50:15.888739] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-25T20:50:16.688721] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-25T20:50:17.296281] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-25T20:50:17.421086] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T20:50:17.485693] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T20:50:17.488969] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-25T20:50:18.288711] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-25T20:50:19.067846] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T20:50:19.085187] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T20:50:19.088677] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-25T20:50:19.888740] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-25T20:50:20.660569] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T20:50:20.688700] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-25T20:50:20.971697] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T20:50:21.488756] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-25T20:50:22.288739] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-25T20:50:22.361605] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T20:50:23.088693] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-25T20:50:23.434104] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T20:50:23.504041] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T20:50:23.888742] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-25T20:50:24.463877] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T20:50:24.476479] [INFO ] [REMOTE ] PRO: Full fetch complete (51394 records). [2025-09-25T20:50:24.476731] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-25T20:50:24.694947] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-25T20:50:24.986702] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-25T20:50:24.986814] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-25T20:50:24.987774] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-25T20:50:24.987842] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-25T20:50:24.989370] [DEBUG] [LOCAL ] PRO: Trimmed 51394 records to 38081 (keeping 200 days of data) [2025-09-25T20:50:25.266817] [DEBUG] [LOCAL ] PRO: Primary data saved (38081 records). [2025-09-25T20:50:25.267002] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-25T20:50:25.267139] [INFO ] [MAIN ] Update Progress: 1733/2372 symbols completed. PRO took 31.2s. Estimated remaining: 1h 24m 57s. Rate: 7.5 symbols/min [2025-09-25T20:50:25.412393] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T20:50:25.461065] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:25.488705] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-25T20:50:25.541385] [DEBUG] [LOCAL ] PRU: Loaded 51465 existing records from primary storage. [2025-09-25T20:50:25.541547] [INFO ] [MAIN ] PRU: Loaded 51465 existing records. [2025-09-25T20:50:25.763124] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:50:25.764013] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-25T20:50:25.764084] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-25T20:50:25.781873] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T20:50:25.794680] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-25T20:50:25.794880] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-25T20:50:26.119132] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T20:50:26.218412] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:26.288734] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-25T20:50:27.088736] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-25T20:50:27.888792] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-25T20:50:28.094898] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T20:50:28.111913] [INFO ] [REMOTE ] PRMB: Full fetch complete (76071 records). [2025-09-25T20:50:28.112136] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-25T20:50:28.512336] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T20:50:28.602370] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-25T20:50:28.602479] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-25T20:50:28.603778] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-25T20:50:28.603905] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-25T20:50:28.609364] [DEBUG] [LOCAL ] PRMB: Trimmed 76071 records to 53544 (keeping 200 days of data) [2025-09-25T20:50:28.690730] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-25T20:50:29.009321] [DEBUG] [LOCAL ] PRMB: Primary data saved (53544 records). [2025-09-25T20:50:29.009604] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-25T20:50:29.009822] [INFO ] [MAIN ] Update Progress: 1734/2372 symbols completed. PRMB took 38.6s. Estimated remaining: 1h 24m 47s. Rate: 7.5 symbols/min [2025-09-25T20:50:29.169690] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T20:50:29.223790] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:29.224034] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-25T20:50:29.224095] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-25T20:50:29.224335] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-25T20:50:29.224379] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-25T20:50:29.224422] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-25T20:50:29.224465] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-25T20:50:29.493850] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-25T20:50:29.669328] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T20:50:29.699155] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:30.288740] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-25T20:50:30.617385] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:50:30.784155] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T20:50:31.088739] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-25T20:50:31.519141] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T20:50:31.888793] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-25T20:50:32.369170] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T20:50:32.688807] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-25T20:50:33.489256] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-25T20:50:33.490558] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:50:34.288758] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-25T20:50:34.602110] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:50:34.724231] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-25T20:50:35.088842] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-25T20:50:35.813269] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T20:50:35.817449] [INFO ] [REMOTE ] PRT: Full fetch complete (9181 records). [2025-09-25T20:50:35.817546] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-25T20:50:35.894828] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-25T20:50:36.238979] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-25T20:50:36.239081] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-25T20:50:36.239338] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-25T20:50:36.239408] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-25T20:50:36.240247] [DEBUG] [LOCAL ] PRT: Trimmed 9181 records to 5372 (keeping 200 days of data) [2025-09-25T20:50:36.278357] [DEBUG] [LOCAL ] PRT: Primary data saved (5372 records). [2025-09-25T20:50:36.278484] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-25T20:50:36.278697] [INFO ] [MAIN ] Update Progress: 1735/2372 symbols completed. PRT took 25.9s. Estimated remaining: 1h 24m 39s. Rate: 7.5 symbols/min [2025-09-25T20:50:36.463887] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:36.533829] [DEBUG] [LOCAL ] PSA: Loaded 41843 existing records from primary storage. [2025-09-25T20:50:36.533981] [INFO ] [MAIN ] PSA: Loaded 41843 existing records. [2025-09-25T20:50:36.715733] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-25T20:50:36.721171] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:50:36.722976] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-25T20:50:36.723046] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-25T20:50:36.726678] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-25T20:50:36.726749] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-25T20:50:37.092143] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:37.488745] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-25T20:50:37.722567] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T20:50:37.884930] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T20:50:37.928251] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T20:50:38.288773] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-25T20:50:38.676196] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T20:50:39.088823] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-25T20:50:39.888770] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-25T20:50:40.293450] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T20:50:40.688796] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-25T20:50:40.833061] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T20:50:41.488789] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-25T20:50:41.936959] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:50:41.945718] [INFO ] [REMOTE ] PRSU: Full fetch complete (32074 records). [2025-09-25T20:50:41.945912] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-25T20:50:42.172593] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T20:50:42.173185] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:50:42.173256] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:50:42.173328] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-25T20:50:42.173453] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-25T20:50:42.173531] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-25T20:50:42.173615] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-25T20:50:42.173929] [INFO ] [MAIN ] Update Progress: 1736/2372 symbols completed. PRSU took 33.4s. Estimated remaining: 1h 24m 30s. Rate: 7.5 symbols/min [2025-09-25T20:50:42.293903] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-25T20:50:42.365849] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:50:42.396321] [DEBUG] [LOCAL ] PSBD: Loaded 6921 existing records from primary storage. [2025-09-25T20:50:42.396466] [INFO ] [MAIN ] PSBD: Loaded 6921 existing records. [2025-09-25T20:50:42.606883] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:50:42.607347] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-25T20:50:42.607399] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-25T20:50:42.607800] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-25T20:50:42.607873] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-25T20:50:42.990859] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:50:43.088703] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-25T20:50:43.437685] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T20:50:43.782093] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T20:50:43.888793] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-25T20:50:44.244970] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:50:44.530541] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T20:50:44.688755] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-25T20:50:45.304443] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T20:50:45.488748] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-25T20:50:46.288757] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-25T20:50:46.764203] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T20:50:46.892076] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T20:50:47.088760] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-25T20:50:47.888719] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-25T20:50:48.498551] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T20:50:48.523834] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T20:50:48.688737] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-25T20:50:49.439283] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T20:50:49.488737] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-25T20:50:49.876885] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-25T20:50:50.288745] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-25T20:50:51.088729] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-25T20:50:51.455439] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T20:50:51.898504] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-25T20:50:51.916722] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T20:50:52.688737] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-25T20:50:53.488735] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-25T20:50:53.769336] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T20:50:53.808482] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-25T20:50:54.288719] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-25T20:50:54.576028] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:50:55.072536] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T20:50:55.088698] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-25T20:50:55.888748] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-25T20:50:55.912378] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-25T20:50:56.688739] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-25T20:50:57.488794] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-25T20:50:57.956706] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T20:50:58.038594] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T20:50:58.288737] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-25T20:50:58.343012] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T20:50:59.088741] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-25T20:50:59.773717] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T20:50:59.888745] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-25T20:50:59.949215] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T20:50:59.952376] [INFO ] [REMOTE ] PSBD: Full fetch complete (9298 records). [2025-09-25T20:50:59.952472] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-25T20:51:00.335076] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T20:51:00.336370] [INFO ] [REMOTE ] PRVS: Full fetch complete (1268 records). [2025-09-25T20:51:00.336449] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-25T20:51:00.493760] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-25T20:51:00.493894] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-25T20:51:00.494528] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-25T20:51:00.494598] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-25T20:51:00.495216] [DEBUG] [LOCAL ] PSBD: Trimmed 9298 records to 7064 (keeping 200 days of data) [2025-09-25T20:51:00.628864] [DEBUG] [LOCAL ] PSBD: Primary data saved (7064 records). [2025-09-25T20:51:00.629042] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-25T20:51:00.629174] [INFO ] [MAIN ] Update Progress: 1737/2372 symbols completed. PSBD took 18.5s. Estimated remaining: 1h 24m 26s. Rate: 7.5 symbols/min [2025-09-25T20:51:00.695753] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-25T20:51:00.732115] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-25T20:51:00.732417] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:51:00.732464] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:51:00.732506] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-25T20:51:00.732588] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-25T20:51:00.732694] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-25T20:51:00.738288] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-25T20:51:00.738375] [INFO ] [MAIN ] Update Progress: 1738/2372 symbols completed. PRVS took 31.7s. Estimated remaining: 1h 24m 15s. Rate: 7.5 symbols/min [2025-09-25T20:51:01.036796] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:01.042451] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:01.058716] [DEBUG] [LOCAL ] PSF: Loaded 6776 existing records from primary storage. [2025-09-25T20:51:01.058933] [INFO ] [MAIN ] PSF: Loaded 6776 existing records. [2025-09-25T20:51:01.282716] [DEBUG] [LOCAL ] PSFE: Loaded 30406 existing records from primary storage. [2025-09-25T20:51:01.283102] [INFO ] [MAIN ] PSFE: Loaded 30406 existing records. [2025-09-25T20:51:01.308587] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:01.308930] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-25T20:51:01.308990] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-25T20:51:01.309412] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-25T20:51:01.309471] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-25T20:51:01.497718] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-25T20:51:01.643250] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:01.643616] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-25T20:51:01.643766] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-25T20:51:01.644136] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-25T20:51:01.644199] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-25T20:51:02.224249] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:02.293833] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-25T20:51:02.401299] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:02.425422] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T20:51:03.076996] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T20:51:03.088668] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-25T20:51:03.238623] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:51:03.888755] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-25T20:51:03.939206] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T20:51:04.688855] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-25T20:51:05.488807] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-25T20:51:05.900709] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T20:51:05.971303] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-25T20:51:06.023128] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T20:51:06.288738] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-25T20:51:06.991066] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-25T20:51:07.088729] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-25T20:51:07.888805] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-25T20:51:08.688843] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-25T20:51:08.812995] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T20:51:08.821922] [INFO ] [REMOTE ] PSA: Full fetch complete (59127 records). [2025-09-25T20:51:08.822139] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-25T20:51:09.273476] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-25T20:51:09.273598] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-25T20:51:09.274899] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-25T20:51:09.275016] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-25T20:51:09.277236] [DEBUG] [LOCAL ] PSA: Trimmed 59127 records to 42130 (keeping 200 days of data) [2025-09-25T20:51:09.501754] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-25T20:51:09.541115] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T20:51:09.606808] [DEBUG] [LOCAL ] PSA: Primary data saved (42130 records). [2025-09-25T20:51:09.606970] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-25T20:51:09.607154] [INFO ] [MAIN ] Update Progress: 1739/2372 symbols completed. PSA took 33.3s. Estimated remaining: 1h 24m 7s. Rate: 7.5 symbols/min [2025-09-25T20:51:09.807033] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:09.850719] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T20:51:09.919349] [DEBUG] [LOCAL ] PSN: Loaded 46194 existing records from primary storage. [2025-09-25T20:51:09.919532] [INFO ] [MAIN ] PSN: Loaded 46194 existing records. [2025-09-25T20:51:10.117789] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:10.118369] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-25T20:51:10.118436] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-25T20:51:10.119092] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-25T20:51:10.119172] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-25T20:51:10.289317] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-25T20:51:10.519283] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:10.926696] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T20:51:11.088749] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-25T20:51:11.135211] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T20:51:11.888715] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-25T20:51:12.213180] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T20:51:12.301178] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-25T20:51:12.688706] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-25T20:51:13.488818] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-25T20:51:14.268350] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T20:51:14.288704] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-25T20:51:14.850305] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T20:51:15.088753] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-25T20:51:15.888759] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-25T20:51:16.001698] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T20:51:16.567355] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T20:51:16.688725] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-25T20:51:16.727130] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T20:51:17.488714] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-25T20:51:17.499228] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T20:51:18.288769] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-25T20:51:19.088764] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-25T20:51:19.209048] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T20:51:19.656709] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T20:51:19.888737] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-25T20:51:20.678796] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:51:20.681481] [INFO ] [REMOTE ] PSF: Full fetch complete (9634 records). [2025-09-25T20:51:20.681624] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-25T20:51:20.696076] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-25T20:51:21.047499] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T20:51:21.078128] [INFO ] [REMOTE ] PRU: Full fetch complete (74283 records). [2025-09-25T20:51:21.078434] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-25T20:51:21.240266] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-25T20:51:21.240357] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-25T20:51:21.240605] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-25T20:51:21.240667] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-25T20:51:21.241152] [DEBUG] [LOCAL ] PSF: Trimmed 9634 records to 6828 (keeping 200 days of data) [2025-09-25T20:51:21.367815] [DEBUG] [LOCAL ] PSF: Primary data saved (6828 records). [2025-09-25T20:51:21.367960] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-25T20:51:21.368111] [INFO ] [MAIN ] Update Progress: 1740/2372 symbols completed. PSF took 20.7s. Estimated remaining: 1h 24m 1s. Rate: 7.5 symbols/min [2025-09-25T20:51:21.494713] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-25T20:51:21.838490] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:21.912019] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-25T20:51:21.912148] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-25T20:51:21.913379] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-25T20:51:21.913458] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-25T20:51:21.926030] [DEBUG] [LOCAL ] PRU: Trimmed 74283 records to 51835 (keeping 200 days of data) [2025-09-25T20:51:22.098031] [DEBUG] [LOCAL ] PSO: Loaded 37363 existing records from primary storage. [2025-09-25T20:51:22.098202] [INFO ] [MAIN ] PSO: Loaded 37363 existing records. [2025-09-25T20:51:22.404499] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:51:22.441938] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-25T20:51:22.485026] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:22.485299] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-25T20:51:22.485368] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-25T20:51:22.485938] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-25T20:51:22.486041] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-25T20:51:22.691986] [DEBUG] [LOCAL ] PRU: Primary data saved (51835 records). [2025-09-25T20:51:22.692153] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-25T20:51:22.693472] [INFO ] [MAIN ] Update Progress: 1741/2372 symbols completed. PRU took 57.4s. Estimated remaining: 1h 23m 50s. Rate: 7.5 symbols/min [2025-09-25T20:51:23.074009] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:23.214831] [DEBUG] [LOCAL ] PSQH: Loaded 34746 existing records from primary storage. [2025-09-25T20:51:23.221929] [INFO ] [MAIN ] PSQH: Loaded 34746 existing records. [2025-09-25T20:51:23.308139] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T20:51:23.364863] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-25T20:51:23.413402] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:23.545346] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:23.546288] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-25T20:51:23.546344] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-25T20:51:23.547009] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-25T20:51:23.547085] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-25T20:51:23.691470] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T20:51:23.894722] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-25T20:51:23.964286] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:24.688737] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-25T20:51:25.002828] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T20:51:25.433420] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T20:51:25.488725] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-25T20:51:26.288737] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-25T20:51:26.831369] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-25T20:51:26.880589] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T20:51:27.088717] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-25T20:51:27.888727] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-25T20:51:28.022168] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T20:51:28.688754] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-25T20:51:28.948921] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T20:51:28.993866] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T20:51:29.000694] [INFO ] [REMOTE ] PSFE: Full fetch complete (43143 records). [2025-09-25T20:51:29.000835] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-25T20:51:29.413435] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-25T20:51:29.413546] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-25T20:51:29.414832] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-25T20:51:29.414912] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-25T20:51:29.416798] [DEBUG] [LOCAL ] PSFE: Trimmed 43143 records to 30563 (keeping 200 days of data) [2025-09-25T20:51:29.495967] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-25T20:51:29.651122] [DEBUG] [LOCAL ] PSFE: Primary data saved (30563 records). [2025-09-25T20:51:29.651287] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-25T20:51:29.651405] [INFO ] [MAIN ] Update Progress: 1742/2372 symbols completed. PSFE took 28.9s. Estimated remaining: 1h 23m 42s. Rate: 7.5 symbols/min [2025-09-25T20:51:29.853111] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:29.918776] [DEBUG] [LOCAL ] PSTG: Loaded 52847 existing records from primary storage. [2025-09-25T20:51:29.918945] [INFO ] [MAIN ] PSTG: Loaded 52847 existing records. [2025-09-25T20:51:30.130890] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:30.131519] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-25T20:51:30.131576] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-25T20:51:30.132053] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-25T20:51:30.132114] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-25T20:51:30.292922] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-25T20:51:30.347387] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T20:51:30.603818] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:30.855487] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T20:51:31.088723] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-25T20:51:31.654790] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:51:31.888817] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-25T20:51:32.688730] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-25T20:51:32.754259] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T20:51:33.185782] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T20:51:33.488765] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-25T20:51:34.239458] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T20:51:34.288924] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-25T20:51:35.089027] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-25T20:51:35.584835] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-25T20:51:35.623314] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T20:51:35.888763] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-25T20:51:36.493377] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T20:51:36.688711] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-25T20:51:37.135573] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T20:51:37.488857] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-25T20:51:38.022623] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T20:51:38.288731] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-25T20:51:39.026617] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:51:39.088735] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-25T20:51:39.888783] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-25T20:51:39.950324] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T20:51:40.543025] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T20:51:40.688746] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-25T20:51:41.488715] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-25T20:51:41.675747] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T20:51:42.264073] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-25T20:51:42.288682] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-25T20:51:43.088733] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-25T20:51:43.436059] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-25T20:51:43.888788] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-25T20:51:43.925632] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T20:51:44.688743] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-25T20:51:44.857973] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T20:51:44.869015] [INFO ] [REMOTE ] PSQH: Full fetch complete (53858 records). [2025-09-25T20:51:44.869196] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-25T20:51:45.331988] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-25T20:51:45.332149] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-25T20:51:45.333226] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-25T20:51:45.333347] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-25T20:51:45.334728] [DEBUG] [LOCAL ] PSQH: Trimmed 53858 records to 35131 (keeping 200 days of data) [2025-09-25T20:51:45.380303] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T20:51:45.454195] [INFO ] [REMOTE ] PSN: Full fetch complete (66789 records). [2025-09-25T20:51:45.454436] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-25T20:51:45.489726] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-25T20:51:45.821668] [DEBUG] [LOCAL ] PSQH: Primary data saved (35131 records). [2025-09-25T20:51:45.821815] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-25T20:51:45.822065] [INFO ] [MAIN ] Update Progress: 1743/2372 symbols completed. PSQH took 23.1s. Estimated remaining: 1h 23m 37s. Rate: 7.5 symbols/min [2025-09-25T20:51:46.397067] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-25T20:51:46.397215] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-25T20:51:46.400007] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-25T20:51:46.401940] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-25T20:51:46.403904] [DEBUG] [LOCAL ] PSN: Trimmed 66789 records to 46526 (keeping 200 days of data) [2025-09-25T20:51:46.406033] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:46.429859] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T20:51:46.509328] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-25T20:51:46.510323] [DEBUG] [LOCAL ] PSTL: Loaded 20371 existing records from primary storage. [2025-09-25T20:51:46.512341] [INFO ] [MAIN ] PSTL: Loaded 20371 existing records. [2025-09-25T20:51:46.897351] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:46.927732] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-25T20:51:46.936727] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-25T20:51:46.954677] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-25T20:51:46.978808] [DEBUG] [LOCAL ] PSN: Primary data saved (46526 records). [2025-09-25T20:51:46.978977] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-25T20:51:46.979184] [INFO ] [MAIN ] Update Progress: 1744/2372 symbols completed. PSN took 37.4s. Estimated remaining: 1h 23m 27s. Rate: 7.5 symbols/min [2025-09-25T20:51:46.985745] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-25T20:51:47.385167] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:47.532450] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-25T20:51:47.558015] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-25T20:51:47.594811] [DEBUG] [LOCAL ] PSX: Loaded 53132 existing records from primary storage. [2025-09-25T20:51:47.594981] [INFO ] [MAIN ] PSX: Loaded 53132 existing records. [2025-09-25T20:51:47.836314] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:47.889600] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-25T20:51:47.909612] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:47.910371] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-25T20:51:47.910450] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-25T20:51:47.911279] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-25T20:51:47.911396] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-25T20:51:48.190775] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T20:51:48.352626] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:48.688735] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-25T20:51:49.121204] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T20:51:49.488725] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-25T20:51:49.598259] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T20:51:50.288698] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-25T20:51:50.598322] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T20:51:50.619555] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T20:51:51.088777] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-25T20:51:51.500017] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T20:51:51.888737] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-25T20:51:52.688739] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-25T20:51:53.050623] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T20:51:53.111250] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-25T20:51:53.488727] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-25T20:51:53.925614] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T20:51:53.932273] [INFO ] [REMOTE ] PSO: Full fetch complete (51753 records). [2025-09-25T20:51:53.932392] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-25T20:51:54.292819] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-25T20:51:54.352230] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-25T20:51:54.352331] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-25T20:51:54.353269] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-25T20:51:54.353334] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-25T20:51:54.356802] [DEBUG] [LOCAL ] PSO: Trimmed 51753 records to 37577 (keeping 200 days of data) [2025-09-25T20:51:54.631800] [DEBUG] [LOCAL ] PSO: Primary data saved (37577 records). [2025-09-25T20:51:54.631963] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-25T20:51:54.632067] [INFO ] [MAIN ] Update Progress: 1745/2372 symbols completed. PSO took 33.3s. Estimated remaining: 1h 23m 19s. Rate: 7.5 symbols/min [2025-09-25T20:51:54.809801] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:51:54.835608] [DEBUG] [LOCAL ] PTA: Loaded 15059 existing records from primary storage. [2025-09-25T20:51:54.835780] [INFO ] [MAIN ] PTA: Loaded 15059 existing records. [2025-09-25T20:51:55.019285] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:51:55.021870] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-25T20:51:55.021920] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-25T20:51:55.022148] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-25T20:51:55.022208] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-25T20:51:55.094092] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-25T20:51:55.273747] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T20:51:55.475400] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:51:55.888689] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-25T20:51:55.961476] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T20:51:56.143975] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T20:51:56.688771] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-25T20:51:57.104561] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T20:51:57.488764] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-25T20:51:58.288699] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-25T20:51:58.376300] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T20:51:59.088697] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-25T20:51:59.427139] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T20:51:59.459559] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T20:51:59.888726] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-25T20:52:00.688741] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-25T20:52:00.990670] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T20:52:01.261114] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-25T20:52:01.488735] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-25T20:52:01.890399] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T20:52:02.288737] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-25T20:52:03.088699] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-25T20:52:03.481246] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:52:03.527092] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T20:52:03.888750] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-25T20:52:04.688713] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-25T20:52:05.014225] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T20:52:05.488699] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-25T20:52:05.847292] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:52:05.882525] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T20:52:06.288924] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-25T20:52:07.088731] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-25T20:52:07.295738] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T20:52:07.888777] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-25T20:52:08.199358] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T20:52:08.349884] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T20:52:08.689011] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-25T20:52:08.695745] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T20:52:09.488802] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-25T20:52:10.288784] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-25T20:52:10.466408] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T20:52:10.671618] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T20:52:11.088727] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-25T20:52:11.888723] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-25T20:52:11.987115] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T20:52:12.300500] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T20:52:12.688761] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-25T20:52:13.488808] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-25T20:52:13.836519] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T20:52:13.943832] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T20:52:13.957712] [INFO ] [REMOTE ] PSTG: Full fetch complete (76544 records). [2025-09-25T20:52:13.957936] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-25T20:52:14.158222] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T20:52:14.288924] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-25T20:52:14.440249] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-25T20:52:14.440357] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-25T20:52:14.441728] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-25T20:52:14.441851] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-25T20:52:14.444940] [DEBUG] [LOCAL ] PSTG: Trimmed 76544 records to 53237 (keeping 200 days of data) [2025-09-25T20:52:14.790894] [DEBUG] [LOCAL ] PSTG: Primary data saved (53237 records). [2025-09-25T20:52:14.791059] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-25T20:52:14.791257] [INFO ] [MAIN ] Update Progress: 1746/2372 symbols completed. PSTG took 45.1s. Estimated remaining: 1h 23m 15s. Rate: 7.5 symbols/min [2025-09-25T20:52:14.973440] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:15.030254] [DEBUG] [LOCAL ] PTY: Loaded 37399 existing records from primary storage. [2025-09-25T20:52:15.030410] [INFO ] [MAIN ] PTY: Loaded 37399 existing records. [2025-09-25T20:52:15.118068] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T20:52:15.122093] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-25T20:52:15.124621] [INFO ] [REMOTE ] PSTL: Full fetch complete (29661 records). [2025-09-25T20:52:15.124858] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-25T20:52:15.418273] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:15.423964] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-25T20:52:15.424032] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-25T20:52:15.424563] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-25T20:52:15.424636] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-25T20:52:15.889628] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-25T20:52:15.889807] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-25T20:52:15.890693] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-25T20:52:15.894971] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-25T20:52:15.900683] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T20:52:15.908910] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-25T20:52:15.932471] [DEBUG] [LOCAL ] PSTL: Trimmed 29661 records to 20493 (keeping 200 days of data) [2025-09-25T20:52:16.176096] [DEBUG] [LOCAL ] PSTL: Primary data saved (20493 records). [2025-09-25T20:52:16.176273] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-25T20:52:16.176396] [INFO ] [MAIN ] Update Progress: 1747/2372 symbols completed. PSTL took 30.4s. Estimated remaining: 1h 23m 5s. Rate: 7.5 symbols/min [2025-09-25T20:52:16.421075] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:16.473688] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:16.549118] [DEBUG] [LOCAL ] PUK: Loaded 44895 existing records from primary storage. [2025-09-25T20:52:16.549278] [INFO ] [MAIN ] PUK: Loaded 44895 existing records. [2025-09-25T20:52:16.694726] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-25T20:52:16.751179] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:16.751673] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-25T20:52:16.751735] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-25T20:52:16.752098] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-25T20:52:16.752158] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-25T20:52:17.133440] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:17.488692] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-25T20:52:17.890091] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-25T20:52:17.900675] [INFO ] [REMOTE ] PSX: Full fetch complete (77045 records). [2025-09-25T20:52:17.900854] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-25T20:52:18.293771] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-25T20:52:18.307554] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T20:52:18.415025] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-25T20:52:18.415130] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-25T20:52:18.416777] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-25T20:52:18.416857] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-25T20:52:18.418491] [DEBUG] [LOCAL ] PSX: Trimmed 77045 records to 53522 (keeping 200 days of data) [2025-09-25T20:52:18.567137] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T20:52:18.810179] [DEBUG] [LOCAL ] PSX: Primary data saved (53522 records). [2025-09-25T20:52:18.810417] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-25T20:52:18.810581] [INFO ] [MAIN ] Update Progress: 1748/2372 symbols completed. PSX took 31.8s. Estimated remaining: 1h 22m 55s. Rate: 7.5 symbols/min [2025-09-25T20:52:19.001750] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:19.059172] [DEBUG] [LOCAL ] PUMP: Loaded 49434 existing records from primary storage. [2025-09-25T20:52:19.059360] [INFO ] [MAIN ] PUMP: Loaded 49434 existing records. [2025-09-25T20:52:19.093848] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-25T20:52:19.257763] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:19.259102] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-25T20:52:19.259165] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-25T20:52:19.262237] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-25T20:52:19.262318] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-25T20:52:19.650532] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:19.722813] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T20:52:19.888790] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-25T20:52:20.135233] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:52:20.139998] [INFO ] [REMOTE ] PTA: Full fetch complete (23501 records). [2025-09-25T20:52:20.140089] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-25T20:52:20.556068] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-25T20:52:20.556227] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-25T20:52:20.556865] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-25T20:52:20.556933] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-25T20:52:20.558710] [DEBUG] [LOCAL ] PTA: Trimmed 23501 records to 15182 (keeping 200 days of data) [2025-09-25T20:52:20.677292] [DEBUG] [LOCAL ] PTA: Primary data saved (15182 records). [2025-09-25T20:52:20.677452] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-25T20:52:20.677619] [INFO ] [MAIN ] Update Progress: 1749/2372 symbols completed. PTA took 26.0s. Estimated remaining: 1h 22m 45s. Rate: 7.5 symbols/min [2025-09-25T20:52:20.693064] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-25T20:52:20.888516] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:20.968300] [DEBUG] [LOCAL ] PVH: Loaded 50466 existing records from primary storage. [2025-09-25T20:52:20.968481] [INFO ] [MAIN ] PVH: Loaded 50466 existing records. [2025-09-25T20:52:21.203349] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:21.203618] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-25T20:52:21.203708] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-25T20:52:21.204048] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-25T20:52:21.204108] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-25T20:52:21.500995] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-25T20:52:21.524908] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T20:52:21.680796] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:22.288722] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-25T20:52:22.383832] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T20:52:23.088719] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-25T20:52:23.287172] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T20:52:23.888735] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-25T20:52:24.038954] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T20:52:24.520171] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T20:52:24.688749] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-25T20:52:25.469742] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:52:25.488687] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-25T20:52:26.161108] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T20:52:26.288747] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-25T20:52:27.088741] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-25T20:52:27.323421] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:52:27.888787] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-25T20:52:28.049463] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T20:52:28.688687] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-25T20:52:28.745487] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T20:52:29.488783] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-25T20:52:29.903033] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T20:52:30.293829] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-25T20:52:30.308494] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T20:52:31.088714] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-25T20:52:31.129800] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T20:52:31.888749] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-25T20:52:32.030176] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T20:52:32.688741] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-25T20:52:32.827011] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T20:52:33.372938] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:52:33.488742] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-25T20:52:34.288731] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-25T20:52:34.317535] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T20:52:35.088686] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-25T20:52:35.208829] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T20:52:35.888703] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-25T20:52:36.001585] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:52:36.470674] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T20:52:36.688730] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-25T20:52:37.488701] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-25T20:52:37.660287] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T20:52:38.288699] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-25T20:52:38.465745] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T20:52:39.058981] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T20:52:39.088673] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-25T20:52:39.888734] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-25T20:52:40.039447] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T20:52:40.628944] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T20:52:40.639138] [INFO ] [REMOTE ] PTY: Full fetch complete (53822 records). [2025-09-25T20:52:40.639414] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-25T20:52:40.695955] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-25T20:52:41.099442] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-25T20:52:41.099549] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-25T20:52:41.100530] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-25T20:52:41.100607] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-25T20:52:41.102137] [DEBUG] [LOCAL ] PTY: Trimmed 53822 records to 37653 (keeping 200 days of data) [2025-09-25T20:52:41.359982] [DEBUG] [LOCAL ] PTY: Primary data saved (37653 records). [2025-09-25T20:52:41.360153] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-25T20:52:41.360302] [INFO ] [MAIN ] Update Progress: 1750/2372 symbols completed. PTY took 26.6s. Estimated remaining: 1h 22m 41s. Rate: 7.5 symbols/min [2025-09-25T20:52:41.493870] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-25T20:52:41.592134] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:41.603007] [DEBUG] [LOCAL ] PVL: Loaded 4745 existing records from primary storage. [2025-09-25T20:52:41.603152] [INFO ] [MAIN ] PVL: Loaded 4745 existing records. [2025-09-25T20:52:41.755196] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T20:52:41.852112] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:41.852463] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-25T20:52:41.852513] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-25T20:52:41.852851] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-25T20:52:41.852911] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-25T20:52:42.320708] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-25T20:52:42.327231] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:42.360961] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T20:52:42.955107] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T20:52:43.088721] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-25T20:52:43.888745] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-25T20:52:44.012014] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T20:52:44.271266] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T20:52:44.688759] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-25T20:52:44.753971] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T20:52:45.488855] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-25T20:52:46.182553] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T20:52:46.288773] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-25T20:52:46.393792] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T20:52:46.404845] [INFO ] [REMOTE ] PUK: Full fetch complete (65145 records). [2025-09-25T20:52:46.405116] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-25T20:52:46.818378] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-25T20:52:46.818513] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-25T20:52:46.820084] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-25T20:52:46.820225] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-25T20:52:46.824729] [DEBUG] [LOCAL ] PUK: Trimmed 65145 records to 45251 (keeping 200 days of data) [2025-09-25T20:52:47.088890] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-25T20:52:47.155148] [DEBUG] [LOCAL ] PUK: Primary data saved (45251 records). [2025-09-25T20:52:47.155349] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-25T20:52:47.155554] [INFO ] [MAIN ] Update Progress: 1751/2372 symbols completed. PUK took 31.0s. Estimated remaining: 1h 22m 32s. Rate: 7.5 symbols/min [2025-09-25T20:52:47.333725] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:47.412500] [DEBUG] [LOCAL ] PWR: Loaded 47367 existing records from primary storage. [2025-09-25T20:52:47.412731] [INFO ] [MAIN ] PWR: Loaded 47367 existing records. [2025-09-25T20:52:47.601132] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:47.601786] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-25T20:52:47.601849] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-25T20:52:47.602489] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-25T20:52:47.602574] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-25T20:52:47.898703] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-25T20:52:47.997404] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:52:48.080660] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:48.563882] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T20:52:48.600300] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T20:52:48.688746] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-25T20:52:49.357241] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T20:52:49.488805] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-25T20:52:50.288858] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-25T20:52:51.088847] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-25T20:52:51.263169] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T20:52:51.720514] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T20:52:51.888735] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-25T20:52:52.688794] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-25T20:52:52.828232] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T20:52:52.842340] [INFO ] [REMOTE ] PUMP: Full fetch complete (71771 records). [2025-09-25T20:52:52.842596] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-25T20:52:53.331303] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-25T20:52:53.331421] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-25T20:52:53.332661] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-25T20:52:53.332742] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-25T20:52:53.334311] [DEBUG] [LOCAL ] PUMP: Trimmed 71771 records to 49796 (keeping 200 days of data) [2025-09-25T20:52:53.409145] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T20:52:53.435627] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T20:52:53.488777] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-25T20:52:53.698292] [DEBUG] [LOCAL ] PUMP: Primary data saved (49796 records). [2025-09-25T20:52:53.698470] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-25T20:52:53.698670] [INFO ] [MAIN ] Update Progress: 1752/2372 symbols completed. PUMP took 34.9s. Estimated remaining: 1h 22m 24s. Rate: 7.5 symbols/min [2025-09-25T20:52:53.892080] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:53.939216] [DEBUG] [LOCAL ] PX: Loaded 34711 existing records from primary storage. [2025-09-25T20:52:53.939376] [INFO ] [MAIN ] PX: Loaded 34711 existing records. [2025-09-25T20:52:54.146336] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:52:54.146721] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-25T20:52:54.146790] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-25T20:52:54.147122] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-25T20:52:54.147202] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-25T20:52:54.299397] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-25T20:52:54.539944] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:55.011453] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T20:52:55.088713] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-25T20:52:55.416734] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T20:52:55.888804] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-25T20:52:56.235420] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T20:52:56.688736] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-25T20:52:57.488724] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-25T20:52:57.694276] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T20:52:57.704624] [INFO ] [REMOTE ] PVH: Full fetch complete (70734 records). [2025-09-25T20:52:57.704830] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-25T20:52:58.030229] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T20:52:58.163344] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-25T20:52:58.163455] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-25T20:52:58.164606] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-25T20:52:58.165182] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-25T20:52:58.167513] [DEBUG] [LOCAL ] PVH: Trimmed 70734 records to 50819 (keeping 200 days of data) [2025-09-25T20:52:58.170398] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T20:52:58.288909] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-25T20:52:58.528993] [DEBUG] [LOCAL ] PVH: Primary data saved (50819 records). [2025-09-25T20:52:58.529150] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-25T20:52:58.530730] [INFO ] [MAIN ] Update Progress: 1753/2372 symbols completed. PVH took 37.9s. Estimated remaining: 1h 22m 15s. Rate: 7.5 symbols/min [2025-09-25T20:52:58.710493] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:52:58.710696] [DEBUG] [LOCAL ] QBTS: No existing data file found in primary storage. [2025-09-25T20:52:58.710748] [WARN ] [MAIN ] QBTS: No existing data found, performing full refresh instead. [2025-09-25T20:52:58.711025] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-25T20:52:58.711082] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-25T20:52:58.711149] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-25T20:52:58.711185] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-25T20:52:59.093732] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-25T20:52:59.100031] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:52:59.717972] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T20:52:59.888719] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-25T20:52:59.931434] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T20:53:00.688737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-25T20:53:01.488805] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-25T20:53:02.115848] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T20:53:02.288727] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-25T20:53:02.325525] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-25T20:53:03.088715] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-25T20:53:03.444777] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-25T20:53:03.745920] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T20:53:03.897427] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-25T20:53:03.916491] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T20:53:04.688775] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-25T20:53:05.488754] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-25T20:53:06.128875] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T20:53:06.133078] [INFO ] [REMOTE ] PVL: Full fetch complete (7590 records). [2025-09-25T20:53:06.133171] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-25T20:53:06.294771] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-25T20:53:06.484901] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-25T20:53:06.658406] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-25T20:53:06.658774] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-25T20:53:06.668718] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-25T20:53:06.669605] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-25T20:53:06.670088] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-25T20:53:06.671009] [DEBUG] [LOCAL ] PVL: Trimmed 7590 records to 4785 (keeping 200 days of data) [2025-09-25T20:53:06.702106] [DEBUG] [LOCAL ] PVL: Primary data saved (4785 records). [2025-09-25T20:53:06.702254] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-25T20:53:06.702422] [INFO ] [MAIN ] Update Progress: 1754/2372 symbols completed. PVL took 25.3s. Estimated remaining: 1h 22m 7s. Rate: 7.5 symbols/min [2025-09-25T20:53:06.890182] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:06.939348] [DEBUG] [LOCAL ] QD: Loaded 28012 existing records from primary storage. [2025-09-25T20:53:06.939504] [INFO ] [MAIN ] QD: Loaded 28012 existing records. [2025-09-25T20:53:07.101736] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-25T20:53:07.149156] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:07.149483] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-25T20:53:07.149554] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-25T20:53:07.154703] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-25T20:53:07.154832] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-25T20:53:07.539250] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:07.824375] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T20:53:07.888704] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-25T20:53:08.688725] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-25T20:53:09.488746] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-25T20:53:09.818300] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-25T20:53:09.842803] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:53:10.148421] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T20:53:10.288750] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-25T20:53:10.630896] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T20:53:11.088721] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-25T20:53:11.888744] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-25T20:53:12.219047] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T20:53:12.562720] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T20:53:12.688726] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-25T20:53:13.488746] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-25T20:53:14.288790] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-25T20:53:14.613072] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-25T20:53:14.723925] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-25T20:53:14.753045] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T20:53:15.088728] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-25T20:53:15.670839] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T20:53:15.888790] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-25T20:53:16.688696] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-25T20:53:17.026137] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-25T20:53:17.223424] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:53:17.231357] [INFO ] [REMOTE ] PX: Full fetch complete (51151 records). [2025-09-25T20:53:17.231540] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-25T20:53:17.497740] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-25T20:53:17.714082] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-25T20:53:17.714175] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-25T20:53:17.715221] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-25T20:53:17.715290] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-25T20:53:17.716639] [DEBUG] [LOCAL ] PX: Trimmed 51151 records to 34911 (keeping 200 days of data) [2025-09-25T20:53:17.945453] [DEBUG] [LOCAL ] PX: Primary data saved (34911 records). [2025-09-25T20:53:17.945617] [INFO ] [MAIN ] PX: Full history saved. [2025-09-25T20:53:17.945751] [INFO ] [MAIN ] Update Progress: 1755/2372 symbols completed. PX took 24.2s. Estimated remaining: 1h 22m 0s. Rate: 7.5 symbols/min [2025-09-25T20:53:18.017686] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T20:53:18.160285] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:18.209201] [DEBUG] [LOCAL ] QGEN: Loaded 49151 existing records from primary storage. [2025-09-25T20:53:18.209361] [INFO ] [MAIN ] QGEN: Loaded 49151 existing records. [2025-09-25T20:53:18.294746] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-25T20:53:18.429373] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:18.430996] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-25T20:53:18.431049] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-25T20:53:18.431374] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-25T20:53:18.431437] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-25T20:53:18.824343] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:19.088744] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-25T20:53:19.632730] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T20:53:19.855405] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-25T20:53:19.888735] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-25T20:53:20.688695] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-25T20:53:20.807180] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T20:53:21.398703] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T20:53:21.488728] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-25T20:53:22.288751] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-25T20:53:23.088733] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-25T20:53:23.268424] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T20:53:23.353804] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-25T20:53:23.510134] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T20:53:23.888753] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-25T20:53:24.494992] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T20:53:24.688716] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-25T20:53:25.488740] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-25T20:53:25.996589] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-25T20:53:26.288718] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-25T20:53:26.550844] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-25T20:53:27.088717] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-25T20:53:27.310585] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T20:53:27.332024] [INFO ] [REMOTE ] PWR: Full fetch complete (69049 records). [2025-09-25T20:53:27.332265] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-25T20:53:27.894725] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-25T20:53:27.964469] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T20:53:28.159605] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-25T20:53:28.159744] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-25T20:53:28.161043] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-25T20:53:28.161140] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-25T20:53:28.162800] [DEBUG] [LOCAL ] PWR: Trimmed 69049 records to 47713 (keeping 200 days of data) [2025-09-25T20:53:28.497376] [DEBUG] [LOCAL ] PWR: Primary data saved (47713 records). [2025-09-25T20:53:28.497524] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-25T20:53:28.498869] [INFO ] [MAIN ] Update Progress: 1756/2372 symbols completed. PWR took 41.3s. Estimated remaining: 1h 21m 53s. Rate: 7.5 symbols/min [2025-09-25T20:53:28.680267] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:28.688751] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-25T20:53:28.762342] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-25T20:53:28.762511] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-25T20:53:28.958365] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:28.958622] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-25T20:53:28.959062] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-25T20:53:28.959422] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-25T20:53:28.959481] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-25T20:53:29.021422] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T20:53:29.354178] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:29.488726] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-25T20:53:30.038574] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-25T20:53:30.288721] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-25T20:53:30.551814] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:53:31.088736] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-25T20:53:31.798692] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-25T20:53:31.888790] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-25T20:53:32.465696] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-25T20:53:32.688832] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-25T20:53:33.179347] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-25T20:53:33.488708] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-25T20:53:33.676305] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-25T20:53:33.931380] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-25T20:53:34.288698] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-25T20:53:34.390577] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T20:53:34.401298] [INFO ] [REMOTE ] QBTS: Full fetch complete (77533 records). [2025-09-25T20:53:34.401487] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-25T20:53:34.408115] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:53:34.408515] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:53:34.408623] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:53:34.408757] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-25T20:53:34.408859] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-25T20:53:34.408940] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-25T20:53:34.409033] [DEBUG] [LOCAL ] QBTS: No derivative data file found to delete. [2025-09-25T20:53:34.409175] [INFO ] [MAIN ] Update Progress: 1757/2372 symbols completed. QBTS took 35.9s. Estimated remaining: 1h 21m 44s. Rate: 7.5 symbols/min [2025-09-25T20:53:35.088743] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-25T20:53:35.888812] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-25T20:53:36.696382] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-25T20:53:36.711102] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-25T20:53:36.844041] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T20:53:36.854183] [INFO ] [REMOTE ] QD: Full fetch complete (40773 records). [2025-09-25T20:53:36.854330] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-25T20:53:37.084831] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T20:53:37.321704] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-25T20:53:37.321807] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-25T20:53:37.322631] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-25T20:53:37.322745] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-25T20:53:37.323745] [DEBUG] [LOCAL ] QD: Trimmed 40773 records to 28263 (keeping 200 days of data) [2025-09-25T20:53:37.488752] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-25T20:53:37.500171] [DEBUG] [LOCAL ] QD: Primary data saved (28263 records). [2025-09-25T20:53:37.502231] [INFO ] [MAIN ] QD: Full history saved. [2025-09-25T20:53:37.502416] [INFO ] [MAIN ] Update Progress: 1758/2372 symbols completed. QD took 30.8s. Estimated remaining: 1h 21m 35s. Rate: 7.5 symbols/min [2025-09-25T20:53:38.953050] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-25T20:53:38.965134] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-25T20:53:39.307966] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T20:53:39.321714] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-25T20:53:41.092962] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T20:53:41.107193] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-25T20:53:41.204179] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T20:53:41.216319] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-25T20:53:42.930586] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T20:53:42.942372] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-25T20:53:43.556792] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-25T20:53:43.572742] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-25T20:53:44.740637] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T20:53:44.755676] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-25T20:53:45.919574] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-25T20:53:45.931729] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-25T20:53:46.604432] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T20:53:46.618105] [INFO ] [REMOTE ] QGEN: Full fetch complete (69997 records). [2025-09-25T20:53:46.618323] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-25T20:53:47.045317] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-25T20:53:47.045415] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-25T20:53:47.046595] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-25T20:53:47.046685] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-25T20:53:47.048191] [DEBUG] [LOCAL ] QGEN: Trimmed 69997 records to 49526 (keeping 200 days of data) [2025-09-25T20:53:47.372173] [DEBUG] [LOCAL ] QGEN: Primary data saved (49526 records). [2025-09-25T20:53:47.372322] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-25T20:53:47.372534] [INFO ] [MAIN ] Update Progress: 1759/2372 symbols completed. QGEN took 29.4s. Estimated remaining: 1h 21m 27s. Rate: 7.5 symbols/min [2025-09-25T20:53:48.836300] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-09-25T20:53:48.848838] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-25T20:53:51.520856] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-09-25T20:53:51.537669] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-25T20:53:54.223781] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.69 seconds). [2025-09-25T20:53:54.234150] [INFO ] [REMOTE ] QS: Full fetch complete (77883 records). [2025-09-25T20:53:54.234352] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-25T20:53:54.662463] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-25T20:53:54.662590] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-25T20:53:54.663935] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-25T20:53:54.664011] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-25T20:53:54.665946] [DEBUG] [LOCAL ] QS: Trimmed 77883 records to 54132 (keeping 200 days of data) [2025-09-25T20:53:55.005029] [DEBUG] [LOCAL ] QS: Primary data saved (54132 records). [2025-09-25T20:53:55.005699] [INFO ] [MAIN ] QS: Full history saved. [2025-09-25T20:53:55.007291] [INFO ] [MAIN ] Update Progress: 1760/2372 symbols completed. QS took 26.5s. Estimated remaining: 1h 21m 19s. Rate: 7.5 symbols/min [2025-09-25T20:53:55.770035] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:55.815466] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:55.837585] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:55.862037] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:53:55.878041] [DEBUG] [LOCAL ] QUAD: Loaded 23702 existing records from primary storage. [2025-09-25T20:53:55.878194] [INFO ] [MAIN ] QUAD: Loaded 23702 existing records. [2025-09-25T20:53:55.894898] [DEBUG] [LOCAL ] QVCC: Loaded 8904 existing records from primary storage. [2025-09-25T20:53:55.895058] [INFO ] [MAIN ] QVCC: Loaded 8904 existing records. [2025-09-25T20:53:56.169563] [DEBUG] [LOCAL ] QTWO: Loaded 39066 existing records from primary storage. [2025-09-25T20:53:56.175097] [INFO ] [MAIN ] QTWO: Loaded 39066 existing records. [2025-09-25T20:53:56.181030] [DEBUG] [LOCAL ] QSR: Loaded 52405 existing records from primary storage. [2025-09-25T20:53:56.181126] [INFO ] [MAIN ] QSR: Loaded 52405 existing records. [2025-09-25T20:53:56.556444] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:56.580265] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-25T20:53:56.580365] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-25T20:53:56.580797] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-25T20:53:56.580862] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-25T20:53:56.720391] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:56.726346] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-25T20:53:56.726431] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-25T20:53:56.726729] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-25T20:53:56.726792] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-25T20:53:56.891255] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:56.929825] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:53:56.930061] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-25T20:53:56.930108] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-25T20:53:56.930548] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-25T20:53:56.930610] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-25T20:53:56.942046] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-25T20:53:56.942159] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-25T20:53:56.942560] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-25T20:53:56.942621] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-25T20:53:58.334536] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:58.346229] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-25T20:53:58.345847] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:58.356303] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-25T20:53:58.383226] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:58.383585] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-25T20:53:58.401297] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:53:58.401626] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-25T20:53:59.340615] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T20:53:59.343348] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-25T20:53:59.633833] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T20:53:59.640016] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-25T20:53:59.796254] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-25T20:53:59.798297] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-25T20:53:59.816951] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T20:53:59.828031] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-25T20:54:00.237211] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T20:54:00.251178] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-25T20:54:00.504579] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T20:54:00.507281] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-25T20:54:00.842560] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T20:54:00.847728] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-25T20:54:01.116392] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T20:54:01.125560] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-25T20:54:01.364238] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:54:01.367311] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-25T20:54:01.872338] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T20:54:01.882437] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-25T20:54:02.063538] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-25T20:54:02.066325] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-25T20:54:02.102688] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:54:02.113840] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-25T20:54:02.314590] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:54:02.323040] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-25T20:54:02.652941] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-25T20:54:02.657292] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-25T20:54:02.812184] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T20:54:02.817858] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-25T20:54:03.211215] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-25T20:54:03.216319] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-25T20:54:03.513248] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T20:54:03.523727] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-25T20:54:03.991933] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T20:54:03.994368] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-25T20:54:03.998700] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T20:54:04.009115] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-25T20:54:04.203146] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T20:54:04.688777] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-25T20:54:04.802770] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T20:54:05.378579] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-25T20:54:05.430090] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T20:54:05.488742] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-25T20:54:05.616292] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-25T20:54:06.288785] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-25T20:54:06.969923] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T20:54:06.972398] [INFO ] [REMOTE ] QVCC: Full fetch complete (11949 records). [2025-09-25T20:54:06.972587] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-25T20:54:07.050923] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T20:54:07.090088] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-25T20:54:07.423582] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-25T20:54:07.423701] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-25T20:54:07.423994] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-25T20:54:07.424036] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-25T20:54:07.424508] [DEBUG] [LOCAL ] QVCC: Trimmed 11949 records to 8949 (keeping 200 days of data) [2025-09-25T20:54:07.478969] [DEBUG] [LOCAL ] QVCC: Primary data saved (8949 records). [2025-09-25T20:54:07.479112] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-25T20:54:07.479205] [INFO ] [MAIN ] Update Progress: 1761/2372 symbols completed. QVCC took 12.4s. Estimated remaining: 1h 21m 13s. Rate: 7.5 symbols/min [2025-09-25T20:54:07.658742] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:07.674020] [DEBUG] [LOCAL ] QVCD: Loaded 4480 existing records from primary storage. [2025-09-25T20:54:07.674151] [INFO ] [MAIN ] QVCD: Loaded 4480 existing records. [2025-09-25T20:54:07.858670] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:07.858931] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-25T20:54:07.859016] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-25T20:54:07.859283] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-25T20:54:07.859342] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-25T20:54:07.893687] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-25T20:54:08.316963] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:08.338094] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T20:54:08.688810] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-25T20:54:09.410525] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T20:54:09.488806] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-25T20:54:09.862442] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T20:54:10.288716] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-25T20:54:10.612240] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T20:54:10.994252] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T20:54:11.088718] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-25T20:54:11.888746] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-25T20:54:12.688706] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-25T20:54:12.934139] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T20:54:12.997512] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T20:54:13.488743] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-25T20:54:14.243622] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T20:54:14.288750] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-25T20:54:14.797464] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T20:54:14.848638] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T20:54:15.088761] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-25T20:54:15.626058] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-25T20:54:15.888854] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-25T20:54:16.540934] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T20:54:16.688725] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-25T20:54:17.488813] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-25T20:54:17.531939] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-25T20:54:18.288793] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-25T20:54:18.939608] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-25T20:54:19.012735] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T20:54:19.088740] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-25T20:54:19.888819] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-25T20:54:20.688701] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-25T20:54:20.759515] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T20:54:21.054249] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T20:54:21.064866] [INFO ] [REMOTE ] QUAD: Full fetch complete (34699 records). [2025-09-25T20:54:21.065032] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-25T20:54:21.309587] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T20:54:21.488777] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-25T20:54:21.526028] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-25T20:54:21.526117] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-25T20:54:21.527091] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-25T20:54:21.527206] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-25T20:54:21.529149] [DEBUG] [LOCAL ] QUAD: Trimmed 34699 records to 23833 (keeping 200 days of data) [2025-09-25T20:54:21.696663] [DEBUG] [LOCAL ] QUAD: Primary data saved (23833 records). [2025-09-25T20:54:21.696824] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-25T20:54:21.697033] [INFO ] [MAIN ] Update Progress: 1762/2372 symbols completed. QUAD took 26.7s. Estimated remaining: 1h 21m 7s. Rate: 7.5 symbols/min [2025-09-25T20:54:21.888013] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:21.982241] [DEBUG] [LOCAL ] QXO: Loaded 53184 existing records from primary storage. [2025-09-25T20:54:21.982398] [INFO ] [MAIN ] QXO: Loaded 53184 existing records. [2025-09-25T20:54:22.153052] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T20:54:22.189166] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:22.189506] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-25T20:54:22.189577] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-25T20:54:22.191893] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-25T20:54:22.191969] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-25T20:54:22.291474] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-25T20:54:22.586531] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:22.837836] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-25T20:54:22.839021] [INFO ] [REMOTE ] QVCD: Full fetch complete (6145 records). [2025-09-25T20:54:22.839093] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-25T20:54:23.089953] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-25T20:54:23.244084] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-25T20:54:23.244170] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-25T20:54:23.244339] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-25T20:54:23.244377] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-25T20:54:23.244902] [DEBUG] [LOCAL ] QVCD: Trimmed 6145 records to 4519 (keeping 200 days of data) [2025-09-25T20:54:23.276865] [DEBUG] [LOCAL ] QVCD: Primary data saved (4519 records). [2025-09-25T20:54:23.277010] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-25T20:54:23.277154] [INFO ] [MAIN ] Update Progress: 1763/2372 symbols completed. QVCD took 15.8s. Estimated remaining: 1h 20m 57s. Rate: 7.5 symbols/min [2025-09-25T20:54:23.455813] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:23.501078] [DEBUG] [LOCAL ] R: Loaded 29357 existing records from primary storage. [2025-09-25T20:54:23.501245] [INFO ] [MAIN ] R: Loaded 29357 existing records. [2025-09-25T20:54:23.698242] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:23.698675] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-25T20:54:23.698737] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-25T20:54:23.699077] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-25T20:54:23.699139] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-25T20:54:23.893815] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-25T20:54:24.079209] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:24.688758] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-25T20:54:24.987157] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T20:54:25.221702] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T20:54:25.235845] [INFO ] [REMOTE ] QTWO: Full fetch complete (57237 records). [2025-09-25T20:54:25.236003] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-25T20:54:25.491953] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-25T20:54:25.649052] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-25T20:54:25.649150] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-25T20:54:25.650199] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-25T20:54:25.650266] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-25T20:54:25.651580] [DEBUG] [LOCAL ] QTWO: Trimmed 57237 records to 39406 (keeping 200 days of data) [2025-09-25T20:54:25.911468] [DEBUG] [LOCAL ] QTWO: Primary data saved (39406 records). [2025-09-25T20:54:25.911626] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-25T20:54:25.911807] [INFO ] [MAIN ] Update Progress: 1764/2372 symbols completed. QTWO took 30.9s. Estimated remaining: 1h 20m 47s. Rate: 7.5 symbols/min [2025-09-25T20:54:26.096886] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:26.133175] [DEBUG] [LOCAL ] RA: Loaded 21573 existing records from primary storage. [2025-09-25T20:54:26.133321] [INFO ] [MAIN ] RA: Loaded 21573 existing records. [2025-09-25T20:54:26.275947] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T20:54:26.310721] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-25T20:54:26.396163] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:26.397459] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-25T20:54:26.397528] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-25T20:54:26.397809] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-25T20:54:26.398296] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-25T20:54:26.770288] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:26.848861] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-25T20:54:27.088737] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-25T20:54:27.256118] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T20:54:27.888770] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-25T20:54:28.688717] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-25T20:54:28.964165] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T20:54:29.488762] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-25T20:54:29.598842] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T20:54:29.664787] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T20:54:30.288734] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-25T20:54:30.777684] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:54:31.088741] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-25T20:54:31.629201] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T20:54:31.888682] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-25T20:54:31.910163] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T20:54:32.688751] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-25T20:54:33.405553] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T20:54:33.488672] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-25T20:54:34.288711] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-25T20:54:34.501245] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T20:54:34.514590] [INFO ] [REMOTE ] QSR: Full fetch complete (75811 records). [2025-09-25T20:54:34.514774] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-25T20:54:34.976933] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-25T20:54:34.977051] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-25T20:54:34.978232] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-25T20:54:34.978306] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-25T20:54:34.979996] [DEBUG] [LOCAL ] QSR: Trimmed 75811 records to 52792 (keeping 200 days of data) [2025-09-25T20:54:35.092555] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-25T20:54:35.134597] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T20:54:35.421638] [DEBUG] [LOCAL ] QSR: Primary data saved (52792 records). [2025-09-25T20:54:35.421836] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-25T20:54:35.422029] [INFO ] [MAIN ] Update Progress: 1765/2372 symbols completed. QSR took 40.4s. Estimated remaining: 1h 20m 40s. Rate: 7.5 symbols/min [2025-09-25T20:54:35.610204] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:35.664674] [DEBUG] [LOCAL ] RACE: Loaded 32896 existing records from primary storage. [2025-09-25T20:54:35.664837] [INFO ] [MAIN ] RACE: Loaded 32896 existing records. [2025-09-25T20:54:35.867862] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:35.868169] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-25T20:54:35.868232] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-25T20:54:35.868582] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-25T20:54:35.868680] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-25T20:54:35.900070] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-25T20:54:36.194876] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T20:54:36.245857] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T20:54:36.345683] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:36.688735] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-25T20:54:37.355285] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T20:54:37.488679] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-25T20:54:38.242144] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T20:54:38.288734] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-25T20:54:38.701940] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T20:54:39.088726] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-25T20:54:39.785739] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T20:54:39.888735] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-25T20:54:40.530330] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T20:54:40.688732] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-25T20:54:41.097589] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T20:54:41.488728] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-25T20:54:42.049216] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T20:54:42.288748] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-25T20:54:42.663500] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T20:54:43.088732] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-25T20:54:43.749256] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T20:54:43.888739] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-25T20:54:44.313631] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T20:54:44.319316] [INFO ] [REMOTE ] R: Full fetch complete (41921 records). [2025-09-25T20:54:44.319424] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-25T20:54:44.693907] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-25T20:54:44.744124] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-25T20:54:44.744222] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-25T20:54:44.745092] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-25T20:54:44.745205] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-25T20:54:44.746319] [DEBUG] [LOCAL ] R: Trimmed 41921 records to 29533 (keeping 200 days of data) [2025-09-25T20:54:44.956273] [DEBUG] [LOCAL ] R: Primary data saved (29533 records). [2025-09-25T20:54:44.956480] [INFO ] [MAIN ] R: Full history saved. [2025-09-25T20:54:44.956639] [INFO ] [MAIN ] Update Progress: 1766/2372 symbols completed. R took 21.7s. Estimated remaining: 1h 20m 32s. Rate: 7.5 symbols/min [2025-09-25T20:54:45.083299] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T20:54:45.211307] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:45.279220] [DEBUG] [LOCAL ] RAMP: Loaded 37712 existing records from primary storage. [2025-09-25T20:54:45.279370] [INFO ] [MAIN ] RAMP: Loaded 37712 existing records. [2025-09-25T20:54:45.465840] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:45.466235] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-25T20:54:45.466295] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-25T20:54:45.466688] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-25T20:54:45.466749] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-25T20:54:45.494733] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-25T20:54:45.923989] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:46.288731] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-25T20:54:46.626549] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T20:54:46.725924] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T20:54:47.088730] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-25T20:54:47.652832] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T20:54:47.888747] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-25T20:54:48.688734] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-25T20:54:49.034858] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T20:54:49.326541] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T20:54:49.488727] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-25T20:54:50.288718] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-25T20:54:50.522535] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:54:50.907583] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T20:54:51.088718] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-25T20:54:51.329817] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T20:54:51.888736] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-25T20:54:52.688722] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-25T20:54:52.829010] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T20:54:53.488713] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-25T20:54:53.547507] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T20:54:53.928701] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-25T20:54:54.288734] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-25T20:54:54.874895] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T20:54:55.088745] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-25T20:54:55.870441] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T20:54:55.888672] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-25T20:54:56.688734] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-25T20:54:57.200189] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-25T20:54:57.470396] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T20:54:57.488688] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-25T20:54:57.849846] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T20:54:57.854823] [INFO ] [REMOTE ] RA: Full fetch complete (31891 records). [2025-09-25T20:54:57.854919] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-25T20:54:58.271443] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-25T20:54:58.271532] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-25T20:54:58.272232] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-25T20:54:58.272296] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-25T20:54:58.273142] [DEBUG] [LOCAL ] RA: Trimmed 31891 records to 21803 (keeping 200 days of data) [2025-09-25T20:54:58.327437] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-25T20:54:58.421136] [DEBUG] [LOCAL ] RA: Primary data saved (21803 records). [2025-09-25T20:54:58.421279] [INFO ] [MAIN ] RA: Full history saved. [2025-09-25T20:54:58.421370] [INFO ] [MAIN ] Update Progress: 1767/2372 symbols completed. RA took 32.5s. Estimated remaining: 1h 20m 26s. Rate: 7.5 symbols/min [2025-09-25T20:54:58.603731] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:54:58.657590] [DEBUG] [LOCAL ] RBA: Loaded 45942 existing records from primary storage. [2025-09-25T20:54:58.657821] [INFO ] [MAIN ] RBA: Loaded 45942 existing records. [2025-09-25T20:54:58.842292] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:54:58.842730] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-25T20:54:58.842787] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-25T20:54:58.843212] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-25T20:54:58.843274] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-25T20:54:59.105873] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-25T20:54:59.231210] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:54:59.600950] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-25T20:54:59.893802] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-25T20:54:59.909708] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T20:55:00.228696] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:55:00.688767] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-25T20:55:01.488757] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-25T20:55:01.971989] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-25T20:55:01.984430] [INFO ] [REMOTE ] QXO: Full fetch complete (75480 records). [2025-09-25T20:55:01.984625] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-25T20:55:02.234818] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T20:55:02.293775] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-25T20:55:02.530515] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-25T20:55:02.530619] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-25T20:55:02.531894] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-25T20:55:02.531966] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-25T20:55:02.534941] [DEBUG] [LOCAL ] QXO: Trimmed 75480 records to 53574 (keeping 200 days of data) [2025-09-25T20:55:02.888827] [DEBUG] [LOCAL ] QXO: Primary data saved (53574 records). [2025-09-25T20:55:02.888996] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-25T20:55:02.891554] [INFO ] [MAIN ] Update Progress: 1768/2372 symbols completed. QXO took 41.2s. Estimated remaining: 1h 20m 17s. Rate: 7.5 symbols/min [2025-09-25T20:55:03.081306] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:03.088744] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-25T20:55:03.103089] [DEBUG] [LOCAL ] RBC: Loaded 15155 existing records from primary storage. [2025-09-25T20:55:03.103235] [INFO ] [MAIN ] RBC: Loaded 15155 existing records. [2025-09-25T20:55:03.194789] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T20:55:03.335805] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:55:03.336067] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-25T20:55:03.336115] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-25T20:55:03.336399] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-25T20:55:03.336462] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-25T20:55:03.714667] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:03.888736] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-25T20:55:04.061423] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T20:55:04.497031] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T20:55:04.688745] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-25T20:55:05.269409] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T20:55:05.488757] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-25T20:55:06.244676] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T20:55:06.288728] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-25T20:55:06.681084] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T20:55:07.088754] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-25T20:55:07.824083] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T20:55:07.830376] [INFO ] [REMOTE ] RACE: Full fetch complete (47646 records). [2025-09-25T20:55:07.830504] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-25T20:55:07.888782] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-25T20:55:08.120857] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T20:55:08.283584] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-25T20:55:08.283708] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-25T20:55:08.284743] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-25T20:55:08.284824] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-25T20:55:08.286699] [DEBUG] [LOCAL ] RACE: Trimmed 47646 records to 33135 (keeping 200 days of data) [2025-09-25T20:55:08.515868] [DEBUG] [LOCAL ] RACE: Primary data saved (33135 records). [2025-09-25T20:55:08.516021] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-25T20:55:08.516865] [INFO ] [MAIN ] Update Progress: 1769/2372 symbols completed. RACE took 33.1s. Estimated remaining: 1h 20m 8s. Rate: 7.5 symbols/min [2025-09-25T20:55:08.688839] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-25T20:55:08.713725] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:08.714116] [DEBUG] [LOCAL ] RBLX: No existing data file found in primary storage. [2025-09-25T20:55:08.714175] [WARN ] [MAIN ] RBLX: No existing data found, performing full refresh instead. [2025-09-25T20:55:08.716771] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-25T20:55:08.716828] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-25T20:55:08.716874] [DEBUG] [LOCAL ] RBLX: No primary data file found to delete. [2025-09-25T20:55:08.716909] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-25T20:55:09.132113] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:09.480477] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T20:55:09.488698] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-25T20:55:09.488976] [INFO ] [REMOTE ] RAMP: Full fetch complete (53173 records). [2025-09-25T20:55:09.490058] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-25T20:55:09.831838] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T20:55:09.965514] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-25T20:55:09.965638] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-25T20:55:09.967276] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-25T20:55:09.967393] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-25T20:55:09.968847] [DEBUG] [LOCAL ] RAMP: Trimmed 53173 records to 37942 (keeping 200 days of data) [2025-09-25T20:55:10.212423] [DEBUG] [LOCAL ] RAMP: Primary data saved (37942 records). [2025-09-25T20:55:10.212582] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-25T20:55:10.212698] [INFO ] [MAIN ] Update Progress: 1770/2372 symbols completed. RAMP took 25.3s. Estimated remaining: 1h 19m 58s. Rate: 7.5 symbols/min [2025-09-25T20:55:10.296742] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-25T20:55:10.412411] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:10.422673] [DEBUG] [LOCAL ] RBOT: Loaded 5058 existing records from primary storage. [2025-09-25T20:55:10.422806] [INFO ] [MAIN ] RBOT: Loaded 5058 existing records. [2025-09-25T20:55:10.633934] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:55:10.634410] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-25T20:55:10.634501] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-25T20:55:10.634866] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-25T20:55:10.634955] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-25T20:55:11.031792] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:11.088697] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-25T20:55:11.269173] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T20:55:11.657367] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T20:55:11.888749] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-25T20:55:12.389938] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T20:55:12.439527] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-25T20:55:12.688732] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-25T20:55:13.488940] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-25T20:55:14.288770] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-25T20:55:14.437087] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T20:55:15.088766] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-25T20:55:15.107335] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T20:55:15.577355] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T20:55:15.888740] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-25T20:55:16.353415] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T20:55:16.688753] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-25T20:55:17.208776] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T20:55:17.368911] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T20:55:17.488668] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-25T20:55:18.064589] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T20:55:18.288768] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-25T20:55:19.088841] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-25T20:55:19.888801] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-25T20:55:20.357754] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T20:55:20.688698] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-25T20:55:20.979550] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T20:55:21.064142] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T20:55:21.488794] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-25T20:55:22.288697] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-25T20:55:22.431038] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T20:55:22.669895] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T20:55:23.088763] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-25T20:55:23.484022] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T20:55:23.888765] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-25T20:55:24.263160] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T20:55:24.688742] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-25T20:55:24.771218] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T20:55:25.488746] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-25T20:55:26.291037] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-25T20:55:26.292746] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:55:26.391306] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:55:27.088740] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-25T20:55:27.881767] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T20:55:27.884205] [INFO ] [REMOTE ] RBOT: Full fetch complete (8592 records). [2025-09-25T20:55:27.884293] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-25T20:55:27.900041] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-25T20:55:28.317330] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-25T20:55:28.317440] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-25T20:55:28.317711] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-25T20:55:28.317773] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-25T20:55:28.318729] [DEBUG] [LOCAL ] RBOT: Trimmed 8592 records to 5178 (keeping 200 days of data) [2025-09-25T20:55:28.358052] [DEBUG] [LOCAL ] RBOT: Primary data saved (5178 records). [2025-09-25T20:55:28.358215] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-25T20:55:28.358385] [INFO ] [MAIN ] Update Progress: 1771/2372 symbols completed. RBOT took 18.1s. Estimated remaining: 1h 19m 54s. Rate: 7.5 symbols/min [2025-09-25T20:55:28.493055] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-25T20:55:28.614000] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:28.694113] [DEBUG] [LOCAL ] RBRK: Loaded 53117 existing records from primary storage. [2025-09-25T20:55:28.694288] [INFO ] [MAIN ] RBRK: Loaded 53117 existing records. [2025-09-25T20:55:28.707734] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-25T20:55:28.904736] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:55:28.905374] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-25T20:55:28.905444] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-25T20:55:28.905963] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-25T20:55:28.906045] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-25T20:55:29.291582] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:29.488774] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-25T20:55:29.630075] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T20:55:30.288726] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-25T20:55:30.605194] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T20:55:31.088785] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-25T20:55:31.140235] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-25T20:55:31.895237] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-25T20:55:31.930435] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T20:55:32.207205] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T20:55:32.688741] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-25T20:55:33.488679] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-25T20:55:33.713817] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T20:55:34.291367] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-25T20:55:34.305457] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-25T20:55:34.988153] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-25T20:55:35.098128] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-25T20:55:35.119349] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T20:55:35.888739] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-25T20:55:36.141620] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T20:55:36.145993] [INFO ] [REMOTE ] RBC: Full fetch complete (21932 records). [2025-09-25T20:55:36.146079] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-25T20:55:36.573485] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-25T20:55:36.573574] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-25T20:55:36.574112] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-25T20:55:36.574176] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-25T20:55:36.575133] [DEBUG] [LOCAL ] RBC: Trimmed 21932 records to 15246 (keeping 200 days of data) [2025-09-25T20:55:36.677674] [DEBUG] [LOCAL ] RBC: Primary data saved (15246 records). [2025-09-25T20:55:36.677847] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-25T20:55:36.677994] [INFO ] [MAIN ] Update Progress: 1772/2372 symbols completed. RBC took 33.8s. Estimated remaining: 1h 19m 46s. Rate: 7.5 symbols/min [2025-09-25T20:55:36.694552] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-25T20:55:36.880530] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:36.956302] [DEBUG] [LOCAL ] RC: Loaded 48997 existing records from primary storage. [2025-09-25T20:55:36.956474] [INFO ] [MAIN ] RC: Loaded 48997 existing records. [2025-09-25T20:55:37.153178] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:55:37.153449] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-25T20:55:37.153499] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-25T20:55:37.153803] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-25T20:55:37.153864] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-25T20:55:37.498729] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-25T20:55:37.553767] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:37.902535] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T20:55:38.288708] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-25T20:55:38.456329] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T20:55:38.466378] [INFO ] [REMOTE ] RBA: Full fetch complete (65401 records). [2025-09-25T20:55:38.466520] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-25T20:55:38.909262] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-25T20:55:38.909377] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-25T20:55:38.910431] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-25T20:55:38.910494] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-25T20:55:38.911938] [DEBUG] [LOCAL ] RBA: Trimmed 65401 records to 46238 (keeping 200 days of data) [2025-09-25T20:55:39.113456] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-25T20:55:39.249081] [DEBUG] [LOCAL ] RBA: Primary data saved (46238 records). [2025-09-25T20:55:39.249243] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-25T20:55:39.249353] [INFO ] [MAIN ] Update Progress: 1773/2372 symbols completed. RBA took 40.8s. Estimated remaining: 1h 19m 36s. Rate: 7.5 symbols/min [2025-09-25T20:55:39.424185] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:39.424417] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-25T20:55:39.424475] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-25T20:55:39.425826] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-25T20:55:39.425872] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-25T20:55:39.425916] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-25T20:55:39.425950] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-25T20:55:39.886887] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:39.889676] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-25T20:55:40.189058] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-25T20:55:40.249855] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T20:55:40.345560] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T20:55:40.688704] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-25T20:55:40.966284] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T20:55:41.488729] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-25T20:55:42.288737] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-25T20:55:42.805749] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-25T20:55:43.088747] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-25T20:55:43.221663] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-25T20:55:43.251521] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T20:55:43.888820] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-25T20:55:44.688705] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-25T20:55:44.933453] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:55:45.488771] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-25T20:55:46.225011] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-25T20:55:46.288695] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-25T20:55:46.358337] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:55:46.366445] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-25T20:55:46.385423] [INFO ] [REMOTE ] RBLX: Full fetch complete (77780 records). [2025-09-25T20:55:46.385606] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-25T20:55:46.830991] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-25T20:55:46.831107] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-25T20:55:46.832279] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-25T20:55:46.832390] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-25T20:55:46.837586] [DEBUG] [LOCAL ] RBLX: Trimmed 77780 records to 54107 (keeping 200 days of data) [2025-09-25T20:55:46.995773] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T20:55:47.091721] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-25T20:55:47.233602] [DEBUG] [LOCAL ] RBLX: Primary data saved (54107 records). [2025-09-25T20:55:47.233815] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-25T20:55:47.234014] [INFO ] [MAIN ] Update Progress: 1774/2372 symbols completed. RBLX took 38.7s. Estimated remaining: 1h 19m 28s. Rate: 7.5 symbols/min [2025-09-25T20:55:47.421992] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:47.426869] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-25T20:55:47.426938] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-25T20:55:47.428841] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-25T20:55:47.428890] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-25T20:55:47.428933] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-25T20:55:47.428978] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-25T20:55:47.830128] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:47.886464] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T20:55:47.888670] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-25T20:55:48.688820] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-25T20:55:49.385255] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T20:55:49.488684] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-25T20:55:49.979613] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-25T20:55:49.990675] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-25T20:55:50.288749] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-25T20:55:50.625703] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-25T20:55:51.088789] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-25T20:55:51.888835] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-25T20:55:52.297047] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-25T20:55:52.688731] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-25T20:55:53.082799] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-25T20:55:53.086557] [INFO ] [REMOTE ] RCB: Full fetch complete (3748 records). [2025-09-25T20:55:53.086753] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-25T20:55:53.218002] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T20:55:53.365370] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T20:55:53.366608] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:55:53.366844] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:55:53.367088] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-25T20:55:53.367196] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-25T20:55:53.367265] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-25T20:55:53.367350] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-25T20:55:53.367507] [INFO ] [MAIN ] Update Progress: 1775/2372 symbols completed. RCB took 14.1s. Estimated remaining: 1h 19m 19s. Rate: 7.5 symbols/min [2025-09-25T20:55:53.493840] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-25T20:55:53.570610] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:55:53.667478] [DEBUG] [LOCAL ] RCI: Loaded 48721 existing records from primary storage. [2025-09-25T20:55:53.667679] [INFO ] [MAIN ] RCI: Loaded 48721 existing records. [2025-09-25T20:55:53.903884] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:55:53.904353] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-25T20:55:53.904422] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-25T20:55:53.905069] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-25T20:55:53.905139] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-25T20:55:54.310513] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T20:55:54.293946] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-25T20:55:54.509770] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:55:55.088783] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-25T20:55:55.871823] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T20:55:55.888699] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-25T20:55:56.125969] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:55:56.688759] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-25T20:55:57.488706] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-25T20:55:57.695978] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T20:55:58.288732] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-25T20:55:58.904726] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T20:55:58.927797] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-25T20:55:59.088726] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-25T20:55:59.326054] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T20:55:59.888750] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-25T20:56:00.688741] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-25T20:56:00.746059] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:56:00.990971] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T20:56:01.488718] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-25T20:56:02.117548] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T20:56:02.288746] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-25T20:56:02.904720] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-25T20:56:03.088736] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-25T20:56:03.888703] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-25T20:56:04.061983] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T20:56:04.505365] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T20:56:04.688692] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-25T20:56:05.192748] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T20:56:05.309312] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T20:56:05.488769] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-25T20:56:06.124799] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T20:56:06.288715] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-25T20:56:06.919334] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T20:56:07.088721] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-25T20:56:07.721746] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T20:56:07.723624] [INFO ] [REMOTE ] RCD: Full fetch complete (6834 records). [2025-09-25T20:56:07.723744] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-25T20:56:07.897467] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-25T20:56:07.961037] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-25T20:56:07.961340] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:56:07.961398] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:56:07.961455] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-25T20:56:07.961587] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-25T20:56:07.961689] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-25T20:56:07.961785] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-25T20:56:07.961947] [INFO ] [MAIN ] Update Progress: 1776/2372 symbols completed. RCD took 20.7s. Estimated remaining: 1h 19m 14s. Rate: 7.5 symbols/min [2025-09-25T20:56:08.185688] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:08.185954] [DEBUG] [LOCAL ] RCL: No existing data file found in primary storage. [2025-09-25T20:56:08.186012] [WARN ] [MAIN ] RCL: No existing data found, performing full refresh instead. [2025-09-25T20:56:08.186151] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-25T20:56:08.186221] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-25T20:56:08.186285] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-25T20:56:08.186335] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-25T20:56:08.563135] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:08.688773] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-25T20:56:09.488737] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-25T20:56:09.802380] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T20:56:10.288737] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-25T20:56:11.021749] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-25T20:56:11.038984] [INFO ] [REMOTE ] RBRK: Full fetch complete (76527 records). [2025-09-25T20:56:11.039228] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-25T20:56:11.095745] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-25T20:56:11.422865] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T20:56:11.447759] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T20:56:11.626588] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-25T20:56:11.626740] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-25T20:56:11.627937] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-25T20:56:11.628012] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-25T20:56:11.629842] [DEBUG] [LOCAL ] RBRK: Trimmed 76527 records to 53507 (keeping 200 days of data) [2025-09-25T20:56:11.888891] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-25T20:56:11.999355] [DEBUG] [LOCAL ] RBRK: Primary data saved (53507 records). [2025-09-25T20:56:11.999528] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-25T20:56:11.999664] [INFO ] [MAIN ] Update Progress: 1777/2372 symbols completed. RBRK took 43.6s. Estimated remaining: 1h 19m 4s. Rate: 7.5 symbols/min [2025-09-25T20:56:12.177199] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:12.195994] [DEBUG] [LOCAL ] RCS: Loaded 11437 existing records from primary storage. [2025-09-25T20:56:12.196153] [INFO ] [MAIN ] RCS: Loaded 11437 existing records. [2025-09-25T20:56:12.398450] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:12.398802] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-25T20:56:12.398852] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-25T20:56:12.399163] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-25T20:56:12.399222] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-25T20:56:12.695916] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-25T20:56:12.806746] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:12.858606] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T20:56:13.488760] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-25T20:56:13.972250] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-25T20:56:14.288709] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-25T20:56:14.599664] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T20:56:14.600935] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T20:56:15.088737] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-25T20:56:15.860455] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T20:56:15.888703] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-25T20:56:16.688739] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-25T20:56:16.847978] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T20:56:17.488742] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-25T20:56:17.931582] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-25T20:56:18.288707] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-25T20:56:18.350716] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T20:56:18.783572] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T20:56:19.088736] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-25T20:56:19.888739] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-25T20:56:20.420683] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-25T20:56:20.688755] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-25T20:56:20.764426] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T20:56:20.776331] [INFO ] [REMOTE ] RC: Full fetch complete (70822 records). [2025-09-25T20:56:20.776564] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-25T20:56:20.827506] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T20:56:21.218203] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-25T20:56:21.218290] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-25T20:56:21.219394] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-25T20:56:21.219463] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-25T20:56:21.220958] [DEBUG] [LOCAL ] RC: Trimmed 70822 records to 49317 (keeping 200 days of data) [2025-09-25T20:56:21.508765] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-25T20:56:21.548662] [DEBUG] [LOCAL ] RC: Primary data saved (49317 records). [2025-09-25T20:56:21.548810] [INFO ] [MAIN ] RC: Full history saved. [2025-09-25T20:56:21.548958] [INFO ] [MAIN ] Update Progress: 1778/2372 symbols completed. RC took 44.9s. Estimated remaining: 1h 18m 57s. Rate: 7.5 symbols/min [2025-09-25T20:56:21.731846] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:21.787436] [DEBUG] [LOCAL ] RCUS: Loaded 42690 existing records from primary storage. [2025-09-25T20:56:21.790786] [INFO ] [MAIN ] RCUS: Loaded 42690 existing records. [2025-09-25T20:56:21.985044] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:21.985300] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-25T20:56:21.985346] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-25T20:56:21.985999] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-25T20:56:21.986061] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-25T20:56:22.303922] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-25T20:56:22.340209] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T20:56:22.424416] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:22.949622] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-25T20:56:23.088737] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-25T20:56:23.888753] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-25T20:56:23.951579] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T20:56:24.204346] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T20:56:24.688733] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-25T20:56:25.488742] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-25T20:56:26.073167] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-25T20:56:26.288700] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-25T20:56:26.316734] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T20:56:26.373482] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T20:56:27.088829] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-25T20:56:27.888769] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-25T20:56:27.975024] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T20:56:28.236887] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T20:56:28.688866] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-25T20:56:29.069403] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T20:56:29.488722] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-25T20:56:29.545100] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T20:56:30.288796] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-25T20:56:30.456819] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T20:56:31.088925] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-25T20:56:31.888785] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-25T20:56:31.945113] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T20:56:31.964092] [INFO ] [REMOTE ] RCI: Full fetch complete (70547 records). [2025-09-25T20:56:31.964332] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-25T20:56:32.446939] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-25T20:56:32.447078] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-25T20:56:32.448425] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-25T20:56:32.448548] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-25T20:56:32.450831] [DEBUG] [LOCAL ] RCI: Trimmed 70547 records to 49060 (keeping 200 days of data) [2025-09-25T20:56:32.555808] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T20:56:32.599188] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T20:56:32.695156] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-25T20:56:32.837564] [DEBUG] [LOCAL ] RCI: Primary data saved (49060 records). [2025-09-25T20:56:32.837896] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-25T20:56:32.838198] [INFO ] [MAIN ] Update Progress: 1779/2372 symbols completed. RCI took 39.5s. Estimated remaining: 1h 18m 50s. Rate: 7.5 symbols/min [2025-09-25T20:56:33.023357] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:33.095111] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-25T20:56:33.095276] [INFO ] [MAIN ] RDDT: Loaded 53784 existing records. [2025-09-25T20:56:33.338298] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:33.338960] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-25T20:56:33.339008] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-25T20:56:33.339592] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-25T20:56:33.339699] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-25T20:56:33.488706] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-25T20:56:33.649525] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T20:56:33.765789] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:34.288736] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-25T20:56:35.013814] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T20:56:35.088716] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-25T20:56:35.888727] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-25T20:56:36.675823] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T20:56:36.688697] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-25T20:56:36.775260] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-25T20:56:37.488996] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-25T20:56:38.107568] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-25T20:56:38.288710] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-25T20:56:38.376810] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T20:56:39.088741] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-25T20:56:39.160497] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T20:56:39.164746] [INFO ] [REMOTE ] RCS: Full fetch complete (19198 records). [2025-09-25T20:56:39.164859] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-25T20:56:39.606902] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-25T20:56:39.607081] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-25T20:56:39.608065] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-25T20:56:39.608138] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-25T20:56:39.609785] [DEBUG] [LOCAL ] RCS: Trimmed 19198 records to 11526 (keeping 200 days of data) [2025-09-25T20:56:39.701845] [DEBUG] [LOCAL ] RCS: Primary data saved (11526 records). [2025-09-25T20:56:39.702485] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-25T20:56:39.702759] [INFO ] [MAIN ] Update Progress: 1780/2372 symbols completed. RCS took 27.7s. Estimated remaining: 1h 18m 42s. Rate: 7.5 symbols/min [2025-09-25T20:56:39.891740] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-25T20:56:39.933129] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-25T20:56:39.959444] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:40.020736] [DEBUG] [LOCAL ] RDN: Loaded 45275 existing records from primary storage. [2025-09-25T20:56:40.020909] [INFO ] [MAIN ] RDN: Loaded 45275 existing records. [2025-09-25T20:56:40.220292] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:40.220593] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-25T20:56:40.220767] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-25T20:56:40.221222] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-25T20:56:40.221303] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-25T20:56:40.693090] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-25T20:56:40.708129] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:40.712778] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T20:56:40.870526] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T20:56:40.880734] [INFO ] [REMOTE ] RCL: Full fetch complete (75084 records). [2025-09-25T20:56:40.880909] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-25T20:56:40.882387] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:56:40.882498] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:56:40.882575] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:56:40.882687] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-25T20:56:40.882780] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-25T20:56:40.882834] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-25T20:56:40.882903] [DEBUG] [LOCAL ] RCL: No derivative data file found to delete. [2025-09-25T20:56:40.882970] [INFO ] [MAIN ] Update Progress: 1781/2372 symbols completed. RCL took 32.9s. Estimated remaining: 1h 18m 31s. Rate: 7.5 symbols/min [2025-09-25T20:56:41.066165] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:41.155801] [DEBUG] [LOCAL ] RDW: Loaded 52014 existing records from primary storage. [2025-09-25T20:56:41.156070] [INFO ] [MAIN ] RDW: Loaded 52014 existing records. [2025-09-25T20:56:41.344395] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:41.345420] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-25T20:56:41.345479] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-25T20:56:41.345831] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-25T20:56:41.345893] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-25T20:56:41.494935] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-25T20:56:41.722638] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:42.288735] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-25T20:56:43.094740] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-25T20:56:43.094872] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-25T20:56:43.191173] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:56:43.888733] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-25T20:56:44.321320] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T20:56:44.688734] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-25T20:56:44.763692] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T20:56:45.488733] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-25T20:56:46.290460] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-25T20:56:46.296983] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-25T20:56:46.339408] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T20:56:47.088702] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-25T20:56:47.180694] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T20:56:47.888728] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-25T20:56:48.141900] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T20:56:48.688723] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-25T20:56:49.055903] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T20:56:49.488764] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-25T20:56:49.699763] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-25T20:56:50.288738] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-25T20:56:50.397135] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T20:56:50.634053] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T20:56:50.643490] [INFO ] [REMOTE ] RCUS: Full fetch complete (60226 records). [2025-09-25T20:56:50.643687] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-25T20:56:51.086061] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-25T20:56:51.086502] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-25T20:56:51.087751] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-25T20:56:51.087821] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-25T20:56:51.088685] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-25T20:56:51.091127] [DEBUG] [LOCAL ] RCUS: Trimmed 60226 records to 42949 (keeping 200 days of data) [2025-09-25T20:56:51.356211] [DEBUG] [LOCAL ] RCUS: Primary data saved (42949 records). [2025-09-25T20:56:51.356390] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-25T20:56:51.356579] [INFO ] [MAIN ] Update Progress: 1782/2372 symbols completed. RCUS took 29.8s. Estimated remaining: 1h 18m 24s. Rate: 7.5 symbols/min [2025-09-25T20:56:51.574433] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:56:51.633517] [DEBUG] [LOCAL ] RDY: Loaded 46777 existing records from primary storage. [2025-09-25T20:56:51.633723] [INFO ] [MAIN ] RDY: Loaded 46777 existing records. [2025-09-25T20:56:51.825010] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:56:51.825483] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-25T20:56:51.825532] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-25T20:56:51.825923] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-25T20:56:51.825983] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-25T20:56:51.897940] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-25T20:56:52.214764] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:56:52.688729] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-25T20:56:52.924413] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-25T20:56:53.025294] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T20:56:53.488731] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-25T20:56:53.706353] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T20:56:54.189597] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T20:56:54.288677] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-25T20:56:55.088738] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-25T20:56:55.888742] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-25T20:56:56.109463] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-25T20:56:56.150639] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T20:56:56.688743] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-25T20:56:56.948389] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T20:56:57.491205] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-25T20:56:57.495622] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T20:56:58.290873] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-25T20:56:59.088700] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-25T20:56:59.188683] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-25T20:56:59.523186] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T20:56:59.648086] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T20:56:59.888758] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-25T20:57:00.688776] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-25T20:57:00.780870] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T20:57:01.488737] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-25T20:57:02.020386] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T20:57:02.288744] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-25T20:57:03.088750] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-25T20:57:03.310147] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T20:57:03.426141] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-25T20:57:03.888738] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-25T20:57:03.993209] [DEBUG] [REMOTE ] RDDT: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-25T20:57:03.993556] [WARN ] [REMOTE ] RDDT: No data returned for month 2025-09 [2025-09-25T20:57:03.994955] [INFO ] [REMOTE ] RDDT: Full fetch complete (70874 records). [2025-09-25T20:57:03.995039] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-25T20:57:04.001163] [FATAL] [VALIDATOR ] RDDT: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T20:57:04.001692] [FATAL] [MAIN ] RDDT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:57:04.001921] [WARN ] [MAIN ] RDDT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:57:04.002089] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-25T20:57:04.002194] [DEBUG] [LOCAL ] RDDT: No primary data file found to delete. [2025-09-25T20:57:04.002253] [INFO ] [LOCAL ] RDDT: Starting deletion of derivative data. [2025-09-25T20:57:04.004091] [DEBUG] [LOCAL ] RDDT: Deleted derivative data file. [2025-09-25T20:57:04.004228] [INFO ] [MAIN ] Update Progress: 1783/2372 symbols completed. RDDT took 31.2s. Estimated remaining: 1h 18m 18s. Rate: 7.5 symbols/min [2025-09-25T20:57:04.256805] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:04.320855] [DEBUG] [LOCAL ] RELX: Loaded 47852 existing records from primary storage. [2025-09-25T20:57:04.321011] [INFO ] [MAIN ] RELX: Loaded 47852 existing records. [2025-09-25T20:57:04.507522] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:04.508233] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-25T20:57:04.508290] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-25T20:57:04.508573] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-25T20:57:04.508632] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-25T20:57:04.733720] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-25T20:57:04.810797] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T20:57:04.843404] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-25T20:57:05.039963] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:05.488719] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-25T20:57:06.288749] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-25T20:57:06.358530] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T20:57:07.088796] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-25T20:57:07.888708] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-25T20:57:07.961530] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-25T20:57:08.001874] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T20:57:08.522093] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T20:57:08.688730] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-25T20:57:09.221879] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T20:57:09.488761] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-25T20:57:10.288729] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-25T20:57:10.370152] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T20:57:10.781672] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T20:57:11.008829] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T20:57:11.088727] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-25T20:57:11.888798] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-25T20:57:12.688813] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-25T20:57:12.753473] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T20:57:13.152948] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T20:57:13.162775] [INFO ] [REMOTE ] RDN: Full fetch complete (65879 records). [2025-09-25T20:57:13.162998] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-25T20:57:13.497805] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-25T20:57:13.622676] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-25T20:57:13.622793] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-25T20:57:13.624065] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-25T20:57:13.624907] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-25T20:57:13.626503] [DEBUG] [LOCAL ] RDN: Trimmed 65879 records to 45605 (keeping 200 days of data) [2025-09-25T20:57:13.947369] [DEBUG] [LOCAL ] RDN: Primary data saved (45605 records). [2025-09-25T20:57:13.947524] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-25T20:57:13.948885] [INFO ] [MAIN ] Update Progress: 1784/2372 symbols completed. RDN took 34.2s. Estimated remaining: 1h 18m 10s. Rate: 7.5 symbols/min [2025-09-25T20:57:14.150189] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:14.217690] [DEBUG] [LOCAL ] RERE: Loaded 41078 existing records from primary storage. [2025-09-25T20:57:14.217932] [INFO ] [MAIN ] RERE: Loaded 41078 existing records. [2025-09-25T20:57:14.297747] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-25T20:57:14.449564] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:14.449990] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-25T20:57:14.450048] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-25T20:57:14.450376] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-25T20:57:14.450449] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-25T20:57:14.523209] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T20:57:14.918057] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:15.088728] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-25T20:57:15.351472] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T20:57:15.888732] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-25T20:57:16.678980] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-25T20:57:16.689442] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-25T20:57:16.691749] [INFO ] [REMOTE ] RDW: Full fetch complete (74502 records). [2025-09-25T20:57:16.691862] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-25T20:57:16.903305] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T20:57:17.177421] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T20:57:17.281373] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-25T20:57:17.281482] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-25T20:57:17.282597] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-25T20:57:17.282689] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-25T20:57:17.286169] [DEBUG] [LOCAL ] RDW: Trimmed 74502 records to 52404 (keeping 200 days of data) [2025-09-25T20:57:17.492717] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-25T20:57:17.640714] [DEBUG] [LOCAL ] RDW: Primary data saved (52404 records). [2025-09-25T20:57:17.640909] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-25T20:57:17.641958] [INFO ] [MAIN ] Update Progress: 1785/2372 symbols completed. RDW took 36.8s. Estimated remaining: 1h 18m 1s. Rate: 7.5 symbols/min [2025-09-25T20:57:17.828300] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:17.885976] [DEBUG] [LOCAL ] RES: Loaded 47504 existing records from primary storage. [2025-09-25T20:57:17.886135] [INFO ] [MAIN ] RES: Loaded 47504 existing records. [2025-09-25T20:57:18.079632] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:18.080154] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-25T20:57:18.080209] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-25T20:57:18.080570] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-25T20:57:18.080630] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-25T20:57:18.300741] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-25T20:57:18.501910] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T20:57:18.520611] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:19.088737] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-25T20:57:19.347867] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T20:57:19.404190] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T20:57:19.888761] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-25T20:57:20.592968] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T20:57:20.688745] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-25T20:57:21.081804] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T20:57:21.092823] [INFO ] [REMOTE ] RDY: Full fetch complete (69011 records). [2025-09-25T20:57:21.093078] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-25T20:57:21.527341] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-25T20:57:21.527447] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-25T20:57:21.528590] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-25T20:57:21.528705] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-25T20:57:21.530275] [DEBUG] [LOCAL ] RDY: Trimmed 69011 records to 47087 (keeping 200 days of data) [2025-09-25T20:57:21.504768] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-25T20:57:21.852934] [DEBUG] [LOCAL ] RDY: Primary data saved (47087 records). [2025-09-25T20:57:21.853100] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-25T20:57:21.853242] [INFO ] [MAIN ] Update Progress: 1786/2372 symbols completed. RDY took 30.5s. Estimated remaining: 1h 17m 52s. Rate: 7.5 symbols/min [2025-09-25T20:57:22.055221] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:22.108117] [DEBUG] [LOCAL ] REVG: Loaded 40955 existing records from primary storage. [2025-09-25T20:57:22.108278] [INFO ] [MAIN ] REVG: Loaded 40955 existing records. [2025-09-25T20:57:22.290794] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-25T20:57:22.318095] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:22.318506] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-25T20:57:22.318573] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-25T20:57:22.318925] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-25T20:57:22.318994] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-25T20:57:22.444406] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T20:57:22.753128] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:22.983916] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T20:57:23.088788] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-25T20:57:23.767726] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T20:57:23.888763] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-25T20:57:24.688794] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-25T20:57:24.787459] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T20:57:25.488737] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-25T20:57:25.559150] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T20:57:26.288710] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-25T20:57:26.337063] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T20:57:27.088779] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-25T20:57:27.371256] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T20:57:27.888732] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-25T20:57:28.128152] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:57:28.630471] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T20:57:28.688735] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-25T20:57:29.488748] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-25T20:57:29.848945] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T20:57:30.288702] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-25T20:57:30.574143] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:57:30.899020] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T20:57:31.088752] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-25T20:57:31.857043] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T20:57:31.866334] [INFO ] [REMOTE ] RELX: Full fetch complete (67045 records). [2025-09-25T20:57:31.866499] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-25T20:57:31.900213] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-25T20:57:32.335166] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-25T20:57:32.335268] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-25T20:57:32.336485] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-25T20:57:32.336563] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-25T20:57:32.339758] [DEBUG] [LOCAL ] RELX: Trimmed 67045 records to 48211 (keeping 200 days of data) [2025-09-25T20:57:32.625106] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T20:57:32.689380] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-25T20:57:32.720456] [DEBUG] [LOCAL ] RELX: Primary data saved (48211 records). [2025-09-25T20:57:32.720577] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-25T20:57:32.720729] [INFO ] [MAIN ] Update Progress: 1787/2372 symbols completed. RELX took 28.7s. Estimated remaining: 1h 17m 45s. Rate: 7.5 symbols/min [2025-09-25T20:57:32.908112] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:32.927754] [DEBUG] [LOCAL ] REX: Loaded 13981 existing records from primary storage. [2025-09-25T20:57:32.927893] [INFO ] [MAIN ] REX: Loaded 13981 existing records. [2025-09-25T20:57:33.120093] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:33.122685] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-25T20:57:33.122767] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-25T20:57:33.123190] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-25T20:57:33.123262] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-25T20:57:33.498731] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-25T20:57:33.502325] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:33.528272] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T20:57:34.288715] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-25T20:57:34.343007] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T20:57:35.088718] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-25T20:57:35.212103] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T20:57:35.417189] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T20:57:35.888792] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-25T20:57:36.688745] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-25T20:57:36.913112] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T20:57:36.937868] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T20:57:37.488732] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-25T20:57:38.288687] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-25T20:57:38.331838] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T20:57:38.363110] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T20:57:39.088739] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-25T20:57:39.464986] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T20:57:39.888735] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-25T20:57:40.688705] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-25T20:57:40.858284] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T20:57:40.870496] [INFO ] [REMOTE ] RERE: Full fetch complete (57444 records). [2025-09-25T20:57:40.870710] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-25T20:57:41.302834] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-25T20:57:41.302951] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-25T20:57:41.304070] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-25T20:57:41.304140] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-25T20:57:41.305560] [DEBUG] [LOCAL ] RERE: Trimmed 57444 records to 41364 (keeping 200 days of data) [2025-09-25T20:57:41.510811] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-25T20:57:41.561458] [DEBUG] [LOCAL ] RERE: Primary data saved (41364 records). [2025-09-25T20:57:41.561613] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-25T20:57:41.561766] [INFO ] [MAIN ] Update Progress: 1788/2372 symbols completed. RERE took 27.6s. Estimated remaining: 1h 17m 37s. Rate: 7.5 symbols/min [2025-09-25T20:57:41.766987] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T20:57:41.798243] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:41.855428] [DEBUG] [LOCAL ] REXR: Loaded 52081 existing records from primary storage. [2025-09-25T20:57:41.855619] [INFO ] [MAIN ] REXR: Loaded 52081 existing records. [2025-09-25T20:57:42.068496] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:42.068855] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-25T20:57:42.068908] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-25T20:57:42.069259] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-25T20:57:42.069320] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-25T20:57:42.221615] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T20:57:42.275639] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T20:57:42.293720] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-25T20:57:42.515791] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:43.088742] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-25T20:57:43.888711] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-25T20:57:44.126594] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T20:57:44.193027] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T20:57:44.688754] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-25T20:57:45.283257] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T20:57:45.488746] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-25T20:57:46.288754] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-25T20:57:46.622525] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T20:57:47.101417] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-25T20:57:47.104746] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T20:57:47.114670] [INFO ] [REMOTE ] RES: Full fetch complete (69051 records). [2025-09-25T20:57:47.114861] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-25T20:57:47.530187] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-25T20:57:47.530292] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-25T20:57:47.531495] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-25T20:57:47.531565] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-25T20:57:47.533359] [DEBUG] [LOCAL ] RES: Trimmed 69051 records to 47879 (keeping 200 days of data) [2025-09-25T20:57:47.853134] [DEBUG] [LOCAL ] RES: Primary data saved (47879 records). [2025-09-25T20:57:47.853305] [INFO ] [MAIN ] RES: Full history saved. [2025-09-25T20:57:47.854349] [INFO ] [MAIN ] Update Progress: 1789/2372 symbols completed. RES took 30.2s. Estimated remaining: 1h 17m 29s. Rate: 7.5 symbols/min [2025-09-25T20:57:47.902748] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-25T20:57:48.053781] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:48.111408] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-25T20:57:48.139058] [DEBUG] [LOCAL ] REZI: Loaded 46856 existing records from primary storage. [2025-09-25T20:57:48.139232] [INFO ] [MAIN ] REZI: Loaded 46856 existing records. [2025-09-25T20:57:48.337602] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:48.337917] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-25T20:57:48.337966] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-25T20:57:48.338254] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-25T20:57:48.338314] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-25T20:57:48.703741] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-25T20:57:48.711554] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:49.488727] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-25T20:57:49.663724] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T20:57:49.730303] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T20:57:50.288874] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-25T20:57:50.875953] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (4.59 seconds). [2025-09-25T20:57:51.094947] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-25T20:57:51.097493] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T20:57:51.253206] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-25T20:57:51.888739] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-25T20:57:52.688714] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-25T20:57:52.848268] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T20:57:53.488705] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-25T20:57:53.622325] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T20:57:53.692108] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T20:57:54.288731] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-25T20:57:54.775117] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T20:57:55.088768] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-25T20:57:55.855088] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T20:57:55.888888] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-25T20:57:56.688757] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-25T20:57:56.972105] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T20:57:57.006840] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T20:57:57.011749] [INFO ] [REMOTE ] REX: Full fetch complete (21057 records). [2025-09-25T20:57:57.011858] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-25T20:57:57.409871] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-25T20:57:57.410001] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-25T20:57:57.410772] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-25T20:57:57.410879] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-25T20:57:57.411785] [DEBUG] [LOCAL ] REX: Trimmed 21057 records to 14094 (keeping 200 days of data) [2025-09-25T20:57:57.512466] [DEBUG] [LOCAL ] REX: Primary data saved (14094 records). [2025-09-25T20:57:57.512685] [INFO ] [MAIN ] REX: Full history saved. [2025-09-25T20:57:57.512880] [INFO ] [MAIN ] Update Progress: 1790/2372 symbols completed. REX took 24.8s. Estimated remaining: 1h 17m 21s. Rate: 7.5 symbols/min [2025-09-25T20:57:57.502744] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-25T20:57:57.723017] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:57:57.794174] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-25T20:57:57.795204] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-25T20:57:58.013391] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:57:58.014022] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-25T20:57:58.014090] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-25T20:57:58.014802] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-25T20:57:58.014925] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-25T20:57:58.290890] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-25T20:57:58.380809] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T20:57:58.755927] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:57:59.088733] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-25T20:57:59.468593] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T20:57:59.888742] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-25T20:57:59.984523] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T20:58:00.693226] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-25T20:58:00.696067] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T20:58:01.488709] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-25T20:58:01.820945] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T20:58:02.288704] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-25T20:58:02.361415] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T20:58:02.829582] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T20:58:02.838852] [INFO ] [REMOTE ] REVG: Full fetch complete (58388 records). [2025-09-25T20:58:02.839053] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-25T20:58:03.108452] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-25T20:58:03.341878] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-25T20:58:03.342014] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-25T20:58:03.343412] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-25T20:58:03.343495] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-25T20:58:03.344982] [DEBUG] [LOCAL ] REVG: Trimmed 58388 records to 41220 (keeping 200 days of data) [2025-09-25T20:58:03.666572] [DEBUG] [LOCAL ] REVG: Primary data saved (41220 records). [2025-09-25T20:58:03.666771] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-25T20:58:03.666943] [INFO ] [MAIN ] Update Progress: 1791/2372 symbols completed. REVG took 41.8s. Estimated remaining: 1h 17m 13s. Rate: 7.5 symbols/min [2025-09-25T20:58:03.863279] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:03.879807] [DEBUG] [LOCAL ] RFI: Loaded 10465 existing records from primary storage. [2025-09-25T20:58:03.879954] [INFO ] [MAIN ] RFI: Loaded 10465 existing records. [2025-09-25T20:58:03.914756] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-25T20:58:04.096694] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T20:58:04.132342] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:04.132610] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-25T20:58:04.132863] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-25T20:58:04.133148] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-25T20:58:04.133209] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-25T20:58:04.523193] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:04.688775] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-25T20:58:05.012564] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T20:58:05.281897] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T20:58:05.488739] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-25T20:58:06.063017] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-25T20:58:06.288764] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-25T20:58:06.408108] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T20:58:07.088759] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-25T20:58:07.876125] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T20:58:07.900173] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-25T20:58:07.930683] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T20:58:08.688746] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-25T20:58:09.488722] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-25T20:58:09.768007] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T20:58:10.160536] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T20:58:10.294720] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-25T20:58:10.311557] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T20:58:11.088747] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-25T20:58:11.888733] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-25T20:58:12.105090] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T20:58:12.126293] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T20:58:12.688714] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-25T20:58:13.488739] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-25T20:58:13.523691] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T20:58:13.628096] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T20:58:14.288745] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-25T20:58:15.088703] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-25T20:58:15.136325] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T20:58:15.445520] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T20:58:15.888753] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-25T20:58:16.649349] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T20:58:16.688692] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-25T20:58:17.488714] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-25T20:58:17.577222] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T20:58:17.836767] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T20:58:18.288738] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-25T20:58:19.088693] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-25T20:58:19.268318] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T20:58:19.278516] [INFO ] [REMOTE ] REXR: Full fetch complete (75114 records). [2025-09-25T20:58:19.278734] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-25T20:58:19.745804] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-25T20:58:19.745926] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-25T20:58:19.747166] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-25T20:58:19.747238] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-25T20:58:19.748911] [DEBUG] [LOCAL ] REXR: Trimmed 75114 records to 52467 (keeping 200 days of data) [2025-09-25T20:58:19.888730] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-25T20:58:20.155820] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T20:58:20.181924] [DEBUG] [LOCAL ] REXR: Primary data saved (52467 records). [2025-09-25T20:58:20.182091] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-25T20:58:20.183565] [INFO ] [MAIN ] Update Progress: 1792/2372 symbols completed. REXR took 38.6s. Estimated remaining: 1h 17m 7s. Rate: 7.5 symbols/min [2025-09-25T20:58:20.365798] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:20.389005] [DEBUG] [LOCAL ] RFL: Loaded 10943 existing records from primary storage. [2025-09-25T20:58:20.389185] [INFO ] [MAIN ] RFL: Loaded 10943 existing records. [2025-09-25T20:58:20.595240] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:20.595551] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-25T20:58:20.595625] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-25T20:58:20.596829] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-25T20:58:20.596949] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-25T20:58:20.697763] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-25T20:58:21.002018] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T20:58:21.054961] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T20:58:21.073032] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:21.488736] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-25T20:58:22.132251] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T20:58:22.288734] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-25T20:58:22.553541] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T20:58:22.573204] [INFO ] [REMOTE ] REZI: Full fetch complete (65688 records). [2025-09-25T20:58:22.573437] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-25T20:58:23.095757] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-25T20:58:23.325963] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-25T20:58:23.326057] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-25T20:58:23.327151] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-25T20:58:23.327217] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-25T20:58:23.328617] [DEBUG] [LOCAL ] REZI: Trimmed 65688 records to 47235 (keeping 200 days of data) [2025-09-25T20:58:23.610410] [DEBUG] [LOCAL ] REZI: Primary data saved (47235 records). [2025-09-25T20:58:23.610555] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-25T20:58:23.611522] [INFO ] [MAIN ] Update Progress: 1793/2372 symbols completed. REZI took 35.8s. Estimated remaining: 1h 16m 58s. Rate: 7.5 symbols/min [2025-09-25T20:58:23.803913] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:23.813280] [DEBUG] [LOCAL ] RFM: Loaded 4154 existing records from primary storage. [2025-09-25T20:58:23.813411] [INFO ] [MAIN ] RFM: Loaded 4154 existing records. [2025-09-25T20:58:23.897552] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-25T20:58:24.034451] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T20:58:24.039707] [INFO ] [REMOTE ] RFI: Full fetch complete (15762 records). [2025-09-25T20:58:24.039860] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-25T20:58:24.064493] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T20:58:24.168491] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:24.173326] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-25T20:58:24.173395] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-25T20:58:24.173783] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-25T20:58:24.173858] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-25T20:58:24.699814] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-25T20:58:24.768021] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T20:58:25.012867] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-25T20:58:25.012953] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-25T20:58:25.013342] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-25T20:58:25.013382] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-25T20:58:25.013948] [DEBUG] [LOCAL ] RFI: Trimmed 15762 records to 10508 (keeping 200 days of data) [2025-09-25T20:58:25.058185] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:25.096582] [DEBUG] [LOCAL ] RFI: Primary data saved (10508 records). [2025-09-25T20:58:25.096792] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-25T20:58:25.096904] [INFO ] [MAIN ] Update Progress: 1794/2372 symbols completed. RFI took 21.4s. Estimated remaining: 1h 16m 48s. Rate: 7.5 symbols/min [2025-09-25T20:58:25.290710] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:25.307338] [DEBUG] [LOCAL ] RFMZ: Loaded 8713 existing records from primary storage. [2025-09-25T20:58:25.307481] [INFO ] [MAIN ] RFMZ: Loaded 8713 existing records. [2025-09-25T20:58:25.494589] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-25T20:58:25.504126] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:25.504555] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-25T20:58:25.504638] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-25T20:58:25.504955] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-25T20:58:25.505035] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-25T20:58:25.911895] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:26.230307] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T20:58:26.288703] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-25T20:58:26.610450] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T20:58:26.906137] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T20:58:27.088729] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-25T20:58:27.811887] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T20:58:27.888737] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-25T20:58:28.426048] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T20:58:28.688702] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-25T20:58:29.283139] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T20:58:29.488739] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-25T20:58:30.158413] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-25T20:58:30.288715] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-25T20:58:30.937919] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T20:58:31.088726] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-25T20:58:31.716969] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T20:58:31.888740] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-25T20:58:32.613007] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-25T20:58:32.688763] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-25T20:58:33.488816] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-25T20:58:34.288726] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-25T20:58:34.374137] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T20:58:34.601152] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T20:58:34.904442] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T20:58:35.088744] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-25T20:58:35.733499] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T20:58:35.888746] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-25T20:58:36.688782] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-25T20:58:37.155313] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T20:58:37.172752] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T20:58:37.488763] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-25T20:58:38.157710] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T20:58:38.160107] [INFO ] [REMOTE ] RFM: Full fetch complete (5904 records). [2025-09-25T20:58:38.160230] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-25T20:58:38.294067] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-25T20:58:38.599152] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-25T20:58:38.599285] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-25T20:58:38.599609] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-25T20:58:38.599761] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-25T20:58:38.600349] [DEBUG] [LOCAL ] RFM: Trimmed 5904 records to 4168 (keeping 200 days of data) [2025-09-25T20:58:38.633297] [DEBUG] [LOCAL ] RFM: Primary data saved (4168 records). [2025-09-25T20:58:38.633438] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-25T20:58:38.633633] [INFO ] [MAIN ] Update Progress: 1795/2372 symbols completed. RFM took 15.0s. Estimated remaining: 1h 16m 42s. Rate: 7.5 symbols/min [2025-09-25T20:58:38.818449] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:38.894553] [DEBUG] [LOCAL ] RGA: Loaded 30123 existing records from primary storage. [2025-09-25T20:58:38.894789] [INFO ] [MAIN ] RGA: Loaded 30123 existing records. [2025-09-25T20:58:39.082007] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:39.082755] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-25T20:58:39.082815] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-25T20:58:39.083390] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-25T20:58:39.083468] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-25T20:58:39.098741] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-25T20:58:39.511059] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:39.888715] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-25T20:58:40.091613] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T20:58:40.237310] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T20:58:40.688745] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-25T20:58:40.942877] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T20:58:41.488774] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-25T20:58:41.549805] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T20:58:42.100557] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T20:58:42.288842] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-25T20:58:43.088832] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-25T20:58:43.893832] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-25T20:58:43.909099] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T20:58:44.136587] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T20:58:44.140461] [INFO ] [REMOTE ] RFL: Full fetch complete (12822 records). [2025-09-25T20:58:44.140574] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-25T20:58:44.550736] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-25T20:58:44.550829] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-25T20:58:44.551333] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-25T20:58:44.551407] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-25T20:58:44.552022] [DEBUG] [LOCAL ] RFL: Trimmed 12822 records to 11000 (keeping 200 days of data) [2025-09-25T20:58:44.599823] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T20:58:44.647145] [DEBUG] [LOCAL ] RFL: Primary data saved (11000 records). [2025-09-25T20:58:44.647320] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-25T20:58:44.647463] [INFO ] [MAIN ] Update Progress: 1796/2372 symbols completed. RFL took 24.5s. Estimated remaining: 1h 16m 33s. Rate: 7.5 symbols/min [2025-09-25T20:58:44.689134] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-25T20:58:44.870013] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:58:44.909766] [DEBUG] [LOCAL ] RGR: Loaded 20396 existing records from primary storage. [2025-09-25T20:58:44.909915] [INFO ] [MAIN ] RGR: Loaded 20396 existing records. [2025-09-25T20:58:45.097497] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:58:45.097873] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-25T20:58:45.097956] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-25T20:58:45.098233] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-25T20:58:45.098293] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-25T20:58:45.501855] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-25T20:58:45.508001] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:58:46.288823] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-25T20:58:46.494785] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T20:58:46.512815] [INFO ] [REMOTE ] RF: Full fetch complete (77624 records). [2025-09-25T20:58:46.513015] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-25T20:58:46.945291] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T20:58:47.064621] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-25T20:58:47.064766] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-25T20:58:47.066073] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-25T20:58:47.066145] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-25T20:58:47.071382] [DEBUG] [LOCAL ] RF: Trimmed 77624 records to 54020 (keeping 200 days of data) [2025-09-25T20:58:47.088694] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-25T20:58:47.471015] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T20:58:47.499241] [DEBUG] [LOCAL ] RF: Primary data saved (54020 records). [2025-09-25T20:58:47.499433] [INFO ] [MAIN ] RF: Full history saved. [2025-09-25T20:58:47.499600] [INFO ] [MAIN ] Update Progress: 1797/2372 symbols completed. RF took 50.0s. Estimated remaining: 1h 16m 24s. Rate: 7.5 symbols/min [2025-09-25T20:58:47.888743] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-25T20:58:48.688749] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-25T20:58:48.805528] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T20:58:48.938615] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T20:58:49.488780] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-25T20:58:49.488707] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T20:58:50.288733] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-25T20:58:50.683137] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T20:58:51.088762] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-25T20:58:51.818006] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T20:58:51.888743] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-25T20:58:52.232865] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T20:58:52.688695] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-25T20:58:52.748870] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T20:58:53.488804] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-25T20:58:54.180698] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T20:58:54.288742] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-25T20:58:54.345266] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T20:58:55.088737] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-25T20:58:55.471237] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T20:58:55.888715] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-25T20:58:55.976186] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T20:58:56.688751] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-25T20:58:57.084950] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T20:58:57.487568] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T20:58:57.490704] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-25T20:58:58.288748] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-25T20:58:58.652010] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T20:58:59.085716] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T20:58:59.088669] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-25T20:58:59.888729] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-25T20:58:59.898214] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T20:58:59.901452] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12879 records). [2025-09-25T20:58:59.901670] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-25T20:59:00.314985] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-25T20:59:00.315085] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-25T20:59:00.315454] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-25T20:59:00.315519] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-25T20:59:00.316745] [DEBUG] [LOCAL ] RFMZ: Trimmed 12879 records to 8769 (keeping 200 days of data) [2025-09-25T20:59:00.382382] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8769 records). [2025-09-25T20:59:00.382539] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-25T20:59:00.382699] [INFO ] [MAIN ] Update Progress: 1798/2372 symbols completed. RFMZ took 35.3s. Estimated remaining: 1h 16m 17s. Rate: 7.5 symbols/min [2025-09-25T20:59:00.688782] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-25T20:59:01.219613] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-25T20:59:01.488778] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-25T20:59:02.128092] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T20:59:02.282122] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T20:59:02.288673] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-25T20:59:03.088757] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-25T20:59:03.539988] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T20:59:03.544925] [INFO ] [REMOTE ] RGR: Full fetch complete (28609 records). [2025-09-25T20:59:03.545035] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-25T20:59:03.981392] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-25T20:59:03.983612] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-25T20:59:03.984255] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-25T20:59:03.984311] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-25T20:59:03.988236] [DEBUG] [LOCAL ] RGR: Trimmed 28609 records to 20534 (keeping 200 days of data) [2025-09-25T20:59:04.129867] [DEBUG] [LOCAL ] RGR: Primary data saved (20534 records). [2025-09-25T20:59:04.130006] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-25T20:59:04.130118] [INFO ] [MAIN ] Update Progress: 1799/2372 symbols completed. RGR took 19.5s. Estimated remaining: 1h 16m 8s. Rate: 7.5 symbols/min [2025-09-25T20:59:04.325356] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T20:59:04.331226] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-25T20:59:05.689062] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T20:59:05.698624] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-25T20:59:07.158132] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T20:59:07.165500] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-25T20:59:08.504519] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T20:59:08.511007] [INFO ] [REMOTE ] RGA: Full fetch complete (45694 records). [2025-09-25T20:59:08.511175] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-25T20:59:08.947340] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-25T20:59:08.947428] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-25T20:59:08.948409] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-25T20:59:08.948476] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-25T20:59:08.949513] [DEBUG] [LOCAL ] RGA: Trimmed 45694 records to 30376 (keeping 200 days of data) [2025-09-25T20:59:09.171120] [DEBUG] [LOCAL ] RGA: Primary data saved (30376 records). [2025-09-25T20:59:09.171272] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-25T20:59:09.171364] [INFO ] [MAIN ] Update Progress: 1800/2372 symbols completed. RGA took 30.5s. Estimated remaining: 1h 15m 59s. Rate: 7.5 symbols/min [2025-09-25T20:59:09.986197] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:09.989904] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:10.033736] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:10.039266] [INFO ] [MAIN ] RHLD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:10.039387] [DEBUG] [LOCAL ] RHLD: No existing data file found in primary storage. [2025-09-25T20:59:10.039443] [WARN ] [MAIN ] RHLD: No existing data found, performing full refresh instead. [2025-09-25T20:59:10.039606] [INFO ] [MAIN ] RHLD: Wiping existing primary data before full refresh. [2025-09-25T20:59:10.061524] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-25T20:59:10.061777] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-25T20:59:10.061836] [INFO ] [MAIN ] RHLD: Starting full primary refresh. [2025-09-25T20:59:10.120039] [DEBUG] [LOCAL ] RGT: Loaded 2858 existing records from primary storage. [2025-09-25T20:59:10.120225] [INFO ] [MAIN ] RGT: Loaded 2858 existing records. [2025-09-25T20:59:10.215870] [DEBUG] [LOCAL ] RHI: Loaded 49256 existing records from primary storage. [2025-09-25T20:59:10.216048] [INFO ] [MAIN ] RHI: Loaded 49256 existing records. [2025-09-25T20:59:10.337978] [DEBUG] [LOCAL ] RH: Loaded 47654 existing records from primary storage. [2025-09-25T20:59:10.338150] [INFO ] [MAIN ] RH: Loaded 47654 existing records. [2025-09-25T20:59:10.892612] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:10.935038] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-25T20:59:10.957104] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:10.980897] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-25T20:59:10.981122] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-25T20:59:10.987242] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-25T20:59:10.987311] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-25T20:59:10.981023] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-25T20:59:11.017080] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-25T20:59:11.017222] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-25T20:59:11.250921] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:11.251211] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-25T20:59:11.251266] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-25T20:59:11.256833] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-25T20:59:11.277870] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-25T20:59:11.510275] [INFO ] [REMOTE ] RHLD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:11.510681] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2024-12. [2025-09-25T20:59:11.966106] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:59:11.966578] [WARN ] [REMOTE ] RHLD: No data returned for month 2024-12 [2025-09-25T20:59:11.966989] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-01. [2025-09-25T20:59:12.303037] [DEBUG] [REMOTE ] RHLD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T20:59:12.338977] [WARN ] [REMOTE ] RHLD: No data returned for month 2025-01 [2025-09-25T20:59:12.359252] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-02. [2025-09-25T20:59:12.405499] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:12.406278] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-25T20:59:12.456775] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:12.457146] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-25T20:59:12.554872] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:12.555324] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-25T20:59:12.877858] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T20:59:12.879009] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-03. [2025-09-25T20:59:13.206948] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T20:59:13.208387] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-25T20:59:13.683873] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T20:59:13.685783] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-25T20:59:13.952062] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T20:59:13.961425] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-25T20:59:13.993385] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T20:59:14.040932] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T20:59:14.195912] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T20:59:14.288731] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-25T20:59:15.029581] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-25T20:59:15.088711] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-25T20:59:15.637084] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T20:59:15.673376] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T20:59:15.888725] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-25T20:59:16.688918] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-25T20:59:17.489170] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-25T20:59:17.502872] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T20:59:18.047849] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T20:59:18.288732] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-25T20:59:18.401927] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T20:59:18.889201] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T20:59:19.088736] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-25T20:59:19.739231] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T20:59:19.888748] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-25T20:59:20.688781] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-25T20:59:21.468301] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T20:59:21.488736] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-04. [2025-09-25T20:59:22.289803] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-25T20:59:22.517341] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T20:59:22.527239] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T20:59:22.794365] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T20:59:23.088732] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-25T20:59:23.888778] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-25T20:59:24.688700] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-25T20:59:24.983607] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T20:59:25.285969] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T20:59:25.287264] [INFO ] [REMOTE ] RGT: Full fetch complete (4157 records). [2025-09-25T20:59:25.287391] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-25T20:59:25.439349] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T20:59:25.493822] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-25T20:59:25.768310] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-25T20:59:25.768429] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-25T20:59:25.768615] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-25T20:59:25.768749] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-25T20:59:25.769445] [DEBUG] [LOCAL ] RGT: Trimmed 4157 records to 2869 (keeping 200 days of data) [2025-09-25T20:59:25.790591] [DEBUG] [LOCAL ] RGT: Primary data saved (2869 records). [2025-09-25T20:59:25.790735] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-25T20:59:25.790972] [INFO ] [MAIN ] Update Progress: 1801/2372 symbols completed. RGT took 16.6s. Estimated remaining: 1h 15m 54s. Rate: 7.5 symbols/min [2025-09-25T20:59:25.975054] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:26.058510] [DEBUG] [LOCAL ] RHP: Loaded 41735 existing records from primary storage. [2025-09-25T20:59:26.058712] [INFO ] [MAIN ] RHP: Loaded 41735 existing records. [2025-09-25T20:59:26.245063] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:26.245463] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-25T20:59:26.245534] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-25T20:59:26.248170] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-25T20:59:26.248247] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-25T20:59:26.294692] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-05. [2025-09-25T20:59:26.642266] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:26.990693] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T20:59:27.088728] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-06. [2025-09-25T20:59:27.784855] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-25T20:59:27.849442] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-25T20:59:27.888777] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-25T20:59:28.688807] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-25T20:59:29.488767] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-25T20:59:29.561138] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T20:59:30.288718] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-25T20:59:30.655590] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T20:59:30.731247] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T20:59:31.088738] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-07. [2025-09-25T20:59:31.888899] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-25T20:59:32.003158] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T20:59:32.019741] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T20:59:32.688753] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-25T20:59:33.488796] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-25T20:59:33.874371] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T20:59:34.288757] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-08. [2025-09-25T20:59:34.523706] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T20:59:34.567236] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T20:59:34.842636] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T20:59:35.088782] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-25T20:59:35.888745] [INFO ] [REMOTE ] RHLD: Fetching primary data for 2025-09. [2025-09-25T20:59:36.692235] [INFO ] [REMOTE ] RHLD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T20:59:36.691244] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-25T20:59:36.695009] [INFO ] [REMOTE ] RHLD: Full fetch complete (11549 records). [2025-09-25T20:59:36.696349] [DEBUG] [VALIDATOR ] RHLD: Validating primary data. [2025-09-25T20:59:36.944582] [WARN ] [VALIDATOR ] RHLD: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-25T20:59:36.962842] [FATAL] [MAIN ] RHLD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T20:59:36.962928] [WARN ] [MAIN ] RHLD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T20:59:36.963004] [INFO ] [LOCAL ] RHLD: Starting deletion of primary data. [2025-09-25T20:59:36.963134] [DEBUG] [LOCAL ] RHLD: No primary data file found to delete. [2025-09-25T20:59:36.963210] [INFO ] [LOCAL ] RHLD: Starting deletion of derivative data. [2025-09-25T20:59:36.963279] [DEBUG] [LOCAL ] RHLD: No derivative data file found to delete. [2025-09-25T20:59:36.963388] [INFO ] [MAIN ] Update Progress: 1802/2372 symbols completed. RHLD took 27.8s. Estimated remaining: 1h 15m 47s. Rate: 7.5 symbols/min [2025-09-25T20:59:37.018848] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T20:59:37.183130] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:37.271685] [DEBUG] [LOCAL ] RIG: Loaded 53669 existing records from primary storage. [2025-09-25T20:59:37.271874] [INFO ] [MAIN ] RIG: Loaded 53669 existing records. [2025-09-25T20:59:37.470672] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:37.471229] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-25T20:59:37.471279] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-25T20:59:37.471722] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-25T20:59:37.471794] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-25T20:59:37.494737] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-25T20:59:37.869629] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:38.288691] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-25T20:59:38.554222] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T20:59:39.021598] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T20:59:39.088735] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-25T20:59:39.888736] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-25T20:59:40.350639] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-25T20:59:40.632347] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T20:59:40.688702] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-25T20:59:41.488709] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-25T20:59:41.658112] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T20:59:41.667343] [INFO ] [REMOTE ] RHI: Full fetch complete (69813 records). [2025-09-25T20:59:41.667483] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-25T20:59:42.079623] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-25T20:59:42.079757] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-25T20:59:42.080858] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-25T20:59:42.080924] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-25T20:59:42.082466] [DEBUG] [LOCAL ] RHI: Trimmed 69813 records to 49628 (keeping 200 days of data) [2025-09-25T20:59:42.292219] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-25T20:59:42.393558] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T20:59:42.479489] [DEBUG] [LOCAL ] RHI: Primary data saved (49628 records). [2025-09-25T20:59:42.479675] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-25T20:59:42.479814] [INFO ] [MAIN ] Update Progress: 1803/2372 symbols completed. RHI took 33.3s. Estimated remaining: 1h 15m 38s. Rate: 7.5 symbols/min [2025-09-25T20:59:42.660357] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:42.723206] [DEBUG] [LOCAL ] RIO: Loaded 53394 existing records from primary storage. [2025-09-25T20:59:42.723376] [INFO ] [MAIN ] RIO: Loaded 53394 existing records. [2025-09-25T20:59:42.915425] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:42.917283] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-25T20:59:42.917336] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-25T20:59:42.917589] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-25T20:59:42.917680] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-25T20:59:43.088923] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-25T20:59:43.322061] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:43.354776] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T20:59:43.365128] [INFO ] [REMOTE ] RH: Full fetch complete (65673 records). [2025-09-25T20:59:43.365328] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-25T20:59:43.814306] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-25T20:59:43.814421] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-25T20:59:43.815810] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-25T20:59:43.815903] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-25T20:59:43.820505] [DEBUG] [LOCAL ] RH: Trimmed 65673 records to 47979 (keeping 200 days of data) [2025-09-25T20:59:43.898745] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-25T20:59:44.176959] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T20:59:44.273474] [DEBUG] [LOCAL ] RH: Primary data saved (47979 records). [2025-09-25T20:59:44.273730] [INFO ] [MAIN ] RH: Full history saved. [2025-09-25T20:59:44.273877] [INFO ] [MAIN ] Update Progress: 1804/2372 symbols completed. RH took 35.1s. Estimated remaining: 1h 15m 28s. Rate: 7.5 symbols/min [2025-09-25T20:59:44.557351] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T20:59:44.657103] [DEBUG] [LOCAL ] RITM: Loaded 52819 existing records from primary storage. [2025-09-25T20:59:44.657325] [INFO ] [MAIN ] RITM: Loaded 52819 existing records. [2025-09-25T20:59:44.691401] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-25T20:59:44.945871] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T20:59:44.946205] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-25T20:59:44.946300] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-25T20:59:44.946612] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-25T20:59:44.946710] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-25T20:59:45.033314] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T20:59:45.392287] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T20:59:45.488740] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-25T20:59:46.191733] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-25T20:59:46.288818] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-25T20:59:46.494521] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T20:59:47.088734] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-25T20:59:47.630528] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-25T20:59:47.888732] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-25T20:59:48.295717] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T20:59:48.688728] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-25T20:59:48.745571] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T20:59:49.488728] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-25T20:59:50.102455] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T20:59:50.288700] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-25T20:59:50.670306] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T20:59:51.053999] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T20:59:51.088693] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-25T20:59:51.888755] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-25T20:59:52.539265] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-25T20:59:52.688739] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-25T20:59:52.765612] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T20:59:53.443685] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T20:59:53.488739] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-25T20:59:54.288722] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-25T20:59:54.540440] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T20:59:55.088681] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-25T20:59:55.665606] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T20:59:55.668115] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-25T20:59:55.888735] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-25T20:59:56.689124] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-25T20:59:56.826564] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T20:59:57.488700] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-25T20:59:57.902826] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-25T20:59:58.288716] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-25T20:59:58.828439] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-25T20:59:59.088762] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-25T20:59:59.584969] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-25T20:59:59.624073] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T20:59:59.635429] [INFO ] [REMOTE ] RHP: Full fetch complete (57980 records). [2025-09-25T20:59:59.635682] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-25T20:59:59.894743] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-25T21:00:00.116069] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-25T21:00:00.116176] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-25T21:00:00.117385] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-25T21:00:00.117529] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-25T21:00:00.121689] [DEBUG] [LOCAL ] RHP: Trimmed 57980 records to 42046 (keeping 200 days of data) [2025-09-25T21:00:00.432155] [DEBUG] [LOCAL ] RHP: Primary data saved (42046 records). [2025-09-25T21:00:00.432331] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-25T21:00:00.432521] [INFO ] [MAIN ] Update Progress: 1805/2372 symbols completed. RHP took 34.6s. Estimated remaining: 1h 15m 23s. Rate: 7.5 symbols/min [2025-09-25T21:00:00.638774] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:00.660777] [DEBUG] [LOCAL ] RIV: Loaded 11965 existing records from primary storage. [2025-09-25T21:00:00.660939] [INFO ] [MAIN ] RIV: Loaded 11965 existing records. [2025-09-25T21:00:00.692994] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-25T21:00:00.885301] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:00.885923] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-25T21:00:00.885974] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-25T21:00:00.886301] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-25T21:00:00.886372] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-25T21:00:01.308440] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:01.488710] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-25T21:00:01.577035] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-25T21:00:02.193821] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-25T21:00:02.288723] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-25T21:00:02.399291] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T21:00:02.725544] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T21:00:03.088738] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-25T21:00:03.888734] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-25T21:00:04.688743] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-25T21:00:04.890222] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-25T21:00:05.191379] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T21:00:05.206734] [INFO ] [REMOTE ] RIG: Full fetch complete (77706 records). [2025-09-25T21:00:05.206983] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-25T21:00:05.492795] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-25T21:00:05.700190] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T21:00:05.708159] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-25T21:00:05.708246] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-25T21:00:05.709425] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-25T21:00:05.709516] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-25T21:00:05.711287] [DEBUG] [LOCAL ] RIG: Trimmed 77706 records to 54059 (keeping 200 days of data) [2025-09-25T21:00:06.017062] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-25T21:00:06.135763] [DEBUG] [LOCAL ] RIG: Primary data saved (54059 records). [2025-09-25T21:00:06.136021] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-25T21:00:06.141751] [INFO ] [MAIN ] Update Progress: 1806/2372 symbols completed. RIG took 29.2s. Estimated remaining: 1h 15m 14s. Rate: 7.5 symbols/min [2025-09-25T21:00:06.293807] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-25T21:00:06.343768] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:06.410290] [DEBUG] [LOCAL ] RJF: Loaded 47095 existing records from primary storage. [2025-09-25T21:00:06.410452] [INFO ] [MAIN ] RJF: Loaded 47095 existing records. [2025-09-25T21:00:06.622214] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:06.622850] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-25T21:00:06.622915] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-25T21:00:06.623294] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-25T21:00:06.623374] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-25T21:00:07.032986] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:07.088727] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-25T21:00:07.597628] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T21:00:07.888739] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-25T21:00:08.081580] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T21:00:08.688731] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-25T21:00:08.965482] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T21:00:09.488785] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-25T21:00:09.600445] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:00:09.733634] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T21:00:10.288712] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-25T21:00:11.088713] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-25T21:00:11.627928] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T21:00:11.888729] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-25T21:00:12.003325] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T21:00:12.342415] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T21:00:12.688727] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-25T21:00:13.440317] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T21:00:13.488737] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-25T21:00:13.777034] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T21:00:14.288731] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-25T21:00:15.088729] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-25T21:00:15.108502] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T21:00:15.353395] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T21:00:15.371038] [INFO ] [REMOTE ] RITM: Full fetch complete (76554 records). [2025-09-25T21:00:15.371232] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-25T21:00:15.851079] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-25T21:00:15.851202] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-25T21:00:15.852546] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-25T21:00:15.852618] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-25T21:00:15.854366] [DEBUG] [LOCAL ] RITM: Trimmed 76554 records to 53206 (keeping 200 days of data) [2025-09-25T21:00:15.927179] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-25T21:00:16.229104] [DEBUG] [LOCAL ] RITM: Primary data saved (53206 records). [2025-09-25T21:00:16.229274] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-25T21:00:16.229444] [INFO ] [MAIN ] Update Progress: 1807/2372 symbols completed. RITM took 32.0s. Estimated remaining: 1h 15m 7s. Rate: 7.5 symbols/min [2025-09-25T21:00:16.428397] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:16.499450] [DEBUG] [LOCAL ] RKT: Loaded 53721 existing records from primary storage. [2025-09-25T21:00:16.499701] [INFO ] [MAIN ] RKT: Loaded 53721 existing records. [2025-09-25T21:00:16.698733] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-25T21:00:16.706361] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:16.709877] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-25T21:00:16.709941] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-25T21:00:16.710313] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-25T21:00:16.710390] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-25T21:00:16.765605] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:00:17.143724] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T21:00:17.185916] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:17.488761] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-25T21:00:18.288699] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-25T21:00:18.426891] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T21:00:18.499372] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:00:19.088762] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-25T21:00:19.888744] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-25T21:00:20.090846] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-25T21:00:20.238381] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T21:00:20.688749] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-25T21:00:21.488784] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-25T21:00:21.736871] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T21:00:21.749427] [INFO ] [REMOTE ] RIO: Full fetch complete (77353 records). [2025-09-25T21:00:21.749625] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-25T21:00:22.188492] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-25T21:00:22.188593] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-25T21:00:22.189896] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-25T21:00:22.189987] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-25T21:00:22.192423] [DEBUG] [LOCAL ] RIO: Trimmed 77353 records to 53783 (keeping 200 days of data) [2025-09-25T21:00:22.301421] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-25T21:00:22.614336] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T21:00:22.622169] [INFO ] [REMOTE ] RIV: Full fetch complete (17321 records). [2025-09-25T21:00:22.622296] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-25T21:00:22.634390] [DEBUG] [LOCAL ] RIO: Primary data saved (53783 records). [2025-09-25T21:00:22.634568] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-25T21:00:22.635877] [INFO ] [MAIN ] Update Progress: 1808/2372 symbols completed. RIO took 40.2s. Estimated remaining: 1h 14m 58s. Rate: 7.5 symbols/min [2025-09-25T21:00:22.846377] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-25T21:00:23.093426] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-25T21:00:23.093329] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:23.325103] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-25T21:00:23.325185] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-25T21:00:23.325602] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-25T21:00:23.325674] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-25T21:00:23.326308] [DEBUG] [LOCAL ] RIV: Trimmed 17321 records to 12070 (keeping 200 days of data) [2025-09-25T21:00:23.410026] [DEBUG] [LOCAL ] RIV: Primary data saved (12070 records). [2025-09-25T21:00:23.410174] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-25T21:00:23.410295] [INFO ] [MAIN ] Update Progress: 1809/2372 symbols completed. RIV took 23.0s. Estimated remaining: 1h 14m 48s. Rate: 7.5 symbols/min [2025-09-25T21:00:23.568879] [DEBUG] [LOCAL ] RL: Loaded 41521 existing records from primary storage. [2025-09-25T21:00:23.569044] [INFO ] [MAIN ] RL: Loaded 41521 existing records. [2025-09-25T21:00:23.649892] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:23.761297] [DEBUG] [LOCAL ] RLI: Loaded 33293 existing records from primary storage. [2025-09-25T21:00:23.761461] [INFO ] [MAIN ] RLI: Loaded 33293 existing records. [2025-09-25T21:00:24.088282] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:24.092219] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-25T21:00:24.092281] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-25T21:00:24.092539] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-25T21:00:24.092600] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-25T21:00:24.129067] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:24.129318] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-25T21:00:24.129365] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-25T21:00:24.129631] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-25T21:00:24.129727] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-25T21:00:24.355727] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T21:00:24.400355] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-25T21:00:24.772780] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:00:24.854547] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-25T21:00:25.073709] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:25.142224] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:25.488754] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-25T21:00:26.288733] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-25T21:00:26.368170] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T21:00:27.058174] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-25T21:00:27.088664] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-25T21:00:27.185529] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:00:27.227312] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T21:00:27.888720] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-25T21:00:28.688738] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-25T21:00:29.296510] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T21:00:29.342828] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T21:00:29.488727] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-25T21:00:30.288726] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-25T21:00:30.512500] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T21:00:30.882621] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T21:00:31.088715] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-25T21:00:31.733428] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T21:00:31.888742] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-25T21:00:32.688780] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-25T21:00:32.900352] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T21:00:33.276918] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T21:00:33.488749] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-25T21:00:34.120817] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T21:00:34.288741] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-25T21:00:35.088744] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-25T21:00:35.732787] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-25T21:00:35.888709] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-25T21:00:36.288557] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T21:00:36.688732] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-25T21:00:36.741584] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T21:00:37.488758] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-25T21:00:38.288740] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-25T21:00:38.352525] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-25T21:00:38.629030] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-25T21:00:38.778257] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:00:39.088727] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-25T21:00:39.888754] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-25T21:00:40.469387] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T21:00:40.495382] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T21:00:40.688732] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-25T21:00:41.491114] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-25T21:00:41.664980] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:00:41.912357] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T21:00:42.288734] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-25T21:00:43.088750] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-25T21:00:43.776976] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-25T21:00:43.888791] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-25T21:00:44.151058] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T21:00:44.435933] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T21:00:44.447366] [INFO ] [REMOTE ] RJF: Full fetch complete (68346 records). [2025-09-25T21:00:44.447535] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-25T21:00:44.700486] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-25T21:00:44.902554] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-25T21:00:44.902688] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-25T21:00:44.903906] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-25T21:00:44.904021] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-25T21:00:44.905669] [DEBUG] [LOCAL ] RJF: Trimmed 68346 records to 47455 (keeping 200 days of data) [2025-09-25T21:00:45.243964] [DEBUG] [LOCAL ] RJF: Primary data saved (47455 records). [2025-09-25T21:00:45.244399] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-25T21:00:45.245785] [INFO ] [MAIN ] Update Progress: 1810/2372 symbols completed. RJF took 39.1s. Estimated remaining: 1h 14m 44s. Rate: 7.5 symbols/min [2025-09-25T21:00:45.442905] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:45.494249] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-25T21:00:45.527579] [DEBUG] [LOCAL ] RLJ: Loaded 48235 existing records from primary storage. [2025-09-25T21:00:45.527773] [INFO ] [MAIN ] RLJ: Loaded 48235 existing records. [2025-09-25T21:00:45.722612] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:45.723295] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-25T21:00:45.723346] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-25T21:00:45.724095] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-25T21:00:45.724171] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-25T21:00:45.870505] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T21:00:46.150117] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:46.288744] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-25T21:00:46.409888] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-25T21:00:46.822468] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T21:00:47.088851] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-25T21:00:47.389803] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T21:00:47.399242] [INFO ] [REMOTE ] RLI: Full fetch complete (46372 records). [2025-09-25T21:00:47.399408] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-25T21:00:47.858951] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-25T21:00:47.859042] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-25T21:00:47.860012] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-25T21:00:47.860093] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-25T21:00:47.861212] [DEBUG] [LOCAL ] RLI: Trimmed 46372 records to 33549 (keeping 200 days of data) [2025-09-25T21:00:47.929691] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-25T21:00:48.109127] [DEBUG] [LOCAL ] RLI: Primary data saved (33549 records). [2025-09-25T21:00:48.109288] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-25T21:00:48.109419] [INFO ] [MAIN ] Update Progress: 1811/2372 symbols completed. RLI took 24.7s. Estimated remaining: 1h 14m 35s. Rate: 7.5 symbols/min [2025-09-25T21:00:48.294007] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:48.315791] [DEBUG] [LOCAL ] RLTY: Loaded 11089 existing records from primary storage. [2025-09-25T21:00:48.315950] [INFO ] [MAIN ] RLTY: Loaded 11089 existing records. [2025-09-25T21:00:48.505371] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:48.505816] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-25T21:00:48.505874] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-25T21:00:48.506202] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-25T21:00:48.506320] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-25T21:00:48.688735] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-25T21:00:48.895548] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:49.063321] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T21:00:49.079037] [INFO ] [REMOTE ] RKT: Full fetch complete (77356 records). [2025-09-25T21:00:49.079242] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-25T21:00:49.497727] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-25T21:00:49.528720] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-25T21:00:49.528820] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-25T21:00:49.532350] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-25T21:00:49.532921] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-25T21:00:49.536582] [DEBUG] [LOCAL ] RKT: Trimmed 77356 records to 54111 (keeping 200 days of data) [2025-09-25T21:00:49.697353] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T21:00:49.992625] [DEBUG] [LOCAL ] RKT: Primary data saved (54111 records). [2025-09-25T21:00:49.992900] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-25T21:00:49.993109] [INFO ] [MAIN ] Update Progress: 1812/2372 symbols completed. RKT took 33.8s. Estimated remaining: 1h 14m 25s. Rate: 7.5 symbols/min [2025-09-25T21:00:50.179563] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:50.236768] [DEBUG] [LOCAL ] RLX: Loaded 48255 existing records from primary storage. [2025-09-25T21:00:50.237018] [INFO ] [MAIN ] RLX: Loaded 48255 existing records. [2025-09-25T21:00:50.290735] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-25T21:00:50.479722] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:50.480159] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-25T21:00:50.480211] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-25T21:00:50.480556] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-25T21:00:50.481195] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-25T21:00:50.626814] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T21:00:50.702249] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T21:00:50.940729] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:51.088691] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-25T21:00:51.688202] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T21:00:51.888712] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-25T21:00:52.454902] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T21:00:52.688706] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-25T21:00:52.850040] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-25T21:00:53.488713] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-25T21:00:54.288743] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-25T21:00:54.352937] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T21:00:54.506365] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T21:00:55.088782] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-25T21:00:55.888752] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-25T21:00:55.933272] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T21:00:55.941955] [INFO ] [REMOTE ] RL: Full fetch complete (59910 records). [2025-09-25T21:00:55.942134] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-25T21:00:56.049770] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T21:00:56.385167] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-25T21:00:56.385294] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-25T21:00:56.386351] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-25T21:00:56.386425] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-25T21:00:56.388343] [DEBUG] [LOCAL ] RL: Trimmed 59910 records to 41765 (keeping 200 days of data) [2025-09-25T21:00:56.706523] [DEBUG] [LOCAL ] RL: Primary data saved (41765 records). [2025-09-25T21:00:56.706772] [INFO ] [MAIN ] RL: Full history saved. [2025-09-25T21:00:56.706957] [INFO ] [MAIN ] Update Progress: 1813/2372 symbols completed. RL took 34.1s. Estimated remaining: 1h 14m 16s. Rate: 7.5 symbols/min [2025-09-25T21:00:56.688778] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-25T21:00:56.908048] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:00:56.927247] [DEBUG] [LOCAL ] RM: Loaded 7664 existing records from primary storage. [2025-09-25T21:00:56.927398] [INFO ] [MAIN ] RM: Loaded 7664 existing records. [2025-09-25T21:00:57.127438] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:00:57.128839] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-25T21:00:57.128904] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-25T21:00:57.129144] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-25T21:00:57.129285] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-25T21:00:57.498750] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-25T21:00:57.665438] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:00:57.724285] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T21:00:57.753253] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T21:00:58.288776] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-25T21:00:59.088709] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-25T21:00:59.409133] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T21:00:59.888701] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-25T21:00:59.915874] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-25T21:01:00.164315] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T21:01:00.688795] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-25T21:01:01.488774] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-25T21:01:01.555481] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:01:01.599182] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T21:01:02.288726] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-25T21:01:02.358701] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T21:01:03.088755] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-25T21:01:03.888742] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-25T21:01:04.099298] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T21:01:04.688706] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-25T21:01:04.742452] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T21:01:04.860341] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T21:01:05.488750] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-25T21:01:05.524355] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:01:06.288737] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-25T21:01:07.088707] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-25T21:01:07.260378] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T21:01:07.808828] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T21:01:07.888707] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-25T21:01:08.238249] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T21:01:08.688723] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-25T21:01:08.752347] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T21:01:09.488778] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-25T21:01:10.288778] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-25T21:01:10.351438] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T21:01:10.937480] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T21:01:11.088701] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-25T21:01:11.156814] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T21:01:11.888714] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-25T21:01:12.688775] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-25T21:01:12.743620] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:01:12.747190] [INFO ] [REMOTE ] RLTY: Full fetch complete (18162 records). [2025-09-25T21:01:12.747439] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-25T21:01:12.880907] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T21:01:13.194675] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-25T21:01:13.194840] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-25T21:01:13.195350] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-25T21:01:13.195405] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-25T21:01:13.196095] [DEBUG] [LOCAL ] RLTY: Trimmed 18162 records to 11174 (keeping 200 days of data) [2025-09-25T21:01:13.272376] [DEBUG] [LOCAL ] RLTY: Primary data saved (11174 records). [2025-09-25T21:01:13.272543] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-25T21:01:13.272688] [INFO ] [MAIN ] Update Progress: 1814/2372 symbols completed. RLTY took 25.2s. Estimated remaining: 1h 14m 11s. Rate: 7.5 symbols/min [2025-09-25T21:01:13.315736] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T21:01:13.469418] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:13.491716] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-25T21:01:13.504267] [DEBUG] [LOCAL ] RMAX: Loaded 21865 existing records from primary storage. [2025-09-25T21:01:13.504421] [INFO ] [MAIN ] RMAX: Loaded 21865 existing records. [2025-09-25T21:01:13.721249] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:13.721517] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-25T21:01:13.721589] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-25T21:01:13.721955] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-25T21:01:13.722017] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-25T21:01:14.121090] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:14.288727] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-25T21:01:14.324868] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-25T21:01:15.088731] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-25T21:01:15.406265] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T21:01:15.888742] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-25T21:01:16.688780] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-25T21:01:16.825391] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T21:01:16.837941] [INFO ] [REMOTE ] RLJ: Full fetch complete (69208 records). [2025-09-25T21:01:16.838143] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-25T21:01:17.208343] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-25T21:01:17.266224] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-25T21:01:17.266371] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-25T21:01:17.267541] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-25T21:01:17.267636] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-25T21:01:17.269321] [DEBUG] [LOCAL ] RLJ: Trimmed 69208 records to 48574 (keeping 200 days of data) [2025-09-25T21:01:17.303224] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T21:01:17.519247] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-25T21:01:17.618434] [DEBUG] [LOCAL ] RLJ: Primary data saved (48574 records). [2025-09-25T21:01:17.618607] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-25T21:01:17.619633] [INFO ] [MAIN ] Update Progress: 1815/2372 symbols completed. RLJ took 32.4s. Estimated remaining: 1h 14m 2s. Rate: 7.5 symbols/min [2025-09-25T21:01:17.805052] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:17.859100] [DEBUG] [LOCAL ] RMD: Loaded 42266 existing records from primary storage. [2025-09-25T21:01:17.859273] [INFO ] [MAIN ] RMD: Loaded 42266 existing records. [2025-09-25T21:01:18.046363] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:18.046622] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-25T21:01:18.046782] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-25T21:01:18.047131] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-25T21:01:18.047190] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-25T21:01:18.294001] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-25T21:01:18.511205] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:19.088690] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-25T21:01:19.276986] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T21:01:19.463270] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T21:01:19.888737] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-25T21:01:20.694309] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-25T21:01:20.715129] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T21:01:21.488708] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-25T21:01:21.941552] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T21:01:21.968329] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T21:01:22.288727] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-25T21:01:23.088734] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-25T21:01:23.357726] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T21:01:23.888691] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-25T21:01:24.226012] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T21:01:24.291626] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T21:01:24.664451] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T21:01:24.688750] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-25T21:01:25.488754] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-25T21:01:25.808568] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T21:01:26.288719] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-25T21:01:26.324918] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T21:01:27.088743] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-25T21:01:27.376851] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T21:01:27.888702] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-25T21:01:27.898493] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:01:27.900935] [INFO ] [REMOTE ] RM: Full fetch complete (11551 records). [2025-09-25T21:01:27.901101] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-25T21:01:28.347346] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-25T21:01:28.347445] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-25T21:01:28.347795] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-25T21:01:28.347859] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-25T21:01:28.348394] [DEBUG] [LOCAL ] RM: Trimmed 11551 records to 7695 (keeping 200 days of data) [2025-09-25T21:01:28.410269] [DEBUG] [LOCAL ] RM: Primary data saved (7695 records). [2025-09-25T21:01:28.410425] [INFO ] [MAIN ] RM: Full history saved. [2025-09-25T21:01:28.410545] [INFO ] [MAIN ] Update Progress: 1816/2372 symbols completed. RM took 31.7s. Estimated remaining: 1h 13m 55s. Rate: 7.5 symbols/min [2025-09-25T21:01:28.595167] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:28.606315] [DEBUG] [LOCAL ] RMI: Loaded 4690 existing records from primary storage. [2025-09-25T21:01:28.606467] [INFO ] [MAIN ] RMI: Loaded 4690 existing records. [2025-09-25T21:01:28.694746] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-25T21:01:28.822201] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:28.822471] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-25T21:01:28.822540] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-25T21:01:28.822919] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-25T21:01:28.822983] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-25T21:01:29.192974] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T21:01:29.301427] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:29.488763] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-25T21:01:30.288695] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-25T21:01:30.458347] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T21:01:30.692469] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T21:01:31.088757] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-25T21:01:31.888751] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-25T21:01:31.999326] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T21:01:32.015002] [INFO ] [REMOTE ] RLX: Full fetch complete (70346 records). [2025-09-25T21:01:32.015194] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-25T21:01:32.417161] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-25T21:01:32.417275] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-25T21:01:32.418915] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-25T21:01:32.418984] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-25T21:01:32.420844] [DEBUG] [LOCAL ] RLX: Trimmed 70346 records to 48602 (keeping 200 days of data) [2025-09-25T21:01:32.704990] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-25T21:01:32.812441] [DEBUG] [LOCAL ] RLX: Primary data saved (48602 records). [2025-09-25T21:01:32.812784] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-25T21:01:32.812922] [INFO ] [MAIN ] Update Progress: 1817/2372 symbols completed. RLX took 42.8s. Estimated remaining: 1h 13m 46s. Rate: 7.5 symbols/min [2025-09-25T21:01:32.940752] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T21:01:33.053919] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:33.070736] [DEBUG] [LOCAL ] RMM: Loaded 10443 existing records from primary storage. [2025-09-25T21:01:33.070921] [INFO ] [MAIN ] RMM: Loaded 10443 existing records. [2025-09-25T21:01:33.271035] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:33.280107] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-25T21:01:33.280162] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-25T21:01:33.280407] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-25T21:01:33.280468] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-25T21:01:33.331528] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T21:01:33.496362] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-25T21:01:33.619418] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T21:01:33.703148] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:34.288754] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-25T21:01:34.906784] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T21:01:34.913787] [INFO ] [REMOTE ] RMAX: Full fetch complete (29682 records). [2025-09-25T21:01:34.913962] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-25T21:01:35.091307] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-25T21:01:35.233329] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T21:01:35.343111] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-25T21:01:35.343220] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-25T21:01:35.344243] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-25T21:01:35.344313] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-25T21:01:35.345526] [DEBUG] [LOCAL ] RMAX: Trimmed 29682 records to 21993 (keeping 200 days of data) [2025-09-25T21:01:35.483136] [DEBUG] [LOCAL ] RMAX: Primary data saved (21993 records). [2025-09-25T21:01:35.483327] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-25T21:01:35.483460] [INFO ] [MAIN ] Update Progress: 1818/2372 symbols completed. RMAX took 22.2s. Estimated remaining: 1h 13m 36s. Rate: 7.5 symbols/min [2025-09-25T21:01:35.659861] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:35.670160] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T21:01:35.675628] [DEBUG] [LOCAL ] RMMZ: Loaded 4845 existing records from primary storage. [2025-09-25T21:01:35.675800] [INFO ] [MAIN ] RMMZ: Loaded 4845 existing records. [2025-09-25T21:01:35.855293] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:35.856296] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-25T21:01:35.856400] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-25T21:01:35.856817] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-25T21:01:35.856883] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-25T21:01:35.894729] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-25T21:01:36.248502] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:36.688756] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-25T21:01:36.706271] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T21:01:37.488820] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-25T21:01:37.587564] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T21:01:38.288841] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-25T21:01:39.088866] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-25T21:01:39.131759] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:01:39.539898] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T21:01:39.545312] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T21:01:39.888784] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-25T21:01:40.688771] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-25T21:01:40.715251] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:01:41.213716] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T21:01:41.488755] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-25T21:01:42.288851] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-25T21:01:42.894086] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-25T21:01:43.088767] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-25T21:01:43.184618] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:01:43.888755] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-25T21:01:43.961925] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-25T21:01:44.688794] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-25T21:01:45.424310] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T21:01:45.451139] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T21:01:45.488714] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-25T21:01:46.288838] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-25T21:01:46.922660] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:01:47.088826] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-25T21:01:47.237444] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:01:47.463956] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-25T21:01:47.888751] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-25T21:01:48.657811] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T21:01:48.688725] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-25T21:01:49.488770] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-25T21:01:49.529849] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:01:50.288757] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-25T21:01:51.088699] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-25T21:01:51.199557] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T21:01:51.256115] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T21:01:51.775051] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-25T21:01:51.888765] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-25T21:01:52.688739] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-25T21:01:53.202624] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T21:01:53.488739] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-25T21:01:53.622049] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T21:01:53.632815] [INFO ] [REMOTE ] RMD: Full fetch complete (61018 records). [2025-09-25T21:01:53.633026] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-25T21:01:54.083107] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-25T21:01:54.083254] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-25T21:01:54.084471] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-25T21:01:54.084588] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-25T21:01:54.086197] [DEBUG] [LOCAL ] RMD: Trimmed 61018 records to 42571 (keeping 200 days of data) [2025-09-25T21:01:54.177828] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-25T21:01:54.308740] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-25T21:01:54.433295] [DEBUG] [LOCAL ] RMD: Primary data saved (42571 records). [2025-09-25T21:01:54.433451] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-25T21:01:54.434889] [INFO ] [MAIN ] Update Progress: 1819/2372 symbols completed. RMD took 36.8s. Estimated remaining: 1h 13m 32s. Rate: 7.5 symbols/min [2025-09-25T21:01:54.625106] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:54.652129] [DEBUG] [LOCAL ] RMT: Loaded 17504 existing records from primary storage. [2025-09-25T21:01:54.652270] [INFO ] [MAIN ] RMT: Loaded 17504 existing records. [2025-09-25T21:01:54.836730] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:54.837103] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-25T21:01:54.837172] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-25T21:01:54.838121] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-25T21:01:54.838210] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-25T21:01:55.093908] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-25T21:01:55.238247] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:55.251708] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T21:01:55.810319] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T21:01:55.888731] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-25T21:01:56.688765] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-25T21:01:56.847552] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-25T21:01:56.850806] [INFO ] [REMOTE ] RMM: Full fetch complete (14952 records). [2025-09-25T21:01:56.850901] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-25T21:01:57.115203] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T21:01:57.241521] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-25T21:01:57.241613] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-25T21:01:57.241972] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-25T21:01:57.244733] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-25T21:01:57.245389] [DEBUG] [LOCAL ] RMM: Trimmed 14952 records to 10537 (keeping 200 days of data) [2025-09-25T21:01:57.323442] [DEBUG] [LOCAL ] RMM: Primary data saved (10537 records). [2025-09-25T21:01:57.323605] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-25T21:01:57.323755] [INFO ] [MAIN ] Update Progress: 1820/2372 symbols completed. RMM took 24.5s. Estimated remaining: 1h 13m 22s. Rate: 7.5 symbols/min [2025-09-25T21:01:57.489392] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-25T21:01:57.512919] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:01:57.591769] [DEBUG] [LOCAL ] RNG: Loaded 48144 existing records from primary storage. [2025-09-25T21:01:57.591940] [INFO ] [MAIN ] RNG: Loaded 48144 existing records. [2025-09-25T21:01:57.791333] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:01:57.792808] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-25T21:01:57.792862] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-25T21:01:57.793140] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-25T21:01:57.793201] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-25T21:01:58.191213] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:01:58.288693] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-25T21:01:58.579498] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T21:01:59.088728] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-25T21:01:59.888748] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-25T21:01:59.987036] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:02:00.018244] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-25T21:02:00.690847] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-25T21:02:00.693072] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T21:02:01.488732] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-25T21:02:02.288738] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-25T21:02:02.336755] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T21:02:02.396556] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:02:02.698236] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-25T21:02:03.088729] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-25T21:02:03.888733] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-25T21:02:04.226075] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T21:02:04.564773] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-25T21:02:04.571684] [INFO ] [REMOTE ] RMI: Full fetch complete (6347 records). [2025-09-25T21:02:04.572069] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-25T21:02:04.693824] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-25T21:02:04.963921] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-25T21:02:04.964014] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-25T21:02:04.964192] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-25T21:02:04.964230] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-25T21:02:04.964636] [DEBUG] [LOCAL ] RMI: Trimmed 6347 records to 4702 (keeping 200 days of data) [2025-09-25T21:02:05.000616] [DEBUG] [LOCAL ] RMI: Primary data saved (4702 records). [2025-09-25T21:02:05.000790] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-25T21:02:05.000960] [INFO ] [MAIN ] Update Progress: 1821/2372 symbols completed. RMI took 36.6s. Estimated remaining: 1h 13m 14s. Rate: 7.5 symbols/min [2025-09-25T21:02:05.176412] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:05.222029] [DEBUG] [LOCAL ] RNGR: Loaded 20444 existing records from primary storage. [2025-09-25T21:02:05.222213] [INFO ] [MAIN ] RNGR: Loaded 20444 existing records. [2025-09-25T21:02:05.410821] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:05.411531] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-25T21:02:05.411585] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-25T21:02:05.412054] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-25T21:02:05.412134] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-25T21:02:05.490066] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-25T21:02:05.806581] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:05.862116] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T21:02:06.197496] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T21:02:06.288726] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-25T21:02:07.088760] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-25T21:02:07.439978] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T21:02:07.888740] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-25T21:02:08.197685] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T21:02:08.688754] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-25T21:02:09.488800] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-25T21:02:09.693249] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:02:09.762808] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T21:02:10.288803] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-25T21:02:10.613124] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T21:02:11.088760] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-25T21:02:11.501201] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T21:02:11.637587] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T21:02:11.888805] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-25T21:02:12.688806] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-25T21:02:12.829514] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-25T21:02:13.488820] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-25T21:02:13.802381] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T21:02:13.958959] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T21:02:13.960938] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7140 records). [2025-09-25T21:02:13.961074] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-25T21:02:14.297861] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-25T21:02:14.397614] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-25T21:02:14.397741] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-25T21:02:14.397999] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-25T21:02:14.398119] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-25T21:02:14.399221] [DEBUG] [LOCAL ] RMMZ: Trimmed 7140 records to 4858 (keeping 200 days of data) [2025-09-25T21:02:14.439810] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4858 records). [2025-09-25T21:02:14.439987] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-25T21:02:14.440308] [INFO ] [MAIN ] Update Progress: 1822/2372 symbols completed. RMMZ took 39.0s. Estimated remaining: 1h 13m 7s. Rate: 7.5 symbols/min [2025-09-25T21:02:14.654004] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:14.687549] [DEBUG] [LOCAL ] RNP: Loaded 15782 existing records from primary storage. [2025-09-25T21:02:14.687723] [INFO ] [MAIN ] RNP: Loaded 15782 existing records. [2025-09-25T21:02:14.876627] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:14.876925] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-25T21:02:14.876983] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-25T21:02:14.877395] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-25T21:02:14.877465] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-25T21:02:15.089598] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-25T21:02:15.271738] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:15.888699] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-25T21:02:16.086701] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T21:02:16.125102] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T21:02:16.129592] [INFO ] [REMOTE ] RMT: Full fetch complete (25536 records). [2025-09-25T21:02:16.132725] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-25T21:02:16.520796] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-25T21:02:16.520891] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-25T21:02:16.521538] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-25T21:02:16.521584] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-25T21:02:16.522627] [DEBUG] [LOCAL ] RMT: Trimmed 25536 records to 17611 (keeping 200 days of data) [2025-09-25T21:02:16.667858] [DEBUG] [LOCAL ] RMT: Primary data saved (17611 records). [2025-09-25T21:02:16.668018] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-25T21:02:16.668181] [INFO ] [MAIN ] Update Progress: 1823/2372 symbols completed. RMT took 22.2s. Estimated remaining: 1h 12m 57s. Rate: 7.5 symbols/min [2025-09-25T21:02:16.693785] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-25T21:02:16.908545] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:16.954830] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T21:02:16.987245] [DEBUG] [LOCAL ] RNR: Loaded 34254 existing records from primary storage. [2025-09-25T21:02:16.987415] [INFO ] [MAIN ] RNR: Loaded 34254 existing records. [2025-09-25T21:02:17.180943] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:17.181438] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-25T21:02:17.181494] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-25T21:02:17.181762] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-25T21:02:17.181830] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-25T21:02:17.493796] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-25T21:02:17.561218] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:17.779064] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T21:02:18.289223] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-25T21:02:19.088758] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-25T21:02:19.266746] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T21:02:19.888763] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-25T21:02:20.076336] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T21:02:20.225795] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T21:02:20.679393] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T21:02:20.688672] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-25T21:02:21.488740] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-25T21:02:21.975896] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:02:22.288748] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-25T21:02:23.088731] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-25T21:02:23.164033] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T21:02:23.796556] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T21:02:23.888746] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-25T21:02:24.049046] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T21:02:24.688720] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-25T21:02:25.335165] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:02:25.488734] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-25T21:02:25.915515] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T21:02:26.288742] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-25T21:02:26.900893] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T21:02:27.088713] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-25T21:02:27.348982] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T21:02:27.888706] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-25T21:02:28.081149] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T21:02:28.688737] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-25T21:02:29.488749] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-25T21:02:29.533639] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:02:29.790553] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T21:02:30.288712] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-25T21:02:30.571083] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T21:02:30.588253] [INFO ] [REMOTE ] RNGR: Full fetch complete (28366 records). [2025-09-25T21:02:30.588412] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-25T21:02:31.023063] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-25T21:02:31.023165] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-25T21:02:31.023850] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-25T21:02:31.023918] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-25T21:02:31.024853] [DEBUG] [LOCAL ] RNGR: Trimmed 28366 records to 20559 (keeping 200 days of data) [2025-09-25T21:02:31.096739] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-25T21:02:31.185478] [DEBUG] [LOCAL ] RNGR: Primary data saved (20559 records). [2025-09-25T21:02:31.185662] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-25T21:02:31.185827] [INFO ] [MAIN ] Update Progress: 1824/2372 symbols completed. RNGR took 26.2s. Estimated remaining: 1h 12m 51s. Rate: 7.5 symbols/min [2025-09-25T21:02:31.382304] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:31.449833] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T21:02:31.473894] [DEBUG] [LOCAL ] RNST: Loaded 37138 existing records from primary storage. [2025-09-25T21:02:31.474057] [INFO ] [MAIN ] RNST: Loaded 37138 existing records. [2025-09-25T21:02:31.688086] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:31.688345] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-25T21:02:31.688419] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-25T21:02:31.688910] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-25T21:02:31.688985] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-25T21:02:31.899777] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-25T21:02:32.088442] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:32.407695] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T21:02:32.688736] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-25T21:02:33.488707] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-25T21:02:33.533055] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T21:02:33.579213] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T21:02:34.288764] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-25T21:02:34.915792] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T21:02:35.088741] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-25T21:02:35.339509] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T21:02:35.888741] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-25T21:02:36.538567] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T21:02:36.688737] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-25T21:02:37.418039] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T21:02:37.488687] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-25T21:02:37.591062] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T21:02:38.288687] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-25T21:02:38.660963] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T21:02:39.088731] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-25T21:02:39.735077] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T21:02:39.888750] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-25T21:02:40.688727] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-25T21:02:40.837439] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:02:40.853251] [INFO ] [REMOTE ] RNG: Full fetch complete (69493 records). [2025-09-25T21:02:40.853442] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-25T21:02:41.370461] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-25T21:02:41.370564] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-25T21:02:41.371897] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-25T21:02:41.371976] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-25T21:02:41.373581] [DEBUG] [LOCAL ] RNG: Trimmed 69493 records to 48491 (keeping 200 days of data) [2025-09-25T21:02:41.513981] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-25T21:02:41.518433] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T21:02:41.533182] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:02:41.781980] [DEBUG] [LOCAL ] RNG: Primary data saved (48491 records). [2025-09-25T21:02:41.782150] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-25T21:02:41.782267] [INFO ] [MAIN ] Update Progress: 1825/2372 symbols completed. RNG took 44.5s. Estimated remaining: 1h 12m 44s. Rate: 7.5 symbols/min [2025-09-25T21:02:41.975458] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:42.011606] [DEBUG] [LOCAL ] ROG: Loaded 23151 existing records from primary storage. [2025-09-25T21:02:42.011780] [INFO ] [MAIN ] ROG: Loaded 23151 existing records. [2025-09-25T21:02:42.208238] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:42.210458] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-25T21:02:42.210515] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-25T21:02:42.210829] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-25T21:02:42.210893] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-25T21:02:42.292481] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-25T21:02:42.611169] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:43.088740] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-25T21:02:43.249188] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T21:02:43.872920] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T21:02:43.891117] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-25T21:02:43.895456] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:02:43.899897] [INFO ] [REMOTE ] RNP: Full fetch complete (23360 records). [2025-09-25T21:02:43.900003] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-25T21:02:44.352101] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-25T21:02:44.352506] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-25T21:02:44.353384] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-25T21:02:44.353513] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-25T21:02:44.364717] [DEBUG] [LOCAL ] RNP: Trimmed 23360 records to 15850 (keeping 200 days of data) [2025-09-25T21:02:44.510027] [DEBUG] [LOCAL ] RNP: Primary data saved (15850 records). [2025-09-25T21:02:44.510217] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-25T21:02:44.510342] [INFO ] [MAIN ] Update Progress: 1826/2372 symbols completed. RNP took 30.1s. Estimated remaining: 1h 12m 34s. Rate: 7.5 symbols/min [2025-09-25T21:02:44.693866] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-25T21:02:44.791914] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:44.871924] [DEBUG] [LOCAL ] ROK: Loaded 43954 existing records from primary storage. [2025-09-25T21:02:44.872124] [INFO ] [MAIN ] ROK: Loaded 43954 existing records. [2025-09-25T21:02:45.157574] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:45.157964] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-25T21:02:45.158038] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-25T21:02:45.158514] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-25T21:02:45.158609] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-25T21:02:45.211794] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-25T21:02:45.494094] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-25T21:02:45.710042] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:46.288716] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-25T21:02:46.399012] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T21:02:46.499194] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T21:02:46.511288] [INFO ] [REMOTE ] RNR: Full fetch complete (51170 records). [2025-09-25T21:02:46.511420] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-25T21:02:46.946308] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-25T21:02:46.946421] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-25T21:02:46.947441] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-25T21:02:46.947526] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-25T21:02:46.951178] [DEBUG] [LOCAL ] RNR: Trimmed 51170 records to 34424 (keeping 200 days of data) [2025-09-25T21:02:47.101763] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-25T21:02:47.212836] [DEBUG] [LOCAL ] RNR: Primary data saved (34424 records). [2025-09-25T21:02:47.213003] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-25T21:02:47.214602] [INFO ] [MAIN ] Update Progress: 1827/2372 symbols completed. RNR took 30.5s. Estimated remaining: 1h 12m 25s. Rate: 7.5 symbols/min [2025-09-25T21:02:47.399049] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:47.471470] [DEBUG] [LOCAL ] ROL: Loaded 50266 existing records from primary storage. [2025-09-25T21:02:47.471676] [INFO ] [MAIN ] ROL: Loaded 50266 existing records. [2025-09-25T21:02:47.690142] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:47.691194] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-25T21:02:47.691248] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-25T21:02:47.691494] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-25T21:02:47.691553] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-25T21:02:47.893006] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-25T21:02:48.092953] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:02:48.183048] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:48.204560] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:02:48.688770] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-25T21:02:49.479518] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T21:02:49.491177] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-25T21:02:49.860048] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T21:02:50.288743] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-25T21:02:50.975664] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:02:51.088715] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-25T21:02:51.396440] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T21:02:51.888721] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-25T21:02:52.602169] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T21:02:52.688731] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-25T21:02:52.777802] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T21:02:53.488800] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-25T21:02:54.135829] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T21:02:54.288849] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-25T21:02:55.088753] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-25T21:02:55.226426] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:02:55.838429] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T21:02:55.845395] [INFO ] [REMOTE ] RNST: Full fetch complete (52952 records). [2025-09-25T21:02:55.845569] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-25T21:02:55.897802] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-25T21:02:56.317671] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-25T21:02:56.317790] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-25T21:02:56.318830] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-25T21:02:56.318897] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-25T21:02:56.320434] [DEBUG] [LOCAL ] RNST: Trimmed 52952 records to 37407 (keeping 200 days of data) [2025-09-25T21:02:56.591611] [DEBUG] [LOCAL ] RNST: Primary data saved (37407 records). [2025-09-25T21:02:56.591841] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-25T21:02:56.592082] [INFO ] [MAIN ] Update Progress: 1828/2372 symbols completed. RNST took 25.4s. Estimated remaining: 1h 12m 17s. Rate: 7.5 symbols/min [2025-09-25T21:02:56.693927] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-25T21:02:56.828523] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:02:56.846737] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:02:56.909585] [DEBUG] [LOCAL ] RPM: Loaded 41115 existing records from primary storage. [2025-09-25T21:02:56.909794] [INFO ] [MAIN ] RPM: Loaded 41115 existing records. [2025-09-25T21:02:57.133107] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:02:57.135028] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-25T21:02:57.137745] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-25T21:02:57.138040] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-25T21:02:57.138116] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-25T21:02:57.394403] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:02:57.497919] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-25T21:02:57.601213] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:02:58.288704] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-25T21:02:58.495452] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T21:02:59.088776] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-25T21:02:59.248088] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T21:02:59.319977] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T21:02:59.888755] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-25T21:03:00.638767] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:03:00.688739] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-25T21:03:01.488701] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-25T21:03:01.801910] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:03:01.859989] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T21:03:02.288754] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-25T21:03:03.088741] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-25T21:03:03.204979] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T21:03:03.888736] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-25T21:03:04.048781] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T21:03:04.688749] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-25T21:03:05.060342] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T21:03:05.151898] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T21:03:05.488716] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-25T21:03:05.585695] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T21:03:06.288729] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-25T21:03:07.088779] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-25T21:03:07.397156] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T21:03:07.502114] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:03:07.888743] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-25T21:03:08.688710] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-25T21:03:08.798229] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T21:03:09.488706] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-25T21:03:09.607887] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T21:03:09.824433] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T21:03:09.828597] [INFO ] [REMOTE ] ROG: Full fetch complete (30685 records). [2025-09-25T21:03:09.828732] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-25T21:03:10.254600] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-25T21:03:10.254716] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-25T21:03:10.255419] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-25T21:03:10.255461] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-25T21:03:10.256377] [DEBUG] [LOCAL ] ROG: Trimmed 30685 records to 23271 (keeping 200 days of data) [2025-09-25T21:03:10.306587] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-25T21:03:10.405184] [DEBUG] [LOCAL ] ROG: Primary data saved (23271 records). [2025-09-25T21:03:10.405348] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-25T21:03:10.405471] [INFO ] [MAIN ] Update Progress: 1829/2372 symbols completed. ROG took 28.6s. Estimated remaining: 1h 12m 11s. Rate: 7.5 symbols/min [2025-09-25T21:03:10.591245] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:10.617926] [DEBUG] [LOCAL ] RPT: Loaded 19599 existing records from primary storage. [2025-09-25T21:03:10.618079] [INFO ] [MAIN ] RPT: Loaded 19599 existing records. [2025-09-25T21:03:10.804830] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:03:10.807565] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-25T21:03:10.807613] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-25T21:03:10.807870] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-25T21:03:10.807929] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-25T21:03:11.093980] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-25T21:03:11.214999] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:11.243140] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T21:03:11.888748] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-25T21:03:12.268902] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T21:03:12.688763] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-25T21:03:12.921021] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:03:13.488802] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-25T21:03:13.630828] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:03:14.288785] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-25T21:03:14.460268] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T21:03:14.551470] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T21:03:15.088735] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-25T21:03:15.777238] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T21:03:15.888707] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-25T21:03:16.688692] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-25T21:03:16.982775] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-25T21:03:17.081114] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-25T21:03:17.488754] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-25T21:03:18.288760] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-25T21:03:18.381256] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:03:18.394266] [INFO ] [REMOTE ] ROK: Full fetch complete (63421 records). [2025-09-25T21:03:18.394537] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-25T21:03:18.582276] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T21:03:18.820063] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-25T21:03:18.820179] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-25T21:03:18.821829] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-25T21:03:18.821898] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-25T21:03:18.823593] [DEBUG] [LOCAL ] ROK: Trimmed 63421 records to 44258 (keeping 200 days of data) [2025-09-25T21:03:19.088709] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-25T21:03:19.144099] [DEBUG] [LOCAL ] ROK: Primary data saved (44258 records). [2025-09-25T21:03:19.144268] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-25T21:03:19.144399] [INFO ] [MAIN ] Update Progress: 1830/2372 symbols completed. ROK took 34.6s. Estimated remaining: 1h 12m 3s. Rate: 7.5 symbols/min [2025-09-25T21:03:19.326360] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:19.364238] [DEBUG] [LOCAL ] RQI: Loaded 29112 existing records from primary storage. [2025-09-25T21:03:19.364443] [INFO ] [MAIN ] RQI: Loaded 29112 existing records. [2025-09-25T21:03:19.554728] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:03:19.555061] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-25T21:03:19.555114] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-25T21:03:19.555466] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-25T21:03:19.555608] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-25T21:03:19.929368] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:19.923814] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-25T21:03:19.973549] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T21:03:20.282242] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T21:03:20.688744] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-25T21:03:21.488805] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-25T21:03:21.580527] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T21:03:22.288764] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-25T21:03:22.552126] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T21:03:22.629059] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T21:03:23.088753] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-25T21:03:23.888888] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-25T21:03:24.105388] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T21:03:24.143528] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T21:03:24.688747] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-25T21:03:25.413909] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T21:03:25.488767] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-25T21:03:25.915802] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T21:03:26.288872] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-25T21:03:27.088703] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-25T21:03:27.281181] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T21:03:27.293753] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:03:27.888760] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-25T21:03:28.101749] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T21:03:28.688779] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-25T21:03:29.488727] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-25T21:03:29.599929] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T21:03:30.063584] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T21:03:30.288718] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-25T21:03:30.624694] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T21:03:31.088744] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-25T21:03:31.553572] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:03:31.888697] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-25T21:03:32.110315] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T21:03:32.114172] [INFO ] [REMOTE ] RPT: Full fetch complete (28603 records). [2025-09-25T21:03:32.114403] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-25T21:03:32.553372] [DEBUG] [VALIDATOR ] RPT: All expected trading days are present. [2025-09-25T21:03:32.553478] [DEBUG] [VALIDATOR ] RPT: Primary data validation passed. [2025-09-25T21:03:32.554116] [INFO ] [MAIN ] RPT: Fetched primary data is valid. [2025-09-25T21:03:32.554229] [DEBUG] [LOCAL ] RPT: Saving primary data. [2025-09-25T21:03:32.555196] [DEBUG] [LOCAL ] RPT: Trimmed 28603 records to 19668 (keeping 200 days of data) [2025-09-25T21:03:32.689511] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-25T21:03:32.717575] [DEBUG] [LOCAL ] RPT: Primary data saved (19668 records). [2025-09-25T21:03:32.717860] [INFO ] [MAIN ] RPT: Full history saved. [2025-09-25T21:03:32.718080] [INFO ] [MAIN ] Update Progress: 1831/2372 symbols completed. RPT took 22.3s. Estimated remaining: 1h 11m 57s. Rate: 7.5 symbols/min [2025-09-25T21:03:32.927126] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:32.927366] [DEBUG] [LOCAL ] RRC: No existing data file found in primary storage. [2025-09-25T21:03:32.927413] [WARN ] [MAIN ] RRC: No existing data found, performing full refresh instead. [2025-09-25T21:03:32.927637] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-25T21:03:32.927735] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-25T21:03:32.927809] [DEBUG] [LOCAL ] RRC: No primary data file found to delete. [2025-09-25T21:03:32.927864] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-25T21:03:33.209459] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T21:03:33.395695] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:33.489801] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-25T21:03:34.288760] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-25T21:03:34.548723] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T21:03:34.561914] [INFO ] [REMOTE ] ROL: Full fetch complete (72635 records). [2025-09-25T21:03:34.562176] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-25T21:03:34.755807] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T21:03:35.044959] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-25T21:03:35.045156] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-25T21:03:35.046446] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-25T21:03:35.046514] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-25T21:03:35.049223] [DEBUG] [LOCAL ] ROL: Trimmed 72635 records to 50649 (keeping 200 days of data) [2025-09-25T21:03:35.124279] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-25T21:03:35.418331] [DEBUG] [LOCAL ] ROL: Primary data saved (50649 records). [2025-09-25T21:03:35.418543] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-25T21:03:35.419969] [INFO ] [MAIN ] Update Progress: 1832/2372 symbols completed. ROL took 48.2s. Estimated remaining: 1h 11m 47s. Rate: 7.5 symbols/min [2025-09-25T21:03:35.595299] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:35.663379] [DEBUG] [LOCAL ] RRX: Loaded 41153 existing records from primary storage. [2025-09-25T21:03:35.663592] [INFO ] [MAIN ] RRX: Loaded 41153 existing records. [2025-09-25T21:03:35.857902] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:03:35.858311] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-25T21:03:35.858380] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-25T21:03:35.858841] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-25T21:03:35.858924] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-25T21:03:35.891794] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-25T21:03:36.199018] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T21:03:36.366083] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:36.533323] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T21:03:36.688738] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-25T21:03:37.493959] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-25T21:03:37.516871] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T21:03:38.232920] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T21:03:38.288752] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-25T21:03:39.088693] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-25T21:03:39.370939] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T21:03:39.888699] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-25T21:03:39.930449] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T21:03:40.632925] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:03:40.640496] [INFO ] [REMOTE ] RPM: Full fetch complete (58802 records). [2025-09-25T21:03:40.640681] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-25T21:03:40.696730] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-25T21:03:41.103512] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-25T21:03:41.103749] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-25T21:03:41.104871] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-25T21:03:41.104940] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-25T21:03:41.106429] [DEBUG] [LOCAL ] RPM: Trimmed 58802 records to 41430 (keeping 200 days of data) [2025-09-25T21:03:41.407583] [DEBUG] [LOCAL ] RPM: Primary data saved (41430 records). [2025-09-25T21:03:41.407794] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-25T21:03:41.407995] [INFO ] [MAIN ] Update Progress: 1833/2372 symbols completed. RPM took 44.8s. Estimated remaining: 1h 11m 39s. Rate: 7.5 symbols/min [2025-09-25T21:03:41.496752] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-25T21:03:41.629181] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:41.675182] [DEBUG] [LOCAL ] RS: Loaded 25544 existing records from primary storage. [2025-09-25T21:03:41.675386] [INFO ] [MAIN ] RS: Loaded 25544 existing records. [2025-09-25T21:03:41.796143] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T21:03:41.928700] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:03:41.929176] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-25T21:03:41.929228] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-25T21:03:41.929554] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-25T21:03:41.929613] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-25T21:03:42.202194] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T21:03:42.293776] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-25T21:03:42.339626] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:43.022567] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T21:03:43.088686] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-25T21:03:43.718201] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T21:03:43.725472] [INFO ] [REMOTE ] RQI: Full fetch complete (43352 records). [2025-09-25T21:03:43.725712] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-25T21:03:43.902009] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-25T21:03:44.153115] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-25T21:03:44.153214] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-25T21:03:44.154083] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-25T21:03:44.154147] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-25T21:03:44.155869] [DEBUG] [LOCAL ] RQI: Trimmed 43352 records to 29374 (keeping 200 days of data) [2025-09-25T21:03:44.367240] [DEBUG] [LOCAL ] RQI: Primary data saved (29374 records). [2025-09-25T21:03:44.367411] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-25T21:03:44.367523] [INFO ] [MAIN ] Update Progress: 1834/2372 symbols completed. RQI took 25.2s. Estimated remaining: 1h 11m 29s. Rate: 7.5 symbols/min [2025-09-25T21:03:44.571461] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:03:44.579491] [DEBUG] [LOCAL ] RSF: Loaded 4135 existing records from primary storage. [2025-09-25T21:03:44.579603] [INFO ] [MAIN ] RSF: Loaded 4135 existing records. [2025-09-25T21:03:44.689624] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-25T21:03:44.816845] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T21:03:44.819984] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:03:44.820164] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-25T21:03:44.820207] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-25T21:03:44.820468] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-25T21:03:44.820527] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-25T21:03:45.189241] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:03:45.488721] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-25T21:03:45.792948] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T21:03:45.850471] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T21:03:46.288732] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-25T21:03:47.088738] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-25T21:03:47.224672] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T21:03:47.851911] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:03:47.888708] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-25T21:03:48.688700] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-25T21:03:49.030446] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T21:03:49.488719] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-25T21:03:49.608545] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T21:03:49.819873] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:03:50.018129] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-25T21:03:50.288713] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-25T21:03:51.088754] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-25T21:03:51.715923] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T21:03:51.836455] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:03:51.888737] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-25T21:03:52.688733] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-25T21:03:53.488685] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-25T21:03:53.529168] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T21:03:54.205842] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T21:03:54.288734] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-25T21:03:55.088712] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-25T21:03:55.362361] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T21:03:55.627274] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T21:03:55.888730] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-25T21:03:56.041454] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:03:56.688765] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-25T21:03:57.488751] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-25T21:03:57.702509] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T21:03:58.288695] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-25T21:03:58.456398] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T21:03:58.660283] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T21:03:59.088776] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-25T21:03:59.888750] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-25T21:04:00.155599] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T21:04:00.211813] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T21:04:00.688738] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-25T21:04:01.243714] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T21:04:01.488707] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-25T21:04:01.657376] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T21:04:01.669947] [INFO ] [REMOTE ] RRX: Full fetch complete (57989 records). [2025-09-25T21:04:01.670117] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-25T21:04:02.157698] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-25T21:04:02.157880] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-25T21:04:02.159763] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-25T21:04:02.159875] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-25T21:04:02.162326] [DEBUG] [LOCAL ] RRX: Trimmed 57989 records to 41433 (keeping 200 days of data) [2025-09-25T21:04:02.288784] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-25T21:04:02.497135] [DEBUG] [LOCAL ] RRX: Primary data saved (41433 records). [2025-09-25T21:04:02.497282] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-25T21:04:02.498314] [INFO ] [MAIN ] Update Progress: 1835/2372 symbols completed. RRX took 27.1s. Estimated remaining: 1h 11m 24s. Rate: 7.5 symbols/min [2025-09-25T21:04:02.681992] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:02.748101] [DEBUG] [LOCAL ] RSG: Loaded 47484 existing records from primary storage. [2025-09-25T21:04:02.748284] [INFO ] [MAIN ] RSG: Loaded 47484 existing records. [2025-09-25T21:04:02.958768] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:02.959056] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-25T21:04:02.959105] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-25T21:04:02.959492] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-25T21:04:02.959553] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-25T21:04:03.094050] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-25T21:04:03.252545] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:04:03.446278] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:03.696249] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T21:04:03.751630] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T21:04:03.888728] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-25T21:04:04.520077] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:04:04.688747] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-25T21:04:05.488743] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-25T21:04:06.288701] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-25T21:04:06.547150] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T21:04:06.560857] [INFO ] [REMOTE ] RRC: Full fetch complete (76305 records). [2025-09-25T21:04:06.561041] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-25T21:04:07.009519] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-25T21:04:07.009628] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-25T21:04:07.010980] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-25T21:04:07.011060] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-25T21:04:07.012751] [DEBUG] [LOCAL ] RRC: Trimmed 76305 records to 53166 (keeping 200 days of data) [2025-09-25T21:04:07.115277] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-25T21:04:07.356577] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:04:07.397488] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T21:04:07.533906] [DEBUG] [LOCAL ] RRC: Primary data saved (53166 records). [2025-09-25T21:04:07.534091] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-25T21:04:07.534198] [INFO ] [MAIN ] Update Progress: 1836/2372 symbols completed. RRC took 34.8s. Estimated remaining: 1h 11m 15s. Rate: 7.5 symbols/min [2025-09-25T21:04:07.706862] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:07.767737] [DEBUG] [LOCAL ] RSI: Loaded 47050 existing records from primary storage. [2025-09-25T21:04:07.767936] [INFO ] [MAIN ] RSI: Loaded 47050 existing records. [2025-09-25T21:04:07.895899] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-25T21:04:07.968978] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:07.969759] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-25T21:04:07.969821] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-25T21:04:07.970228] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-25T21:04:07.970289] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-25T21:04:08.059204] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T21:04:08.352539] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:08.688762] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-25T21:04:09.171297] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T21:04:09.176588] [INFO ] [REMOTE ] RS: Full fetch complete (39445 records). [2025-09-25T21:04:09.176879] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-25T21:04:09.494708] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-25T21:04:09.590735] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-25T21:04:09.590821] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-25T21:04:09.591633] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-25T21:04:09.591713] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-25T21:04:09.593750] [DEBUG] [LOCAL ] RS: Trimmed 39445 records to 25703 (keeping 200 days of data) [2025-09-25T21:04:09.776356] [DEBUG] [LOCAL ] RS: Primary data saved (25703 records). [2025-09-25T21:04:09.776497] [INFO ] [MAIN ] RS: Full history saved. [2025-09-25T21:04:09.776587] [INFO ] [MAIN ] Update Progress: 1837/2372 symbols completed. RS took 28.4s. Estimated remaining: 1h 11m 6s. Rate: 7.5 symbols/min [2025-09-25T21:04:10.187356] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-25T21:04:10.288747] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-25T21:04:10.520766] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T21:04:10.899750] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T21:04:11.088722] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-25T21:04:11.888740] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-25T21:04:12.688741] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-25T21:04:12.906021] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T21:04:13.230308] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T21:04:13.231628] [INFO ] [REMOTE ] RSF: Full fetch complete (5565 records). [2025-09-25T21:04:13.231757] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-25T21:04:13.497466] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-25T21:04:13.620153] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T21:04:13.701315] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-25T21:04:13.701415] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-25T21:04:13.701664] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-25T21:04:13.701745] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-25T21:04:13.702310] [DEBUG] [LOCAL ] RSF: Trimmed 5565 records to 4145 (keeping 200 days of data) [2025-09-25T21:04:13.734943] [DEBUG] [LOCAL ] RSF: Primary data saved (4145 records). [2025-09-25T21:04:13.735039] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-25T21:04:13.735139] [INFO ] [MAIN ] Update Progress: 1838/2372 symbols completed. RSF took 29.4s. Estimated remaining: 1h 10m 57s. Rate: 7.5 symbols/min [2025-09-25T21:04:14.288751] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-25T21:04:15.462754] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T21:04:15.477932] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-25T21:04:16.088220] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T21:04:16.101913] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-25T21:04:17.490566] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:04:17.505736] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-25T21:04:17.770627] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:04:17.782806] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-25T21:04:19.297833] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:04:19.308608] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-25T21:04:19.650403] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T21:04:19.667974] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-25T21:04:21.158737] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T21:04:21.169951] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-25T21:04:21.254048] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T21:04:21.267995] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-25T21:04:23.015588] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T21:04:23.025896] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-25T21:04:23.124859] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T21:04:23.137592] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-25T21:04:24.614576] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T21:04:24.627813] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-25T21:04:25.083087] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T21:04:25.100005] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-25T21:04:26.539368] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T21:04:26.553522] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-25T21:04:26.803227] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-25T21:04:26.813075] [INFO ] [REMOTE ] RSG: Full fetch complete (67993 records). [2025-09-25T21:04:26.813267] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-25T21:04:27.282554] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-25T21:04:27.282703] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-25T21:04:27.283810] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-25T21:04:27.283921] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-25T21:04:27.285383] [DEBUG] [LOCAL ] RSG: Trimmed 67993 records to 47849 (keeping 200 days of data) [2025-09-25T21:04:27.622090] [DEBUG] [LOCAL ] RSG: Primary data saved (47849 records). [2025-09-25T21:04:27.622255] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-25T21:04:27.623119] [INFO ] [MAIN ] Update Progress: 1839/2372 symbols completed. RSG took 25.1s. Estimated remaining: 1h 10m 50s. Rate: 7.5 symbols/min [2025-09-25T21:04:28.397066] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T21:04:28.410010] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-25T21:04:30.163687] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:04:30.175864] [INFO ] [REMOTE ] RSI: Full fetch complete (69440 records). [2025-09-25T21:04:30.176023] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-25T21:04:30.608904] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-25T21:04:30.609014] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-25T21:04:30.610102] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-25T21:04:30.610167] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-25T21:04:30.611806] [DEBUG] [LOCAL ] RSI: Trimmed 69440 records to 47388 (keeping 200 days of data) [2025-09-25T21:04:30.899150] [DEBUG] [LOCAL ] RSI: Primary data saved (47388 records). [2025-09-25T21:04:30.899317] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-25T21:04:30.899436] [INFO ] [MAIN ] Update Progress: 1840/2372 symbols completed. RSI took 23.4s. Estimated remaining: 1h 10m 41s. Rate: 7.5 symbols/min [2025-09-25T21:04:31.600116] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:31.605728] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:31.613859] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:31.762265] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:31.764924] [DEBUG] [LOCAL ] RVLV: Loaded 47826 existing records from primary storage. [2025-09-25T21:04:31.777069] [INFO ] [MAIN ] RVLV: Loaded 47826 existing records. [2025-09-25T21:04:31.873597] [DEBUG] [LOCAL ] RTX: Loaded 53709 existing records from primary storage. [2025-09-25T21:04:31.881941] [INFO ] [MAIN ] RTX: Loaded 53709 existing records. [2025-09-25T21:04:31.888084] [DEBUG] [LOCAL ] RTO: Loaded 40234 existing records from primary storage. [2025-09-25T21:04:31.888159] [INFO ] [MAIN ] RTO: Loaded 40234 existing records. [2025-09-25T21:04:32.087826] [DEBUG] [LOCAL ] RSKD: Loaded 33898 existing records from primary storage. [2025-09-25T21:04:32.088102] [INFO ] [MAIN ] RSKD: Loaded 33898 existing records. [2025-09-25T21:04:32.605486] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:32.605874] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-25T21:04:32.605951] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-25T21:04:32.606387] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-25T21:04:32.606478] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-25T21:04:32.931214] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:32.931567] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-25T21:04:32.950781] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-25T21:04:32.951279] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-25T21:04:32.951359] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-25T21:04:32.966354] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:32.966710] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-25T21:04:32.966770] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-25T21:04:32.982158] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-25T21:04:32.982273] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-25T21:04:33.118908] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:33.119225] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-25T21:04:33.119285] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-25T21:04:33.133710] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-25T21:04:33.203590] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-25T21:04:34.400915] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:34.404348] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-25T21:04:34.403974] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:34.441321] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-25T21:04:34.502672] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:34.503032] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-25T21:04:34.637929] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:34.638343] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-25T21:04:36.049917] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T21:04:36.057190] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-25T21:04:36.114974] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T21:04:36.126258] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-25T21:04:36.196920] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T21:04:36.205372] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-25T21:04:36.636871] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-25T21:04:36.647948] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-25T21:04:37.283357] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:04:37.290929] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-25T21:04:37.738197] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T21:04:37.747845] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-25T21:04:37.849082] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T21:04:37.861599] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-25T21:04:38.590264] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T21:04:38.600358] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-25T21:04:38.762215] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T21:04:38.774256] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-25T21:04:38.825229] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T21:04:38.835569] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-25T21:04:39.466073] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T21:04:39.478612] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-25T21:04:39.842063] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T21:04:39.850196] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-25T21:04:40.413207] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T21:04:40.425359] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-25T21:04:40.456775] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:04:40.467166] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-25T21:04:40.806112] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T21:04:40.817299] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-25T21:04:40.846768] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-25T21:04:41.488778] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-25T21:04:42.234866] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T21:04:42.280922] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T21:04:42.292765] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-25T21:04:42.505700] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T21:04:42.974941] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T21:04:43.088745] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-25T21:04:43.583154] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:04:43.888737] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-25T21:04:44.688726] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-25T21:04:45.373491] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:04:45.438895] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-25T21:04:45.488722] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-25T21:04:46.288715] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-25T21:04:46.534971] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T21:04:46.892770] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T21:04:47.088743] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-25T21:04:47.888744] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-25T21:04:48.486971] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-25T21:04:48.535415] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:04:48.688733] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-25T21:04:49.488804] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-25T21:04:49.555293] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T21:04:50.164380] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T21:04:50.288716] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-25T21:04:51.088720] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-25T21:04:51.705012] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T21:04:51.711666] [INFO ] [REMOTE ] RSKD: Full fetch complete (48386 records). [2025-09-25T21:04:51.711796] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-25T21:04:51.879805] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-25T21:04:51.919742] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-25T21:04:52.224961] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-25T21:04:52.225055] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-25T21:04:52.226088] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-25T21:04:52.226155] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-25T21:04:52.227331] [DEBUG] [LOCAL ] RSKD: Trimmed 48386 records to 34089 (keeping 200 days of data) [2025-09-25T21:04:52.437172] [DEBUG] [LOCAL ] RSKD: Primary data saved (34089 records). [2025-09-25T21:04:52.437346] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-25T21:04:52.437474] [INFO ] [MAIN ] Update Progress: 1841/2372 symbols completed. RSKD took 21.5s. Estimated remaining: 1h 10m 37s. Rate: 7.5 symbols/min [2025-09-25T21:04:52.631990] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:52.661212] [DEBUG] [LOCAL ] RVT: Loaded 27074 existing records from primary storage. [2025-09-25T21:04:52.661361] [INFO ] [MAIN ] RVT: Loaded 27074 existing records. [2025-09-25T21:04:52.695769] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-25T21:04:52.859332] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T21:04:52.948313] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:52.949819] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-25T21:04:52.949882] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-25T21:04:52.950213] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-25T21:04:52.950275] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-25T21:04:53.362246] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:53.474447] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T21:04:53.488680] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-25T21:04:54.288712] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-25T21:04:55.003685] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-25T21:04:55.088696] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-25T21:04:55.136059] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:04:55.143899] [INFO ] [REMOTE ] RTO: Full fetch complete (58431 records). [2025-09-25T21:04:55.144063] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-25T21:04:55.575196] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-25T21:04:55.575367] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-25T21:04:55.576635] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-25T21:04:55.576739] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-25T21:04:55.578678] [DEBUG] [LOCAL ] RTO: Trimmed 58431 records to 40564 (keeping 200 days of data) [2025-09-25T21:04:55.741324] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:04:55.889038] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-25T21:04:55.931292] [DEBUG] [LOCAL ] RTO: Primary data saved (40564 records). [2025-09-25T21:04:55.931460] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-25T21:04:55.931558] [INFO ] [MAIN ] Update Progress: 1842/2372 symbols completed. RTO took 25.0s. Estimated remaining: 1h 10m 28s. Rate: 7.5 symbols/min [2025-09-25T21:04:56.119602] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T21:04:56.190727] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:04:56.263835] [DEBUG] [LOCAL ] RVTY: Loaded 47533 existing records from primary storage. [2025-09-25T21:04:56.264048] [INFO ] [MAIN ] RVTY: Loaded 47533 existing records. [2025-09-25T21:04:56.458132] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:04:56.458500] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-25T21:04:56.458563] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-25T21:04:56.459160] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-25T21:04:56.459225] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-25T21:04:56.693965] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-25T21:04:56.857153] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:04:57.488735] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-25T21:04:57.625913] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T21:04:58.098939] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T21:04:58.288722] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-25T21:04:59.088867] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-25T21:04:59.530308] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T21:04:59.549344] [INFO ] [REMOTE ] RTX: Full fetch complete (77731 records). [2025-09-25T21:04:59.550061] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-25T21:04:59.714618] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T21:04:59.893788] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-25T21:05:00.079728] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-25T21:05:00.079823] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-25T21:05:00.081254] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-25T21:05:00.081362] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-25T21:05:00.087058] [DEBUG] [LOCAL ] RTX: Trimmed 77731 records to 54098 (keeping 200 days of data) [2025-09-25T21:05:00.461318] [DEBUG] [LOCAL ] RTX: Primary data saved (54098 records). [2025-09-25T21:05:00.461478] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-25T21:05:00.462414] [INFO ] [MAIN ] Update Progress: 1843/2372 symbols completed. RTX took 29.6s. Estimated remaining: 1h 10m 19s. Rate: 7.5 symbols/min [2025-09-25T21:05:00.646551] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:00.690124] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-25T21:05:00.719664] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T21:05:00.745866] [DEBUG] [LOCAL ] RWT: Loaded 40781 existing records from primary storage. [2025-09-25T21:05:00.746015] [INFO ] [MAIN ] RWT: Loaded 40781 existing records. [2025-09-25T21:05:00.753967] [INFO ] [REMOTE ] RVLV: Full fetch complete (68797 records). [2025-09-25T21:05:00.754107] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-25T21:05:01.138098] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:05:01.138539] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-25T21:05:01.138598] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-25T21:05:01.155684] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-25T21:05:01.155851] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-25T21:05:01.774505] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T21:05:01.747638] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-25T21:05:01.785876] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-25T21:05:01.787311] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-25T21:05:01.787405] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-25T21:05:01.791192] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-25T21:05:01.802867] [DEBUG] [LOCAL ] RVLV: Trimmed 68797 records to 48170 (keeping 200 days of data) [2025-09-25T21:05:02.023081] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T21:05:02.098004] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:02.276114] [DEBUG] [LOCAL ] RVLV: Primary data saved (48170 records). [2025-09-25T21:05:02.276323] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-25T21:05:02.276486] [INFO ] [MAIN ] Update Progress: 1844/2372 symbols completed. RVLV took 31.4s. Estimated remaining: 1h 10m 9s. Rate: 7.5 symbols/min [2025-09-25T21:05:02.289816] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-25T21:05:02.463865] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:02.464101] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-25T21:05:02.464167] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-25T21:05:02.464470] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-25T21:05:02.464614] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-25T21:05:02.464725] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-25T21:05:02.465439] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-25T21:05:02.856530] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:03.088814] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-25T21:05:03.511246] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T21:05:03.888708] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-25T21:05:03.971933] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T21:05:04.358186] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-25T21:05:04.531386] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T21:05:04.688744] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-25T21:05:05.488811] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-25T21:05:06.293162] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-25T21:05:06.307637] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T21:05:06.901040] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T21:05:07.088761] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-25T21:05:07.178494] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:05:07.888765] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-25T21:05:08.523264] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T21:05:08.688811] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-25T21:05:09.475230] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T21:05:09.488736] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-25T21:05:10.138023] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T21:05:10.288716] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-25T21:05:11.077527] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T21:05:11.088682] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-25T21:05:11.634862] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T21:05:11.888708] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-25T21:05:12.295136] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T21:05:12.449457] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T21:05:12.688745] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-25T21:05:13.214558] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T21:05:13.488726] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-25T21:05:14.164810] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-25T21:05:14.288745] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-25T21:05:15.088744] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-25T21:05:15.599864] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:05:15.888731] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-25T21:05:16.688771] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-25T21:05:16.721353] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T21:05:17.309515] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T21:05:17.488750] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-25T21:05:18.288728] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-25T21:05:18.629944] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T21:05:18.716125] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T21:05:19.088741] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-25T21:05:19.855272] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T21:05:19.888717] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-25T21:05:20.417900] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:05:20.424113] [INFO ] [REMOTE ] RVT: Full fetch complete (40100 records). [2025-09-25T21:05:20.424327] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-25T21:05:20.699804] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-25T21:05:20.879871] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-25T21:05:20.880008] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-25T21:05:20.881128] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-25T21:05:20.881217] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-25T21:05:20.882893] [DEBUG] [LOCAL ] RVT: Trimmed 40100 records to 27248 (keeping 200 days of data) [2025-09-25T21:05:21.085851] [DEBUG] [LOCAL ] RVT: Primary data saved (27248 records). [2025-09-25T21:05:21.086021] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-25T21:05:21.086187] [INFO ] [MAIN ] Update Progress: 1845/2372 symbols completed. RVT took 28.6s. Estimated remaining: 1h 10m 4s. Rate: 7.5 symbols/min [2025-09-25T21:05:21.298759] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:21.298953] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-25T21:05:21.298993] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-25T21:05:21.299248] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-25T21:05:21.299313] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-25T21:05:21.299384] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-25T21:05:21.299442] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-25T21:05:21.508827] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-25T21:05:21.525053] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T21:05:21.737014] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:22.064277] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T21:05:22.111212] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T21:05:22.288739] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-25T21:05:22.789416] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T21:05:23.088739] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-25T21:05:23.789335] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-25T21:05:23.888732] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-25T21:05:24.688734] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-25T21:05:25.488692] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-25T21:05:25.572690] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T21:05:25.869893] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-25T21:05:26.288729] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-25T21:05:26.345969] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T21:05:26.799396] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T21:05:27.088749] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-25T21:05:27.608974] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-25T21:05:27.888729] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-25T21:05:28.688762] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-25T21:05:29.192904] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T21:05:29.488728] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-25T21:05:29.567199] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:05:30.288731] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-25T21:05:31.088692] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-25T21:05:31.168775] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T21:05:31.176919] [INFO ] [REMOTE ] RWT: Full fetch complete (58723 records). [2025-09-25T21:05:31.177094] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-25T21:05:31.532723] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-25T21:05:31.646977] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-25T21:05:31.647081] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-25T21:05:31.648371] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-25T21:05:31.648460] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-25T21:05:31.650043] [DEBUG] [LOCAL ] RWT: Trimmed 58723 records to 41085 (keeping 200 days of data) [2025-09-25T21:05:31.888764] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-25T21:05:31.923132] [DEBUG] [LOCAL ] RWT: Primary data saved (41085 records). [2025-09-25T21:05:31.923289] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-25T21:05:31.924254] [INFO ] [MAIN ] Update Progress: 1846/2372 symbols completed. RWT took 31.5s. Estimated remaining: 1h 9m 57s. Rate: 7.5 symbols/min [2025-09-25T21:05:32.064484] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:05:32.239707] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:32.239900] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-25T21:05:32.239939] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-25T21:05:32.240068] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-25T21:05:32.240108] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-25T21:05:32.240155] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-25T21:05:32.240189] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-25T21:05:32.385695] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-25T21:05:32.635079] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:32.688679] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-25T21:05:32.930753] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:05:32.931126] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-25T21:05:33.488728] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-25T21:05:34.288721] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-25T21:05:34.773308] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T21:05:35.088732] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-25T21:05:35.226596] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T21:05:35.237303] [INFO ] [REMOTE ] RVTY: Full fetch complete (66449 records). [2025-09-25T21:05:35.237494] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-25T21:05:35.477570] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T21:05:35.681072] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-25T21:05:35.681174] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-25T21:05:35.682275] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-25T21:05:35.682358] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-25T21:05:35.684051] [DEBUG] [LOCAL ] RVTY: Trimmed 66449 records to 47880 (keeping 200 days of data) [2025-09-25T21:05:35.905520] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-25T21:05:35.999481] [DEBUG] [LOCAL ] RVTY: Primary data saved (47880 records). [2025-09-25T21:05:35.999635] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-25T21:05:35.999783] [INFO ] [MAIN ] Update Progress: 1847/2372 symbols completed. RVTY took 40.1s. Estimated remaining: 1h 9m 48s. Rate: 7.5 symbols/min [2025-09-25T21:05:36.175350] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:36.228918] [DEBUG] [LOCAL ] RXO: Loaded 47804 existing records from primary storage. [2025-09-25T21:05:36.229073] [INFO ] [MAIN ] RXO: Loaded 47804 existing records. [2025-09-25T21:05:36.415215] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:05:36.415472] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-25T21:05:36.415517] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-25T21:05:36.416508] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-25T21:05:36.416572] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-25T21:05:36.691448] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-25T21:05:36.802247] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T21:05:36.806557] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:37.225489] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-25T21:05:37.488725] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-25T21:05:38.069318] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T21:05:38.070533] [INFO ] [REMOTE ] RWTN: Full fetch complete (3148 records). [2025-09-25T21:05:38.070619] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-25T21:05:38.257387] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-25T21:05:38.257716] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:05:38.257803] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:05:38.257871] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-25T21:05:38.257948] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-25T21:05:38.258555] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-25T21:05:38.258624] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-25T21:05:38.258784] [INFO ] [MAIN ] Update Progress: 1848/2372 symbols completed. RWTN took 36.0s. Estimated remaining: 1h 9m 38s. Rate: 7.5 symbols/min [2025-09-25T21:05:38.294132] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-25T21:05:38.466899] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:38.532324] [DEBUG] [LOCAL ] RY: Loaded 47905 existing records from primary storage. [2025-09-25T21:05:38.532488] [INFO ] [MAIN ] RY: Loaded 47905 existing records. [2025-09-25T21:05:38.725709] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:05:38.725964] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-25T21:05:38.726015] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-25T21:05:38.726464] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-25T21:05:38.726526] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-25T21:05:39.106255] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:39.101819] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-25T21:05:39.750027] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T21:05:39.888721] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-25T21:05:40.002119] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T21:05:40.580989] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T21:05:40.688714] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-25T21:05:41.292261] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T21:05:41.488739] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-25T21:05:42.126382] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T21:05:42.128117] [INFO ] [REMOTE ] RWTO: Full fetch complete (4796 records). [2025-09-25T21:05:42.128223] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-25T21:05:42.293931] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-25T21:05:42.372696] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T21:05:42.373774] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:05:42.373956] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:05:42.374182] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-25T21:05:42.374281] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-25T21:05:42.374340] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-25T21:05:42.374386] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-25T21:05:42.374471] [INFO ] [MAIN ] Update Progress: 1849/2372 symbols completed. RWTO took 21.3s. Estimated remaining: 1h 9m 29s. Rate: 7.5 symbols/min [2025-09-25T21:05:42.629727] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:42.702947] [DEBUG] [LOCAL ] RYAM: Loaded 35165 existing records from primary storage. [2025-09-25T21:05:42.703188] [INFO ] [MAIN ] RYAM: Loaded 35165 existing records. [2025-09-25T21:05:42.954739] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:05:42.955351] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-25T21:05:42.955403] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-25T21:05:42.955733] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-25T21:05:42.955841] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-25T21:05:43.093902] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-25T21:05:43.439217] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:43.546812] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-25T21:05:43.888699] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-25T21:05:44.031527] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:05:44.417031] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T21:05:44.688721] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-25T21:05:45.165804] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T21:05:45.488769] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-25T21:05:46.288724] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-25T21:05:47.074687] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:05:47.088686] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-25T21:05:47.888756] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-25T21:05:48.227825] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T21:05:48.533576] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T21:05:48.688775] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-25T21:05:48.932409] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T21:05:49.488746] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-25T21:05:49.989427] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-25T21:05:50.288712] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-25T21:05:50.532286] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T21:05:51.088872] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-25T21:05:51.888718] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-25T21:05:51.958943] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:05:52.409123] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-25T21:05:52.688744] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-25T21:05:53.077769] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T21:05:53.488731] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-25T21:05:53.960473] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T21:05:54.288711] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-25T21:05:54.919133] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T21:05:54.920721] [INFO ] [REMOTE ] RWTP: Full fetch complete (4473 records). [2025-09-25T21:05:54.920809] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-25T21:05:55.099747] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-25T21:05:55.152889] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-25T21:05:55.153441] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:05:55.153723] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:05:55.153912] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-25T21:05:55.154159] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-25T21:05:55.154332] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-25T21:05:55.154437] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-25T21:05:55.154612] [INFO ] [MAIN ] Update Progress: 1850/2372 symbols completed. RWTP took 23.2s. Estimated remaining: 1h 9m 22s. Rate: 7.5 symbols/min [2025-09-25T21:05:55.404697] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:05:55.412636] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:05:55.490382] [DEBUG] [LOCAL ] RYAN: Loaded 44204 existing records from primary storage. [2025-09-25T21:05:55.490559] [INFO ] [MAIN ] RYAN: Loaded 44204 existing records. [2025-09-25T21:05:55.683664] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:05:55.683922] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-25T21:05:55.683967] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-25T21:05:55.684445] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-25T21:05:55.684504] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-25T21:05:55.901739] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-25T21:05:56.068817] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:05:56.688737] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-25T21:05:57.034494] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:05:57.248221] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T21:05:57.488732] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-25T21:05:57.941952] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T21:05:58.288816] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-25T21:05:58.747708] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T21:05:59.088733] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-25T21:05:59.888733] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-25T21:05:59.954472] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T21:06:00.688695] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-25T21:06:00.785629] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:06:01.431283] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T21:06:01.488778] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-25T21:06:02.288752] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-25T21:06:02.549130] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:06:03.031898] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:06:03.088728] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-25T21:06:03.662865] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:06:03.888722] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-25T21:06:04.647242] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T21:06:04.688718] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-25T21:06:05.488807] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-25T21:06:05.594556] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T21:06:06.154732] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T21:06:06.288731] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-25T21:06:06.818898] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T21:06:07.088790] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-25T21:06:07.888742] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-25T21:06:08.093241] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T21:06:08.688780] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-25T21:06:08.896874] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T21:06:09.488737] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-25T21:06:09.638132] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:06:10.288768] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-25T21:06:10.374132] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T21:06:11.088762] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-25T21:06:11.184117] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T21:06:11.888770] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-25T21:06:11.965331] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T21:06:12.304307] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T21:06:12.688759] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-25T21:06:13.488695] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-25T21:06:13.900442] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T21:06:13.918703] [INFO ] [REMOTE ] RXO: Full fetch complete (68070 records). [2025-09-25T21:06:13.918899] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-25T21:06:14.309738] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-25T21:06:14.398927] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T21:06:14.447841] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-25T21:06:14.447976] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-25T21:06:14.449480] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-25T21:06:14.449578] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-25T21:06:14.451469] [DEBUG] [LOCAL ] RXO: Trimmed 68070 records to 48150 (keeping 200 days of data) [2025-09-25T21:06:14.778873] [DEBUG] [LOCAL ] RXO: Primary data saved (48150 records). [2025-09-25T21:06:14.779050] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-25T21:06:14.779229] [INFO ] [MAIN ] Update Progress: 1851/2372 symbols completed. RXO took 38.8s. Estimated remaining: 1h 9m 18s. Rate: 7.5 symbols/min [2025-09-25T21:06:14.985141] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:15.038079] [DEBUG] [LOCAL ] RYI: Loaded 21528 existing records from primary storage. [2025-09-25T21:06:15.038237] [INFO ] [MAIN ] RYI: Loaded 21528 existing records. [2025-09-25T21:06:15.058780] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:06:15.091493] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-25T21:06:15.248236] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:15.249932] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-25T21:06:15.249994] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-25T21:06:15.250322] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-25T21:06:15.250447] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-25T21:06:15.644581] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:15.818161] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T21:06:15.832522] [INFO ] [REMOTE ] RY: Full fetch complete (68576 records). [2025-09-25T21:06:15.832715] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-25T21:06:15.894794] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-25T21:06:16.361814] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-25T21:06:16.361912] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-25T21:06:16.363122] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-25T21:06:16.363192] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-25T21:06:16.364830] [DEBUG] [LOCAL ] RY: Trimmed 68576 records to 48274 (keeping 200 days of data) [2025-09-25T21:06:16.695992] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-25T21:06:16.737624] [DEBUG] [LOCAL ] RY: Primary data saved (48274 records). [2025-09-25T21:06:16.737839] [INFO ] [MAIN ] RY: Full history saved. [2025-09-25T21:06:16.737965] [INFO ] [MAIN ] Update Progress: 1852/2372 symbols completed. RY took 38.5s. Estimated remaining: 1h 9m 8s. Rate: 7.5 symbols/min [2025-09-25T21:06:16.938187] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T21:06:16.981613] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:17.029758] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T21:06:17.076755] [DEBUG] [LOCAL ] RYN: Loaded 45655 existing records from primary storage. [2025-09-25T21:06:17.076962] [INFO ] [MAIN ] RYN: Loaded 45655 existing records. [2025-09-25T21:06:17.277382] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:17.277868] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-25T21:06:17.277941] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-25T21:06:17.278296] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-25T21:06:17.278356] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-25T21:06:17.489879] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-25T21:06:17.688698] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:17.876723] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T21:06:18.288727] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-25T21:06:19.088747] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-25T21:06:19.180253] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:06:19.191929] [INFO ] [REMOTE ] RYAN: Full fetch complete (63699 records). [2025-09-25T21:06:19.192110] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-25T21:06:19.572261] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T21:06:19.666010] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-25T21:06:19.666134] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-25T21:06:19.668035] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-25T21:06:19.668105] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-25T21:06:19.670088] [DEBUG] [LOCAL ] RYAN: Trimmed 63699 records to 44574 (keeping 200 days of data) [2025-09-25T21:06:19.908189] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-25T21:06:20.009113] [DEBUG] [LOCAL ] RYAN: Primary data saved (44574 records). [2025-09-25T21:06:20.009318] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-25T21:06:20.010124] [INFO ] [MAIN ] Update Progress: 1853/2372 symbols completed. RYAN took 24.9s. Estimated remaining: 1h 8m 59s. Rate: 7.5 symbols/min [2025-09-25T21:06:20.202382] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:20.219615] [DEBUG] [LOCAL ] RZB: Loaded 6246 existing records from primary storage. [2025-09-25T21:06:20.219845] [INFO ] [MAIN ] RZB: Loaded 6246 existing records. [2025-09-25T21:06:20.454999] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T21:06:20.469704] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:20.470027] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-25T21:06:20.470108] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-25T21:06:20.470481] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-25T21:06:20.470544] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-25T21:06:20.689959] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-25T21:06:20.880896] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:21.110821] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-25T21:06:21.488754] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-25T21:06:22.079504] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T21:06:22.271234] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T21:06:22.288684] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-25T21:06:22.930296] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T21:06:23.088730] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-25T21:06:23.888760] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-25T21:06:24.611874] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T21:06:24.619557] [INFO ] [REMOTE ] RYAM: Full fetch complete (48828 records). [2025-09-25T21:06:24.619734] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-25T21:06:24.693701] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-25T21:06:25.076141] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-25T21:06:25.076234] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-25T21:06:25.077288] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-25T21:06:25.077354] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-25T21:06:25.078597] [DEBUG] [LOCAL ] RYAM: Trimmed 48828 records to 35428 (keeping 200 days of data) [2025-09-25T21:06:25.310854] [DEBUG] [LOCAL ] RYAM: Primary data saved (35428 records). [2025-09-25T21:06:25.311069] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-25T21:06:25.311227] [INFO ] [MAIN ] Update Progress: 1854/2372 symbols completed. RYAM took 42.9s. Estimated remaining: 1h 8m 50s. Rate: 7.5 symbols/min [2025-09-25T21:06:25.367025] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-25T21:06:25.493843] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-25T21:06:25.574320] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:25.593504] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T21:06:25.610277] [DEBUG] [LOCAL ] RZC: Loaded 6773 existing records from primary storage. [2025-09-25T21:06:25.610486] [INFO ] [MAIN ] RZC: Loaded 6773 existing records. [2025-09-25T21:06:25.911985] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:25.912310] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-25T21:06:25.912368] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-25T21:06:25.912623] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-25T21:06:25.912720] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-25T21:06:26.290496] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-25T21:06:26.288964] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-25T21:06:26.327891] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:27.088721] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-25T21:06:27.888691] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-25T21:06:28.060961] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T21:06:28.200324] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:06:28.549229] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-25T21:06:28.688727] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-25T21:06:29.488730] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-25T21:06:29.567208] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T21:06:30.288696] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-25T21:06:30.682684] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T21:06:30.971981] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T21:06:31.088727] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-25T21:06:31.888720] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-25T21:06:32.239963] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:06:32.466014] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T21:06:32.688733] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-25T21:06:33.488730] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-25T21:06:34.253161] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T21:06:34.288759] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-25T21:06:34.452577] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:06:35.088783] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-25T21:06:35.211134] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T21:06:35.735897] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T21:06:35.888771] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-25T21:06:36.688736] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-25T21:06:37.488734] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-25T21:06:37.682059] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:06:37.754599] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T21:06:38.286269] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T21:06:38.289067] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-25T21:06:38.966897] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-25T21:06:39.088742] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-25T21:06:39.888751] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-25T21:06:40.688705] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-25T21:06:40.876240] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T21:06:40.900395] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T21:06:41.488701] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-25T21:06:41.635969] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T21:06:42.210436] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-25T21:06:42.288708] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-25T21:06:43.088731] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-25T21:06:43.583594] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T21:06:43.591146] [INFO ] [REMOTE ] RYI: Full fetch complete (32398 records). [2025-09-25T21:06:43.591339] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-25T21:06:43.756165] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T21:06:43.889591] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-25T21:06:44.065999] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-25T21:06:44.066097] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-25T21:06:44.066822] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-25T21:06:44.066885] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-25T21:06:44.067801] [DEBUG] [LOCAL ] RYI: Trimmed 32398 records to 21726 (keeping 200 days of data) [2025-09-25T21:06:44.214127] [DEBUG] [LOCAL ] RYI: Primary data saved (21726 records). [2025-09-25T21:06:44.214265] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-25T21:06:44.214367] [INFO ] [MAIN ] Update Progress: 1855/2372 symbols completed. RYI took 29.4s. Estimated remaining: 1h 8m 45s. Rate: 7.5 symbols/min [2025-09-25T21:06:44.414405] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:44.483609] [DEBUG] [LOCAL ] S: Loaded 53544 existing records from primary storage. [2025-09-25T21:06:44.483810] [INFO ] [MAIN ] S: Loaded 53544 existing records. [2025-09-25T21:06:44.561367] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T21:06:44.562865] [INFO ] [REMOTE ] RZB: Full fetch complete (8710 records). [2025-09-25T21:06:44.562940] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-25T21:06:44.689468] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-25T21:06:44.841432] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:44.841851] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-25T21:06:44.841922] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-25T21:06:44.842344] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-25T21:06:44.842404] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-25T21:06:45.528149] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:45.528502] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-25T21:06:45.534140] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-25T21:06:45.534771] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-25T21:06:45.535016] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-25T21:06:45.535057] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-25T21:06:45.535541] [DEBUG] [LOCAL ] RZB: Trimmed 8710 records to 6274 (keeping 200 days of data) [2025-09-25T21:06:45.578895] [DEBUG] [LOCAL ] RZB: Primary data saved (6274 records). [2025-09-25T21:06:45.579042] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-25T21:06:45.579157] [INFO ] [MAIN ] Update Progress: 1856/2372 symbols completed. RZB took 25.6s. Estimated remaining: 1h 8m 35s. Rate: 7.5 symbols/min [2025-09-25T21:06:45.765014] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:45.833867] [DEBUG] [LOCAL ] SA: Loaded 43111 existing records from primary storage. [2025-09-25T21:06:45.834023] [INFO ] [MAIN ] SA: Loaded 43111 existing records. [2025-09-25T21:06:46.020567] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:46.020910] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-25T21:06:46.020959] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-25T21:06:46.021179] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-25T21:06:46.021237] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-25T21:06:46.302730] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-25T21:06:46.405199] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:46.662862] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T21:06:47.040769] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T21:06:47.088734] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-25T21:06:47.888724] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-25T21:06:47.945242] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T21:06:47.953662] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-25T21:06:48.688866] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-25T21:06:49.492097] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-25T21:06:49.493243] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T21:06:49.522298] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T21:06:50.288753] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-25T21:06:51.088738] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-25T21:06:51.307379] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T21:06:51.732765] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T21:06:51.735954] [INFO ] [REMOTE ] RZC: Full fetch complete (9869 records). [2025-09-25T21:06:51.736153] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-25T21:06:51.892340] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-25T21:06:52.202246] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-25T21:06:52.202335] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-25T21:06:52.202602] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-25T21:06:52.203007] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-25T21:06:52.203700] [DEBUG] [LOCAL ] RZC: Trimmed 9869 records to 6805 (keeping 200 days of data) [2025-09-25T21:06:52.255781] [DEBUG] [LOCAL ] RZC: Primary data saved (6805 records). [2025-09-25T21:06:52.255960] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-25T21:06:52.256112] [INFO ] [MAIN ] Update Progress: 1857/2372 symbols completed. RZC took 26.9s. Estimated remaining: 1h 8m 27s. Rate: 7.5 symbols/min [2025-09-25T21:06:52.475967] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:52.523227] [DEBUG] [LOCAL ] SABA: Loaded 9195 existing records from primary storage. [2025-09-25T21:06:52.523425] [INFO ] [MAIN ] SABA: Loaded 9195 existing records. [2025-09-25T21:06:52.563797] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-25T21:06:52.693807] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-25T21:06:52.769187] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:52.771731] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-25T21:06:52.771817] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-25T21:06:52.772249] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-25T21:06:52.772319] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-25T21:06:53.166221] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:53.488781] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-25T21:06:53.530704] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T21:06:53.541245] [INFO ] [REMOTE ] RYN: Full fetch complete (64693 records). [2025-09-25T21:06:53.541420] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-25T21:06:54.018830] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-25T21:06:54.018961] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-25T21:06:54.020266] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-25T21:06:54.020365] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-25T21:06:54.022852] [DEBUG] [LOCAL ] RYN: Trimmed 64693 records to 45996 (keeping 200 days of data) [2025-09-25T21:06:54.288756] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-25T21:06:54.358238] [DEBUG] [LOCAL ] RYN: Primary data saved (45996 records). [2025-09-25T21:06:54.358404] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-25T21:06:54.358591] [INFO ] [MAIN ] Update Progress: 1858/2372 symbols completed. RYN took 37.6s. Estimated remaining: 1h 8m 17s. Rate: 7.5 symbols/min [2025-09-25T21:06:54.550579] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:06:54.602231] [DEBUG] [LOCAL ] SAFE: Loaded 30372 existing records from primary storage. [2025-09-25T21:06:54.602387] [INFO ] [MAIN ] SAFE: Loaded 30372 existing records. [2025-09-25T21:06:54.792098] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-25T21:06:54.875886] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:06:54.877061] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-25T21:06:54.877119] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-25T21:06:54.877470] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-25T21:06:54.877531] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-25T21:06:55.079239] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T21:06:55.102390] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-25T21:06:55.129201] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T21:06:55.344949] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:06:55.888747] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-25T21:06:56.284437] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T21:06:56.688796] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-25T21:06:57.493923] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-25T21:06:57.510471] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T21:06:58.123611] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T21:06:58.288718] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-25T21:06:59.088737] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-25T21:06:59.610305] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T21:06:59.769358] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T21:06:59.888771] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-25T21:07:00.679875] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T21:07:00.688838] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-25T21:07:01.234474] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T21:07:01.488729] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-25T21:07:02.288716] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-25T21:07:02.431268] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T21:07:02.839855] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T21:07:03.088756] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-25T21:07:03.836558] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T21:07:03.890041] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-25T21:07:04.689716] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-25T21:07:05.230737] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-25T21:07:05.426689] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:07:05.488729] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-25T21:07:05.594328] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T21:07:06.288803] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-25T21:07:06.924382] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T21:07:06.935496] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-25T21:07:07.088749] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-25T21:07:07.888881] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-25T21:07:08.366895] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T21:07:08.688750] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-25T21:07:08.699392] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T21:07:09.488793] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-25T21:07:10.059318] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:07:10.288719] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-25T21:07:10.872743] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T21:07:11.088689] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-25T21:07:11.277994] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T21:07:11.888744] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-25T21:07:12.461891] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T21:07:12.688748] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-25T21:07:13.488815] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-25T21:07:14.200862] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-25T21:07:14.288701] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-25T21:07:14.346271] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T21:07:14.431889] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:07:15.088722] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-25T21:07:15.325158] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-25T21:07:15.331563] [INFO ] [REMOTE ] SAFE: Full fetch complete (45069 records). [2025-09-25T21:07:15.331759] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-25T21:07:15.758057] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-25T21:07:15.758192] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-25T21:07:15.759350] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-25T21:07:15.759431] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-25T21:07:15.760941] [DEBUG] [LOCAL ] SAFE: Trimmed 45069 records to 30617 (keeping 200 days of data) [2025-09-25T21:07:15.889223] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-25T21:07:15.963565] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T21:07:15.982386] [DEBUG] [LOCAL ] SAFE: Primary data saved (30617 records). [2025-09-25T21:07:15.982577] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-25T21:07:15.982794] [INFO ] [MAIN ] Update Progress: 1859/2372 symbols completed. SAFE took 21.6s. Estimated remaining: 1h 8m 13s. Rate: 7.5 symbols/min [2025-09-25T21:07:16.180668] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:16.208633] [DEBUG] [LOCAL ] SAH: Loaded 22081 existing records from primary storage. [2025-09-25T21:07:16.208804] [INFO ] [MAIN ] SAH: Loaded 22081 existing records. [2025-09-25T21:07:16.399100] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:16.399758] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-25T21:07:16.399836] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-25T21:07:16.400225] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-25T21:07:16.400308] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-25T21:07:16.699819] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-25T21:07:16.785858] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:17.488743] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-25T21:07:17.577670] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T21:07:17.948831] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-25T21:07:18.288715] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-25T21:07:19.088732] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-25T21:07:19.124965] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T21:07:19.144248] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T21:07:19.147253] [INFO ] [REMOTE ] SABA: Full fetch complete (15467 records). [2025-09-25T21:07:19.147387] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-25T21:07:19.563438] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-25T21:07:19.563545] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-25T21:07:19.563982] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-25T21:07:19.564052] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-25T21:07:19.565014] [DEBUG] [LOCAL ] SABA: Trimmed 15467 records to 9248 (keeping 200 days of data) [2025-09-25T21:07:19.638310] [DEBUG] [LOCAL ] SABA: Primary data saved (9248 records). [2025-09-25T21:07:19.638473] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-25T21:07:19.638629] [INFO ] [MAIN ] Update Progress: 1860/2372 symbols completed. SABA took 27.4s. Estimated remaining: 1h 8m 4s. Rate: 7.5 symbols/min [2025-09-25T21:07:19.825681] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:19.825867] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-25T21:07:19.825905] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-25T21:07:19.826108] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-25T21:07:19.826148] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-25T21:07:19.826187] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-25T21:07:19.826227] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-25T21:07:19.893245] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-25T21:07:20.216889] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:20.688774] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-25T21:07:21.177729] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-25T21:07:21.388401] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-25T21:07:21.400228] [INFO ] [REMOTE ] S: Full fetch complete (77549 records). [2025-09-25T21:07:21.400418] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-25T21:07:21.490501] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-25T21:07:21.824195] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T21:07:21.940285] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-25T21:07:21.940388] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-25T21:07:21.941552] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-25T21:07:21.941625] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-25T21:07:21.943555] [DEBUG] [LOCAL ] S: Trimmed 77549 records to 53928 (keeping 200 days of data) [2025-09-25T21:07:22.292719] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-25T21:07:22.316149] [DEBUG] [LOCAL ] S: Primary data saved (53928 records). [2025-09-25T21:07:22.316323] [INFO ] [MAIN ] S: Full history saved. [2025-09-25T21:07:22.316467] [INFO ] [MAIN ] Update Progress: 1861/2372 symbols completed. S took 38.1s. Estimated remaining: 1h 7m 55s. Rate: 7.5 symbols/min [2025-09-25T21:07:22.486247] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-25T21:07:22.523270] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:22.560803] [DEBUG] [LOCAL ] SAM: Loaded 21523 existing records from primary storage. [2025-09-25T21:07:22.560959] [INFO ] [MAIN ] SAM: Loaded 21523 existing records. [2025-09-25T21:07:22.762551] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:22.762921] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-25T21:07:22.762970] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-25T21:07:22.763263] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-25T21:07:22.763323] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-25T21:07:23.093832] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-25T21:07:23.138856] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:23.788880] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T21:07:23.888729] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-25T21:07:24.397697] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T21:07:24.688745] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-25T21:07:25.488717] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-25T21:07:25.924891] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:07:26.097239] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-25T21:07:26.111606] [INFO ] [REMOTE ] SA: Full fetch complete (62016 records). [2025-09-25T21:07:26.113829] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-25T21:07:26.300050] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-25T21:07:26.465365] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T21:07:26.602085] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-25T21:07:26.602186] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-25T21:07:26.603396] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-25T21:07:26.603467] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-25T21:07:26.604973] [DEBUG] [LOCAL ] SA: Trimmed 62016 records to 43469 (keeping 200 days of data) [2025-09-25T21:07:26.736200] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T21:07:26.888216] [DEBUG] [LOCAL ] SA: Primary data saved (43469 records). [2025-09-25T21:07:26.888361] [INFO ] [MAIN ] SA: Full history saved. [2025-09-25T21:07:26.889452] [INFO ] [MAIN ] Update Progress: 1862/2372 symbols completed. SA took 41.3s. Estimated remaining: 1h 7m 46s. Rate: 7.5 symbols/min [2025-09-25T21:07:27.067081] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:27.088704] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-25T21:07:27.150100] [DEBUG] [LOCAL ] SAN: Loaded 53018 existing records from primary storage. [2025-09-25T21:07:27.150266] [INFO ] [MAIN ] SAN: Loaded 53018 existing records. [2025-09-25T21:07:27.340937] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:27.341266] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-25T21:07:27.341311] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-25T21:07:27.341592] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-25T21:07:27.341684] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-25T21:07:27.575937] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T21:07:27.726606] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:27.888705] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-25T21:07:28.688775] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-25T21:07:29.082932] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T21:07:29.488731] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-25T21:07:29.907105] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T21:07:30.288721] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-25T21:07:30.732339] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:07:31.088732] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-25T21:07:31.533480] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-25T21:07:31.684171] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T21:07:31.888727] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-25T21:07:32.688688] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-25T21:07:33.038023] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:07:33.488737] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-25T21:07:33.886833] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-25T21:07:34.288701] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-25T21:07:34.649555] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T21:07:34.703333] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T21:07:35.088752] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-25T21:07:35.888755] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-25T21:07:36.237355] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:07:36.688741] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-25T21:07:37.488728] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-25T21:07:37.574953] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T21:07:38.092346] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T21:07:38.288715] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-25T21:07:38.677188] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-25T21:07:38.753199] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T21:07:39.088762] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-25T21:07:39.888738] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-25T21:07:40.688722] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-25T21:07:40.893726] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:07:41.060008] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-25T21:07:41.488721] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-25T21:07:41.518212] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T21:07:41.871048] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-25T21:07:42.288737] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-25T21:07:43.088760] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-25T21:07:43.586617] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T21:07:43.888734] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-25T21:07:44.279690] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-25T21:07:44.280632] [INFO ] [REMOTE ] SAJ: Full fetch complete (930 records). [2025-09-25T21:07:44.282741] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-25T21:07:44.388376] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T21:07:44.535177] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-25T21:07:44.535433] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:07:44.535480] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:07:44.535519] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-25T21:07:44.535983] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-25T21:07:44.536046] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-25T21:07:44.536108] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-25T21:07:44.536193] [INFO ] [MAIN ] Update Progress: 1863/2372 symbols completed. SAJ took 24.9s. Estimated remaining: 1h 7m 40s. Rate: 7.5 symbols/min [2025-09-25T21:07:44.691878] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-25T21:07:44.723809] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:44.827218] [DEBUG] [LOCAL ] SAND: Loaded 51770 existing records from primary storage. [2025-09-25T21:07:44.827436] [INFO ] [MAIN ] SAND: Loaded 51770 existing records. [2025-09-25T21:07:45.038622] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:45.039006] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-25T21:07:45.039072] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-25T21:07:45.039412] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-25T21:07:45.039478] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-25T21:07:45.415997] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:45.488676] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-25T21:07:46.288752] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-25T21:07:46.828225] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T21:07:47.088740] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-25T21:07:47.210211] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T21:07:47.403612] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T21:07:47.744726] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T21:07:47.749287] [INFO ] [REMOTE ] SAH: Full fetch complete (30388 records). [2025-09-25T21:07:47.749381] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-25T21:07:47.893876] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-25T21:07:48.185029] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-25T21:07:48.185116] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-25T21:07:48.185851] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-25T21:07:48.185916] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-25T21:07:48.186785] [DEBUG] [LOCAL ] SAH: Trimmed 30388 records to 22254 (keeping 200 days of data) [2025-09-25T21:07:48.347044] [DEBUG] [LOCAL ] SAH: Primary data saved (22254 records). [2025-09-25T21:07:48.347184] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-25T21:07:48.347292] [INFO ] [MAIN ] Update Progress: 1864/2372 symbols completed. SAH took 32.4s. Estimated remaining: 1h 7m 31s. Rate: 7.5 symbols/min [2025-09-25T21:07:48.533894] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:48.604040] [DEBUG] [LOCAL ] SAP: Loaded 50074 existing records from primary storage. [2025-09-25T21:07:48.604207] [INFO ] [MAIN ] SAP: Loaded 50074 existing records. [2025-09-25T21:07:48.692947] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-25T21:07:48.798907] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:48.799330] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-25T21:07:48.799405] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-25T21:07:48.799900] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-25T21:07:48.799975] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-25T21:07:49.179417] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:49.213248] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T21:07:49.488743] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-25T21:07:50.198692] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T21:07:50.288692] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-25T21:07:50.624005] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T21:07:51.088719] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-25T21:07:51.888719] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-25T21:07:52.078737] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T21:07:52.548911] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T21:07:52.688722] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-25T21:07:53.094389] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:07:53.488787] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-25T21:07:54.288758] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-25T21:07:54.506531] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T21:07:54.654708] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T21:07:54.659522] [INFO ] [REMOTE ] SAM: Full fetch complete (30387 records). [2025-09-25T21:07:54.659667] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-25T21:07:55.061068] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-25T21:07:55.061153] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-25T21:07:55.061885] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-25T21:07:55.061953] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-25T21:07:55.062752] [DEBUG] [LOCAL ] SAM: Trimmed 30387 records to 21650 (keeping 200 days of data) [2025-09-25T21:07:55.123754] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-25T21:07:55.218952] [DEBUG] [LOCAL ] SAM: Primary data saved (21650 records). [2025-09-25T21:07:55.219110] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-25T21:07:55.219202] [INFO ] [MAIN ] Update Progress: 1865/2372 symbols completed. SAM took 32.9s. Estimated remaining: 1h 7m 23s. Rate: 7.5 symbols/min [2025-09-25T21:07:55.426219] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:07:55.454176] [DEBUG] [LOCAL ] SAR: Loaded 16123 existing records from primary storage. [2025-09-25T21:07:55.454351] [INFO ] [MAIN ] SAR: Loaded 16123 existing records. [2025-09-25T21:07:55.670867] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:07:55.671271] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-25T21:07:55.671339] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-25T21:07:55.671572] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-25T21:07:55.671635] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-25T21:07:55.898265] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-25T21:07:56.054973] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:07:56.129357] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:07:56.688715] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-25T21:07:57.172137] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T21:07:57.488750] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-25T21:07:58.069925] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-25T21:07:58.134427] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T21:07:58.288717] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-25T21:07:59.086410] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T21:07:59.095025] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-25T21:07:59.888715] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-25T21:08:00.291008] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T21:08:00.298599] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:08:00.688900] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-25T21:08:01.488854] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-25T21:08:01.824458] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T21:08:02.024592] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-25T21:08:02.288711] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-25T21:08:03.088726] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-25T21:08:03.449389] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-25T21:08:03.888745] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-25T21:08:04.436758] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-25T21:08:04.688740] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-25T21:08:05.065401] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T21:08:05.488748] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-25T21:08:05.692863] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:08:06.288693] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-25T21:08:06.790479] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T21:08:07.088705] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-25T21:08:07.455377] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T21:08:07.526313] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T21:08:07.536978] [INFO ] [REMOTE ] SAN: Full fetch complete (76191 records). [2025-09-25T21:08:07.537346] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-25T21:08:07.893819] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-25T21:08:07.987384] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-25T21:08:07.987472] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-25T21:08:07.988661] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-25T21:08:07.988771] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-25T21:08:07.990545] [DEBUG] [LOCAL ] SAN: Trimmed 76191 records to 53398 (keeping 200 days of data) [2025-09-25T21:08:08.326707] [DEBUG] [LOCAL ] SAN: Primary data saved (53398 records). [2025-09-25T21:08:08.326858] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-25T21:08:08.327807] [INFO ] [MAIN ] Update Progress: 1866/2372 symbols completed. SAN took 41.4s. Estimated remaining: 1h 7m 16s. Rate: 7.5 symbols/min [2025-09-25T21:08:08.501798] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:08.561938] [DEBUG] [LOCAL ] SARO: Loaded 48764 existing records from primary storage. [2025-09-25T21:08:08.562121] [INFO ] [MAIN ] SARO: Loaded 48764 existing records. [2025-09-25T21:08:08.693763] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-25T21:08:08.770000] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:08:08.770267] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-25T21:08:08.770314] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-25T21:08:08.770673] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-25T21:08:08.770746] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-25T21:08:09.181257] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T21:08:09.286146] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:09.488720] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-25T21:08:09.840368] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-25T21:08:09.925511] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T21:08:10.288709] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-25T21:08:11.088699] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-25T21:08:11.297284] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T21:08:11.888738] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-25T21:08:12.423526] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T21:08:12.514100] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T21:08:12.688710] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-25T21:08:12.827077] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T21:08:13.488747] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-25T21:08:14.288693] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-25T21:08:14.555234] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T21:08:14.565443] [INFO ] [REMOTE ] SAND: Full fetch complete (74371 records). [2025-09-25T21:08:14.565599] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-25T21:08:14.745408] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-25T21:08:15.023281] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-25T21:08:15.023416] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-25T21:08:15.024787] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-25T21:08:15.024868] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-25T21:08:15.026628] [DEBUG] [LOCAL ] SAND: Trimmed 74371 records to 52153 (keeping 200 days of data) [2025-09-25T21:08:15.120698] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-25T21:08:15.368256] [DEBUG] [LOCAL ] SAND: Primary data saved (52153 records). [2025-09-25T21:08:15.368533] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-25T21:08:15.369371] [INFO ] [MAIN ] Update Progress: 1867/2372 symbols completed. SAND took 30.8s. Estimated remaining: 1h 7m 8s. Rate: 7.5 symbols/min [2025-09-25T21:08:15.561260] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:15.561470] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-25T21:08:15.561525] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-25T21:08:15.561724] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-25T21:08:15.561828] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-25T21:08:15.561916] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-25T21:08:15.561985] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-25T21:08:15.893092] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-25T21:08:16.003565] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:16.043947] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:08:16.688734] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-25T21:08:17.009876] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T21:08:17.029630] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T21:08:17.207732] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-25T21:08:17.488738] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-25T21:08:17.882680] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-25T21:08:18.288731] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-25T21:08:18.691058] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T21:08:19.088740] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-25T21:08:19.584908] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T21:08:19.888733] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-25T21:08:20.375563] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T21:08:20.688739] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-25T21:08:21.072271] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-25T21:08:21.488751] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-25T21:08:22.288727] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-25T21:08:23.088786] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-25T21:08:23.474338] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-25T21:08:23.607570] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-25T21:08:23.617546] [INFO ] [REMOTE ] SAP: Full fetch complete (71677 records). [2025-09-25T21:08:23.617822] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-25T21:08:23.769242] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T21:08:23.893846] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-25T21:08:24.114349] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-25T21:08:24.114445] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-25T21:08:24.115700] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-25T21:08:24.115770] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-25T21:08:24.117290] [DEBUG] [LOCAL ] SAP: Trimmed 71677 records to 50440 (keeping 200 days of data) [2025-09-25T21:08:24.454515] [DEBUG] [LOCAL ] SAP: Primary data saved (50440 records). [2025-09-25T21:08:24.454740] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-25T21:08:24.454879] [INFO ] [MAIN ] Update Progress: 1868/2372 symbols completed. SAP took 36.1s. Estimated remaining: 1h 7m 1s. Rate: 7.5 symbols/min [2025-09-25T21:08:24.630178] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:24.630374] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-25T21:08:24.630415] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-25T21:08:24.630829] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-25T21:08:24.630896] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-25T21:08:24.630968] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-25T21:08:24.631025] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-25T21:08:24.694920] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-25T21:08:25.017513] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:25.488715] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-25T21:08:25.738309] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T21:08:25.861862] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T21:08:25.886833] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-25T21:08:26.288782] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-25T21:08:27.088752] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-25T21:08:27.492461] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-25T21:08:27.888742] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-25T21:08:28.113908] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T21:08:28.688694] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-25T21:08:28.969736] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T21:08:29.023154] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-25T21:08:29.488805] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-25T21:08:30.288733] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-25T21:08:31.088683] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-25T21:08:31.242307] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T21:08:31.384193] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T21:08:31.388147] [INFO ] [REMOTE ] SAR: Full fetch complete (22437 records). [2025-09-25T21:08:31.388241] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-25T21:08:31.496093] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-25T21:08:31.787899] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-25T21:08:31.788002] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-25T21:08:31.788568] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-25T21:08:31.788633] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-25T21:08:31.789485] [DEBUG] [LOCAL ] SAR: Trimmed 22437 records to 16248 (keeping 200 days of data) [2025-09-25T21:08:31.891202] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-25T21:08:31.923299] [DEBUG] [LOCAL ] SAR: Primary data saved (16248 records). [2025-09-25T21:08:31.923503] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-25T21:08:31.923775] [INFO ] [MAIN ] Update Progress: 1869/2372 symbols completed. SAR took 36.7s. Estimated remaining: 1h 6m 52s. Rate: 7.5 symbols/min [2025-09-25T21:08:32.125037] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:32.125291] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-25T21:08:32.125347] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-25T21:08:32.125760] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-25T21:08:32.125809] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-25T21:08:32.125850] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-25T21:08:32.125938] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-25T21:08:32.382114] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T21:08:32.383117] [INFO ] [REMOTE ] SAT: Full fetch complete (1603 records). [2025-09-25T21:08:32.383192] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-25T21:08:32.689528] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-25T21:08:32.757824] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:32.772005] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-25T21:08:32.772201] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:08:32.772287] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:08:32.772386] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-25T21:08:32.772507] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-25T21:08:32.772578] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-25T21:08:32.772680] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-25T21:08:32.772769] [INFO ] [MAIN ] Update Progress: 1870/2372 symbols completed. SAT took 17.4s. Estimated remaining: 1h 6m 43s. Rate: 7.5 symbols/min [2025-09-25T21:08:32.955801] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:33.007350] [DEBUG] [LOCAL ] SB: Loaded 33316 existing records from primary storage. [2025-09-25T21:08:33.007504] [INFO ] [MAIN ] SB: Loaded 33316 existing records. [2025-09-25T21:08:33.272180] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:08:33.272575] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-25T21:08:33.272624] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-25T21:08:33.273098] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-25T21:08:33.273158] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-25T21:08:33.489375] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-25T21:08:33.654569] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:33.919151] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-25T21:08:34.288719] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-25T21:08:34.342131] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:08:34.688638] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T21:08:35.088765] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-25T21:08:35.888742] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-25T21:08:36.305752] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-25T21:08:36.688702] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-25T21:08:36.739849] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T21:08:37.086239] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-25T21:08:37.488770] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-25T21:08:38.288741] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-25T21:08:38.865216] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T21:08:39.088735] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-25T21:08:39.169065] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T21:08:39.576712] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-25T21:08:39.888770] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-25T21:08:40.292045] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T21:08:40.688816] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-25T21:08:41.488750] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-25T21:08:41.889949] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T21:08:42.288696] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-25T21:08:42.578326] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T21:08:42.673814] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-25T21:08:43.088736] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-25T21:08:43.575724] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T21:08:43.888723] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-25T21:08:44.688737] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-25T21:08:45.400158] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T21:08:45.488722] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-25T21:08:45.987265] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T21:08:46.288694] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-25T21:08:46.349349] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T21:08:46.360231] [INFO ] [REMOTE ] SARO: Full fetch complete (69090 records). [2025-09-25T21:08:46.360403] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-25T21:08:46.703679] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-25T21:08:46.814484] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-25T21:08:46.814600] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-25T21:08:46.815958] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-25T21:08:46.816030] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-25T21:08:46.818428] [DEBUG] [LOCAL ] SARO: Trimmed 69090 records to 49097 (keeping 200 days of data) [2025-09-25T21:08:47.088745] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-25T21:08:47.161582] [DEBUG] [LOCAL ] SARO: Primary data saved (49097 records). [2025-09-25T21:08:47.161779] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-25T21:08:47.162925] [INFO ] [MAIN ] Update Progress: 1871/2372 symbols completed. SARO took 38.8s. Estimated remaining: 1h 6m 36s. Rate: 7.5 symbols/min [2025-09-25T21:08:47.349984] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:47.350200] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-25T21:08:47.350257] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-25T21:08:47.351121] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-25T21:08:47.351167] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-25T21:08:47.351210] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-25T21:08:47.351243] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-25T21:08:47.635172] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-25T21:08:47.738241] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:47.888734] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-25T21:08:48.281835] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-25T21:08:48.282730] [INFO ] [REMOTE ] SAY: Full fetch complete (1418 records). [2025-09-25T21:08:48.282817] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-25T21:08:48.481702] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-25T21:08:48.481979] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:08:48.482047] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:08:48.482131] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-25T21:08:48.482227] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-25T21:08:48.482283] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-25T21:08:48.482327] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-25T21:08:48.482391] [INFO ] [MAIN ] Update Progress: 1872/2372 symbols completed. SAY took 24.0s. Estimated remaining: 1h 6m 27s. Rate: 7.5 symbols/min [2025-09-25T21:08:48.672091] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:08:48.688693] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-25T21:08:48.752255] [DEBUG] [LOCAL ] SBH: Loaded 49829 existing records from primary storage. [2025-09-25T21:08:48.752462] [INFO ] [MAIN ] SBH: Loaded 49829 existing records. [2025-09-25T21:08:48.940605] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:08:48.940966] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-25T21:08:48.941016] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-25T21:08:48.941351] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-25T21:08:48.941441] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-25T21:08:49.310950] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:08:49.488743] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-25T21:08:49.750494] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:49.750883] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-25T21:08:50.188516] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T21:08:50.288729] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-25T21:08:50.553144] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:50.553912] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-25T21:08:51.088727] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-25T21:08:51.339490] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:51.339892] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-25T21:08:51.888723] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-25T21:08:52.146240] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:52.146626] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-25T21:08:52.688733] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-25T21:08:52.971446] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:52.971828] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-25T21:08:53.488725] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-25T21:08:53.893545] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-25T21:08:54.288746] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-25T21:08:55.088739] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-25T21:08:55.888725] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-25T21:08:56.434461] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-25T21:08:56.623523] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:56.623965] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-25T21:08:56.688729] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-25T21:08:57.466998] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (3.18 seconds). [2025-09-25T21:08:57.488700] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-25T21:08:58.288730] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-25T21:08:58.545732] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:08:58.546163] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-25T21:08:58.842367] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-25T21:08:59.088754] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-25T21:08:59.156880] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:08:59.888786] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-25T21:09:00.294232] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-25T21:09:00.689772] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-25T21:09:00.705260] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T21:09:01.488721] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-25T21:09:02.288762] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-25T21:09:02.357782] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T21:09:02.696402] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-25T21:09:03.088731] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-25T21:09:03.159532] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:09:03.561200] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-25T21:09:03.562086] [INFO ] [REMOTE ] SAZ: Full fetch complete (1814 records). [2025-09-25T21:09:03.562160] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-25T21:09:03.818048] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T21:09:03.818292] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:09:03.818341] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:09:03.818382] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-25T21:09:03.818598] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-25T21:09:03.818898] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-25T21:09:03.818983] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-25T21:09:03.819089] [INFO ] [MAIN ] Update Progress: 1873/2372 symbols completed. SAZ took 31.9s. Estimated remaining: 1h 6m 20s. Rate: 7.5 symbols/min [2025-09-25T21:09:03.893812] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-25T21:09:04.020094] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:04.038240] [DEBUG] [LOCAL ] SBI: Loaded 7787 existing records from primary storage. [2025-09-25T21:09:04.038380] [INFO ] [MAIN ] SBI: Loaded 7787 existing records. [2025-09-25T21:09:04.225831] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:04.226157] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-25T21:09:04.226205] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-25T21:09:04.226495] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-25T21:09:04.226556] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-25T21:09:04.552261] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T21:09:04.629637] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:04.688718] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-25T21:09:05.488798] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-25T21:09:05.530849] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T21:09:06.107213] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T21:09:06.108733] [INFO ] [REMOTE ] SBDS: Full fetch complete (1117 records). [2025-09-25T21:09:06.108811] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-25T21:09:06.290113] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-25T21:09:06.333783] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-25T21:09:06.334144] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:09:06.334215] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:09:06.334322] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-25T21:09:06.334413] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-25T21:09:06.334471] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-25T21:09:06.334516] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-25T21:09:06.334588] [INFO ] [MAIN ] Update Progress: 1874/2372 symbols completed. SBDS took 19.2s. Estimated remaining: 1h 6m 11s. Rate: 7.5 symbols/min [2025-09-25T21:09:06.513507] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:06.528878] [DEBUG] [LOCAL ] SBR: Loaded 7179 existing records from primary storage. [2025-09-25T21:09:06.529070] [INFO ] [MAIN ] SBR: Loaded 7179 existing records. [2025-09-25T21:09:06.710025] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:06.710470] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-25T21:09:06.710521] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-25T21:09:06.710876] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-25T21:09:06.710940] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-25T21:09:07.076211] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:07.088681] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-25T21:09:07.888736] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-25T21:09:08.627013] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-25T21:09:08.688728] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-25T21:09:09.037277] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-25T21:09:09.488734] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-25T21:09:10.162687] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T21:09:10.204389] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-25T21:09:10.288802] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-25T21:09:10.304791] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T21:09:11.088732] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-25T21:09:11.758856] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T21:09:11.888732] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-25T21:09:12.688766] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-25T21:09:12.781125] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T21:09:12.931353] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T21:09:13.488759] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-25T21:09:13.839107] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T21:09:13.848176] [INFO ] [REMOTE ] SB: Full fetch complete (50449 records). [2025-09-25T21:09:13.848356] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-25T21:09:14.310832] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-25T21:09:14.333405] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T21:09:14.339333] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-25T21:09:14.339428] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-25T21:09:14.340471] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-25T21:09:14.340550] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-25T21:09:14.342045] [DEBUG] [LOCAL ] SB: Trimmed 50449 records to 33516 (keeping 200 days of data) [2025-09-25T21:09:14.575326] [DEBUG] [LOCAL ] SB: Primary data saved (33516 records). [2025-09-25T21:09:14.575511] [INFO ] [MAIN ] SB: Full history saved. [2025-09-25T21:09:14.575609] [INFO ] [MAIN ] Update Progress: 1875/2372 symbols completed. SB took 41.8s. Estimated remaining: 1h 6m 3s. Rate: 7.5 symbols/min [2025-09-25T21:09:14.759797] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:14.834500] [DEBUG] [LOCAL ] SBS: Loaded 49512 existing records from primary storage. [2025-09-25T21:09:14.834764] [INFO ] [MAIN ] SBS: Loaded 49512 existing records. [2025-09-25T21:09:15.036293] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:15.036772] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-25T21:09:15.036840] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-25T21:09:15.037228] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-25T21:09:15.037291] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-25T21:09:15.091458] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-25T21:09:15.116557] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T21:09:15.453196] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:15.888729] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-25T21:09:16.688740] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-25T21:09:16.719612] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T21:09:16.878285] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:09:17.488726] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-25T21:09:18.152381] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-25T21:09:18.288746] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-25T21:09:19.023395] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-25T21:09:19.088696] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-25T21:09:19.408061] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-25T21:09:19.888752] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-25T21:09:20.671393] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:09:20.688683] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-25T21:09:20.715802] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:09:21.488721] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-25T21:09:21.499819] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T21:09:22.288865] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-25T21:09:22.994276] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T21:09:23.088722] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-25T21:09:23.133666] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T21:09:23.888756] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-25T21:09:24.688796] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-25T21:09:24.781180] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:09:25.488794] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-25T21:09:25.551979] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T21:09:25.693239] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T21:09:26.288860] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-25T21:09:27.088742] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-25T21:09:27.307598] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T21:09:27.639024] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T21:09:27.781855] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T21:09:27.888750] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-25T21:09:28.688770] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-25T21:09:29.488720] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-25T21:09:29.784232] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T21:09:30.181817] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T21:09:30.288692] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-25T21:09:30.465501] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:09:30.480745] [INFO ] [REMOTE ] SBH: Full fetch complete (72798 records). [2025-09-25T21:09:30.481079] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-25T21:09:30.921492] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-25T21:09:30.921636] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-25T21:09:30.923376] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-25T21:09:30.923487] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-25T21:09:30.925586] [DEBUG] [LOCAL ] SBH: Trimmed 72798 records to 50195 (keeping 200 days of data) [2025-09-25T21:09:31.119599] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-25T21:09:31.203523] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T21:09:31.292440] [DEBUG] [LOCAL ] SBH: Primary data saved (50195 records). [2025-09-25T21:09:31.292723] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-25T21:09:31.293000] [INFO ] [MAIN ] Update Progress: 1876/2372 symbols completed. SBH took 42.8s. Estimated remaining: 1h 5m 57s. Rate: 7.5 symbols/min [2025-09-25T21:09:31.472748] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:31.498413] [DEBUG] [LOCAL ] SBSI: Loaded 14749 existing records from primary storage. [2025-09-25T21:09:31.498597] [INFO ] [MAIN ] SBSI: Loaded 14749 existing records. [2025-09-25T21:09:31.703462] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:31.703775] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-25T21:09:31.703844] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-25T21:09:31.704246] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-25T21:09:31.704334] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-25T21:09:31.889427] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-25T21:09:31.938601] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T21:09:31.941627] [INFO ] [REMOTE ] SBR: Full fetch complete (11039 records). [2025-09-25T21:09:31.941766] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-25T21:09:32.336002] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:32.578634] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-25T21:09:32.578772] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-25T21:09:32.579125] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-25T21:09:32.579172] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-25T21:09:32.579881] [DEBUG] [LOCAL ] SBR: Trimmed 11039 records to 7250 (keeping 200 days of data) [2025-09-25T21:09:32.637110] [DEBUG] [LOCAL ] SBR: Primary data saved (7250 records). [2025-09-25T21:09:32.637301] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-25T21:09:32.637451] [INFO ] [MAIN ] Update Progress: 1877/2372 symbols completed. SBR took 26.3s. Estimated remaining: 1h 5m 48s. Rate: 7.5 symbols/min [2025-09-25T21:09:32.688257] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T21:09:32.689168] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-25T21:09:33.488876] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-25T21:09:34.209983] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T21:09:34.285753] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T21:09:34.289332] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-25T21:09:34.939196] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T21:09:34.941126] [INFO ] [REMOTE ] SBI: Full fetch complete (10689 records). [2025-09-25T21:09:34.941204] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-25T21:09:35.098788] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-25T21:09:35.364926] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-25T21:09:35.365022] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-25T21:09:35.365312] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-25T21:09:35.365375] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-25T21:09:35.366088] [DEBUG] [LOCAL ] SBI: Trimmed 10689 records to 7807 (keeping 200 days of data) [2025-09-25T21:09:35.423474] [DEBUG] [LOCAL ] SBI: Primary data saved (7807 records). [2025-09-25T21:09:35.423636] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-25T21:09:35.423852] [INFO ] [MAIN ] Update Progress: 1878/2372 symbols completed. SBI took 31.6s. Estimated remaining: 1h 5m 38s. Rate: 7.5 symbols/min [2025-09-25T21:09:35.888735] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-25T21:09:36.778633] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T21:09:36.789591] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-25T21:09:36.926511] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T21:09:37.488762] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-25T21:09:38.677169] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T21:09:38.691055] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-25T21:09:38.716695] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:09:39.088737] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-25T21:09:39.993042] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T21:09:39.996278] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-25T21:09:40.521727] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T21:09:40.688680] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-25T21:09:40.995482] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T21:09:41.488727] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-25T21:09:42.439759] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:09:42.449740] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T21:09:42.460837] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-25T21:09:42.461027] [INFO ] [REMOTE ] SBS: Full fetch complete (70137 records). [2025-09-25T21:09:42.461987] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-25T21:09:42.918335] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-25T21:09:42.918444] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-25T21:09:42.919708] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-25T21:09:42.919780] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-25T21:09:42.921324] [DEBUG] [LOCAL ] SBS: Trimmed 70137 records to 49864 (keeping 200 days of data) [2025-09-25T21:09:43.237872] [DEBUG] [LOCAL ] SBS: Primary data saved (49864 records). [2025-09-25T21:09:43.238033] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-25T21:09:43.239391] [INFO ] [MAIN ] Update Progress: 1879/2372 symbols completed. SBS took 28.7s. Estimated remaining: 1h 5m 30s. Rate: 7.5 symbols/min [2025-09-25T21:09:43.459591] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-25T21:09:43.463128] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-25T21:09:44.467119] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T21:09:44.471000] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-25T21:09:45.503351] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:09:45.507187] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-25T21:09:46.543372] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T21:09:46.547171] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-25T21:09:47.443982] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T21:09:47.447497] [INFO ] [REMOTE ] SBSI: Full fetch complete (21188 records). [2025-09-25T21:09:47.447588] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-25T21:09:47.855052] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-25T21:09:47.855148] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-25T21:09:47.855773] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-25T21:09:47.855842] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-25T21:09:47.856754] [DEBUG] [LOCAL ] SBSI: Trimmed 21188 records to 14872 (keeping 200 days of data) [2025-09-25T21:09:47.952194] [DEBUG] [LOCAL ] SBSI: Primary data saved (14872 records). [2025-09-25T21:09:47.952351] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-25T21:09:47.952445] [INFO ] [MAIN ] Update Progress: 1880/2372 symbols completed. SBSI took 16.7s. Estimated remaining: 1h 5m 22s. Rate: 7.5 symbols/min [2025-09-25T21:09:48.641253] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:48.713521] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:48.781123] [DEBUG] [LOCAL ] SCD: Loaded 12596 existing records from primary storage. [2025-09-25T21:09:48.803481] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:48.791908] [INFO ] [MAIN ] SCD: Loaded 12596 existing records. [2025-09-25T21:09:48.844572] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:09:48.866976] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-25T21:09:48.867085] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-25T21:09:48.867261] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-25T21:09:48.867306] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-25T21:09:48.867351] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-25T21:09:48.867395] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-25T21:09:49.011198] [DEBUG] [LOCAL ] SCCO: Loaded 49388 existing records from primary storage. [2025-09-25T21:09:49.011396] [INFO ] [MAIN ] SCCO: Loaded 49388 existing records. [2025-09-25T21:09:49.029486] [DEBUG] [LOCAL ] SBSW: Loaded 52965 existing records from primary storage. [2025-09-25T21:09:49.029702] [INFO ] [MAIN ] SBSW: Loaded 52965 existing records. [2025-09-25T21:09:49.615685] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:49.615962] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-25T21:09:49.616012] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-25T21:09:49.616317] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-25T21:09:49.616407] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-25T21:09:49.787780] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:49.788129] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-25T21:09:49.788239] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-25T21:09:49.788728] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-25T21:09:49.788790] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-25T21:09:49.877257] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:09:49.877583] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-25T21:09:49.877632] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-25T21:09:49.892065] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-25T21:09:49.892128] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-25T21:09:50.370627] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:50.371083] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-25T21:09:50.771542] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T21:09:50.829488] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-25T21:09:51.107455] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:51.107857] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-25T21:09:51.127198] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:51.127490] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-25T21:09:51.176920] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-25T21:09:51.178032] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-25T21:09:51.243896] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:09:51.244239] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-25T21:09:51.581574] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T21:09:51.582723] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-25T21:09:51.856440] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-25T21:09:51.888670] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-25T21:09:51.929671] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T21:09:52.178671] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-25T21:09:52.688696] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-25T21:09:52.797906] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T21:09:53.060057] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T21:09:53.484110] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T21:09:53.488663] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-25T21:09:54.288768] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-25T21:09:54.310707] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T21:09:54.688071] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T21:09:55.088758] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-25T21:09:55.888735] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-25T21:09:55.977446] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T21:09:56.688777] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-25T21:09:57.488767] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-25T21:09:57.879702] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T21:09:58.091810] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T21:09:58.109512] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T21:09:58.288895] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-25T21:09:59.088783] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-25T21:09:59.888747] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-25T21:09:59.950785] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T21:10:00.084127] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:10:00.450897] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T21:10:00.688821] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-25T21:10:01.420575] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T21:10:01.488739] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-25T21:10:02.288781] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-25T21:10:03.088737] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-25T21:10:03.601481] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-25T21:10:03.634369] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T21:10:03.888715] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-25T21:10:04.334835] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T21:10:04.335787] [INFO ] [REMOTE ] SBXD: Full fetch complete (3082 records). [2025-09-25T21:10:04.335899] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-25T21:10:04.467604] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T21:10:04.599261] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-25T21:10:04.600908] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:10:04.601017] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:10:04.601122] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-25T21:10:04.601215] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-25T21:10:04.601286] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-25T21:10:04.601366] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-25T21:10:04.601533] [INFO ] [MAIN ] Update Progress: 1881/2372 symbols completed. SBXD took 16.6s. Estimated remaining: 1h 5m 16s. Rate: 7.5 symbols/min [2025-09-25T21:10:04.694735] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-25T21:10:04.796487] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:04.886634] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-25T21:10:04.886820] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-09-25T21:10:05.079418] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:05.080041] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-25T21:10:05.080090] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-25T21:10:05.080531] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-25T21:10:05.080591] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-25T21:10:05.460247] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:05.488748] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-25T21:10:06.288688] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-25T21:10:06.703007] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:10:07.088700] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-25T21:10:07.532834] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T21:10:07.827123] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T21:10:07.888735] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-25T21:10:08.295281] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-25T21:10:08.688755] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-25T21:10:09.488719] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-25T21:10:09.908335] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T21:10:10.288694] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-25T21:10:10.395375] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T21:10:11.088754] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-25T21:10:11.654885] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-25T21:10:11.888725] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-25T21:10:12.155181] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T21:10:12.688805] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-25T21:10:12.969896] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-25T21:10:13.488713] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-25T21:10:13.795708] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T21:10:14.288738] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-25T21:10:14.823945] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-25T21:10:14.860215] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:10:15.088709] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-25T21:10:15.888704] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-25T21:10:16.372301] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T21:10:16.688723] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-25T21:10:17.217202] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-25T21:10:17.316279] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T21:10:17.488733] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-25T21:10:18.288689] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-25T21:10:18.456063] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T21:10:18.960540] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-25T21:10:19.088729] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-25T21:10:19.888736] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-25T21:10:20.397791] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-25T21:10:20.458039] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-25T21:10:20.467473] [INFO ] [REMOTE ] SCCO: Full fetch complete (70810 records). [2025-09-25T21:10:20.467786] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-25T21:10:20.583313] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T21:10:20.590669] [INFO ] [REMOTE ] SCD: Full fetch complete (16253 records). [2025-09-25T21:10:20.590816] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-25T21:10:20.693013] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-25T21:10:21.210351] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-25T21:10:21.210535] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-25T21:10:21.211813] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-25T21:10:21.211901] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-25T21:10:21.218174] [DEBUG] [LOCAL ] SCCO: Trimmed 70810 records to 49775 (keeping 200 days of data) [2025-09-25T21:10:21.492843] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-25T21:10:21.696446] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-25T21:10:21.696891] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-25T21:10:21.697125] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-25T21:10:21.697170] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-25T21:10:21.700022] [DEBUG] [LOCAL ] SCD: Trimmed 16253 records to 12668 (keeping 200 days of data) [2025-09-25T21:10:21.803021] [DEBUG] [LOCAL ] SCD: Primary data saved (12668 records). [2025-09-25T21:10:21.803251] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-25T21:10:21.803447] [INFO ] [MAIN ] Update Progress: 1882/2372 symbols completed. SCD took 33.8s. Estimated remaining: 1h 5m 10s. Rate: 7.5 symbols/min [2025-09-25T21:10:22.000735] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:22.128620] [DEBUG] [LOCAL ] SCI: Loaded 46671 existing records from primary storage. [2025-09-25T21:10:22.132502] [INFO ] [MAIN ] SCI: Loaded 46671 existing records. [2025-09-25T21:10:22.137735] [DEBUG] [LOCAL ] SCCO: Primary data saved (49775 records). [2025-09-25T21:10:22.137878] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-25T21:10:22.138006] [INFO ] [MAIN ] Update Progress: 1883/2372 symbols completed. SCCO took 34.2s. Estimated remaining: 1h 5m 0s. Rate: 7.5 symbols/min [2025-09-25T21:10:22.523016] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:22.553476] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:22.574060] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-25T21:10:22.574200] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-25T21:10:22.574907] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-25T21:10:22.575000] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-25T21:10:22.641249] [DEBUG] [LOCAL ] SCL: Loaded 14862 existing records from primary storage. [2025-09-25T21:10:22.641393] [INFO ] [MAIN ] SCL: Loaded 14862 existing records. [2025-09-25T21:10:22.659763] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-25T21:10:22.739331] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-25T21:10:23.059499] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:23.059769] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-25T21:10:23.059828] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-25T21:10:23.060150] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-25T21:10:23.060209] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-25T21:10:23.445173] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:23.445621] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-25T21:10:23.598068] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-25T21:10:23.685572] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:23.888708] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-25T21:10:24.704724] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-25T21:10:24.708371] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-25T21:10:25.043012] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T21:10:25.488693] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-25T21:10:25.615945] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-25T21:10:25.944500] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-25T21:10:25.960126] [INFO ] [REMOTE ] SBSW: Full fetch complete (76497 records). [2025-09-25T21:10:25.960365] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-25T21:10:26.293871] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-25T21:10:26.568245] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-25T21:10:26.568380] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-25T21:10:26.570434] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-25T21:10:26.570633] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-25T21:10:26.573249] [DEBUG] [LOCAL ] SBSW: Trimmed 76497 records to 53355 (keeping 200 days of data) [2025-09-25T21:10:26.986583] [DEBUG] [LOCAL ] SBSW: Primary data saved (53355 records). [2025-09-25T21:10:26.986793] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-25T21:10:26.988786] [INFO ] [MAIN ] Update Progress: 1884/2372 symbols completed. SBSW took 39.0s. Estimated remaining: 1h 4m 52s. Rate: 7.5 symbols/min [2025-09-25T21:10:27.093786] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-25T21:10:27.215039] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:27.238031] [DEBUG] [LOCAL ] SCM: Loaded 19803 existing records from primary storage. [2025-09-25T21:10:27.238214] [INFO ] [MAIN ] SCM: Loaded 19803 existing records. [2025-09-25T21:10:27.355623] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T21:10:27.442454] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:27.442748] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-25T21:10:27.442808] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-25T21:10:27.443292] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-25T21:10:27.443355] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-25T21:10:27.706323] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-25T21:10:27.889305] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-25T21:10:27.889251] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:28.609636] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T21:10:28.688730] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-25T21:10:28.759610] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T21:10:29.488758] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-25T21:10:29.817267] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T21:10:30.186693] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-25T21:10:30.288768] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-25T21:10:31.088739] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-25T21:10:31.888693] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-25T21:10:32.007751] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T21:10:32.150671] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T21:10:32.403670] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T21:10:32.416896] [INFO ] [REMOTE ] SCHW: Full fetch complete (77702 records). [2025-09-25T21:10:32.417134] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-25T21:10:32.691372] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-25T21:10:32.894211] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-25T21:10:32.894312] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-25T21:10:32.895633] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-25T21:10:32.895739] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-25T21:10:32.897521] [DEBUG] [LOCAL ] SCHW: Trimmed 77702 records to 54075 (keeping 200 days of data) [2025-09-25T21:10:33.254429] [DEBUG] [LOCAL ] SCHW: Primary data saved (54075 records). [2025-09-25T21:10:33.254588] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-25T21:10:33.254730] [INFO ] [MAIN ] Update Progress: 1885/2372 symbols completed. SCHW took 28.7s. Estimated remaining: 1h 4m 43s. Rate: 7.5 symbols/min [2025-09-25T21:10:33.431999] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:33.481460] [DEBUG] [LOCAL ] SCS: Loaded 43120 existing records from primary storage. [2025-09-25T21:10:33.481616] [INFO ] [MAIN ] SCS: Loaded 43120 existing records. [2025-09-25T21:10:33.495309] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-25T21:10:33.702233] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:33.703754] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-25T21:10:33.703815] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-25T21:10:33.704181] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-25T21:10:33.704242] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-25T21:10:34.085196] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:34.288705] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-25T21:10:34.480247] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-25T21:10:34.703123] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T21:10:35.088723] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-25T21:10:35.577437] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T21:10:35.888702] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-25T21:10:36.269684] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T21:10:36.688733] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-25T21:10:37.473320] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:10:37.488678] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-25T21:10:37.585336] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T21:10:38.288760] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-25T21:10:39.059433] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T21:10:39.088690] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-25T21:10:39.135183] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T21:10:39.888728] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-25T21:10:40.688750] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-25T21:10:41.009939] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:10:41.488699] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-25T21:10:41.612302] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T21:10:41.774590] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-25T21:10:42.101490] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T21:10:42.288713] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-25T21:10:43.088739] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-25T21:10:43.888694] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-25T21:10:44.070605] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T21:10:44.564411] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T21:10:44.688738] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-25T21:10:44.735002] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T21:10:45.488755] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-25T21:10:46.061859] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-25T21:10:46.288754] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-25T21:10:47.088724] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-25T21:10:47.122551] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T21:10:47.631873] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T21:10:47.635562] [INFO ] [REMOTE ] SCL: Full fetch complete (21102 records). [2025-09-25T21:10:47.635684] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-25T21:10:47.889540] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-25T21:10:48.134045] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-25T21:10:48.134139] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-25T21:10:48.134607] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-25T21:10:48.137945] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-25T21:10:48.139070] [DEBUG] [LOCAL ] SCL: Trimmed 21102 records to 15001 (keeping 200 days of data) [2025-09-25T21:10:48.268808] [DEBUG] [LOCAL ] SCL: Primary data saved (15001 records). [2025-09-25T21:10:48.268983] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-25T21:10:48.269123] [INFO ] [MAIN ] Update Progress: 1886/2372 symbols completed. SCL took 26.1s. Estimated remaining: 1h 4m 37s. Rate: 7.5 symbols/min [2025-09-25T21:10:48.534849] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:48.593152] [DEBUG] [LOCAL ] SD: Loaded 28979 existing records from primary storage. [2025-09-25T21:10:48.593328] [INFO ] [MAIN ] SD: Loaded 28979 existing records. [2025-09-25T21:10:48.695802] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-25T21:10:48.758487] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T21:10:48.841855] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:48.842536] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-25T21:10:48.842591] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-25T21:10:48.842971] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-25T21:10:48.843033] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-25T21:10:49.195941] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T21:10:49.241547] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:49.488842] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-25T21:10:50.288701] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-25T21:10:50.353008] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T21:10:51.088707] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-25T21:10:51.291384] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T21:10:51.366221] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T21:10:51.888740] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-25T21:10:52.688738] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-25T21:10:52.762331] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T21:10:53.488707] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-25T21:10:53.650319] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:10:53.932190] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T21:10:54.288733] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-25T21:10:54.968294] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T21:10:55.088725] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-25T21:10:55.887592] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T21:10:55.895178] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-25T21:10:55.898448] [INFO ] [REMOTE ] SCI: Full fetch complete (67206 records). [2025-09-25T21:10:55.898565] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-25T21:10:56.360884] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-25T21:10:56.360988] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-25T21:10:56.362099] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-25T21:10:56.362169] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-25T21:10:56.363696] [DEBUG] [LOCAL ] SCI: Trimmed 67206 records to 46946 (keeping 200 days of data) [2025-09-25T21:10:56.690950] [DEBUG] [LOCAL ] SCI: Primary data saved (46946 records). [2025-09-25T21:10:56.691122] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-25T21:10:56.691225] [INFO ] [MAIN ] Update Progress: 1887/2372 symbols completed. SCI took 34.9s. Estimated remaining: 1h 4m 29s. Rate: 7.5 symbols/min [2025-09-25T21:10:56.689742] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-25T21:10:56.869419] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:10:56.900598] [INFO ] [REMOTE ] SCS: Full fetch complete (60194 records). [2025-09-25T21:10:56.922190] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-25T21:10:56.958922] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:57.102481] [DEBUG] [LOCAL ] SDHC: Loaded 10459 existing records from primary storage. [2025-09-25T21:10:57.102687] [INFO ] [MAIN ] SDHC: Loaded 10459 existing records. [2025-09-25T21:10:57.263926] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:10:57.505048] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-25T21:10:57.509357] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:57.516910] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-25T21:10:57.516964] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-25T21:10:57.517175] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-25T21:10:57.517235] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-25T21:10:57.873719] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T21:10:57.886940] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-25T21:10:57.902843] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-25T21:10:57.904268] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-25T21:10:57.904348] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-25T21:10:57.945547] [DEBUG] [LOCAL ] SCS: Trimmed 60194 records to 43480 (keeping 200 days of data) [2025-09-25T21:10:58.237481] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:58.302158] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-25T21:10:58.406138] [DEBUG] [LOCAL ] SCS: Primary data saved (43480 records). [2025-09-25T21:10:58.406308] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-25T21:10:58.406443] [INFO ] [MAIN ] Update Progress: 1888/2372 symbols completed. SCS took 25.2s. Estimated remaining: 1h 4m 20s. Rate: 7.5 symbols/min [2025-09-25T21:10:58.597509] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:10:58.615228] [DEBUG] [LOCAL ] SDHY: Loaded 10565 existing records from primary storage. [2025-09-25T21:10:58.615375] [INFO ] [MAIN ] SDHY: Loaded 10565 existing records. [2025-09-25T21:10:58.810472] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:10:58.811324] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-25T21:10:58.811378] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-25T21:10:58.811561] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-25T21:10:58.811619] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-25T21:10:59.029035] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T21:10:59.093884] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-25T21:10:59.248070] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:10:59.398451] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:10:59.888765] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-25T21:11:00.604581] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T21:11:00.688773] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-25T21:11:01.121762] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T21:11:01.488735] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-25T21:11:01.824867] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T21:11:02.288736] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-25T21:11:02.316462] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T21:11:03.088834] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-25T21:11:03.558409] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T21:11:03.735741] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-25T21:11:03.888716] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-25T21:11:04.688838] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-25T21:11:05.311685] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T21:11:05.488735] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-25T21:11:05.700095] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T21:11:06.100565] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T21:11:06.288737] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-25T21:11:07.088756] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-25T21:11:07.152430] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T21:11:07.888756] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-25T21:11:08.001246] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:11:08.688736] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-25T21:11:09.000688] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T21:11:09.008767] [INFO ] [REMOTE ] SCM: Full fetch complete (28387 records). [2025-09-25T21:11:09.009028] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-25T21:11:09.461409] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-25T21:11:09.461546] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-25T21:11:09.462359] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-25T21:11:09.462508] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-25T21:11:09.463550] [DEBUG] [LOCAL ] SCM: Trimmed 28387 records to 19974 (keeping 200 days of data) [2025-09-25T21:11:09.531435] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-25T21:11:09.604838] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-25T21:11:09.635460] [DEBUG] [LOCAL ] SCM: Primary data saved (19974 records). [2025-09-25T21:11:09.635639] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-25T21:11:09.635876] [INFO ] [MAIN ] Update Progress: 1889/2372 symbols completed. SCM took 42.6s. Estimated remaining: 1h 4m 12s. Rate: 7.5 symbols/min [2025-09-25T21:11:09.817185] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:09.882510] [DEBUG] [LOCAL ] SDRL: Loaded 41884 existing records from primary storage. [2025-09-25T21:11:09.882718] [INFO ] [MAIN ] SDRL: Loaded 41884 existing records. [2025-09-25T21:11:10.081369] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:10.084313] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-25T21:11:10.084377] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-25T21:11:10.084801] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-25T21:11:10.084878] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-25T21:11:10.293265] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-25T21:11:10.465315] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:10.896434] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:11:11.088697] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-25T21:11:11.403750] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:11:11.888767] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-25T21:11:12.549610] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:11:12.688700] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-25T21:11:12.921436] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T21:11:13.488721] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-25T21:11:14.288717] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-25T21:11:14.493485] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:11:14.700785] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T21:11:14.710010] [INFO ] [REMOTE ] SD: Full fetch complete (41116 records). [2025-09-25T21:11:14.710352] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-25T21:11:15.096991] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-25T21:11:15.148089] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-25T21:11:15.148182] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-25T21:11:15.149099] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-25T21:11:15.149163] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-25T21:11:15.152527] [DEBUG] [LOCAL ] SD: Trimmed 41116 records to 29168 (keeping 200 days of data) [2025-09-25T21:11:15.166112] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T21:11:15.362803] [DEBUG] [LOCAL ] SD: Primary data saved (29168 records). [2025-09-25T21:11:15.362952] [INFO ] [MAIN ] SD: Full history saved. [2025-09-25T21:11:15.363097] [INFO ] [MAIN ] Update Progress: 1890/2372 symbols completed. SD took 27.1s. Estimated remaining: 1h 4m 4s. Rate: 7.5 symbols/min [2025-09-25T21:11:15.549374] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:15.549594] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-25T21:11:15.549665] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-25T21:11:15.550015] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-25T21:11:15.550068] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-25T21:11:15.550592] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-25T21:11:15.550671] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-25T21:11:15.893811] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-25T21:11:16.069546] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:16.078746] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T21:11:16.688766] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-25T21:11:17.488702] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-25T21:11:17.557765] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T21:11:17.566309] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:11:18.288775] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-25T21:11:18.385062] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T21:11:19.088800] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-25T21:11:19.888711] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-25T21:11:19.982826] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T21:11:20.017405] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T21:11:20.688759] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-25T21:11:21.488740] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-25T21:11:22.077217] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-25T21:11:22.096078] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T21:11:22.288696] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-25T21:11:22.399000] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T21:11:23.088760] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-25T21:11:23.114472] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T21:11:23.888747] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-25T21:11:24.688711] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-25T21:11:24.812591] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T21:11:25.073761] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T21:11:25.488719] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-25T21:11:26.288732] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-25T21:11:26.384043] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T21:11:27.000398] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T21:11:27.005547] [INFO ] [REMOTE ] SDHY: Full fetch complete (15990 records). [2025-09-25T21:11:27.005701] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-25T21:11:27.096551] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-25T21:11:27.451213] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-25T21:11:27.451308] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-25T21:11:27.451736] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-25T21:11:27.451800] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-25T21:11:27.452374] [DEBUG] [LOCAL ] SDHY: Trimmed 15990 records to 10653 (keeping 200 days of data) [2025-09-25T21:11:27.526950] [DEBUG] [LOCAL ] SDHY: Primary data saved (10653 records). [2025-09-25T21:11:27.527107] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-25T21:11:27.527238] [INFO ] [MAIN ] Update Progress: 1891/2372 symbols completed. SDHY took 29.1s. Estimated remaining: 1h 3m 57s. Rate: 7.5 symbols/min [2025-09-25T21:11:27.635173] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-25T21:11:27.795069] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:27.863793] [DEBUG] [LOCAL ] SEE: Loaded 48341 existing records from primary storage. [2025-09-25T21:11:27.863960] [INFO ] [MAIN ] SEE: Loaded 48341 existing records. [2025-09-25T21:11:27.897710] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-25T21:11:28.070206] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:28.070709] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-25T21:11:28.070780] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-25T21:11:28.071250] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-25T21:11:28.071311] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-25T21:11:28.526130] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:28.688722] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-25T21:11:28.757024] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:11:29.488762] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-25T21:11:30.295999] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-25T21:11:30.317814] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T21:11:30.345378] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-25T21:11:30.803116] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:11:30.901733] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-25T21:11:31.088735] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-25T21:11:31.888739] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-25T21:11:32.688744] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-25T21:11:33.449148] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-25T21:11:33.493972] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-25T21:11:33.508848] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T21:11:33.548008] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T21:11:33.551108] [INFO ] [REMOTE ] SDHC: Full fetch complete (17075 records). [2025-09-25T21:11:33.551203] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-25T21:11:33.939982] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-25T21:11:33.940067] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-25T21:11:33.940447] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-25T21:11:33.940487] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-25T21:11:33.941738] [DEBUG] [LOCAL ] SDHC: Trimmed 17075 records to 10574 (keeping 200 days of data) [2025-09-25T21:11:34.004718] [DEBUG] [LOCAL ] SDHC: Primary data saved (10574 records). [2025-09-25T21:11:34.004867] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-25T21:11:34.005453] [INFO ] [MAIN ] Update Progress: 1892/2372 symbols completed. SDHC took 37.3s. Estimated remaining: 1h 3m 49s. Rate: 7.5 symbols/min [2025-09-25T21:11:34.183937] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:34.206267] [DEBUG] [LOCAL ] SEG: Loaded 13754 existing records from primary storage. [2025-09-25T21:11:34.206461] [INFO ] [MAIN ] SEG: Loaded 13754 existing records. [2025-09-25T21:11:34.293869] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-25T21:11:34.440007] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:34.440273] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-25T21:11:34.440319] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-25T21:11:34.440749] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-25T21:11:34.440813] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-25T21:11:34.846966] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:35.088760] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-25T21:11:35.242990] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T21:11:35.888733] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-25T21:11:36.449363] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T21:11:36.514263] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-25T21:11:36.688734] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-25T21:11:37.152297] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T21:11:37.488761] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-25T21:11:38.288701] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-25T21:11:38.366358] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T21:11:38.887889] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-25T21:11:39.088728] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-25T21:11:39.727734] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T21:11:39.888730] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-25T21:11:40.632282] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:11:40.640689] [INFO ] [REMOTE ] SDRL: Full fetch complete (61903 records). [2025-09-25T21:11:40.640922] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-25T21:11:40.693913] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-25T21:11:41.069926] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-25T21:11:41.070034] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-25T21:11:41.071073] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-25T21:11:41.071142] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-25T21:11:41.072681] [DEBUG] [LOCAL ] SDRL: Trimmed 61903 records to 42248 (keeping 200 days of data) [2025-09-25T21:11:41.343164] [DEBUG] [LOCAL ] SDRL: Primary data saved (42248 records). [2025-09-25T21:11:41.343310] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-25T21:11:41.344715] [INFO ] [MAIN ] Update Progress: 1893/2372 symbols completed. SDRL took 31.7s. Estimated remaining: 1h 3m 40s. Rate: 7.5 symbols/min [2025-09-25T21:11:41.494726] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-25T21:11:41.580729] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:41.654256] [DEBUG] [LOCAL ] SEI: Loaded 49645 existing records from primary storage. [2025-09-25T21:11:41.654421] [INFO ] [MAIN ] SEI: Loaded 49645 existing records. [2025-09-25T21:11:41.815638] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:11:41.913676] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:41.913982] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-25T21:11:41.914027] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-25T21:11:41.914405] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-25T21:11:41.914463] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-25T21:11:42.304115] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-25T21:11:42.311106] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:42.547363] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T21:11:42.718944] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T21:11:43.088717] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-25T21:11:43.865028] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T21:11:43.888704] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-25T21:11:44.340630] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T21:11:44.688740] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-25T21:11:45.488750] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-25T21:11:45.630159] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T21:11:46.288732] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-25T21:11:46.816350] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-25T21:11:46.866504] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T21:11:47.088739] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-25T21:11:47.287327] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T21:11:47.888695] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-25T21:11:47.992000] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T21:11:48.006720] [INFO ] [REMOTE ] SE: Full fetch complete (76680 records). [2025-09-25T21:11:48.006905] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-25T21:11:48.008847] [FATAL] [VALIDATOR ] SE: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T21:11:48.008962] [FATAL] [MAIN ] SE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:11:48.009006] [WARN ] [MAIN ] SE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:11:48.009044] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-25T21:11:48.009130] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-25T21:11:48.009186] [INFO ] [LOCAL ] SE: Starting deletion of derivative data. [2025-09-25T21:11:48.009305] [DEBUG] [LOCAL ] SE: No derivative data file found to delete. [2025-09-25T21:11:48.009394] [INFO ] [MAIN ] Update Progress: 1894/2372 symbols completed. SE took 32.6s. Estimated remaining: 1h 3m 32s. Rate: 7.5 symbols/min [2025-09-25T21:11:48.208418] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:48.277189] [DEBUG] [LOCAL ] SEM: Loaded 42940 existing records from primary storage. [2025-09-25T21:11:48.277345] [INFO ] [MAIN ] SEM: Loaded 42940 existing records. [2025-09-25T21:11:48.470708] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:48.470964] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-25T21:11:48.471097] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-25T21:11:48.471389] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-25T21:11:48.471448] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-25T21:11:48.694731] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-25T21:11:48.867196] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:49.488734] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-25T21:11:49.668886] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:11:50.168765] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T21:11:50.288757] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-25T21:11:50.933227] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:11:51.088732] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-25T21:11:51.888720] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-25T21:11:52.029876] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T21:11:52.196595] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:11:52.688738] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-25T21:11:53.443682] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T21:11:53.488681] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-25T21:11:54.092858] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T21:11:54.288729] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-25T21:11:54.677827] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T21:11:55.088758] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-25T21:11:55.888737] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-25T21:11:56.004315] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T21:11:56.013711] [INFO ] [REMOTE ] SEE: Full fetch complete (69586 records). [2025-09-25T21:11:56.013878] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-25T21:11:56.455002] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-25T21:11:56.455164] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-25T21:11:56.456327] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-25T21:11:56.456476] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-25T21:11:56.458033] [DEBUG] [LOCAL ] SEE: Trimmed 69586 records to 48710 (keeping 200 days of data) [2025-09-25T21:11:56.713351] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-25T21:11:56.812258] [DEBUG] [LOCAL ] SEE: Primary data saved (48710 records). [2025-09-25T21:11:56.812414] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-25T21:11:56.812508] [INFO ] [MAIN ] Update Progress: 1895/2372 symbols completed. SEE took 29.3s. Estimated remaining: 1h 3m 24s. Rate: 7.5 symbols/min [2025-09-25T21:11:57.037323] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T21:11:57.041672] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:11:57.107566] [DEBUG] [LOCAL ] SEMR: Loaded 41586 existing records from primary storage. [2025-09-25T21:11:57.107744] [INFO ] [MAIN ] SEMR: Loaded 41586 existing records. [2025-09-25T21:11:57.304519] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:11:57.306272] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-25T21:11:57.306323] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-25T21:11:57.306603] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-25T21:11:57.306697] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-25T21:11:57.496433] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-25T21:11:57.570079] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:11:57.741732] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T21:11:57.763285] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:11:58.288741] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-25T21:11:59.088687] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-25T21:11:59.743156] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:11:59.815210] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-25T21:11:59.888735] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-25T21:12:00.051281] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T21:12:00.688719] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-25T21:12:01.488736] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-25T21:12:01.581093] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T21:12:01.621209] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:12:02.288730] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-25T21:12:03.065717] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T21:12:03.088692] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-25T21:12:03.888699] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-25T21:12:04.216958] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T21:12:04.475685] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T21:12:04.678757] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:12:04.695470] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-25T21:12:05.488724] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-25T21:12:06.288745] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-25T21:12:06.515079] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T21:12:06.591501] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T21:12:07.088719] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-25T21:12:07.335594] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T21:12:07.888736] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-25T21:12:08.688739] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-25T21:12:08.738487] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T21:12:09.488703] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-25T21:12:09.541400] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:12:09.565247] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T21:12:09.568242] [INFO ] [REMOTE ] SEG: Full fetch complete (19778 records). [2025-09-25T21:12:09.568360] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-25T21:12:10.005916] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-25T21:12:10.006005] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-25T21:12:10.006628] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-25T21:12:10.006715] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-25T21:12:10.007559] [DEBUG] [LOCAL ] SEG: Trimmed 19778 records to 13814 (keeping 200 days of data) [2025-09-25T21:12:10.104631] [DEBUG] [LOCAL ] SEG: Primary data saved (13814 records). [2025-09-25T21:12:10.104818] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-25T21:12:10.104949] [INFO ] [MAIN ] Update Progress: 1896/2372 symbols completed. SEG took 36.1s. Estimated remaining: 1h 3m 18s. Rate: 7.5 symbols/min [2025-09-25T21:12:10.288706] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-25T21:12:10.288592] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:10.362842] [DEBUG] [LOCAL ] SES: Loaded 51552 existing records from primary storage. [2025-09-25T21:12:10.363001] [INFO ] [MAIN ] SES: Loaded 51552 existing records. [2025-09-25T21:12:10.545265] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:10.545529] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-25T21:12:10.545578] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-25T21:12:10.545987] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-25T21:12:10.546050] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-25T21:12:10.950541] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:11.088705] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-25T21:12:11.159596] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T21:12:11.669299] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T21:12:11.888715] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-25T21:12:12.688733] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-25T21:12:12.955250] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:12:13.488887] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-25T21:12:13.769109] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T21:12:14.180620] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T21:12:14.188940] [INFO ] [REMOTE ] SEM: Full fetch complete (61616 records). [2025-09-25T21:12:14.189077] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-25T21:12:14.295140] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-25T21:12:14.653786] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-25T21:12:14.654100] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-25T21:12:14.655339] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-25T21:12:14.655460] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-25T21:12:14.657022] [DEBUG] [LOCAL ] SEM: Trimmed 61616 records to 43243 (keeping 200 days of data) [2025-09-25T21:12:14.989059] [DEBUG] [LOCAL ] SEM: Primary data saved (43243 records). [2025-09-25T21:12:14.989211] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-25T21:12:14.989402] [INFO ] [MAIN ] Update Progress: 1897/2372 symbols completed. SEM took 27.0s. Estimated remaining: 1h 3m 9s. Rate: 7.5 symbols/min [2025-09-25T21:12:15.093857] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-25T21:12:15.143603] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T21:12:15.239127] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:15.300044] [DEBUG] [LOCAL ] SF: Loaded 41759 existing records from primary storage. [2025-09-25T21:12:15.300207] [INFO ] [MAIN ] SF: Loaded 41759 existing records. [2025-09-25T21:12:15.499242] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:15.499735] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-25T21:12:15.499795] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-25T21:12:15.500371] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-25T21:12:15.500445] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-25T21:12:15.909912] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:15.902454] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-25T21:12:16.327965] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-25T21:12:16.688749] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-25T21:12:17.448838] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T21:12:17.488687] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-25T21:12:17.861132] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T21:12:17.976567] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.88 seconds). [2025-09-25T21:12:18.288770] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-25T21:12:19.067539] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T21:12:19.088720] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-25T21:12:19.897783] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-25T21:12:19.925536] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T21:12:20.688744] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-25T21:12:20.850802] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-25T21:12:21.488740] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-25T21:12:21.751009] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T21:12:21.765025] [INFO ] [REMOTE ] SEI: Full fetch complete (69689 records). [2025-09-25T21:12:21.765226] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-25T21:12:22.223244] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-25T21:12:22.223371] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-25T21:12:22.224631] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-25T21:12:22.224734] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-25T21:12:22.227378] [DEBUG] [LOCAL ] SEI: Trimmed 69689 records to 50031 (keeping 200 days of data) [2025-09-25T21:12:22.300675] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-25T21:12:22.409715] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T21:12:22.418510] [INFO ] [REMOTE ] SEMR: Full fetch complete (58966 records). [2025-09-25T21:12:22.421253] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-25T21:12:22.977919] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-25T21:12:22.978017] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-25T21:12:22.979208] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-25T21:12:22.979280] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-25T21:12:22.984213] [DEBUG] [LOCAL ] SEMR: Trimmed 58966 records to 41879 (keeping 200 days of data) [2025-09-25T21:12:23.293336] [DEBUG] [LOCAL ] SEI: Primary data saved (50031 records). [2025-09-25T21:12:23.293498] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-25T21:12:23.294562] [INFO ] [MAIN ] Update Progress: 1898/2372 symbols completed. SEI took 41.9s. Estimated remaining: 1h 3m 1s. Rate: 7.5 symbols/min [2025-09-25T21:12:23.471781] [DEBUG] [LOCAL ] SEMR: Primary data saved (41879 records). [2025-09-25T21:12:23.489786] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-25T21:12:23.539880] [INFO ] [MAIN ] Update Progress: 1899/2372 symbols completed. SEMR took 26.7s. Estimated remaining: 1h 2m 51s. Rate: 7.5 symbols/min [2025-09-25T21:12:23.539584] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:23.623507] [DEBUG] [LOCAL ] SFB: Loaded 3999 existing records from primary storage. [2025-09-25T21:12:23.623674] [INFO ] [MAIN ] SFB: Loaded 3999 existing records. [2025-09-25T21:12:23.877833] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:23.971367] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:23.972243] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-25T21:12:23.972295] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-25T21:12:23.972575] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-25T21:12:23.972844] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-25T21:12:24.055920] [DEBUG] [LOCAL ] SFBS: Loaded 21272 existing records from primary storage. [2025-09-25T21:12:24.061959] [INFO ] [MAIN ] SFBS: Loaded 21272 existing records. [2025-09-25T21:12:24.243397] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-25T21:12:24.297497] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-25T21:12:24.353851] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T21:12:24.386431] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-25T21:12:24.609477] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:24.636689] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-25T21:12:24.642695] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-25T21:12:24.696736] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-25T21:12:24.696915] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-25T21:12:24.711130] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:24.711491] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-25T21:12:25.085521] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:25.346005] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T21:12:25.488728] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-25T21:12:26.098493] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T21:12:26.288735] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-25T21:12:26.593900] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T21:12:26.887082] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-25T21:12:27.088755] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-25T21:12:27.575200] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T21:12:27.852438] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T21:12:27.888744] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-25T21:12:28.409590] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T21:12:28.688826] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-25T21:12:29.488825] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-25T21:12:30.263697] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T21:12:30.289000] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-25T21:12:30.566627] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T21:12:31.088874] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-25T21:12:31.888808] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-25T21:12:32.300415] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T21:12:32.354714] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-25T21:12:32.688724] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-25T21:12:32.852954] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.56 seconds). [2025-09-25T21:12:33.488762] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-25T21:12:33.607707] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T21:12:34.110507] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T21:12:34.288729] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-25T21:12:35.088742] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-25T21:12:35.449245] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T21:12:35.888742] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-25T21:12:36.688706] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-25T21:12:36.802769] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T21:12:37.319415] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T21:12:37.488766] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-25T21:12:38.288761] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-25T21:12:38.628562] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T21:12:38.985071] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-25T21:12:38.998376] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T21:12:39.088741] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-25T21:12:39.888729] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-25T21:12:40.688702] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-25T21:12:40.767379] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T21:12:41.494714] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-25T21:12:41.522510] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-25T21:12:41.925574] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T21:12:42.288743] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-25T21:12:42.760724] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T21:12:43.088738] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-25T21:12:43.888733] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-25T21:12:44.251194] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T21:12:44.556961] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-25T21:12:44.688742] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-25T21:12:45.488727] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-25T21:12:45.551914] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T21:12:45.605545] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T21:12:45.609838] [INFO ] [REMOTE ] SFBS: Full fetch complete (30235 records). [2025-09-25T21:12:45.609953] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-25T21:12:46.098679] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-25T21:12:46.098772] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-25T21:12:46.099391] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-25T21:12:46.099432] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-25T21:12:46.100776] [DEBUG] [LOCAL ] SFBS: Trimmed 30235 records to 21381 (keeping 200 days of data) [2025-09-25T21:12:46.163296] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T21:12:46.251576] [DEBUG] [LOCAL ] SFBS: Primary data saved (21381 records). [2025-09-25T21:12:46.251743] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-25T21:12:46.251882] [INFO ] [MAIN ] Update Progress: 1900/2372 symbols completed. SFBS took 22.7s. Estimated remaining: 1h 2m 47s. Rate: 7.5 symbols/min [2025-09-25T21:12:46.291543] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-25T21:12:46.440850] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:46.499345] [DEBUG] [LOCAL ] SFL: Loaded 45305 existing records from primary storage. [2025-09-25T21:12:46.499516] [INFO ] [MAIN ] SFL: Loaded 45305 existing records. [2025-09-25T21:12:46.709509] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:46.711291] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-25T21:12:46.711388] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-25T21:12:46.711903] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-25T21:12:46.711971] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-25T21:12:46.937245] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T21:12:47.101224] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-25T21:12:47.155533] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:47.888703] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-25T21:12:47.940781] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T21:12:47.950191] [INFO ] [REMOTE ] SES: Full fetch complete (74796 records). [2025-09-25T21:12:47.950365] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-25T21:12:48.376010] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-25T21:12:48.376114] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-25T21:12:48.377323] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-25T21:12:48.377394] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-25T21:12:48.379012] [DEBUG] [LOCAL ] SES: Trimmed 74796 records to 51942 (keeping 200 days of data) [2025-09-25T21:12:48.477303] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T21:12:48.478620] [INFO ] [REMOTE ] SFB: Full fetch complete (5729 records). [2025-09-25T21:12:48.478719] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-25T21:12:48.693657] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-25T21:12:48.920479] [DEBUG] [LOCAL ] SES: Primary data saved (51942 records). [2025-09-25T21:12:48.920682] [INFO ] [MAIN ] SES: Full history saved. [2025-09-25T21:12:48.920845] [INFO ] [MAIN ] Update Progress: 1901/2372 symbols completed. SES took 38.8s. Estimated remaining: 1h 2m 38s. Rate: 7.5 symbols/min [2025-09-25T21:12:49.291094] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:49.336078] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-25T21:12:49.336164] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-25T21:12:49.336348] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-25T21:12:49.336419] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-25T21:12:49.336932] [DEBUG] [LOCAL ] SFB: Trimmed 5729 records to 4020 (keeping 200 days of data) [2025-09-25T21:12:49.362895] [DEBUG] [LOCAL ] SFB: Primary data saved (4020 records). [2025-09-25T21:12:49.363002] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-25T21:12:49.363093] [INFO ] [MAIN ] Update Progress: 1902/2372 symbols completed. SFB took 26.1s. Estimated remaining: 1h 2m 28s. Rate: 7.5 symbols/min [2025-09-25T21:12:49.493907] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-25T21:12:49.598595] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:49.623534] [DEBUG] [LOCAL ] SG: Loaded 53448 existing records from primary storage. [2025-09-25T21:12:49.623733] [INFO ] [MAIN ] SG: Loaded 53448 existing records. [2025-09-25T21:12:49.716490] [DEBUG] [LOCAL ] SGHC: Loaded 45708 existing records from primary storage. [2025-09-25T21:12:49.716701] [INFO ] [MAIN ] SGHC: Loaded 45708 existing records. [2025-09-25T21:12:50.037163] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:50.037516] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-25T21:12:50.037583] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-25T21:12:50.046398] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-25T21:12:50.046484] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-25T21:12:50.110117] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:12:50.110384] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-25T21:12:50.110430] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-25T21:12:50.122884] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-25T21:12:50.122982] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-25T21:12:50.344236] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T21:12:50.369908] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-25T21:12:50.961969] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:50.993719] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:51.088726] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-25T21:12:51.139525] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T21:12:51.888733] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-25T21:12:52.015703] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:12:52.023364] [INFO ] [REMOTE ] SF: Full fetch complete (59549 records). [2025-09-25T21:12:52.023519] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-25T21:12:52.425597] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-25T21:12:52.425751] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-25T21:12:52.427704] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-25T21:12:52.427775] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-25T21:12:52.429612] [DEBUG] [LOCAL ] SF: Trimmed 59549 records to 42020 (keeping 200 days of data) [2025-09-25T21:12:52.711614] [DEBUG] [LOCAL ] SF: Primary data saved (42020 records). [2025-09-25T21:12:52.711838] [INFO ] [MAIN ] SF: Full history saved. [2025-09-25T21:12:52.711969] [INFO ] [MAIN ] Update Progress: 1903/2372 symbols completed. SF took 37.7s. Estimated remaining: 1h 2m 19s. Rate: 7.5 symbols/min [2025-09-25T21:12:52.699739] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-25T21:12:52.906890] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:12:52.907138] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-25T21:12:52.907175] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-25T21:12:52.907422] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-25T21:12:52.907461] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-25T21:12:52.907501] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-25T21:12:52.907535] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-25T21:12:53.115805] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T21:12:53.342986] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:12:53.485362] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T21:12:53.496884] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-25T21:12:53.754137] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:12:53.754517] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-25T21:12:54.288697] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-25T21:12:54.437037] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:12:54.544040] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:12:54.544409] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-25T21:12:55.088728] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-25T21:12:55.888741] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-25T21:12:56.688753] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-25T21:12:57.136127] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-25T21:12:57.488721] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-25T21:12:57.570682] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:12:58.275757] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:12:58.288677] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-25T21:12:58.773299] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T21:12:59.088701] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-25T21:12:59.892823] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-25T21:12:59.894955] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T21:13:00.688753] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-25T21:13:00.833459] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T21:13:01.481915] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T21:13:01.492865] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-25T21:13:02.288694] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-25T21:13:02.356531] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:13:03.088775] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-25T21:13:03.321532] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T21:13:03.888773] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-25T21:13:04.202679] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T21:13:04.546486] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T21:13:04.688725] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-25T21:13:05.488702] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-25T21:13:05.789958] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T21:13:06.288687] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-25T21:13:06.744044] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T21:13:07.088684] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-25T21:13:07.273920] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:13:07.888789] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-25T21:13:08.376332] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T21:13:08.688697] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-25T21:13:08.744826] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:13:09.488769] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-25T21:13:10.042871] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-25T21:13:10.288729] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-25T21:13:10.641505] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T21:13:11.093819] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-25T21:13:11.100042] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T21:13:11.888756] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-25T21:13:12.354732] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-25T21:13:12.688756] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-25T21:13:12.916070] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T21:13:13.314265] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T21:13:13.488749] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-25T21:13:14.288745] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-25T21:13:14.779297] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T21:13:15.088688] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-25T21:13:15.462053] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T21:13:15.706494] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T21:13:15.888779] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-25T21:13:16.688708] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-25T21:13:16.737088] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T21:13:16.837112] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T21:13:17.488730] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-25T21:13:18.288759] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-25T21:13:18.486195] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:13:19.088742] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-25T21:13:19.400919] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T21:13:19.415093] [INFO ] [REMOTE ] SG: Full fetch complete (77250 records). [2025-09-25T21:13:19.415349] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-25T21:13:19.920010] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-25T21:13:19.942271] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-25T21:13:19.942361] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-25T21:13:19.943863] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-25T21:13:19.944002] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-25T21:13:19.941549] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:13:19.958143] [DEBUG] [LOCAL ] SG: Trimmed 77250 records to 53838 (keeping 200 days of data) [2025-09-25T21:13:19.966033] [INFO ] [REMOTE ] SGHC: Full fetch complete (63355 records). [2025-09-25T21:13:19.966204] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-25T21:13:20.731525] [DEBUG] [LOCAL ] SG: Primary data saved (53838 records). [2025-09-25T21:13:20.731728] [INFO ] [MAIN ] SG: Full history saved. [2025-09-25T21:13:20.732029] [INFO ] [MAIN ] Update Progress: 1904/2372 symbols completed. SG took 31.8s. Estimated remaining: 1h 2m 16s. Rate: 7.5 symbols/min [2025-09-25T21:13:20.876194] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-25T21:13:20.876304] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-25T21:13:20.877486] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-25T21:13:20.877568] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-25T21:13:20.879221] [DEBUG] [LOCAL ] SGHC: Trimmed 63355 records to 46069 (keeping 200 days of data) [2025-09-25T21:13:21.058488] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T21:13:21.122511] [INFO ] [REMOTE ] SGI: Full fetch complete (57881 records). [2025-09-25T21:13:21.150916] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-25T21:13:21.244257] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:21.433233] [DEBUG] [LOCAL ] SGU: Loaded 6649 existing records from primary storage. [2025-09-25T21:13:21.433397] [INFO ] [MAIN ] SGU: Loaded 6649 existing records. [2025-09-25T21:13:21.694249] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T21:13:21.685267] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-25T21:13:21.699908] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:13:21.700005] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:13:21.700094] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-25T21:13:21.700185] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-25T21:13:21.700255] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-25T21:13:21.700336] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-25T21:13:21.700429] [INFO ] [MAIN ] Update Progress: 1905/2372 symbols completed. SGI took 29.0s. Estimated remaining: 1h 2m 6s. Rate: 7.5 symbols/min [2025-09-25T21:13:21.757021] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-25T21:13:21.920807] [DEBUG] [LOCAL ] SGHC: Primary data saved (46069 records). [2025-09-25T21:13:21.921003] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-25T21:13:21.921139] [INFO ] [MAIN ] Update Progress: 1906/2372 symbols completed. SGHC took 32.6s. Estimated remaining: 1h 1m 56s. Rate: 7.5 symbols/min [2025-09-25T21:13:22.201839] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:22.224115] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-25T21:13:22.224191] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-25T21:13:22.224554] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-25T21:13:22.224631] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-25T21:13:22.300084] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:22.371592] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:22.476445] [DEBUG] [LOCAL ] SHCO: Loaded 26028 existing records from primary storage. [2025-09-25T21:13:22.492729] [INFO ] [MAIN ] SHCO: Loaded 26028 existing records. [2025-09-25T21:13:22.536973] [DEBUG] [LOCAL ] SHAK: Loaded 49120 existing records from primary storage. [2025-09-25T21:13:22.537159] [INFO ] [MAIN ] SHAK: Loaded 49120 existing records. [2025-09-25T21:13:23.028277] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:23.028567] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-25T21:13:23.028616] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-25T21:13:23.029047] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-25T21:13:23.029142] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-25T21:13:23.119695] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:23.119977] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-25T21:13:23.120025] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-25T21:13:23.120397] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-25T21:13:23.120457] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-25T21:13:23.438975] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:23.454522] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-25T21:13:23.802617] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T21:13:23.869287] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-25T21:13:24.215397] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T21:13:24.218458] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-25T21:13:24.303269] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:24.340259] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-25T21:13:24.339866] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:24.688735] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-25T21:13:24.970529] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T21:13:25.371548] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:13:25.380858] [INFO ] [REMOTE ] SFL: Full fetch complete (65480 records). [2025-09-25T21:13:25.381039] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-25T21:13:25.490793] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-25T21:13:25.715855] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T21:13:25.854762] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-25T21:13:25.854867] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-25T21:13:25.855964] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-25T21:13:25.856030] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-25T21:13:25.860061] [DEBUG] [LOCAL ] SFL: Trimmed 65480 records to 45665 (keeping 200 days of data) [2025-09-25T21:13:25.971088] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T21:13:26.132275] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:13:26.207149] [DEBUG] [LOCAL ] SFL: Primary data saved (45665 records). [2025-09-25T21:13:26.207301] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-25T21:13:26.207418] [INFO ] [MAIN ] Update Progress: 1907/2372 symbols completed. SFL took 40.0s. Estimated remaining: 1h 1m 47s. Rate: 7.5 symbols/min [2025-09-25T21:13:26.293788] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-25T21:13:26.392561] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:26.465504] [DEBUG] [LOCAL ] SHEL: Loaded 53671 existing records from primary storage. [2025-09-25T21:13:26.465711] [INFO ] [MAIN ] SHEL: Loaded 53671 existing records. [2025-09-25T21:13:26.647547] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:26.648136] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-25T21:13:26.648300] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-25T21:13:26.648749] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-25T21:13:26.648814] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-25T21:13:27.035220] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:27.088729] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-25T21:13:27.581078] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T21:13:27.888732] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-25T21:13:28.688720] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-25T21:13:28.935246] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T21:13:29.037589] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T21:13:29.221692] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T21:13:29.488740] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-25T21:13:30.277594] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T21:13:30.288683] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-25T21:13:31.088712] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-25T21:13:31.100587] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-25T21:13:31.888721] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-25T21:13:32.688756] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-25T21:13:32.938389] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T21:13:33.488738] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-25T21:13:34.009158] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-25T21:13:34.046927] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T21:13:34.288787] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-25T21:13:35.034919] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:13:35.065122] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T21:13:35.088701] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-25T21:13:35.888777] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-25T21:13:36.688900] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-25T21:13:36.716823] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-25T21:13:37.311976] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-25T21:13:37.488767] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-25T21:13:37.988371] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-25T21:13:38.288735] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-25T21:13:38.336150] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T21:13:39.088810] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-25T21:13:39.888744] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-25T21:13:40.104356] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:13:40.241067] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:13:40.586922] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T21:13:40.591467] [INFO ] [REMOTE ] SGU: Full fetch complete (8936 records). [2025-09-25T21:13:40.591767] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-25T21:13:40.694022] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-25T21:13:41.006225] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-25T21:13:41.006421] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-25T21:13:41.006789] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-25T21:13:41.006907] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-25T21:13:41.007747] [DEBUG] [LOCAL ] SGU: Trimmed 8936 records to 6706 (keeping 200 days of data) [2025-09-25T21:13:41.057762] [DEBUG] [LOCAL ] SGU: Primary data saved (6706 records). [2025-09-25T21:13:41.057916] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-25T21:13:41.058192] [INFO ] [MAIN ] Update Progress: 1908/2372 symbols completed. SGU took 20.3s. Estimated remaining: 1h 1m 41s. Rate: 7.5 symbols/min [2025-09-25T21:13:41.247999] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:41.294416] [DEBUG] [LOCAL ] SHG: Loaded 26963 existing records from primary storage. [2025-09-25T21:13:41.294568] [INFO ] [MAIN ] SHG: Loaded 26963 existing records. [2025-09-25T21:13:41.480671] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:41.480923] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-25T21:13:41.480971] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-25T21:13:41.481387] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-25T21:13:41.481459] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-25T21:13:41.494857] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-25T21:13:41.908817] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:42.288757] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-25T21:13:42.741490] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T21:13:43.088735] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-25T21:13:43.416036] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T21:13:43.624496] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-25T21:13:43.888839] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-25T21:13:44.473620] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T21:13:44.688742] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-25T21:13:45.319418] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T21:13:45.488737] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-25T21:13:46.288775] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-25T21:13:46.522725] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:13:46.950297] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:13:47.088732] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-25T21:13:47.421523] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T21:13:47.888719] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-25T21:13:48.688741] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-25T21:13:49.276376] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T21:13:49.282804] [INFO ] [REMOTE ] SHCO: Full fetch complete (37447 records). [2025-09-25T21:13:49.282917] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-25T21:13:49.450708] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-25T21:13:49.493885] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-25T21:13:49.755306] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T21:13:49.828380] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-25T21:13:49.828483] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-25T21:13:49.829417] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-25T21:13:49.829496] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-25T21:13:49.830612] [DEBUG] [LOCAL ] SHCO: Trimmed 37447 records to 26175 (keeping 200 days of data) [2025-09-25T21:13:50.002414] [DEBUG] [LOCAL ] SHCO: Primary data saved (26175 records). [2025-09-25T21:13:50.002576] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-25T21:13:50.002764] [INFO ] [MAIN ] Update Progress: 1909/2372 symbols completed. SHCO took 28.1s. Estimated remaining: 1h 1m 33s. Rate: 7.5 symbols/min [2025-09-25T21:13:50.188941] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:50.257970] [DEBUG] [LOCAL ] SHO: Loaded 49825 existing records from primary storage. [2025-09-25T21:13:50.258176] [INFO ] [MAIN ] SHO: Loaded 49825 existing records. [2025-09-25T21:13:50.293830] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-25T21:13:50.467225] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:50.467852] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-25T21:13:50.467903] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-25T21:13:50.468409] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-25T21:13:50.468473] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-25T21:13:50.841248] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:51.088764] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-25T21:13:51.734580] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T21:13:51.865708] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-25T21:13:51.888683] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-25T21:13:52.431150] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T21:13:52.688723] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-25T21:13:53.488723] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-25T21:13:53.917461] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T21:13:54.239289] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:13:54.288734] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-25T21:13:55.088736] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-25T21:13:55.409883] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T21:13:55.823718] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T21:13:55.888689] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-25T21:13:56.688735] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-25T21:13:56.987565] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T21:13:57.488759] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-25T21:13:57.582045] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:13:58.211457] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T21:13:58.220441] [INFO ] [REMOTE ] SHAK: Full fetch complete (70110 records). [2025-09-25T21:13:58.220606] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-25T21:13:58.294724] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-25T21:13:58.681143] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-25T21:13:58.681240] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-25T21:13:58.682394] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-25T21:13:58.682463] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-25T21:13:58.684003] [DEBUG] [LOCAL ] SHAK: Trimmed 70110 records to 49485 (keeping 200 days of data) [2025-09-25T21:13:58.984817] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:13:59.062912] [DEBUG] [LOCAL ] SHAK: Primary data saved (49485 records). [2025-09-25T21:13:59.063069] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-25T21:13:59.064731] [INFO ] [MAIN ] Update Progress: 1910/2372 symbols completed. SHAK took 37.4s. Estimated remaining: 1h 1m 25s. Rate: 7.5 symbols/min [2025-09-25T21:13:59.090097] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-25T21:13:59.253983] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:13:59.266552] [DEBUG] [LOCAL ] SHOC: Loaded 3716 existing records from primary storage. [2025-09-25T21:13:59.266721] [INFO ] [MAIN ] SHOC: Loaded 3716 existing records. [2025-09-25T21:13:59.461425] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:13:59.462000] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-25T21:13:59.462049] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-25T21:13:59.462224] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-25T21:13:59.462282] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-25T21:13:59.827053] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:13:59.888692] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-25T21:14:00.464909] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-25T21:14:00.688701] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-25T21:14:00.779056] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T21:14:01.086107] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T21:14:01.488747] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-25T21:14:02.288713] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-25T21:14:02.689956] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T21:14:03.088727] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-25T21:14:03.175366] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T21:14:03.325832] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-25T21:14:03.888742] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-25T21:14:04.688732] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-25T21:14:05.158888] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-25T21:14:05.170162] [INFO ] [REMOTE ] SHEL: Full fetch complete (77690 records). [2025-09-25T21:14:05.170364] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-25T21:14:05.299426] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T21:14:05.399111] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T21:14:05.492441] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-25T21:14:05.701903] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-25T21:14:05.702002] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-25T21:14:05.703278] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-25T21:14:05.703347] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-25T21:14:05.705049] [DEBUG] [LOCAL ] SHEL: Trimmed 77690 records to 54061 (keeping 200 days of data) [2025-09-25T21:14:06.060354] [DEBUG] [LOCAL ] SHEL: Primary data saved (54061 records). [2025-09-25T21:14:06.060519] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-25T21:14:06.060614] [INFO ] [MAIN ] Update Progress: 1911/2372 symbols completed. SHEL took 39.9s. Estimated remaining: 1h 1m 17s. Rate: 7.5 symbols/min [2025-09-25T21:14:06.243338] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:06.297726] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-25T21:14:06.301866] [DEBUG] [LOCAL ] SHW: Loaded 50451 existing records from primary storage. [2025-09-25T21:14:06.302035] [INFO ] [MAIN ] SHW: Loaded 50451 existing records. [2025-09-25T21:14:06.497867] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:14:06.498233] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-25T21:14:06.498281] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-25T21:14:06.498617] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-25T21:14:06.498725] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-25T21:14:06.868741] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:07.088691] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-25T21:14:07.274906] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T21:14:07.348182] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-25T21:14:07.888753] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-25T21:14:08.688717] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-25T21:14:09.044529] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T21:14:09.348164] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-25T21:14:09.488786] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-25T21:14:10.163481] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T21:14:10.288725] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-25T21:14:11.088749] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-25T21:14:11.429518] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T21:14:11.888734] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-25T21:14:12.041101] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T21:14:12.123167] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:14:12.688691] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-25T21:14:12.735765] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T21:14:13.488710] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-25T21:14:13.927092] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T21:14:13.933964] [INFO ] [REMOTE ] SHG: Full fetch complete (41441 records). [2025-09-25T21:14:13.934137] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-25T21:14:14.234757] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T21:14:14.293801] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-25T21:14:14.367258] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-25T21:14:14.367345] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-25T21:14:14.368187] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-25T21:14:14.368859] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-25T21:14:14.369867] [DEBUG] [LOCAL ] SHG: Trimmed 41441 records to 27160 (keeping 200 days of data) [2025-09-25T21:14:14.564230] [DEBUG] [LOCAL ] SHG: Primary data saved (27160 records). [2025-09-25T21:14:14.564377] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-25T21:14:14.564473] [INFO ] [MAIN ] Update Progress: 1912/2372 symbols completed. SHG took 33.5s. Estimated remaining: 1h 1m 9s. Rate: 7.5 symbols/min [2025-09-25T21:14:14.746360] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:14.746570] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-25T21:14:14.746611] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-25T21:14:14.746900] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-25T21:14:14.746946] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-25T21:14:14.746987] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-25T21:14:14.747021] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-25T21:14:15.124069] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:15.093837] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-25T21:14:15.694704] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T21:14:15.888720] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-25T21:14:16.154353] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:16.154757] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-25T21:14:16.257075] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T21:14:16.688768] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-25T21:14:17.488872] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-25T21:14:17.966150] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T21:14:18.288702] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-25T21:14:18.764927] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T21:14:18.912801] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T21:14:19.088761] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-25T21:14:19.888752] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-25T21:14:20.479302] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T21:14:20.688701] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-25T21:14:21.046273] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T21:14:21.488731] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-25T21:14:22.067917] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T21:14:22.069660] [INFO ] [REMOTE ] SHOC: Full fetch complete (7444 records). [2025-09-25T21:14:22.069743] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-25T21:14:22.193366] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-25T21:14:22.293796] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-25T21:14:22.537477] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-25T21:14:22.537588] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-25T21:14:22.537869] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-25T21:14:22.537998] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-25T21:14:22.538750] [DEBUG] [LOCAL ] SHOC: Trimmed 7444 records to 3735 (keeping 200 days of data) [2025-09-25T21:14:22.567879] [DEBUG] [LOCAL ] SHOC: Primary data saved (3735 records). [2025-09-25T21:14:22.567990] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-25T21:14:22.568157] [INFO ] [MAIN ] Update Progress: 1913/2372 symbols completed. SHOC took 23.5s. Estimated remaining: 1h 1m 1s. Rate: 7.5 symbols/min [2025-09-25T21:14:22.751276] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:22.835823] [DEBUG] [LOCAL ] SID: Loaded 42217 existing records from primary storage. [2025-09-25T21:14:22.836049] [INFO ] [MAIN ] SID: Loaded 42217 existing records. [2025-09-25T21:14:23.025969] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:14:23.026316] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-25T21:14:23.026368] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-25T21:14:23.027245] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-25T21:14:23.027328] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-25T21:14:23.094800] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-25T21:14:23.406102] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:23.406465] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-25T21:14:23.412187] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:23.888741] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-25T21:14:24.014895] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T21:14:24.029187] [INFO ] [REMOTE ] SHO: Full fetch complete (71101 records). [2025-09-25T21:14:24.029362] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-25T21:14:24.460036] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-25T21:14:24.460147] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-25T21:14:24.461244] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-25T21:14:24.461309] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-25T21:14:24.464831] [DEBUG] [LOCAL ] SHO: Trimmed 71101 records to 50179 (keeping 200 days of data) [2025-09-25T21:14:24.707416] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-25T21:14:24.823412] [DEBUG] [LOCAL ] SHO: Primary data saved (50179 records). [2025-09-25T21:14:24.823585] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-25T21:14:24.823737] [INFO ] [MAIN ] Update Progress: 1914/2372 symbols completed. SHO took 34.8s. Estimated remaining: 1h 0m 52s. Rate: 7.5 symbols/min [2025-09-25T21:14:25.005211] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:25.022638] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:25.023088] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-25T21:14:25.073099] [DEBUG] [LOCAL ] SIG: Loaded 46524 existing records from primary storage. [2025-09-25T21:14:25.073276] [INFO ] [MAIN ] SIG: Loaded 46524 existing records. [2025-09-25T21:14:25.272405] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:14:25.273130] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-25T21:14:25.273207] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-25T21:14:25.273569] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-25T21:14:25.278747] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-25T21:14:25.497104] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-25T21:14:25.630106] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:14:25.728521] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:25.804544] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:25.805024] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-25T21:14:26.288737] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-25T21:14:27.088752] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-25T21:14:27.893908] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-25T21:14:27.922612] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T21:14:28.180721] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:28.181121] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-25T21:14:28.392380] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:14:28.688731] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-25T21:14:29.488827] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-25T21:14:30.288769] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-25T21:14:30.559825] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T21:14:30.570979] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:30.571357] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-25T21:14:31.088745] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-25T21:14:31.377035] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:14:31.379253] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-25T21:14:31.379100] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T21:14:31.888737] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-25T21:14:32.379058] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T21:14:32.688739] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-25T21:14:33.488713] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-25T21:14:33.852760] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-25T21:14:34.293866] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-25T21:14:34.307774] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-25T21:14:35.088825] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-25T21:14:35.888745] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-25T21:14:36.025442] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T21:14:36.551568] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T21:14:36.563171] [INFO ] [REMOTE ] SHW: Full fetch complete (73028 records). [2025-09-25T21:14:36.563363] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-25T21:14:36.693814] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-25T21:14:37.010568] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-25T21:14:37.021437] [INFO ] [REMOTE ] SI: Full fetch complete (5860 records). [2025-09-25T21:14:37.021516] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-25T21:14:37.073541] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-25T21:14:37.073669] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-25T21:14:37.074863] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-25T21:14:37.074948] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-25T21:14:37.092907] [DEBUG] [LOCAL ] SHW: Trimmed 73028 records to 50823 (keeping 200 days of data) [2025-09-25T21:14:37.359265] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-25T21:14:37.359532] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:14:37.360521] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:14:37.361425] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-25T21:14:37.361523] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-25T21:14:37.361580] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-25T21:14:37.361687] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-25T21:14:37.361833] [INFO ] [MAIN ] Update Progress: 1915/2372 symbols completed. SI took 22.8s. Estimated remaining: 1h 0m 45s. Rate: 7.5 symbols/min [2025-09-25T21:14:37.495722] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-25T21:14:37.700096] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:37.778373] [DEBUG] [LOCAL ] SII: Loaded 23247 existing records from primary storage. [2025-09-25T21:14:37.793290] [INFO ] [MAIN ] SII: Loaded 23247 existing records. [2025-09-25T21:14:37.902815] [DEBUG] [LOCAL ] SHW: Primary data saved (50823 records). [2025-09-25T21:14:37.902989] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-25T21:14:37.903134] [INFO ] [MAIN ] Update Progress: 1916/2372 symbols completed. SHW took 31.8s. Estimated remaining: 1h 0m 35s. Rate: 7.5 symbols/min [2025-09-25T21:14:38.213362] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:14:38.220920] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-25T21:14:38.220975] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-25T21:14:38.221330] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-25T21:14:38.221391] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-25T21:14:38.235088] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-25T21:14:38.276348] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:14:38.298391] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-25T21:14:38.369601] [DEBUG] [LOCAL ] SILA: Loaded 31333 existing records from primary storage. [2025-09-25T21:14:38.369786] [INFO ] [MAIN ] SILA: Loaded 31333 existing records. [2025-09-25T21:14:38.857120] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:14:38.868052] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-25T21:14:38.878400] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-25T21:14:38.900274] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-25T21:14:38.921902] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-25T21:14:39.027349] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:39.088672] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-25T21:14:39.440319] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:14:39.473404] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T21:14:39.893860] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-25T21:14:39.912916] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T21:14:39.966372] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T21:14:40.688744] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-25T21:14:41.488718] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-25T21:14:41.664533] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:14:42.288710] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-25T21:14:42.325942] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T21:14:42.540341] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T21:14:43.088723] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-25T21:14:43.888741] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-25T21:14:44.054978] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T21:14:44.478026] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T21:14:44.688745] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-25T21:14:45.324756] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T21:14:45.488701] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-25T21:14:45.712866] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T21:14:46.288732] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-25T21:14:46.749817] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T21:14:47.088802] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-25T21:14:47.127747] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:14:47.888839] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-25T21:14:48.688730] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-25T21:14:48.889245] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T21:14:49.488778] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-25T21:14:49.569261] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:14:49.689277] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T21:14:50.288681] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-25T21:14:50.363614] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T21:14:51.088775] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-25T21:14:51.745071] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T21:14:51.888728] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-25T21:14:52.688737] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-25T21:14:52.792229] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T21:14:53.488761] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-25T21:14:53.656525] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T21:14:53.980230] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-25T21:14:54.288732] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-25T21:14:55.093796] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-25T21:14:55.110240] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T21:14:55.120724] [INFO ] [REMOTE ] SID: Full fetch complete (60812 records). [2025-09-25T21:14:55.120930] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-25T21:14:55.564372] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-25T21:14:55.564527] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-25T21:14:55.565730] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-25T21:14:55.565802] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-25T21:14:55.567385] [DEBUG] [LOCAL ] SID: Trimmed 60812 records to 42519 (keeping 200 days of data) [2025-09-25T21:14:55.695222] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T21:14:55.855460] [DEBUG] [LOCAL ] SID: Primary data saved (42519 records). [2025-09-25T21:14:55.855603] [INFO ] [MAIN ] SID: Full history saved. [2025-09-25T21:14:55.855768] [INFO ] [MAIN ] Update Progress: 1917/2372 symbols completed. SID took 33.3s. Estimated remaining: 1h 0m 30s. Rate: 7.5 symbols/min [2025-09-25T21:14:55.888679] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-25T21:14:56.577060] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:14:56.688726] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-25T21:14:56.954791] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T21:14:57.488761] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-25T21:14:58.288723] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-25T21:14:58.533387] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T21:14:58.976791] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:14:59.088708] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-25T21:14:59.162356] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T21:14:59.888729] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-25T21:15:00.688765] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-25T21:15:00.864150] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:15:01.488742] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-25T21:15:01.688819] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:15:01.947029] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T21:15:02.288797] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-25T21:15:02.895747] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T21:15:03.088742] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-25T21:15:03.888730] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-25T21:15:04.038785] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:15:04.050886] [INFO ] [REMOTE ] SIG: Full fetch complete (68212 records). [2025-09-25T21:15:04.051037] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-25T21:15:04.340060] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T21:15:04.350093] [INFO ] [REMOTE ] SILA: Full fetch complete (45191 records). [2025-09-25T21:15:04.350223] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-25T21:15:04.740527] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-25T21:15:04.740612] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-25T21:15:04.744260] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-25T21:15:04.744440] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-25T21:15:04.762557] [DEBUG] [LOCAL ] SIG: Trimmed 68212 records to 46847 (keeping 200 days of data) [2025-09-25T21:15:04.916902] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:15:04.927779] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-25T21:15:05.253230] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-25T21:15:05.253322] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-25T21:15:05.254249] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-25T21:15:05.256987] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-25T21:15:05.258406] [DEBUG] [LOCAL ] SILA: Trimmed 45191 records to 31516 (keeping 200 days of data) [2025-09-25T21:15:05.508565] [DEBUG] [LOCAL ] SIG: Primary data saved (46847 records). [2025-09-25T21:15:05.508755] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-25T21:15:05.508869] [INFO ] [MAIN ] Update Progress: 1918/2372 symbols completed. SIG took 40.7s. Estimated remaining: 1h 0m 22s. Rate: 7.5 symbols/min [2025-09-25T21:15:05.531770] [DEBUG] [LOCAL ] SILA: Primary data saved (31516 records). [2025-09-25T21:15:05.531905] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-25T21:15:05.532016] [INFO ] [MAIN ] Update Progress: 1919/2372 symbols completed. SILA took 27.6s. Estimated remaining: 1h 0m 12s. Rate: 7.5 symbols/min [2025-09-25T21:15:06.180135] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T21:15:06.185358] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-25T21:15:07.375707] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T21:15:07.380341] [INFO ] [REMOTE ] SII: Full fetch complete (29839 records). [2025-09-25T21:15:07.380434] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-25T21:15:07.803094] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-25T21:15:07.803181] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-25T21:15:07.803840] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-25T21:15:07.803903] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-25T21:15:07.804756] [DEBUG] [LOCAL ] SII: Trimmed 29839 records to 23425 (keeping 200 days of data) [2025-09-25T21:15:07.962127] [DEBUG] [LOCAL ] SII: Primary data saved (23425 records). [2025-09-25T21:15:07.962269] [INFO ] [MAIN ] SII: Full history saved. [2025-09-25T21:15:07.962361] [INFO ] [MAIN ] Update Progress: 1920/2372 symbols completed. SII took 30.6s. Estimated remaining: 1h 0m 3s. Rate: 7.5 symbols/min [2025-09-25T21:15:08.646081] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:08.649069] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:08.701039] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:08.810986] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:08.851870] [DEBUG] [LOCAL ] SITE: Loaded 35058 existing records from primary storage. [2025-09-25T21:15:08.852169] [INFO ] [MAIN ] SITE: Loaded 35058 existing records. [2025-09-25T21:15:08.927349] [DEBUG] [LOCAL ] SITC: Loaded 41572 existing records from primary storage. [2025-09-25T21:15:08.927508] [INFO ] [MAIN ] SITC: Loaded 41572 existing records. [2025-09-25T21:15:08.941766] [DEBUG] [LOCAL ] SJM: Loaded 50133 existing records from primary storage. [2025-09-25T21:15:08.941910] [INFO ] [MAIN ] SJM: Loaded 50133 existing records. [2025-09-25T21:15:08.956016] [DEBUG] [LOCAL ] SJT: Loaded 22145 existing records from primary storage. [2025-09-25T21:15:08.956128] [INFO ] [MAIN ] SJT: Loaded 22145 existing records. [2025-09-25T21:15:09.670191] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:09.673708] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-25T21:15:09.673791] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-25T21:15:09.674232] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-25T21:15:09.674313] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-25T21:15:09.737832] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:09.738120] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-25T21:15:09.738169] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-25T21:15:09.738615] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-25T21:15:09.759339] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-25T21:15:09.850495] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:09.859060] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-25T21:15:09.859122] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-25T21:15:09.859571] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-25T21:15:09.859677] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-25T21:15:09.824732] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:09.873869] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-25T21:15:09.873931] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-25T21:15:09.874256] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-25T21:15:09.874328] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-25T21:15:11.591331] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:11.610438] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-25T21:15:11.639704] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:11.645619] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-25T21:15:11.692102] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:11.697576] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-25T21:15:11.742971] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:11.743306] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-25T21:15:13.001531] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T21:15:13.008239] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-25T21:15:13.043675] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:15:13.051416] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-25T21:15:13.209300] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T21:15:13.219361] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-25T21:15:13.385059] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T21:15:13.403292] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-25T21:15:14.072071] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T21:15:14.081207] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-25T21:15:14.095504] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-25T21:15:14.101323] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-25T21:15:14.684299] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T21:15:14.694179] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-25T21:15:15.000074] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T21:15:15.088709] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-25T21:15:15.217635] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T21:15:15.262521] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T21:15:15.888722] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-25T21:15:16.405497] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T21:15:16.517806] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T21:15:16.635799] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T21:15:16.688743] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-25T21:15:17.488846] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-25T21:15:18.285561] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T21:15:18.295854] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-25T21:15:18.709629] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T21:15:19.088754] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-25T21:15:19.894300] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-25T21:15:19.924075] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T21:15:20.688732] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-25T21:15:20.741146] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:15:21.488754] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-25T21:15:21.848932] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T21:15:21.977824] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:15:22.288780] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-25T21:15:23.088717] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-25T21:15:23.167985] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T21:15:23.888741] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-25T21:15:24.149370] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T21:15:24.552926] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T21:15:24.688753] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-25T21:15:25.393776] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T21:15:25.488720] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-25T21:15:25.921114] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T21:15:26.288766] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-25T21:15:26.822966] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T21:15:27.088756] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-25T21:15:27.888735] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-25T21:15:27.970402] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:15:28.185928] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:15:28.688757] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-25T21:15:29.439341] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T21:15:29.488726] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-25T21:15:30.288753] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-25T21:15:30.491339] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T21:15:30.741177] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T21:15:31.088710] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-25T21:15:31.382849] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T21:15:31.888725] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-25T21:15:32.688735] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-25T21:15:32.741054] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:15:32.749764] [INFO ] [REMOTE ] SITC: Full fetch complete (60970 records). [2025-09-25T21:15:32.749969] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-25T21:15:33.173453] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-25T21:15:33.173593] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-25T21:15:33.174659] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-25T21:15:33.174782] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-25T21:15:33.176239] [DEBUG] [LOCAL ] SITC: Trimmed 60970 records to 41936 (keeping 200 days of data) [2025-09-25T21:15:33.458152] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T21:15:33.489720] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-25T21:15:33.524476] [DEBUG] [LOCAL ] SITC: Primary data saved (41936 records). [2025-09-25T21:15:33.524714] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-25T21:15:33.524946] [INFO ] [MAIN ] Update Progress: 1921/2372 symbols completed. SITC took 25.5s. Estimated remaining: 59m 59s. Rate: 7.5 symbols/min [2025-09-25T21:15:33.750998] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:33.803539] [DEBUG] [LOCAL ] SKE: Loaded 35654 existing records from primary storage. [2025-09-25T21:15:33.803733] [INFO ] [MAIN ] SKE: Loaded 35654 existing records. [2025-09-25T21:15:33.955008] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T21:15:34.035957] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:34.038875] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-25T21:15:34.038946] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-25T21:15:34.039458] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-25T21:15:34.039542] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-25T21:15:34.294756] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-25T21:15:34.508420] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:35.032904] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T21:15:35.088699] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-25T21:15:35.843971] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:15:35.849293] [INFO ] [REMOTE ] SJT: Full fetch complete (32342 records). [2025-09-25T21:15:35.849422] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-25T21:15:35.895802] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-25T21:15:36.302155] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T21:15:36.340127] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-25T21:15:36.340214] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-25T21:15:36.340951] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-25T21:15:36.341016] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-25T21:15:36.341930] [DEBUG] [LOCAL ] SJT: Trimmed 32342 records to 22312 (keeping 200 days of data) [2025-09-25T21:15:36.478087] [DEBUG] [LOCAL ] SJT: Primary data saved (22312 records). [2025-09-25T21:15:36.478234] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-25T21:15:36.478352] [INFO ] [MAIN ] Update Progress: 1922/2372 symbols completed. SJT took 28.5s. Estimated remaining: 59m 50s. Rate: 7.5 symbols/min [2025-09-25T21:15:36.651195] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:36.663743] [DEBUG] [LOCAL ] SKIL: Loaded 6336 existing records from primary storage. [2025-09-25T21:15:36.663872] [INFO ] [MAIN ] SKIL: Loaded 6336 existing records. [2025-09-25T21:15:36.689732] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-25T21:15:36.848886] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:36.849135] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-25T21:15:36.849179] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-25T21:15:36.849494] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-25T21:15:36.849553] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-25T21:15:37.089777] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T21:15:37.160759] [INFO ] [REMOTE ] SITE: Full fetch complete (49353 records). [2025-09-25T21:15:37.178733] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-25T21:15:37.352728] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:37.495769] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-25T21:15:37.681727] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-25T21:15:37.681837] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-25T21:15:37.682786] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-25T21:15:37.682855] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-25T21:15:37.686196] [DEBUG] [LOCAL ] SITE: Trimmed 49353 records to 35314 (keeping 200 days of data) [2025-09-25T21:15:37.920465] [DEBUG] [LOCAL ] SITE: Primary data saved (35314 records). [2025-09-25T21:15:37.920629] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-25T21:15:37.920845] [INFO ] [MAIN ] Update Progress: 1923/2372 symbols completed. SITE took 30.0s. Estimated remaining: 59m 41s. Rate: 7.5 symbols/min [2025-09-25T21:15:38.112005] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:38.132843] [DEBUG] [LOCAL ] SKLZ: Loaded 11946 existing records from primary storage. [2025-09-25T21:15:38.132985] [INFO ] [MAIN ] SKLZ: Loaded 11946 existing records. [2025-09-25T21:15:38.290101] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-25T21:15:38.336044] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:38.336335] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-25T21:15:38.336382] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-25T21:15:38.336783] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-25T21:15:38.336853] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-25T21:15:38.442635] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T21:15:38.473212] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T21:15:38.795543] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:39.088757] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-25T21:15:39.772794] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T21:15:39.888737] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-25T21:15:40.577870] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T21:15:40.589937] [INFO ] [REMOTE ] SJM: Full fetch complete (72060 records). [2025-09-25T21:15:40.590076] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-25T21:15:40.690022] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-25T21:15:40.996040] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T21:15:41.041331] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-25T21:15:41.041415] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-25T21:15:41.042612] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-25T21:15:41.042703] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-25T21:15:41.044270] [DEBUG] [LOCAL ] SJM: Trimmed 72060 records to 50513 (keeping 200 days of data) [2025-09-25T21:15:41.392160] [DEBUG] [LOCAL ] SJM: Primary data saved (50513 records). [2025-09-25T21:15:41.392329] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-25T21:15:41.394121] [INFO ] [MAIN ] Update Progress: 1924/2372 symbols completed. SJM took 33.4s. Estimated remaining: 59m 32s. Rate: 7.5 symbols/min [2025-09-25T21:15:41.492048] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-25T21:15:41.587714] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:15:41.652466] [DEBUG] [LOCAL ] SKM: Loaded 35139 existing records from primary storage. [2025-09-25T21:15:41.652616] [INFO ] [MAIN ] SKM: Loaded 35139 existing records. [2025-09-25T21:15:41.851481] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:15:41.851869] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-25T21:15:41.851922] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-25T21:15:41.852218] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-25T21:15:41.852278] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-25T21:15:41.990481] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:15:42.295736] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-25T21:15:42.348473] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:15:42.862532] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:15:43.088734] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-25T21:15:43.277161] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T21:15:43.888741] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-25T21:15:44.403105] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T21:15:44.669905] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T21:15:44.688729] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-25T21:15:45.488718] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-25T21:15:46.151434] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T21:15:46.288743] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-25T21:15:46.593431] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T21:15:47.088759] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-25T21:15:47.142194] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T21:15:47.888753] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-25T21:15:48.168110] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T21:15:48.618243] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T21:15:48.688735] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-25T21:15:49.488776] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-25T21:15:49.667476] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T21:15:50.143357] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-25T21:15:50.288737] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-25T21:15:51.088768] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-25T21:15:51.319550] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T21:15:51.888731] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-25T21:15:52.401968] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T21:15:52.688702] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-25T21:15:52.825637] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T21:15:53.488751] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-25T21:15:54.241027] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:15:54.288712] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-25T21:15:54.619457] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T21:15:54.865720] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-25T21:15:55.088730] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-25T21:15:55.888723] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-25T21:15:56.688739] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-25T21:15:56.732749] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:15:56.760550] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:15:57.488741] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-25T21:15:57.526660] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:15:58.288823] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-25T21:15:58.811808] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-25T21:15:59.090834] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-25T21:15:59.841603] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T21:15:59.888692] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-25T21:16:00.618152] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T21:16:00.688748] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-25T21:16:01.488753] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-25T21:16:01.538312] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:16:01.937088] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T21:16:02.288775] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-25T21:16:02.359914] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T21:16:03.088825] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-25T21:16:03.762360] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T21:16:03.798136] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T21:16:03.888730] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-25T21:16:04.688851] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-25T21:16:05.493899] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-25T21:16:05.520294] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T21:16:05.531433] [INFO ] [REMOTE ] SKE: Full fetch complete (50308 records). [2025-09-25T21:16:05.531185] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T21:16:05.534437] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-25T21:16:05.539725] [INFO ] [REMOTE ] SKIL: Full fetch complete (10099 records). [2025-09-25T21:16:05.581161] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-25T21:16:06.292821] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-25T21:16:06.460773] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-25T21:16:06.460885] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-25T21:16:06.461122] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-25T21:16:06.461240] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-25T21:16:06.461893] [DEBUG] [LOCAL ] SKIL: Trimmed 10099 records to 6368 (keeping 200 days of data) [2025-09-25T21:16:06.468748] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-25T21:16:06.468799] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-25T21:16:06.469713] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-25T21:16:06.469775] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-25T21:16:06.471019] [DEBUG] [LOCAL ] SKE: Trimmed 50308 records to 35919 (keeping 200 days of data) [2025-09-25T21:16:06.637068] [DEBUG] [LOCAL ] SKIL: Primary data saved (6368 records). [2025-09-25T21:16:06.637293] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-25T21:16:06.637543] [INFO ] [MAIN ] Update Progress: 1925/2372 symbols completed. SKIL took 30.2s. Estimated remaining: 59m 28s. Rate: 7.5 symbols/min [2025-09-25T21:16:06.971901] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:07.016205] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T21:16:07.036874] [DEBUG] [LOCAL ] SKE: Primary data saved (35919 records). [2025-09-25T21:16:07.037159] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-25T21:16:07.037377] [INFO ] [MAIN ] Update Progress: 1926/2372 symbols completed. SKE took 33.5s. Estimated remaining: 59m 18s. Rate: 7.5 symbols/min [2025-09-25T21:16:07.090886] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-25T21:16:07.272834] [DEBUG] [LOCAL ] SKT: Loaded 42650 existing records from primary storage. [2025-09-25T21:16:07.273023] [INFO ] [MAIN ] SKT: Loaded 42650 existing records. [2025-09-25T21:16:07.348579] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:07.351310] [DEBUG] [LOCAL ] SKY: No existing data file found in primary storage. [2025-09-25T21:16:07.351384] [WARN ] [MAIN ] SKY: No existing data found, performing full refresh instead. [2025-09-25T21:16:07.351596] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-25T21:16:07.351720] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-25T21:16:07.351809] [DEBUG] [LOCAL ] SKY: No primary data file found to delete. [2025-09-25T21:16:07.351913] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-25T21:16:07.583096] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-25T21:16:07.776701] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:07.776975] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-25T21:16:07.777023] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-25T21:16:07.777353] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-25T21:16:07.777412] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-25T21:16:07.908165] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-25T21:16:08.173282] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:08.395723] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:08.562153] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T21:16:08.688729] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-25T21:16:08.967109] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T21:16:09.488738] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-25T21:16:10.196608] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T21:16:10.204454] [INFO ] [REMOTE ] SKM: Full fetch complete (47990 records). [2025-09-25T21:16:10.204597] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-25T21:16:10.293870] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-25T21:16:10.457361] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T21:16:10.531970] [INFO ] [REMOTE ] SKLZ: Full fetch complete (18993 records). [2025-09-25T21:16:10.532139] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-25T21:16:10.880463] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-25T21:16:10.880559] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-25T21:16:10.881769] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-25T21:16:10.885351] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-25T21:16:10.895735] [DEBUG] [LOCAL ] SKM: Trimmed 47990 records to 35350 (keeping 200 days of data) [2025-09-25T21:16:11.095682] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-25T21:16:11.351597] [DEBUG] [LOCAL ] SKM: Primary data saved (35350 records). [2025-09-25T21:16:11.354846] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-25T21:16:11.355036] [INFO ] [MAIN ] Update Progress: 1927/2372 symbols completed. SKM took 30.0s. Estimated remaining: 59m 9s. Rate: 7.5 symbols/min [2025-09-25T21:16:11.419841] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-25T21:16:11.419984] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-25T21:16:11.420525] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-25T21:16:11.420590] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-25T21:16:11.434804] [DEBUG] [LOCAL ] SKLZ: Trimmed 18993 records to 12038 (keeping 200 days of data) [2025-09-25T21:16:11.610147] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12038 records). [2025-09-25T21:16:11.610583] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-25T21:16:11.610851] [INFO ] [MAIN ] Update Progress: 1928/2372 symbols completed. SKLZ took 33.7s. Estimated remaining: 58m 59s. Rate: 7.5 symbols/min [2025-09-25T21:16:11.821180] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:11.917336] [DEBUG] [LOCAL ] SKYH: Loaded 16626 existing records from primary storage. [2025-09-25T21:16:11.917489] [INFO ] [MAIN ] SKYH: Loaded 16626 existing records. [2025-09-25T21:16:11.907541] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:12.040421] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T21:16:12.056963] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-25T21:16:12.236871] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-25T21:16:12.237078] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-25T21:16:12.308859] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:12.309171] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-25T21:16:12.309227] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-25T21:16:12.309568] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-25T21:16:12.309628] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-25T21:16:12.652242] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:12.686979] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-25T21:16:12.687092] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-25T21:16:12.687527] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-25T21:16:12.687587] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-25T21:16:13.013728] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T21:16:13.081990] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:13.085155] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-25T21:16:13.347097] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:13.358466] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T21:16:13.488799] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-25T21:16:14.168780] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T21:16:14.288677] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-25T21:16:15.088696] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-25T21:16:15.265920] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T21:16:15.800774] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-25T21:16:15.888741] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-25T21:16:16.452231] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T21:16:16.688739] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-25T21:16:17.410325] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T21:16:17.488744] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-25T21:16:18.288736] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-25T21:16:18.562882] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T21:16:19.002485] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T21:16:19.088723] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-25T21:16:19.888733] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-25T21:16:19.954787] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:16:20.661108] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T21:16:20.688722] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-25T21:16:20.800364] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:16:21.488760] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-25T21:16:22.246344] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T21:16:22.288773] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-25T21:16:22.593965] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:16:23.088747] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-25T21:16:23.813242] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T21:16:23.888740] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-25T21:16:24.615696] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T21:16:24.688726] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-25T21:16:25.488695] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-25T21:16:25.526461] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T21:16:26.288694] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-25T21:16:26.332228] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T21:16:26.435417] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-25T21:16:27.088723] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-25T21:16:27.597568] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:16:27.888735] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-25T21:16:28.597504] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T21:16:28.688743] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-25T21:16:29.481306] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T21:16:29.490224] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-25T21:16:30.288729] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-25T21:16:30.580330] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T21:16:31.088789] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-25T21:16:31.122637] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T21:16:31.882147] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T21:16:31.890822] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-25T21:16:32.225715] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-25T21:16:32.688794] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-25T21:16:33.494268] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-25T21:16:33.508288] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T21:16:33.516833] [INFO ] [REMOTE ] SKY: Full fetch complete (55007 records). [2025-09-25T21:16:33.516992] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-25T21:16:33.943301] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-25T21:16:33.943424] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-25T21:16:33.944423] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-25T21:16:33.944548] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-25T21:16:33.946761] [DEBUG] [LOCAL ] SKY: Trimmed 55007 records to 38035 (keeping 200 days of data) [2025-09-25T21:16:34.199030] [DEBUG] [LOCAL ] SKY: Primary data saved (38035 records). [2025-09-25T21:16:34.199187] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-25T21:16:34.199383] [INFO ] [MAIN ] Update Progress: 1929/2372 symbols completed. SKY took 27.2s. Estimated remaining: 58m 55s. Rate: 7.5 symbols/min [2025-09-25T21:16:34.298806] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-25T21:16:34.399788] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:34.459528] [DEBUG] [LOCAL ] SLF: Loaded 38957 existing records from primary storage. [2025-09-25T21:16:34.459739] [INFO ] [MAIN ] SLF: Loaded 38957 existing records. [2025-09-25T21:16:34.667216] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:34.667827] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-25T21:16:34.667884] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-25T21:16:34.668448] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-25T21:16:34.668521] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-25T21:16:34.955317] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-25T21:16:35.094726] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-25T21:16:35.161936] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:35.249763] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T21:16:35.259829] [INFO ] [REMOTE ] SKT: Full fetch complete (60144 records). [2025-09-25T21:16:35.259969] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-25T21:16:35.448259] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:16:35.701721] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-25T21:16:35.701827] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-25T21:16:35.702971] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-25T21:16:35.703671] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-25T21:16:35.708046] [DEBUG] [LOCAL ] SKT: Trimmed 60144 records to 42940 (keeping 200 days of data) [2025-09-25T21:16:35.900724] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-25T21:16:36.001629] [DEBUG] [LOCAL ] SKT: Primary data saved (42940 records). [2025-09-25T21:16:36.001814] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-25T21:16:36.001980] [INFO ] [MAIN ] Update Progress: 1930/2372 symbols completed. SKT took 29.4s. Estimated remaining: 58m 45s. Rate: 7.5 symbols/min [2025-09-25T21:16:36.262986] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:36.323481] [DEBUG] [LOCAL ] SLG: Loaded 45524 existing records from primary storage. [2025-09-25T21:16:36.323668] [INFO ] [MAIN ] SLG: Loaded 45524 existing records. [2025-09-25T21:16:36.512216] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:36.512663] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-25T21:16:36.512726] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-25T21:16:36.513056] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-25T21:16:36.513115] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-25T21:16:36.708839] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-25T21:16:36.956343] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:37.313693] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-25T21:16:37.416186] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T21:16:37.488678] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-25T21:16:37.705167] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-25T21:16:38.288835] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-25T21:16:38.775392] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T21:16:39.088715] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-25T21:16:39.310196] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T21:16:39.888758] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-25T21:16:40.688731] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-25T21:16:40.861066] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T21:16:41.273570] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T21:16:41.277722] [INFO ] [REMOTE ] SKYH: Full fetch complete (22690 records). [2025-09-25T21:16:41.277850] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-25T21:16:41.412730] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T21:16:41.493875] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-25T21:16:41.763498] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-25T21:16:41.763680] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-25T21:16:41.764282] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-25T21:16:41.764347] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-25T21:16:41.765427] [DEBUG] [LOCAL ] SKYH: Trimmed 22690 records to 16732 (keeping 200 days of data) [2025-09-25T21:16:41.884916] [DEBUG] [LOCAL ] SKYH: Primary data saved (16732 records). [2025-09-25T21:16:41.885147] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-25T21:16:41.885328] [INFO ] [MAIN ] Update Progress: 1931/2372 symbols completed. SKYH took 30.5s. Estimated remaining: 58m 37s. Rate: 7.5 symbols/min [2025-09-25T21:16:42.072897] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:16:42.134858] [DEBUG] [LOCAL ] SLGN: Loaded 40337 existing records from primary storage. [2025-09-25T21:16:42.135031] [INFO ] [MAIN ] SLGN: Loaded 40337 existing records. [2025-09-25T21:16:42.293853] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-25T21:16:42.324081] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:16:42.326326] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-25T21:16:42.326470] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-25T21:16:42.326793] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-25T21:16:42.326865] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-25T21:16:42.725105] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:16:43.088724] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-25T21:16:43.302478] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T21:16:43.888730] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-25T21:16:43.943530] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:16:44.564057] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T21:16:44.688836] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-25T21:16:45.489822] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-25T21:16:45.495346] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T21:16:46.288726] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-25T21:16:46.341840] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T21:16:47.088776] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-25T21:16:47.178457] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T21:16:47.888762] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-25T21:16:48.005590] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T21:16:48.688783] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-25T21:16:49.219851] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T21:16:49.294141] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T21:16:49.488776] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-25T21:16:50.214142] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T21:16:50.288724] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-25T21:16:51.088722] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-25T21:16:51.134972] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:16:51.895944] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-25T21:16:51.899479] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T21:16:52.688734] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-25T21:16:52.996115] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T21:16:53.488768] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-25T21:16:53.598714] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-25T21:16:53.890413] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T21:16:54.288781] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-25T21:16:55.088778] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-25T21:16:55.399685] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T21:16:55.835052] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T21:16:55.888735] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-25T21:16:56.378476] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:16:56.688768] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-25T21:16:57.488783] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-25T21:16:58.293779] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-25T21:16:58.317720] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-25T21:16:58.463845] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:16:59.088706] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-25T21:16:59.238995] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T21:16:59.427463] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T21:16:59.888703] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-25T21:17:00.012890] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T21:17:00.688715] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-25T21:17:01.488766] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-25T21:17:01.928327] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T21:17:02.207384] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T21:17:02.216037] [INFO ] [REMOTE ] SLF: Full fetch complete (56449 records). [2025-09-25T21:17:02.216251] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-25T21:17:02.294723] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-25T21:17:02.646172] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-25T21:17:02.646283] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-25T21:17:02.647435] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-25T21:17:02.647509] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-25T21:17:02.648874] [DEBUG] [LOCAL ] SLF: Trimmed 56449 records to 39211 (keeping 200 days of data) [2025-09-25T21:17:02.937134] [DEBUG] [LOCAL ] SLF: Primary data saved (39211 records). [2025-09-25T21:17:02.937307] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-25T21:17:02.937435] [INFO ] [MAIN ] Update Progress: 1932/2372 symbols completed. SLF took 28.7s. Estimated remaining: 58m 32s. Rate: 7.5 symbols/min [2025-09-25T21:17:03.093863] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-25T21:17:03.135928] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:03.136148] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-25T21:17:03.136186] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-25T21:17:03.136382] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-25T21:17:03.136476] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-25T21:17:03.136547] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-25T21:17:03.136603] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-25T21:17:03.429682] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T21:17:03.473067] [INFO ] [REMOTE ] SLB: Full fetch complete (77740 records). [2025-09-25T21:17:03.473402] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-25T21:17:03.511316] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T21:17:03.831950] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:03.901732] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-25T21:17:04.127202] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-25T21:17:04.127302] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-25T21:17:04.128467] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-25T21:17:04.128536] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-25T21:17:04.130248] [DEBUG] [LOCAL ] SLB: Trimmed 77740 records to 54087 (keeping 200 days of data) [2025-09-25T21:17:04.383463] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-25T21:17:04.515886] [DEBUG] [LOCAL ] SLB: Primary data saved (54087 records). [2025-09-25T21:17:04.516109] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-25T21:17:04.516258] [INFO ] [MAIN ] Update Progress: 1933/2372 symbols completed. SLB took 52.9s. Estimated remaining: 58m 22s. Rate: 7.5 symbols/min [2025-09-25T21:17:04.691105] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:04.691744] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-25T21:17:04.746305] [DEBUG] [LOCAL ] SLQT: Loaded 43866 existing records from primary storage. [2025-09-25T21:17:04.746593] [INFO ] [MAIN ] SLQT: Loaded 43866 existing records. [2025-09-25T21:17:04.970774] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:04.971063] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-25T21:17:04.971110] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-25T21:17:04.971489] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-25T21:17:04.971552] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-25T21:17:05.004543] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T21:17:05.115888] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-25T21:17:05.383352] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:05.488711] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-25T21:17:06.288751] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-25T21:17:06.686587] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T21:17:06.955585] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T21:17:07.088728] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-25T21:17:07.495018] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-25T21:17:07.888740] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-25T21:17:08.688756] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-25T21:17:09.488712] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-25T21:17:09.672416] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:17:09.682347] [INFO ] [REMOTE ] SLG: Full fetch complete (65273 records). [2025-09-25T21:17:09.682530] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-25T21:17:09.898411] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-25T21:17:09.986618] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T21:17:10.158940] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-25T21:17:10.159070] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-25T21:17:10.160183] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-25T21:17:10.160250] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-25T21:17:10.161696] [DEBUG] [LOCAL ] SLG: Trimmed 65273 records to 45836 (keeping 200 days of data) [2025-09-25T21:17:10.288705] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-25T21:17:10.488729] [DEBUG] [LOCAL ] SLG: Primary data saved (45836 records). [2025-09-25T21:17:10.488934] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-25T21:17:10.489032] [INFO ] [MAIN ] Update Progress: 1934/2372 symbols completed. SLG took 34.5s. Estimated remaining: 58m 14s. Rate: 7.5 symbols/min [2025-09-25T21:17:10.686383] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:10.711410] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T21:17:10.723235] [DEBUG] [LOCAL ] SLVM: Loaded 27971 existing records from primary storage. [2025-09-25T21:17:10.723406] [INFO ] [MAIN ] SLVM: Loaded 27971 existing records. [2025-09-25T21:17:10.913740] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:10.914169] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-25T21:17:10.914226] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-25T21:17:10.914637] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-25T21:17:10.916236] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-25T21:17:11.088752] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-25T21:17:11.310918] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:11.536551] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T21:17:11.888711] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-25T21:17:12.688754] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-25T21:17:13.112709] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-25T21:17:13.488734] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-25T21:17:13.608931] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T21:17:13.618066] [INFO ] [REMOTE ] SLGN: Full fetch complete (58213 records). [2025-09-25T21:17:13.618201] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-25T21:17:13.816258] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-25T21:17:14.197883] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-25T21:17:14.198008] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-25T21:17:14.199301] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-25T21:17:14.199403] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-25T21:17:14.204762] [DEBUG] [LOCAL ] SLGN: Trimmed 58213 records to 40698 (keeping 200 days of data) [2025-09-25T21:17:14.288742] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-25T21:17:14.604934] [DEBUG] [LOCAL ] SLGN: Primary data saved (40698 records). [2025-09-25T21:17:14.605438] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-25T21:17:14.605702] [INFO ] [MAIN ] Update Progress: 1935/2372 symbols completed. SLGN took 32.7s. Estimated remaining: 58m 5s. Rate: 7.5 symbols/min [2025-09-25T21:17:14.661596] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-25T21:17:14.687923] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1057 records). [2025-09-25T21:17:14.712868] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-25T21:17:15.091852] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-25T21:17:15.151760] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:15.197759] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-25T21:17:15.202097] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:17:15.202671] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:17:15.203040] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-25T21:17:15.203214] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-25T21:17:15.203371] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-25T21:17:15.203459] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-25T21:17:15.203635] [INFO ] [MAIN ] Update Progress: 1936/2372 symbols completed. SLNZ took 12.3s. Estimated remaining: 57m 55s. Rate: 7.5 symbols/min [2025-09-25T21:17:15.421223] [DEBUG] [LOCAL ] SM: Loaded 52313 existing records from primary storage. [2025-09-25T21:17:15.421399] [INFO ] [MAIN ] SM: Loaded 52313 existing records. [2025-09-25T21:17:15.573210] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:15.573434] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-25T21:17:15.573492] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-25T21:17:15.579880] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-25T21:17:15.579959] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-25T21:17:15.580012] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-25T21:17:15.580049] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-25T21:17:15.767547] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:15.806967] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-25T21:17:15.818738] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-25T21:17:15.825228] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-25T21:17:15.825317] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-25T21:17:15.894727] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-25T21:17:16.478240] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:16.501813] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:16.688767] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-25T21:17:16.832639] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:17:17.180749] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:17:17.181754] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-25T21:17:17.220256] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T21:17:17.488782] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-25T21:17:17.770973] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:17:17.771443] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-25T21:17:18.288743] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-25T21:17:19.088776] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-25T21:17:19.888769] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-25T21:17:20.005694] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T21:17:20.688753] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-25T21:17:20.794483] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T21:17:20.915941] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T21:17:20.953537] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:17:20.954023] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-25T21:17:21.488845] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-25T21:17:21.736526] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:17:21.736972] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-25T21:17:22.288805] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-25T21:17:23.088804] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-25T21:17:23.647817] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T21:17:23.888731] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-25T21:17:24.593996] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T21:17:24.688763] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-25T21:17:24.980261] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T21:17:25.488798] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-25T21:17:26.121075] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T21:17:26.288729] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-25T21:17:26.985691] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T21:17:27.088717] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-25T21:17:27.216990] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T21:17:27.888727] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-25T21:17:28.688728] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-25T21:17:28.834898] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T21:17:29.488874] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-25T21:17:29.574635] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T21:17:30.171118] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:17:30.288733] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-25T21:17:31.090967] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-25T21:17:31.449508] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T21:17:31.888707] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-25T21:17:32.029022] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T21:17:32.241105] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:17:32.688759] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-25T21:17:33.488703] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-25T21:17:33.823163] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:17:34.233952] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T21:17:34.288734] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-25T21:17:34.939124] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T21:17:35.088768] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-25T21:17:35.482499] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-25T21:17:35.888770] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-25T21:17:36.688747] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-25T21:17:37.016688] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T21:17:37.052118] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T21:17:37.488740] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-25T21:17:37.826171] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T21:17:38.273353] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T21:17:38.288703] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-25T21:17:39.088728] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-25T21:17:39.616868] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:17:39.623380] [INFO ] [REMOTE ] SLVM: Full fetch complete (39614 records). [2025-09-25T21:17:39.623515] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-25T21:17:39.893867] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-25T21:17:40.050036] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-25T21:17:40.050159] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-25T21:17:40.051508] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-25T21:17:40.051596] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-25T21:17:40.059222] [DEBUG] [LOCAL ] SLVM: Trimmed 39614 records to 28188 (keeping 200 days of data) [2025-09-25T21:17:40.281969] [DEBUG] [LOCAL ] SLVM: Primary data saved (28188 records). [2025-09-25T21:17:40.282175] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-25T21:17:40.282370] [INFO ] [MAIN ] Update Progress: 1937/2372 symbols completed. SLVM took 29.8s. Estimated remaining: 57m 51s. Rate: 7.5 symbols/min [2025-09-25T21:17:40.473810] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:40.492259] [DEBUG] [LOCAL ] SMBK: Loaded 8254 existing records from primary storage. [2025-09-25T21:17:40.492432] [INFO ] [MAIN ] SMBK: Loaded 8254 existing records. [2025-09-25T21:17:40.578573] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T21:17:40.642945] [INFO ] [REMOTE ] SMA: Full fetch complete (29711 records). [2025-09-25T21:17:40.658777] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-25T21:17:40.694101] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-25T21:17:40.909998] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:40.910380] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-25T21:17:40.910433] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-25T21:17:40.915942] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-25T21:17:40.916057] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-25T21:17:41.235145] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 122 unique days, need 200 days [2025-09-25T21:17:41.246112] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:17:41.311713] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:17:41.311937] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-25T21:17:41.312051] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-25T21:17:41.312113] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-25T21:17:41.319589] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-25T21:17:41.319758] [INFO ] [MAIN ] Update Progress: 1938/2372 symbols completed. SMA took 26.1s. Estimated remaining: 57m 42s. Rate: 7.5 symbols/min [2025-09-25T21:17:41.593936] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T21:17:41.622307] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-25T21:17:41.697940] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:41.721091] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:41.743456] [DEBUG] [LOCAL ] SMC: Loaded 11512 existing records from primary storage. [2025-09-25T21:17:41.743622] [INFO ] [MAIN ] SMC: Loaded 11512 existing records. [2025-09-25T21:17:41.938886] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:41.939523] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-25T21:17:41.939579] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-25T21:17:41.940370] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-25T21:17:41.940434] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-25T21:17:42.299252] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-25T21:17:42.332801] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:42.558621] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:17:43.088716] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-25T21:17:43.194453] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T21:17:43.441325] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T21:17:43.888731] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-25T21:17:43.993128] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T21:17:44.688753] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-25T21:17:44.858521] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T21:17:45.488748] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-25T21:17:45.602538] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T21:17:46.288891] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-25T21:17:47.088786] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-25T21:17:47.483439] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-25T21:17:47.888735] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-25T21:17:47.956106] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T21:17:48.015007] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T21:17:48.688840] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-25T21:17:49.488691] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-25T21:17:49.700482] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T21:17:50.157519] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-25T21:17:50.224908] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:17:50.237689] [INFO ] [REMOTE ] SLQT: Full fetch complete (63564 records). [2025-09-25T21:17:50.237927] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-25T21:17:50.291689] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-25T21:17:50.718935] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-25T21:17:50.719047] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-25T21:17:50.720109] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-25T21:17:50.720387] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-25T21:17:50.722031] [DEBUG] [LOCAL ] SLQT: Trimmed 63564 records to 44097 (keeping 200 days of data) [2025-09-25T21:17:51.010671] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-25T21:17:51.018383] [DEBUG] [LOCAL ] SLQT: Primary data saved (44097 records). [2025-09-25T21:17:51.018557] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-25T21:17:51.018811] [INFO ] [MAIN ] Update Progress: 1939/2372 symbols completed. SLQT took 46.5s. Estimated remaining: 57m 34s. Rate: 7.5 symbols/min [2025-09-25T21:17:51.094727] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-25T21:17:51.209157] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:51.267014] [DEBUG] [LOCAL ] SMFG: Loaded 48090 existing records from primary storage. [2025-09-25T21:17:51.267204] [INFO ] [MAIN ] SMFG: Loaded 48090 existing records. [2025-09-25T21:17:51.474214] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:51.474838] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-25T21:17:51.474912] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-25T21:17:51.475336] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-25T21:17:51.475409] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-25T21:17:51.881138] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:51.888670] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-25T21:17:52.193607] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T21:17:52.688864] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-25T21:17:53.488778] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-25T21:17:53.534726] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T21:17:53.618415] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T21:17:54.092232] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T21:17:54.288735] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-25T21:17:55.088702] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-25T21:17:55.216215] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-25T21:17:55.888774] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-25T21:17:56.688741] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-25T21:17:56.925114] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T21:17:56.943315] [INFO ] [REMOTE ] SM: Full fetch complete (75205 records). [2025-09-25T21:17:56.944365] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-25T21:17:57.375597] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-25T21:17:57.375721] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-25T21:17:57.376904] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-25T21:17:57.376969] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-25T21:17:57.379066] [DEBUG] [LOCAL ] SM: Trimmed 75205 records to 52692 (keeping 200 days of data) [2025-09-25T21:17:57.491317] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-25T21:17:57.665784] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T21:17:57.685478] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T21:17:57.814688] [DEBUG] [LOCAL ] SM: Primary data saved (52692 records). [2025-09-25T21:17:57.814958] [INFO ] [MAIN ] SM: Full history saved. [2025-09-25T21:17:57.815124] [INFO ] [MAIN ] Update Progress: 1940/2372 symbols completed. SM took 43.2s. Estimated remaining: 57m 26s. Rate: 7.5 symbols/min [2025-09-25T21:17:57.987474] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:17:58.041850] [DEBUG] [LOCAL ] SMG: Loaded 43911 existing records from primary storage. [2025-09-25T21:17:58.042068] [INFO ] [MAIN ] SMG: Loaded 43911 existing records. [2025-09-25T21:17:58.229410] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:17:58.229903] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-25T21:17:58.229976] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-25T21:17:58.230501] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-25T21:17:58.230582] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-25T21:17:58.294028] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-25T21:17:58.543430] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T21:17:58.629311] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:17:59.088767] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-25T21:17:59.859352] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T21:17:59.888708] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-25T21:17:59.965536] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T21:18:00.688731] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-25T21:18:01.488700] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-25T21:18:01.564220] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T21:18:01.568214] [INFO ] [REMOTE ] SMC: Full fetch complete (16787 records). [2025-09-25T21:18:01.568294] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-25T21:18:02.006616] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T21:18:02.053881] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-25T21:18:02.053968] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-25T21:18:02.054480] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-25T21:18:02.054544] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-25T21:18:02.055344] [DEBUG] [LOCAL ] SMC: Trimmed 16787 records to 11564 (keeping 200 days of data) [2025-09-25T21:18:02.135231] [DEBUG] [LOCAL ] SMC: Primary data saved (11564 records). [2025-09-25T21:18:02.135401] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-25T21:18:02.135559] [INFO ] [MAIN ] Update Progress: 1941/2372 symbols completed. SMC took 20.8s. Estimated remaining: 57m 17s. Rate: 7.5 symbols/min [2025-09-25T21:18:02.292150] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-25T21:18:02.321484] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:02.346893] [DEBUG] [LOCAL ] SMHI: Loaded 13809 existing records from primary storage. [2025-09-25T21:18:02.347077] [INFO ] [MAIN ] SMHI: Loaded 13809 existing records. [2025-09-25T21:18:02.533491] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:18:02.533950] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-25T21:18:02.534010] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-25T21:18:02.534256] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-25T21:18:02.534333] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-25T21:18:02.955959] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:03.090231] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-25T21:18:03.096212] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:18:03.184149] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:18:03.888770] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-25T21:18:04.694063] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-25T21:18:04.697160] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T21:18:05.161050] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-25T21:18:05.488745] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-25T21:18:06.087216] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T21:18:06.288736] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-25T21:18:07.088800] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-25T21:18:07.145522] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T21:18:07.430349] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T21:18:07.888790] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-25T21:18:08.096588] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T21:18:08.688757] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-25T21:18:09.318100] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-25T21:18:09.346584] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T21:18:09.488745] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-25T21:18:10.283541] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T21:18:10.285771] [INFO ] [REMOTE ] SMBK: Full fetch complete (11824 records). [2025-09-25T21:18:10.285903] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-25T21:18:10.297366] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-25T21:18:10.743098] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-25T21:18:10.743208] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-25T21:18:10.743525] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-25T21:18:10.743570] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-25T21:18:10.744389] [DEBUG] [LOCAL ] SMBK: Trimmed 11824 records to 8297 (keeping 200 days of data) [2025-09-25T21:18:10.820186] [DEBUG] [LOCAL ] SMBK: Primary data saved (8297 records). [2025-09-25T21:18:10.820345] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-25T21:18:10.820533] [INFO ] [MAIN ] Update Progress: 1942/2372 symbols completed. SMBK took 30.5s. Estimated remaining: 57m 9s. Rate: 7.5 symbols/min [2025-09-25T21:18:11.016292] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:11.049508] [DEBUG] [LOCAL ] SMP: Loaded 19784 existing records from primary storage. [2025-09-25T21:18:11.049702] [INFO ] [MAIN ] SMP: Loaded 19784 existing records. [2025-09-25T21:18:11.097775] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-25T21:18:11.243863] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:18:11.244499] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-25T21:18:11.244549] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-25T21:18:11.244891] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-25T21:18:11.244950] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-25T21:18:11.632184] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:11.888706] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-25T21:18:11.999084] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T21:18:12.159319] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T21:18:12.568776] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-25T21:18:12.688736] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-25T21:18:13.488772] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-25T21:18:14.288764] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-25T21:18:14.467933] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T21:18:14.510272] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T21:18:15.088731] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-25T21:18:15.888719] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-25T21:18:16.184025] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T21:18:16.217121] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:18:16.688739] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-25T21:18:17.488705] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-25T21:18:17.707794] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:18:17.869803] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T21:18:18.288896] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-25T21:18:19.088754] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-25T21:18:19.339080] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T21:18:19.888746] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-25T21:18:19.955297] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T21:18:20.268694] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-25T21:18:20.688729] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-25T21:18:21.496311] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-25T21:18:21.528243] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:18:21.739420] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-25T21:18:22.288804] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-25T21:18:22.566012] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-25T21:18:23.088816] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-25T21:18:23.888779] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-25T21:18:24.003227] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T21:18:24.014518] [INFO ] [REMOTE ] SMFG: Full fetch complete (68859 records). [2025-09-25T21:18:24.014739] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-25T21:18:24.491402] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-25T21:18:24.491538] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-25T21:18:24.493084] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-25T21:18:24.493243] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-25T21:18:24.503985] [DEBUG] [LOCAL ] SMFG: Trimmed 68859 records to 48429 (keeping 200 days of data) [2025-09-25T21:18:24.535553] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T21:18:24.689568] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-25T21:18:24.902521] [DEBUG] [LOCAL ] SMFG: Primary data saved (48429 records). [2025-09-25T21:18:24.902706] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-25T21:18:24.902883] [INFO ] [MAIN ] Update Progress: 1943/2372 symbols completed. SMFG took 33.9s. Estimated remaining: 57m 3s. Rate: 7.5 symbols/min [2025-09-25T21:18:25.096299] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:25.096518] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-25T21:18:25.096567] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-25T21:18:25.105834] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-25T21:18:25.105891] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-25T21:18:25.105962] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-25T21:18:25.106018] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-25T21:18:25.117445] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T21:18:25.493737] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:25.494155] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-25T21:18:26.293771] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-25T21:18:26.315040] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T21:18:27.088734] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-25T21:18:27.317172] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T21:18:27.888732] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-25T21:18:28.123067] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-25T21:18:28.173908] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T21:18:28.563269] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T21:18:28.688735] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-25T21:18:29.488812] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-25T21:18:29.585465] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-25T21:18:30.288738] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-25T21:18:31.088726] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-25T21:18:31.209229] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T21:18:31.248363] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T21:18:31.888842] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-25T21:18:32.688780] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-25T21:18:33.087402] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T21:18:33.488765] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-25T21:18:33.760322] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-25T21:18:34.229308] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:18:34.243638] [INFO ] [REMOTE ] SMG: Full fetch complete (62649 records). [2025-09-25T21:18:34.243844] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-25T21:18:34.289158] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-25T21:18:34.707998] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-25T21:18:34.708106] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-25T21:18:34.709151] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-25T21:18:34.709242] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-25T21:18:34.712796] [DEBUG] [LOCAL ] SMG: Trimmed 62649 records to 44209 (keeping 200 days of data) [2025-09-25T21:18:34.870583] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T21:18:35.059788] [DEBUG] [LOCAL ] SMG: Primary data saved (44209 records). [2025-09-25T21:18:35.060027] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-25T21:18:35.060264] [INFO ] [MAIN ] Update Progress: 1944/2372 symbols completed. SMG took 37.2s. Estimated remaining: 56m 55s. Rate: 7.5 symbols/min [2025-09-25T21:18:35.092076] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-25T21:18:35.240393] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T21:18:35.246537] [INFO ] [REMOTE ] SMHI: Full fetch complete (24116 records). [2025-09-25T21:18:35.246712] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-25T21:18:35.291003] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:35.399332] [DEBUG] [LOCAL ] SMRT: Loaded 44219 existing records from primary storage. [2025-09-25T21:18:35.399499] [INFO ] [MAIN ] SMRT: Loaded 44219 existing records. [2025-09-25T21:18:35.738467] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:18:35.768734] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-25T21:18:35.768852] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-25T21:18:35.769320] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-25T21:18:35.769401] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-25T21:18:35.940719] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-25T21:18:35.969385] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T21:18:35.984337] [INFO ] [REMOTE ] SMP: Full fetch complete (26127 records). [2025-09-25T21:18:35.984521] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-25T21:18:36.273684] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-25T21:18:36.273796] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-25T21:18:36.274397] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-25T21:18:36.274439] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-25T21:18:36.281630] [DEBUG] [LOCAL ] SMHI: Trimmed 24116 records to 13854 (keeping 200 days of data) [2025-09-25T21:18:36.514537] [DEBUG] [LOCAL ] SMHI: Primary data saved (13854 records). [2025-09-25T21:18:36.515686] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-25T21:18:36.515909] [INFO ] [MAIN ] Update Progress: 1945/2372 symbols completed. SMHI took 34.4s. Estimated remaining: 56m 46s. Rate: 7.5 symbols/min [2025-09-25T21:18:36.954577] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:36.954989] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-25T21:18:37.015240] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:37.120408] [DEBUG] [LOCAL ] SMWB: Loaded 32775 existing records from primary storage. [2025-09-25T21:18:37.120572] [INFO ] [MAIN ] SMWB: Loaded 32775 existing records. [2025-09-25T21:18:37.177878] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-25T21:18:37.177989] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-25T21:18:37.178676] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-25T21:18:37.178750] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-25T21:18:37.188780] [DEBUG] [LOCAL ] SMP: Trimmed 26127 records to 19897 (keeping 200 days of data) [2025-09-25T21:18:37.484090] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:18:37.488069] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-25T21:18:37.488122] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-25T21:18:37.488378] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-25T21:18:37.488437] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-25T21:18:37.707759] [DEBUG] [LOCAL ] SMP: Primary data saved (19897 records). [2025-09-25T21:18:37.707931] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-25T21:18:37.708097] [INFO ] [MAIN ] Update Progress: 1946/2372 symbols completed. SMP took 26.9s. Estimated remaining: 56m 36s. Rate: 7.5 symbols/min [2025-09-25T21:18:38.189892] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:38.190395] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-25T21:18:38.201996] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:18:38.279610] [DEBUG] [LOCAL ] SN: Loaded 49791 existing records from primary storage. [2025-09-25T21:18:38.279856] [INFO ] [MAIN ] SN: Loaded 49791 existing records. [2025-09-25T21:18:38.496290] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:18:38.497777] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-25T21:18:38.497840] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-25T21:18:38.498210] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-25T21:18:38.498275] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-25T21:18:38.684370] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T21:18:38.716216] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-25T21:18:38.773783] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-25T21:18:39.033302] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:18:39.088680] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-25T21:18:39.424835] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T21:18:39.888722] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-25T21:18:40.267360] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T21:18:40.688768] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-25T21:18:41.436250] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:18:41.488728] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-25T21:18:41.755513] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.67 seconds). [2025-09-25T21:18:42.294352] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-25T21:18:42.312557] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T21:18:42.955376] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T21:18:43.088757] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-25T21:18:43.889052] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-25T21:18:44.024168] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T21:18:44.601857] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T21:18:44.688728] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-25T21:18:45.078230] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T21:18:45.488735] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-25T21:18:45.831695] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T21:18:46.288751] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-25T21:18:47.088737] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-25T21:18:47.783586] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T21:18:47.888752] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-25T21:18:48.176211] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-25T21:18:48.343764] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:18:48.688746] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-25T21:18:49.488733] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-25T21:18:49.626985] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T21:18:50.288779] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-25T21:18:50.920050] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-25T21:18:51.088709] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-25T21:18:51.350429] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T21:18:51.411581] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-25T21:18:51.888834] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-25T21:18:52.688693] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-25T21:18:52.868521] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T21:18:53.350279] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T21:18:53.488739] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-25T21:18:54.135771] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T21:18:54.288735] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-25T21:18:55.088791] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-25T21:18:55.351327] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T21:18:55.888775] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-25T21:18:56.463187] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:18:56.688759] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-25T21:18:57.090626] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-25T21:18:57.466742] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T21:18:57.495063] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-25T21:18:57.530959] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T21:18:58.288764] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-25T21:18:59.088794] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-25T21:18:59.889120] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-25T21:19:00.103364] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T21:19:00.158568] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T21:19:00.168614] [INFO ] [REMOTE ] SMWB: Full fetch complete (50009 records). [2025-09-25T21:19:00.168919] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-25T21:19:00.513187] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (3.02 seconds). [2025-09-25T21:19:00.694749] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-25T21:19:00.772049] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-25T21:19:00.772190] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-25T21:19:00.773296] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-25T21:19:00.773421] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-25T21:19:00.774841] [DEBUG] [LOCAL ] SMWB: Trimmed 50009 records to 32959 (keeping 200 days of data) [2025-09-25T21:19:00.989094] [DEBUG] [LOCAL ] SMWB: Primary data saved (32959 records). [2025-09-25T21:19:00.989261] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-25T21:19:00.989479] [INFO ] [MAIN ] Update Progress: 1947/2372 symbols completed. SMWB took 24.5s. Estimated remaining: 56m 32s. Rate: 7.5 symbols/min [2025-09-25T21:19:01.190576] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:01.230794] [DEBUG] [LOCAL ] SNA: Loaded 26318 existing records from primary storage. [2025-09-25T21:19:01.230951] [INFO ] [MAIN ] SNA: Loaded 26318 existing records. [2025-09-25T21:19:01.389386] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T21:19:01.493804] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-25T21:19:01.502920] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:01.503317] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-25T21:19:01.503382] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-25T21:19:01.503951] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-25T21:19:01.504028] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-25T21:19:01.930900] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:02.288764] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-25T21:19:03.088744] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-25T21:19:03.477660] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T21:19:03.589552] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-25T21:19:03.888697] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-25T21:19:04.066153] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:19:04.134799] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T21:19:04.689282] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-25T21:19:04.689436] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-25T21:19:04.706509] [INFO ] [REMOTE ] SMR: Full fetch complete (77584 records). [2025-09-25T21:19:04.706773] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-25T21:19:04.707980] [FATAL] [VALIDATOR ] SMR: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T21:19:04.708099] [FATAL] [MAIN ] SMR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:19:04.708190] [WARN ] [MAIN ] SMR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:19:04.708267] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-25T21:19:04.708342] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-25T21:19:04.708439] [INFO ] [LOCAL ] SMR: Starting deletion of derivative data. [2025-09-25T21:19:04.708529] [DEBUG] [LOCAL ] SMR: No derivative data file found to delete. [2025-09-25T21:19:04.708674] [INFO ] [MAIN ] Update Progress: 1948/2372 symbols completed. SMR took 39.8s. Estimated remaining: 56m 23s. Rate: 7.5 symbols/min [2025-09-25T21:19:04.918315] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:04.987135] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-25T21:19:04.987300] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-25T21:19:05.177144] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:05.177481] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-25T21:19:05.177530] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-25T21:19:05.177921] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-25T21:19:05.177987] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-25T21:19:05.494715] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-25T21:19:05.588600] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:06.288767] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-25T21:19:06.657236] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-25T21:19:06.986181] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T21:19:07.088723] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-25T21:19:07.888797] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-25T21:19:08.471881] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T21:19:08.693867] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-25T21:19:08.715802] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-25T21:19:09.488751] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-25T21:19:09.648017] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T21:19:09.662896] [INFO ] [REMOTE ] SN: Full fetch complete (70810 records). [2025-09-25T21:19:09.663136] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-25T21:19:10.090177] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-25T21:19:10.090309] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-25T21:19:10.091972] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-25T21:19:10.092046] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-25T21:19:10.093886] [DEBUG] [LOCAL ] SN: Trimmed 70810 records to 50150 (keeping 200 days of data) [2025-09-25T21:19:10.259260] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T21:19:10.277008] [INFO ] [REMOTE ] SMRT: Full fetch complete (62134 records). [2025-09-25T21:19:10.277197] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-25T21:19:10.288826] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-25T21:19:10.772986] [DEBUG] [LOCAL ] SN: Primary data saved (50150 records). [2025-09-25T21:19:10.773221] [INFO ] [MAIN ] SN: Full history saved. [2025-09-25T21:19:10.773516] [INFO ] [MAIN ] Update Progress: 1949/2372 symbols completed. SN took 33.1s. Estimated remaining: 56m 14s. Rate: 7.5 symbols/min [2025-09-25T21:19:11.105361] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T21:19:11.130549] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-25T21:19:11.192928] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-25T21:19:11.193176] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-25T21:19:11.197682] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-25T21:19:11.197784] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-25T21:19:11.237703] [DEBUG] [LOCAL ] SMRT: Trimmed 62134 records to 44436 (keeping 200 days of data) [2025-09-25T21:19:11.245724] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:11.313275] [DEBUG] [LOCAL ] SNDA: Loaded 4672 existing records from primary storage. [2025-09-25T21:19:11.313421] [INFO ] [MAIN ] SNDA: Loaded 4672 existing records. [2025-09-25T21:19:11.750373] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:11.750713] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-25T21:19:11.750800] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-25T21:19:11.751109] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-25T21:19:11.751173] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-25T21:19:12.189376] [DEBUG] [LOCAL ] SMRT: Primary data saved (44436 records). [2025-09-25T21:19:12.189599] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-25T21:19:12.189805] [INFO ] [MAIN ] Update Progress: 1950/2372 symbols completed. SMRT took 37.1s. Estimated remaining: 56m 5s. Rate: 7.5 symbols/min [2025-09-25T21:19:12.347558] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:12.367981] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-25T21:19:12.492162] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:12.543151] [DEBUG] [LOCAL ] SNDR: Loaded 40714 existing records from primary storage. [2025-09-25T21:19:12.543344] [INFO ] [MAIN ] SNDR: Loaded 40714 existing records. [2025-09-25T21:19:12.771744] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:12.773061] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-25T21:19:12.773142] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-25T21:19:12.773545] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-25T21:19:12.773616] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-25T21:19:12.891123] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:19:12.909064] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-25T21:19:12.929480] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-25T21:19:13.267965] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:13.293426] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-25T21:19:13.488728] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-25T21:19:14.179897] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T21:19:14.289876] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-25T21:19:15.068844] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T21:19:15.088670] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-25T21:19:15.193350] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-25T21:19:15.888734] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-25T21:19:16.665112] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:19:16.688677] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-25T21:19:17.488732] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-25T21:19:18.163816] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-25T21:19:18.182301] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-25T21:19:18.209068] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T21:19:18.288698] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-25T21:19:18.996971] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T21:19:19.088737] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-25T21:19:19.850836] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T21:19:19.888708] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-25T21:19:20.600870] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T21:19:20.688710] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-25T21:19:21.488739] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-25T21:19:22.288746] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-25T21:19:23.053100] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T21:19:23.093805] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-25T21:19:23.115788] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-25T21:19:23.180415] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T21:19:23.888744] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-25T21:19:24.693855] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-25T21:19:24.708834] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T21:19:24.819515] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T21:19:25.201209] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-25T21:19:25.488765] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-25T21:19:26.288729] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-25T21:19:26.776450] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T21:19:27.088770] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-25T21:19:27.133263] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T21:19:27.888760] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-25T21:19:28.312192] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T21:19:28.688735] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-25T21:19:29.340484] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T21:19:29.488782] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-25T21:19:30.146273] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T21:19:30.147913] [INFO ] [REMOTE ] SNDA: Full fetch complete (8490 records). [2025-09-25T21:19:30.147991] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-25T21:19:30.293777] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-25T21:19:30.437500] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-25T21:19:30.626915] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-25T21:19:30.627010] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-25T21:19:30.627250] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-25T21:19:30.627313] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-25T21:19:30.627825] [DEBUG] [LOCAL ] SNDA: Trimmed 8490 records to 4711 (keeping 200 days of data) [2025-09-25T21:19:30.657619] [DEBUG] [LOCAL ] SNDA: Primary data saved (4711 records). [2025-09-25T21:19:30.657762] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-25T21:19:30.657921] [INFO ] [MAIN ] Update Progress: 1951/2372 symbols completed. SNDA took 19.9s. Estimated remaining: 55m 59s. Rate: 7.5 symbols/min [2025-09-25T21:19:30.845939] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:30.900841] [DEBUG] [LOCAL ] SNN: Loaded 44392 existing records from primary storage. [2025-09-25T21:19:30.901005] [INFO ] [MAIN ] SNN: Loaded 44392 existing records. [2025-09-25T21:19:31.089023] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-25T21:19:31.090236] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:31.090611] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-25T21:19:31.090699] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-25T21:19:31.091071] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-25T21:19:31.091615] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-25T21:19:31.469716] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:31.831077] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T21:19:31.888733] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-25T21:19:32.688688] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-25T21:19:32.813884] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-25T21:19:32.820774] [INFO ] [REMOTE ] SNA: Full fetch complete (39097 records). [2025-09-25T21:19:32.820910] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-25T21:19:33.308381] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-25T21:19:33.308472] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-25T21:19:33.309389] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-25T21:19:33.309479] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-25T21:19:33.310546] [DEBUG] [LOCAL ] SNA: Trimmed 39097 records to 26478 (keeping 200 days of data) [2025-09-25T21:19:33.487847] [DEBUG] [LOCAL ] SNA: Primary data saved (26478 records). [2025-09-25T21:19:33.488020] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-25T21:19:33.488138] [INFO ] [MAIN ] Update Progress: 1952/2372 symbols completed. SNA took 32.5s. Estimated remaining: 55m 50s. Rate: 7.5 symbols/min [2025-09-25T21:19:33.504727] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-25T21:19:33.594164] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-25T21:19:33.731430] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:33.731671] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-25T21:19:33.731730] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-25T21:19:33.731943] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-25T21:19:33.731984] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-25T21:19:33.732027] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-25T21:19:33.732060] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-25T21:19:34.181887] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:34.300139] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-25T21:19:34.307819] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T21:19:35.088746] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-25T21:19:35.246556] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:19:35.888786] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-25T21:19:36.636936] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T21:19:36.688685] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-25T21:19:37.019603] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-25T21:19:37.488689] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-25T21:19:37.663688] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T21:19:38.293539] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-25T21:19:38.303923] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T21:19:38.312690] [INFO ] [REMOTE ] SNDR: Full fetch complete (58965 records). [2025-09-25T21:19:38.312840] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-25T21:19:38.754805] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-25T21:19:38.754899] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-25T21:19:38.755897] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-25T21:19:38.755963] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-25T21:19:38.757316] [DEBUG] [LOCAL ] SNDR: Trimmed 58965 records to 41031 (keeping 200 days of data) [2025-09-25T21:19:39.022125] [DEBUG] [LOCAL ] SNDR: Primary data saved (41031 records). [2025-09-25T21:19:39.022271] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-25T21:19:39.022363] [INFO ] [MAIN ] Update Progress: 1953/2372 symbols completed. SNDR took 26.8s. Estimated remaining: 55m 42s. Rate: 7.5 symbols/min [2025-09-25T21:19:39.089191] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-25T21:19:39.220067] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:39.265727] [DEBUG] [LOCAL ] SNV: Loaded 48908 existing records from primary storage. [2025-09-25T21:19:39.265886] [INFO ] [MAIN ] SNV: Loaded 48908 existing records. [2025-09-25T21:19:39.467539] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:39.467922] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-25T21:19:39.467975] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-25T21:19:39.468429] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-25T21:19:39.468491] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-25T21:19:39.915961] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:39.916287] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-25T21:19:40.020323] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-25T21:19:40.706945] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-25T21:19:40.718306] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-25T21:19:40.753878] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T21:19:41.433159] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T21:19:41.488727] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-25T21:19:42.288743] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-25T21:19:42.942059] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-25T21:19:43.088760] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-25T21:19:43.264057] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T21:19:43.888712] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-25T21:19:44.066599] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T21:19:44.688734] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-25T21:19:45.480030] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-25T21:19:45.491491] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-25T21:19:46.097511] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-25T21:19:46.288710] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-25T21:19:46.345365] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-25T21:19:46.893232] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T21:19:47.088733] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-25T21:19:47.888697] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-25T21:19:47.994201] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T21:19:48.688730] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-25T21:19:48.930209] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T21:19:49.488741] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-25T21:19:50.269286] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-25T21:19:50.289576] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-25T21:19:50.313462] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T21:19:51.088751] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-25T21:19:51.244908] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T21:19:51.498969] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:19:51.888735] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-25T21:19:52.688730] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-25T21:19:52.868099] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:19:53.488772] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-25T21:19:54.288802] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-25T21:19:54.461107] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-25T21:19:54.472440] [INFO ] [REMOTE ] SNAP: Full fetch complete (77933 records). [2025-09-25T21:19:54.472692] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-25T21:19:54.896558] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-25T21:19:54.896704] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-25T21:19:54.898390] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-25T21:19:54.898508] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-25T21:19:54.901572] [DEBUG] [LOCAL ] SNAP: Trimmed 77933 records to 54186 (keeping 200 days of data) [2025-09-25T21:19:55.328449] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T21:19:55.362732] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-25T21:19:55.396132] [DEBUG] [LOCAL ] SNAP: Primary data saved (54186 records). [2025-09-25T21:19:55.396320] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-25T21:19:55.396550] [INFO ] [MAIN ] Update Progress: 1954/2372 symbols completed. SNAP took 50.7s. Estimated remaining: 55m 36s. Rate: 7.5 symbols/min [2025-09-25T21:19:55.436939] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.75 seconds). [2025-09-25T21:19:55.538128] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T21:19:55.648534] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:55.707963] [DEBUG] [LOCAL ] SNX: Loaded 39794 existing records from primary storage. [2025-09-25T21:19:55.708179] [INFO ] [MAIN ] SNX: Loaded 39794 existing records. [2025-09-25T21:19:55.892223] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-25T21:19:55.917271] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:19:55.920131] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-25T21:19:55.920226] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-25T21:19:55.920901] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-25T21:19:55.920994] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-25T21:19:56.313796] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:56.688767] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-25T21:19:57.052925] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T21:19:57.143932] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T21:19:57.155128] [INFO ] [REMOTE ] SNN: Full fetch complete (63129 records). [2025-09-25T21:19:57.155292] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-25T21:19:57.493672] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-25T21:19:57.614536] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-25T21:19:57.614688] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-25T21:19:57.616084] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-25T21:19:57.616154] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-25T21:19:57.618283] [DEBUG] [LOCAL ] SNN: Trimmed 63129 records to 44731 (keeping 200 days of data) [2025-09-25T21:19:57.883701] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T21:19:57.958011] [DEBUG] [LOCAL ] SNN: Primary data saved (44731 records). [2025-09-25T21:19:57.958166] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-25T21:19:57.958311] [INFO ] [MAIN ] Update Progress: 1955/2372 symbols completed. SNN took 27.3s. Estimated remaining: 55m 26s. Rate: 7.5 symbols/min [2025-09-25T21:19:58.145282] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:19:58.145502] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-25T21:19:58.145562] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-25T21:19:58.146533] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-25T21:19:58.146584] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-25T21:19:58.146681] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-25T21:19:58.146741] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-25T21:19:58.299530] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-25T21:19:58.541387] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:19:59.088782] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-25T21:19:59.402535] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-25T21:19:59.888728] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-25T21:19:59.928366] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T21:20:00.688846] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-25T21:20:01.007135] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T21:20:01.494003] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-25T21:20:01.529843] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:20:02.288778] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-25T21:20:03.053794] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-25T21:20:03.088696] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-25T21:20:03.256208] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:20:03.607081] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-25T21:20:03.623856] [INFO ] [REMOTE ] SNV: Full fetch complete (71145 records). [2025-09-25T21:20:03.624107] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-25T21:20:03.890401] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-25T21:20:04.079124] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-25T21:20:04.079892] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-25T21:20:04.081231] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-25T21:20:04.081313] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-25T21:20:04.083099] [DEBUG] [LOCAL ] SNV: Trimmed 71145 records to 49296 (keeping 200 days of data) [2025-09-25T21:20:04.429605] [DEBUG] [LOCAL ] SNV: Primary data saved (49296 records). [2025-09-25T21:20:04.429885] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-25T21:20:04.430138] [INFO ] [MAIN ] Update Progress: 1956/2372 symbols completed. SNV took 25.4s. Estimated remaining: 55m 18s. Rate: 7.5 symbols/min [2025-09-25T21:20:04.627829] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:04.686296] [DEBUG] [LOCAL ] SOBO: Loaded 39598 existing records from primary storage. [2025-09-25T21:20:04.686503] [INFO ] [MAIN ] SOBO: Loaded 39598 existing records. [2025-09-25T21:20:04.695142] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-25T21:20:04.905492] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:04.905831] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-25T21:20:04.905895] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-25T21:20:04.906263] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-25T21:20:04.906336] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-25T21:20:05.343889] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:05.507619] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-25T21:20:05.522731] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-25T21:20:05.820152] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T21:20:06.288760] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-25T21:20:06.471882] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T21:20:07.088738] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-25T21:20:07.234095] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-25T21:20:07.888799] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-25T21:20:08.688750] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-25T21:20:08.848696] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T21:20:08.933445] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-25T21:20:09.488749] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-25T21:20:09.900807] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T21:20:10.288734] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-25T21:20:10.355348] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:20:11.078801] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T21:20:11.090572] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-25T21:20:11.131840] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T21:20:11.147471] [INFO ] [REMOTE ] SNOW: Full fetch complete (77263 records). [2025-09-25T21:20:11.147723] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-25T21:20:11.151113] [FATAL] [VALIDATOR ] SNOW: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T21:20:11.151276] [FATAL] [MAIN ] SNOW: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:20:11.151351] [WARN ] [MAIN ] SNOW: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:20:11.151430] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-25T21:20:11.151567] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-25T21:20:11.151669] [INFO ] [LOCAL ] SNOW: Starting deletion of derivative data. [2025-09-25T21:20:11.151766] [DEBUG] [LOCAL ] SNOW: No derivative data file found to delete. [2025-09-25T21:20:11.151920] [INFO ] [MAIN ] Update Progress: 1957/2372 symbols completed. SNOW took 37.7s. Estimated remaining: 55m 10s. Rate: 7.5 symbols/min [2025-09-25T21:20:11.888734] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-25T21:20:12.688783] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-25T21:20:13.109584] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T21:20:13.405671] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T21:20:13.488724] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-25T21:20:14.023108] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T21:20:14.288785] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-25T21:20:15.088699] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-25T21:20:15.197075] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T21:20:15.888737] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-25T21:20:15.938371] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:20:16.688716] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-25T21:20:17.109334] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-25T21:20:17.473728] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T21:20:17.488675] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-25T21:20:17.930017] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T21:20:18.288755] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-25T21:20:18.998231] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T21:20:19.088772] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-25T21:20:19.813753] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T21:20:19.888727] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-25T21:20:20.680811] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T21:20:20.688993] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-25T21:20:21.489765] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-25T21:20:21.724737] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T21:20:22.288702] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-25T21:20:22.381268] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:20:22.394034] [INFO ] [REMOTE ] SNX: Full fetch complete (56762 records). [2025-09-25T21:20:22.394306] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-25T21:20:22.673545] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T21:20:22.875878] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-25T21:20:22.876007] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-25T21:20:22.877299] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-25T21:20:22.877387] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-25T21:20:22.879670] [DEBUG] [LOCAL ] SNX: Trimmed 56762 records to 40172 (keeping 200 days of data) [2025-09-25T21:20:23.097907] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-25T21:20:23.179504] [DEBUG] [LOCAL ] SNX: Primary data saved (40172 records). [2025-09-25T21:20:23.179678] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-25T21:20:23.179786] [INFO ] [MAIN ] Update Progress: 1958/2372 symbols completed. SNX took 27.8s. Estimated remaining: 55m 3s. Rate: 7.5 symbols/min [2025-09-25T21:20:24.339558] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T21:20:24.358878] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-25T21:20:24.714248] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T21:20:24.723425] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-25T21:20:25.315367] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-25T21:20:25.488742] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-25T21:20:26.088183] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-25T21:20:26.096031] [INFO ] [REMOTE ] SOBO: Full fetch complete (58509 records). [2025-09-25T21:20:26.096163] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-25T21:20:26.354293] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T21:20:26.385294] [INFO ] [REMOTE ] SO: Full fetch complete (77196 records). [2025-09-25T21:20:26.385453] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-25T21:20:26.386447] [FATAL] [VALIDATOR ] SO: Data is stale - most recent date (2025-09-24) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T21:20:26.386568] [FATAL] [MAIN ] SO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:20:26.386612] [WARN ] [MAIN ] SO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:20:26.386678] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-25T21:20:26.386797] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-25T21:20:26.386855] [INFO ] [LOCAL ] SO: Starting deletion of derivative data. [2025-09-25T21:20:26.386914] [DEBUG] [LOCAL ] SO: No derivative data file found to delete. [2025-09-25T21:20:26.386998] [INFO ] [MAIN ] Update Progress: 1959/2372 symbols completed. SO took 28.4s. Estimated remaining: 54m 54s. Rate: 7.5 symbols/min [2025-09-25T21:20:26.574002] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-25T21:20:26.574088] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-25T21:20:26.575281] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-25T21:20:26.575347] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-25T21:20:26.578114] [DEBUG] [LOCAL ] SOBO: Trimmed 58509 records to 39894 (keeping 200 days of data) [2025-09-25T21:20:26.843854] [DEBUG] [LOCAL ] SOBO: Primary data saved (39894 records). [2025-09-25T21:20:26.844012] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-25T21:20:26.844155] [INFO ] [MAIN ] Update Progress: 1960/2372 symbols completed. SOBO took 22.4s. Estimated remaining: 54m 44s. Rate: 7.5 symbols/min [2025-09-25T21:20:27.562754] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:27.586548] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:27.641614] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:27.645147] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:27.656307] [DEBUG] [LOCAL ] SOJE: Loaded 9259 existing records from primary storage. [2025-09-25T21:20:27.663638] [INFO ] [MAIN ] SOJE: Loaded 9259 existing records. [2025-09-25T21:20:27.683840] [DEBUG] [LOCAL ] SOJC: Loaded 5058 existing records from primary storage. [2025-09-25T21:20:27.684013] [INFO ] [MAIN ] SOJC: Loaded 5058 existing records. [2025-09-25T21:20:27.713512] [DEBUG] [LOCAL ] SOJD: Loaded 12935 existing records from primary storage. [2025-09-25T21:20:27.713808] [INFO ] [MAIN ] SOJD: Loaded 12935 existing records. [2025-09-25T21:20:27.924814] [DEBUG] [LOCAL ] SOC: Loaded 50261 existing records from primary storage. [2025-09-25T21:20:27.925044] [INFO ] [MAIN ] SOC: Loaded 50261 existing records. [2025-09-25T21:20:28.428316] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:28.440111] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-25T21:20:28.440183] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-25T21:20:28.440619] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-25T21:20:28.449943] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-25T21:20:28.517614] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:28.517913] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-25T21:20:28.517963] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-25T21:20:28.518277] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-25T21:20:28.518337] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-25T21:20:28.535844] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:28.536087] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-25T21:20:28.536132] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-25T21:20:28.536381] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-25T21:20:28.536466] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-25T21:20:28.732474] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:28.740182] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-25T21:20:28.740240] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-25T21:20:28.787883] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-25T21:20:28.788152] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-25T21:20:30.182473] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:30.187726] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-25T21:20:30.236485] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:30.239550] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-25T21:20:30.252815] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:30.253081] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-25T21:20:30.349742] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:30.350120] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-25T21:20:31.159602] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T21:20:31.162504] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-25T21:20:31.352206] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:20:31.358200] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-25T21:20:31.439341] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T21:20:31.444213] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-25T21:20:31.707978] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T21:20:31.726012] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T21:20:31.888739] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-25T21:20:31.957832] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T21:20:32.091560] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T21:20:32.688824] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-25T21:20:33.337213] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T21:20:33.488703] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-25T21:20:33.613250] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-25T21:20:34.288717] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-25T21:20:34.455915] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T21:20:35.088787] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-25T21:20:35.888795] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-25T21:20:36.005989] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T21:20:36.037814] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T21:20:36.688748] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-25T21:20:36.836016] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T21:20:37.488759] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-25T21:20:37.621631] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T21:20:38.035887] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T21:20:38.288742] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-25T21:20:39.088750] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-25T21:20:39.248997] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-25T21:20:39.888787] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-25T21:20:40.688829] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-25T21:20:40.835235] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T21:20:40.899194] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T21:20:41.296848] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T21:20:41.489876] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-25T21:20:42.267907] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T21:20:42.288688] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-25T21:20:43.088776] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-25T21:20:43.860246] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T21:20:43.888779] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-25T21:20:44.205892] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:20:44.497256] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T21:20:44.688745] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-25T21:20:45.441132] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-25T21:20:45.488703] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-25T21:20:46.288753] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-25T21:20:46.893019] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T21:20:47.088709] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-25T21:20:47.272758] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T21:20:47.481291] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-25T21:20:47.888743] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-25T21:20:48.646802] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T21:20:48.688733] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-25T21:20:49.488717] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-25T21:20:49.638470] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T21:20:50.056153] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T21:20:50.288743] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-25T21:20:51.088765] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-25T21:20:51.888726] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-25T21:20:51.929296] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:20:52.033218] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T21:20:52.547592] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T21:20:52.550142] [INFO ] [REMOTE ] SOJE: Full fetch complete (14551 records). [2025-09-25T21:20:52.550272] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-25T21:20:52.693792] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-25T21:20:52.960159] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-25T21:20:52.960295] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-25T21:20:52.960747] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-25T21:20:52.960908] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-25T21:20:52.961624] [DEBUG] [LOCAL ] SOJE: Trimmed 14551 records to 9346 (keeping 200 days of data) [2025-09-25T21:20:53.034457] [DEBUG] [LOCAL ] SOJE: Primary data saved (9346 records). [2025-09-25T21:20:53.034635] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-25T21:20:53.035006] [INFO ] [MAIN ] Update Progress: 1961/2372 symbols completed. SOJE took 26.2s. Estimated remaining: 54m 40s. Rate: 7.5 symbols/min [2025-09-25T21:20:53.219100] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:53.219315] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-25T21:20:53.219372] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-25T21:20:53.222684] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-25T21:20:53.222769] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-25T21:20:53.222840] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-25T21:20:53.222903] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-25T21:20:53.493776] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-25T21:20:53.621620] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:53.718934] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:20:54.288739] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-25T21:20:55.088706] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-25T21:20:55.146250] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T21:20:55.284163] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T21:20:55.841973] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T21:20:55.843850] [INFO ] [REMOTE ] SOJC: Full fetch complete (7881 records). [2025-09-25T21:20:55.843926] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-25T21:20:55.894018] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-25T21:20:56.275260] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-25T21:20:56.275348] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-25T21:20:56.275577] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-25T21:20:56.275618] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-25T21:20:56.276114] [DEBUG] [LOCAL ] SOJC: Trimmed 7881 records to 5090 (keeping 200 days of data) [2025-09-25T21:20:56.314237] [DEBUG] [LOCAL ] SOJC: Primary data saved (5090 records). [2025-09-25T21:20:56.314396] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-25T21:20:56.314575] [INFO ] [MAIN ] Update Progress: 1962/2372 symbols completed. SOJC took 29.4s. Estimated remaining: 54m 31s. Rate: 7.5 symbols/min [2025-09-25T21:20:56.502199] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:56.534355] [DEBUG] [LOCAL ] SOL: Loaded 13541 existing records from primary storage. [2025-09-25T21:20:56.534523] [INFO ] [MAIN ] SOL: Loaded 13541 existing records. [2025-09-25T21:20:56.694731] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-25T21:20:56.736260] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:56.737345] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-25T21:20:56.737399] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-25T21:20:56.737719] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-25T21:20:56.737781] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-25T21:20:56.833861] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T21:20:56.856873] [INFO ] [REMOTE ] SOJD: Full fetch complete (20132 records). [2025-09-25T21:20:56.883737] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-25T21:20:56.941772] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:20:56.942168] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-25T21:20:57.393572] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:57.493259] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-25T21:20:57.615462] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-25T21:20:57.615559] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-25T21:20:57.616069] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-25T21:20:57.616134] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-25T21:20:57.616917] [DEBUG] [LOCAL ] SOJD: Trimmed 20132 records to 13059 (keeping 200 days of data) [2025-09-25T21:20:57.706892] [DEBUG] [LOCAL ] SOJD: Primary data saved (13059 records). [2025-09-25T21:20:57.707066] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-25T21:20:57.707224] [INFO ] [MAIN ] Update Progress: 1963/2372 symbols completed. SOJD took 30.9s. Estimated remaining: 54m 22s. Rate: 7.5 symbols/min [2025-09-25T21:20:57.898571] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:20:57.976264] [DEBUG] [LOCAL ] SOLV: Loaded 44090 existing records from primary storage. [2025-09-25T21:20:57.976467] [INFO ] [MAIN ] SOLV: Loaded 44090 existing records. [2025-09-25T21:20:58.194674] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:20:58.195036] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-25T21:20:58.195087] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-25T21:20:58.195462] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-25T21:20:58.195523] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-25T21:20:58.296799] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-25T21:20:58.603674] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:20:58.660789] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T21:20:59.088785] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-25T21:20:59.888686] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-25T21:21:00.107064] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T21:21:00.284210] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T21:21:00.688733] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-25T21:21:01.414672] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T21:21:01.488725] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-25T21:21:01.646228] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-25T21:21:02.288735] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-25T21:21:03.045983] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:21:03.088734] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-25T21:21:03.888761] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-25T21:21:04.121375] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-25T21:21:04.135114] [INFO ] [REMOTE ] SOC: Full fetch complete (71340 records). [2025-09-25T21:21:04.135327] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-25T21:21:04.641188] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T21:21:04.649021] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-25T21:21:04.649100] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-25T21:21:04.650461] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-25T21:21:04.650558] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-25T21:21:04.653388] [DEBUG] [LOCAL ] SOC: Trimmed 71340 records to 50651 (keeping 200 days of data) [2025-09-25T21:21:04.719143] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-25T21:21:04.779503] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:21:05.035197] [DEBUG] [LOCAL ] SOC: Primary data saved (50651 records). [2025-09-25T21:21:05.035373] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-25T21:21:05.035499] [INFO ] [MAIN ] Update Progress: 1964/2372 symbols completed. SOC took 38.2s. Estimated remaining: 54m 14s. Rate: 7.5 symbols/min [2025-09-25T21:21:05.224363] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:05.332228] [DEBUG] [LOCAL ] SON: Loaded 42894 existing records from primary storage. [2025-09-25T21:21:05.334084] [INFO ] [MAIN ] SON: Loaded 42894 existing records. [2025-09-25T21:21:05.493865] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-25T21:21:05.620941] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:05.621220] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-25T21:21:05.621267] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-25T21:21:05.621752] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-25T21:21:05.621817] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-25T21:21:05.865528] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-25T21:21:06.173439] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:06.288755] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-25T21:21:06.988148] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T21:21:07.088539] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T21:21:07.094040] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-25T21:21:07.874970] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T21:21:07.888750] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-25T21:21:08.688736] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-25T21:21:09.488692] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-25T21:21:09.557939] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:21:09.584417] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T21:21:10.293481] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-25T21:21:10.299018] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T21:21:11.088740] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-25T21:21:11.892493] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-25T21:21:11.897561] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T21:21:12.531328] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T21:21:12.694166] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-25T21:21:12.708093] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T21:21:13.494188] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-25T21:21:13.495245] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:21:14.288793] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-25T21:21:15.090592] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-25T21:21:15.094521] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T21:21:15.400060] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:21:15.888742] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-25T21:21:15.998459] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-25T21:21:15.998891] [WARN ] [REMOTE ] SOJF: No data returned for month 2025-06 [2025-09-25T21:21:16.461679] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T21:21:16.688787] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-25T21:21:17.475011] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T21:21:17.488676] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-25T21:21:18.251593] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-25T21:21:18.288690] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-25T21:21:18.923384] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T21:21:18.925713] [INFO ] [REMOTE ] SOJF: Full fetch complete (11744 records). [2025-09-25T21:21:18.925832] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-25T21:21:19.089493] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-25T21:21:19.126508] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 154 unique days, need 200 days [2025-09-25T21:21:19.126800] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:21:19.126888] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:21:19.127090] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-25T21:21:19.127247] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-25T21:21:19.127324] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-25T21:21:19.127406] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-25T21:21:19.127617] [INFO ] [MAIN ] Update Progress: 1965/2372 symbols completed. SOJF took 26.1s. Estimated remaining: 54m 7s. Rate: 7.5 symbols/min [2025-09-25T21:21:19.309840] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:19.396759] [DEBUG] [LOCAL ] SONY: Loaded 53357 existing records from primary storage. [2025-09-25T21:21:19.396928] [INFO ] [MAIN ] SONY: Loaded 53357 existing records. [2025-09-25T21:21:19.579884] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:19.580175] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-25T21:21:19.580233] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-25T21:21:19.581020] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-25T21:21:19.581085] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-25T21:21:19.893889] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-25T21:21:19.976926] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:20.431847] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T21:21:20.689858] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-25T21:21:20.920854] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:21:21.488778] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-25T21:21:22.288733] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-25T21:21:22.320631] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T21:21:22.355489] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:21:23.088778] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-25T21:21:23.880835] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T21:21:23.890705] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-25T21:21:23.896168] [INFO ] [REMOTE ] SOL: Full fetch complete (21784 records). [2025-09-25T21:21:23.896304] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-25T21:21:23.906577] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T21:21:24.331040] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-25T21:21:24.331151] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-25T21:21:24.331636] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-25T21:21:24.331757] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-25T21:21:24.334088] [DEBUG] [LOCAL ] SOL: Trimmed 21784 records to 13615 (keeping 200 days of data) [2025-09-25T21:21:24.436784] [DEBUG] [LOCAL ] SOL: Primary data saved (13615 records). [2025-09-25T21:21:24.436968] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-25T21:21:24.437119] [INFO ] [MAIN ] Update Progress: 1966/2372 symbols completed. SOL took 28.1s. Estimated remaining: 53m 58s. Rate: 7.5 symbols/min [2025-09-25T21:21:24.620913] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:24.628368] [DEBUG] [LOCAL ] SOR: Loaded 2920 existing records from primary storage. [2025-09-25T21:21:24.628465] [INFO ] [MAIN ] SOR: Loaded 2920 existing records. [2025-09-25T21:21:24.692742] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-25T21:21:24.817068] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:24.817504] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-25T21:21:24.817571] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-25T21:21:24.817885] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-25T21:21:24.817956] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-25T21:21:25.234383] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:25.488721] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-25T21:21:25.616515] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:21:26.288765] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-25T21:21:26.451057] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T21:21:27.082673] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T21:21:27.092558] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-25T21:21:27.888779] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-25T21:21:27.942758] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T21:21:28.688754] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-25T21:21:29.174130] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-25T21:21:29.488956] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-25T21:21:29.492819] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T21:21:29.504461] [INFO ] [REMOTE ] SOLV: Full fetch complete (63197 records). [2025-09-25T21:21:29.504707] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-25T21:21:29.975340] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-25T21:21:29.975444] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-25T21:21:29.976526] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-25T21:21:29.976639] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-25T21:21:29.981967] [DEBUG] [LOCAL ] SOLV: Trimmed 63197 records to 44431 (keeping 200 days of data) [2025-09-25T21:21:30.289978] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-25T21:21:30.296194] [DEBUG] [LOCAL ] SOLV: Primary data saved (44431 records). [2025-09-25T21:21:30.296308] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-25T21:21:30.296561] [INFO ] [MAIN ] Update Progress: 1967/2372 symbols completed. SOLV took 32.6s. Estimated remaining: 53m 50s. Rate: 7.5 symbols/min [2025-09-25T21:21:30.500666] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T21:21:30.535394] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:30.552336] [DEBUG] [LOCAL ] SOS: Loaded 8068 existing records from primary storage. [2025-09-25T21:21:30.552477] [INFO ] [MAIN ] SOS: Loaded 8068 existing records. [2025-09-25T21:21:30.743205] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:30.743721] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-25T21:21:30.743789] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-25T21:21:30.744072] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-25T21:21:30.744141] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-25T21:21:30.851290] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-25T21:21:31.137841] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:31.094812] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-25T21:21:31.452253] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T21:21:31.755101] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T21:21:31.888753] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-25T21:21:32.369072] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T21:21:32.688793] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-25T21:21:33.193312] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-25T21:21:33.488727] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-25T21:21:34.288747] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-25T21:21:34.865153] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T21:21:35.088746] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-25T21:21:35.139145] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T21:21:35.655815] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-25T21:21:35.888725] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-25T21:21:36.550017] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-25T21:21:36.688741] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-25T21:21:37.488754] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-25T21:21:37.833729] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T21:21:38.288747] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-25T21:21:39.088764] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-25T21:21:39.107254] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T21:21:39.142701] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T21:21:39.888717] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-25T21:21:40.688695] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-25T21:21:41.126890] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-25T21:21:41.200874] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T21:21:41.216165] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:21:41.225021] [INFO ] [REMOTE ] SON: Full fetch complete (62159 records). [2025-09-25T21:21:41.225208] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-25T21:21:41.490586] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-25T21:21:41.710290] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-25T21:21:41.710394] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-25T21:21:41.711471] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-25T21:21:41.711563] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-25T21:21:41.714232] [DEBUG] [LOCAL ] SON: Trimmed 62159 records to 43244 (keeping 200 days of data) [2025-09-25T21:21:42.034154] [DEBUG] [LOCAL ] SON: Primary data saved (43244 records). [2025-09-25T21:21:42.034311] [INFO ] [MAIN ] SON: Full history saved. [2025-09-25T21:21:42.034443] [INFO ] [MAIN ] Update Progress: 1968/2372 symbols completed. SON took 37.0s. Estimated remaining: 53m 43s. Rate: 7.5 symbols/min [2025-09-25T21:21:42.207622] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:42.264755] [DEBUG] [LOCAL ] SPB: Loaded 34229 existing records from primary storage. [2025-09-25T21:21:42.264978] [INFO ] [MAIN ] SPB: Loaded 34229 existing records. [2025-09-25T21:21:42.289089] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-25T21:21:42.460604] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:42.460937] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-25T21:21:42.460990] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-25T21:21:42.461516] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-25T21:21:42.461581] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-25T21:21:42.858471] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:42.881157] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T21:21:43.088696] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-25T21:21:43.554019] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T21:21:43.888798] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-25T21:21:44.363693] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-25T21:21:44.443130] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-25T21:21:44.688744] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-25T21:21:45.167307] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T21:21:45.488864] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-25T21:21:46.288877] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-25T21:21:46.774705] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T21:21:46.787717] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-25T21:21:47.088733] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-25T21:21:47.718247] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:21:47.888782] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-25T21:21:48.375013] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-25T21:21:48.688759] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-25T21:21:49.488717] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-25T21:21:49.843398] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T21:21:50.288786] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-25T21:21:50.812990] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T21:21:50.961873] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T21:21:51.088725] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-25T21:21:51.888860] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-25T21:21:52.443084] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T21:21:52.688743] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-25T21:21:53.181007] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T21:21:53.182774] [INFO ] [REMOTE ] SOR: Full fetch complete (4355 records). [2025-09-25T21:21:53.182896] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-25T21:21:53.499260] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-25T21:21:53.635465] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-25T21:21:53.635632] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-25T21:21:53.636010] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-25T21:21:53.636137] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-25T21:21:53.636716] [DEBUG] [LOCAL ] SOR: Trimmed 4355 records to 2934 (keeping 200 days of data) [2025-09-25T21:21:53.660187] [DEBUG] [LOCAL ] SOR: Primary data saved (2934 records). [2025-09-25T21:21:53.660492] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-25T21:21:53.660709] [INFO ] [MAIN ] Update Progress: 1969/2372 symbols completed. SOR took 29.2s. Estimated remaining: 53m 36s. Rate: 7.5 symbols/min [2025-09-25T21:21:53.842994] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T21:21:53.936605] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:53.936830] [DEBUG] [LOCAL ] SPCE: No existing data file found in primary storage. [2025-09-25T21:21:53.936881] [WARN ] [MAIN ] SPCE: No existing data found, performing full refresh instead. [2025-09-25T21:21:53.937361] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-25T21:21:53.937417] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-25T21:21:53.937486] [DEBUG] [LOCAL ] SPCE: No primary data file found to delete. [2025-09-25T21:21:53.937533] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-25T21:21:54.290025] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-25T21:21:54.315310] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:54.934594] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T21:21:55.088692] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-25T21:21:55.479399] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-25T21:21:55.483238] [INFO ] [REMOTE ] SOS: Full fetch complete (10909 records). [2025-09-25T21:21:55.483331] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-25T21:21:55.880556] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-25T21:21:55.880687] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-25T21:21:55.880972] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-25T21:21:55.881019] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-25T21:21:55.881498] [DEBUG] [LOCAL ] SOS: Trimmed 10909 records to 8154 (keeping 200 days of data) [2025-09-25T21:21:55.888699] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-25T21:21:55.969330] [DEBUG] [LOCAL ] SOS: Primary data saved (8154 records). [2025-09-25T21:21:55.969596] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-25T21:21:55.970015] [INFO ] [MAIN ] Update Progress: 1970/2372 symbols completed. SOS took 25.7s. Estimated remaining: 53m 26s. Rate: 7.5 symbols/min [2025-09-25T21:21:56.163998] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:21:56.195261] [DEBUG] [LOCAL ] SPE: Loaded 6374 existing records from primary storage. [2025-09-25T21:21:56.195409] [INFO ] [MAIN ] SPE: Loaded 6374 existing records. [2025-09-25T21:21:56.396790] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:21:56.397102] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-25T21:21:56.397151] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-25T21:21:56.397482] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-25T21:21:56.397563] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-25T21:21:56.680722] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T21:21:56.701453] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-25T21:21:56.870309] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:21:57.488774] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-25T21:21:57.708002] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-25T21:21:58.288822] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-25T21:21:58.544972] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T21:21:58.910782] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-25T21:21:59.036767] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-25T21:21:59.088772] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-25T21:21:59.881905] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-25T21:21:59.888674] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-25T21:22:00.688708] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-25T21:22:01.488753] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-25T21:22:01.503890] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T21:22:02.021773] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T21:22:02.288746] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-25T21:22:03.022518] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T21:22:03.088749] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-25T21:22:03.308323] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T21:22:03.888769] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-25T21:22:04.314180] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T21:22:04.688777] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-25T21:22:05.488703] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-25T21:22:05.878176] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-25T21:22:06.147793] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:22:06.237218] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T21:22:06.288696] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-25T21:22:07.088783] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-25T21:22:07.888759] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-25T21:22:08.206724] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T21:22:08.303284] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T21:22:08.311255] [INFO ] [REMOTE ] SPB: Full fetch complete (47514 records). [2025-09-25T21:22:08.311398] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-25T21:22:08.699199] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-25T21:22:08.724389] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-25T21:22:08.724499] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-25T21:22:08.725582] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-25T21:22:08.725670] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-25T21:22:08.727090] [DEBUG] [LOCAL ] SPB: Trimmed 47514 records to 34467 (keeping 200 days of data) [2025-09-25T21:22:08.981443] [DEBUG] [LOCAL ] SPB: Primary data saved (34467 records). [2025-09-25T21:22:08.981611] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-25T21:22:08.981827] [INFO ] [MAIN ] Update Progress: 1971/2372 symbols completed. SPB took 26.9s. Estimated remaining: 53m 19s. Rate: 7.5 symbols/min [2025-09-25T21:22:09.173872] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:09.243225] [DEBUG] [LOCAL ] SPG: Loaded 50420 existing records from primary storage. [2025-09-25T21:22:09.243390] [INFO ] [MAIN ] SPG: Loaded 50420 existing records. [2025-09-25T21:22:09.337700] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T21:22:09.459742] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:09.462892] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-25T21:22:09.462959] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-25T21:22:09.463502] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-25T21:22:09.463564] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-25T21:22:09.496688] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-25T21:22:09.846089] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T21:22:09.866362] [INFO ] [REMOTE ] SONY: Full fetch complete (77220 records). [2025-09-25T21:22:09.866584] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-25T21:22:10.071408] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:10.293861] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-25T21:22:10.389923] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-25T21:22:10.390115] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-25T21:22:10.391501] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-25T21:22:10.391585] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-25T21:22:10.393418] [DEBUG] [LOCAL ] SONY: Trimmed 77220 records to 53747 (keeping 200 days of data) [2025-09-25T21:22:10.764940] [DEBUG] [LOCAL ] SONY: Primary data saved (53747 records). [2025-09-25T21:22:10.765117] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-25T21:22:10.765252] [INFO ] [MAIN ] Update Progress: 1972/2372 symbols completed. SONY took 51.6s. Estimated remaining: 53m 10s. Rate: 7.5 symbols/min [2025-09-25T21:22:10.951270] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:11.008576] [DEBUG] [LOCAL ] SPGI: Loaded 45813 existing records from primary storage. [2025-09-25T21:22:11.008756] [INFO ] [MAIN ] SPGI: Loaded 45813 existing records. [2025-09-25T21:22:11.102742] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-25T21:22:11.209706] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:11.210039] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-25T21:22:11.210086] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-25T21:22:11.210540] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-25T21:22:11.210599] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-25T21:22:11.608363] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:11.641210] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T21:22:11.651062] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-25T21:22:11.888742] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-25T21:22:12.200053] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-25T21:22:12.688775] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-25T21:22:13.331943] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T21:22:13.488700] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-25T21:22:13.611990] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T21:22:14.132513] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T21:22:14.288736] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-25T21:22:15.088739] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-25T21:22:15.888724] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-25T21:22:16.100992] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-25T21:22:16.643843] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:22:16.647200] [INFO ] [REMOTE ] SPE: Full fetch complete (10150 records). [2025-09-25T21:22:16.647281] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-25T21:22:16.693883] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-25T21:22:16.863967] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T21:22:17.118494] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-25T21:22:17.118622] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-25T21:22:17.119105] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-25T21:22:17.119159] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-25T21:22:17.119812] [DEBUG] [LOCAL ] SPE: Trimmed 10150 records to 6414 (keeping 200 days of data) [2025-09-25T21:22:17.170913] [DEBUG] [LOCAL ] SPE: Primary data saved (6414 records). [2025-09-25T21:22:17.171131] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-25T21:22:17.171295] [INFO ] [MAIN ] Update Progress: 1973/2372 symbols completed. SPE took 21.2s. Estimated remaining: 53m 2s. Rate: 7.5 symbols/min [2025-09-25T21:22:17.363243] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:17.394437] [DEBUG] [LOCAL ] SPH: Loaded 18057 existing records from primary storage. [2025-09-25T21:22:17.394619] [INFO ] [MAIN ] SPH: Loaded 18057 existing records. [2025-09-25T21:22:17.493865] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-25T21:22:17.598895] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:17.599268] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-25T21:22:17.599324] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-25T21:22:17.599724] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-25T21:22:17.599788] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-25T21:22:17.975038] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:18.288714] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-25T21:22:18.496093] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:22:18.979749] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T21:22:19.088730] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-25T21:22:19.245792] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T21:22:19.888744] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-25T21:22:20.242395] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-25T21:22:20.688736] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-25T21:22:21.488802] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-25T21:22:21.588659] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T21:22:21.897501] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-25T21:22:22.288903] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-25T21:22:23.088836] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-25T21:22:23.553328] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T21:22:23.713482] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T21:22:23.888728] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-25T21:22:24.254057] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T21:22:24.688812] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-25T21:22:25.488745] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-25T21:22:25.612480] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-25T21:22:25.815252] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:22:26.288797] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-25T21:22:27.088782] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-25T21:22:27.368982] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T21:22:27.553133] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-25T21:22:27.888762] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-25T21:22:28.688701] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-25T21:22:28.769275] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:22:28.953235] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T21:22:29.488731] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-25T21:22:30.288769] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-25T21:22:30.887996] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-25T21:22:30.965972] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-25T21:22:31.088741] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-25T21:22:31.643011] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-25T21:22:31.888834] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-25T21:22:32.688726] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-25T21:22:32.954687] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T21:22:33.176228] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T21:22:33.488802] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-25T21:22:34.288756] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-25T21:22:34.632605] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T21:22:35.004906] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:22:35.088678] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-25T21:22:35.888719] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-25T21:22:35.966768] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T21:22:35.977122] [INFO ] [REMOTE ] SPCE: Full fetch complete (72294 records). [2025-09-25T21:22:35.977333] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-25T21:22:36.418461] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-25T21:22:36.418597] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-25T21:22:36.419942] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-25T21:22:36.420065] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-25T21:22:36.421820] [DEBUG] [LOCAL ] SPCE: Trimmed 72294 records to 50249 (keeping 200 days of data) [2025-09-25T21:22:36.688808] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-25T21:22:36.795056] [DEBUG] [LOCAL ] SPCE: Primary data saved (50249 records). [2025-09-25T21:22:36.795220] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-25T21:22:36.795501] [INFO ] [MAIN ] Update Progress: 1974/2372 symbols completed. SPCE took 43.1s. Estimated remaining: 52m 56s. Rate: 7.5 symbols/min [2025-09-25T21:22:36.931281] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T21:22:37.031944] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T21:22:37.043682] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:37.092363] [DEBUG] [LOCAL ] SPHR: Loaded 40141 existing records from primary storage. [2025-09-25T21:22:37.092526] [INFO ] [MAIN ] SPHR: Loaded 40141 existing records. [2025-09-25T21:22:37.279040] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:37.279631] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-25T21:22:37.279738] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-25T21:22:37.280559] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-25T21:22:37.280676] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-25T21:22:37.488786] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-25T21:22:37.679333] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:38.288703] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-25T21:22:38.351325] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T21:22:38.373975] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T21:22:38.377259] [INFO ] [REMOTE ] SPH: Full fetch complete (28505 records). [2025-09-25T21:22:38.377339] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-25T21:22:38.782192] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-25T21:22:38.782333] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-25T21:22:38.783579] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-25T21:22:38.783678] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-25T21:22:38.784609] [DEBUG] [LOCAL ] SPH: Trimmed 28505 records to 18140 (keeping 200 days of data) [2025-09-25T21:22:38.929982] [DEBUG] [LOCAL ] SPH: Primary data saved (18140 records). [2025-09-25T21:22:38.930173] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-25T21:22:38.930329] [INFO ] [MAIN ] Update Progress: 1975/2372 symbols completed. SPH took 21.8s. Estimated remaining: 52m 47s. Rate: 7.5 symbols/min [2025-09-25T21:22:39.088771] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-25T21:22:39.111873] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:39.161087] [DEBUG] [LOCAL ] SPIR: Loaded 37442 existing records from primary storage. [2025-09-25T21:22:39.161309] [INFO ] [MAIN ] SPIR: Loaded 37442 existing records. [2025-09-25T21:22:39.349070] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:39.349341] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-25T21:22:39.349390] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-25T21:22:39.350486] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-25T21:22:39.350555] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-25T21:22:39.735966] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:39.888734] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-25T21:22:40.073434] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:22:40.688696] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-25T21:22:41.048631] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T21:22:41.466914] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T21:22:41.488682] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-25T21:22:42.250999] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T21:22:42.261797] [INFO ] [REMOTE ] SPGI: Full fetch complete (66586 records). [2025-09-25T21:22:42.261968] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-25T21:22:42.289484] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-25T21:22:42.706684] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-25T21:22:42.706895] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-25T21:22:42.708518] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-25T21:22:42.708595] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-25T21:22:42.710616] [DEBUG] [LOCAL ] SPGI: Trimmed 66586 records to 46194 (keeping 200 days of data) [2025-09-25T21:22:43.000920] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T21:22:43.088720] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-25T21:22:43.093048] [DEBUG] [LOCAL ] SPGI: Primary data saved (46194 records). [2025-09-25T21:22:43.093146] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-25T21:22:43.093327] [INFO ] [MAIN ] Update Progress: 1976/2372 symbols completed. SPGI took 32.3s. Estimated remaining: 52m 38s. Rate: 7.5 symbols/min [2025-09-25T21:22:43.285399] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:43.297085] [DEBUG] [LOCAL ] SPMC: Loaded 5572 existing records from primary storage. [2025-09-25T21:22:43.297239] [INFO ] [MAIN ] SPMC: Loaded 5572 existing records. [2025-09-25T21:22:43.488784] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:22:43.489058] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-25T21:22:43.489107] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-25T21:22:43.489446] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-25T21:22:43.489508] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-25T21:22:43.897745] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-25T21:22:43.905293] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:44.293174] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-25T21:22:44.533299] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T21:22:44.688735] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-25T21:22:45.103599] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T21:22:45.488749] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-25T21:22:46.296090] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T21:22:46.306241] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-25T21:22:46.872683] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T21:22:47.088729] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-25T21:22:47.888717] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-25T21:22:47.932236] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T21:22:48.688718] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-25T21:22:48.733265] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:22:49.290461] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T21:22:49.488719] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-25T21:22:49.580828] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:22:49.595471] [INFO ] [REMOTE ] SPG: Full fetch complete (72055 records). [2025-09-25T21:22:49.595713] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-25T21:22:49.896013] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-25T21:22:50.118832] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-25T21:22:50.118924] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-25T21:22:50.120148] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-25T21:22:50.120220] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-25T21:22:50.121878] [DEBUG] [LOCAL ] SPG: Trimmed 72055 records to 50772 (keeping 200 days of data) [2025-09-25T21:22:50.336119] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-25T21:22:50.522446] [DEBUG] [LOCAL ] SPG: Primary data saved (50772 records). [2025-09-25T21:22:50.522606] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-25T21:22:50.524282] [INFO ] [MAIN ] Update Progress: 1977/2372 symbols completed. SPG took 41.5s. Estimated remaining: 52m 30s. Rate: 7.5 symbols/min [2025-09-25T21:22:50.733113] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:22:50.733348] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-25T21:22:50.733405] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-25T21:22:50.734410] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-25T21:22:50.734485] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-25T21:22:50.734548] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-25T21:22:50.734591] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-25T21:22:51.097879] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-25T21:22:51.275508] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:22:51.888726] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-25T21:22:52.688740] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-25T21:23:04.391530] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:04.392762] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-25T21:23:04.395764] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-25T21:23:05.443740] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (15.11 seconds). [2025-09-25T21:23:05.453320] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-25T21:23:05.497458] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:05.497889] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-25T21:23:05.498398] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-25T21:23:05.510233] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (14.41 seconds). [2025-09-25T21:23:05.513821] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-25T21:23:05.609078] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (12.92 seconds). [2025-09-25T21:23:05.624086] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-25T21:23:05.732328] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:05.732755] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-25T21:23:05.733311] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-25T21:23:05.945812] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:05.946163] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-25T21:23:05.946768] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-25T21:23:06.039513] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-25T21:23:06.042668] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-25T21:23:06.168047] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:06.168937] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-25T21:23:06.169518] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-25T21:23:06.385225] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:06.385747] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-25T21:23:06.386224] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-25T21:23:06.605179] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:23:06.605529] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-25T21:23:06.606032] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-25T21:23:06.714042] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-25T21:23:06.722329] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-25T21:23:06.833617] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T21:23:06.838468] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-25T21:23:06.835937] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T21:23:06.850793] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-25T21:23:06.929855] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-25T21:23:06.931146] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-25T21:23:07.234247] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-25T21:23:07.236312] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-25T21:23:07.395579] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T21:23:07.396800] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-25T21:23:07.661186] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-25T21:23:07.663546] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-25T21:23:07.736673] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-25T21:23:07.737477] [INFO ] [REMOTE ] SPME: Full fetch complete (664 records). [2025-09-25T21:23:07.737595] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-25T21:23:07.949255] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 49 unique days, need 200 days [2025-09-25T21:23:07.951819] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:23:07.951911] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:23:07.952024] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-25T21:23:07.952130] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-25T21:23:07.952203] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-25T21:23:07.952296] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-25T21:23:07.952437] [INFO ] [MAIN ] Update Progress: 1978/2372 symbols completed. SPME took 17.4s. Estimated remaining: 52m 24s. Rate: 7.5 symbols/min [2025-09-25T21:23:08.047308] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T21:23:08.056680] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-25T21:23:08.211737] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:08.295723] [DEBUG] [LOCAL ] SPNT: Loaded 34851 existing records from primary storage. [2025-09-25T21:23:08.295952] [INFO ] [MAIN ] SPNT: Loaded 34851 existing records. [2025-09-25T21:23:08.391095] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T21:23:08.493370] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T21:23:08.574826] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:08.575252] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-25T21:23:08.575312] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-25T21:23:08.575811] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-25T21:23:08.575873] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-25T21:23:08.694736] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-25T21:23:08.979004] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:09.373177] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-25T21:23:09.488736] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-25T21:23:09.663260] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T21:23:10.079428] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T21:23:10.080951] [INFO ] [REMOTE ] SPMC: Full fetch complete (8162 records). [2025-09-25T21:23:10.081047] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-25T21:23:10.295223] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-25T21:23:10.542121] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-25T21:23:10.542222] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-25T21:23:10.542454] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-25T21:23:10.542514] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-25T21:23:10.543190] [DEBUG] [LOCAL ] SPMC: Trimmed 8162 records to 5577 (keeping 200 days of data) [2025-09-25T21:23:10.584514] [DEBUG] [LOCAL ] SPMC: Primary data saved (5577 records). [2025-09-25T21:23:10.584722] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-25T21:23:10.584859] [INFO ] [MAIN ] Update Progress: 1979/2372 symbols completed. SPMC took 27.5s. Estimated remaining: 52m 15s. Rate: 7.5 symbols/min [2025-09-25T21:23:10.773168] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:10.857190] [DEBUG] [LOCAL ] SPOT: Loaded 50841 existing records from primary storage. [2025-09-25T21:23:10.857355] [INFO ] [MAIN ] SPOT: Loaded 50841 existing records. [2025-09-25T21:23:11.045679] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:11.046068] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-25T21:23:11.046119] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-25T21:23:11.046574] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-25T21:23:11.046637] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-25T21:23:11.093860] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-25T21:23:11.440128] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:11.830540] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T21:23:11.888716] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-25T21:23:12.541944] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:23:12.688776] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-25T21:23:13.488763] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-25T21:23:13.979875] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T21:23:14.025978] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-25T21:23:14.288728] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-25T21:23:15.088790] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-25T21:23:15.119824] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-25T21:23:15.133265] [INFO ] [REMOTE ] SPHR: Full fetch complete (57532 records). [2025-09-25T21:23:15.133576] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-25T21:23:15.568810] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-25T21:23:15.568929] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-25T21:23:15.570239] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-25T21:23:15.570307] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-25T21:23:15.571944] [DEBUG] [LOCAL ] SPHR: Trimmed 57532 records to 40404 (keeping 200 days of data) [2025-09-25T21:23:15.841719] [DEBUG] [LOCAL ] SPHR: Primary data saved (40404 records). [2025-09-25T21:23:15.841859] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-25T21:23:15.841986] [INFO ] [MAIN ] Update Progress: 1980/2372 symbols completed. SPHR took 39.0s. Estimated remaining: 52m 7s. Rate: 7.5 symbols/min [2025-09-25T21:23:15.890784] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-25T21:23:16.056787] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:16.109046] [DEBUG] [LOCAL ] SPR: Loaded 41233 existing records from primary storage. [2025-09-25T21:23:16.109245] [INFO ] [MAIN ] SPR: Loaded 41233 existing records. [2025-09-25T21:23:16.324677] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:16.325211] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-25T21:23:16.325283] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-25T21:23:16.325628] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-25T21:23:16.325739] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-25T21:23:16.639724] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T21:23:16.666000] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-25T21:23:16.696787] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-25T21:23:16.801520] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:17.488772] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-25T21:23:17.641636] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T21:23:18.097628] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T21:23:18.288729] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-25T21:23:19.088738] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-25T21:23:19.651257] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T21:23:19.771666] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-25T21:23:19.888734] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-25T21:23:20.272299] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T21:23:20.688743] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-25T21:23:21.488795] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-25T21:23:21.878978] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T21:23:22.225291] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:23:22.233906] [INFO ] [REMOTE ] SPIR: Full fetch complete (52367 records). [2025-09-25T21:23:22.234031] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-25T21:23:22.295010] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-25T21:23:22.700486] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-25T21:23:22.700593] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-25T21:23:22.701588] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-25T21:23:22.701679] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-25T21:23:22.704227] [DEBUG] [LOCAL ] SPIR: Trimmed 52367 records to 37679 (keeping 200 days of data) [2025-09-25T21:23:22.959523] [DEBUG] [LOCAL ] SPIR: Primary data saved (37679 records). [2025-09-25T21:23:22.959830] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-25T21:23:22.960021] [INFO ] [MAIN ] Update Progress: 1981/2372 symbols completed. SPIR took 44.0s. Estimated remaining: 51m 59s. Rate: 7.5 symbols/min [2025-09-25T21:23:23.097751] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-25T21:23:23.167067] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T21:23:23.197794] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:23.216804] [DEBUG] [LOCAL ] SPRU: Loaded 8468 existing records from primary storage. [2025-09-25T21:23:23.216961] [INFO ] [MAIN ] SPRU: Loaded 8468 existing records. [2025-09-25T21:23:23.411877] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:23.412197] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-25T21:23:23.412262] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-25T21:23:23.412602] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-25T21:23:23.412700] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-25T21:23:23.844775] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:23.865050] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T21:23:23.888678] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-25T21:23:24.688732] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-25T21:23:25.436578] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T21:23:25.488766] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-25T21:23:25.613216] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-25T21:23:26.118212] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T21:23:26.288735] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-25T21:23:26.801993] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:23:27.088724] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-25T21:23:27.232073] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-25T21:23:27.888726] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-25T21:23:28.533977] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-25T21:23:28.615927] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T21:23:28.688692] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-25T21:23:29.303256] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T21:23:29.488737] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-25T21:23:30.288734] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-25T21:23:30.947278] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T21:23:31.088679] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-25T21:23:31.835848] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T21:23:31.872862] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-25T21:23:31.888677] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-25T21:23:32.688716] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-25T21:23:33.488698] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-25T21:23:33.967296] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-25T21:23:34.271842] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T21:23:34.288677] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-25T21:23:34.510432] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T21:23:35.072124] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T21:23:35.088679] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-25T21:23:35.888724] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-25T21:23:36.688718] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-25T21:23:36.754877] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:23:37.488741] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-25T21:23:38.116842] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-25T21:23:38.127139] [INFO ] [REMOTE ] SPNT: Full fetch complete (48880 records). [2025-09-25T21:23:38.127272] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-25T21:23:38.302935] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-25T21:23:38.607277] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-25T21:23:38.607479] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-25T21:23:38.608514] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-25T21:23:38.608842] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-25T21:23:38.644995] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-25T21:23:38.657246] [DEBUG] [LOCAL ] SPNT: Trimmed 48880 records to 35119 (keeping 200 days of data) [2025-09-25T21:23:38.831366] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-25T21:23:38.966369] [DEBUG] [LOCAL ] SPNT: Primary data saved (35119 records). [2025-09-25T21:23:38.966550] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-25T21:23:38.966686] [INFO ] [MAIN ] Update Progress: 1982/2372 symbols completed. SPNT took 31.0s. Estimated remaining: 51m 52s. Rate: 7.5 symbols/min [2025-09-25T21:23:39.053772] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-25T21:23:39.094747] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-25T21:23:39.160959] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:39.188690] [DEBUG] [LOCAL ] SPXC: Loaded 23370 existing records from primary storage. [2025-09-25T21:23:39.188843] [INFO ] [MAIN ] SPXC: Loaded 23370 existing records. [2025-09-25T21:23:39.372536] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:39.372951] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-25T21:23:39.373005] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-25T21:23:39.373506] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-25T21:23:39.373566] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-25T21:23:39.746322] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:39.888733] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-25T21:23:40.688739] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-25T21:23:41.262890] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-25T21:23:41.371130] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:23:41.387154] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-25T21:23:41.488721] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-25T21:23:42.288713] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-25T21:23:42.670471] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T21:23:43.088730] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-25T21:23:43.592278] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T21:23:43.888754] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-25T21:23:44.688748] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-25T21:23:45.098875] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T21:23:45.122346] [INFO ] [REMOTE ] SPOT: Full fetch complete (73959 records). [2025-09-25T21:23:45.123184] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-25T21:23:45.123744] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:23:45.494733] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-25T21:23:45.548672] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-25T21:23:45.548801] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-25T21:23:45.550160] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-25T21:23:45.550282] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-25T21:23:45.552037] [DEBUG] [LOCAL ] SPOT: Trimmed 73959 records to 51178 (keeping 200 days of data) [2025-09-25T21:23:45.913066] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T21:23:45.937080] [DEBUG] [LOCAL ] SPOT: Primary data saved (51178 records). [2025-09-25T21:23:45.937230] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-25T21:23:45.937357] [INFO ] [MAIN ] Update Progress: 1983/2372 symbols completed. SPOT took 35.4s. Estimated remaining: 51m 44s. Rate: 7.5 symbols/min [2025-09-25T21:23:46.110592] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:46.131528] [DEBUG] [LOCAL ] SPXX: Loaded 8956 existing records from primary storage. [2025-09-25T21:23:46.131741] [INFO ] [MAIN ] SPXX: Loaded 8956 existing records. [2025-09-25T21:23:46.288735] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-25T21:23:46.315617] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:46.315897] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-25T21:23:46.315947] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-25T21:23:46.316197] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-25T21:23:46.316259] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-25T21:23:46.715586] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:46.732631] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:23:47.088721] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-25T21:23:47.174522] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T21:23:47.177429] [INFO ] [REMOTE ] SPRU: Full fetch complete (11242 records). [2025-09-25T21:23:47.177518] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-25T21:23:47.597935] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-25T21:23:47.598026] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-25T21:23:47.598329] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-25T21:23:47.598371] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-25T21:23:47.598937] [DEBUG] [LOCAL ] SPRU: Trimmed 11242 records to 8554 (keeping 200 days of data) [2025-09-25T21:23:47.658131] [DEBUG] [LOCAL ] SPRU: Primary data saved (8554 records). [2025-09-25T21:23:47.658287] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-25T21:23:47.658383] [INFO ] [MAIN ] Update Progress: 1984/2372 symbols completed. SPRU took 24.7s. Estimated remaining: 51m 35s. Rate: 7.5 symbols/min [2025-09-25T21:23:47.845880] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:47.888742] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-25T21:23:47.911860] [DEBUG] [LOCAL ] SQM: Loaded 48535 existing records from primary storage. [2025-09-25T21:23:47.912025] [INFO ] [MAIN ] SQM: Loaded 48535 existing records. [2025-09-25T21:23:48.124802] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:48.126744] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-25T21:23:48.126832] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-25T21:23:48.127293] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-25T21:23:48.127354] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-25T21:23:48.570027] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:48.572724] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T21:23:48.688765] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-25T21:23:49.119591] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T21:23:49.413298] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-25T21:23:49.488745] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-25T21:23:50.288786] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-25T21:23:50.992325] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:23:51.008244] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T21:23:51.013743] [INFO ] [REMOTE ] SPR: Full fetch complete (60038 records). [2025-09-25T21:23:51.013985] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-25T21:23:51.093332] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-25T21:23:51.463358] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-25T21:23:51.463474] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-25T21:23:51.464583] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-25T21:23:51.464719] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-25T21:23:51.466162] [DEBUG] [LOCAL ] SPR: Trimmed 60038 records to 41539 (keeping 200 days of data) [2025-09-25T21:23:51.750505] [DEBUG] [LOCAL ] SPR: Primary data saved (41539 records). [2025-09-25T21:23:51.750676] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-25T21:23:51.750913] [INFO ] [MAIN ] Update Progress: 1985/2372 symbols completed. SPR took 35.9s. Estimated remaining: 51m 26s. Rate: 7.5 symbols/min [2025-09-25T21:23:51.893885] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-25T21:23:51.951918] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:23:51.992255] [DEBUG] [LOCAL ] SQNS: Loaded 26021 existing records from primary storage. [2025-09-25T21:23:51.992457] [INFO ] [MAIN ] SQNS: Loaded 26021 existing records. [2025-09-25T21:23:52.184490] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:23:52.184933] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-25T21:23:52.184982] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-25T21:23:52.185488] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-25T21:23:52.185568] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-25T21:23:52.593327] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:23:52.688725] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-25T21:23:52.717530] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-25T21:23:52.839167] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T21:23:53.488782] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-25T21:23:53.700958] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T21:23:54.288730] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-25T21:23:54.354159] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T21:23:55.088866] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-25T21:23:55.624876] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T21:23:55.888767] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-25T21:23:55.910147] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T21:23:56.688766] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-25T21:23:56.980316] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T21:23:57.466580] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T21:23:57.488682] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-25T21:23:58.288761] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-25T21:23:58.317781] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-25T21:23:59.088817] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-25T21:23:59.888775] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-25T21:23:59.955098] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:24:00.189011] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-25T21:24:00.688714] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-25T21:24:00.751189] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T21:24:01.490025] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-25T21:24:02.277441] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T21:24:02.288842] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-25T21:24:02.444215] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T21:24:02.792774] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T21:24:03.088765] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-25T21:24:03.888720] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-25T21:24:04.247988] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T21:24:04.688773] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-25T21:24:05.488708] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-25T21:24:05.642746] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T21:24:05.699031] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-25T21:24:06.252270] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T21:24:06.288731] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-25T21:24:07.088734] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-25T21:24:07.669372] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T21:24:07.888726] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-25T21:24:08.622547] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T21:24:08.688736] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-25T21:24:08.836600] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T21:24:09.488727] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-25T21:24:09.535885] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:24:09.540521] [INFO ] [REMOTE ] SPXC: Full fetch complete (34017 records). [2025-09-25T21:24:09.540686] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-25T21:24:09.953478] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-25T21:24:09.953587] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-25T21:24:09.954421] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-25T21:24:09.954487] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-25T21:24:09.955951] [DEBUG] [LOCAL ] SPXC: Trimmed 34017 records to 23521 (keeping 200 days of data) [2025-09-25T21:24:10.124209] [DEBUG] [LOCAL ] SPXC: Primary data saved (23521 records). [2025-09-25T21:24:10.124381] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-25T21:24:10.124579] [INFO ] [MAIN ] Update Progress: 1986/2372 symbols completed. SPXC took 31.2s. Estimated remaining: 51m 20s. Rate: 7.5 symbols/min [2025-09-25T21:24:10.289505] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-25T21:24:10.322280] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:10.385398] [DEBUG] [LOCAL ] SR: Loaded 32905 existing records from primary storage. [2025-09-25T21:24:10.385554] [INFO ] [MAIN ] SR: Loaded 32905 existing records. [2025-09-25T21:24:10.569837] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:10.570179] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-25T21:24:10.570248] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-25T21:24:10.570560] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-25T21:24:10.570638] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-25T21:24:11.037922] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:11.092442] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-25T21:24:11.094528] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:24:11.097435] [INFO ] [REMOTE ] SPXX: Full fetch complete (12467 records). [2025-09-25T21:24:11.097540] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-25T21:24:11.274200] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:24:11.548091] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-25T21:24:11.548177] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-25T21:24:11.548465] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-25T21:24:11.548505] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-25T21:24:11.549017] [DEBUG] [LOCAL ] SPXX: Trimmed 12467 records to 9037 (keeping 200 days of data) [2025-09-25T21:24:11.614327] [DEBUG] [LOCAL ] SPXX: Primary data saved (9037 records). [2025-09-25T21:24:11.614482] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-25T21:24:11.614627] [INFO ] [MAIN ] Update Progress: 1987/2372 symbols completed. SPXX took 25.7s. Estimated remaining: 51m 11s. Rate: 7.5 symbols/min [2025-09-25T21:24:11.819611] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:11.879565] [DEBUG] [LOCAL ] SRE: Loaded 53426 existing records from primary storage. [2025-09-25T21:24:11.879751] [INFO ] [MAIN ] SRE: Loaded 53426 existing records. [2025-09-25T21:24:11.893865] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-25T21:24:12.080360] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:12.081268] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-25T21:24:12.081317] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-25T21:24:12.081612] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-25T21:24:12.081703] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-25T21:24:12.485057] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:12.508460] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T21:24:12.688715] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-25T21:24:13.467922] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-25T21:24:13.488674] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-25T21:24:13.603721] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:24:14.288732] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-25T21:24:14.552256] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T21:24:15.088715] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-25T21:24:15.888743] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-25T21:24:16.158403] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:24:16.616113] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T21:24:16.688727] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-25T21:24:17.488699] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-25T21:24:17.822386] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-25T21:24:17.863045] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T21:24:18.288756] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-25T21:24:19.088720] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-25T21:24:19.244527] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:24:19.677156] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T21:24:19.888731] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-25T21:24:20.688735] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-25T21:24:21.333456] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-25T21:24:21.379424] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-25T21:24:21.488724] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-25T21:24:22.210318] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T21:24:22.288708] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-25T21:24:22.848019] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T21:24:23.088741] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-25T21:24:23.888691] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-25T21:24:24.066710] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T21:24:24.688687] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-25T21:24:24.836159] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:24:24.845345] [INFO ] [REMOTE ] SQM: Full fetch complete (68859 records). [2025-09-25T21:24:24.845511] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-25T21:24:25.279893] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-25T21:24:25.350880] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-25T21:24:25.351002] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-25T21:24:25.352208] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-25T21:24:25.352297] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-25T21:24:25.356272] [DEBUG] [LOCAL ] SQM: Trimmed 68859 records to 48895 (keeping 200 days of data) [2025-09-25T21:24:25.536699] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-25T21:24:25.680793] [DEBUG] [LOCAL ] SQM: Primary data saved (48895 records). [2025-09-25T21:24:25.681023] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-25T21:24:25.681230] [INFO ] [MAIN ] Update Progress: 1988/2372 symbols completed. SQM took 38.0s. Estimated remaining: 51m 4s. Rate: 7.5 symbols/min [2025-09-25T21:24:25.855020] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:25.874745] [DEBUG] [LOCAL ] SREA: Loaded 10415 existing records from primary storage. [2025-09-25T21:24:25.874936] [INFO ] [MAIN ] SREA: Loaded 10415 existing records. [2025-09-25T21:24:26.076724] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:26.077104] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-25T21:24:26.077155] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-25T21:24:26.077366] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-25T21:24:26.077425] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-25T21:24:26.317895] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-25T21:24:26.502879] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:26.561426] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T21:24:27.062433] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T21:24:27.088714] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-25T21:24:27.888760] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-25T21:24:28.040724] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T21:24:28.688719] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-25T21:24:28.923343] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T21:24:29.019900] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:24:29.488730] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-25T21:24:30.288689] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-25T21:24:30.323910] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T21:24:30.424373] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T21:24:30.433095] [INFO ] [REMOTE ] SQNS: Full fetch complete (31871 records). [2025-09-25T21:24:30.433222] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-25T21:24:30.857737] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-25T21:24:30.857830] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-25T21:24:30.858480] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-25T21:24:30.858520] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-25T21:24:30.859667] [DEBUG] [LOCAL ] SQNS: Trimmed 31871 records to 26181 (keeping 200 days of data) [2025-09-25T21:24:31.016373] [DEBUG] [LOCAL ] SQNS: Primary data saved (26181 records). [2025-09-25T21:24:31.016558] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-25T21:24:31.016694] [INFO ] [MAIN ] Update Progress: 1989/2372 symbols completed. SQNS took 39.3s. Estimated remaining: 50m 56s. Rate: 7.5 symbols/min [2025-09-25T21:24:31.093836] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-25T21:24:31.225260] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:31.275358] [DEBUG] [LOCAL ] SRFM: Loaded 35731 existing records from primary storage. [2025-09-25T21:24:31.275549] [INFO ] [MAIN ] SRFM: Loaded 35731 existing records. [2025-09-25T21:24:31.482555] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:31.482871] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-25T21:24:31.482921] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-25T21:24:31.483269] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-25T21:24:31.483332] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-25T21:24:31.721931] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T21:24:31.894118] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-25T21:24:31.946946] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:31.955629] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T21:24:32.688728] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-25T21:24:33.235195] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T21:24:33.245061] [INFO ] [REMOTE ] SR: Full fetch complete (46049 records). [2025-09-25T21:24:33.245264] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-25T21:24:33.494161] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-25T21:24:33.704720] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-25T21:24:33.704831] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-25T21:24:33.705941] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-25T21:24:33.706013] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-25T21:24:33.707492] [DEBUG] [LOCAL ] SR: Trimmed 46049 records to 33151 (keeping 200 days of data) [2025-09-25T21:24:33.932351] [DEBUG] [LOCAL ] SR: Primary data saved (33151 records). [2025-09-25T21:24:33.932511] [INFO ] [MAIN ] SR: Full history saved. [2025-09-25T21:24:33.932608] [INFO ] [MAIN ] Update Progress: 1990/2372 symbols completed. SR took 23.8s. Estimated remaining: 50m 47s. Rate: 7.5 symbols/min [2025-09-25T21:24:34.128255] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:34.150447] [DEBUG] [LOCAL ] SRG: Loaded 15666 existing records from primary storage. [2025-09-25T21:24:34.150597] [INFO ] [MAIN ] SRG: Loaded 15666 existing records. [2025-09-25T21:24:34.294727] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-25T21:24:34.361049] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:34.361389] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-25T21:24:34.361437] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-25T21:24:34.361689] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-25T21:24:34.361749] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-25T21:24:34.485164] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T21:24:34.805534] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:35.088696] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-25T21:24:35.128738] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:24:35.291906] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:24:35.888734] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-25T21:24:36.535306] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:24:36.688711] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-25T21:24:37.133561] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T21:24:37.488721] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-25T21:24:38.288707] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-25T21:24:38.427002] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:24:38.554831] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T21:24:39.088746] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-25T21:24:39.888736] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-25T21:24:39.978717] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T21:24:40.057162] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T21:24:40.688737] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-25T21:24:40.739367] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T21:24:41.488728] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-25T21:24:42.288734] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-25T21:24:42.550985] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T21:24:42.587808] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T21:24:43.088795] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-25T21:24:43.734474] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T21:24:43.888700] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-25T21:24:44.229210] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T21:24:44.688736] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-25T21:24:45.488724] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-25T21:24:45.688706] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:24:45.996260] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-25T21:24:46.021482] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T21:24:46.288737] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-25T21:24:47.068156] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T21:24:47.088685] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-25T21:24:47.888727] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-25T21:24:48.134268] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T21:24:48.136457] [INFO ] [REMOTE ] SREA: Full fetch complete (15926 records). [2025-09-25T21:24:48.136548] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-25T21:24:48.528232] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-25T21:24:48.528320] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-25T21:24:48.528702] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-25T21:24:48.528764] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-25T21:24:48.529302] [DEBUG] [LOCAL ] SREA: Trimmed 15926 records to 10476 (keeping 200 days of data) [2025-09-25T21:24:48.603783] [DEBUG] [LOCAL ] SREA: Primary data saved (10476 records). [2025-09-25T21:24:48.603940] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-25T21:24:48.604034] [INFO ] [MAIN ] Update Progress: 1991/2372 symbols completed. SREA took 22.9s. Estimated remaining: 50m 40s. Rate: 7.5 symbols/min [2025-09-25T21:24:48.697733] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-25T21:24:48.820701] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:48.862068] [DEBUG] [LOCAL ] SRI: Loaded 27500 existing records from primary storage. [2025-09-25T21:24:48.862230] [INFO ] [MAIN ] SRI: Loaded 27500 existing records. [2025-09-25T21:24:49.051196] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:24:49.052616] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-25T21:24:49.052704] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-25T21:24:49.052965] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-25T21:24:49.053024] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-25T21:24:49.438758] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:49.488675] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-25T21:24:49.858044] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T21:24:50.288755] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-25T21:24:50.468990] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T21:24:50.634694] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T21:24:50.650037] [INFO ] [REMOTE ] SRE: Full fetch complete (77291 records). [2025-09-25T21:24:50.650194] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-25T21:24:51.088853] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T21:24:51.094737] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-25T21:24:51.100875] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-25T21:24:51.101054] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-25T21:24:51.103203] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-25T21:24:51.103293] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-25T21:24:51.105991] [DEBUG] [LOCAL ] SRE: Trimmed 77291 records to 53815 (keeping 200 days of data) [2025-09-25T21:24:51.500121] [DEBUG] [LOCAL ] SRE: Primary data saved (53815 records). [2025-09-25T21:24:51.500358] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-25T21:24:51.500496] [INFO ] [MAIN ] Update Progress: 1992/2372 symbols completed. SRE took 39.9s. Estimated remaining: 50m 31s. Rate: 7.5 symbols/min [2025-09-25T21:24:51.683378] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:24:51.683668] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-25T21:24:51.683727] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-25T21:24:51.684012] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-25T21:24:51.684057] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-25T21:24:51.684098] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-25T21:24:51.684132] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-25T21:24:51.893605] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-25T21:24:52.056056] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:24:52.163337] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T21:24:52.688734] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-25T21:24:53.073179] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T21:24:53.284991] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T21:24:53.488858] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-25T21:24:54.288881] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-25T21:24:55.088844] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-25T21:24:55.315391] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T21:24:55.339082] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T21:24:55.581104] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-25T21:24:55.888826] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-25T21:24:56.688887] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-25T21:24:57.488459] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T21:24:57.491462] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-25T21:24:57.880771] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-25T21:24:58.265137] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-25T21:24:58.288680] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-25T21:24:59.088745] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-25T21:24:59.482766] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-25T21:24:59.888785] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-25T21:25:00.591434] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-25T21:25:00.688701] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-25T21:25:00.798439] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T21:25:01.488782] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-25T21:25:02.061300] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:25:02.288734] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-25T21:25:02.690394] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-25T21:25:03.088691] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-25T21:25:03.595559] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-25T21:25:03.608574] [INFO ] [REMOTE ] SRFM: Full fetch complete (49052 records). [2025-09-25T21:25:03.608811] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-25T21:25:03.892605] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-25T21:25:04.084326] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-25T21:25:04.084424] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-25T21:25:04.085529] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-25T21:25:04.085673] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-25T21:25:04.087106] [DEBUG] [LOCAL ] SRFM: Trimmed 49052 records to 36106 (keeping 200 days of data) [2025-09-25T21:25:04.330542] [DEBUG] [LOCAL ] SRFM: Primary data saved (36106 records). [2025-09-25T21:25:04.330737] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-25T21:25:04.330897] [INFO ] [MAIN ] Update Progress: 1993/2372 symbols completed. SRFM took 33.3s. Estimated remaining: 50m 24s. Rate: 7.5 symbols/min [2025-09-25T21:25:04.371444] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T21:25:04.481368] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T21:25:04.571811] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:04.590877] [DEBUG] [LOCAL ] SRV: Loaded 7538 existing records from primary storage. [2025-09-25T21:25:04.591014] [INFO ] [MAIN ] SRV: Loaded 7538 existing records. [2025-09-25T21:25:04.694015] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-25T21:25:04.792360] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:04.792953] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-25T21:25:04.793002] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-25T21:25:04.793330] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-25T21:25:04.793400] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-25T21:25:05.169183] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:05.488741] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-25T21:25:05.926067] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-25T21:25:06.288769] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-25T21:25:06.299753] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T21:25:07.088731] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-25T21:25:07.566603] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T21:25:07.872144] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T21:25:07.888679] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-25T21:25:08.688732] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-25T21:25:08.993388] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T21:25:09.453422] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T21:25:09.488726] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-25T21:25:09.855444] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-25T21:25:10.288746] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-25T21:25:11.088741] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-25T21:25:11.137932] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:25:11.141353] [INFO ] [REMOTE ] SRG: Full fetch complete (25138 records). [2025-09-25T21:25:11.141449] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-25T21:25:11.583079] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-25T21:25:11.583194] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-25T21:25:11.583857] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-25T21:25:11.583926] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-25T21:25:11.584876] [DEBUG] [LOCAL ] SRG: Trimmed 25138 records to 15726 (keeping 200 days of data) [2025-09-25T21:25:11.712182] [DEBUG] [LOCAL ] SRG: Primary data saved (15726 records). [2025-09-25T21:25:11.712443] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-25T21:25:11.712716] [INFO ] [MAIN ] Update Progress: 1994/2372 symbols completed. SRG took 37.8s. Estimated remaining: 50m 16s. Rate: 7.5 symbols/min [2025-09-25T21:25:11.899722] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-25T21:25:11.903127] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:11.970559] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T21:25:11.989752] [DEBUG] [LOCAL ] SSB: Loaded 42863 existing records from primary storage. [2025-09-25T21:25:11.989910] [INFO ] [MAIN ] SSB: Loaded 42863 existing records. [2025-09-25T21:25:12.175486] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:12.175841] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-25T21:25:12.175892] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-25T21:25:12.176386] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-25T21:25:12.176471] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-25T21:25:12.400746] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-25T21:25:12.564158] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:12.688738] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-25T21:25:13.488764] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-25T21:25:14.295545] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-25T21:25:14.319848] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T21:25:14.751554] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T21:25:14.767147] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T21:25:15.088735] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-25T21:25:15.413762] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-25T21:25:15.415379] [INFO ] [REMOTE ] SRL: Full fetch complete (1971 records). [2025-09-25T21:25:15.415501] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-25T21:25:15.683677] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-25T21:25:15.684009] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:25:15.684093] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:25:15.684215] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-25T21:25:15.684407] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-25T21:25:15.684491] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-25T21:25:15.684598] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-25T21:25:15.685022] [INFO ] [MAIN ] Update Progress: 1995/2372 symbols completed. SRL took 24.2s. Estimated remaining: 50m 7s. Rate: 7.5 symbols/min [2025-09-25T21:25:15.884475] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:15.888768] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-25T21:25:15.927684] [DEBUG] [LOCAL ] SSD: Loaded 22290 existing records from primary storage. [2025-09-25T21:25:15.927875] [INFO ] [MAIN ] SSD: Loaded 22290 existing records. [2025-09-25T21:25:16.117254] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:16.117676] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-25T21:25:16.117737] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-25T21:25:16.117945] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-25T21:25:16.118003] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-25T21:25:16.496838] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:16.688770] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-25T21:25:16.720320] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T21:25:17.488850] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-25T21:25:18.288788] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-25T21:25:18.384830] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:25:18.685499] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T21:25:19.092232] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-25T21:25:19.093318] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:25:19.888840] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-25T21:25:20.324034] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:25:20.688813] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-25T21:25:21.364181] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T21:25:21.488771] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-25T21:25:22.198498] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T21:25:22.194997] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T21:25:22.288746] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-25T21:25:23.088835] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-25T21:25:23.880180] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T21:25:23.888701] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-25T21:25:23.930309] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:25:24.416156] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-25T21:25:24.688743] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-25T21:25:25.488756] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-25T21:25:26.145600] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-25T21:25:26.149790] [INFO ] [REMOTE ] SRV: Full fetch complete (11551 records). [2025-09-25T21:25:26.150039] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-25T21:25:26.294917] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-25T21:25:26.481455] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T21:25:26.652490] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-25T21:25:26.652600] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-25T21:25:26.652993] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-25T21:25:26.653059] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-25T21:25:26.653748] [DEBUG] [LOCAL ] SRV: Trimmed 11551 records to 7583 (keeping 200 days of data) [2025-09-25T21:25:26.706819] [DEBUG] [LOCAL ] SRV: Primary data saved (7583 records). [2025-09-25T21:25:26.707000] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-25T21:25:26.707174] [INFO ] [MAIN ] Update Progress: 1996/2372 symbols completed. SRV took 22.4s. Estimated remaining: 49m 60s. Rate: 7.5 symbols/min [2025-09-25T21:25:26.880520] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:26.929335] [DEBUG] [LOCAL ] SSL: Loaded 41232 existing records from primary storage. [2025-09-25T21:25:26.929497] [INFO ] [MAIN ] SSL: Loaded 41232 existing records. [2025-09-25T21:25:27.117397] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:27.118112] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-25T21:25:27.118184] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-25T21:25:27.118606] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-25T21:25:27.118739] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-25T21:25:27.111800] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-25T21:25:27.204897] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T21:25:27.638905] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:27.888731] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-25T21:25:28.404260] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T21:25:28.688722] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-25T21:25:28.988776] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T21:25:28.993366] [INFO ] [REMOTE ] SRI: Full fetch complete (41692 records). [2025-09-25T21:25:28.993523] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-25T21:25:29.417494] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-25T21:25:29.417589] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-25T21:25:29.418488] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-25T21:25:29.418555] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-25T21:25:29.420132] [DEBUG] [LOCAL ] SRI: Trimmed 41692 records to 27654 (keeping 200 days of data) [2025-09-25T21:25:29.514962] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-25T21:25:29.609521] [DEBUG] [LOCAL ] SRI: Primary data saved (27654 records). [2025-09-25T21:25:29.609733] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-25T21:25:29.609873] [INFO ] [MAIN ] Update Progress: 1997/2372 symbols completed. SRI took 41.0s. Estimated remaining: 49m 51s. Rate: 7.5 symbols/min [2025-09-25T21:25:30.288793] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-25T21:25:30.425275] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:25:30.673238] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T21:25:31.088739] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-25T21:25:31.720232] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-25T21:25:31.888730] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-25T21:25:32.436385] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T21:25:32.688736] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-25T21:25:33.452609] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T21:25:33.488686] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-25T21:25:33.991001] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T21:25:34.288725] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-25T21:25:35.088747] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-25T21:25:35.199147] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T21:25:35.759295] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T21:25:35.888680] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-25T21:25:36.254841] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T21:25:36.688730] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-25T21:25:37.488711] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-25T21:25:37.594372] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T21:25:38.251262] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T21:25:38.288707] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-25T21:25:38.601918] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:25:39.088743] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-25T21:25:39.894833] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-25T21:25:39.917011] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T21:25:40.319104] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T21:25:40.329205] [INFO ] [REMOTE ] SSB: Full fetch complete (61058 records). [2025-09-25T21:25:40.329425] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-25T21:25:40.700457] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-25T21:25:40.760901] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-25T21:25:40.761007] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-25T21:25:40.762210] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-25T21:25:40.762277] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-25T21:25:40.765245] [DEBUG] [LOCAL ] SSB: Trimmed 61058 records to 43106 (keeping 200 days of data) [2025-09-25T21:25:41.086475] [DEBUG] [LOCAL ] SSB: Primary data saved (43106 records). [2025-09-25T21:25:41.086660] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-25T21:25:41.086800] [INFO ] [MAIN ] Update Progress: 1998/2372 symbols completed. SSB took 29.4s. Estimated remaining: 49m 43s. Rate: 7.5 symbols/min [2025-09-25T21:25:41.095675] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T21:25:41.488752] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-25T21:25:42.365203] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:25:42.376526] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-25T21:25:42.717869] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T21:25:43.088784] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-25T21:25:43.971259] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-25T21:25:43.980307] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-25T21:25:44.174682] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T21:25:44.179357] [INFO ] [REMOTE ] SSD: Full fetch complete (32354 records). [2025-09-25T21:25:44.179473] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-25T21:25:44.600413] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-25T21:25:44.600584] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-25T21:25:44.601695] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-25T21:25:44.601758] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-25T21:25:44.602776] [DEBUG] [LOCAL ] SSD: Trimmed 32354 records to 22447 (keeping 200 days of data) [2025-09-25T21:25:44.798178] [DEBUG] [LOCAL ] SSD: Primary data saved (22447 records). [2025-09-25T21:25:44.798421] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-25T21:25:44.798563] [INFO ] [MAIN ] Update Progress: 1999/2372 symbols completed. SSD took 29.1s. Estimated remaining: 49m 35s. Rate: 7.5 symbols/min [2025-09-25T21:25:45.677787] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T21:25:45.687941] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-25T21:25:47.484782] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:25:47.497442] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-25T21:25:49.140199] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T21:25:49.162462] [INFO ] [REMOTE ] SSL: Full fetch complete (60321 records). [2025-09-25T21:25:49.162789] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-25T21:25:49.745107] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-25T21:25:49.745257] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-25T21:25:49.746801] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-25T21:25:49.746977] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-25T21:25:49.750978] [DEBUG] [LOCAL ] SSL: Trimmed 60321 records to 41545 (keeping 200 days of data) [2025-09-25T21:25:50.023930] [DEBUG] [LOCAL ] SSL: Primary data saved (41545 records). [2025-09-25T21:25:50.024075] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-25T21:25:50.024268] [INFO ] [MAIN ] Update Progress: 2000/2372 symbols completed. SSL took 23.3s. Estimated remaining: 49m 26s. Rate: 7.5 symbols/min [2025-09-25T21:25:50.620526] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:50.702368] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:50.834467] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:50.860133] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:25:50.917904] [DEBUG] [LOCAL ] SST: Loaded 12121 existing records from primary storage. [2025-09-25T21:25:50.918046] [INFO ] [MAIN ] SST: Loaded 12121 existing records. [2025-09-25T21:25:51.002120] [DEBUG] [LOCAL ] STAG: Loaded 50028 existing records from primary storage. [2025-09-25T21:25:51.002294] [INFO ] [MAIN ] STAG: Loaded 50028 existing records. [2025-09-25T21:25:51.010540] [DEBUG] [LOCAL ] ST: Loaded 49776 existing records from primary storage. [2025-09-25T21:25:51.039756] [INFO ] [MAIN ] ST: Loaded 49776 existing records. [2025-09-25T21:25:51.189852] [DEBUG] [LOCAL ] SSTK: Loaded 26511 existing records from primary storage. [2025-09-25T21:25:51.190017] [INFO ] [MAIN ] SSTK: Loaded 26511 existing records. [2025-09-25T21:25:51.730544] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:51.731018] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-25T21:25:51.731077] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-25T21:25:51.731603] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-25T21:25:51.742708] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-25T21:25:51.848870] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:51.849181] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-25T21:25:51.849236] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-25T21:25:51.849524] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-25T21:25:51.849596] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-25T21:25:51.940233] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:51.940507] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-25T21:25:51.940555] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-25T21:25:51.940943] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-25T21:25:51.941004] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-25T21:25:52.007084] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:25:52.030974] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-25T21:25:52.031026] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-25T21:25:52.031595] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-25T21:25:52.035946] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-25T21:25:53.129541] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:53.147308] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-25T21:25:53.381014] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:53.381373] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-25T21:25:53.462957] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:53.472176] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-25T21:25:53.543986] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:25:53.544408] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-25T21:25:54.443118] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-25T21:25:54.446573] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-25T21:25:54.660041] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T21:25:54.666942] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-25T21:25:55.015626] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:25:55.028813] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-25T21:25:55.124231] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T21:25:55.134636] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-25T21:25:55.590267] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T21:25:55.595558] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-25T21:25:56.455496] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T21:25:56.461290] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-25T21:25:56.464168] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T21:25:56.473336] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-25T21:25:56.768161] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:25:56.779125] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-25T21:25:56.869627] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T21:25:56.882568] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-25T21:25:57.345720] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T21:25:57.348834] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-25T21:25:57.910035] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T21:25:57.921567] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-25T21:25:58.202251] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T21:25:58.288718] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-25T21:25:58.329242] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:25:58.521107] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T21:25:59.088696] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-25T21:25:59.145691] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-25T21:25:59.210121] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T21:25:59.888786] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-25T21:26:00.688790] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-25T21:26:00.769287] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:26:01.489820] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-25T21:26:01.502972] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T21:26:01.531063] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:26:02.288791] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-25T21:26:03.088726] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-25T21:26:03.160396] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T21:26:03.411805] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:26:03.888757] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-25T21:26:04.692511] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-25T21:26:04.698181] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T21:26:05.038939] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T21:26:05.488749] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-25T21:26:06.161825] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-25T21:26:06.164245] [INFO ] [REMOTE ] SST: Full fetch complete (19027 records). [2025-09-25T21:26:06.164422] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-25T21:26:06.251522] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T21:26:06.294790] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-25T21:26:06.650753] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-25T21:26:06.650914] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-25T21:26:06.651779] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-25T21:26:06.651848] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-25T21:26:06.652721] [DEBUG] [LOCAL ] SST: Trimmed 19027 records to 12151 (keeping 200 days of data) [2025-09-25T21:26:06.734362] [DEBUG] [LOCAL ] SST: Primary data saved (12151 records). [2025-09-25T21:26:06.734531] [INFO ] [MAIN ] SST: Full history saved. [2025-09-25T21:26:06.734806] [INFO ] [MAIN ] Update Progress: 2001/2372 symbols completed. SST took 16.7s. Estimated remaining: 49m 20s. Rate: 7.5 symbols/min [2025-09-25T21:26:06.916471] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:06.943598] [DEBUG] [LOCAL ] STC: Loaded 17713 existing records from primary storage. [2025-09-25T21:26:06.943820] [INFO ] [MAIN ] STC: Loaded 17713 existing records. [2025-09-25T21:26:07.094736] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-25T21:26:07.148802] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:07.152110] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-25T21:26:07.152190] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-25T21:26:07.152561] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-25T21:26:07.152672] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-25T21:26:07.546389] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T21:26:07.585161] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:07.888760] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-25T21:26:08.688755] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-25T21:26:08.921386] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T21:26:09.488757] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-25T21:26:09.699200] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:26:09.936797] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-25T21:26:10.288780] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-25T21:26:10.982905] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:26:11.088757] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-25T21:26:11.614070] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T21:26:11.888761] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-25T21:26:12.310620] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T21:26:12.688717] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-25T21:26:12.993739] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:26:13.488738] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-25T21:26:14.288742] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-25T21:26:14.481460] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T21:26:14.630968] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T21:26:15.088739] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-25T21:26:15.888707] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-25T21:26:16.294333] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T21:26:16.688753] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-25T21:26:16.781049] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T21:26:16.962204] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T21:26:17.488738] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-25T21:26:17.902992] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:26:18.288714] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-25T21:26:18.544056] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T21:26:19.088740] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-25T21:26:19.876822] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T21:26:19.888716] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-25T21:26:19.890504] [INFO ] [REMOTE ] ST: Full fetch complete (71962 records). [2025-09-25T21:26:19.890800] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-25T21:26:19.985194] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T21:26:20.343543] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-25T21:26:20.343677] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-25T21:26:20.344877] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-25T21:26:20.344947] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-25T21:26:20.349469] [DEBUG] [LOCAL ] ST: Trimmed 71962 records to 50150 (keeping 200 days of data) [2025-09-25T21:26:20.688888] [DEBUG] [LOCAL ] ST: Primary data saved (50150 records). [2025-09-25T21:26:20.689052] [INFO ] [MAIN ] ST: Full history saved. [2025-09-25T21:26:20.689173] [INFO ] [MAIN ] Update Progress: 2002/2372 symbols completed. ST took 30.6s. Estimated remaining: 49m 13s. Rate: 7.5 symbols/min [2025-09-25T21:26:20.695744] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-25T21:26:20.891302] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:20.938371] [DEBUG] [LOCAL ] STE: Loaded 35406 existing records from primary storage. [2025-09-25T21:26:20.938541] [INFO ] [MAIN ] STE: Loaded 35406 existing records. [2025-09-25T21:26:21.121323] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:21.121614] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-25T21:26:21.121773] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-25T21:26:21.122154] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-25T21:26:21.122214] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-25T21:26:21.493927] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-25T21:26:21.536676] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:21.669748] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:26:21.739737] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T21:26:22.288759] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-25T21:26:22.395610] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T21:26:22.404264] [INFO ] [REMOTE ] SSTK: Full fetch complete (42146 records). [2025-09-25T21:26:22.404483] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-25T21:26:22.808547] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-25T21:26:22.808759] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-25T21:26:22.810129] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-25T21:26:22.810198] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-25T21:26:22.816520] [DEBUG] [LOCAL ] SSTK: Trimmed 42146 records to 26638 (keeping 200 days of data) [2025-09-25T21:26:23.011109] [DEBUG] [LOCAL ] SSTK: Primary data saved (26638 records). [2025-09-25T21:26:23.011316] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-25T21:26:23.011464] [INFO ] [MAIN ] Update Progress: 2003/2372 symbols completed. SSTK took 32.9s. Estimated remaining: 49m 4s. Rate: 7.5 symbols/min [2025-09-25T21:26:23.097812] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-25T21:26:23.210088] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:23.245905] [DEBUG] [LOCAL ] STEL: Loaded 23631 existing records from primary storage. [2025-09-25T21:26:23.246128] [INFO ] [MAIN ] STEL: Loaded 23631 existing records. [2025-09-25T21:26:23.403265] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:26:23.472595] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:23.473001] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-25T21:26:23.473053] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-25T21:26:23.473437] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-25T21:26:23.473499] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-25T21:26:23.846495] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:23.888669] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-25T21:26:24.356200] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T21:26:24.688749] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-25T21:26:24.959232] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T21:26:25.488742] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-25T21:26:26.175822] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T21:26:26.288730] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-25T21:26:27.016835] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T21:26:27.031269] [INFO ] [REMOTE ] STAG: Full fetch complete (71925 records). [2025-09-25T21:26:27.031470] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-25T21:26:27.089014] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-25T21:26:27.316318] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-25T21:26:27.512583] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-25T21:26:27.512732] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-25T21:26:27.513923] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-25T21:26:27.514043] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-25T21:26:27.516739] [DEBUG] [LOCAL ] STAG: Trimmed 71925 records to 50416 (keeping 200 days of data) [2025-09-25T21:26:27.879267] [DEBUG] [LOCAL ] STAG: Primary data saved (50416 records). [2025-09-25T21:26:27.879439] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-25T21:26:27.879609] [INFO ] [MAIN ] Update Progress: 2004/2372 symbols completed. STAG took 37.8s. Estimated remaining: 48m 55s. Rate: 7.5 symbols/min [2025-09-25T21:26:27.900838] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-25T21:26:28.153523] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:28.217973] [DEBUG] [LOCAL ] STEM: Loaded 39861 existing records from primary storage. [2025-09-25T21:26:28.218134] [INFO ] [MAIN ] STEM: Loaded 39861 existing records. [2025-09-25T21:26:28.244017] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T21:26:28.422792] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:28.424412] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-25T21:26:28.424465] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-25T21:26:28.425007] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-25T21:26:28.425071] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-25T21:26:28.689702] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-25T21:26:28.812278] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:29.045519] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-25T21:26:29.488747] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-25T21:26:29.757565] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T21:26:30.288711] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-25T21:26:31.088690] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-25T21:26:31.455176] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T21:26:31.546370] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T21:26:31.888725] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-25T21:26:32.163862] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T21:26:32.688742] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-25T21:26:33.488840] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-25T21:26:34.051481] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T21:26:34.199037] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-25T21:26:34.288778] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-25T21:26:35.098053] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-25T21:26:35.103060] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T21:26:35.281266] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T21:26:35.286022] [INFO ] [REMOTE ] STC: Full fetch complete (26179 records). [2025-09-25T21:26:35.286130] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-25T21:26:35.682888] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-25T21:26:35.682979] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-25T21:26:35.683593] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-25T21:26:35.683680] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-25T21:26:35.684978] [DEBUG] [LOCAL ] STC: Trimmed 26179 records to 17792 (keeping 200 days of data) [2025-09-25T21:26:35.821286] [DEBUG] [LOCAL ] STC: Primary data saved (17792 records). [2025-09-25T21:26:35.821538] [INFO ] [MAIN ] STC: Full history saved. [2025-09-25T21:26:35.821828] [INFO ] [MAIN ] Update Progress: 2005/2372 symbols completed. STC took 29.1s. Estimated remaining: 48m 47s. Rate: 7.5 symbols/min [2025-09-25T21:26:35.891709] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-25T21:26:36.035823] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:36.061334] [DEBUG] [LOCAL ] STEW: Loaded 16186 existing records from primary storage. [2025-09-25T21:26:36.061496] [INFO ] [MAIN ] STEW: Loaded 16186 existing records. [2025-09-25T21:26:36.251155] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:26:36.294954] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:36.295563] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-25T21:26:36.295630] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-25T21:26:36.295951] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-25T21:26:36.296021] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-25T21:26:36.670161] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:36.688732] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-25T21:26:37.488740] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-25T21:26:37.544326] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T21:26:37.565401] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-25T21:26:38.288784] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-25T21:26:39.088795] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-25T21:26:39.422748] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T21:26:39.900728] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-25T21:26:39.918245] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T21:26:39.997883] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T21:26:40.688711] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-25T21:26:41.008741] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:26:41.455706] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T21:26:41.488740] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-25T21:26:42.288740] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-25T21:26:42.521422] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T21:26:43.088743] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-25T21:26:43.888736] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-25T21:26:44.169940] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T21:26:44.492091] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T21:26:44.684952] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T21:26:44.691679] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-25T21:26:45.488726] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-25T21:26:46.288756] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-25T21:26:46.672606] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T21:26:47.055443] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:26:47.065032] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-25T21:26:47.088676] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-25T21:26:47.888795] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-25T21:26:48.534746] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T21:26:48.688771] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-25T21:26:48.963320] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T21:26:49.488744] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-25T21:26:50.170935] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T21:26:50.181866] [INFO ] [REMOTE ] STE: Full fetch complete (50675 records). [2025-09-25T21:26:50.182023] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-25T21:26:50.294773] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-25T21:26:50.642207] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-25T21:26:50.642323] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-25T21:26:50.643421] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-25T21:26:50.643493] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-25T21:26:50.644903] [DEBUG] [LOCAL ] STE: Trimmed 50675 records to 35635 (keeping 200 days of data) [2025-09-25T21:26:50.884124] [DEBUG] [LOCAL ] STE: Primary data saved (35635 records). [2025-09-25T21:26:50.884288] [INFO ] [MAIN ] STE: Full history saved. [2025-09-25T21:26:50.884461] [INFO ] [MAIN ] Update Progress: 2006/2372 symbols completed. STE took 30.2s. Estimated remaining: 48m 41s. Rate: 7.5 symbols/min [2025-09-25T21:26:51.082161] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:51.082349] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-25T21:26:51.082386] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-25T21:26:51.082555] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-25T21:26:51.082610] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-25T21:26:51.082706] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-25T21:26:51.082764] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-25T21:26:51.088795] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-25T21:26:51.383141] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T21:26:51.421391] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T21:26:51.443121] [INFO ] [REMOTE ] STEL: Full fetch complete (32143 records). [2025-09-25T21:26:51.443225] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-25T21:26:51.732144] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:51.813901] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T21:26:51.894724] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-25T21:26:52.032225] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-25T21:26:52.032311] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-25T21:26:52.033086] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-25T21:26:52.033149] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-25T21:26:52.034727] [DEBUG] [LOCAL ] STEL: Trimmed 32143 records to 23712 (keeping 200 days of data) [2025-09-25T21:26:52.191880] [DEBUG] [LOCAL ] STEL: Primary data saved (23712 records). [2025-09-25T21:26:52.192087] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-25T21:26:52.192250] [INFO ] [MAIN ] Update Progress: 2007/2372 symbols completed. STEL took 29.2s. Estimated remaining: 48m 31s. Rate: 7.5 symbols/min [2025-09-25T21:26:52.373295] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:26:52.393724] [DEBUG] [LOCAL ] STK: Loaded 9399 existing records from primary storage. [2025-09-25T21:26:52.393872] [INFO ] [MAIN ] STK: Loaded 9399 existing records. [2025-09-25T21:26:52.600294] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:26:52.600560] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-25T21:26:52.600608] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-25T21:26:52.601059] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-25T21:26:52.601120] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-25T21:26:52.692311] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-25T21:26:53.004023] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:26:53.488729] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-25T21:26:53.654594] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T21:26:53.755784] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:26:54.288767] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-25T21:26:54.299002] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T21:26:55.088804] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-25T21:26:55.428513] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-25T21:26:55.888731] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-25T21:26:56.040862] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:26:56.688702] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-25T21:26:56.764574] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T21:26:57.153108] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T21:26:57.488729] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-25T21:26:58.288739] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-25T21:26:58.526333] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T21:26:58.701935] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T21:26:59.088727] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-25T21:26:59.888743] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-25T21:26:59.894108] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T21:27:00.688726] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-25T21:27:00.746361] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T21:27:01.488706] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-25T21:27:02.183092] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T21:27:02.196783] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T21:27:02.288736] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-25T21:27:03.088764] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-25T21:27:03.213142] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-25T21:27:03.888744] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-25T21:27:04.186776] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-25T21:27:04.493363] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T21:27:04.501539] [INFO ] [REMOTE ] STEM: Full fetch complete (62688 records). [2025-09-25T21:27:04.501858] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-25T21:27:04.689018] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-25T21:27:04.940919] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-25T21:27:04.941004] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-25T21:27:04.942059] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-25T21:27:04.942137] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-25T21:27:04.943831] [DEBUG] [LOCAL ] STEM: Trimmed 62688 records to 40148 (keeping 200 days of data) [2025-09-25T21:27:05.212560] [DEBUG] [LOCAL ] STEM: Primary data saved (40148 records). [2025-09-25T21:27:05.212721] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-25T21:27:05.212872] [INFO ] [MAIN ] Update Progress: 2008/2372 symbols completed. STEM took 37.3s. Estimated remaining: 48m 24s. Rate: 7.5 symbols/min [2025-09-25T21:27:05.402589] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:05.482529] [DEBUG] [LOCAL ] STLA: Loaded 53542 existing records from primary storage. [2025-09-25T21:27:05.482753] [INFO ] [MAIN ] STLA: Loaded 53542 existing records. [2025-09-25T21:27:05.494816] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-25T21:27:05.522052] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T21:27:05.540580] [INFO ] [REMOTE ] STEW: Full fetch complete (21835 records). [2025-09-25T21:27:05.547835] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-25T21:27:05.889200] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-25T21:27:05.890637] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:05.890886] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-25T21:27:05.890934] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-25T21:27:05.891361] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-25T21:27:05.891421] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-25T21:27:06.290837] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-25T21:27:06.539958] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-25T21:27:06.540057] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-25T21:27:06.540627] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-25T21:27:06.546847] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-25T21:27:06.547807] [DEBUG] [LOCAL ] STEW: Trimmed 21835 records to 16254 (keeping 200 days of data) [2025-09-25T21:27:06.721727] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:06.735335] [DEBUG] [LOCAL ] STEW: Primary data saved (16254 records). [2025-09-25T21:27:06.735470] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-25T21:27:06.735567] [INFO ] [MAIN ] Update Progress: 2009/2372 symbols completed. STEW took 30.9s. Estimated remaining: 48m 15s. Rate: 7.5 symbols/min [2025-09-25T21:27:06.924167] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:06.994275] [DEBUG] [LOCAL ] STM: Loaded 53586 existing records from primary storage. [2025-09-25T21:27:06.994517] [INFO ] [MAIN ] STM: Loaded 53586 existing records. [2025-09-25T21:27:07.093819] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-25T21:27:07.200256] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T21:27:07.191399] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:07.203949] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-25T21:27:07.204014] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-25T21:27:07.204699] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-25T21:27:07.204769] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-25T21:27:07.575067] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:07.888730] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-25T21:27:08.511043] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T21:27:08.688705] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-25T21:27:09.378386] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-25T21:27:09.402618] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-25T21:27:09.488710] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-25T21:27:10.288805] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-25T21:27:10.295303] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-25T21:27:11.088749] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-25T21:27:11.533910] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:27:11.888799] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-25T21:27:12.334140] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T21:27:12.372861] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-25T21:27:12.688732] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-25T21:27:13.488752] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-25T21:27:14.244231] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T21:27:14.288728] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-25T21:27:14.562818] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T21:27:14.753503] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T21:27:15.088725] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-25T21:27:15.888729] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-25T21:27:15.915476] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T21:27:15.920357] [INFO ] [REMOTE ] STK: Full fetch complete (14104 records). [2025-09-25T21:27:15.920478] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-25T21:27:16.354199] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-25T21:27:16.354317] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-25T21:27:16.354726] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-25T21:27:16.354801] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-25T21:27:16.355420] [DEBUG] [LOCAL ] STK: Trimmed 14104 records to 9500 (keeping 200 days of data) [2025-09-25T21:27:16.420614] [DEBUG] [LOCAL ] STK: Primary data saved (9500 records). [2025-09-25T21:27:16.420801] [INFO ] [MAIN ] STK: Full history saved. [2025-09-25T21:27:16.421007] [INFO ] [MAIN ] Update Progress: 2010/2372 symbols completed. STK took 24.2s. Estimated remaining: 48m 8s. Rate: 7.5 symbols/min [2025-09-25T21:27:16.607295] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:16.647871] [DEBUG] [LOCAL ] STN: Loaded 23138 existing records from primary storage. [2025-09-25T21:27:16.648021] [INFO ] [MAIN ] STN: Loaded 23138 existing records. [2025-09-25T21:27:16.693854] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-25T21:27:16.840543] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:16.841722] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-25T21:27:16.841778] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-25T21:27:16.841984] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-25T21:27:16.842042] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-25T21:27:17.177151] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T21:27:17.178219] [INFO ] [REMOTE ] STG: Full fetch complete (2496 records). [2025-09-25T21:27:17.178295] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-25T21:27:17.297623] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:17.414702] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-25T21:27:17.415055] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:27:17.415148] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:27:17.415243] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-25T21:27:17.415309] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-25T21:27:17.415357] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-25T21:27:17.415441] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-25T21:27:17.415569] [INFO ] [MAIN ] Update Progress: 2011/2372 symbols completed. STG took 26.5s. Estimated remaining: 47m 58s. Rate: 7.5 symbols/min [2025-09-25T21:27:17.489566] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-25T21:27:17.603997] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:17.684457] [DEBUG] [LOCAL ] STNG: Loaded 44045 existing records from primary storage. [2025-09-25T21:27:17.684667] [INFO ] [MAIN ] STNG: Loaded 44045 existing records. [2025-09-25T21:27:17.911922] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:17.912299] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-25T21:27:17.912378] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-25T21:27:17.912733] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-25T21:27:17.912805] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-25T21:27:18.291136] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-25T21:27:18.305612] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-25T21:27:18.408488] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:19.088729] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-25T21:27:19.384706] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-25T21:27:19.515057] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-25T21:27:19.888832] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-25T21:27:20.688757] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-25T21:27:20.730588] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T21:27:21.488734] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-25T21:27:22.202627] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-25T21:27:22.288700] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-25T21:27:22.720980] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T21:27:23.088696] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-25T21:27:23.200115] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T21:27:23.888746] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-25T21:27:24.094776] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:27:24.688698] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-25T21:27:24.736082] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T21:27:24.948132] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T21:27:25.488773] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-25T21:27:26.288778] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-25T21:27:26.682448] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T21:27:27.088809] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-25T21:27:27.388508] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T21:27:27.680043] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-25T21:27:27.888770] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-25T21:27:28.688762] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-25T21:27:29.338274] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-25T21:27:29.416024] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T21:27:29.488712] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-25T21:27:30.288736] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-25T21:27:30.397322] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:27:30.945586] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-25T21:27:31.088758] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-25T21:27:31.832873] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:27:31.877952] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T21:27:31.888685] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-25T21:27:32.688736] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-25T21:27:33.488702] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-25T21:27:33.600964] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T21:27:33.748902] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T21:27:34.288859] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-25T21:27:35.088755] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-25T21:27:35.722761] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-25T21:27:35.852980] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T21:27:35.888695] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-25T21:27:35.987220] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T21:27:36.688725] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-25T21:27:37.488768] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-25T21:27:37.636136] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:27:38.288749] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-25T21:27:38.802746] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-25T21:27:39.088770] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-25T21:27:39.710538] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-25T21:27:39.720920] [INFO ] [REMOTE ] STLA: Full fetch complete (77531 records). [2025-09-25T21:27:39.721116] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-25T21:27:39.856334] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T21:27:39.892860] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-25T21:27:40.271088] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T21:27:40.276826] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-25T21:27:40.276959] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-25T21:27:40.278594] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-25T21:27:40.278705] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-25T21:27:40.280599] [DEBUG] [LOCAL ] STLA: Trimmed 77531 records to 53932 (keeping 200 days of data) [2025-09-25T21:27:40.615377] [DEBUG] [LOCAL ] STLA: Primary data saved (53932 records). [2025-09-25T21:27:40.615541] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-25T21:27:40.615717] [INFO ] [MAIN ] Update Progress: 2012/2372 symbols completed. STLA took 35.4s. Estimated remaining: 47m 53s. Rate: 7.5 symbols/min [2025-09-25T21:27:40.694022] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-25T21:27:40.824477] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:40.844419] [DEBUG] [LOCAL ] STRV: Loaded 11574 existing records from primary storage. [2025-09-25T21:27:40.844570] [INFO ] [MAIN ] STRV: Loaded 11574 existing records. [2025-09-25T21:27:41.039399] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:41.039918] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-25T21:27:41.039999] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-25T21:27:41.040414] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-25T21:27:41.040493] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-25T21:27:41.491115] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-25T21:27:41.500962] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:41.490984] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T21:27:41.522982] [INFO ] [REMOTE ] STNG: Full fetch complete (64413 records). [2025-09-25T21:27:41.523251] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-25T21:27:41.545987] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T21:27:41.965960] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-25T21:27:41.966079] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-25T21:27:41.967817] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-25T21:27:41.967890] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-25T21:27:41.969721] [DEBUG] [LOCAL ] STNG: Trimmed 64413 records to 44319 (keeping 200 days of data) [2025-09-25T21:27:42.288709] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-25T21:27:42.291540] [DEBUG] [LOCAL ] STNG: Primary data saved (44319 records). [2025-09-25T21:27:42.291675] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-25T21:27:42.291899] [INFO ] [MAIN ] Update Progress: 2013/2372 symbols completed. STNG took 24.9s. Estimated remaining: 47m 44s. Rate: 7.5 symbols/min [2025-09-25T21:27:42.478123] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:42.540873] [DEBUG] [LOCAL ] STT: Loaded 51071 existing records from primary storage. [2025-09-25T21:27:42.541097] [INFO ] [MAIN ] STT: Loaded 51071 existing records. [2025-09-25T21:27:42.727549] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:42.728793] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-25T21:27:42.728894] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-25T21:27:42.729290] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-25T21:27:42.729349] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-25T21:27:43.094248] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:43.094688] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-25T21:27:43.441325] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T21:27:43.648545] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-25T21:27:43.888735] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-25T21:27:44.688708] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-25T21:27:44.858335] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T21:27:44.897177] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T21:27:44.906603] [INFO ] [REMOTE ] STN: Full fetch complete (32393 records). [2025-09-25T21:27:44.906789] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-25T21:27:45.301121] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-25T21:27:45.301228] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-25T21:27:45.302315] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-25T21:27:45.302381] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-25T21:27:45.304847] [DEBUG] [LOCAL ] STN: Trimmed 32393 records to 23298 (keeping 200 days of data) [2025-09-25T21:27:45.486133] [DEBUG] [LOCAL ] STN: Primary data saved (23298 records). [2025-09-25T21:27:45.486320] [INFO ] [MAIN ] STN: Full history saved. [2025-09-25T21:27:45.486472] [INFO ] [MAIN ] Update Progress: 2014/2372 symbols completed. STN took 29.1s. Estimated remaining: 47m 35s. Rate: 7.5 symbols/min [2025-09-25T21:27:45.501094] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-25T21:27:45.681634] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:45.681900] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-25T21:27:45.681942] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-25T21:27:45.682098] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-25T21:27:45.682140] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-25T21:27:45.682181] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-25T21:27:45.682213] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-25T21:27:46.059602] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:46.288683] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-25T21:27:46.673605] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T21:27:46.871853] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T21:27:47.088737] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-25T21:27:47.888880] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-25T21:27:48.135743] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:27:48.136257] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-25T21:27:48.153838] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T21:27:48.328137] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-25T21:27:48.688743] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-25T21:27:49.488779] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-25T21:27:50.288716] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-25T21:27:50.339125] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T21:27:51.088701] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-25T21:27:51.278297] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T21:27:51.306891] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T21:27:51.888745] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-25T21:27:52.688830] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-25T21:27:52.835819] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T21:27:52.942246] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T21:27:53.488768] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-25T21:27:54.288699] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-25T21:27:54.494105] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T21:27:54.921014] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-25T21:27:54.934198] [INFO ] [REMOTE ] STM: Full fetch complete (77525 records). [2025-09-25T21:27:54.934419] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-25T21:27:55.093840] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-25T21:27:55.353377] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:27:55.353768] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-25T21:27:55.441296] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-25T21:27:55.441504] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-25T21:27:55.442834] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-25T21:27:55.442912] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-25T21:27:55.444684] [DEBUG] [LOCAL ] STM: Trimmed 77525 records to 53974 (keeping 200 days of data) [2025-09-25T21:27:55.818383] [DEBUG] [LOCAL ] STM: Primary data saved (53974 records). [2025-09-25T21:27:55.818547] [INFO ] [MAIN ] STM: Full history saved. [2025-09-25T21:27:55.818746] [INFO ] [MAIN ] Update Progress: 2015/2372 symbols completed. STM took 49.1s. Estimated remaining: 47m 28s. Rate: 7.5 symbols/min [2025-09-25T21:27:55.893796] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-25T21:27:56.038866] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:27:56.072325] [DEBUG] [LOCAL ] STVN: Loaded 26260 existing records from primary storage. [2025-09-25T21:27:56.072483] [INFO ] [MAIN ] STVN: Loaded 26260 existing records. [2025-09-25T21:27:56.249700] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-25T21:27:56.360364] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:27:56.360684] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-25T21:27:56.360756] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-25T21:27:56.361171] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-25T21:27:56.361246] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-25T21:27:56.691286] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-25T21:27:56.855209] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:27:56.865635] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-25T21:27:57.488755] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-25T21:27:58.288760] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-25T21:27:58.331052] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-25T21:27:58.526045] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T21:27:59.088847] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-25T21:27:59.647067] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T21:27:59.888711] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-25T21:27:59.951926] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-25T21:28:00.107191] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:00.107541] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-25T21:28:00.688746] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-25T21:28:01.488795] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-25T21:28:02.156566] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T21:28:02.254768] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-25T21:28:02.288704] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-25T21:28:03.088855] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-25T21:28:03.550363] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T21:28:03.893821] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-25T21:28:03.896699] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:28:03.900539] [INFO ] [REMOTE ] STRV: Full fetch complete (18561 records). [2025-09-25T21:28:03.900675] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-25T21:28:04.324605] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-25T21:28:04.324735] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-25T21:28:04.325237] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-25T21:28:04.325341] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-25T21:28:04.326717] [DEBUG] [LOCAL ] STRV: Trimmed 18561 records to 11659 (keeping 200 days of data) [2025-09-25T21:28:04.423392] [DEBUG] [LOCAL ] STRV: Primary data saved (11659 records). [2025-09-25T21:28:04.423600] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-25T21:28:04.423790] [INFO ] [MAIN ] Update Progress: 2016/2372 symbols completed. STRV took 23.8s. Estimated remaining: 47m 20s. Rate: 7.5 symbols/min [2025-09-25T21:28:04.606364] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:04.680941] [DEBUG] [LOCAL ] STWD: Loaded 51894 existing records from primary storage. [2025-09-25T21:28:04.681104] [INFO ] [MAIN ] STWD: Loaded 51894 existing records. [2025-09-25T21:28:04.695689] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-25T21:28:04.877191] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:04.877455] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-25T21:28:04.877513] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-25T21:28:04.879311] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-25T21:28:04.879467] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-25T21:28:04.996494] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:05.013187] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-25T21:28:05.274953] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:05.488708] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-25T21:28:05.724751] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:05.725244] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-25T21:28:05.731115] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T21:28:06.288788] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-25T21:28:07.088836] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-25T21:28:07.888750] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-25T21:28:08.115464] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:28:08.173195] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T21:28:08.688799] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-25T21:28:08.908860] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:08.909243] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-25T21:28:09.488765] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-25T21:28:09.710419] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T21:28:09.865060] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:09.865380] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-25T21:28:10.288774] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-25T21:28:11.088716] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-25T21:28:11.888729] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-25T21:28:12.094802] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:12.095181] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-25T21:28:12.166593] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T21:28:12.549708] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:28:12.688720] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-25T21:28:13.488731] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-25T21:28:13.723289] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:28:13.723752] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-25T21:28:14.288695] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-25T21:28:14.602740] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T21:28:14.619731] [INFO ] [REMOTE ] STT: Full fetch complete (74538 records). [2025-09-25T21:28:14.620046] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-25T21:28:15.068941] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-25T21:28:15.069049] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-25T21:28:15.070183] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-25T21:28:15.070252] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-25T21:28:15.071915] [DEBUG] [LOCAL ] STT: Trimmed 74538 records to 51441 (keeping 200 days of data) [2025-09-25T21:28:15.088752] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-25T21:28:15.439108] [DEBUG] [LOCAL ] STT: Primary data saved (51441 records). [2025-09-25T21:28:15.439259] [INFO ] [MAIN ] STT: Full history saved. [2025-09-25T21:28:15.439418] [INFO ] [MAIN ] Update Progress: 2017/2372 symbols completed. STT took 33.1s. Estimated remaining: 47m 12s. Rate: 7.5 symbols/min [2025-09-25T21:28:15.616905] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:15.622493] [DEBUG] [LOCAL ] STXD: Loaded 1320 existing records from primary storage. [2025-09-25T21:28:15.622604] [INFO ] [MAIN ] STXD: Loaded 1320 existing records. [2025-09-25T21:28:15.819178] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:15.819492] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-25T21:28:15.819557] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-25T21:28:15.819950] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-25T21:28:15.820032] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-25T21:28:15.891202] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-25T21:28:16.015613] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T21:28:16.271271] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:16.412929] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:28:16.688757] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-25T21:28:16.801155] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T21:28:16.807370] [INFO ] [REMOTE ] STUB: Full fetch complete (2564 records). [2025-09-25T21:28:16.807451] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-25T21:28:17.004383] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-25T21:28:17.004753] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:28:17.004856] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:28:17.004958] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-25T21:28:17.005031] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-25T21:28:17.005081] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-25T21:28:17.005171] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-25T21:28:17.005302] [INFO ] [MAIN ] Update Progress: 2018/2372 symbols completed. STUB took 31.5s. Estimated remaining: 47m 3s. Rate: 7.5 symbols/min [2025-09-25T21:28:17.177621] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:17.187380] [DEBUG] [LOCAL ] STXE: Loaded 2199 existing records from primary storage. [2025-09-25T21:28:17.187585] [INFO ] [MAIN ] STXE: Loaded 2199 existing records. [2025-09-25T21:28:17.371441] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:17.371948] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-25T21:28:17.372005] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-25T21:28:17.372220] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-25T21:28:17.372279] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-25T21:28:17.493792] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-25T21:28:17.738813] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:18.288700] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-25T21:28:18.525895] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T21:28:18.684451] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T21:28:18.833460] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T21:28:19.088727] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-25T21:28:19.585569] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T21:28:19.888732] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-25T21:28:20.356061] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T21:28:20.688726] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-25T21:28:21.488731] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-25T21:28:22.288724] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-25T21:28:23.088747] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-25T21:28:23.142721] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:28:23.556465] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-25T21:28:23.888739] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-25T21:28:24.615770] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T21:28:24.688730] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-25T21:28:25.041942] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-25T21:28:25.488748] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-25T21:28:25.709498] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T21:28:25.891494] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T21:28:25.992948] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T21:28:26.288752] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-25T21:28:26.735824] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:28:27.088740] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-25T21:28:27.506803] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-25T21:28:27.888741] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-25T21:28:28.688716] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-25T21:28:29.236836] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T21:28:29.488734] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-25T21:28:30.039153] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-25T21:28:30.288748] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-25T21:28:30.538626] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T21:28:31.088715] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-25T21:28:31.282787] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-25T21:28:31.292031] [INFO ] [REMOTE ] STVN: Full fetch complete (39372 records). [2025-09-25T21:28:31.292162] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-25T21:28:31.797248] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-25T21:28:31.797336] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-25T21:28:31.798306] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-25T21:28:31.798376] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-25T21:28:31.801296] [DEBUG] [LOCAL ] STVN: Trimmed 39372 records to 26453 (keeping 200 days of data) [2025-09-25T21:28:31.892886] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-25T21:28:32.029960] [DEBUG] [LOCAL ] STVN: Primary data saved (26453 records). [2025-09-25T21:28:32.030111] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-25T21:28:32.030231] [INFO ] [MAIN ] Update Progress: 2019/2372 symbols completed. STVN took 36.2s. Estimated remaining: 46m 56s. Rate: 7.5 symbols/min [2025-09-25T21:28:32.211877] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:32.221990] [DEBUG] [LOCAL ] STXG: Loaded 2586 existing records from primary storage. [2025-09-25T21:28:32.222149] [INFO ] [MAIN ] STXG: Loaded 2586 existing records. [2025-09-25T21:28:32.323524] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-25T21:28:32.433959] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:32.434215] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-25T21:28:32.434259] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-25T21:28:32.434452] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-25T21:28:32.434511] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-25T21:28:32.694737] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-25T21:28:32.854225] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:32.884818] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:28:33.488858] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-25T21:28:34.098606] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T21:28:34.288739] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-25T21:28:34.863894] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T21:28:35.088793] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-25T21:28:35.654414] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-25T21:28:35.888717] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-25T21:28:35.996558] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-25T21:28:36.241449] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-25T21:28:36.242717] [INFO ] [REMOTE ] STXD: Full fetch complete (2068 records). [2025-09-25T21:28:36.242823] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-25T21:28:36.662170] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-25T21:28:36.662251] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-25T21:28:36.662345] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-25T21:28:36.662445] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-25T21:28:36.662851] [DEBUG] [LOCAL ] STXD: Trimmed 2068 records to 1335 (keeping 200 days of data) [2025-09-25T21:28:36.674132] [DEBUG] [LOCAL ] STXD: Primary data saved (1335 records). [2025-09-25T21:28:36.674253] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-25T21:28:36.674425] [INFO ] [MAIN ] Update Progress: 2020/2372 symbols completed. STXD took 21.2s. Estimated remaining: 46m 48s. Rate: 7.5 symbols/min [2025-09-25T21:28:36.695944] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-25T21:28:36.878621] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:36.887547] [DEBUG] [LOCAL ] STXK: Loaded 1513 existing records from primary storage. [2025-09-25T21:28:36.887671] [INFO ] [MAIN ] STXK: Loaded 1513 existing records. [2025-09-25T21:28:37.086210] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:37.086940] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-25T21:28:37.087003] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-25T21:28:37.087319] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-25T21:28:37.087426] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-25T21:28:37.477252] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:37.488739] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-25T21:28:38.097766] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T21:28:38.288694] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-25T21:28:38.580780] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T21:28:38.775876] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-25T21:28:39.088751] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-25T21:28:39.583499] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T21:28:39.888687] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-25T21:28:40.338893] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:28:40.688708] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-25T21:28:41.147696] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T21:28:41.488729] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-25T21:28:42.288790] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-25T21:28:42.850597] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T21:28:43.088764] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-25T21:28:43.155547] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T21:28:43.170189] [INFO ] [REMOTE ] STWD: Full fetch complete (75006 records). [2025-09-25T21:28:43.170390] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-25T21:28:43.597900] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-25T21:28:43.598043] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-25T21:28:43.599844] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-25T21:28:43.599928] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-25T21:28:43.603360] [DEBUG] [LOCAL ] STWD: Trimmed 75006 records to 52269 (keeping 200 days of data) [2025-09-25T21:28:43.680824] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T21:28:43.888910] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-25T21:28:43.990176] [DEBUG] [LOCAL ] STWD: Primary data saved (52269 records). [2025-09-25T21:28:43.990396] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-25T21:28:43.990607] [INFO ] [MAIN ] Update Progress: 2021/2372 symbols completed. STWD took 39.6s. Estimated remaining: 46m 40s. Rate: 7.5 symbols/min [2025-09-25T21:28:44.167230] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:44.167478] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-25T21:28:44.167517] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-25T21:28:44.168734] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-25T21:28:44.168788] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-25T21:28:44.168831] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-25T21:28:44.168866] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-25T21:28:44.548411] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:44.688727] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-25T21:28:44.760309] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-25T21:28:45.130465] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T21:28:45.488736] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-25T21:28:45.974414] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T21:28:46.288765] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-25T21:28:46.754614] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-25T21:28:47.088828] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-25T21:28:47.791624] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-25T21:28:47.888733] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-25T21:28:48.348051] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T21:28:48.688733] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-25T21:28:49.103965] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-25T21:28:49.488728] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-25T21:28:49.939766] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-25T21:28:50.288728] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-25T21:28:50.777719] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T21:28:51.088796] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-25T21:28:51.440159] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-25T21:28:51.888768] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-25T21:28:52.378141] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-25T21:28:52.688735] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-25T21:28:53.138978] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:28:53.488734] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-25T21:28:53.950295] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T21:28:54.288728] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-25T21:28:54.775266] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T21:28:55.088735] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-25T21:28:55.550376] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-25T21:28:55.888736] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-25T21:28:56.336011] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T21:28:56.688758] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-25T21:28:57.187925] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T21:28:57.488734] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-25T21:28:57.934350] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T21:28:57.935446] [INFO ] [REMOTE ] STXG: Full fetch complete (4176 records). [2025-09-25T21:28:57.935530] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-25T21:28:58.293788] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-25T21:28:58.353525] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-25T21:28:58.353613] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-25T21:28:58.353830] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-25T21:28:58.353904] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-25T21:28:58.354438] [DEBUG] [LOCAL ] STXG: Trimmed 4176 records to 2599 (keeping 200 days of data) [2025-09-25T21:28:58.374277] [DEBUG] [LOCAL ] STXG: Primary data saved (2599 records). [2025-09-25T21:28:58.374382] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-25T21:28:58.374521] [INFO ] [MAIN ] Update Progress: 2022/2372 symbols completed. STXG took 26.3s. Estimated remaining: 46m 33s. Rate: 7.5 symbols/min [2025-09-25T21:28:58.553331] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:28:58.566097] [DEBUG] [LOCAL ] STXT: Loaded 2566 existing records from primary storage. [2025-09-25T21:28:58.566249] [INFO ] [MAIN ] STXT: Loaded 2566 existing records. [2025-09-25T21:28:58.703575] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T21:28:58.765068] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:28:58.765424] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-25T21:28:58.765503] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-25T21:28:58.765829] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-25T21:28:58.765911] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-25T21:28:59.097809] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-25T21:28:59.183713] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:28:59.657000] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-25T21:28:59.888722] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-25T21:29:00.246406] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T21:29:00.688769] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-25T21:29:01.224829] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T21:29:01.226090] [INFO ] [REMOTE ] STXE: Full fetch complete (3700 records). [2025-09-25T21:29:01.226162] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-25T21:29:01.493942] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-25T21:29:01.626396] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-25T21:29:01.626554] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-25T21:29:01.626780] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-25T21:29:01.626847] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-25T21:29:01.627241] [DEBUG] [LOCAL ] STXE: Trimmed 3700 records to 2216 (keeping 200 days of data) [2025-09-25T21:29:01.647750] [DEBUG] [LOCAL ] STXE: Primary data saved (2216 records). [2025-09-25T21:29:01.647846] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-25T21:29:01.648089] [INFO ] [MAIN ] Update Progress: 2023/2372 symbols completed. STXE took 44.6s. Estimated remaining: 46m 24s. Rate: 7.5 symbols/min [2025-09-25T21:29:01.834661] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:01.842834] [DEBUG] [LOCAL ] STXV: Loaded 1638 existing records from primary storage. [2025-09-25T21:29:01.842949] [INFO ] [MAIN ] STXV: Loaded 1638 existing records. [2025-09-25T21:29:01.882980] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-25T21:29:02.042368] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:02.042635] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-25T21:29:02.043446] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-25T21:29:02.045915] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-25T21:29:02.045979] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-25T21:29:02.293943] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-25T21:29:02.459822] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:02.682186] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-25T21:29:03.088756] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-25T21:29:03.453844] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-25T21:29:03.888761] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-25T21:29:04.325596] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T21:29:04.688741] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-25T21:29:05.033893] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-25T21:29:05.034935] [INFO ] [REMOTE ] STXK: Full fetch complete (2424 records). [2025-09-25T21:29:05.035009] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-25T21:29:05.452887] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-25T21:29:05.452971] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-25T21:29:05.453078] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-25T21:29:05.453116] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-25T21:29:05.453463] [DEBUG] [LOCAL ] STXK: Trimmed 2424 records to 1527 (keeping 200 days of data) [2025-09-25T21:29:05.464092] [DEBUG] [LOCAL ] STXK: Primary data saved (1527 records). [2025-09-25T21:29:05.464159] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-25T21:29:05.464275] [INFO ] [MAIN ] Update Progress: 2024/2372 symbols completed. STXK took 28.8s. Estimated remaining: 46m 15s. Rate: 7.5 symbols/min [2025-09-25T21:29:05.489727] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-25T21:29:05.661349] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:05.757848] [DEBUG] [LOCAL ] STZ: Loaded 52265 existing records from primary storage. [2025-09-25T21:29:05.758036] [INFO ] [MAIN ] STZ: Loaded 52265 existing records. [2025-09-25T21:29:05.944986] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:05.946612] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-25T21:29:05.946692] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-25T21:29:05.947185] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-25T21:29:05.947244] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-25T21:29:06.108358] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T21:29:06.288833] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-25T21:29:06.320671] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:06.852728] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-25T21:29:07.088744] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-25T21:29:07.544513] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T21:29:07.888782] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-25T21:29:08.354744] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T21:29:08.688763] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-25T21:29:09.169513] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-25T21:29:09.488838] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-25T21:29:09.974875] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T21:29:10.288867] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-25T21:29:10.747988] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T21:29:11.088800] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-25T21:29:11.494584] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-25T21:29:11.888812] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-25T21:29:12.352216] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T21:29:12.688850] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-25T21:29:13.200146] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-25T21:29:13.488745] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-25T21:29:13.991943] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-25T21:29:14.288738] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-25T21:29:15.088807] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-25T21:29:15.709812] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T21:29:15.888698] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-25T21:29:16.214396] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-25T21:29:16.284382] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-25T21:29:16.688752] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-25T21:29:17.139188] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-25T21:29:17.141062] [INFO ] [REMOTE ] STXT: Full fetch complete (4003 records). [2025-09-25T21:29:17.141188] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-25T21:29:17.495757] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-25T21:29:17.670525] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-25T21:29:17.670691] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-25T21:29:17.670923] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-25T21:29:17.670987] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-25T21:29:17.671574] [DEBUG] [LOCAL ] STXT: Trimmed 4003 records to 2574 (keeping 200 days of data) [2025-09-25T21:29:17.692237] [DEBUG] [LOCAL ] STXT: Primary data saved (2574 records). [2025-09-25T21:29:17.692355] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-25T21:29:17.692504] [INFO ] [MAIN ] Update Progress: 2025/2372 symbols completed. STXT took 19.3s. Estimated remaining: 46m 8s. Rate: 7.5 symbols/min [2025-09-25T21:29:17.873514] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:17.880367] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-25T21:29:17.881369] [INFO ] [REMOTE ] STXM: Full fetch complete (1442 records). [2025-09-25T21:29:17.881442] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-25T21:29:18.055726] [DEBUG] [LOCAL ] SU: Loaded 53457 existing records from primary storage. [2025-09-25T21:29:18.056005] [INFO ] [MAIN ] SU: Loaded 53457 existing records. [2025-09-25T21:29:18.243521] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-25T21:29:18.243784] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:29:18.243835] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:29:18.243876] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-25T21:29:18.243962] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-25T21:29:18.244019] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-25T21:29:18.244080] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-25T21:29:18.244181] [INFO ] [MAIN ] Update Progress: 2026/2372 symbols completed. STXM took 34.3s. Estimated remaining: 45m 59s. Rate: 7.5 symbols/min [2025-09-25T21:29:18.295913] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-25T21:29:18.513877] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:18.571834] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:18.572826] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-25T21:29:18.572999] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-25T21:29:18.573693] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-25T21:29:18.573787] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-25T21:29:18.826065] [DEBUG] [LOCAL ] SUI: Loaded 41980 existing records from primary storage. [2025-09-25T21:29:18.826248] [INFO ] [MAIN ] SUI: Loaded 41980 existing records. [2025-09-25T21:29:19.094841] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-25T21:29:19.240704] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:19.241004] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-25T21:29:19.241063] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-25T21:29:19.241364] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-25T21:29:19.241425] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-25T21:29:19.247101] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:19.641469] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:19.646357] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-25T21:29:19.888776] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-25T21:29:20.185571] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T21:29:20.326860] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-25T21:29:20.688733] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-25T21:29:21.488819] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-25T21:29:22.288813] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-25T21:29:22.532742] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T21:29:22.687187] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-25T21:29:22.733794] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T21:29:23.088784] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-25T21:29:23.888802] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-25T21:29:24.257759] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T21:29:24.688697] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-25T21:29:25.030085] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T21:29:25.488736] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-25T21:29:26.288691] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-25T21:29:26.826068] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-25T21:29:26.913088] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T21:29:27.088698] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-25T21:29:27.281434] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T21:29:27.474955] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-25T21:29:27.476150] [INFO ] [REMOTE ] STXV: Full fetch complete (2619 records). [2025-09-25T21:29:27.476224] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-25T21:29:27.860811] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-25T21:29:27.860939] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-25T21:29:27.861082] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-25T21:29:27.861124] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-25T21:29:27.861481] [DEBUG] [LOCAL ] STXV: Trimmed 2619 records to 1645 (keeping 200 days of data) [2025-09-25T21:29:27.873163] [DEBUG] [LOCAL ] STXV: Primary data saved (1645 records). [2025-09-25T21:29:27.873227] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-25T21:29:27.873352] [INFO ] [MAIN ] Update Progress: 2027/2372 symbols completed. STXV took 26.2s. Estimated remaining: 45m 51s. Rate: 7.5 symbols/min [2025-09-25T21:29:27.889081] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-25T21:29:28.057244] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:28.132033] [DEBUG] [LOCAL ] SUN: Loaded 37364 existing records from primary storage. [2025-09-25T21:29:28.132231] [INFO ] [MAIN ] SUN: Loaded 37364 existing records. [2025-09-25T21:29:28.325147] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:28.325474] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-25T21:29:28.325536] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-25T21:29:28.328455] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-25T21:29:28.328541] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-25T21:29:28.703406] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:28.697831] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-25T21:29:29.488744] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-25T21:29:29.836070] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T21:29:30.288747] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-25T21:29:30.833137] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-25T21:29:31.051455] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:29:31.088673] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-25T21:29:31.888720] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-25T21:29:32.297128] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:29:32.639685] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:29:32.688687] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-25T21:29:33.488710] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-25T21:29:33.746070] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T21:29:34.138215] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T21:29:34.288738] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-25T21:29:34.775577] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T21:29:35.088744] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-25T21:29:35.844077] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T21:29:35.888703] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-25T21:29:36.510288] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T21:29:36.688729] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-25T21:29:37.079637] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-25T21:29:37.488718] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-25T21:29:38.293820] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-25T21:29:38.314692] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T21:29:38.889779] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T21:29:39.088739] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-25T21:29:39.888736] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-25T21:29:40.450489] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-25T21:29:40.688713] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-25T21:29:40.748739] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T21:29:41.133439] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T21:29:41.488733] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-25T21:29:42.288753] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-25T21:29:42.828477] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-25T21:29:42.907583] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T21:29:43.088734] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-25T21:29:43.766472] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:29:43.888744] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-25T21:29:44.688877] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-25T21:29:45.301036] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-25T21:29:45.488708] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-25T21:29:45.788678] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T21:29:46.208354] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:29:46.288717] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-25T21:29:47.093856] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-25T21:29:47.112322] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T21:29:47.683145] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T21:29:47.888746] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-25T21:29:48.688732] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-25T21:29:48.886300] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T21:29:49.488742] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-25T21:29:50.063266] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-25T21:29:50.076778] [INFO ] [REMOTE ] STZ: Full fetch complete (75785 records). [2025-09-25T21:29:50.077079] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-25T21:29:50.291779] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-25T21:29:50.501036] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T21:29:50.649362] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-25T21:29:50.649493] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-25T21:29:50.651310] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-25T21:29:50.651495] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-25T21:29:50.653764] [DEBUG] [LOCAL ] STZ: Trimmed 75785 records to 52652 (keeping 200 days of data) [2025-09-25T21:29:50.951960] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T21:29:50.971816] [INFO ] [REMOTE ] SU: Full fetch complete (77396 records). [2025-09-25T21:29:50.974148] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-25T21:29:51.090753] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-25T21:29:51.467209] [DEBUG] [LOCAL ] STZ: Primary data saved (52652 records). [2025-09-25T21:29:51.467482] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-25T21:29:51.467796] [INFO ] [MAIN ] Update Progress: 2028/2372 symbols completed. STZ took 46.0s. Estimated remaining: 45m 46s. Rate: 7.5 symbols/min [2025-09-25T21:29:51.631805] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-25T21:29:51.631950] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-25T21:29:51.633666] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-25T21:29:51.633783] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-25T21:29:51.651663] [DEBUG] [LOCAL ] SU: Trimmed 77396 records to 53845 (keeping 200 days of data) [2025-09-25T21:29:52.036811] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T21:29:52.089191] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-25T21:29:52.137106] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:52.279368] [DEBUG] [LOCAL ] SUPV: Loaded 47192 existing records from primary storage. [2025-09-25T21:29:52.280203] [INFO ] [MAIN ] SUPV: Loaded 47192 existing records. [2025-09-25T21:29:52.372995] [DEBUG] [LOCAL ] SU: Primary data saved (53845 records). [2025-09-25T21:29:52.373165] [INFO ] [MAIN ] SU: Full history saved. [2025-09-25T21:29:52.374927] [INFO ] [MAIN ] Update Progress: 2029/2372 symbols completed. SU took 34.7s. Estimated remaining: 45m 37s. Rate: 7.5 symbols/min [2025-09-25T21:29:52.683796] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:52.691271] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-25T21:29:52.691422] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-25T21:29:52.705877] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-25T21:29:52.706082] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-25T21:29:52.859220] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T21:29:52.876290] [INFO ] [REMOTE ] SUN: Full fetch complete (54521 records). [2025-09-25T21:29:52.876522] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-25T21:29:52.850551] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:53.279034] [DEBUG] [LOCAL ] SUZ: Loaded 45789 existing records from primary storage. [2025-09-25T21:29:53.279275] [INFO ] [MAIN ] SUZ: Loaded 45789 existing records. [2025-09-25T21:29:53.810149] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:53.810704] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-25T21:29:53.874707] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:53.875066] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-25T21:29:53.875128] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-25T21:29:53.875425] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-25T21:29:53.875485] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-25T21:29:53.971388] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-25T21:29:54.054457] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-25T21:29:54.086620] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-25T21:29:54.086767] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-25T21:29:54.088628] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-25T21:29:54.088729] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-25T21:29:54.102400] [DEBUG] [LOCAL ] SUN: Trimmed 54521 records to 37657 (keeping 200 days of data) [2025-09-25T21:29:54.636243] [DEBUG] [LOCAL ] SUN: Primary data saved (37657 records). [2025-09-25T21:29:54.636524] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-25T21:29:54.636796] [INFO ] [MAIN ] Update Progress: 2030/2372 symbols completed. SUN took 26.8s. Estimated remaining: 45m 28s. Rate: 7.5 symbols/min [2025-09-25T21:29:54.794473] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:54.814626] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-25T21:29:54.894317] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:29:54.952901] [DEBUG] [LOCAL ] SVV: Loaded 39502 existing records from primary storage. [2025-09-25T21:29:54.953117] [INFO ] [MAIN ] SVV: Loaded 39502 existing records. [2025-09-25T21:29:55.152963] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:29:55.153627] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-25T21:29:55.153742] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-25T21:29:55.154224] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-25T21:29:55.154288] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-25T21:29:55.546625] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:29:55.547051] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-25T21:29:55.607445] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:29:55.693390] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:29:55.888750] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-25T21:29:56.641271] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T21:29:56.699851] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-25T21:29:56.715607] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T21:29:57.488752] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-25T21:29:57.650242] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:29:58.288791] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-25T21:29:58.356476] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T21:29:58.458232] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-25T21:29:59.088740] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-25T21:29:59.888789] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-25T21:29:59.945964] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T21:29:59.964281] [INFO ] [REMOTE ] SUI: Full fetch complete (61057 records). [2025-09-25T21:29:59.964592] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-25T21:30:00.475299] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T21:30:00.486375] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-25T21:30:00.486515] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-25T21:30:00.488425] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-25T21:30:00.488493] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-25T21:30:00.490275] [DEBUG] [LOCAL ] SUI: Trimmed 61057 records to 42259 (keeping 200 days of data) [2025-09-25T21:30:00.703629] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-25T21:30:00.795605] [DEBUG] [LOCAL ] SUI: Primary data saved (42259 records). [2025-09-25T21:30:00.798839] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-25T21:30:00.799021] [INFO ] [MAIN ] Update Progress: 2031/2372 symbols completed. SUI took 42.6s. Estimated remaining: 45m 20s. Rate: 7.5 symbols/min [2025-09-25T21:30:00.980359] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:01.050759] [DEBUG] [LOCAL ] SW: Loaded 53161 existing records from primary storage. [2025-09-25T21:30:01.050921] [INFO ] [MAIN ] SW: Loaded 53161 existing records. [2025-09-25T21:30:01.258278] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:01.259603] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-25T21:30:01.259701] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-25T21:30:01.259993] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-25T21:30:01.260067] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-25T21:30:01.494264] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-25T21:30:01.528919] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:30:01.719902] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:02.288690] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-25T21:30:02.403098] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T21:30:03.088715] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-25T21:30:03.138296] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:30:03.888702] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-25T21:30:03.927115] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T21:30:04.688742] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-25T21:30:04.913182] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T21:30:05.488696] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-25T21:30:05.685708] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T21:30:06.023150] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T21:30:06.288726] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-25T21:30:07.088727] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-25T21:30:07.178740] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T21:30:07.888716] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-25T21:30:08.047836] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:30:08.586534] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:30:08.688724] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-25T21:30:09.488798] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-25T21:30:09.741149] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T21:30:10.288737] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-25T21:30:10.433016] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:30:10.821313] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-25T21:30:11.088776] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-25T21:30:11.833249] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-25T21:30:11.888765] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-25T21:30:12.294562] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T21:30:12.688741] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-25T21:30:12.774622] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-25T21:30:13.488761] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-25T21:30:14.288702] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-25T21:30:14.451275] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-25T21:30:15.088747] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-25T21:30:15.484224] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T21:30:15.715173] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T21:30:15.888717] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-25T21:30:16.509141] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T21:30:16.688726] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-25T21:30:17.441585] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-25T21:30:17.488743] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-25T21:30:18.288692] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-25T21:30:18.398440] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:30:18.705718] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T21:30:19.088753] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-25T21:30:19.888750] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-25T21:30:19.946883] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T21:30:19.958783] [INFO ] [REMOTE ] SVV: Full fetch complete (55931 records). [2025-09-25T21:30:19.959004] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-25T21:30:20.401511] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-25T21:30:20.401637] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-25T21:30:20.402930] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-25T21:30:20.403000] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-25T21:30:20.404477] [DEBUG] [LOCAL ] SVV: Trimmed 55931 records to 39864 (keeping 200 days of data) [2025-09-25T21:30:20.670926] [DEBUG] [LOCAL ] SVV: Primary data saved (39864 records). [2025-09-25T21:30:20.671096] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-25T21:30:20.671204] [INFO ] [MAIN ] Update Progress: 2032/2372 symbols completed. SVV took 26.0s. Estimated remaining: 45m 14s. Rate: 7.5 symbols/min [2025-09-25T21:30:20.693592] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-25T21:30:20.770710] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T21:30:20.938444] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:20.995761] [DEBUG] [LOCAL ] SWK: Loaded 52442 existing records from primary storage. [2025-09-25T21:30:20.995927] [INFO ] [MAIN ] SWK: Loaded 52442 existing records. [2025-09-25T21:30:21.208611] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:21.208932] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-25T21:30:21.208982] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-25T21:30:21.209450] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-25T21:30:21.209513] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-25T21:30:21.443738] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T21:30:21.469300] [INFO ] [REMOTE ] SUZ: Full fetch complete (66957 records). [2025-09-25T21:30:21.469490] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-25T21:30:21.500188] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-25T21:30:21.919179] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:22.148517] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:30:22.206076] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-25T21:30:22.206184] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-25T21:30:22.208043] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-25T21:30:22.208127] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-25T21:30:22.209801] [DEBUG] [LOCAL ] SUZ: Trimmed 66957 records to 46114 (keeping 200 days of data) [2025-09-25T21:30:22.313993] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-25T21:30:22.524523] [DEBUG] [LOCAL ] SUZ: Primary data saved (46114 records). [2025-09-25T21:30:22.524736] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-25T21:30:22.524853] [INFO ] [MAIN ] Update Progress: 2033/2372 symbols completed. SUZ took 30.1s. Estimated remaining: 45m 5s. Rate: 7.5 symbols/min [2025-09-25T21:30:22.710798] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:22.764325] [DEBUG] [LOCAL ] SWX: Loaded 31294 existing records from primary storage. [2025-09-25T21:30:22.764535] [INFO ] [MAIN ] SWX: Loaded 31294 existing records. [2025-09-25T21:30:22.993815] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:22.994161] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-25T21:30:22.994272] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-25T21:30:22.994615] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-25T21:30:22.995128] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-25T21:30:23.088736] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-25T21:30:23.210882] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:30:23.441289] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:23.888721] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-25T21:30:24.138629] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T21:30:24.504276] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T21:30:24.688761] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-25T21:30:25.129332] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T21:30:25.488741] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-25T21:30:26.187049] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T21:30:26.288698] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-25T21:30:27.088749] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-25T21:30:27.452987] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T21:30:27.888700] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-25T21:30:28.076168] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T21:30:28.464501] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T21:30:28.477060] [INFO ] [REMOTE ] SUPV: Full fetch complete (68208 records). [2025-09-25T21:30:28.477208] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-25T21:30:28.695840] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-25T21:30:28.958673] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-25T21:30:28.958788] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-25T21:30:28.960661] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-25T21:30:28.960778] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-25T21:30:28.962472] [DEBUG] [LOCAL ] SUPV: Trimmed 68208 records to 47575 (keeping 200 days of data) [2025-09-25T21:30:29.313531] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T21:30:29.354356] [DEBUG] [LOCAL ] SUPV: Primary data saved (47575 records). [2025-09-25T21:30:29.354538] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-25T21:30:29.357720] [INFO ] [MAIN ] Update Progress: 2034/2372 symbols completed. SUPV took 37.9s. Estimated remaining: 44m 56s. Rate: 7.5 symbols/min [2025-09-25T21:30:29.494813] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-25T21:30:29.558784] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:29.576760] [DEBUG] [LOCAL ] SWZ: Loaded 6023 existing records from primary storage. [2025-09-25T21:30:29.576889] [INFO ] [MAIN ] SWZ: Loaded 6023 existing records. [2025-09-25T21:30:29.775146] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:29.775839] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-25T21:30:29.775908] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-25T21:30:29.776233] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-25T21:30:29.776304] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-25T21:30:30.181631] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:30.288790] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-25T21:30:30.655603] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-25T21:30:30.729159] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T21:30:31.088737] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-25T21:30:31.888733] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-25T21:30:32.200848] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T21:30:32.485227] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-25T21:30:32.552453] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T21:30:32.564202] [INFO ] [REMOTE ] SW: Full fetch complete (76746 records). [2025-09-25T21:30:32.564483] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-25T21:30:32.688683] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-25T21:30:33.020826] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-25T21:30:33.020933] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-25T21:30:33.022361] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-25T21:30:33.022451] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-25T21:30:33.026169] [DEBUG] [LOCAL ] SW: Trimmed 76746 records to 53551 (keeping 200 days of data) [2025-09-25T21:30:33.330950] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-25T21:30:33.419138] [DEBUG] [LOCAL ] SW: Primary data saved (53551 records). [2025-09-25T21:30:33.419322] [INFO ] [MAIN ] SW: Full history saved. [2025-09-25T21:30:33.419509] [INFO ] [MAIN ] Update Progress: 2035/2372 symbols completed. SW took 32.6s. Estimated remaining: 44m 48s. Rate: 7.5 symbols/min [2025-09-25T21:30:33.493913] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-25T21:30:33.619544] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:33.676498] [DEBUG] [LOCAL ] SXC: Loaded 41571 existing records from primary storage. [2025-09-25T21:30:33.676718] [INFO ] [MAIN ] SXC: Loaded 41571 existing records. [2025-09-25T21:30:33.869601] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:33.870047] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-25T21:30:33.870098] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-25T21:30:33.870558] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-25T21:30:33.870618] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-25T21:30:34.238032] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:34.288683] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-25T21:30:34.906465] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T21:30:35.088723] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-25T21:30:35.660068] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-25T21:30:35.888784] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-25T21:30:36.688803] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-25T21:30:37.073512] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T21:30:37.234619] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T21:30:37.294907] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T21:30:37.488747] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-25T21:30:38.288901] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-25T21:30:39.006872] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-25T21:30:39.082386] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:30:39.090135] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-25T21:30:39.888776] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-25T21:30:39.986553] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T21:30:40.688749] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-25T21:30:41.389008] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T21:30:41.488724] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-25T21:30:42.118679] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:30:42.288716] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-25T21:30:42.716992] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T21:30:43.088800] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-25T21:30:43.329012] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T21:30:43.631162] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-25T21:30:43.888723] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-25T21:30:44.547766] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-25T21:30:44.688737] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-25T21:30:45.488778] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-25T21:30:46.288700] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-25T21:30:46.466096] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T21:30:46.514177] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T21:30:47.088720] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-25T21:30:47.322401] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T21:30:47.494806] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-25T21:30:47.496233] [INFO ] [REMOTE ] SWZ: Full fetch complete (8088 records). [2025-09-25T21:30:47.496371] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-25T21:30:47.889827] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-25T21:30:47.906207] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-25T21:30:47.906314] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-25T21:30:47.906715] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-25T21:30:47.906812] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-25T21:30:47.907277] [DEBUG] [LOCAL ] SWZ: Trimmed 8088 records to 6042 (keeping 200 days of data) [2025-09-25T21:30:47.952350] [DEBUG] [LOCAL ] SWZ: Primary data saved (6042 records). [2025-09-25T21:30:47.952492] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-25T21:30:47.952725] [INFO ] [MAIN ] Update Progress: 2036/2372 symbols completed. SWZ took 18.6s. Estimated remaining: 44m 41s. Rate: 7.5 symbols/min [2025-09-25T21:30:48.132387] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:30:48.151000] [DEBUG] [LOCAL ] SXI: Loaded 11540 existing records from primary storage. [2025-09-25T21:30:48.151152] [INFO ] [MAIN ] SXI: Loaded 11540 existing records. [2025-09-25T21:30:48.338166] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:30:48.338589] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-25T21:30:48.338907] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-25T21:30:48.339207] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-25T21:30:48.339285] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-25T21:30:48.694750] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-25T21:30:48.725907] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:30:49.381411] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T21:30:49.488730] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-25T21:30:49.951605] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T21:30:49.980941] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T21:30:50.288739] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-25T21:30:51.084375] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T21:30:51.088586] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-25T21:30:51.888723] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-25T21:30:51.902939] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T21:30:52.688743] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-25T21:30:53.488729] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-25T21:30:53.610845] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T21:30:53.947746] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-25T21:30:54.288723] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-25T21:30:55.088740] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-25T21:30:55.229517] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T21:30:55.362357] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T21:30:55.888727] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-25T21:30:56.057870] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T21:30:56.065981] [INFO ] [REMOTE ] SWX: Full fetch complete (43799 records). [2025-09-25T21:30:56.066095] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-25T21:30:56.513878] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-25T21:30:56.513987] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-25T21:30:56.515234] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-25T21:30:56.515303] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-25T21:30:56.519570] [DEBUG] [LOCAL ] SWX: Trimmed 43799 records to 31496 (keeping 200 days of data) [2025-09-25T21:30:56.715396] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-25T21:30:56.768984] [DEBUG] [LOCAL ] SWX: Primary data saved (31496 records). [2025-09-25T21:30:56.769172] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-25T21:30:56.769338] [INFO ] [MAIN ] Update Progress: 2037/2372 symbols completed. SWX took 34.2s. Estimated remaining: 44m 33s. Rate: 7.5 symbols/min [2025-09-25T21:30:57.292288] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-25T21:30:57.347123] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T21:30:57.488738] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-25T21:30:58.288751] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-25T21:30:59.088736] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-25T21:30:59.230876] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-25T21:30:59.251612] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T21:30:59.888725] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-25T21:31:00.646082] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T21:31:00.688685] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-25T21:31:00.952091] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-25T21:31:00.962783] [INFO ] [REMOTE ] SWK: Full fetch complete (75364 records). [2025-09-25T21:31:00.962999] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-25T21:31:01.451054] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-25T21:31:01.451163] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-25T21:31:01.452539] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-25T21:31:01.452616] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-25T21:31:01.455969] [DEBUG] [LOCAL ] SWK: Trimmed 75364 records to 52803 (keeping 200 days of data) [2025-09-25T21:31:01.529719] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-25T21:31:01.594834] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T21:31:01.895985] [DEBUG] [LOCAL ] SWK: Primary data saved (52803 records). [2025-09-25T21:31:01.896139] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-25T21:31:01.897488] [INFO ] [MAIN ] Update Progress: 2038/2372 symbols completed. SWK took 41.2s. Estimated remaining: 44m 25s. Rate: 7.5 symbols/min [2025-09-25T21:31:02.288741] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-25T21:31:03.151330] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-25T21:31:03.155682] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-25T21:31:03.200691] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T21:31:03.888706] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-25T21:31:04.084863] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T21:31:04.688740] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-25T21:31:05.132755] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T21:31:05.141501] [INFO ] [REMOTE ] SXC: Full fetch complete (61267 records). [2025-09-25T21:31:05.141723] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-25T21:31:05.311786] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T21:31:05.493830] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-25T21:31:05.577163] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-25T21:31:05.577271] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-25T21:31:05.578784] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-25T21:31:05.578855] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-25T21:31:05.580421] [DEBUG] [LOCAL ] SXC: Trimmed 61267 records to 41877 (keeping 200 days of data) [2025-09-25T21:31:05.857996] [DEBUG] [LOCAL ] SXC: Primary data saved (41877 records). [2025-09-25T21:31:05.858144] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-25T21:31:05.858325] [INFO ] [MAIN ] Update Progress: 2039/2372 symbols completed. SXC took 32.4s. Estimated remaining: 44m 16s. Rate: 7.5 symbols/min [2025-09-25T21:31:06.406286] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T21:31:06.409390] [INFO ] [REMOTE ] SXI: Full fetch complete (14626 records). [2025-09-25T21:31:06.409467] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-25T21:31:06.816228] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-25T21:31:06.816318] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-25T21:31:06.816772] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-25T21:31:06.816838] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-25T21:31:06.817431] [DEBUG] [LOCAL ] SXI: Trimmed 14626 records to 11616 (keeping 200 days of data) [2025-09-25T21:31:06.906726] [DEBUG] [LOCAL ] SXI: Primary data saved (11616 records). [2025-09-25T21:31:06.906901] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-25T21:31:06.906999] [INFO ] [MAIN ] Update Progress: 2040/2372 symbols completed. SXI took 19.0s. Estimated remaining: 44m 7s. Rate: 7.5 symbols/min [2025-09-25T21:31:07.576745] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:07.683725] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:07.735095] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:07.809398] [DEBUG] [LOCAL ] SXT: Loaded 29113 existing records from primary storage. [2025-09-25T21:31:07.809567] [INFO ] [MAIN ] SXT: Loaded 29113 existing records. [2025-09-25T21:31:07.839229] [DEBUG] [LOCAL ] SYY: Loaded 53233 existing records from primary storage. [2025-09-25T21:31:07.839420] [INFO ] [MAIN ] SYY: Loaded 53233 existing records. [2025-09-25T21:31:07.835970] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:08.211566] [DEBUG] [LOCAL ] SYF: Loaded 53454 existing records from primary storage. [2025-09-25T21:31:08.248991] [INFO ] [MAIN ] SYF: Loaded 53454 existing records. [2025-09-25T21:31:08.243582] [DEBUG] [LOCAL ] SYK: Loaded 47045 existing records from primary storage. [2025-09-25T21:31:08.255113] [INFO ] [MAIN ] SYK: Loaded 47045 existing records. [2025-09-25T21:31:08.346614] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:08.346972] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-25T21:31:08.347024] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-25T21:31:08.347345] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-25T21:31:08.347405] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-25T21:31:08.706325] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:08.712359] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-25T21:31:08.712490] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-25T21:31:08.739570] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-25T21:31:08.874398] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-25T21:31:09.041970] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:09.048009] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-25T21:31:09.048071] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-25T21:31:09.048460] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-25T21:31:09.065229] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-25T21:31:09.270139] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:09.278411] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-25T21:31:09.278466] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-25T21:31:09.288364] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-25T21:31:09.288630] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-25T21:31:10.211330] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:10.211773] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-25T21:31:10.595826] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:10.599092] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-25T21:31:10.652628] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:10.653082] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-25T21:31:10.659364] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:10.660023] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-25T21:31:11.364430] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T21:31:11.368633] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-25T21:31:12.420316] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T21:31:12.432110] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-25T21:31:12.534361] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T21:31:12.548154] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-25T21:31:12.573030] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T21:31:12.578936] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-25T21:31:12.621025] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T21:31:12.688781] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-25T21:31:13.481864] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-25T21:31:13.488995] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-25T21:31:14.060193] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T21:31:14.151729] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-25T21:31:14.288740] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-25T21:31:14.465068] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T21:31:14.525761] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T21:31:15.088787] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-25T21:31:15.888757] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-25T21:31:16.055366] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:31:16.688879] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-25T21:31:17.071414] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T21:31:17.335700] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T21:31:17.488840] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-25T21:31:18.288712] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-25T21:31:18.361995] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:31:19.088725] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-25T21:31:19.469120] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T21:31:19.888733] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-25T21:31:20.057441] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:31:20.130461] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T21:31:20.688749] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-25T21:31:21.488743] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-25T21:31:21.926523] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-25T21:31:21.965334] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T21:31:22.288768] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-25T21:31:23.088709] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-25T21:31:23.379444] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T21:31:23.829602] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T21:31:23.888719] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-25T21:31:24.688772] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-25T21:31:25.010716] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T21:31:25.247760] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T21:31:25.488748] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-25T21:31:26.238934] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T21:31:26.288673] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-25T21:31:27.088701] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-25T21:31:27.289814] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T21:31:27.888742] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-25T21:31:28.041223] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T21:31:28.688734] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-25T21:31:29.079592] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T21:31:29.488714] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-25T21:31:29.584661] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T21:31:30.135971] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:31:30.288779] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-25T21:31:30.456434] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T21:31:30.462876] [INFO ] [REMOTE ] SXT: Full fetch complete (37923 records). [2025-09-25T21:31:30.463132] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-25T21:31:30.867330] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-25T21:31:30.867455] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-25T21:31:30.869551] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-25T21:31:30.869696] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-25T21:31:30.871259] [DEBUG] [LOCAL ] SXT: Trimmed 37923 records to 29329 (keeping 200 days of data) [2025-09-25T21:31:31.084425] [DEBUG] [LOCAL ] SXT: Primary data saved (29329 records). [2025-09-25T21:31:31.084580] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-25T21:31:31.084821] [INFO ] [MAIN ] Update Progress: 2041/2372 symbols completed. SXT took 24.2s. Estimated remaining: 44m 2s. Rate: 7.5 symbols/min [2025-09-25T21:31:31.090483] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-25T21:31:31.267261] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:31.330269] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-25T21:31:31.330446] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-25T21:31:31.517341] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:31.517772] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-25T21:31:31.517849] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-25T21:31:31.518674] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-25T21:31:31.518766] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-25T21:31:31.906033] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-25T21:31:31.913663] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:32.104039] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-25T21:31:32.688695] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-25T21:31:32.867999] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:31:33.416579] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T21:31:33.488677] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-25T21:31:34.288764] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-25T21:31:35.088699] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-25T21:31:35.202281] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-25T21:31:35.233527] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-25T21:31:35.243277] [INFO ] [REMOTE ] SYK: Full fetch complete (68780 records). [2025-09-25T21:31:35.243476] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-25T21:31:35.665995] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-25T21:31:35.666103] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-25T21:31:35.667544] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-25T21:31:35.667614] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-25T21:31:35.669567] [DEBUG] [LOCAL ] SYK: Trimmed 68780 records to 47405 (keeping 200 days of data) [2025-09-25T21:31:35.827435] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T21:31:35.922201] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-25T21:31:36.064538] [DEBUG] [LOCAL ] SYK: Primary data saved (47405 records). [2025-09-25T21:31:36.064787] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-25T21:31:36.064986] [INFO ] [MAIN ] Update Progress: 2042/2372 symbols completed. SYK took 29.1s. Estimated remaining: 43m 53s. Rate: 7.5 symbols/min [2025-09-25T21:31:36.243499] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:36.298790] [DEBUG] [LOCAL ] TAC: Loaded 42852 existing records from primary storage. [2025-09-25T21:31:36.298992] [INFO ] [MAIN ] TAC: Loaded 42852 existing records. [2025-09-25T21:31:36.482842] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:36.483313] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-25T21:31:36.483377] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-25T21:31:36.483964] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-25T21:31:36.484050] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-25T21:31:36.693767] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-25T21:31:36.925772] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:36.986495] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T21:31:37.488727] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-25T21:31:37.687544] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T21:31:37.701630] [INFO ] [REMOTE ] SYF: Full fetch complete (77332 records). [2025-09-25T21:31:37.701853] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-25T21:31:38.095769] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-25T21:31:38.095875] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-25T21:31:38.097189] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-25T21:31:38.097265] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-25T21:31:38.099134] [DEBUG] [LOCAL ] SYF: Trimmed 77332 records to 53840 (keeping 200 days of data) [2025-09-25T21:31:38.297515] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-25T21:31:38.462043] [DEBUG] [LOCAL ] SYF: Primary data saved (53840 records). [2025-09-25T21:31:38.462268] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-25T21:31:38.463528] [INFO ] [MAIN ] Update Progress: 2043/2372 symbols completed. SYF took 31.5s. Estimated remaining: 43m 44s. Rate: 7.5 symbols/min [2025-09-25T21:31:38.640420] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:38.706123] [DEBUG] [LOCAL ] TAK: Loaded 49852 existing records from primary storage. [2025-09-25T21:31:38.706283] [INFO ] [MAIN ] TAK: Loaded 49852 existing records. [2025-09-25T21:31:38.895182] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:38.895574] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-25T21:31:38.895630] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-25T21:31:38.895958] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-25T21:31:38.896019] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-25T21:31:39.305998] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:39.306405] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-25T21:31:39.463111] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T21:31:39.526543] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-25T21:31:39.888696] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-25T21:31:39.999189] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:31:40.688735] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-25T21:31:41.161893] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T21:31:41.488845] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-25T21:31:41.748705] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T21:31:42.288735] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-25T21:31:42.473026] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-25T21:31:43.094722] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-25T21:31:43.118610] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T21:31:43.888758] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-25T21:31:44.624996] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-25T21:31:44.688752] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-25T21:31:44.796949] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T21:31:45.079109] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T21:31:45.488715] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-25T21:31:46.288730] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-25T21:31:47.088729] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-25T21:31:47.171810] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-25T21:31:47.214202] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-25T21:31:47.888738] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-25T21:31:48.103543] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T21:31:48.121819] [INFO ] [REMOTE ] SYY: Full fetch complete (76971 records). [2025-09-25T21:31:48.122067] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-25T21:31:48.694804] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-25T21:31:48.730879] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-25T21:31:48.730974] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-25T21:31:48.732395] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-25T21:31:48.732459] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-25T21:31:48.737317] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:31:48.750188] [DEBUG] [LOCAL ] SYY: Trimmed 76971 records to 53623 (keeping 200 days of data) [2025-09-25T21:31:49.132536] [DEBUG] [LOCAL ] SYY: Primary data saved (53623 records). [2025-09-25T21:31:49.132722] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-25T21:31:49.132893] [INFO ] [MAIN ] Update Progress: 2044/2372 symbols completed. SYY took 42.2s. Estimated remaining: 43m 37s. Rate: 7.5 symbols/min [2025-09-25T21:31:49.326612] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:31:49.400712] [DEBUG] [LOCAL ] TAL: Loaded 52104 existing records from primary storage. [2025-09-25T21:31:49.400873] [INFO ] [MAIN ] TAL: Loaded 52104 existing records. [2025-09-25T21:31:49.490531] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-25T21:31:49.559928] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:31:49.650968] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:31:49.652146] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-25T21:31:49.652199] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-25T21:31:49.652534] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-25T21:31:49.652597] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-25T21:31:50.036094] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:31:50.288731] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-25T21:31:51.088699] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-25T21:31:51.222912] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:31:51.277935] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-25T21:31:51.888711] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-25T21:31:52.113066] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-25T21:31:52.678147] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T21:31:52.688788] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-25T21:31:53.488800] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-25T21:31:54.160682] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T21:31:54.288728] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-25T21:31:54.474589] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-09-25T21:31:55.068023] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:31:55.088684] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-25T21:31:55.888829] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-25T21:31:55.974112] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T21:31:56.688731] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-25T21:31:56.891070] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-25T21:31:57.488802] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-25T21:31:58.010531] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T21:31:58.294742] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-25T21:31:58.309979] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T21:31:59.088747] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-25T21:31:59.358500] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T21:31:59.863141] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T21:31:59.888723] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-25T21:32:00.177470] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T21:32:00.191884] [INFO ] [REMOTE ] TAC: Full fetch complete (64199 records). [2025-09-25T21:32:00.192097] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-25T21:32:00.640126] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-25T21:32:00.640247] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-25T21:32:00.641689] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-25T21:32:00.641839] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-25T21:32:00.643729] [DEBUG] [LOCAL ] TAC: Trimmed 64199 records to 43179 (keeping 200 days of data) [2025-09-25T21:32:00.717469] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-25T21:32:00.944285] [DEBUG] [LOCAL ] TAC: Primary data saved (43179 records). [2025-09-25T21:32:00.944444] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-25T21:32:00.945612] [INFO ] [MAIN ] Update Progress: 2045/2372 symbols completed. TAC took 24.9s. Estimated remaining: 43m 29s. Rate: 7.5 symbols/min [2025-09-25T21:32:01.195275] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:01.266814] [DEBUG] [LOCAL ] TALO: Loaded 50834 existing records from primary storage. [2025-09-25T21:32:01.267040] [INFO ] [MAIN ] TALO: Loaded 50834 existing records. [2025-09-25T21:32:01.488692] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:01.489262] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-25T21:32:01.489324] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-25T21:32:01.489742] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-25T21:32:01.492682] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-25T21:32:01.492803] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-25T21:32:01.652464] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T21:32:01.969903] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:02.288817] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-25T21:32:03.088720] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-25T21:32:03.436831] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-25T21:32:03.483913] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T21:32:03.888734] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-25T21:32:04.144797] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T21:32:04.688709] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-25T21:32:04.765221] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T21:32:05.488704] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-25T21:32:05.936885] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T21:32:06.288810] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-25T21:32:06.585424] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T21:32:06.759708] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T21:32:07.088762] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-25T21:32:07.888737] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-25T21:32:08.689427] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-25T21:32:08.703367] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-25T21:32:08.754243] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:32:09.488740] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-25T21:32:09.750557] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:32:10.244869] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:32:10.258039] [INFO ] [REMOTE ] T: Full fetch complete (77935 records). [2025-09-25T21:32:10.258193] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-25T21:32:10.293720] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-25T21:32:10.635211] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T21:32:10.650094] [INFO ] [REMOTE ] TAK: Full fetch complete (71473 records). [2025-09-25T21:32:10.650316] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-25T21:32:10.939138] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-25T21:32:10.939282] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-25T21:32:10.940951] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-25T21:32:10.941064] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-25T21:32:10.980110] [DEBUG] [LOCAL ] T: Trimmed 77935 records to 54188 (keeping 200 days of data) [2025-09-25T21:32:11.092981] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-25T21:32:11.521033] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-25T21:32:11.521125] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-25T21:32:11.522473] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-25T21:32:11.522547] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-25T21:32:11.527370] [DEBUG] [LOCAL ] TAK: Trimmed 71473 records to 50211 (keeping 200 days of data) [2025-09-25T21:32:11.796209] [DEBUG] [LOCAL ] T: Primary data saved (54188 records). [2025-09-25T21:32:11.796406] [INFO ] [MAIN ] T: Full history saved. [2025-09-25T21:32:11.796562] [INFO ] [MAIN ] Update Progress: 2046/2372 symbols completed. T took 40.7s. Estimated remaining: 43m 22s. Rate: 7.5 symbols/min [2025-09-25T21:32:12.123805] [DEBUG] [LOCAL ] TAK: Primary data saved (50211 records). [2025-09-25T21:32:12.124025] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-25T21:32:12.124208] [INFO ] [MAIN ] Update Progress: 2047/2372 symbols completed. TAK took 33.7s. Estimated remaining: 43m 13s. Rate: 7.5 symbols/min [2025-09-25T21:32:12.383465] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-25T21:32:12.413810] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-25T21:32:12.485165] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:12.528457] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:12.592521] [DEBUG] [LOCAL ] TBB: Loaded 11717 existing records from primary storage. [2025-09-25T21:32:12.592702] [INFO ] [MAIN ] TBB: Loaded 11717 existing records. [2025-09-25T21:32:12.599852] [DEBUG] [LOCAL ] TAP: Loaded 52874 existing records from primary storage. [2025-09-25T21:32:12.599966] [INFO ] [MAIN ] TAP: Loaded 52874 existing records. [2025-09-25T21:32:12.958872] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T21:32:12.981489] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-25T21:32:13.009095] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:13.009440] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-25T21:32:13.009505] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-25T21:32:13.014917] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-25T21:32:13.015008] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-25T21:32:13.060274] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:13.060536] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-25T21:32:13.060588] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-25T21:32:13.064597] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-25T21:32:13.064698] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-25T21:32:13.807877] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:13.808264] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-25T21:32:13.852171] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:14.211037] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-25T21:32:14.288736] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-25T21:32:14.408177] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T21:32:15.088734] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-25T21:32:15.255433] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:32:15.389872] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:32:15.888749] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-25T21:32:16.688769] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-25T21:32:16.834835] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T21:32:17.325341] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T21:32:17.488737] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-25T21:32:17.623729] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-25T21:32:18.288727] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-25T21:32:19.088725] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-25T21:32:19.306151] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T21:32:19.888739] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-25T21:32:20.066226] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T21:32:20.688702] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-25T21:32:20.774681] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:32:20.800587] [INFO ] [REMOTE ] TAL: Full fetch complete (75649 records). [2025-09-25T21:32:20.800843] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-25T21:32:20.815045] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-25T21:32:21.306348] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-25T21:32:21.306446] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-25T21:32:21.307809] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-25T21:32:21.307876] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-25T21:32:21.309636] [DEBUG] [LOCAL ] TAL: Trimmed 75649 records to 52439 (keeping 200 days of data) [2025-09-25T21:32:21.502720] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-25T21:32:21.667369] [DEBUG] [LOCAL ] TAL: Primary data saved (52439 records). [2025-09-25T21:32:21.667518] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-25T21:32:21.667629] [INFO ] [MAIN ] Update Progress: 2048/2372 symbols completed. TAL took 32.5s. Estimated remaining: 43m 5s. Rate: 7.5 symbols/min [2025-09-25T21:32:21.848463] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:21.892291] [DEBUG] [LOCAL ] TBBB: Loaded 35683 existing records from primary storage. [2025-09-25T21:32:21.892441] [INFO ] [MAIN ] TBBB: Loaded 35683 existing records. [2025-09-25T21:32:22.082384] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:22.082752] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-25T21:32:22.082810] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-25T21:32:22.083139] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-25T21:32:22.083201] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-25T21:32:22.309034] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-25T21:32:22.331614] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:32:22.357447] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T21:32:22.549636] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:23.088733] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-25T21:32:23.888700] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-25T21:32:24.356705] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T21:32:24.475868] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T21:32:24.688725] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-25T21:32:24.730331] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T21:32:25.488743] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-25T21:32:26.288709] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-25T21:32:26.434385] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T21:32:26.705764] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-25T21:32:27.088740] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-25T21:32:27.514685] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:32:27.888829] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-25T21:32:28.688700] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-25T21:32:29.116372] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T21:32:29.137162] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T21:32:29.221310] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-25T21:32:29.488731] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-25T21:32:30.288756] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-25T21:32:30.904854] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T21:32:31.088757] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-25T21:32:31.101190] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T21:32:31.888745] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-25T21:32:32.688775] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-25T21:32:32.796638] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-25T21:32:32.915621] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T21:32:33.488725] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-25T21:32:33.887149] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-25T21:32:34.288789] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-25T21:32:34.313853] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T21:32:34.317580] [INFO ] [REMOTE ] TBB: Full fetch complete (17971 records). [2025-09-25T21:32:34.317721] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-25T21:32:34.725134] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-25T21:32:34.725266] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-25T21:32:34.725868] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-25T21:32:34.725987] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-25T21:32:34.726762] [DEBUG] [LOCAL ] TBB: Trimmed 17971 records to 11782 (keeping 200 days of data) [2025-09-25T21:32:34.819063] [DEBUG] [LOCAL ] TBB: Primary data saved (11782 records). [2025-09-25T21:32:34.819225] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-25T21:32:34.819589] [INFO ] [MAIN ] Update Progress: 2049/2372 symbols completed. TBB took 22.7s. Estimated remaining: 42m 58s. Rate: 7.5 symbols/min [2025-09-25T21:32:35.006097] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:35.046482] [DEBUG] [LOCAL ] TBI: Loaded 22593 existing records from primary storage. [2025-09-25T21:32:35.046674] [INFO ] [MAIN ] TBI: Loaded 22593 existing records. [2025-09-25T21:32:35.096196] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-25T21:32:35.242118] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:35.242449] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-25T21:32:35.242509] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-25T21:32:35.243372] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-25T21:32:35.243451] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-25T21:32:35.622225] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:35.852347] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T21:32:35.888813] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-25T21:32:36.688690] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-25T21:32:36.784157] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:32:36.794561] [INFO ] [REMOTE ] TALO: Full fetch complete (73272 records). [2025-09-25T21:32:36.794754] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-25T21:32:37.248446] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-25T21:32:37.248548] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-25T21:32:37.249789] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-25T21:32:37.249860] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-25T21:32:37.253666] [DEBUG] [LOCAL ] TALO: Trimmed 73272 records to 51193 (keeping 200 days of data) [2025-09-25T21:32:37.519112] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-25T21:32:37.699367] [DEBUG] [LOCAL ] TALO: Primary data saved (51193 records). [2025-09-25T21:32:37.699604] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-25T21:32:37.700014] [INFO ] [MAIN ] Update Progress: 2050/2372 symbols completed. TALO took 36.8s. Estimated remaining: 42m 49s. Rate: 7.5 symbols/min [2025-09-25T21:32:38.010953] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:38.011138] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-25T21:32:38.011178] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-25T21:32:38.011639] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-25T21:32:38.011718] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-25T21:32:38.011774] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-25T21:32:38.011809] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-25T21:32:38.056201] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-25T21:32:38.240750] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T21:32:38.288961] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-25T21:32:38.378941] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T21:32:38.520286] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:39.088738] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-25T21:32:39.686633] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-25T21:32:39.781192] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T21:32:39.888752] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-25T21:32:40.257520] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-25T21:32:40.688815] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-25T21:32:41.113376] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-25T21:32:41.488726] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-25T21:32:42.288804] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-25T21:32:43.046336] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T21:32:43.066605] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T21:32:43.088753] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-25T21:32:43.888731] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-25T21:32:44.221478] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:32:44.689636] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-25T21:32:44.693142] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T21:32:45.488744] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-25T21:32:46.039350] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T21:32:46.288699] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-25T21:32:47.088771] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-25T21:32:47.288280] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T21:32:47.301823] [INFO ] [REMOTE ] TAP: Full fetch complete (76155 records). [2025-09-25T21:32:47.302054] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-25T21:32:47.678608] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T21:32:47.697047] [INFO ] [REMOTE ] TBBB: Full fetch complete (51278 records). [2025-09-25T21:32:47.697234] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-25T21:32:47.891428] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-25T21:32:47.994053] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-25T21:32:47.994184] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-25T21:32:47.996623] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-25T21:32:47.996761] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-25T21:32:48.011245] [DEBUG] [LOCAL ] TAP: Trimmed 76155 records to 53263 (keeping 200 days of data) [2025-09-25T21:32:48.251584] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-25T21:32:48.457801] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-25T21:32:48.689570] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-25T21:32:48.730718] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-25T21:32:48.731873] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-25T21:32:48.732950] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-25T21:32:48.733301] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-25T21:32:48.739085] [DEBUG] [LOCAL ] TBBB: Trimmed 51278 records to 35967 (keeping 200 days of data) [2025-09-25T21:32:48.804009] [DEBUG] [LOCAL ] TAP: Primary data saved (53263 records). [2025-09-25T21:32:48.804182] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-25T21:32:48.804345] [INFO ] [MAIN ] Update Progress: 2051/2372 symbols completed. TAP took 37.0s. Estimated remaining: 42m 41s. Rate: 7.5 symbols/min [2025-09-25T21:32:49.141311] [DEBUG] [LOCAL ] TBBB: Primary data saved (35967 records). [2025-09-25T21:32:49.141488] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-25T21:32:49.141702] [INFO ] [MAIN ] Update Progress: 2052/2372 symbols completed. TBBB took 27.5s. Estimated remaining: 42m 32s. Rate: 7.5 symbols/min [2025-09-25T21:32:49.294241] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:49.336355] [DEBUG] [LOCAL ] TBN: Loaded 2982 existing records from primary storage. [2025-09-25T21:32:49.336531] [INFO ] [MAIN ] TBN: Loaded 2982 existing records. [2025-09-25T21:32:49.507808] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-25T21:32:49.544952] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:32:49.545187] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-25T21:32:49.545243] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-25T21:32:49.545405] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-25T21:32:49.545516] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-25T21:32:49.545586] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-25T21:32:49.551477] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-25T21:32:49.657331] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:32:49.657724] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-25T21:32:49.657780] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-25T21:32:49.658140] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-25T21:32:49.658201] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-25T21:32:49.944538] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-25T21:32:50.000455] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T21:32:50.294112] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-25T21:32:50.483234] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:50.493829] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:32:51.088771] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-25T21:32:51.448764] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T21:32:51.704255] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T21:32:51.888771] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-25T21:32:52.113148] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:32:52.113537] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-25T21:32:52.688734] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-25T21:32:52.899248] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:32:52.899636] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-25T21:32:53.488720] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-25T21:32:53.724921] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:32:53.725281] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-25T21:32:54.288721] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-25T21:32:54.505695] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:32:54.505990] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-25T21:32:55.088719] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-25T21:32:55.563834] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-25T21:32:55.888743] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-25T21:32:56.512799] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T21:32:56.688738] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-25T21:32:57.031249] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-25T21:32:57.488736] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-25T21:32:58.288746] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-25T21:32:58.475152] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T21:32:58.635821] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-25T21:32:59.088716] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-25T21:32:59.296808] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:32:59.297168] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-25T21:32:59.888718] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-25T21:33:00.241892] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-25T21:33:00.688722] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-25T21:33:01.091817] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-25T21:33:01.092639] [INFO ] [REMOTE ] TBLU: Full fetch complete (1171 records). [2025-09-25T21:33:01.092744] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-25T21:33:01.283211] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T21:33:01.283509] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:33:01.283601] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:33:01.283721] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-25T21:33:01.283795] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-25T21:33:01.283848] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-25T21:33:01.283932] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-25T21:33:01.284053] [INFO ] [MAIN ] Update Progress: 2053/2372 symbols completed. TBLU took 23.6s. Estimated remaining: 42m 25s. Rate: 7.5 symbols/min [2025-09-25T21:33:01.488825] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-25T21:33:01.491118] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:01.563905] [DEBUG] [LOCAL ] TD: Loaded 52269 existing records from primary storage. [2025-09-25T21:33:01.564580] [INFO ] [MAIN ] TD: Loaded 52269 existing records. [2025-09-25T21:33:01.721181] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:33:01.721559] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-25T21:33:01.765794] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:01.766141] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-25T21:33:01.766188] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-25T21:33:01.766751] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-25T21:33:01.766820] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-25T21:33:02.253831] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:02.288705] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-25T21:33:02.942227] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-25T21:33:03.088738] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-25T21:33:03.888731] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-25T21:33:04.291163] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:33:04.291742] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-25T21:33:04.688736] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-25T21:33:04.889126] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:33:04.889532] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-25T21:33:05.137871] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-25T21:33:05.488705] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-25T21:33:06.288712] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-25T21:33:06.620554] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T21:33:07.088740] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-25T21:33:07.888732] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-25T21:33:08.120992] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T21:33:08.176738] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T21:33:08.562032] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T21:33:08.688761] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-25T21:33:09.488727] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-25T21:33:10.090565] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-25T21:33:10.092583] [INFO ] [REMOTE ] TCAI: Full fetch complete (1042 records). [2025-09-25T21:33:10.092689] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-25T21:33:10.293709] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-25T21:33:10.302388] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 37 unique days, need 200 days [2025-09-25T21:33:10.302566] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:33:10.302613] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:33:10.303691] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-25T21:33:10.303815] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-25T21:33:10.303875] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-25T21:33:10.303938] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-25T21:33:10.304032] [INFO ] [MAIN ] Update Progress: 2054/2372 symbols completed. TCAI took 21.2s. Estimated remaining: 42m 17s. Rate: 7.5 symbols/min [2025-09-25T21:33:10.544318] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T21:33:10.558723] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:10.620691] [DEBUG] [LOCAL ] TDC: Loaded 46847 existing records from primary storage. [2025-09-25T21:33:10.620884] [INFO ] [MAIN ] TDC: Loaded 46847 existing records. [2025-09-25T21:33:10.815973] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:10.816341] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-25T21:33:10.816391] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-25T21:33:10.816720] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-25T21:33:10.816781] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-25T21:33:10.910559] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T21:33:11.093972] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-25T21:33:11.215747] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:11.888825] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-25T21:33:12.688771] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-25T21:33:13.025267] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T21:33:13.031100] [INFO ] [REMOTE ] TBI: Full fetch complete (31810 records). [2025-09-25T21:33:13.031223] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-25T21:33:13.146386] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-25T21:33:13.435093] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-25T21:33:13.493805] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-25T21:33:13.554402] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-25T21:33:13.554547] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-25T21:33:13.555892] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-25T21:33:13.556003] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-25T21:33:13.559164] [DEBUG] [LOCAL ] TBI: Trimmed 31810 records to 22787 (keeping 200 days of data) [2025-09-25T21:33:13.729189] [DEBUG] [LOCAL ] TBI: Primary data saved (22787 records). [2025-09-25T21:33:13.729345] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-25T21:33:13.729507] [INFO ] [MAIN ] Update Progress: 2055/2372 symbols completed. TBI took 38.9s. Estimated remaining: 42m 8s. Rate: 7.5 symbols/min [2025-09-25T21:33:13.935222] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:13.946304] [DEBUG] [LOCAL ] TDF: Loaded 6502 existing records from primary storage. [2025-09-25T21:33:13.946458] [INFO ] [MAIN ] TDF: Loaded 6502 existing records. [2025-09-25T21:33:14.055358] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T21:33:14.152467] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:14.154628] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-25T21:33:14.154735] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-25T21:33:14.155049] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-25T21:33:14.155110] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-25T21:33:14.302520] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-25T21:33:14.557260] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:15.088769] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-25T21:33:15.565890] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-25T21:33:15.888762] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-25T21:33:15.988772] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T21:33:16.511989] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T21:33:16.688728] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-25T21:33:17.488846] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-25T21:33:18.253730] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:33:18.288765] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-25T21:33:18.861518] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-25T21:33:19.043583] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T21:33:19.088752] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-25T21:33:19.682403] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-25T21:33:19.888797] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-25T21:33:20.688849] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-25T21:33:21.488745] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-25T21:33:21.658185] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:33:22.288745] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-25T21:33:22.341846] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:33:22.343784] [INFO ] [REMOTE ] TBN: Full fetch complete (4838 records). [2025-09-25T21:33:22.343912] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-25T21:33:22.629960] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T21:33:22.810025] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-25T21:33:22.810149] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-25T21:33:22.810358] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-25T21:33:22.810484] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-25T21:33:22.811055] [DEBUG] [LOCAL ] TBN: Trimmed 4838 records to 3020 (keeping 200 days of data) [2025-09-25T21:33:22.834501] [DEBUG] [LOCAL ] TBN: Primary data saved (3020 records). [2025-09-25T21:33:22.834667] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-25T21:33:22.834917] [INFO ] [MAIN ] Update Progress: 2056/2372 symbols completed. TBN took 34.0s. Estimated remaining: 42m 1s. Rate: 7.5 symbols/min [2025-09-25T21:33:23.040526] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:23.083973] [DEBUG] [LOCAL ] TDG: Loaded 22048 existing records from primary storage. [2025-09-25T21:33:23.084156] [INFO ] [MAIN ] TDG: Loaded 22048 existing records. [2025-09-25T21:33:23.089304] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-25T21:33:23.281539] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:23.283506] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-25T21:33:23.283573] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-25T21:33:23.283935] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-25T21:33:23.284011] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-25T21:33:23.663140] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:23.888702] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-25T21:33:24.042873] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T21:33:24.689858] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-25T21:33:24.704731] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-25T21:33:24.949383] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:33:25.488755] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-25T21:33:26.288711] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-25T21:33:26.381322] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T21:33:26.446941] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:33:27.088731] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-25T21:33:27.888738] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-25T21:33:28.353433] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T21:33:28.386210] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:33:28.688772] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-25T21:33:29.488716] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-25T21:33:29.546863] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:33:29.949814] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T21:33:30.288757] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-25T21:33:31.088842] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-25T21:33:31.104573] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T21:33:31.376090] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T21:33:31.888745] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-25T21:33:32.688801] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-25T21:33:32.734171] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:33:32.804409] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-25T21:33:33.442154] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-25T21:33:33.488705] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-25T21:33:34.288724] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-25T21:33:35.088729] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-25T21:33:35.190374] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T21:33:35.837098] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-25T21:33:35.888679] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-25T21:33:36.189381] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T21:33:36.200025] [INFO ] [REMOTE ] TD: Full fetch complete (75787 records). [2025-09-25T21:33:36.200203] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-25T21:33:36.512327] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T21:33:36.661545] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-25T21:33:36.661692] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-25T21:33:36.664237] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-25T21:33:36.664308] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-25T21:33:36.667521] [DEBUG] [LOCAL ] TD: Trimmed 75787 records to 52650 (keeping 200 days of data) [2025-09-25T21:33:36.741742] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-25T21:33:37.063109] [DEBUG] [LOCAL ] TD: Primary data saved (52650 records). [2025-09-25T21:33:37.063328] [INFO ] [MAIN ] TD: Full history saved. [2025-09-25T21:33:37.063534] [INFO ] [MAIN ] Update Progress: 2057/2372 symbols completed. TD took 35.8s. Estimated remaining: 41m 54s. Rate: 7.5 symbols/min [2025-09-25T21:33:37.240083] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:37.310023] [DEBUG] [LOCAL ] TDOC: Loaded 53345 existing records from primary storage. [2025-09-25T21:33:37.310247] [INFO ] [MAIN ] TDOC: Loaded 53345 existing records. [2025-09-25T21:33:37.493887] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:37.494293] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-25T21:33:37.494355] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-25T21:33:37.494739] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-25T21:33:37.494884] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-25T21:33:37.497771] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-25T21:33:37.870235] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:38.002798] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T21:33:38.159818] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T21:33:38.288733] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-25T21:33:39.088767] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-25T21:33:39.617504] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T21:33:39.888735] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-25T21:33:40.688713] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-25T21:33:40.870157] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:33:41.488715] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-25T21:33:41.991551] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T21:33:42.109573] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-25T21:33:42.288732] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-25T21:33:42.831563] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T21:33:42.852373] [INFO ] [REMOTE ] TDC: Full fetch complete (66740 records). [2025-09-25T21:33:42.852590] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-25T21:33:43.096809] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-25T21:33:43.297956] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-25T21:33:43.298050] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-25T21:33:43.299196] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-25T21:33:43.299263] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-25T21:33:43.300851] [DEBUG] [LOCAL ] TDC: Trimmed 66740 records to 47186 (keeping 200 days of data) [2025-09-25T21:33:43.596979] [DEBUG] [LOCAL ] TDC: Primary data saved (47186 records). [2025-09-25T21:33:43.597124] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-25T21:33:43.597264] [INFO ] [MAIN ] Update Progress: 2058/2372 symbols completed. TDC took 33.3s. Estimated remaining: 41m 45s. Rate: 7.5 symbols/min [2025-09-25T21:33:43.778340] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:43.835598] [DEBUG] [LOCAL ] TDS: Loaded 42796 existing records from primary storage. [2025-09-25T21:33:43.835780] [INFO ] [MAIN ] TDS: Loaded 42796 existing records. [2025-09-25T21:33:43.890043] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-25T21:33:44.054266] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:44.054578] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-25T21:33:44.054625] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-25T21:33:44.055111] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-25T21:33:44.055172] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-25T21:33:44.233079] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T21:33:44.314749] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T21:33:44.352372] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-25T21:33:44.530781] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:44.688731] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-25T21:33:45.488729] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-25T21:33:46.274255] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T21:33:46.288671] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-25T21:33:47.088726] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-25T21:33:47.784372] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-25T21:33:47.844087] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:33:47.846426] [INFO ] [REMOTE ] TDF: Full fetch complete (10628 records). [2025-09-25T21:33:47.846557] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-25T21:33:47.894819] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-25T21:33:48.055382] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T21:33:48.289736] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-25T21:33:48.289835] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-25T21:33:48.290128] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-25T21:33:48.290169] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-25T21:33:48.290742] [DEBUG] [LOCAL ] TDF: Trimmed 10628 records to 6536 (keeping 200 days of data) [2025-09-25T21:33:48.332150] [DEBUG] [LOCAL ] TDF: Primary data saved (6536 records). [2025-09-25T21:33:48.332306] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-25T21:33:48.332474] [INFO ] [MAIN ] Update Progress: 2059/2372 symbols completed. TDF took 34.6s. Estimated remaining: 41m 37s. Rate: 7.5 symbols/min [2025-09-25T21:33:48.515515] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:48.590991] [DEBUG] [LOCAL ] TDW: Loaded 45409 existing records from primary storage. [2025-09-25T21:33:48.591150] [INFO ] [MAIN ] TDW: Loaded 45409 existing records. [2025-09-25T21:33:48.698718] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-25T21:33:48.801312] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:48.801591] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-25T21:33:48.801711] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-25T21:33:48.802080] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-25T21:33:48.802141] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-25T21:33:48.981320] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T21:33:49.205629] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:49.488845] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-25T21:33:50.293850] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-25T21:33:50.309097] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T21:33:51.088735] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-25T21:33:51.674629] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-25T21:33:51.714306] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-25T21:33:51.888724] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-25T21:33:52.688755] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-25T21:33:52.884687] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:33:53.179041] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T21:33:53.184770] [INFO ] [REMOTE ] TDG: Full fetch complete (32176 records). [2025-09-25T21:33:53.184929] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-25T21:33:53.488919] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-25T21:33:53.607168] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-25T21:33:53.607262] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-25T21:33:53.607963] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-25T21:33:53.608029] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-25T21:33:53.609026] [DEBUG] [LOCAL ] TDG: Trimmed 32176 records to 22191 (keeping 200 days of data) [2025-09-25T21:33:53.781013] [DEBUG] [LOCAL ] TDG: Primary data saved (22191 records). [2025-09-25T21:33:53.781298] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-25T21:33:53.781486] [INFO ] [MAIN ] Update Progress: 2060/2372 symbols completed. TDG took 30.9s. Estimated remaining: 41m 29s. Rate: 7.5 symbols/min [2025-09-25T21:33:53.963586] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:33:53.998202] [DEBUG] [LOCAL ] TDY: Loaded 22668 existing records from primary storage. [2025-09-25T21:33:53.998363] [INFO ] [MAIN ] TDY: Loaded 22668 existing records. [2025-09-25T21:33:54.137982] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T21:33:54.241600] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:33:54.241970] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-25T21:33:54.242020] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-25T21:33:54.242393] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-25T21:33:54.242455] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-25T21:33:54.289417] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-25T21:33:54.634995] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:33:55.088821] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-25T21:33:55.573024] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T21:33:55.888776] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-25T21:33:55.968945] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T21:33:56.239270] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T21:33:56.688802] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-25T21:33:57.444500] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:33:57.488702] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-25T21:33:58.288696] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-25T21:33:58.695447] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T21:33:58.745039] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-25T21:33:59.088747] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-25T21:33:59.888711] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-25T21:33:59.897266] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T21:34:00.688841] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-25T21:34:01.342615] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-25T21:34:01.586846] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-25T21:34:01.610114] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T21:34:02.288751] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-25T21:34:02.537206] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T21:34:03.088737] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-25T21:34:03.413763] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:34:03.643465] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T21:34:03.888719] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-25T21:34:04.579496] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:34:04.688722] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-25T21:34:05.488750] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-25T21:34:06.075632] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-25T21:34:06.288732] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-25T21:34:06.437450] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:34:06.742475] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T21:34:07.088794] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-25T21:34:07.888696] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-25T21:34:08.317464] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-25T21:34:08.328396] [INFO ] [REMOTE ] TDOC: Full fetch complete (77273 records). [2025-09-25T21:34:08.328586] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-25T21:34:08.698919] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-25T21:34:08.759156] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-25T21:34:08.759248] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-25T21:34:08.760435] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-25T21:34:08.761398] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-25T21:34:08.764096] [DEBUG] [LOCAL ] TDOC: Trimmed 77273 records to 53735 (keeping 200 days of data) [2025-09-25T21:34:09.054150] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T21:34:09.189768] [DEBUG] [LOCAL ] TDOC: Primary data saved (53735 records). [2025-09-25T21:34:09.189958] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-25T21:34:09.190183] [INFO ] [MAIN ] Update Progress: 2061/2372 symbols completed. TDOC took 32.1s. Estimated remaining: 41m 22s. Rate: 7.5 symbols/min [2025-09-25T21:34:09.373413] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:09.373601] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-25T21:34:09.373681] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-25T21:34:09.373852] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-25T21:34:09.373919] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-25T21:34:09.373988] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-25T21:34:09.374044] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-25T21:34:09.494731] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-25T21:34:09.577624] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T21:34:09.842855] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:10.102294] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T21:34:10.288761] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-25T21:34:11.088742] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-25T21:34:11.193306] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:34:11.302265] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:34:11.302696] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-25T21:34:11.673953] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T21:34:11.685120] [INFO ] [REMOTE ] TDS: Full fetch complete (61487 records). [2025-09-25T21:34:11.685301] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-25T21:34:11.888682] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-25T21:34:12.145995] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-25T21:34:12.146115] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-25T21:34:12.147593] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-25T21:34:12.147702] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-25T21:34:12.149592] [DEBUG] [LOCAL ] TDS: Trimmed 61487 records to 43081 (keeping 200 days of data) [2025-09-25T21:34:12.447515] [DEBUG] [LOCAL ] TDS: Primary data saved (43081 records). [2025-09-25T21:34:12.447735] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-25T21:34:12.447910] [INFO ] [MAIN ] Update Progress: 2062/2372 symbols completed. TDS took 28.9s. Estimated remaining: 41m 13s. Rate: 7.5 symbols/min [2025-09-25T21:34:12.628008] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:12.650485] [DEBUG] [LOCAL ] TEAF: Loaded 7370 existing records from primary storage. [2025-09-25T21:34:12.650689] [INFO ] [MAIN ] TEAF: Loaded 7370 existing records. [2025-09-25T21:34:12.693863] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-25T21:34:12.845822] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:34:12.847184] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-25T21:34:12.847240] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-25T21:34:12.847697] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-25T21:34:12.847759] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-25T21:34:13.226072] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:13.488735] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-25T21:34:13.568043] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T21:34:13.718684] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:34:13.719013] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-25T21:34:13.929904] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T21:34:14.288739] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-25T21:34:14.506991] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:34:14.507342] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-25T21:34:15.088729] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-25T21:34:15.888727] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-25T21:34:16.373610] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-25T21:34:16.688723] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-25T21:34:17.362215] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T21:34:17.488742] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-25T21:34:18.102465] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T21:34:18.288710] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-25T21:34:18.728705] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-25T21:34:19.100307] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-25T21:34:19.127435] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T21:34:19.712031] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T21:34:19.888745] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-25T21:34:20.688744] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-25T21:34:21.286828] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T21:34:21.488704] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-25T21:34:21.548612] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:34:22.288688] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-25T21:34:22.522979] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-25T21:34:23.088763] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-25T21:34:23.737130] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T21:34:23.888747] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-25T21:34:24.688870] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-25T21:34:24.749475] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T21:34:25.444217] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T21:34:25.488733] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-25T21:34:25.712191] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T21:34:26.288723] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-25T21:34:26.945105] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:34:27.088732] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-25T21:34:27.888798] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-25T21:34:28.029610] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T21:34:28.680330] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T21:34:28.689872] [INFO ] [REMOTE ] TDW: Full fetch complete (67230 records). [2025-09-25T21:34:28.690044] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-25T21:34:28.688687] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-25T21:34:29.127208] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T21:34:29.144551] [INFO ] [REMOTE ] TDY: Full fetch complete (32358 records). [2025-09-25T21:34:29.144720] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-25T21:34:29.187580] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-25T21:34:29.187715] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-25T21:34:29.188862] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-25T21:34:29.188979] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-25T21:34:29.194334] [DEBUG] [LOCAL ] TDW: Trimmed 67230 records to 45760 (keeping 200 days of data) [2025-09-25T21:34:29.491481] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-25T21:34:29.918152] [DEBUG] [LOCAL ] TDW: Primary data saved (45760 records). [2025-09-25T21:34:29.918372] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-25T21:34:29.920183] [INFO ] [MAIN ] Update Progress: 2063/2372 symbols completed. TDW took 41.6s. Estimated remaining: 41m 6s. Rate: 7.5 symbols/min [2025-09-25T21:34:30.021927] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-25T21:34:30.022032] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-25T21:34:30.023038] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-25T21:34:30.023117] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-25T21:34:30.024287] [DEBUG] [LOCAL ] TDY: Trimmed 32358 records to 22795 (keeping 200 days of data) [2025-09-25T21:34:30.255671] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:30.315979] [DEBUG] [LOCAL ] TDY: Primary data saved (22795 records). [2025-09-25T21:34:30.316156] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-25T21:34:30.316383] [INFO ] [MAIN ] Update Progress: 2064/2372 symbols completed. TDY took 36.5s. Estimated remaining: 40m 57s. Rate: 7.5 symbols/min [2025-09-25T21:34:30.474593] [DEBUG] [LOCAL ] TECK: Loaded 53436 existing records from primary storage. [2025-09-25T21:34:30.474809] [INFO ] [MAIN ] TECK: Loaded 53436 existing records. [2025-09-25T21:34:30.505225] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-25T21:34:30.534974] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-25T21:34:30.654921] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-25T21:34:30.714428] [INFO ] [REMOTE ] TE: Full fetch complete (47046 records). [2025-09-25T21:34:30.714708] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-25T21:34:30.944555] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:31.071194] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:34:31.071762] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-25T21:34:31.071823] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-25T21:34:31.072618] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-25T21:34:31.097810] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-25T21:34:31.247499] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-25T21:34:31.250054] [DEBUG] [LOCAL ] TEF: Loaded 37326 existing records from primary storage. [2025-09-25T21:34:31.250151] [INFO ] [MAIN ] TEF: Loaded 37326 existing records. [2025-09-25T21:34:31.245560] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-25T21:34:31.259330] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:34:31.259501] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:34:31.259588] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-25T21:34:31.273100] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-25T21:34:31.273214] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-25T21:34:31.273297] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-25T21:34:31.273474] [INFO ] [MAIN ] Update Progress: 2065/2372 symbols completed. TE took 22.1s. Estimated remaining: 40m 48s. Rate: 7.5 symbols/min [2025-09-25T21:34:31.311171] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-25T21:34:31.773411] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:34:31.781969] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-25T21:34:31.782091] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-25T21:34:31.782512] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-25T21:34:31.782574] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-25T21:34:31.917526] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:32.100101] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T21:34:32.157321] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-25T21:34:32.156561] [DEBUG] [LOCAL ] TEI: Loaded 20526 existing records from primary storage. [2025-09-25T21:34:32.177086] [INFO ] [MAIN ] TEI: Loaded 20526 existing records. [2025-09-25T21:34:32.603255] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:32.690749] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-25T21:34:32.784206] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:32.753126] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:34:32.785992] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-25T21:34:32.786092] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-25T21:34:32.786471] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-25T21:34:32.786571] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-25T21:34:33.101747] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-25T21:34:33.244740] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:33.488739] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-25T21:34:34.288713] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-25T21:34:34.517707] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T21:34:34.582445] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T21:34:34.999677] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T21:34:35.088723] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-25T21:34:35.888692] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-25T21:34:36.205248] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T21:34:36.614244] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T21:34:36.616456] [INFO ] [REMOTE ] TEAF: Full fetch complete (9928 records). [2025-09-25T21:34:36.619840] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-25T21:34:36.694727] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-25T21:34:37.056311] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-25T21:34:37.056426] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-25T21:34:37.056788] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-25T21:34:37.056851] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-25T21:34:37.057886] [DEBUG] [LOCAL ] TEAF: Trimmed 9928 records to 7487 (keeping 200 days of data) [2025-09-25T21:34:37.117717] [DEBUG] [LOCAL ] TEAF: Primary data saved (7487 records). [2025-09-25T21:34:37.117875] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-25T21:34:37.118002] [INFO ] [MAIN ] Update Progress: 2066/2372 symbols completed. TEAF took 24.7s. Estimated remaining: 40m 40s. Rate: 7.5 symbols/min [2025-09-25T21:34:37.305761] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:34:37.401442] [DEBUG] [LOCAL ] TEL: Loaded 51151 existing records from primary storage. [2025-09-25T21:34:37.401687] [INFO ] [MAIN ] TEL: Loaded 51151 existing records. [2025-09-25T21:34:37.493838] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-25T21:34:37.623616] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:34:37.624022] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-25T21:34:37.624085] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-25T21:34:37.624469] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-25T21:34:37.624550] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-25T21:34:38.005918] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:34:38.288717] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-25T21:34:38.334823] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T21:34:38.472526] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-25T21:34:39.088741] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-25T21:34:39.888749] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-25T21:34:40.004388] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T21:34:40.508249] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T21:34:40.553325] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T21:34:40.688740] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-25T21:34:41.488727] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-25T21:34:42.230785] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T21:34:42.288758] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-25T21:34:43.026888] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T21:34:43.088732] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-25T21:34:43.888690] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-25T21:34:44.062603] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:34:44.471747] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T21:34:44.688759] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-25T21:34:45.010606] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T21:34:45.488728] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-25T21:34:46.290987] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-25T21:34:46.296257] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-25T21:34:47.088739] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-25T21:34:47.265032] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T21:34:47.316129] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-25T21:34:47.888750] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-25T21:34:48.688738] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-25T21:34:49.015042] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T21:34:49.488844] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-25T21:34:49.941375] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-25T21:34:50.053293] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T21:34:50.288739] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-25T21:34:51.088742] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-25T21:34:51.283124] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T21:34:51.888734] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-25T21:34:52.286534] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T21:34:52.574694] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-25T21:34:52.688769] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-25T21:34:53.488721] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-25T21:34:53.744549] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T21:34:54.112839] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T21:34:54.288737] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-25T21:34:55.088765] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-25T21:34:55.334804] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-25T21:34:55.360825] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T21:34:55.888752] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-25T21:34:56.623008] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T21:34:56.688701] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-25T21:34:57.253392] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T21:34:57.488738] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-25T21:34:58.118536] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T21:34:58.288759] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-25T21:34:59.088755] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-25T21:34:59.266538] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:34:59.888765] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-25T21:35:00.127386] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T21:35:00.158744] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T21:35:00.688714] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-25T21:35:01.488718] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-25T21:35:01.825275] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T21:35:02.288699] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-25T21:35:02.578581] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T21:35:02.998387] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T21:35:03.006085] [INFO ] [REMOTE ] TEF: Full fetch complete (54601 records). [2025-09-25T21:35:03.006265] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-25T21:35:03.094728] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-25T21:35:03.464940] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T21:35:03.475675] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-25T21:35:03.475801] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-25T21:35:03.476931] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-25T21:35:03.477008] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-25T21:35:03.479258] [DEBUG] [LOCAL ] TEF: Trimmed 54601 records to 37632 (keeping 200 days of data) [2025-09-25T21:35:03.733239] [DEBUG] [LOCAL ] TEF: Primary data saved (37632 records). [2025-09-25T21:35:03.733411] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-25T21:35:03.733537] [INFO ] [MAIN ] Update Progress: 2067/2372 symbols completed. TEF took 33.4s. Estimated remaining: 40m 35s. Rate: 7.5 symbols/min [2025-09-25T21:35:03.902434] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-25T21:35:03.939159] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:03.979763] [DEBUG] [LOCAL ] TEN: Loaded 31027 existing records from primary storage. [2025-09-25T21:35:03.979927] [INFO ] [MAIN ] TEN: Loaded 31027 existing records. [2025-09-25T21:35:04.177429] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:04.177806] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-25T21:35:04.177858] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-25T21:35:04.178292] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-25T21:35:04.178352] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-25T21:35:04.645489] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:04.688683] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-25T21:35:05.028682] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T21:35:05.045701] [INFO ] [REMOTE ] TECK: Full fetch complete (77306 records). [2025-09-25T21:35:05.045881] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-25T21:35:05.474780] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-25T21:35:05.474952] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-25T21:35:05.476174] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-25T21:35:05.476243] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-25T21:35:05.478238] [DEBUG] [LOCAL ] TECK: Trimmed 77306 records to 53826 (keeping 200 days of data) [2025-09-25T21:35:05.488772] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-25T21:35:05.848042] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-25T21:35:05.985442] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:35:06.009428] [DEBUG] [LOCAL ] TECK: Primary data saved (53826 records). [2025-09-25T21:35:06.009604] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-25T21:35:06.011040] [INFO ] [MAIN ] Update Progress: 2068/2372 symbols completed. TECK took 36.1s. Estimated remaining: 40m 26s. Rate: 7.5 symbols/min [2025-09-25T21:35:06.203384] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:06.242518] [DEBUG] [LOCAL ] TEO: Loaded 21995 existing records from primary storage. [2025-09-25T21:35:06.242721] [INFO ] [MAIN ] TEO: Loaded 21995 existing records. [2025-09-25T21:35:06.293855] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-25T21:35:06.462295] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:06.462905] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-25T21:35:06.462980] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-25T21:35:06.463331] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-25T21:35:06.463392] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-25T21:35:06.594281] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T21:35:06.601079] [INFO ] [REMOTE ] TEI: Full fetch complete (30030 records). [2025-09-25T21:35:06.601356] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-25T21:35:07.113835] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-25T21:35:07.373710] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:07.444005] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-25T21:35:07.444086] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-25T21:35:07.444752] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-25T21:35:07.444837] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-25T21:35:07.445815] [DEBUG] [LOCAL ] TEI: Trimmed 30030 records to 20713 (keeping 200 days of data) [2025-09-25T21:35:07.584358] [DEBUG] [LOCAL ] TEI: Primary data saved (20713 records). [2025-09-25T21:35:07.584491] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-25T21:35:07.584617] [INFO ] [MAIN ] Update Progress: 2069/2372 symbols completed. TEI took 36.3s. Estimated remaining: 40m 17s. Rate: 7.5 symbols/min [2025-09-25T21:35:07.811739] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:07.809376] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T21:35:07.886319] [DEBUG] [LOCAL ] TEVA: Loaded 53633 existing records from primary storage. [2025-09-25T21:35:07.886521] [INFO ] [MAIN ] TEVA: Loaded 53633 existing records. [2025-09-25T21:35:07.891581] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-25T21:35:08.088512] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:08.089020] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-25T21:35:08.089685] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-25T21:35:08.090428] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-25T21:35:08.090498] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-25T21:35:08.478392] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:08.612819] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:35:08.627695] [INFO ] [REMOTE ] TEL: Full fetch complete (73368 records). [2025-09-25T21:35:08.627893] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-25T21:35:08.693822] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-25T21:35:09.123867] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-25T21:35:09.123990] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-25T21:35:09.125195] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-25T21:35:09.125262] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-25T21:35:09.128157] [DEBUG] [LOCAL ] TEL: Trimmed 73368 records to 51528 (keeping 200 days of data) [2025-09-25T21:35:09.405030] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T21:35:09.500623] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-25T21:35:09.530344] [DEBUG] [LOCAL ] TEL: Primary data saved (51528 records). [2025-09-25T21:35:09.530504] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-25T21:35:09.530744] [INFO ] [MAIN ] Update Progress: 2070/2372 symbols completed. TEL took 32.4s. Estimated remaining: 40m 8s. Rate: 7.5 symbols/min [2025-09-25T21:35:09.743596] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:09.806807] [DEBUG] [LOCAL ] TEX: Loaded 44627 existing records from primary storage. [2025-09-25T21:35:09.806960] [INFO ] [MAIN ] TEX: Loaded 44627 existing records. [2025-09-25T21:35:10.008923] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:10.009286] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-25T21:35:10.009340] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-25T21:35:10.009805] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-25T21:35:10.009875] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-25T21:35:10.294717] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-25T21:35:10.483111] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:10.851850] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-25T21:35:10.910010] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T21:35:11.088738] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-25T21:35:11.598093] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T21:35:11.888733] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-25T21:35:12.688805] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-25T21:35:13.094168] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T21:35:13.488810] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-25T21:35:13.620082] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T21:35:13.952314] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:35:14.288829] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-25T21:35:14.369309] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T21:35:15.088795] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-25T21:35:15.570056] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-25T21:35:15.888777] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-25T21:35:16.688703] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-25T21:35:16.758732] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:35:17.058832] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T21:35:17.488810] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-25T21:35:17.786561] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:35:18.288754] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-25T21:35:18.917331] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T21:35:19.088706] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-25T21:35:19.369971] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T21:35:19.888784] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-25T21:35:20.693864] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-25T21:35:20.715409] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T21:35:21.343132] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:35:21.488731] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-25T21:35:22.288721] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-25T21:35:22.771993] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-25T21:35:23.088697] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-25T21:35:23.210231] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T21:35:23.420814] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T21:35:23.888743] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-25T21:35:24.688705] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-25T21:35:25.083833] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T21:35:25.488726] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-25T21:35:25.698935] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:35:25.914979] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-25T21:35:26.288740] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-25T21:35:26.800579] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T21:35:27.088740] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-25T21:35:27.347467] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T21:35:27.888717] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-25T21:35:28.688736] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-25T21:35:28.812977] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T21:35:29.042626] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T21:35:29.488794] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-25T21:35:30.288738] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-25T21:35:30.771630] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-25T21:35:30.841309] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-25T21:35:30.847930] [INFO ] [REMOTE ] TEN: Full fetch complete (44698 records). [2025-09-25T21:35:30.848085] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-25T21:35:31.091665] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-25T21:35:31.298895] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-25T21:35:31.299007] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-25T21:35:31.300087] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-25T21:35:31.300161] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-25T21:35:31.302367] [DEBUG] [LOCAL ] TEN: Trimmed 44698 records to 31215 (keeping 200 days of data) [2025-09-25T21:35:31.496930] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:35:31.546418] [DEBUG] [LOCAL ] TEN: Primary data saved (31215 records). [2025-09-25T21:35:31.546613] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-25T21:35:31.546859] [INFO ] [MAIN ] Update Progress: 2071/2372 symbols completed. TEN took 27.8s. Estimated remaining: 40m 2s. Rate: 7.5 symbols/min [2025-09-25T21:35:31.736359] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:31.801160] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-25T21:35:31.801344] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-25T21:35:31.893879] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-25T21:35:32.021601] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:32.021923] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-25T21:35:32.022018] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-25T21:35:32.022589] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-25T21:35:32.023362] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-25T21:35:32.412826] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:32.688732] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-25T21:35:32.825287] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T21:35:33.221104] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:35:33.226910] [INFO ] [REMOTE ] TEO: Full fetch complete (32800 records). [2025-09-25T21:35:33.227021] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-25T21:35:33.494725] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-25T21:35:33.623104] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-25T21:35:33.623194] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-25T21:35:33.623984] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-25T21:35:33.624057] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-25T21:35:33.624927] [DEBUG] [LOCAL ] TEO: Trimmed 32800 records to 22136 (keeping 200 days of data) [2025-09-25T21:35:33.755932] [DEBUG] [LOCAL ] TEO: Primary data saved (22136 records). [2025-09-25T21:35:33.756070] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-25T21:35:33.756192] [INFO ] [MAIN ] Update Progress: 2072/2372 symbols completed. TEO took 27.7s. Estimated remaining: 39m 53s. Rate: 7.5 symbols/min [2025-09-25T21:35:33.956672] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:34.008555] [DEBUG] [LOCAL ] TFII: Loaded 34270 existing records from primary storage. [2025-09-25T21:35:34.008729] [INFO ] [MAIN ] TFII: Loaded 34270 existing records. [2025-09-25T21:35:34.201710] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:34.201968] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-25T21:35:34.202014] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-25T21:35:34.202392] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-25T21:35:34.202453] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-25T21:35:34.290297] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-25T21:35:34.524306] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T21:35:34.648076] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:35.088766] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-25T21:35:35.269550] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T21:35:35.888842] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-25T21:35:35.933427] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:35:36.688903] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-25T21:35:37.052299] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-25T21:35:37.171838] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T21:35:37.488744] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-25T21:35:38.289452] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-25T21:35:38.289374] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-25T21:35:38.298448] [INFO ] [REMOTE ] TEX: Full fetch complete (64805 records). [2025-09-25T21:35:38.298554] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-25T21:35:38.742283] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-25T21:35:38.742380] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-25T21:35:38.743634] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-25T21:35:38.743786] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-25T21:35:38.745451] [DEBUG] [LOCAL ] TEX: Trimmed 64805 records to 44916 (keeping 200 days of data) [2025-09-25T21:35:38.865546] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T21:35:39.059002] [DEBUG] [LOCAL ] TEX: Primary data saved (44916 records). [2025-09-25T21:35:39.059146] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-25T21:35:39.059259] [INFO ] [MAIN ] Update Progress: 2073/2372 symbols completed. TEX took 29.5s. Estimated remaining: 39m 45s. Rate: 7.5 symbols/min [2025-09-25T21:35:39.089272] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-25T21:35:39.245758] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:39.274427] [DEBUG] [LOCAL ] TFIN: Loaded 23600 existing records from primary storage. [2025-09-25T21:35:39.274573] [INFO ] [MAIN ] TFIN: Loaded 23600 existing records. [2025-09-25T21:35:39.463278] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:39.463628] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-25T21:35:39.463723] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-25T21:35:39.464672] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-25T21:35:39.464740] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-25T21:35:39.850224] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:39.888676] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-25T21:35:40.205456] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T21:35:40.688701] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-25T21:35:40.761614] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-25T21:35:41.300580] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-25T21:35:41.488722] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-25T21:35:42.288713] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-25T21:35:42.679887] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T21:35:42.712438] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T21:35:43.088762] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-25T21:35:43.888752] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-25T21:35:44.471793] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-25T21:35:44.514278] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T21:35:44.688735] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-25T21:35:44.964629] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T21:35:45.488812] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-25T21:35:46.288730] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-25T21:35:46.328447] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:35:47.088760] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-25T21:35:47.427222] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T21:35:47.888705] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-25T21:35:48.209020] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T21:35:48.389976] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T21:35:48.688731] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-25T21:35:49.488819] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-25T21:35:49.592203] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:35:49.865590] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-25T21:35:50.288730] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-25T21:35:50.432102] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T21:35:51.088775] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-25T21:35:51.509497] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T21:35:51.888743] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-25T21:35:52.181878] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T21:35:52.688730] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-25T21:35:53.204219] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T21:35:53.488750] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-25T21:35:54.288726] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-25T21:35:54.702596] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T21:35:55.088756] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-25T21:35:55.429161] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T21:35:55.694406] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-25T21:35:55.713890] [INFO ] [REMOTE ] TEVA: Full fetch complete (77673 records). [2025-09-25T21:35:55.714198] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-25T21:35:55.903765] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-25T21:35:56.150591] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-25T21:35:56.150815] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-25T21:35:56.153597] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-25T21:35:56.153765] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-25T21:35:56.158841] [DEBUG] [LOCAL ] TEVA: Trimmed 77673 records to 54023 (keeping 200 days of data) [2025-09-25T21:35:56.583858] [DEBUG] [LOCAL ] TEVA: Primary data saved (54023 records). [2025-09-25T21:35:56.584099] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-25T21:35:56.584352] [INFO ] [MAIN ] Update Progress: 2074/2372 symbols completed. TEVA took 49.0s. Estimated remaining: 39m 38s. Rate: 7.5 symbols/min [2025-09-25T21:35:56.697737] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-25T21:35:56.802871] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:35:56.858309] [DEBUG] [LOCAL ] TFPM: Loaded 37385 existing records from primary storage. [2025-09-25T21:35:56.858697] [INFO ] [MAIN ] TFPM: Loaded 37385 existing records. [2025-09-25T21:35:57.070708] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:35:57.071151] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-25T21:35:57.071205] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-25T21:35:57.092306] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-25T21:35:57.092474] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-25T21:35:57.114334] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-25T21:35:57.138931] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T21:35:57.489118] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-25T21:35:57.591922] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:35:58.185421] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-25T21:35:58.288731] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-25T21:35:59.088688] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-25T21:35:59.499464] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T21:35:59.510252] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-25T21:35:59.513462] [INFO ] [REMOTE ] TFII: Full fetch complete (47659 records). [2025-09-25T21:35:59.513604] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-25T21:35:59.892456] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-25T21:35:59.948622] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-25T21:35:59.948743] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-25T21:35:59.949831] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-25T21:35:59.949897] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-25T21:35:59.951271] [DEBUG] [LOCAL ] TFII: Trimmed 47659 records to 34506 (keeping 200 days of data) [2025-09-25T21:36:00.201258] [DEBUG] [LOCAL ] TFII: Primary data saved (34506 records). [2025-09-25T21:36:00.201410] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-25T21:36:00.201524] [INFO ] [MAIN ] Update Progress: 2075/2372 symbols completed. TFII took 26.4s. Estimated remaining: 39m 30s. Rate: 7.5 symbols/min [2025-09-25T21:36:00.346024] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T21:36:00.437048] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:00.506780] [DEBUG] [LOCAL ] TFX: Loaded 37291 existing records from primary storage. [2025-09-25T21:36:00.506937] [INFO ] [MAIN ] TFX: Loaded 37291 existing records. [2025-09-25T21:36:00.695969] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-25T21:36:00.703799] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:00.704145] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-25T21:36:00.704215] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-25T21:36:00.707679] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-25T21:36:00.707767] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-25T21:36:01.095223] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:01.488778] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-25T21:36:02.019691] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T21:36:02.031100] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-25T21:36:02.042488] [INFO ] [REMOTE ] TFC: Full fetch complete (77670 records). [2025-09-25T21:36:02.042731] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-25T21:36:02.293919] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-25T21:36:02.527376] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-25T21:36:02.527483] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-25T21:36:02.528854] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-25T21:36:02.528926] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-25T21:36:02.530623] [DEBUG] [LOCAL ] TFC: Trimmed 77670 records to 54057 (keeping 200 days of data) [2025-09-25T21:36:02.715379] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T21:36:02.948811] [DEBUG] [LOCAL ] TFC: Primary data saved (54057 records). [2025-09-25T21:36:02.949010] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-25T21:36:02.949175] [INFO ] [MAIN ] Update Progress: 2076/2372 symbols completed. TFC took 31.4s. Estimated remaining: 39m 21s. Rate: 7.5 symbols/min [2025-09-25T21:36:03.093933] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-25T21:36:03.152557] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:03.167366] [DEBUG] [LOCAL ] TG: Loaded 10495 existing records from primary storage. [2025-09-25T21:36:03.167522] [INFO ] [MAIN ] TG: Loaded 10495 existing records. [2025-09-25T21:36:03.360295] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:03.360611] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-25T21:36:03.360808] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-25T21:36:03.361110] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-25T21:36:03.361179] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-25T21:36:03.577076] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-25T21:36:03.774495] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:03.888761] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-25T21:36:04.248799] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T21:36:04.254820] [INFO ] [REMOTE ] TFIN: Full fetch complete (30987 records). [2025-09-25T21:36:04.254943] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-25T21:36:04.693055] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-25T21:36:04.711665] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-25T21:36:04.711780] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-25T21:36:04.712461] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-25T21:36:04.712503] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-25T21:36:04.713639] [DEBUG] [LOCAL ] TFIN: Trimmed 30987 records to 23741 (keeping 200 days of data) [2025-09-25T21:36:04.850734] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T21:36:04.892715] [DEBUG] [LOCAL ] TFIN: Primary data saved (23741 records). [2025-09-25T21:36:04.892894] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-25T21:36:04.893043] [INFO ] [MAIN ] Update Progress: 2077/2372 symbols completed. TFIN took 25.8s. Estimated remaining: 39m 12s. Rate: 7.5 symbols/min [2025-09-25T21:36:05.488747] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-25T21:36:06.061488] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:36:06.288736] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-25T21:36:06.991357] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-25T21:36:07.088730] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-25T21:36:07.559236] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T21:36:07.888748] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-25T21:36:08.609384] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T21:36:08.688712] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-25T21:36:09.400196] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T21:36:09.488779] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-25T21:36:09.931163] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:36:10.288743] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-25T21:36:11.059042] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T21:36:11.088684] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-25T21:36:11.874753] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T21:36:11.888756] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-25T21:36:12.612516] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:36:12.632374] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T21:36:12.688699] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-25T21:36:13.203182] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T21:36:13.488719] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-25T21:36:14.288777] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-25T21:36:15.088700] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-25T21:36:15.115628] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:36:15.228063] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T21:36:15.888726] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-25T21:36:16.689237] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-25T21:36:16.694415] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T21:36:16.744472] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T21:36:17.488746] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-25T21:36:18.194564] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T21:36:18.288721] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-25T21:36:19.088700] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-25T21:36:19.114805] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T21:36:19.793964] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-25T21:36:19.888741] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-25T21:36:19.908790] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T21:36:20.688710] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-25T21:36:21.468252] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-25T21:36:21.494781] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-25T21:36:21.516196] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T21:36:22.288696] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-25T21:36:22.519947] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:36:23.088737] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-25T21:36:23.731407] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-25T21:36:23.888747] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-25T21:36:24.630580] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:36:24.638842] [INFO ] [REMOTE ] TFPM: Full fetch complete (50571 records). [2025-09-25T21:36:24.638971] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-25T21:36:24.696981] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-25T21:36:25.111134] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-25T21:36:25.111256] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-25T21:36:25.112312] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-25T21:36:25.112379] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-25T21:36:25.113731] [DEBUG] [LOCAL ] TFPM: Trimmed 50571 records to 37671 (keeping 200 days of data) [2025-09-25T21:36:25.392275] [DEBUG] [LOCAL ] TFPM: Primary data saved (37671 records). [2025-09-25T21:36:25.392442] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-25T21:36:25.392560] [INFO ] [MAIN ] Update Progress: 2078/2372 symbols completed. TFPM took 28.8s. Estimated remaining: 39m 6s. Rate: 7.5 symbols/min [2025-09-25T21:36:25.453947] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T21:36:25.461666] [INFO ] [REMOTE ] TFX: Full fetch complete (54219 records). [2025-09-25T21:36:25.461813] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-25T21:36:25.545713] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T21:36:25.550173] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-25T21:36:25.953897] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-25T21:36:25.953986] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-25T21:36:25.955014] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-25T21:36:25.955078] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-25T21:36:25.956275] [DEBUG] [LOCAL ] TFX: Trimmed 54219 records to 37634 (keeping 200 days of data) [2025-09-25T21:36:26.207031] [DEBUG] [LOCAL ] TFX: Primary data saved (37634 records). [2025-09-25T21:36:26.207189] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-25T21:36:26.207300] [INFO ] [MAIN ] Update Progress: 2079/2372 symbols completed. TFX took 26.0s. Estimated remaining: 38m 57s. Rate: 7.5 symbols/min [2025-09-25T21:36:26.383950] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T21:36:26.386779] [INFO ] [REMOTE ] TG: Full fetch complete (15234 records). [2025-09-25T21:36:26.386853] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-25T21:36:26.782076] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-25T21:36:26.782164] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-25T21:36:26.782553] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-25T21:36:26.782597] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-25T21:36:26.783190] [DEBUG] [LOCAL ] TG: Trimmed 15234 records to 10546 (keeping 200 days of data) [2025-09-25T21:36:26.844513] [DEBUG] [LOCAL ] TG: Primary data saved (10546 records). [2025-09-25T21:36:26.844746] [INFO ] [MAIN ] TG: Full history saved. [2025-09-25T21:36:26.844859] [INFO ] [MAIN ] Update Progress: 2080/2372 symbols completed. TG took 23.9s. Estimated remaining: 38m 48s. Rate: 7.5 symbols/min [2025-09-25T21:36:27.562542] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:27.670524] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:27.675190] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:27.648536] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:27.676888] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-25T21:36:27.676973] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-25T21:36:27.677131] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-25T21:36:27.677171] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-25T21:36:27.677219] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-25T21:36:27.677265] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-25T21:36:27.790722] [DEBUG] [LOCAL ] TGS: Loaded 32486 existing records from primary storage. [2025-09-25T21:36:27.804827] [DEBUG] [LOCAL ] TGLS: Loaded 28289 existing records from primary storage. [2025-09-25T21:36:27.804984] [INFO ] [MAIN ] TGLS: Loaded 28289 existing records. [2025-09-25T21:36:27.790929] [INFO ] [MAIN ] TGS: Loaded 32486 existing records. [2025-09-25T21:36:28.133225] [DEBUG] [LOCAL ] TGNA: Loaded 48698 existing records from primary storage. [2025-09-25T21:36:28.133394] [INFO ] [MAIN ] TGNA: Loaded 48698 existing records. [2025-09-25T21:36:28.718841] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:28.735519] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-25T21:36:28.735916] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:28.736684] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-25T21:36:28.736780] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-25T21:36:28.737180] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-25T21:36:28.737260] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-25T21:36:28.735638] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-25T21:36:28.764275] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-25T21:36:28.764570] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-25T21:36:29.148004] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:29.191054] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-25T21:36:29.191132] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-25T21:36:29.191533] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-25T21:36:29.191606] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-25T21:36:29.386348] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:29.386826] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-25T21:36:29.834978] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:29.835367] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-25T21:36:29.835766] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-25T21:36:30.089368] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:30.106985] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-25T21:36:30.107456] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-25T21:36:30.269756] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:30.273334] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-25T21:36:30.297213] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:30.297584] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-25T21:36:30.363132] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:30.363463] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-25T21:36:30.393437] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:30.393915] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-25T21:36:31.088741] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-25T21:36:31.322966] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:31.323341] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-25T21:36:31.598262] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T21:36:31.859409] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T21:36:31.888700] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-25T21:36:32.111319] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T21:36:32.688718] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-25T21:36:33.139769] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T21:36:33.488732] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-25T21:36:33.712565] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:33.712959] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-25T21:36:34.288703] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-25T21:36:34.368320] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-25T21:36:34.505174] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:36:34.505508] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-25T21:36:35.088734] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-25T21:36:35.888836] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-25T21:36:36.588559] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T21:36:36.688709] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-25T21:36:37.307636] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-25T21:36:37.488771] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-25T21:36:38.245137] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T21:36:38.288672] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-25T21:36:38.740452] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T21:36:39.088748] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-25T21:36:39.888814] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-25T21:36:39.953804] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:36:40.544326] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T21:36:40.688767] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-25T21:36:40.779809] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-25T21:36:41.488836] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-25T21:36:42.288755] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-25T21:36:42.490963] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T21:36:42.850122] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T21:36:43.088740] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-25T21:36:43.113693] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-25T21:36:43.888845] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-25T21:36:44.688811] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-25T21:36:44.771697] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T21:36:45.106577] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T21:36:45.110986] [INFO ] [REMOTE ] TGE: Full fetch complete (9145 records). [2025-09-25T21:36:45.111250] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-25T21:36:45.321385] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-25T21:36:45.321761] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:36:45.321877] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:36:45.322012] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-25T21:36:45.322119] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-25T21:36:45.322192] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-25T21:36:45.322275] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-25T21:36:45.322454] [INFO ] [MAIN ] Update Progress: 2081/2372 symbols completed. TGE took 18.5s. Estimated remaining: 38m 42s. Rate: 7.5 symbols/min [2025-09-25T21:36:45.489927] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-25T21:36:45.521355] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:45.625514] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-25T21:36:45.625726] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-25T21:36:45.848958] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:45.849290] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-25T21:36:45.849469] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-25T21:36:45.850479] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-25T21:36:45.850546] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-25T21:36:46.011287] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:36:46.274136] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:46.288771] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-25T21:36:46.501524] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T21:36:47.088736] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-25T21:36:47.607418] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T21:36:47.888769] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-25T21:36:48.609404] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T21:36:48.688758] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-25T21:36:49.488866] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-25T21:36:49.551221] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T21:36:50.146987] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T21:36:50.288752] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-25T21:36:50.645456] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T21:36:51.088781] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-25T21:36:51.888703] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-25T21:36:52.210120] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T21:36:52.688725] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-25T21:36:53.049527] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T21:36:53.328304] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T21:36:53.488731] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-25T21:36:54.141776] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T21:36:54.161834] [INFO ] [REMOTE ] TGNA: Full fetch complete (69923 records). [2025-09-25T21:36:54.161993] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-25T21:36:54.289808] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-25T21:36:54.689689] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-25T21:36:54.689789] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-25T21:36:54.690895] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-25T21:36:54.690962] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-25T21:36:54.693750] [DEBUG] [LOCAL ] TGNA: Trimmed 69923 records to 49082 (keeping 200 days of data) [2025-09-25T21:36:55.031282] [DEBUG] [LOCAL ] TGNA: Primary data saved (49082 records). [2025-09-25T21:36:55.031428] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-25T21:36:55.033293] [INFO ] [MAIN ] Update Progress: 2082/2372 symbols completed. TGNA took 28.2s. Estimated remaining: 38m 34s. Rate: 7.5 symbols/min [2025-09-25T21:36:55.100813] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-25T21:36:55.272048] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:36:55.345614] [DEBUG] [LOCAL ] THC: Loaded 48021 existing records from primary storage. [2025-09-25T21:36:55.345801] [INFO ] [MAIN ] THC: Loaded 48021 existing records. [2025-09-25T21:36:55.534016] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:36:55.534389] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-25T21:36:55.534449] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-25T21:36:55.534908] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-25T21:36:55.534970] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-25T21:36:55.775189] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:36:55.815237] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-25T21:36:55.896771] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-25T21:36:56.054786] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:36:56.376324] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-25T21:36:56.688704] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-25T21:36:57.334797] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T21:36:57.488738] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-25T21:36:58.288718] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-25T21:36:58.717283] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-25T21:36:59.088700] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-25T21:36:59.184982] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:36:59.764062] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T21:36:59.888712] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-25T21:37:00.688798] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-25T21:37:01.163133] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T21:37:01.173885] [INFO ] [REMOTE ] TGLS: Full fetch complete (40399 records). [2025-09-25T21:37:01.174028] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-25T21:37:01.393988] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-25T21:37:01.493834] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-25T21:37:01.735702] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-25T21:37:01.754229] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-25T21:37:01.754333] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-25T21:37:01.755390] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-25T21:37:01.755469] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-25T21:37:01.756865] [DEBUG] [LOCAL ] TGLS: Trimmed 40399 records to 28513 (keeping 200 days of data) [2025-09-25T21:37:01.950705] [DEBUG] [LOCAL ] TGLS: Primary data saved (28513 records). [2025-09-25T21:37:01.950866] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-25T21:37:01.950996] [INFO ] [MAIN ] Update Progress: 2083/2372 symbols completed. TGLS took 35.0s. Estimated remaining: 38m 26s. Rate: 7.5 symbols/min [2025-09-25T21:37:02.134204] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:02.160680] [DEBUG] [LOCAL ] THG: Loaded 21781 existing records from primary storage. [2025-09-25T21:37:02.160851] [INFO ] [MAIN ] THG: Loaded 21781 existing records. [2025-09-25T21:37:02.293805] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-25T21:37:02.361516] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:02.361867] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-25T21:37:02.361942] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-25T21:37:02.362258] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-25T21:37:02.362319] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-25T21:37:02.767888] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:03.088733] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-25T21:37:03.888696] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-25T21:37:04.051396] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T21:37:04.049625] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.56 seconds). [2025-09-25T21:37:04.233060] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-25T21:37:04.688738] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-25T21:37:05.371123] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-25T21:37:05.381094] [INFO ] [REMOTE ] TGS: Full fetch complete (47518 records). [2025-09-25T21:37:05.381251] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-25T21:37:05.492126] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-25T21:37:05.780725] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-25T21:37:05.780822] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-25T21:37:05.781769] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-25T21:37:05.781859] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-25T21:37:05.784171] [DEBUG] [LOCAL ] TGS: Trimmed 47518 records to 32812 (keeping 200 days of data) [2025-09-25T21:37:06.000905] [DEBUG] [LOCAL ] TGS: Primary data saved (32812 records). [2025-09-25T21:37:06.001071] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-25T21:37:06.001190] [INFO ] [MAIN ] Update Progress: 2084/2372 symbols completed. TGS took 39.1s. Estimated remaining: 38m 17s. Rate: 7.5 symbols/min [2025-09-25T21:37:06.175700] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:06.181955] [DEBUG] [LOCAL ] THIR: Loaded 2202 existing records from primary storage. [2025-09-25T21:37:06.182051] [INFO ] [MAIN ] THIR: Loaded 2202 existing records. [2025-09-25T21:37:06.295715] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-25T21:37:06.368714] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:06.369083] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-25T21:37:06.369131] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-25T21:37:06.369316] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-25T21:37:06.369376] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-25T21:37:06.755719] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:07.088128] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-25T21:37:07.099985] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-25T21:37:07.202833] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T21:37:07.464423] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-25T21:37:07.539159] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T21:37:07.888733] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-25T21:37:08.688742] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-25T21:37:09.160015] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T21:37:09.488809] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-25T21:37:10.288746] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-25T21:37:10.944398] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-25T21:37:11.005306] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T21:37:11.088705] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-25T21:37:11.522558] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T21:37:11.888726] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-25T21:37:12.182400] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-25T21:37:12.688724] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-25T21:37:13.049145] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-25T21:37:13.290878] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-25T21:37:13.488729] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-25T21:37:14.288729] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-25T21:37:14.655882] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-25T21:37:14.913972] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T21:37:15.088721] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-25T21:37:15.569171] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-25T21:37:15.888735] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-25T21:37:16.688689] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-25T21:37:17.062846] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-25T21:37:17.136250] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:37:17.488735] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-25T21:37:18.288725] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-25T21:37:18.645875] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-25T21:37:18.729806] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-25T21:37:19.088758] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-25T21:37:19.888734] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-25T21:37:20.688712] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-25T21:37:20.855895] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T21:37:21.159889] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-25T21:37:21.488736] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-25T21:37:21.938591] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T21:37:22.288789] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-25T21:37:22.695910] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T21:37:22.840563] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-25T21:37:23.088728] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-25T21:37:23.888726] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-25T21:37:24.149623] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-25T21:37:24.231059] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-25T21:37:24.232221] [INFO ] [REMOTE ] THIR: Full fetch complete (2678 records). [2025-09-25T21:37:24.232295] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-25T21:37:24.611960] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-25T21:37:24.612047] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-25T21:37:24.612157] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-25T21:37:24.612195] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-25T21:37:24.612575] [DEBUG] [LOCAL ] THIR: Trimmed 2678 records to 2219 (keeping 200 days of data) [2025-09-25T21:37:24.626915] [DEBUG] [LOCAL ] THIR: Primary data saved (2219 records). [2025-09-25T21:37:24.627023] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-25T21:37:24.627108] [INFO ] [MAIN ] Update Progress: 2085/2372 symbols completed. THIR took 18.6s. Estimated remaining: 38m 11s. Rate: 7.5 symbols/min [2025-09-25T21:37:24.694045] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-25T21:37:24.831133] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:24.838109] [DEBUG] [LOCAL ] THLV: Loaded 1609 existing records from primary storage. [2025-09-25T21:37:24.838210] [INFO ] [MAIN ] THLV: Loaded 1609 existing records. [2025-09-25T21:37:25.037393] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:25.038293] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-25T21:37:25.038343] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-25T21:37:25.038532] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-25T21:37:25.038631] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-25T21:37:25.470043] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:25.488675] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-25T21:37:25.939271] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-25T21:37:26.288728] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-25T21:37:27.094795] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-25T21:37:27.116478] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-25T21:37:27.130914] [INFO ] [REMOTE ] TGT: Full fetch complete (77860 records). [2025-09-25T21:37:27.131118] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-25T21:37:27.181824] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-25T21:37:27.223874] [INFO ] [REMOTE ] THG: Full fetch complete (31064 records). [2025-09-25T21:37:27.224115] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-25T21:37:27.615078] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-25T21:37:27.888702] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-25T21:37:28.083668] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-25T21:37:28.083812] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-25T21:37:28.084678] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-25T21:37:28.088443] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-25T21:37:28.090781] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-25T21:37:28.090838] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-25T21:37:28.091839] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-25T21:37:28.091904] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-25T21:37:28.092991] [DEBUG] [LOCAL ] THG: Trimmed 31064 records to 21891 (keeping 200 days of data) [2025-09-25T21:37:28.096607] [DEBUG] [LOCAL ] TGT: Trimmed 77860 records to 54168 (keeping 200 days of data) [2025-09-25T21:37:28.425302] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-25T21:37:28.524549] [DEBUG] [LOCAL ] THG: Primary data saved (21891 records). [2025-09-25T21:37:28.524741] [INFO ] [MAIN ] THG: Full history saved. [2025-09-25T21:37:28.524854] [INFO ] [MAIN ] Update Progress: 2086/2372 symbols completed. THG took 26.6s. Estimated remaining: 38m 2s. Rate: 7.5 symbols/min [2025-09-25T21:37:28.689896] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-25T21:37:28.864804] [DEBUG] [LOCAL ] TGT: Primary data saved (54168 records). [2025-09-25T21:37:28.865059] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-25T21:37:28.865176] [INFO ] [MAIN ] Update Progress: 2087/2372 symbols completed. TGT took 43.5s. Estimated remaining: 37m 53s. Rate: 7.5 symbols/min [2025-09-25T21:37:28.960912] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:29.114051] [DEBUG] [LOCAL ] THO: Loaded 42345 existing records from primary storage. [2025-09-25T21:37:29.114208] [INFO ] [MAIN ] THO: Loaded 42345 existing records. [2025-09-25T21:37:29.164978] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T21:37:29.183578] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:29.261069] [DEBUG] [LOCAL ] THQ: Loaded 24522 existing records from primary storage. [2025-09-25T21:37:29.261239] [INFO ] [MAIN ] THQ: Loaded 24522 existing records. [2025-09-25T21:37:29.496979] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-25T21:37:29.550442] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:29.556965] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-25T21:37:29.557044] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-25T21:37:29.566673] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-25T21:37:29.584957] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-25T21:37:29.618947] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:29.619278] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-25T21:37:29.619329] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-25T21:37:29.619628] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-25T21:37:29.619727] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-25T21:37:30.011599] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T21:37:30.292533] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-25T21:37:30.369163] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:30.454975] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:31.088810] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-25T21:37:31.541607] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-25T21:37:31.888792] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-25T21:37:32.229866] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T21:37:32.247774] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T21:37:32.688763] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-25T21:37:33.054045] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-25T21:37:33.488830] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-25T21:37:33.850204] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-25T21:37:34.288746] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-25T21:37:35.088780] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-25T21:37:35.737806] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:37:35.888686] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-25T21:37:36.215238] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T21:37:36.688773] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-25T21:37:37.072385] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-25T21:37:37.073693] [INFO ] [REMOTE ] THLV: Full fetch complete (2681 records). [2025-09-25T21:37:37.073799] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-25T21:37:37.449181] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:37:37.494191] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-25T21:37:37.550631] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-25T21:37:37.550863] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-25T21:37:37.551028] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-25T21:37:37.551159] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-25T21:37:37.551587] [DEBUG] [LOCAL ] THLV: Trimmed 2681 records to 1612 (keeping 200 days of data) [2025-09-25T21:37:37.564138] [DEBUG] [LOCAL ] THLV: Primary data saved (1612 records). [2025-09-25T21:37:37.564234] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-25T21:37:37.564491] [INFO ] [MAIN ] Update Progress: 2088/2372 symbols completed. THLV took 12.9s. Estimated remaining: 37m 45s. Rate: 7.5 symbols/min [2025-09-25T21:37:37.757380] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:37.795464] [DEBUG] [LOCAL ] THR: Loaded 19903 existing records from primary storage. [2025-09-25T21:37:37.795619] [INFO ] [MAIN ] THR: Loaded 19903 existing records. [2025-09-25T21:37:37.987094] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:37.987747] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-25T21:37:37.987803] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-25T21:37:37.988299] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-25T21:37:37.988371] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-25T21:37:38.293809] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-25T21:37:38.378730] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:38.497730] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T21:37:39.088799] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-25T21:37:39.634359] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T21:37:39.888828] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-25T21:37:40.577185] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:37:40.688776] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-25T21:37:40.951860] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T21:37:41.488870] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-25T21:37:42.288728] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-25T21:37:42.570519] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-25T21:37:42.598036] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T21:37:43.088781] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-25T21:37:43.888738] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-25T21:37:44.048466] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T21:37:44.388920] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T21:37:44.688705] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-25T21:37:44.893675] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-25T21:37:45.488742] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-25T21:37:46.231459] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T21:37:46.288741] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-25T21:37:47.088843] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-25T21:37:47.217418] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:37:47.467473] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T21:37:47.476311] [INFO ] [REMOTE ] THC: Full fetch complete (69478 records). [2025-09-25T21:37:47.476527] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-25T21:37:47.888742] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-25T21:37:47.996247] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-25T21:37:47.996350] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-25T21:37:47.998515] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-25T21:37:47.998608] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-25T21:37:48.000209] [DEBUG] [LOCAL ] THC: Trimmed 69478 records to 48304 (keeping 200 days of data) [2025-09-25T21:37:48.343348] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-25T21:37:48.351015] [DEBUG] [LOCAL ] THC: Primary data saved (48304 records). [2025-09-25T21:37:48.351170] [INFO ] [MAIN ] THC: Full history saved. [2025-09-25T21:37:48.352873] [INFO ] [MAIN ] Update Progress: 2089/2372 symbols completed. THC took 53.3s. Estimated remaining: 37m 38s. Rate: 7.5 symbols/min [2025-09-25T21:37:48.536097] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:37:48.594011] [DEBUG] [LOCAL ] THS: Loaded 38007 existing records from primary storage. [2025-09-25T21:37:48.594171] [INFO ] [MAIN ] THS: Loaded 38007 existing records. [2025-09-25T21:37:48.693792] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-25T21:37:48.799240] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:37:48.799592] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-25T21:37:48.799673] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-25T21:37:48.800052] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-25T21:37:48.800116] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-25T21:37:49.100708] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T21:37:49.227801] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:37:49.488703] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-25T21:37:49.836126] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-25T21:37:50.288734] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-25T21:37:50.962079] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T21:37:51.088760] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-25T21:37:51.471927] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T21:37:51.888736] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-25T21:37:52.520355] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-25T21:37:52.688743] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-25T21:37:53.035610] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-25T21:37:53.488774] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-25T21:37:54.138222] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:37:54.201017] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T21:37:54.288703] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-25T21:37:55.088733] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-25T21:37:55.758843] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T21:37:55.888735] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-25T21:37:56.242610] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T21:37:56.688733] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-25T21:37:57.336937] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T21:37:57.488721] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-25T21:37:57.777552] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T21:37:58.288720] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-25T21:37:58.713796] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-25T21:37:59.088760] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-25T21:37:59.641560] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T21:37:59.888744] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-25T21:38:00.407080] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:38:00.688744] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-25T21:38:01.421613] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T21:38:01.488735] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-25T21:38:01.922428] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T21:38:01.929240] [INFO ] [REMOTE ] THQ: Full fetch complete (34887 records). [2025-09-25T21:38:01.929327] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-25T21:38:02.289704] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-25T21:38:02.371726] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-25T21:38:02.371818] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-25T21:38:02.372559] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-25T21:38:02.372599] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-25T21:38:02.373499] [DEBUG] [LOCAL ] THQ: Trimmed 34887 records to 24695 (keeping 200 days of data) [2025-09-25T21:38:02.554016] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T21:38:02.589801] [DEBUG] [LOCAL ] THQ: Primary data saved (24695 records). [2025-09-25T21:38:02.589957] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-25T21:38:02.590066] [INFO ] [MAIN ] Update Progress: 2090/2372 symbols completed. THQ took 33.7s. Estimated remaining: 37m 31s. Rate: 7.5 symbols/min [2025-09-25T21:38:02.774018] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:02.801105] [DEBUG] [LOCAL ] THW: Loaded 19134 existing records from primary storage. [2025-09-25T21:38:02.801248] [INFO ] [MAIN ] THW: Loaded 19134 existing records. [2025-09-25T21:38:02.992542] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:02.992906] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-25T21:38:02.992957] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-25T21:38:02.993206] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-25T21:38:02.993265] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-25T21:38:03.090448] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-25T21:38:03.391004] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:03.862316] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T21:38:03.888722] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-25T21:38:04.688752] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-25T21:38:04.730034] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T21:38:04.786843] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T21:38:05.488752] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-25T21:38:06.288700] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-25T21:38:06.328666] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T21:38:06.342378] [INFO ] [REMOTE ] THO: Full fetch complete (60235 records). [2025-09-25T21:38:06.342590] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-25T21:38:06.673470] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T21:38:06.802764] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-25T21:38:06.802856] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-25T21:38:06.803892] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-25T21:38:06.803957] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-25T21:38:06.805366] [DEBUG] [LOCAL ] THO: Trimmed 60235 records to 42681 (keeping 200 days of data) [2025-09-25T21:38:07.083815] [DEBUG] [LOCAL ] THO: Primary data saved (42681 records). [2025-09-25T21:38:07.083955] [INFO ] [MAIN ] THO: Full history saved. [2025-09-25T21:38:07.084112] [INFO ] [MAIN ] Update Progress: 2091/2372 symbols completed. THO took 38.6s. Estimated remaining: 37m 22s. Rate: 7.5 symbols/min [2025-09-25T21:38:07.095323] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-25T21:38:07.274668] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:07.274886] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-25T21:38:07.274926] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-25T21:38:07.275633] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-25T21:38:07.275722] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-25T21:38:07.275775] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-25T21:38:07.275811] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-25T21:38:07.309854] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-25T21:38:07.685556] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:07.873596] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-25T21:38:07.888680] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-25T21:38:08.688731] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-25T21:38:08.723357] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:38:08.919954] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:38:08.920362] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-25T21:38:09.488731] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-25T21:38:10.288743] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-25T21:38:10.544206] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-25T21:38:11.088683] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-25T21:38:11.502111] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:38:11.888717] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-25T21:38:12.170718] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T21:38:12.688700] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-25T21:38:13.062816] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T21:38:13.069694] [INFO ] [REMOTE ] THR: Full fetch complete (28835 records). [2025-09-25T21:38:13.069808] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-25T21:38:13.484182] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-25T21:38:13.484318] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-25T21:38:13.485018] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-25T21:38:13.485087] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-25T21:38:13.485962] [DEBUG] [LOCAL ] THR: Trimmed 28835 records to 20062 (keeping 200 days of data) [2025-09-25T21:38:13.488678] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-25T21:38:13.641303] [DEBUG] [LOCAL ] THR: Primary data saved (20062 records). [2025-09-25T21:38:13.641472] [INFO ] [MAIN ] THR: Full history saved. [2025-09-25T21:38:13.641583] [INFO ] [MAIN ] Update Progress: 2092/2372 symbols completed. THR took 36.1s. Estimated remaining: 37m 14s. Rate: 7.5 symbols/min [2025-09-25T21:38:13.774525] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:38:13.774946] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-25T21:38:13.838607] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:38:13.887579] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:13.954273] [DEBUG] [LOCAL ] TIMB: Loaded 36658 existing records from primary storage. [2025-09-25T21:38:13.954463] [INFO ] [MAIN ] TIMB: Loaded 36658 existing records. [2025-09-25T21:38:14.252113] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:14.252557] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-25T21:38:14.252612] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-25T21:38:14.253088] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-25T21:38:14.253160] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-25T21:38:14.292532] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-25T21:38:14.782038] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T21:38:14.791408] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:15.088751] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-25T21:38:15.838532] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-25T21:38:15.888712] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-25T21:38:16.688703] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-25T21:38:16.976430] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T21:38:17.488761] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-25T21:38:18.239741] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:38:18.288697] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-25T21:38:18.530937] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T21:38:19.088689] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-25T21:38:19.413552] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-25T21:38:19.888805] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-25T21:38:20.100149] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-25T21:38:20.688704] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-25T21:38:20.892870] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-25T21:38:20.898149] [INFO ] [REMOTE ] THW: Full fetch complete (29324 records). [2025-09-25T21:38:20.898278] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-25T21:38:21.298115] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-25T21:38:21.298201] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-25T21:38:21.298825] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-25T21:38:21.298887] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-25T21:38:21.300029] [DEBUG] [LOCAL ] THW: Trimmed 29324 records to 19235 (keeping 200 days of data) [2025-09-25T21:38:21.448462] [DEBUG] [LOCAL ] THW: Primary data saved (19235 records). [2025-09-25T21:38:21.448754] [INFO ] [MAIN ] THW: Full history saved. [2025-09-25T21:38:21.449090] [INFO ] [MAIN ] Update Progress: 2093/2372 symbols completed. THW took 18.9s. Estimated remaining: 37m 6s. Rate: 7.5 symbols/min [2025-09-25T21:38:21.494753] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-25T21:38:21.669063] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:21.682367] [DEBUG] [LOCAL ] TISI: Loaded 3787 existing records from primary storage. [2025-09-25T21:38:21.682516] [INFO ] [MAIN ] TISI: Loaded 3787 existing records. [2025-09-25T21:38:21.892538] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:21.893886] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-25T21:38:21.893939] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-25T21:38:21.894162] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-25T21:38:21.894222] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-25T21:38:22.261072] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:38:22.293773] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-25T21:38:22.355663] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:23.024566] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T21:38:23.088736] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-25T21:38:23.836317] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T21:38:23.888711] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-25T21:38:24.551433] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T21:38:24.688730] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-25T21:38:24.761694] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T21:38:25.488759] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-25T21:38:26.203548] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T21:38:26.226805] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:38:26.235960] [INFO ] [REMOTE ] THS: Full fetch complete (53679 records). [2025-09-25T21:38:26.236168] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-25T21:38:26.294715] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-25T21:38:26.717049] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-25T21:38:26.717173] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-25T21:38:26.718301] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-25T21:38:26.718400] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-25T21:38:26.719975] [DEBUG] [LOCAL ] THS: Trimmed 53679 records to 38320 (keeping 200 days of data) [2025-09-25T21:38:26.804351] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T21:38:26.985822] [DEBUG] [LOCAL ] THS: Primary data saved (38320 records). [2025-09-25T21:38:26.985995] [INFO ] [MAIN ] THS: Full history saved. [2025-09-25T21:38:26.986220] [INFO ] [MAIN ] Update Progress: 2094/2372 symbols completed. THS took 38.6s. Estimated remaining: 36m 58s. Rate: 7.5 symbols/min [2025-09-25T21:38:27.094093] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-25T21:38:27.180712] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:27.222333] [DEBUG] [LOCAL ] TIXT: Loaded 31483 existing records from primary storage. [2025-09-25T21:38:27.222498] [INFO ] [MAIN ] TIXT: Loaded 31483 existing records. [2025-09-25T21:38:27.433001] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:27.434877] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-25T21:38:27.434968] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-25T21:38:27.435505] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-25T21:38:27.435591] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-25T21:38:27.860933] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:27.888724] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-25T21:38:28.664537] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:38:28.688674] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-25T21:38:29.229413] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T21:38:29.488752] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-25T21:38:30.074084] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T21:38:30.288877] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-25T21:38:30.876094] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T21:38:31.001803] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T21:38:31.088753] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-25T21:38:31.888789] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-25T21:38:32.578040] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-25T21:38:32.688727] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-25T21:38:33.148240] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-25T21:38:33.193974] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T21:38:33.488737] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-25T21:38:34.288710] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-25T21:38:34.623518] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-25T21:38:35.088723] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-25T21:38:35.888750] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-25T21:38:35.945954] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T21:38:35.956046] [INFO ] [REMOTE ] TIC: Full fetch complete (38689 records). [2025-09-25T21:38:35.956187] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-25T21:38:36.180815] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 151 unique days, need 200 days [2025-09-25T21:38:36.181434] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:38:36.181519] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:38:36.181599] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-25T21:38:36.181776] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-25T21:38:36.181845] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-25T21:38:36.181927] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-25T21:38:36.182071] [INFO ] [MAIN ] Update Progress: 2095/2372 symbols completed. TIC took 29.1s. Estimated remaining: 36m 50s. Rate: 7.5 symbols/min [2025-09-25T21:38:36.344389] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:38:36.403084] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-25T21:38:36.408595] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:36.491704] [DEBUG] [LOCAL ] TJX: Loaded 53669 existing records from primary storage. [2025-09-25T21:38:36.491892] [INFO ] [MAIN ] TJX: Loaded 53669 existing records. [2025-09-25T21:38:36.687231] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:36.687502] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-25T21:38:36.687554] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-25T21:38:36.688052] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-25T21:38:36.688134] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-25T21:38:36.693124] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-25T21:38:37.071708] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:37.488758] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-25T21:38:37.902209] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T21:38:38.123160] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T21:38:38.288730] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-25T21:38:39.088765] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-25T21:38:39.706845] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T21:38:39.738575] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:38:39.888736] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-25T21:38:40.368709] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T21:38:40.688741] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-25T21:38:41.488749] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-25T21:38:41.966346] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-25T21:38:41.968993] [INFO ] [REMOTE ] TISI: Full fetch complete (4954 records). [2025-09-25T21:38:41.969071] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-25T21:38:42.295734] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-25T21:38:42.415772] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-25T21:38:42.415864] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-25T21:38:42.416020] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-25T21:38:42.416059] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-25T21:38:42.416474] [DEBUG] [LOCAL ] TISI: Trimmed 4954 records to 3795 (keeping 200 days of data) [2025-09-25T21:38:42.443191] [DEBUG] [LOCAL ] TISI: Primary data saved (3795 records). [2025-09-25T21:38:42.443315] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-25T21:38:42.443492] [INFO ] [MAIN ] Update Progress: 2096/2372 symbols completed. TISI took 21.0s. Estimated remaining: 36m 42s. Rate: 7.5 symbols/min [2025-09-25T21:38:42.645805] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:42.699377] [DEBUG] [LOCAL ] TK: Loaded 39711 existing records from primary storage. [2025-09-25T21:38:42.699545] [INFO ] [MAIN ] TK: Loaded 39711 existing records. [2025-09-25T21:38:42.855175] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-25T21:38:42.964256] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:42.964836] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-25T21:38:42.964908] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-25T21:38:42.965406] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-25T21:38:42.965477] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-25T21:38:43.093799] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-25T21:38:43.415229] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:43.779051] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T21:38:43.888733] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-25T21:38:44.521503] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T21:38:44.688751] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-25T21:38:45.495153] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-25T21:38:45.515784] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T21:38:46.127819] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T21:38:46.288741] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-25T21:38:47.088761] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-25T21:38:47.481834] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-25T21:38:47.833534] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:38:47.888705] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-25T21:38:48.672759] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:38:48.688710] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-25T21:38:49.256129] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-25T21:38:49.488724] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-25T21:38:50.288801] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-25T21:38:50.583479] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T21:38:50.656927] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T21:38:51.088751] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-25T21:38:51.259339] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T21:38:51.888724] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-25T21:38:52.416112] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T21:38:52.688736] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-25T21:38:53.459224] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T21:38:53.488688] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-25T21:38:53.873026] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T21:38:53.883502] [INFO ] [REMOTE ] TIXT: Full fetch complete (45663 records). [2025-09-25T21:38:53.883684] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-25T21:38:54.289026] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-25T21:38:54.322407] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-25T21:38:54.322496] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-25T21:38:54.323438] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-25T21:38:54.323502] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-25T21:38:54.324547] [DEBUG] [LOCAL ] TIXT: Trimmed 45663 records to 31678 (keeping 200 days of data) [2025-09-25T21:38:54.507918] [DEBUG] [LOCAL ] TIXT: Primary data saved (31678 records). [2025-09-25T21:38:54.508079] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-25T21:38:54.508187] [INFO ] [MAIN ] Update Progress: 2097/2372 symbols completed. TIXT took 27.5s. Estimated remaining: 36m 34s. Rate: 7.5 symbols/min [2025-09-25T21:38:54.694233] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:38:54.755465] [DEBUG] [LOCAL ] TKC: Loaded 38381 existing records from primary storage. [2025-09-25T21:38:54.755627] [INFO ] [MAIN ] TKC: Loaded 38381 existing records. [2025-09-25T21:38:54.957097] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:38:54.957346] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-25T21:38:54.957395] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-25T21:38:54.957872] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-25T21:38:54.957938] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-25T21:38:55.093892] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-25T21:38:55.214529] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:38:55.397050] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:38:55.888743] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-25T21:38:56.284951] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T21:38:56.649408] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T21:38:56.688734] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-25T21:38:57.071934] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T21:38:57.488759] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-25T21:38:58.013000] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T21:38:58.288739] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-25T21:38:59.088679] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-25T21:38:59.648154] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-25T21:38:59.688130] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T21:38:59.888725] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-25T21:39:00.315066] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T21:39:00.688786] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-25T21:39:00.979630] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T21:39:01.488732] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-25T21:39:01.986376] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T21:39:02.288742] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-25T21:39:03.088680] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-25T21:39:03.613091] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T21:39:03.810860] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T21:39:03.888733] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-25T21:39:04.332786] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T21:39:04.341819] [INFO ] [REMOTE ] TIMB: Full fetch complete (54691 records). [2025-09-25T21:39:04.341976] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-25T21:39:04.693853] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-25T21:39:04.756928] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-25T21:39:04.757013] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-25T21:39:04.758121] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-25T21:39:04.758188] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-25T21:39:04.760464] [DEBUG] [LOCAL ] TIMB: Trimmed 54691 records to 36834 (keeping 200 days of data) [2025-09-25T21:39:05.008840] [DEBUG] [LOCAL ] TIMB: Primary data saved (36834 records). [2025-09-25T21:39:05.008983] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-25T21:39:05.009094] [INFO ] [MAIN ] Update Progress: 2098/2372 symbols completed. TIMB took 51.4s. Estimated remaining: 36m 27s. Rate: 7.5 symbols/min [2025-09-25T21:39:05.198764] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:05.268571] [DEBUG] [LOCAL ] TKO: Loaded 44166 existing records from primary storage. [2025-09-25T21:39:05.268800] [INFO ] [MAIN ] TKO: Loaded 44166 existing records. [2025-09-25T21:39:05.408460] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T21:39:05.513725] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-25T21:39:05.521295] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:05.521576] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-25T21:39:05.521628] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-25T21:39:05.523059] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-25T21:39:05.523120] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-25T21:39:05.888458] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:06.288740] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-25T21:39:06.732362] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-25T21:39:06.978314] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:39:07.088733] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-25T21:39:07.608386] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T21:39:07.888750] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-25T21:39:08.688743] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-25T21:39:09.065024] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T21:39:09.493869] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-25T21:39:09.512748] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T21:39:10.132521] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T21:39:10.139364] [INFO ] [REMOTE ] TK: Full fetch complete (56908 records). [2025-09-25T21:39:10.139495] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-25T21:39:10.296676] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-25T21:39:10.565211] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-25T21:39:10.565308] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-25T21:39:10.566375] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-25T21:39:10.566441] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-25T21:39:10.567860] [DEBUG] [LOCAL ] TK: Trimmed 56908 records to 39941 (keeping 200 days of data) [2025-09-25T21:39:10.823542] [DEBUG] [LOCAL ] TK: Primary data saved (39941 records). [2025-09-25T21:39:10.823742] [INFO ] [MAIN ] TK: Full history saved. [2025-09-25T21:39:10.823882] [INFO ] [MAIN ] Update Progress: 2099/2372 symbols completed. TK took 28.4s. Estimated remaining: 36m 18s. Rate: 7.5 symbols/min [2025-09-25T21:39:11.019195] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:11.073579] [DEBUG] [LOCAL ] TKR: Loaded 40238 existing records from primary storage. [2025-09-25T21:39:11.073789] [INFO ] [MAIN ] TKR: Loaded 40238 existing records. [2025-09-25T21:39:11.121281] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-25T21:39:11.281723] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:11.282364] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-25T21:39:11.282416] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-25T21:39:11.282889] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-25T21:39:11.282948] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-25T21:39:11.643258] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-25T21:39:11.785230] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:11.878291] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T21:39:11.888851] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-25T21:39:12.688787] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-25T21:39:12.834153] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T21:39:13.488990] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-25T21:39:13.488842] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T21:39:13.679008] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T21:39:14.288830] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-25T21:39:14.906026] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T21:39:15.088713] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-25T21:39:15.771880] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T21:39:15.888699] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-25T21:39:16.608601] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T21:39:16.688739] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-25T21:39:17.358897] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-25T21:39:17.488740] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-25T21:39:17.858441] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T21:39:18.288733] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-25T21:39:18.697165] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T21:39:18.708989] [INFO ] [REMOTE ] TKC: Full fetch complete (51486 records). [2025-09-25T21:39:18.709165] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-25T21:39:19.092527] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-25T21:39:19.138910] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-25T21:39:19.139204] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-25T21:39:19.140290] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-25T21:39:19.140425] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-25T21:39:19.141873] [DEBUG] [LOCAL ] TKC: Trimmed 51486 records to 38717 (keeping 200 days of data) [2025-09-25T21:39:19.390625] [DEBUG] [LOCAL ] TKC: Primary data saved (38717 records). [2025-09-25T21:39:19.390818] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-25T21:39:19.390994] [INFO ] [MAIN ] Update Progress: 2100/2372 symbols completed. TKC took 24.9s. Estimated remaining: 36m 10s. Rate: 7.5 symbols/min [2025-09-25T21:39:19.579383] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:19.641798] [DEBUG] [LOCAL ] TLK: Loaded 39448 existing records from primary storage. [2025-09-25T21:39:19.641947] [INFO ] [MAIN ] TLK: Loaded 39448 existing records. [2025-09-25T21:39:19.857685] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T21:39:19.880960] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:19.881261] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-25T21:39:19.881313] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-25T21:39:19.883748] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-25T21:39:19.883827] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-25T21:39:19.889375] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-25T21:39:20.290540] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:20.646041] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T21:39:20.688734] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-25T21:39:21.488816] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-25T21:39:21.541595] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:39:21.964731] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T21:39:22.288739] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-25T21:39:23.046759] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:39:23.060705] [INFO ] [REMOTE ] TJX: Full fetch complete (77677 records). [2025-09-25T21:39:23.060871] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-25T21:39:23.094928] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-25T21:39:23.223927] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:39:23.535306] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-25T21:39:23.536082] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-25T21:39:23.537323] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-25T21:39:23.537399] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-25T21:39:23.541486] [DEBUG] [LOCAL ] TJX: Trimmed 77677 records to 54059 (keeping 200 days of data) [2025-09-25T21:39:23.888895] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-25T21:39:23.915956] [DEBUG] [LOCAL ] TJX: Primary data saved (54059 records). [2025-09-25T21:39:23.916123] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-25T21:39:23.916263] [INFO ] [MAIN ] Update Progress: 2101/2372 symbols completed. TJX took 47.7s. Estimated remaining: 36m 2s. Rate: 7.5 symbols/min [2025-09-25T21:39:24.100777] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:24.126175] [DEBUG] [LOCAL ] TLYS: Loaded 16973 existing records from primary storage. [2025-09-25T21:39:24.126367] [INFO ] [MAIN ] TLYS: Loaded 16973 existing records. [2025-09-25T21:39:24.310917] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:24.311298] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-25T21:39:24.311359] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-25T21:39:24.311625] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-25T21:39:24.311723] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-25T21:39:24.694709] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-25T21:39:24.744615] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:24.838612] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T21:39:25.488693] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-25T21:39:25.610413] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T21:39:25.930932] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-25T21:39:26.288838] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-25T21:39:26.847813] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-25T21:39:27.088746] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-25T21:39:27.607913] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T21:39:27.888725] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-25T21:39:28.519377] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-25T21:39:28.620866] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T21:39:28.688733] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-25T21:39:29.488757] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-25T21:39:30.159056] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-25T21:39:30.288748] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-25T21:39:31.088778] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-25T21:39:31.123217] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T21:39:31.152264] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T21:39:31.888808] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-25T21:39:32.594042] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T21:39:32.688690] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-25T21:39:32.807939] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T21:39:32.822454] [INFO ] [REMOTE ] TKO: Full fetch complete (64629 records). [2025-09-25T21:39:32.822662] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-25T21:39:33.253767] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-25T21:39:33.253902] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-25T21:39:33.254996] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-25T21:39:33.255060] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-25T21:39:33.256426] [DEBUG] [LOCAL ] TKO: Trimmed 64629 records to 44485 (keeping 200 days of data) [2025-09-25T21:39:33.502753] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-25T21:39:33.568034] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T21:39:33.592594] [DEBUG] [LOCAL ] TKO: Primary data saved (44485 records). [2025-09-25T21:39:33.592887] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-25T21:39:33.593123] [INFO ] [MAIN ] Update Progress: 2102/2372 symbols completed. TKO took 28.6s. Estimated remaining: 35m 54s. Rate: 7.5 symbols/min [2025-09-25T21:39:33.788894] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:33.846003] [DEBUG] [LOCAL ] TM: Loaded 36600 existing records from primary storage. [2025-09-25T21:39:33.846161] [INFO ] [MAIN ] TM: Loaded 36600 existing records. [2025-09-25T21:39:34.038873] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:34.039204] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-25T21:39:34.039274] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-25T21:39:34.039736] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-25T21:39:34.039818] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-25T21:39:34.294171] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-25T21:39:34.421279] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:34.966631] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:39:35.088704] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-25T21:39:35.200438] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T21:39:35.889048] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-25T21:39:36.688737] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-25T21:39:36.774595] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T21:39:36.795150] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T21:39:37.488729] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-25T21:39:38.278520] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T21:39:38.289362] [INFO ] [REMOTE ] TKR: Full fetch complete (57754 records). [2025-09-25T21:39:38.289579] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-25T21:39:38.288773] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-25T21:39:38.721194] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-25T21:39:38.721306] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-25T21:39:38.722356] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-25T21:39:38.722426] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-25T21:39:38.725963] [DEBUG] [LOCAL ] TKR: Trimmed 57754 records to 40556 (keeping 200 days of data) [2025-09-25T21:39:38.996075] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T21:39:39.040374] [DEBUG] [LOCAL ] TKR: Primary data saved (40556 records). [2025-09-25T21:39:39.040526] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-25T21:39:39.040700] [INFO ] [MAIN ] Update Progress: 2103/2372 symbols completed. TKR took 28.2s. Estimated remaining: 35m 46s. Rate: 7.5 symbols/min [2025-09-25T21:39:39.092044] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-25T21:39:39.319690] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:39.394228] [DEBUG] [LOCAL ] TME: Loaded 53201 existing records from primary storage. [2025-09-25T21:39:39.394425] [INFO ] [MAIN ] TME: Loaded 53201 existing records. [2025-09-25T21:39:39.556198] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-25T21:39:39.621212] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:39.621964] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-25T21:39:39.622026] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-25T21:39:39.622509] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-25T21:39:39.622571] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-25T21:39:39.894736] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-25T21:39:40.049529] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:40.694122] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T21:39:40.705080] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-25T21:39:40.850245] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T21:39:41.488754] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-25T21:39:42.288781] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-25T21:39:42.586160] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-25T21:39:43.088692] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-25T21:39:43.203920] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T21:39:43.503115] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T21:39:43.888754] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-25T21:39:44.675813] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:39:44.688676] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-25T21:39:44.758688] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T21:39:45.488719] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-25T21:39:46.288709] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-25T21:39:46.468146] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T21:39:46.471425] [INFO ] [REMOTE ] TLYS: Full fetch complete (22008 records). [2025-09-25T21:39:46.471503] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-25T21:39:46.631154] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T21:39:46.904516] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-25T21:39:46.904611] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-25T21:39:46.905134] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-25T21:39:46.905199] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-25T21:39:46.906020] [DEBUG] [LOCAL ] TLYS: Trimmed 22008 records to 17017 (keeping 200 days of data) [2025-09-25T21:39:47.006100] [DEBUG] [LOCAL ] TLYS: Primary data saved (17017 records). [2025-09-25T21:39:47.006262] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-25T21:39:47.006351] [INFO ] [MAIN ] Update Progress: 2104/2372 symbols completed. TLYS took 23.1s. Estimated remaining: 35m 38s. Rate: 7.5 symbols/min [2025-09-25T21:39:47.095720] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-25T21:39:47.197397] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:39:47.246047] [DEBUG] [LOCAL ] TMHC: Loaded 45628 existing records from primary storage. [2025-09-25T21:39:47.246207] [INFO ] [MAIN ] TMHC: Loaded 45628 existing records. [2025-09-25T21:39:47.431767] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:39:47.432144] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-25T21:39:47.432193] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-25T21:39:47.432619] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-25T21:39:47.432740] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-25T21:39:47.819481] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:39:47.888701] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-25T21:39:48.080287] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T21:39:48.688743] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-25T21:39:48.891108] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:39:49.488817] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-25T21:39:49.573869] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:39:50.288707] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-25T21:39:50.545294] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T21:39:51.088733] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-25T21:39:51.149949] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T21:39:51.865976] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T21:39:51.888741] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-25T21:39:52.520785] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T21:39:52.688737] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-25T21:39:53.488690] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-25T21:39:53.876138] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T21:39:54.288736] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-25T21:39:54.626715] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-25T21:39:55.060336] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T21:39:55.088749] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-25T21:39:55.888682] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-25T21:39:56.019186] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T21:39:56.689037] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-25T21:39:56.728683] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:39:57.474393] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T21:39:57.488731] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-25T21:39:58.288758] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-25T21:39:58.685208] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T21:39:58.981139] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T21:39:58.994389] [INFO ] [REMOTE ] TLK: Full fetch complete (57288 records). [2025-09-25T21:39:58.994620] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-25T21:39:59.092268] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-25T21:39:59.447404] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-25T21:39:59.447520] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-25T21:39:59.448563] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-25T21:39:59.448709] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-25T21:39:59.450812] [DEBUG] [LOCAL ] TLK: Trimmed 57288 records to 39713 (keeping 200 days of data) [2025-09-25T21:39:59.736321] [DEBUG] [LOCAL ] TLK: Primary data saved (39713 records). [2025-09-25T21:39:59.736585] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-25T21:39:59.736887] [INFO ] [MAIN ] Update Progress: 2105/2372 symbols completed. TLK took 40.3s. Estimated remaining: 35m 31s. Rate: 7.5 symbols/min [2025-09-25T21:39:59.863539] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T21:39:59.889893] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-25T21:39:59.976014] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:00.045263] [DEBUG] [LOCAL ] TMO: Loaded 52330 existing records from primary storage. [2025-09-25T21:40:00.045433] [INFO ] [MAIN ] TMO: Loaded 52330 existing records. [2025-09-25T21:40:00.238315] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:00.238727] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-25T21:40:00.238785] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-25T21:40:00.239438] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-25T21:40:00.239511] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-25T21:40:00.678802] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:00.688672] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-25T21:40:00.760831] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:40:01.488833] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-25T21:40:02.288724] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-25T21:40:02.419308] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-25T21:40:02.580114] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T21:40:03.016199] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T21:40:03.088707] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-25T21:40:03.888789] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-25T21:40:04.174028] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T21:40:04.688750] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-25T21:40:04.812100] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T21:40:05.488818] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-25T21:40:05.973920] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-25T21:40:06.300932] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-25T21:40:06.302910] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T21:40:07.088785] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-25T21:40:07.635862] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-25T21:40:07.688494] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-25T21:40:07.888815] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-25T21:40:08.590305] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:40:08.596221] [INFO ] [REMOTE ] TM: Full fetch complete (52949 records). [2025-09-25T21:40:08.596341] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-25T21:40:08.695828] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-25T21:40:09.061119] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-25T21:40:09.061231] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-25T21:40:09.062225] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-25T21:40:09.062356] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-25T21:40:09.064913] [DEBUG] [LOCAL ] TM: Trimmed 52949 records to 36783 (keeping 200 days of data) [2025-09-25T21:40:09.340898] [DEBUG] [LOCAL ] TM: Primary data saved (36783 records). [2025-09-25T21:40:09.341107] [INFO ] [MAIN ] TM: Full history saved. [2025-09-25T21:40:09.341285] [INFO ] [MAIN ] Update Progress: 2106/2372 symbols completed. TM took 35.7s. Estimated remaining: 35m 23s. Rate: 7.5 symbols/min [2025-09-25T21:40:09.493801] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-25T21:40:09.514040] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T21:40:09.586193] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:09.617102] [DEBUG] [LOCAL ] TNC: Loaded 15142 existing records from primary storage. [2025-09-25T21:40:09.617248] [INFO ] [MAIN ] TNC: Loaded 15142 existing records. [2025-09-25T21:40:09.815906] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:09.816536] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-25T21:40:09.816616] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-25T21:40:09.816945] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-25T21:40:09.817030] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-25T21:40:10.221882] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:10.265849] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T21:40:10.288709] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-25T21:40:11.088688] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-25T21:40:11.272986] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:40:11.285486] [INFO ] [REMOTE ] TME: Full fetch complete (76929 records). [2025-09-25T21:40:11.285696] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-25T21:40:11.402300] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T21:40:11.745675] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-25T21:40:11.745791] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-25T21:40:11.747128] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-25T21:40:11.747194] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-25T21:40:11.748836] [DEBUG] [LOCAL ] TME: Trimmed 76929 records to 53589 (keeping 200 days of data) [2025-09-25T21:40:11.889230] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-25T21:40:12.118967] [DEBUG] [LOCAL ] TME: Primary data saved (53589 records). [2025-09-25T21:40:12.119125] [INFO ] [MAIN ] TME: Full history saved. [2025-09-25T21:40:12.119255] [INFO ] [MAIN ] Update Progress: 2107/2372 symbols completed. TME took 33.1s. Estimated remaining: 35m 14s. Rate: 7.5 symbols/min [2025-09-25T21:40:12.327924] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:12.374710] [DEBUG] [LOCAL ] TNET: Loaded 28809 existing records from primary storage. [2025-09-25T21:40:12.374868] [INFO ] [MAIN ] TNET: Loaded 28809 existing records. [2025-09-25T21:40:12.577007] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:12.577276] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-25T21:40:12.577322] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-25T21:40:12.578009] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-25T21:40:12.578106] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-25T21:40:12.697728] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-25T21:40:13.005695] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T21:40:13.045386] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:13.488713] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-25T21:40:13.806975] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T21:40:14.078144] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-25T21:40:14.288734] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-25T21:40:14.748997] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T21:40:15.088783] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-25T21:40:15.888744] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-25T21:40:15.948098] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T21:40:15.996211] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T21:40:16.688735] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-25T21:40:17.488710] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-25T21:40:17.796631] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:40:18.099138] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-25T21:40:18.288723] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-25T21:40:18.622947] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T21:40:19.088739] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-25T21:40:19.888791] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-25T21:40:20.380176] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-25T21:40:20.477936] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T21:40:20.688715] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-25T21:40:21.033908] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T21:40:21.488711] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-25T21:40:22.163456] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T21:40:22.288733] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-25T21:40:23.069888] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T21:40:23.079633] [INFO ] [REMOTE ] TMHC: Full fetch complete (65975 records). [2025-09-25T21:40:23.079831] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-25T21:40:23.093972] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-25T21:40:23.549336] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-25T21:40:23.549441] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-25T21:40:23.550523] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-25T21:40:23.550594] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-25T21:40:23.552187] [DEBUG] [LOCAL ] TMHC: Trimmed 65975 records to 45968 (keeping 200 days of data) [2025-09-25T21:40:23.855288] [DEBUG] [LOCAL ] TMHC: Primary data saved (45968 records). [2025-09-25T21:40:23.855452] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-25T21:40:23.855599] [INFO ] [MAIN ] Update Progress: 2108/2372 symbols completed. TMHC took 36.8s. Estimated remaining: 35m 7s. Rate: 7.5 symbols/min [2025-09-25T21:40:23.893850] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-25T21:40:24.060523] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:24.060777] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-25T21:40:24.060834] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-25T21:40:24.061103] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-25T21:40:24.061148] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-25T21:40:24.061190] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-25T21:40:24.061222] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-25T21:40:24.169549] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T21:40:24.496919] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:24.671447] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T21:40:24.693818] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-25T21:40:24.697552] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:40:24.906899] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:24.907293] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-25T21:40:25.488733] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-25T21:40:26.288720] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-25T21:40:27.088734] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-25T21:40:27.278045] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-25T21:40:27.554611] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T21:40:27.888735] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-25T21:40:28.173968] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-25T21:40:28.688726] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-25T21:40:28.943016] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T21:40:29.488731] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-25T21:40:30.288703] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-25T21:40:30.388042] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-25T21:40:30.508069] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:30.508441] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-25T21:40:30.567538] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T21:40:31.088734] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-25T21:40:31.318550] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:31.318996] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-25T21:40:31.888748] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-25T21:40:32.688714] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-25T21:40:32.738019] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:40:32.741087] [INFO ] [REMOTE ] TNC: Full fetch complete (23134 records). [2025-09-25T21:40:32.741169] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-25T21:40:33.179912] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-25T21:40:33.180006] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-25T21:40:33.180509] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-25T21:40:33.180551] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-25T21:40:33.181351] [DEBUG] [LOCAL ] TNC: Trimmed 23134 records to 15213 (keeping 200 days of data) [2025-09-25T21:40:33.284907] [DEBUG] [LOCAL ] TNC: Primary data saved (15213 records). [2025-09-25T21:40:33.285073] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-25T21:40:33.285184] [INFO ] [MAIN ] Update Progress: 2109/2372 symbols completed. TNC took 23.9s. Estimated remaining: 34m 59s. Rate: 7.5 symbols/min [2025-09-25T21:40:33.496868] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-25T21:40:33.500965] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:40:33.515521] [INFO ] [REMOTE ] TMO: Full fetch complete (75460 records). [2025-09-25T21:40:33.533366] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-25T21:40:33.537374] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:33.815956] [DEBUG] [LOCAL ] TNK: Loaded 35229 existing records from primary storage. [2025-09-25T21:40:33.816109] [INFO ] [MAIN ] TNK: Loaded 35229 existing records. [2025-09-25T21:40:34.201541] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:34.223310] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-25T21:40:34.249100] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-25T21:40:34.290685] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-25T21:40:34.316606] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-25T21:40:34.316717] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-25T21:40:34.318204] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-25T21:40:34.318307] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-25T21:40:34.318684] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-25T21:40:34.318793] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-25T21:40:34.361854] [DEBUG] [LOCAL ] TMO: Trimmed 75460 records to 52717 (keeping 200 days of data) [2025-09-25T21:40:34.549038] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:34.554517] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-25T21:40:34.756237] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T21:40:35.095240] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-25T21:40:35.097156] [DEBUG] [LOCAL ] TMO: Primary data saved (52717 records). [2025-09-25T21:40:35.097242] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-25T21:40:35.098749] [INFO ] [MAIN ] Update Progress: 2110/2372 symbols completed. TMO took 35.4s. Estimated remaining: 34m 50s. Rate: 7.5 symbols/min [2025-09-25T21:40:35.178101] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:35.328908] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:35.335259] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:35.335629] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-25T21:40:35.390034] [DEBUG] [LOCAL ] TNL: Loaded 41895 existing records from primary storage. [2025-09-25T21:40:35.390286] [INFO ] [MAIN ] TNL: Loaded 41895 existing records. [2025-09-25T21:40:35.578604] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:35.578946] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-25T21:40:35.578995] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-25T21:40:35.579247] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-25T21:40:35.579309] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-25T21:40:35.893800] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-25T21:40:35.967035] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:36.688718] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-25T21:40:36.901051] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:40:36.901448] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-25T21:40:37.383994] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T21:40:37.488697] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-25T21:40:38.288725] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-25T21:40:38.931854] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:40:39.088726] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-25T21:40:39.834891] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:40:39.888735] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-25T21:40:40.447271] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T21:40:40.688742] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-25T21:40:41.406259] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-25T21:40:41.488732] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-25T21:40:41.851340] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-25T21:40:41.868573] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T21:40:41.874257] [INFO ] [REMOTE ] TNET: Full fetch complete (41735 records). [2025-09-25T21:40:41.874354] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-25T21:40:42.272948] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-25T21:40:42.273045] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-25T21:40:42.274084] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-25T21:40:42.274155] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-25T21:40:42.275369] [DEBUG] [LOCAL ] TNET: Trimmed 41735 records to 29060 (keeping 200 days of data) [2025-09-25T21:40:42.288744] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-25T21:40:42.478971] [DEBUG] [LOCAL ] TNET: Primary data saved (29060 records). [2025-09-25T21:40:42.479150] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-25T21:40:42.479267] [INFO ] [MAIN ] Update Progress: 2111/2372 symbols completed. TNET took 30.4s. Estimated remaining: 34m 42s. Rate: 7.5 symbols/min [2025-09-25T21:40:42.661203] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:42.725297] [DEBUG] [LOCAL ] TOL: Loaded 51079 existing records from primary storage. [2025-09-25T21:40:42.725471] [INFO ] [MAIN ] TOL: Loaded 51079 existing records. [2025-09-25T21:40:42.917195] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:42.917713] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-25T21:40:42.917774] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-25T21:40:42.918145] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-25T21:40:42.918249] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-25T21:40:43.101742] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-25T21:40:43.326239] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:43.558729] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T21:40:43.888737] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-25T21:40:44.688759] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-25T21:40:44.782942] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:40:45.335813] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T21:40:45.488701] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-25T21:40:45.571614] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T21:40:46.236112] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T21:40:46.288772] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-25T21:40:47.088818] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-25T21:40:47.888829] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-25T21:40:47.927339] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:40:48.611553] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T21:40:48.688690] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-25T21:40:49.488719] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-25T21:40:49.766461] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T21:40:50.170769] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T21:40:50.290104] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-25T21:40:51.088709] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-25T21:40:51.156427] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T21:40:51.209959] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T21:40:51.212177] [INFO ] [REMOTE ] TNGY: Full fetch complete (3302 records). [2025-09-25T21:40:51.212287] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-25T21:40:51.431775] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-25T21:40:51.432383] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:40:51.432498] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:40:51.432634] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-25T21:40:51.432764] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-25T21:40:51.432838] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-25T21:40:51.432919] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-25T21:40:51.433065] [INFO ] [MAIN ] Update Progress: 2112/2372 symbols completed. TNGY took 27.6s. Estimated remaining: 34m 34s. Rate: 7.5 symbols/min [2025-09-25T21:40:51.616943] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:40:51.712101] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-25T21:40:51.712300] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-25T21:40:51.891892] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-25T21:40:51.930840] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:40:51.931242] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-25T21:40:51.931301] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-25T21:40:51.931871] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-25T21:40:51.931934] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-25T21:40:52.339974] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:40:52.688762] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-25T21:40:52.918815] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T21:40:53.493922] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-25T21:40:53.510370] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T21:40:54.255780] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T21:40:54.288724] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-25T21:40:55.088737] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-25T21:40:55.560374] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-25T21:40:55.638679] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T21:40:55.888752] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-25T21:40:56.688716] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-25T21:40:56.783598] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T21:40:57.444453] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T21:40:57.488692] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-25T21:40:58.288774] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-25T21:40:58.668284] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-25T21:40:59.088696] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-25T21:40:59.605912] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-25T21:40:59.644960] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-25T21:40:59.888775] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-25T21:41:00.688719] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-25T21:41:01.059313] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-25T21:41:01.488825] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-25T21:41:01.526080] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T21:41:01.534617] [INFO ] [REMOTE ] TNL: Full fetch complete (58826 records). [2025-09-25T21:41:01.534856] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-25T21:41:02.023609] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-25T21:41:02.023744] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-25T21:41:02.024823] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-25T21:41:02.024908] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-25T21:41:02.026388] [DEBUG] [LOCAL ] TNL: Trimmed 58826 records to 42237 (keeping 200 days of data) [2025-09-25T21:41:02.323136] [DEBUG] [LOCAL ] TNL: Primary data saved (42237 records). [2025-09-25T21:41:02.323314] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-25T21:41:02.323485] [INFO ] [MAIN ] Update Progress: 2113/2372 symbols completed. TNL took 27.2s. Estimated remaining: 34m 27s. Rate: 7.5 symbols/min [2025-09-25T21:41:02.336723] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-25T21:41:02.525974] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:02.581486] [DEBUG] [LOCAL ] TPB: Loaded 24883 existing records from primary storage. [2025-09-25T21:41:02.581673] [INFO ] [MAIN ] TPB: Loaded 24883 existing records. [2025-09-25T21:41:02.622194] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:41:02.850999] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:02.851368] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-25T21:41:02.851448] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-25T21:41:02.852249] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-25T21:41:02.852356] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-25T21:41:02.968273] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:41:03.091928] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-25T21:41:03.331798] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:03.888737] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-25T21:41:04.077038] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T21:41:04.688702] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-25T21:41:04.979682] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-25T21:41:05.051246] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-25T21:41:05.488724] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-25T21:41:06.305879] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-25T21:41:06.311950] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-25T21:41:06.559401] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T21:41:07.088730] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-25T21:41:07.634125] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-25T21:41:07.888729] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-25T21:41:08.688735] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-25T21:41:08.929630] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T21:41:09.488721] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-25T21:41:09.823154] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T21:41:09.988272] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-25T21:41:10.288735] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-25T21:41:10.549594] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T21:41:10.559737] [INFO ] [REMOTE ] TNK: Full fetch complete (51827 records). [2025-09-25T21:41:10.559943] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-25T21:41:10.982542] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-25T21:41:10.982673] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-25T21:41:10.983784] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-25T21:41:10.983857] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-25T21:41:10.986749] [DEBUG] [LOCAL ] TNK: Trimmed 51827 records to 35468 (keeping 200 days of data) [2025-09-25T21:41:11.096261] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-25T21:41:11.235831] [DEBUG] [LOCAL ] TNK: Primary data saved (35468 records). [2025-09-25T21:41:11.236001] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-25T21:41:11.236185] [INFO ] [MAIN ] Update Progress: 2114/2372 symbols completed. TNK took 38.0s. Estimated remaining: 34m 19s. Rate: 7.5 symbols/min [2025-09-25T21:41:11.409500] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T21:41:11.447639] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:11.501367] [DEBUG] [LOCAL ] TPC: Loaded 38817 existing records from primary storage. [2025-09-25T21:41:11.501551] [INFO ] [MAIN ] TPC: Loaded 38817 existing records. [2025-09-25T21:41:11.690510] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:11.690946] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-25T21:41:11.690996] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-25T21:41:11.691307] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-25T21:41:11.691368] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-25T21:41:11.896726] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-25T21:41:12.084736] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:12.688753] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-25T21:41:13.108030] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T21:41:13.488783] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-25T21:41:13.922190] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T21:41:13.975728] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-25T21:41:14.288732] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-25T21:41:14.877608] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T21:41:15.080841] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T21:41:15.088819] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-25T21:41:15.888685] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-25T21:41:16.287504] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-25T21:41:16.688706] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-25T21:41:17.363245] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T21:41:17.488714] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-25T21:41:18.288723] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-25T21:41:18.601315] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-25T21:41:19.088736] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-25T21:41:19.637261] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T21:41:19.776568] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-25T21:41:19.888720] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-25T21:41:20.688757] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-25T21:41:20.966895] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T21:41:20.980916] [INFO ] [REMOTE ] TOL: Full fetch complete (73998 records). [2025-09-25T21:41:20.981204] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-25T21:41:21.509032] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-25T21:41:21.514125] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-25T21:41:21.514182] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-25T21:41:21.515634] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-25T21:41:21.515743] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-25T21:41:21.519059] [DEBUG] [LOCAL ] TOL: Trimmed 73998 records to 51422 (keeping 200 days of data) [2025-09-25T21:41:21.523947] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:41:21.842264] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:41:21.946291] [DEBUG] [LOCAL ] TOL: Primary data saved (51422 records). [2025-09-25T21:41:21.946445] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-25T21:41:21.946625] [INFO ] [MAIN ] Update Progress: 2115/2372 symbols completed. TOL took 39.5s. Estimated remaining: 34m 11s. Rate: 7.5 symbols/min [2025-09-25T21:41:22.131918] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:22.183109] [DEBUG] [LOCAL ] TPH: Loaded 45185 existing records from primary storage. [2025-09-25T21:41:22.183291] [INFO ] [MAIN ] TPH: Loaded 45185 existing records. [2025-09-25T21:41:22.288897] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-25T21:41:22.384431] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:22.384791] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-25T21:41:22.384849] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-25T21:41:22.385148] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-25T21:41:22.385206] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-25T21:41:22.768919] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:23.088721] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-25T21:41:23.438407] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T21:41:23.711298] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-25T21:41:23.888716] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-25T21:41:24.642839] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T21:41:24.688722] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-25T21:41:25.490430] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-25T21:41:25.493766] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-25T21:41:26.103972] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-25T21:41:26.288744] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-25T21:41:26.866164] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T21:41:27.088725] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-25T21:41:27.209462] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-25T21:41:27.215329] [INFO ] [REMOTE ] TPB: Full fetch complete (34716 records). [2025-09-25T21:41:27.215504] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-25T21:41:27.615350] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-25T21:41:27.615449] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-25T21:41:27.616291] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-25T21:41:27.616358] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-25T21:41:27.617609] [DEBUG] [LOCAL ] TPB: Trimmed 34716 records to 25164 (keeping 200 days of data) [2025-09-25T21:41:27.778111] [DEBUG] [LOCAL ] TPB: Primary data saved (25164 records). [2025-09-25T21:41:27.778263] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-25T21:41:27.778360] [INFO ] [MAIN ] Update Progress: 2116/2372 symbols completed. TPB took 25.5s. Estimated remaining: 34m 3s. Rate: 7.5 symbols/min [2025-09-25T21:41:27.889585] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-25T21:41:27.973214] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:27.993272] [DEBUG] [LOCAL ] TPL: Loaded 12393 existing records from primary storage. [2025-09-25T21:41:27.993416] [INFO ] [MAIN ] TPL: Loaded 12393 existing records. [2025-09-25T21:41:28.192759] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:28.193142] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-25T21:41:28.193200] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-25T21:41:28.193431] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-25T21:41:28.193492] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-25T21:41:28.643252] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:28.676492] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:41:28.688678] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-25T21:41:29.488736] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-25T21:41:29.989003] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-25T21:41:29.999128] [INFO ] [REMOTE ] TOST: Full fetch complete (77698 records). [2025-09-25T21:41:29.999346] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-25T21:41:30.289848] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-25T21:41:30.325028] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:41:30.513162] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-25T21:41:30.513256] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-25T21:41:30.514561] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-25T21:41:30.514632] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-25T21:41:30.516430] [DEBUG] [LOCAL ] TOST: Trimmed 77698 records to 54071 (keeping 200 days of data) [2025-09-25T21:41:30.852760] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-25T21:41:30.909927] [DEBUG] [LOCAL ] TOST: Primary data saved (54071 records). [2025-09-25T21:41:30.910090] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-25T21:41:30.910187] [INFO ] [MAIN ] Update Progress: 2117/2372 symbols completed. TOST took 39.5s. Estimated remaining: 33m 54s. Rate: 7.5 symbols/min [2025-09-25T21:41:31.088726] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-25T21:41:31.553144] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T21:41:31.888719] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-25T21:41:32.640102] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:41:32.662368] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T21:41:32.688703] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-25T21:41:33.488797] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-25T21:41:33.713254] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T21:41:34.288736] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-25T21:41:35.060939] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:41:35.088668] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-25T21:41:35.114707] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T21:41:35.888712] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-25T21:41:36.614634] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T21:41:36.688670] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-25T21:41:36.712780] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T21:41:37.488802] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-25T21:41:38.230003] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T21:41:38.242839] [INFO ] [REMOTE ] TPC: Full fetch complete (54952 records). [2025-09-25T21:41:38.242998] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-25T21:41:38.293836] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-25T21:41:38.563408] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-25T21:41:38.750246] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-25T21:41:38.750399] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-25T21:41:38.751620] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-25T21:41:38.751715] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-25T21:41:38.753079] [DEBUG] [LOCAL ] TPC: Trimmed 54952 records to 39083 (keeping 200 days of data) [2025-09-25T21:41:39.022484] [DEBUG] [LOCAL ] TPC: Primary data saved (39083 records). [2025-09-25T21:41:39.022679] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-25T21:41:39.022842] [INFO ] [MAIN ] Update Progress: 2118/2372 symbols completed. TPC took 27.8s. Estimated remaining: 33m 46s. Rate: 7.5 symbols/min [2025-09-25T21:41:39.088738] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-25T21:41:40.024945] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T21:41:40.036007] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-25T21:41:40.126668] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T21:41:40.688746] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-25T21:41:41.430934] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-25T21:41:41.488687] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-25T21:41:41.671488] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T21:41:42.288701] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-25T21:41:42.410163] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T21:41:43.088761] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-25T21:41:43.832881] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T21:41:43.879107] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T21:41:43.883077] [INFO ] [REMOTE ] TPL: Full fetch complete (18150 records). [2025-09-25T21:41:43.883205] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-25T21:41:43.901920] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-25T21:41:44.318984] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-25T21:41:44.319084] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-25T21:41:44.319576] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-25T21:41:44.319619] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-25T21:41:44.320339] [DEBUG] [LOCAL ] TPL: Trimmed 18150 records to 12456 (keeping 200 days of data) [2025-09-25T21:41:44.420492] [DEBUG] [LOCAL ] TPL: Primary data saved (12456 records). [2025-09-25T21:41:44.420836] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-25T21:41:44.421010] [INFO ] [MAIN ] Update Progress: 2119/2372 symbols completed. TPL took 16.6s. Estimated remaining: 33m 38s. Rate: 7.5 symbols/min [2025-09-25T21:41:45.697105] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T21:41:45.709068] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-25T21:41:47.352848] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:41:47.362872] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-25T21:41:48.928864] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T21:41:48.944417] [INFO ] [REMOTE ] TPH: Full fetch complete (65010 records). [2025-09-25T21:41:48.944666] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-25T21:41:49.365147] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-25T21:41:49.365480] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-25T21:41:49.367009] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-25T21:41:49.367121] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-25T21:41:49.372804] [DEBUG] [LOCAL ] TPH: Trimmed 65010 records to 45521 (keeping 200 days of data) [2025-09-25T21:41:49.661532] [DEBUG] [LOCAL ] TPH: Primary data saved (45521 records). [2025-09-25T21:41:49.661708] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-25T21:41:49.661888] [INFO ] [MAIN ] Update Progress: 2120/2372 symbols completed. TPH took 27.7s. Estimated remaining: 33m 30s. Rate: 7.5 symbols/min [2025-09-25T21:41:50.361819] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:50.394431] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:50.447444] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:50.448174] [DEBUG] [LOCAL ] TPYP: Loaded 7880 existing records from primary storage. [2025-09-25T21:41:50.448289] [INFO ] [MAIN ] TPYP: Loaded 7880 existing records. [2025-09-25T21:41:50.497380] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:41:50.517284] [DEBUG] [LOCAL ] TPZ: Loaded 5035 existing records from primary storage. [2025-09-25T21:41:50.517478] [INFO ] [MAIN ] TPZ: Loaded 5035 existing records. [2025-09-25T21:41:50.524405] [DEBUG] [LOCAL ] TPVG: Loaded 27022 existing records from primary storage. [2025-09-25T21:41:50.524509] [INFO ] [MAIN ] TPVG: Loaded 27022 existing records. [2025-09-25T21:41:50.798437] [DEBUG] [LOCAL ] TPR: Loaded 53477 existing records from primary storage. [2025-09-25T21:41:50.798598] [INFO ] [MAIN ] TPR: Loaded 53477 existing records. [2025-09-25T21:41:51.196341] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:51.196842] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-25T21:41:51.196946] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-25T21:41:51.197481] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-25T21:41:51.197566] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-25T21:41:51.325421] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:51.325780] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-25T21:41:51.325838] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-25T21:41:51.326068] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-25T21:41:51.326174] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-25T21:41:51.451699] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:51.466185] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-25T21:41:51.466267] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-25T21:41:51.466562] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-25T21:41:51.466635] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-25T21:41:51.607711] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:41:51.621036] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-25T21:41:51.621108] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-25T21:41:51.628808] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-25T21:41:51.629054] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-25T21:41:52.739702] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:52.755562] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-25T21:41:52.803516] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:52.803972] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-25T21:41:52.948178] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:52.948607] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-25T21:41:52.988893] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:41:52.989244] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-25T21:41:53.650418] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T21:41:53.652909] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-25T21:41:53.661187] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T21:41:53.664068] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-25T21:41:54.522036] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T21:41:54.525749] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-25T21:41:54.534100] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-25T21:41:54.542296] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-25T21:41:54.542868] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-25T21:41:54.545222] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-25T21:41:54.911079] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T21:41:54.922241] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-25T21:41:55.336637] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T21:41:55.339442] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-25T21:41:55.356668] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-25T21:41:55.360904] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-25T21:41:55.521764] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T21:41:55.852820] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-25T21:41:55.888728] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-25T21:41:56.145525] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T21:41:56.688801] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-25T21:41:57.079103] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-25T21:41:57.126563] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:41:57.261931] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T21:41:57.488745] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-25T21:41:58.261502] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T21:41:58.288707] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-25T21:41:59.025498] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-25T21:41:59.088741] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-25T21:41:59.888826] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-25T21:42:00.572899] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T21:42:00.688739] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-25T21:42:01.488711] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-25T21:42:01.960891] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-25T21:42:02.048826] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-25T21:42:02.249935] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T21:42:02.288734] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-25T21:42:03.088735] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-25T21:42:03.474408] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-25T21:42:03.888729] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-25T21:42:03.942708] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T21:42:04.688756] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-25T21:42:05.190255] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-25T21:42:05.194833] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:42:05.488785] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-25T21:42:06.288737] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-25T21:42:06.893928] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T21:42:07.088686] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-25T21:42:07.388556] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-25T21:42:07.721609] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-25T21:42:07.888744] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-25T21:42:08.688691] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-25T21:42:09.029609] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T21:42:09.417895] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T21:42:09.488709] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-25T21:42:10.182127] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T21:42:10.184847] [INFO ] [REMOTE ] TPYP: Full fetch complete (12551 records). [2025-09-25T21:42:10.184942] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-25T21:42:10.293841] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-25T21:42:10.635136] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-25T21:42:10.635244] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-25T21:42:10.635599] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-25T21:42:10.635684] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-25T21:42:10.636345] [DEBUG] [LOCAL ] TPYP: Trimmed 12551 records to 7942 (keeping 200 days of data) [2025-09-25T21:42:10.692537] [DEBUG] [LOCAL ] TPYP: Primary data saved (7942 records). [2025-09-25T21:42:10.692733] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-25T21:42:10.692901] [INFO ] [MAIN ] Update Progress: 2121/2372 symbols completed. TPYP took 21.0s. Estimated remaining: 33m 23s. Rate: 7.5 symbols/min [2025-09-25T21:42:10.911473] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:10.936693] [DEBUG] [LOCAL ] TR: Loaded 18276 existing records from primary storage. [2025-09-25T21:42:10.936846] [INFO ] [MAIN ] TR: Loaded 18276 existing records. [2025-09-25T21:42:11.098896] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-25T21:42:11.130633] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:11.131845] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-25T21:42:11.131919] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-25T21:42:11.132191] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-25T21:42:11.132269] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-25T21:42:11.563870] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:11.810048] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T21:42:11.888739] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-25T21:42:12.510724] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-25T21:42:12.688748] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-25T21:42:13.161227] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T21:42:13.488737] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-25T21:42:14.288752] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-25T21:42:14.415992] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T21:42:14.769062] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-25T21:42:14.775077] [INFO ] [REMOTE ] TPVG: Full fetch complete (40284 records). [2025-09-25T21:42:14.775217] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-25T21:42:14.908019] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T21:42:14.909511] [INFO ] [REMOTE ] TPZ: Full fetch complete (9248 records). [2025-09-25T21:42:14.909585] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-25T21:42:15.093815] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-25T21:42:15.569021] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-25T21:42:15.569112] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-25T21:42:15.570026] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-25T21:42:15.570092] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-25T21:42:15.581499] [DEBUG] [LOCAL ] TPVG: Trimmed 40284 records to 27220 (keeping 200 days of data) [2025-09-25T21:42:15.808067] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-25T21:42:15.808143] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-25T21:42:15.808312] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-25T21:42:15.808376] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-25T21:42:15.809015] [DEBUG] [LOCAL ] TPZ: Trimmed 9248 records to 5068 (keeping 200 days of data) [2025-09-25T21:42:15.882852] [DEBUG] [LOCAL ] TPZ: Primary data saved (5068 records). [2025-09-25T21:42:15.882989] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-25T21:42:15.883084] [INFO ] [MAIN ] Update Progress: 2122/2372 symbols completed. TPZ took 26.2s. Estimated remaining: 33m 15s. Rate: 7.5 symbols/min [2025-09-25T21:42:15.889369] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-25T21:42:15.935961] [DEBUG] [LOCAL ] TPVG: Primary data saved (27220 records). [2025-09-25T21:42:15.936115] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-25T21:42:15.936238] [INFO ] [MAIN ] Update Progress: 2123/2372 symbols completed. TPVG took 26.3s. Estimated remaining: 33m 6s. Rate: 7.5 symbols/min [2025-09-25T21:42:16.294053] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:16.295952] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:16.320262] [DEBUG] [LOCAL ] TRC: Loaded 16028 existing records from primary storage. [2025-09-25T21:42:16.320424] [INFO ] [MAIN ] TRC: Loaded 16028 existing records. [2025-09-25T21:42:16.359181] [DEBUG] [LOCAL ] TRAK: Loaded 9304 existing records from primary storage. [2025-09-25T21:42:16.359331] [INFO ] [MAIN ] TRAK: Loaded 9304 existing records. [2025-09-25T21:42:16.737843] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:16.738105] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-25T21:42:16.738199] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-25T21:42:16.738479] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-25T21:42:16.738539] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-25T21:42:16.801328] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:16.810274] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-25T21:42:16.810322] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-25T21:42:16.810537] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-25T21:42:16.810594] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-25T21:42:16.868790] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T21:42:16.903919] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-25T21:42:17.113663] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-25T21:42:17.490500] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-25T21:42:17.667626] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:17.688974] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:18.023072] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-25T21:42:18.288741] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-25T21:42:19.088731] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-25T21:42:19.240575] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-25T21:42:19.344487] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T21:42:19.888698] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-25T21:42:19.933589] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-25T21:42:20.688709] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-25T21:42:20.722089] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T21:42:21.488709] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-25T21:42:21.567296] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-25T21:42:22.288699] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-25T21:42:22.373034] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-25T21:42:23.070198] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T21:42:23.088696] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-25T21:42:23.888744] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-25T21:42:23.923345] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T21:42:24.493688] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T21:42:24.688721] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-25T21:42:25.488694] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-25T21:42:25.802593] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:42:26.288746] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-25T21:42:26.303496] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T21:42:27.088740] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-25T21:42:27.888701] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-25T21:42:27.898373] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-25T21:42:27.935438] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T21:42:28.688725] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-25T21:42:29.025077] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T21:42:29.416153] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T21:42:29.488766] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-25T21:42:30.288747] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-25T21:42:30.689593] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-25T21:42:31.088700] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-25T21:42:31.266441] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T21:42:31.888714] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-25T21:42:32.172145] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-25T21:42:32.688693] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-25T21:42:32.769605] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T21:42:33.488730] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-25T21:42:33.783845] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:42:34.140454] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-25T21:42:34.288747] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-25T21:42:35.088718] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-25T21:42:35.888702] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-25T21:42:35.898363] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T21:42:35.980232] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:42:35.990538] [INFO ] [REMOTE ] TPR: Full fetch complete (77434 records). [2025-09-25T21:42:35.990862] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-25T21:42:36.417853] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-25T21:42:36.417973] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-25T21:42:36.419360] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-25T21:42:36.419436] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-25T21:42:36.422287] [DEBUG] [LOCAL ] TPR: Trimmed 77434 records to 53866 (keeping 200 days of data) [2025-09-25T21:42:36.688754] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-25T21:42:36.803761] [DEBUG] [LOCAL ] TPR: Primary data saved (53866 records). [2025-09-25T21:42:36.803899] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-25T21:42:36.804062] [INFO ] [MAIN ] Update Progress: 2124/2372 symbols completed. TPR took 47.1s. Estimated remaining: 32m 60s. Rate: 7.5 symbols/min [2025-09-25T21:42:36.988592] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:36.988821] [DEBUG] [LOCAL ] TREX: No existing data file found in primary storage. [2025-09-25T21:42:36.988879] [WARN ] [MAIN ] TREX: No existing data found, performing full refresh instead. [2025-09-25T21:42:36.989006] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-25T21:42:36.989058] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-25T21:42:36.989127] [DEBUG] [LOCAL ] TREX: No primary data file found to delete. [2025-09-25T21:42:36.989162] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-25T21:42:37.066481] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-25T21:42:37.394864] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:37.488679] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-25T21:42:37.552147] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-25T21:42:38.288701] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-25T21:42:38.518459] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T21:42:39.088743] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-25T21:42:39.104523] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T21:42:39.108273] [INFO ] [REMOTE ] TRAK: Full fetch complete (13395 records). [2025-09-25T21:42:39.108493] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-25T21:42:39.672841] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-25T21:42:39.672965] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-25T21:42:39.673432] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-25T21:42:39.673515] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-25T21:42:39.674375] [DEBUG] [LOCAL ] TRAK: Trimmed 13395 records to 9342 (keeping 200 days of data) [2025-09-25T21:42:39.767197] [DEBUG] [LOCAL ] TRAK: Primary data saved (9342 records). [2025-09-25T21:42:39.767361] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-25T21:42:39.767491] [INFO ] [MAIN ] Update Progress: 2125/2372 symbols completed. TRAK took 23.9s. Estimated remaining: 32m 51s. Rate: 7.5 symbols/min [2025-09-25T21:42:39.823951] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T21:42:39.893786] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-25T21:42:39.998750] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:40.061998] [DEBUG] [LOCAL ] TRGP: Loaded 50808 existing records from primary storage. [2025-09-25T21:42:40.062164] [INFO ] [MAIN ] TRGP: Loaded 50808 existing records. [2025-09-25T21:42:40.247328] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:40.248190] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-25T21:42:40.248238] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-25T21:42:40.248593] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-25T21:42:40.248684] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-25T21:42:40.613677] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:40.688739] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-25T21:42:40.981558] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T21:42:40.985107] [INFO ] [REMOTE ] TRC: Full fetch complete (22125 records). [2025-09-25T21:42:40.985214] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-25T21:42:41.449189] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-25T21:42:41.449280] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-25T21:42:41.449848] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-25T21:42:41.449921] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-25T21:42:41.450624] [DEBUG] [LOCAL ] TRC: Trimmed 22125 records to 16113 (keeping 200 days of data) [2025-09-25T21:42:41.498489] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-25T21:42:41.585625] [DEBUG] [LOCAL ] TRC: Primary data saved (16113 records). [2025-09-25T21:42:41.585821] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-25T21:42:41.585926] [INFO ] [MAIN ] Update Progress: 2126/2372 symbols completed. TRC took 25.6s. Estimated remaining: 32m 42s. Rate: 7.5 symbols/min [2025-09-25T21:42:41.805310] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:41.853989] [DEBUG] [LOCAL ] TRN: Loaded 37380 existing records from primary storage. [2025-09-25T21:42:41.854176] [INFO ] [MAIN ] TRN: Loaded 37380 existing records. [2025-09-25T21:42:42.050574] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:42.050922] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-25T21:42:42.050973] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-25T21:42:42.051284] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-25T21:42:42.051353] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-25T21:42:42.253195] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T21:42:42.290502] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-25T21:42:42.499162] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:42.639921] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T21:42:43.088731] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-25T21:42:43.888689] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-25T21:42:44.035223] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:42:44.688734] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-25T21:42:44.980628] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T21:42:45.042979] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T21:42:45.488691] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-25T21:42:45.801174] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T21:42:45.805517] [INFO ] [REMOTE ] TR: Full fetch complete (24903 records). [2025-09-25T21:42:45.805608] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-25T21:42:46.196635] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-25T21:42:46.196755] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-25T21:42:46.197321] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-25T21:42:46.197367] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-25T21:42:46.198316] [DEBUG] [LOCAL ] TR: Trimmed 24903 records to 18389 (keeping 200 days of data) [2025-09-25T21:42:46.288726] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-25T21:42:46.322462] [DEBUG] [LOCAL ] TR: Primary data saved (18389 records). [2025-09-25T21:42:46.322616] [INFO ] [MAIN ] TR: Full history saved. [2025-09-25T21:42:46.326518] [INFO ] [MAIN ] Update Progress: 2127/2372 symbols completed. TR took 35.6s. Estimated remaining: 32m 34s. Rate: 7.5 symbols/min [2025-09-25T21:42:46.506796] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:42:46.567073] [DEBUG] [LOCAL ] TRNO: Loaded 44052 existing records from primary storage. [2025-09-25T21:42:46.567226] [INFO ] [MAIN ] TRNO: Loaded 44052 existing records. [2025-09-25T21:42:46.759669] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:42:46.760577] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-25T21:42:46.760627] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-25T21:42:46.760930] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-25T21:42:46.760992] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-25T21:42:47.088901] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-25T21:42:47.177936] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:42:47.215174] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-25T21:42:47.619983] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T21:42:47.888725] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-25T21:42:48.688756] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-25T21:42:48.987046] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T21:42:49.488693] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-25T21:42:49.543327] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T21:42:50.094483] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T21:42:50.288740] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-25T21:42:51.088769] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-25T21:42:51.200436] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T21:42:51.888697] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-25T21:42:51.981331] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T21:42:52.688749] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-25T21:42:52.927557] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-25T21:42:53.438857] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:42:53.488743] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-25T21:42:54.010453] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T21:42:54.288749] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-25T21:42:55.088694] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-25T21:42:55.404751] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:42:55.888718] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-25T21:42:56.273723] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T21:42:56.368634] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-25T21:42:56.688735] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-25T21:42:57.488741] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-25T21:42:57.571925] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:42:58.288756] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-25T21:42:58.811527] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T21:42:58.909513] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T21:42:59.088741] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-25T21:42:59.888810] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-25T21:43:00.038173] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T21:43:00.422194] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T21:43:00.688748] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-25T21:43:01.488777] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-25T21:43:01.899115] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:43:02.288722] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-25T21:43:02.562718] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T21:43:03.008215] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T21:43:03.088744] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-25T21:43:03.767458] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:43:03.888743] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-25T21:43:04.688822] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-25T21:43:04.862245] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T21:43:05.333024] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T21:43:05.488773] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-25T21:43:06.043444] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T21:43:06.288726] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-25T21:43:07.088736] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-25T21:43:07.283574] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T21:43:07.293899] [INFO ] [REMOTE ] TREX: Full fetch complete (70978 records). [2025-09-25T21:43:07.294088] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-25T21:43:07.753621] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-25T21:43:07.753755] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-25T21:43:07.755014] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-25T21:43:07.755143] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-25T21:43:07.760573] [DEBUG] [LOCAL ] TREX: Trimmed 70978 records to 50361 (keeping 200 days of data) [2025-09-25T21:43:07.888932] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-25T21:43:08.156623] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-25T21:43:08.177385] [DEBUG] [LOCAL ] TREX: Primary data saved (50361 records). [2025-09-25T21:43:08.177533] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-25T21:43:08.177715] [INFO ] [MAIN ] Update Progress: 2128/2372 symbols completed. TREX took 31.4s. Estimated remaining: 32m 28s. Rate: 7.5 symbols/min [2025-09-25T21:43:08.379210] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:08.442242] [DEBUG] [LOCAL ] TROX: Loaded 51772 existing records from primary storage. [2025-09-25T21:43:08.442412] [INFO ] [MAIN ] TROX: Loaded 51772 existing records. [2025-09-25T21:43:08.652590] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:08.652954] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-25T21:43:08.653004] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-25T21:43:08.653468] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-25T21:43:08.653542] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-25T21:43:08.693985] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-25T21:43:08.851524] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:43:09.103052] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:09.244544] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-25T21:43:09.488751] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-25T21:43:10.288697] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-25T21:43:10.482806] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T21:43:10.931462] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:43:11.088747] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-25T21:43:11.657318] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T21:43:11.888726] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-25T21:43:12.376001] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T21:43:12.688840] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-25T21:43:13.448372] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T21:43:13.459781] [INFO ] [REMOTE ] TRNO: Full fetch complete (64001 records). [2025-09-25T21:43:13.459959] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-25T21:43:13.503687] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-25T21:43:13.886967] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-25T21:43:13.887064] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-25T21:43:13.888457] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-25T21:43:13.888525] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-25T21:43:13.892616] [DEBUG] [LOCAL ] TRNO: Trimmed 64001 records to 44330 (keeping 200 days of data) [2025-09-25T21:43:14.198832] [DEBUG] [LOCAL ] TRNO: Primary data saved (44330 records). [2025-09-25T21:43:14.199033] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-25T21:43:14.200827] [INFO ] [MAIN ] Update Progress: 2129/2372 symbols completed. TRNO took 27.9s. Estimated remaining: 32m 19s. Rate: 7.5 symbols/min [2025-09-25T21:43:14.293749] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-25T21:43:14.362321] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:43:14.439286] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:14.518683] [DEBUG] [LOCAL ] TRP: Loaded 52118 existing records from primary storage. [2025-09-25T21:43:14.518880] [INFO ] [MAIN ] TRP: Loaded 52118 existing records. [2025-09-25T21:43:14.715819] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:14.716136] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-25T21:43:14.716193] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-25T21:43:14.716458] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-25T21:43:14.716517] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-25T21:43:14.943578] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T21:43:15.022886] [INFO ] [REMOTE ] TRN: Full fetch complete (53020 records). [2025-09-25T21:43:15.034317] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-25T21:43:15.117693] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-25T21:43:15.207627] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:15.564542] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-25T21:43:15.564692] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-25T21:43:15.566828] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-25T21:43:15.566896] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-25T21:43:15.573139] [DEBUG] [LOCAL ] TRN: Trimmed 53020 records to 37620 (keeping 200 days of data) [2025-09-25T21:43:15.839845] [DEBUG] [LOCAL ] TRN: Primary data saved (37620 records). [2025-09-25T21:43:15.840075] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-25T21:43:15.840262] [INFO ] [MAIN ] Update Progress: 2130/2372 symbols completed. TRN took 34.3s. Estimated remaining: 32m 11s. Rate: 7.5 symbols/min [2025-09-25T21:43:15.890798] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-25T21:43:16.079189] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:16.138815] [DEBUG] [LOCAL ] TRTX: Loaded 37423 existing records from primary storage. [2025-09-25T21:43:16.138991] [INFO ] [MAIN ] TRTX: Loaded 37423 existing records. [2025-09-25T21:43:16.395196] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-25T21:43:16.452062] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:16.452456] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-25T21:43:16.452544] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-25T21:43:16.453071] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-25T21:43:16.453160] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-25T21:43:16.705042] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-25T21:43:17.106710] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T21:43:17.230028] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:17.488790] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-25T21:43:17.742289] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T21:43:18.288717] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-25T21:43:18.554369] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T21:43:19.046915] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T21:43:19.088738] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-25T21:43:19.888720] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-25T21:43:19.938027] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-25T21:43:19.957364] [INFO ] [REMOTE ] TRGP: Full fetch complete (73496 records). [2025-09-25T21:43:19.957548] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-25T21:43:20.217574] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T21:43:20.443963] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-25T21:43:20.444074] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-25T21:43:20.445240] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-25T21:43:20.445312] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-25T21:43:20.447150] [DEBUG] [LOCAL ] TRGP: Trimmed 73496 records to 51169 (keeping 200 days of data) [2025-09-25T21:43:20.694737] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-25T21:43:20.812694] [DEBUG] [LOCAL ] TRGP: Primary data saved (51169 records). [2025-09-25T21:43:20.812876] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-25T21:43:20.813010] [INFO ] [MAIN ] Update Progress: 2131/2372 symbols completed. TRGP took 41.0s. Estimated remaining: 32m 2s. Rate: 7.5 symbols/min [2025-09-25T21:43:21.001141] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:21.065832] [DEBUG] [LOCAL ] TRU: Loaded 51194 existing records from primary storage. [2025-09-25T21:43:21.066015] [INFO ] [MAIN ] TRU: Loaded 51194 existing records. [2025-09-25T21:43:21.252784] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:21.253114] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-25T21:43:21.253171] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-25T21:43:21.253639] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-25T21:43:21.254361] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-25T21:43:21.491386] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-25T21:43:21.660066] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:21.861902] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-25T21:43:22.288710] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-25T21:43:22.503449] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T21:43:22.543913] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T21:43:23.088743] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-25T21:43:23.888789] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-25T21:43:23.950048] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T21:43:24.688706] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-25T21:43:24.867074] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T21:43:25.488721] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-25T21:43:25.685614] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T21:43:26.288740] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-25T21:43:26.947468] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T21:43:27.088685] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-25T21:43:27.170157] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-25T21:43:27.608129] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-25T21:43:27.888723] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-25T21:43:28.688729] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-25T21:43:28.760571] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T21:43:29.488743] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-25T21:43:29.661248] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T21:43:30.155680] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-25T21:43:30.288749] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-25T21:43:31.088701] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-25T21:43:31.377346] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T21:43:31.888726] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-25T21:43:32.128893] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T21:43:32.660544] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T21:43:32.688716] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-25T21:43:33.488691] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-25T21:43:33.647693] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T21:43:33.658295] [INFO ] [REMOTE ] TROX: Full fetch complete (72794 records). [2025-09-25T21:43:33.658432] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-25T21:43:34.106204] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-25T21:43:34.106319] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-25T21:43:34.107671] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-25T21:43:34.107743] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-25T21:43:34.109478] [DEBUG] [LOCAL ] TROX: Trimmed 72794 records to 52162 (keeping 200 days of data) [2025-09-25T21:43:34.263867] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-25T21:43:34.288681] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-25T21:43:34.511062] [DEBUG] [LOCAL ] TROX: Primary data saved (52162 records). [2025-09-25T21:43:34.511235] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-25T21:43:34.511372] [INFO ] [MAIN ] Update Progress: 2132/2372 symbols completed. TROX took 26.3s. Estimated remaining: 31m 55s. Rate: 7.5 symbols/min [2025-09-25T21:43:34.707453] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:34.773670] [DEBUG] [LOCAL ] TRV: Loaded 48131 existing records from primary storage. [2025-09-25T21:43:34.773853] [INFO ] [MAIN ] TRV: Loaded 48131 existing records. [2025-09-25T21:43:34.985632] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:34.988174] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-25T21:43:34.988239] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-25T21:43:34.988697] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-25T21:43:34.988761] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-25T21:43:35.097219] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-25T21:43:35.141561] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:43:35.429982] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:35.888736] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-25T21:43:36.309932] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T21:43:36.544399] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T21:43:36.688721] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-25T21:43:37.493940] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-25T21:43:37.509079] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T21:43:38.157674] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T21:43:38.288720] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-25T21:43:39.088696] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-25T21:43:39.270294] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:43:39.864867] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T21:43:39.888671] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-25T21:43:40.688740] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-25T21:43:41.081810] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-25T21:43:41.335547] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T21:43:41.488730] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-25T21:43:42.288748] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-25T21:43:42.702940] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T21:43:43.045291] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T21:43:43.088734] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-25T21:43:43.888729] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-25T21:43:44.438436] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-25T21:43:44.688703] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-25T21:43:45.071960] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T21:43:45.189875] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T21:43:45.488747] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-25T21:43:46.288731] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-25T21:43:46.491367] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-25T21:43:46.503835] [INFO ] [REMOTE ] TRP: Full fetch complete (75554 records). [2025-09-25T21:43:46.503978] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-25T21:43:46.943216] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-25T21:43:46.943358] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-25T21:43:46.944700] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-25T21:43:46.944773] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-25T21:43:46.946435] [DEBUG] [LOCAL ] TRP: Trimmed 75554 records to 52505 (keeping 200 days of data) [2025-09-25T21:43:47.128371] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-25T21:43:47.194766] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T21:43:47.204697] [INFO ] [REMOTE ] TRTX: Full fetch complete (53002 records). [2025-09-25T21:43:47.204811] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-25T21:43:47.766881] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-25T21:43:47.766968] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-25T21:43:47.768114] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-25T21:43:47.768560] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-25T21:43:47.771168] [DEBUG] [LOCAL ] TRTX: Trimmed 53002 records to 37759 (keeping 200 days of data) [2025-09-25T21:43:47.779919] [DEBUG] [LOCAL ] TRP: Primary data saved (52505 records). [2025-09-25T21:43:47.780117] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-25T21:43:47.780266] [INFO ] [MAIN ] Update Progress: 2133/2372 symbols completed. TRP took 33.6s. Estimated remaining: 31m 48s. Rate: 7.5 symbols/min [2025-09-25T21:43:48.238361] [DEBUG] [LOCAL ] TRTX: Primary data saved (37759 records). [2025-09-25T21:43:48.238508] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-25T21:43:48.238592] [INFO ] [MAIN ] Update Progress: 2134/2372 symbols completed. TRTX took 32.4s. Estimated remaining: 31m 39s. Rate: 7.5 symbols/min [2025-09-25T21:43:48.276305] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:48.363502] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-25T21:43:48.382506] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-25T21:43:48.561730] [DEBUG] [LOCAL ] TS: Loaded 51662 existing records from primary storage. [2025-09-25T21:43:48.561904] [INFO ] [MAIN ] TS: Loaded 51662 existing records. [2025-09-25T21:43:48.569481] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:48.644502] [DEBUG] [LOCAL ] TSE: Loaded 28733 existing records from primary storage. [2025-09-25T21:43:48.644638] [INFO ] [MAIN ] TSE: Loaded 28733 existing records. [2025-09-25T21:43:49.007342] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:49.007605] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-25T21:43:49.013159] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:49.013782] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-25T21:43:49.013836] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-25T21:43:49.014141] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-25T21:43:49.014199] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-25T21:43:49.027789] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-25T21:43:49.028066] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-25T21:43:49.028126] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-25T21:43:49.291525] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-25T21:43:49.358165] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-25T21:43:49.889980] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:49.890361] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-25T21:43:49.897042] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:50.108503] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-25T21:43:50.288741] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-25T21:43:51.088773] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-25T21:43:51.517708] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-25T21:43:51.753964] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T21:43:51.888783] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-25T21:43:52.205111] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T21:43:52.217768] [INFO ] [REMOTE ] TRU: Full fetch complete (73161 records). [2025-09-25T21:43:52.218073] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-25T21:43:52.547442] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-25T21:43:52.695091] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-25T21:43:52.696901] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-25T21:43:52.696952] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-25T21:43:52.698426] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-25T21:43:52.698728] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-25T21:43:52.700496] [DEBUG] [LOCAL ] TRU: Trimmed 73161 records to 51583 (keeping 200 days of data) [2025-09-25T21:43:53.054978] [DEBUG] [LOCAL ] TRU: Primary data saved (51583 records). [2025-09-25T21:43:53.055117] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-25T21:43:53.055207] [INFO ] [MAIN ] Update Progress: 2135/2372 symbols completed. TRU took 32.2s. Estimated remaining: 31m 30s. Rate: 7.5 symbols/min [2025-09-25T21:43:53.251903] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:43:53.269252] [DEBUG] [LOCAL ] TSI: Loaded 8034 existing records from primary storage. [2025-09-25T21:43:53.269374] [INFO ] [MAIN ] TSI: Loaded 8034 existing records. [2025-09-25T21:43:53.469126] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:43:53.469391] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-25T21:43:53.469442] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-25T21:43:53.469738] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-25T21:43:53.469798] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-25T21:43:53.489892] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-25T21:43:53.756200] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T21:43:53.941924] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:43:54.288698] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-25T21:43:54.349821] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T21:43:54.406415] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T21:43:55.088737] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-25T21:43:55.888745] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-25T21:43:55.978547] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:43:56.688919] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-25T21:43:56.985927] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T21:43:57.386401] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T21:43:57.488724] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-25T21:43:58.301196] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-25T21:43:58.334563] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-25T21:43:59.089234] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-25T21:43:59.109958] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T21:43:59.641741] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T21:43:59.888742] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-25T21:44:00.619287] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T21:44:00.688693] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-25T21:44:00.961503] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T21:44:01.488733] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-25T21:44:02.288826] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-25T21:44:02.510319] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-25T21:44:02.806742] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:44:03.088730] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-25T21:44:03.888731] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-25T21:44:03.954124] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T21:44:04.198054] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T21:44:04.688737] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-25T21:44:04.730007] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-25T21:44:04.740430] [INFO ] [REMOTE ] TRV: Full fetch complete (69981 records). [2025-09-25T21:44:04.740723] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-25T21:44:05.171766] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-25T21:44:05.171884] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-25T21:44:05.173130] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-25T21:44:05.173250] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-25T21:44:05.176695] [DEBUG] [LOCAL ] TRV: Trimmed 69981 records to 48449 (keeping 200 days of data) [2025-09-25T21:44:05.498789] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-25T21:44:05.520013] [DEBUG] [LOCAL ] TRV: Primary data saved (48449 records). [2025-09-25T21:44:05.520130] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-25T21:44:05.520320] [INFO ] [MAIN ] Update Progress: 2136/2372 symbols completed. TRV took 31.0s. Estimated remaining: 31m 23s. Rate: 7.5 symbols/min [2025-09-25T21:44:05.706472] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:05.762516] [DEBUG] [LOCAL ] TSLX: Loaded 35254 existing records from primary storage. [2025-09-25T21:44:05.762696] [INFO ] [MAIN ] TSLX: Loaded 35254 existing records. [2025-09-25T21:44:05.997918] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T21:44:06.008224] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:06.010516] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-25T21:44:06.010569] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-25T21:44:06.011040] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-25T21:44:06.011120] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-25T21:44:06.293365] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-25T21:44:06.303855] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T21:44:06.415422] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:07.088842] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-25T21:44:07.888715] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-25T21:44:08.000511] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:44:08.086729] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-25T21:44:08.688682] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-25T21:44:09.113925] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T21:44:09.420212] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T21:44:09.488879] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-25T21:44:10.275726] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T21:44:10.288718] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-25T21:44:11.088722] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-25T21:44:11.473051] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T21:44:11.888732] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-25T21:44:12.461028] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:44:12.688779] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-25T21:44:12.906326] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T21:44:13.488743] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-25T21:44:14.095989] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-25T21:44:14.288712] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-25T21:44:14.469296] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-25T21:44:15.088755] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-25T21:44:15.888760] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-25T21:44:15.996807] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-25T21:44:16.662936] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T21:44:16.688750] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-25T21:44:17.186311] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T21:44:17.488791] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-25T21:44:18.286038] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-25T21:44:18.288877] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-25T21:44:18.473273] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-25T21:44:19.009778] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-25T21:44:19.088754] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-25T21:44:19.888763] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-25T21:44:20.589143] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T21:44:20.591424] [INFO ] [REMOTE ] TSI: Full fetch complete (13294 records). [2025-09-25T21:44:20.591538] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-25T21:44:20.692747] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-25T21:44:20.731173] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T21:44:21.056158] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-25T21:44:21.056262] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-25T21:44:21.056622] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-25T21:44:21.056709] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-25T21:44:21.057233] [DEBUG] [LOCAL ] TSI: Trimmed 13294 records to 8063 (keeping 200 days of data) [2025-09-25T21:44:21.113019] [DEBUG] [LOCAL ] TSI: Primary data saved (8063 records). [2025-09-25T21:44:21.113188] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-25T21:44:21.113383] [INFO ] [MAIN ] Update Progress: 2137/2372 symbols completed. TSI took 28.1s. Estimated remaining: 31m 16s. Rate: 7.5 symbols/min [2025-09-25T21:44:21.292256] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:21.362635] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-25T21:44:21.362815] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-25T21:44:21.489977] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-25T21:44:21.572026] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:21.572380] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-25T21:44:21.572449] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-25T21:44:21.572995] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-25T21:44:21.573083] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-25T21:44:21.902751] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-25T21:44:21.927704] [INFO ] [REMOTE ] TSE: Full fetch complete (41805 records). [2025-09-25T21:44:21.927845] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-25T21:44:22.016393] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:22.294795] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-25T21:44:22.382342] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-25T21:44:22.382425] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-25T21:44:22.383299] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-25T21:44:22.383362] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-25T21:44:22.385976] [DEBUG] [LOCAL ] TSE: Trimmed 41805 records to 28865 (keeping 200 days of data) [2025-09-25T21:44:22.586177] [DEBUG] [LOCAL ] TSE: Primary data saved (28865 records). [2025-09-25T21:44:22.586322] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-25T21:44:22.586466] [INFO ] [MAIN ] Update Progress: 2138/2372 symbols completed. TSE took 34.3s. Estimated remaining: 31m 7s. Rate: 7.5 symbols/min [2025-09-25T21:44:22.836298] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:22.896302] [DEBUG] [LOCAL ] TSN: Loaded 52869 existing records from primary storage. [2025-09-25T21:44:22.896453] [INFO ] [MAIN ] TSN: Loaded 52869 existing records. [2025-09-25T21:44:23.098236] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-25T21:44:23.140160] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:23.140441] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-25T21:44:23.140498] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-25T21:44:23.142025] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T21:44:23.150365] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-25T21:44:23.150467] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-25T21:44:23.513948] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:23.889986] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-25T21:44:23.901403] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T21:44:23.911355] [INFO ] [REMOTE ] TS: Full fetch complete (74459 records). [2025-09-25T21:44:23.914795] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-25T21:44:24.347662] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-25T21:44:24.347779] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-25T21:44:24.349010] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-25T21:44:24.349085] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-25T21:44:24.350723] [DEBUG] [LOCAL ] TS: Trimmed 74459 records to 52046 (keeping 200 days of data) [2025-09-25T21:44:24.694912] [DEBUG] [LOCAL ] TS: Primary data saved (52046 records). [2025-09-25T21:44:24.695195] [INFO ] [MAIN ] TS: Full history saved. [2025-09-25T21:44:24.696220] [INFO ] [MAIN ] Update Progress: 2139/2372 symbols completed. TS took 36.9s. Estimated remaining: 30m 59s. Rate: 7.5 symbols/min [2025-09-25T21:44:24.711733] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-25T21:44:24.907417] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:24.924146] [DEBUG] [LOCAL ] TSQ: Loaded 12093 existing records from primary storage. [2025-09-25T21:44:24.924318] [INFO ] [MAIN ] TSQ: Loaded 12093 existing records. [2025-09-25T21:44:25.146269] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:25.146671] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-25T21:44:25.146729] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-25T21:44:25.146931] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-25T21:44:25.146990] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-25T21:44:25.382981] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:44:25.490676] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-25T21:44:25.577975] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-25T21:44:25.668092] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:26.288704] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-25T21:44:26.648625] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-25T21:44:27.074503] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T21:44:27.088674] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-25T21:44:27.888733] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-25T21:44:28.661613] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-25T21:44:28.678944] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T21:44:28.688698] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-25T21:44:29.141636] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-25T21:44:29.488731] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-25T21:44:30.288701] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-25T21:44:30.630429] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-25T21:44:31.088783] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-25T21:44:31.591372] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T21:44:31.598058] [INFO ] [REMOTE ] TSLX: Full fetch complete (49018 records). [2025-09-25T21:44:31.598227] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-25T21:44:31.891725] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-25T21:44:32.130300] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-25T21:44:32.130441] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-25T21:44:32.131909] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-25T21:44:32.131998] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-25T21:44:32.133756] [DEBUG] [LOCAL ] TSLX: Trimmed 49018 records to 35517 (keeping 200 days of data) [2025-09-25T21:44:32.146053] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-25T21:44:32.380127] [DEBUG] [LOCAL ] TSLX: Primary data saved (35517 records). [2025-09-25T21:44:32.380289] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-25T21:44:32.380438] [INFO ] [MAIN ] Update Progress: 2140/2372 symbols completed. TSLX took 26.9s. Estimated remaining: 30m 51s. Rate: 7.5 symbols/min [2025-09-25T21:44:32.479225] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T21:44:32.640955] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:32.689709] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-25T21:44:32.728935] [DEBUG] [LOCAL ] TT: Loaded 47821 existing records from primary storage. [2025-09-25T21:44:32.729142] [INFO ] [MAIN ] TT: Loaded 47821 existing records. [2025-09-25T21:44:33.008261] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-25T21:44:33.064420] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:33.064740] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-25T21:44:33.064797] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-25T21:44:33.065242] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-25T21:44:33.065301] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-25T21:44:33.473484] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:33.488668] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-25T21:44:34.288736] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-25T21:44:35.062593] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T21:44:35.088797] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-25T21:44:35.269322] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T21:44:35.535758] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-25T21:44:35.888725] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-25T21:44:36.688733] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-25T21:44:37.093906] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-25T21:44:37.488746] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-25T21:44:37.601703] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T21:44:37.712460] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T21:44:38.288722] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-25T21:44:39.088703] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-25T21:44:39.109842] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T21:44:39.349303] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-25T21:44:39.888736] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-25T21:44:40.688733] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-25T21:44:40.874175] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T21:44:41.488695] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-25T21:44:41.843392] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T21:44:42.288777] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-25T21:44:43.088745] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-25T21:44:43.408272] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T21:44:43.628823] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.94 seconds). [2025-09-25T21:44:43.758632] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T21:44:43.888710] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-25T21:44:44.338217] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-25T21:44:44.688758] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-25T21:44:44.985057] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:44:45.488817] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-25T21:44:46.288703] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-25T21:44:46.328697] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-25T21:44:46.568631] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T21:44:47.088733] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-25T21:44:47.888799] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-25T21:44:48.116454] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:44:48.688701] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-25T21:44:48.971925] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T21:44:49.488737] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-25T21:44:50.288729] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-25T21:44:50.622692] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T21:44:50.730107] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.84 seconds). [2025-09-25T21:44:51.088699] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-25T21:44:51.138478] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-25T21:44:51.167746] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-25T21:44:51.888873] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-25T21:44:52.688714] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-25T21:44:52.990235] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-25T21:44:53.001422] [INFO ] [REMOTE ] TSN: Full fetch complete (76253 records). [2025-09-25T21:44:53.001722] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-25T21:44:53.478164] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-25T21:44:53.478266] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-25T21:44:53.479479] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-25T21:44:53.479607] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-25T21:44:53.482631] [DEBUG] [LOCAL ] TSN: Trimmed 76253 records to 53256 (keeping 200 days of data) [2025-09-25T21:44:53.488765] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-25T21:44:53.894777] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T21:44:53.930802] [DEBUG] [LOCAL ] TSN: Primary data saved (53256 records). [2025-09-25T21:44:53.930971] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-25T21:44:53.931144] [INFO ] [MAIN ] Update Progress: 2141/2372 symbols completed. TSN took 31.3s. Estimated remaining: 30m 44s. Rate: 7.5 symbols/min [2025-09-25T21:44:54.156444] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:54.156675] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-25T21:44:54.156731] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-25T21:44:54.156949] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-25T21:44:54.156996] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-25T21:44:54.157039] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-25T21:44:54.157212] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-25T21:44:54.293876] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-25T21:44:54.372146] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-25T21:44:54.413934] [INFO ] [REMOTE ] TSQ: Full fetch complete (16665 records). [2025-09-25T21:44:54.414084] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-25T21:44:54.869355] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:55.080393] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-25T21:44:55.080479] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-25T21:44:55.080923] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-25T21:44:55.081036] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-25T21:44:55.082790] [DEBUG] [LOCAL ] TSQ: Trimmed 16665 records to 12165 (keeping 200 days of data) [2025-09-25T21:44:55.088687] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-25T21:44:55.178977] [DEBUG] [LOCAL ] TSQ: Primary data saved (12165 records). [2025-09-25T21:44:55.179120] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-25T21:44:55.179261] [INFO ] [MAIN ] Update Progress: 2142/2372 symbols completed. TSQ took 30.5s. Estimated remaining: 30m 35s. Rate: 7.5 symbols/min [2025-09-25T21:44:55.336845] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:44:55.337171] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-25T21:44:55.362662] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:55.460992] [DEBUG] [LOCAL ] TTC: Loaded 42495 existing records from primary storage. [2025-09-25T21:44:55.461193] [INFO ] [MAIN ] TTC: Loaded 42495 existing records. [2025-09-25T21:44:55.510345] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-25T21:44:55.699995] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-25T21:44:55.767761] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:55.768141] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-25T21:44:55.768191] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-25T21:44:55.768547] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-25T21:44:55.768606] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-25T21:44:55.893787] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-25T21:44:56.169253] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:56.618859] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T21:44:56.630390] [INFO ] [REMOTE ] TT: Full fetch complete (69755 records). [2025-09-25T21:44:56.630584] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-25T21:44:56.694709] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-25T21:44:57.081704] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-25T21:44:57.081828] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-25T21:44:57.083411] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-25T21:44:57.083477] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-25T21:44:57.085679] [DEBUG] [LOCAL ] TT: Trimmed 69755 records to 48171 (keeping 200 days of data) [2025-09-25T21:44:57.413108] [DEBUG] [LOCAL ] TT: Primary data saved (48171 records). [2025-09-25T21:44:57.413299] [INFO ] [MAIN ] TT: Full history saved. [2025-09-25T21:44:57.413520] [INFO ] [MAIN ] Update Progress: 2143/2372 symbols completed. TT took 25.0s. Estimated remaining: 30m 27s. Rate: 7.5 symbols/min [2025-09-25T21:44:57.494718] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-25T21:44:57.604706] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:44:57.664607] [DEBUG] [LOCAL ] TTE: Loaded 51656 existing records from primary storage. [2025-09-25T21:44:57.664807] [INFO ] [MAIN ] TTE: Loaded 51656 existing records. [2025-09-25T21:44:57.793403] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:44:57.793786] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-25T21:44:57.876522] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:44:57.876904] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-25T21:44:57.876977] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-25T21:44:57.877255] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-25T21:44:57.877316] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-25T21:44:58.268948] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:44:58.288717] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-25T21:44:58.363878] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T21:44:59.088831] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-25T21:44:59.888729] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-25T21:45:00.689710] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-25T21:45:01.225570] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-25T21:45:01.264699] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-25T21:45:01.488708] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-25T21:45:01.660313] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-25T21:45:01.819330] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:45:02.288753] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-25T21:45:03.088736] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-25T21:45:03.406995] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T21:45:03.849250] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T21:45:03.888748] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-25T21:45:04.688745] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-25T21:45:05.488747] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-25T21:45:05.729819] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T21:45:05.825993] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-25T21:45:05.938951] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T21:45:06.288739] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-25T21:45:07.088704] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-25T21:45:07.151541] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T21:45:07.888739] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-25T21:45:08.253920] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T21:45:08.688831] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-25T21:45:09.289928] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-25T21:45:09.419850] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T21:45:09.488752] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-25T21:45:09.881300] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-25T21:45:09.897482] [INFO ] [REMOTE ] TSM: Full fetch complete (77990 records). [2025-09-25T21:45:09.897699] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-25T21:45:10.289514] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-25T21:45:10.351594] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-25T21:45:10.351717] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-25T21:45:10.353005] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-25T21:45:10.353072] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-25T21:45:10.354740] [DEBUG] [LOCAL ] TSM: Trimmed 77990 records to 54209 (keeping 200 days of data) [2025-09-25T21:45:10.731053] [DEBUG] [LOCAL ] TSM: Primary data saved (54209 records). [2025-09-25T21:45:10.731216] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-25T21:45:10.731377] [INFO ] [MAIN ] Update Progress: 2144/2372 symbols completed. TSM took 49.6s. Estimated remaining: 30m 19s. Rate: 7.5 symbols/min [2025-09-25T21:45:10.927274] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:10.979891] [DEBUG] [LOCAL ] TTI: Loaded 45370 existing records from primary storage. [2025-09-25T21:45:10.980071] [INFO ] [MAIN ] TTI: Loaded 45370 existing records. [2025-09-25T21:45:11.093700] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-25T21:45:11.189133] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:11.189588] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-25T21:45:11.189665] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-25T21:45:11.190029] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-25T21:45:11.190109] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-25T21:45:11.338337] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T21:45:11.632630] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:11.888756] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-25T21:45:12.265859] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T21:45:12.315715] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T21:45:12.688740] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-25T21:45:13.371093] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-25T21:45:13.488824] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-25T21:45:14.288729] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-25T21:45:14.345120] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:45:15.074535] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:45:15.088672] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-25T21:45:15.687881] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-25T21:45:15.888750] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-25T21:45:16.358359] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T21:45:16.688768] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-25T21:45:17.241756] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T21:45:17.488753] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-25T21:45:18.288757] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-25T21:45:18.358031] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T21:45:19.088688] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-25T21:45:19.121843] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T21:45:19.888738] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-25T21:45:20.080839] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T21:45:20.637324] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-25T21:45:20.688753] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-25T21:45:21.488737] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-25T21:45:21.705604] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:45:22.271165] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T21:45:22.278313] [INFO ] [REMOTE ] TTAM: Full fetch complete (33118 records). [2025-09-25T21:45:22.278410] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-25T21:45:22.293819] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-25T21:45:22.521953] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-25T21:45:22.522935] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:45:22.523051] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:45:22.523124] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-25T21:45:22.523238] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-25T21:45:22.523299] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-25T21:45:22.523359] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-25T21:45:22.523474] [INFO ] [MAIN ] Update Progress: 2145/2372 symbols completed. TTAM took 28.6s. Estimated remaining: 30m 12s. Rate: 7.5 symbols/min [2025-09-25T21:45:22.598561] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T21:45:22.752466] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:22.818242] [DEBUG] [LOCAL ] TU: Loaded 49905 existing records from primary storage. [2025-09-25T21:45:22.818409] [INFO ] [MAIN ] TU: Loaded 49905 existing records. [2025-09-25T21:45:23.000314] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:23.000667] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-25T21:45:23.000729] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-25T21:45:23.001139] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-25T21:45:23.001198] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-25T21:45:23.094743] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-25T21:45:23.379487] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:23.888740] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-25T21:45:24.207504] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T21:45:24.688690] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-25T21:45:24.770707] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:45:25.488742] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-25T21:45:26.136756] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-25T21:45:26.288677] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-25T21:45:26.459922] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T21:45:27.088727] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-25T21:45:27.380760] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-25T21:45:27.888695] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-25T21:45:27.996826] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T21:45:28.383949] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T21:45:28.688735] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-25T21:45:29.439870] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T21:45:29.451502] [INFO ] [REMOTE ] TTE: Full fetch complete (75070 records). [2025-09-25T21:45:29.451663] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-25T21:45:29.493931] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-25T21:45:29.900270] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-25T21:45:29.900371] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-25T21:45:29.901704] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-25T21:45:29.901776] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-25T21:45:29.904691] [DEBUG] [LOCAL ] TTE: Trimmed 75070 records to 52025 (keeping 200 days of data) [2025-09-25T21:45:30.263095] [DEBUG] [LOCAL ] TTE: Primary data saved (52025 records). [2025-09-25T21:45:30.263259] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-25T21:45:30.263388] [INFO ] [MAIN ] Update Progress: 2146/2372 symbols completed. TTE took 32.8s. Estimated remaining: 30m 4s. Rate: 7.5 symbols/min [2025-09-25T21:45:30.301915] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-25T21:45:30.499749] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:30.522285] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T21:45:30.582308] [DEBUG] [LOCAL ] TUYA: Loaded 46557 existing records from primary storage. [2025-09-25T21:45:30.582501] [INFO ] [MAIN ] TUYA: Loaded 46557 existing records. [2025-09-25T21:45:30.672826] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T21:45:30.819082] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:30.819354] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-25T21:45:30.819410] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-25T21:45:30.819946] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-25T21:45:30.820011] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-25T21:45:31.093790] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-25T21:45:31.220026] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:31.888718] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-25T21:45:32.012937] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T21:45:32.426115] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:45:32.434861] [INFO ] [REMOTE ] TTC: Full fetch complete (62202 records). [2025-09-25T21:45:32.434997] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-25T21:45:32.694812] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-25T21:45:32.842714] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-25T21:45:32.842803] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-25T21:45:32.843833] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-25T21:45:32.843897] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-25T21:45:32.847021] [DEBUG] [LOCAL ] TTC: Trimmed 62202 records to 42754 (keeping 200 days of data) [2025-09-25T21:45:33.142560] [DEBUG] [LOCAL ] TTC: Primary data saved (42754 records). [2025-09-25T21:45:33.142726] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-25T21:45:33.142837] [INFO ] [MAIN ] Update Progress: 2147/2372 symbols completed. TTC took 38.0s. Estimated remaining: 29m 55s. Rate: 7.5 symbols/min [2025-09-25T21:45:33.327607] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:33.385031] [DEBUG] [LOCAL ] TV: Loaded 42983 existing records from primary storage. [2025-09-25T21:45:33.385178] [INFO ] [MAIN ] TV: Loaded 42983 existing records. [2025-09-25T21:45:33.497338] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-25T21:45:33.608755] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T21:45:33.638350] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:33.638577] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-25T21:45:33.638621] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-25T21:45:33.638969] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-25T21:45:33.639027] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-25T21:45:34.029863] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:34.138209] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:45:34.288724] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-25T21:45:34.803822] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T21:45:34.815526] [INFO ] [REMOTE ] TTI: Full fetch complete (64990 records). [2025-09-25T21:45:34.815738] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-25T21:45:35.094143] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-25T21:45:35.264693] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-25T21:45:35.264803] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-25T21:45:35.266016] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-25T21:45:35.266093] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-25T21:45:35.267668] [DEBUG] [LOCAL ] TTI: Trimmed 64990 records to 45740 (keeping 200 days of data) [2025-09-25T21:45:35.572249] [DEBUG] [LOCAL ] TTI: Primary data saved (45740 records). [2025-09-25T21:45:35.572427] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-25T21:45:35.572537] [INFO ] [MAIN ] Update Progress: 2148/2372 symbols completed. TTI took 24.8s. Estimated remaining: 29m 47s. Rate: 7.5 symbols/min [2025-09-25T21:45:35.801608] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:35.840010] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T21:45:35.853202] [DEBUG] [LOCAL ] TVC: Loaded 3445 existing records from primary storage. [2025-09-25T21:45:35.853286] [INFO ] [MAIN ] TVC: Loaded 3445 existing records. [2025-09-25T21:45:35.894734] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-25T21:45:36.068788] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:36.069154] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-25T21:45:36.069204] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-25T21:45:36.069399] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-25T21:45:36.069456] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-25T21:45:36.451347] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:36.688734] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-25T21:45:36.841373] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T21:45:37.488702] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-25T21:45:37.576013] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-25T21:45:37.581436] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T21:45:38.288739] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-25T21:45:39.088825] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-25T21:45:39.511600] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-25T21:45:39.888716] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-25T21:45:40.160819] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-25T21:45:40.688738] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-25T21:45:40.984876] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-25T21:45:41.097224] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-25T21:45:41.488700] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-25T21:45:41.891299] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-25T21:45:42.130493] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T21:45:42.288709] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-25T21:45:42.908509] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T21:45:43.088750] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-25T21:45:43.509819] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-25T21:45:43.888763] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-25T21:45:44.688821] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-25T21:45:45.488767] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-25T21:45:45.827477] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T21:45:46.288719] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-25T21:45:46.427325] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T21:45:46.984790] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T21:45:47.088805] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-25T21:45:47.722504] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-25T21:45:47.888707] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-25T21:45:48.087099] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:45:48.688811] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-25T21:45:49.488757] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-25T21:45:49.693522] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T21:45:50.163446] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-25T21:45:50.288799] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-25T21:45:51.088737] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-25T21:45:51.320542] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T21:45:51.614320] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-25T21:45:51.888740] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-25T21:45:52.193567] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T21:45:52.688747] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-25T21:45:53.488831] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-25T21:45:53.539566] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-25T21:45:53.997833] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-25T21:45:54.288754] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-25T21:45:54.335913] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:45:54.346851] [INFO ] [REMOTE ] TU: Full fetch complete (72907 records). [2025-09-25T21:45:54.347095] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-25T21:45:54.830381] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-25T21:45:54.835913] [INFO ] [REMOTE ] TVC: Full fetch complete (5657 records). [2025-09-25T21:45:54.836075] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-25T21:45:54.842015] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-25T21:45:54.842082] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-25T21:45:54.843469] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-25T21:45:54.843603] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-25T21:45:54.848705] [DEBUG] [LOCAL ] TU: Trimmed 72907 records to 50254 (keeping 200 days of data) [2025-09-25T21:45:55.090853] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-25T21:45:55.631622] [DEBUG] [LOCAL ] TU: Primary data saved (50254 records). [2025-09-25T21:45:55.631907] [INFO ] [MAIN ] TU: Full history saved. [2025-09-25T21:45:55.632285] [INFO ] [MAIN ] Update Progress: 2149/2372 symbols completed. TU took 33.1s. Estimated remaining: 29m 40s. Rate: 7.5 symbols/min [2025-09-25T21:45:55.912719] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-25T21:45:56.106607] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-25T21:45:56.108774] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-25T21:45:56.109028] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-25T21:45:56.109092] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-25T21:45:56.109561] [DEBUG] [LOCAL ] TVC: Trimmed 5657 records to 3455 (keeping 200 days of data) [2025-09-25T21:45:56.158546] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:56.165861] [DEBUG] [LOCAL ] TVC: Primary data saved (3455 records). [2025-09-25T21:45:56.166058] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-25T21:45:56.166300] [INFO ] [MAIN ] Update Progress: 2150/2372 symbols completed. TVC took 20.6s. Estimated remaining: 29m 31s. Rate: 7.5 symbols/min [2025-09-25T21:45:56.272283] [DEBUG] [LOCAL ] TVE: Loaded 2769 existing records from primary storage. [2025-09-25T21:45:56.272746] [INFO ] [MAIN ] TVE: Loaded 2769 existing records. [2025-09-25T21:45:56.511771] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:45:56.617999] [DEBUG] [LOCAL ] TWI: Loaded 34508 existing records from primary storage. [2025-09-25T21:45:56.618252] [INFO ] [MAIN ] TWI: Loaded 34508 existing records. [2025-09-25T21:45:56.655592] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:56.656004] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-25T21:45:56.656081] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-25T21:45:56.656391] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-25T21:45:56.656476] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-25T21:45:57.108426] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:45:57.121837] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-25T21:45:57.151695] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-25T21:45:57.186683] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-25T21:45:57.201854] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-25T21:45:57.356229] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:57.360728] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-25T21:45:57.674930] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:45:57.675285] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-25T21:45:58.005393] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-25T21:45:58.288727] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-25T21:45:58.443587] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T21:45:59.088703] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-25T21:45:59.375041] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:45:59.388875] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (3.48 seconds). [2025-09-25T21:45:59.693548] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T21:45:59.811312] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:45:59.888719] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-25T21:46:00.688731] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-25T21:46:01.290292] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-25T21:46:01.488755] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-25T21:46:01.572950] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:46:02.288749] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-25T21:46:03.088739] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-25T21:46:03.248605] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T21:46:03.888753] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-25T21:46:03.976482] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T21:46:04.278296] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-25T21:46:04.692891] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-25T21:46:04.706165] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-25T21:46:05.488742] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-25T21:46:06.288717] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-25T21:46:06.448020] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:46:06.862811] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-25T21:46:06.919534] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-25T21:46:07.088712] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-25T21:46:07.888723] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-25T21:46:08.688712] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-25T21:46:09.002885] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T21:46:09.013368] [INFO ] [REMOTE ] TUYA: Full fetch complete (65833 records). [2025-09-25T21:46:09.013542] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-25T21:46:09.435783] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-25T21:46:09.435895] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-25T21:46:09.437207] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-25T21:46:09.437278] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-25T21:46:09.438920] [DEBUG] [LOCAL ] TUYA: Trimmed 65833 records to 46865 (keeping 200 days of data) [2025-09-25T21:46:09.498438] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-25T21:46:09.769077] [DEBUG] [LOCAL ] TUYA: Primary data saved (46865 records). [2025-09-25T21:46:09.769231] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-25T21:46:09.769454] [INFO ] [MAIN ] Update Progress: 2151/2372 symbols completed. TUYA took 39.5s. Estimated remaining: 29m 24s. Rate: 7.5 symbols/min [2025-09-25T21:46:09.952343] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:10.028372] [DEBUG] [LOCAL ] TWLO: Loaded 52722 existing records from primary storage. [2025-09-25T21:46:10.028536] [INFO ] [MAIN ] TWLO: Loaded 52722 existing records. [2025-09-25T21:46:10.164800] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-25T21:46:10.273429] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:46:10.273867] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-25T21:46:10.273927] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-25T21:46:10.274371] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-25T21:46:10.274431] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-25T21:46:10.296352] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-25T21:46:10.409414] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T21:46:10.705284] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:10.727246] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T21:46:10.735474] [INFO ] [REMOTE ] TV: Full fetch complete (62330 records). [2025-09-25T21:46:10.735716] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-25T21:46:11.089463] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-25T21:46:11.131273] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-25T21:46:11.131378] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-25T21:46:11.132508] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-25T21:46:11.132589] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-25T21:46:11.134100] [DEBUG] [LOCAL ] TV: Trimmed 62330 records to 43277 (keeping 200 days of data) [2025-09-25T21:46:11.412161] [DEBUG] [LOCAL ] TV: Primary data saved (43277 records). [2025-09-25T21:46:11.412328] [INFO ] [MAIN ] TV: Full history saved. [2025-09-25T21:46:11.413517] [INFO ] [MAIN ] Update Progress: 2152/2372 symbols completed. TV took 38.3s. Estimated remaining: 29m 15s. Rate: 7.5 symbols/min [2025-09-25T21:46:11.561184] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:46:11.681188] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:11.688952] [DEBUG] [LOCAL ] TWN: Loaded 3209 existing records from primary storage. [2025-09-25T21:46:11.689075] [INFO ] [MAIN ] TWN: Loaded 3209 existing records. [2025-09-25T21:46:11.878081] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:46:11.878423] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-25T21:46:11.878471] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-25T21:46:11.878819] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-25T21:46:11.878881] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-25T21:46:11.901374] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-25T21:46:12.267519] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:12.598959] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-25T21:46:12.688734] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-25T21:46:13.259022] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-25T21:46:13.279484] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-25T21:46:13.488748] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-25T21:46:13.972244] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-25T21:46:14.288739] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-25T21:46:14.768439] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T21:46:15.088720] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-25T21:46:15.888718] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-25T21:46:16.688727] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-25T21:46:17.231213] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-25T21:46:17.272905] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-25T21:46:17.300022] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T21:46:17.488731] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-25T21:46:18.288734] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-25T21:46:18.775514] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-25T21:46:18.776696] [INFO ] [REMOTE ] TVE: Full fetch complete (4352 records). [2025-09-25T21:46:18.776787] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-25T21:46:19.014011] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T21:46:19.092382] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-25T21:46:19.246194] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-25T21:46:19.246335] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-25T21:46:19.246491] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-25T21:46:19.246595] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-25T21:46:19.247030] [DEBUG] [LOCAL ] TVE: Trimmed 4352 records to 2786 (keeping 200 days of data) [2025-09-25T21:46:19.264942] [DEBUG] [LOCAL ] TVE: Primary data saved (2786 records). [2025-09-25T21:46:19.265037] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-25T21:46:19.265124] [INFO ] [MAIN ] Update Progress: 2153/2372 symbols completed. TVE took 23.6s. Estimated remaining: 29m 7s. Rate: 7.5 symbols/min [2025-09-25T21:46:19.437223] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:19.497902] [DEBUG] [LOCAL ] TWO: Loaded 48323 existing records from primary storage. [2025-09-25T21:46:19.498059] [INFO ] [MAIN ] TWO: Loaded 48323 existing records. [2025-09-25T21:46:19.745264] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:46:19.745515] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-25T21:46:19.745560] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-25T21:46:19.745941] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-25T21:46:19.746003] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-25T21:46:19.893781] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-25T21:46:20.123053] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:20.481454] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-25T21:46:20.508428] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T21:46:20.688731] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-25T21:46:21.488730] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-25T21:46:22.288704] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-25T21:46:22.726735] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-25T21:46:22.745533] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-25T21:46:22.877912] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-25T21:46:23.088808] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-25T21:46:23.793798] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T21:46:23.888752] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-25T21:46:24.444103] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-25T21:46:24.688761] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-25T21:46:25.146969] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-25T21:46:25.488744] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-25T21:46:26.133218] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T21:46:26.288754] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-25T21:46:27.088762] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-25T21:46:27.888695] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-25T21:46:27.929687] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T21:46:28.378537] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T21:46:28.384926] [INFO ] [REMOTE ] TWI: Full fetch complete (53256 records). [2025-09-25T21:46:28.385041] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-25T21:46:28.693813] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-25T21:46:28.816995] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-25T21:46:28.817081] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-25T21:46:28.818149] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-25T21:46:28.818219] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-25T21:46:28.819443] [DEBUG] [LOCAL ] TWI: Trimmed 53256 records to 34766 (keeping 200 days of data) [2025-09-25T21:46:29.036698] [DEBUG] [LOCAL ] TWI: Primary data saved (34766 records). [2025-09-25T21:46:29.036897] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-25T21:46:29.037009] [INFO ] [MAIN ] Update Progress: 2154/2372 symbols completed. TWI took 32.9s. Estimated remaining: 28m 59s. Rate: 7.5 symbols/min [2025-09-25T21:46:29.217222] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-25T21:46:29.219113] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:29.219232] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-25T21:46:29.219286] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-25T21:46:29.219439] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-25T21:46:29.219480] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-25T21:46:29.219522] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-25T21:46:29.219555] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-25T21:46:29.491012] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-25T21:46:29.619880] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:29.842553] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T21:46:30.288983] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-25T21:46:30.506946] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:46:30.507300] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-25T21:46:31.088757] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-25T21:46:31.243228] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-25T21:46:31.449348] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-25T21:46:31.450582] [INFO ] [REMOTE ] TWN: Full fetch complete (5347 records). [2025-09-25T21:46:31.450682] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-25T21:46:31.849084] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-25T21:46:31.849210] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-25T21:46:31.849425] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-25T21:46:31.849496] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-25T21:46:31.849974] [DEBUG] [LOCAL ] TWN: Trimmed 5347 records to 3228 (keeping 200 days of data) [2025-09-25T21:46:31.873451] [DEBUG] [LOCAL ] TWN: Primary data saved (3228 records). [2025-09-25T21:46:31.873541] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-25T21:46:31.873697] [INFO ] [MAIN ] Update Progress: 2155/2372 symbols completed. TWN took 20.5s. Estimated remaining: 28m 51s. Rate: 7.5 symbols/min [2025-09-25T21:46:31.889889] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-25T21:46:32.060771] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:32.108918] [DEBUG] [LOCAL ] TX: Loaded 23676 existing records from primary storage. [2025-09-25T21:46:32.109074] [INFO ] [MAIN ] TX: Loaded 23676 existing records. [2025-09-25T21:46:32.155258] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:46:32.155626] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-25T21:46:32.304610] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:46:32.305244] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-25T21:46:32.305377] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-25T21:46:32.306020] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-25T21:46:32.306081] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-25T21:46:32.693439] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-25T21:46:32.698718] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:32.902072] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:46:32.902591] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-25T21:46:33.488821] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-25T21:46:34.288825] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-25T21:46:35.089838] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-25T21:46:35.312351] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:46:35.312914] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-25T21:46:35.396670] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T21:46:35.888713] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-25T21:46:36.026616] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-25T21:46:36.688808] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-25T21:46:36.901766] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:46:36.902155] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-25T21:46:37.020849] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-25T21:46:37.488806] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-25T21:46:38.288819] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-25T21:46:39.088733] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-25T21:46:39.177273] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T21:46:39.480181] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-25T21:46:39.888836] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-25T21:46:40.688765] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-25T21:46:41.044072] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-25T21:46:41.248414] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T21:46:41.488781] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-25T21:46:42.291946] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-25T21:46:42.303722] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T21:46:42.597496] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:46:43.088731] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-25T21:46:43.888765] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-25T21:46:44.216766] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T21:46:44.217479] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T21:46:44.675774] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T21:46:44.688718] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-25T21:46:45.286131] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T21:46:45.488734] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-25T21:46:45.987867] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-25T21:46:46.288742] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-25T21:46:47.070762] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-25T21:46:47.088686] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-25T21:46:47.704509] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T21:46:47.706280] [INFO ] [REMOTE ] TWOD: Full fetch complete (4311 records). [2025-09-25T21:46:47.706409] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-25T21:46:47.892875] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-25T21:46:47.927925] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 91 unique days, need 200 days [2025-09-25T21:46:47.928187] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:46:47.928254] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:46:47.928364] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-25T21:46:47.928483] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-25T21:46:47.928579] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-25T21:46:47.928700] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-25T21:46:47.928852] [INFO ] [MAIN ] Update Progress: 2156/2372 symbols completed. TWOD took 18.9s. Estimated remaining: 28m 44s. Rate: 7.5 symbols/min [2025-09-25T21:46:48.110775] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:46:48.186051] [DEBUG] [LOCAL ] TXNM: Loaded 43846 existing records from primary storage. [2025-09-25T21:46:48.186224] [INFO ] [MAIN ] TXNM: Loaded 43846 existing records. [2025-09-25T21:46:48.366765] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:46:48.367156] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-25T21:46:48.367213] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-25T21:46:48.368251] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-25T21:46:48.368333] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-25T21:46:48.698933] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-25T21:46:48.734772] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:46:49.488805] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-25T21:46:49.631261] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:46:50.288814] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-25T21:46:50.665121] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-25T21:46:50.857433] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T21:46:51.088752] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-25T21:46:51.888744] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-25T21:46:52.164265] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-25T21:46:52.310279] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T21:46:52.688746] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-25T21:46:53.428334] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-25T21:46:53.488719] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-25T21:46:54.003372] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-25T21:46:54.288738] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-25T21:46:54.750186] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-25T21:46:55.088733] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-25T21:46:55.888737] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-25T21:46:56.052267] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T21:46:56.688764] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-25T21:46:57.126405] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:46:57.267322] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-25T21:46:57.479285] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T21:46:57.488680] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-25T21:46:58.288735] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-25T21:46:58.543098] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T21:46:58.547423] [INFO ] [REMOTE ] TX: Full fetch complete (35717 records). [2025-09-25T21:46:58.547557] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-25T21:46:58.965594] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-25T21:46:58.965718] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-25T21:46:58.966539] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-25T21:46:58.966667] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-25T21:46:58.968227] [DEBUG] [LOCAL ] TX: Trimmed 35717 records to 23787 (keeping 200 days of data) [2025-09-25T21:46:59.088829] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-25T21:46:59.126532] [DEBUG] [LOCAL ] TX: Primary data saved (23787 records). [2025-09-25T21:46:59.127279] [INFO ] [MAIN ] TX: Full history saved. [2025-09-25T21:46:59.127426] [INFO ] [MAIN ] Update Progress: 2157/2372 symbols completed. TX took 27.3s. Estimated remaining: 28m 36s. Rate: 7.5 symbols/min [2025-09-25T21:46:59.888731] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-25T21:47:00.091341] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T21:47:00.688708] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-25T21:47:00.986630] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T21:47:01.488687] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-25T21:47:01.897588] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-25T21:47:01.908686] [INFO ] [REMOTE ] TWLO: Full fetch complete (76449 records). [2025-09-25T21:47:01.908864] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-25T21:47:02.189446] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:47:02.290553] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-25T21:47:02.418781] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-25T21:47:02.418920] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-25T21:47:02.420380] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-25T21:47:02.420463] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-25T21:47:02.423797] [DEBUG] [LOCAL ] TWLO: Trimmed 76449 records to 53111 (keeping 200 days of data) [2025-09-25T21:47:02.791436] [DEBUG] [LOCAL ] TWLO: Primary data saved (53111 records). [2025-09-25T21:47:02.791628] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-25T21:47:02.791825] [INFO ] [MAIN ] Update Progress: 2158/2372 symbols completed. TWLO took 53.0s. Estimated remaining: 28m 28s. Rate: 7.5 symbols/min [2025-09-25T21:47:02.873562] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T21:47:02.884361] [INFO ] [REMOTE ] TWO: Full fetch complete (68931 records). [2025-09-25T21:47:02.884562] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-25T21:47:03.304003] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-25T21:47:03.304113] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-25T21:47:03.306143] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-25T21:47:03.306215] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-25T21:47:03.308082] [DEBUG] [LOCAL ] TWO: Trimmed 68931 records to 48681 (keeping 200 days of data) [2025-09-25T21:47:03.635456] [DEBUG] [LOCAL ] TWO: Primary data saved (48681 records). [2025-09-25T21:47:03.635610] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-25T21:47:03.635730] [INFO ] [MAIN ] Update Progress: 2159/2372 symbols completed. TWO took 44.4s. Estimated remaining: 28m 19s. Rate: 7.5 symbols/min [2025-09-25T21:47:04.153856] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T21:47:04.165169] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-25T21:47:05.606322] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T21:47:05.618072] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-25T21:47:07.204450] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T21:47:07.217988] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-25T21:47:08.779150] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T21:47:08.792854] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-25T21:47:10.214344] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T21:47:10.221801] [INFO ] [REMOTE ] TXNM: Full fetch complete (62616 records). [2025-09-25T21:47:10.221968] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-25T21:47:10.650010] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-25T21:47:10.650105] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-25T21:47:10.651258] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-25T21:47:10.651324] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-25T21:47:10.652723] [DEBUG] [LOCAL ] TXNM: Trimmed 62616 records to 44153 (keeping 200 days of data) [2025-09-25T21:47:10.928906] [DEBUG] [LOCAL ] TXNM: Primary data saved (44153 records). [2025-09-25T21:47:10.929061] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-25T21:47:10.929183] [INFO ] [MAIN ] Update Progress: 2160/2372 symbols completed. TXNM took 23.0s. Estimated remaining: 28m 11s. Rate: 7.5 symbols/min [2025-09-25T21:47:11.660981] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:11.662821] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:11.736486] [DEBUG] [LOCAL ] TYG: Loaded 14210 existing records from primary storage. [2025-09-25T21:47:11.745437] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:11.761771] [INFO ] [MAIN ] TYG: Loaded 14210 existing records. [2025-09-25T21:47:11.839862] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:11.856676] [DEBUG] [LOCAL ] TXO: Loaded 18787 existing records from primary storage. [2025-09-25T21:47:11.856881] [INFO ] [MAIN ] TXO: Loaded 18787 existing records. [2025-09-25T21:47:11.919417] [DEBUG] [LOCAL ] TY: Loaded 7664 existing records from primary storage. [2025-09-25T21:47:11.919812] [INFO ] [MAIN ] TY: Loaded 7664 existing records. [2025-09-25T21:47:11.992046] [DEBUG] [LOCAL ] TXT: Loaded 49729 existing records from primary storage. [2025-09-25T21:47:11.997068] [INFO ] [MAIN ] TXT: Loaded 49729 existing records. [2025-09-25T21:47:12.605444] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:12.615898] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-25T21:47:12.615968] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-25T21:47:12.616343] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-25T21:47:12.616405] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-25T21:47:12.623055] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:12.623193] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-25T21:47:12.623233] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-25T21:47:12.623428] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-25T21:47:12.623486] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-25T21:47:12.675075] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:12.675418] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-25T21:47:12.675477] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-25T21:47:12.675796] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-25T21:47:12.675857] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-25T21:47:12.863047] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:12.880057] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-25T21:47:12.880113] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-25T21:47:12.880609] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-25T21:47:12.880742] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-25T21:47:14.152315] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:14.152941] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-25T21:47:14.166189] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:14.174127] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-25T21:47:14.360559] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:14.361014] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-25T21:47:14.378238] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:14.378607] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-25T21:47:15.015439] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T21:47:15.018950] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-25T21:47:15.254511] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-25T21:47:15.263556] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-25T21:47:15.273744] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T21:47:15.279354] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-25T21:47:15.796733] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T21:47:15.799381] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-25T21:47:16.052356] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T21:47:16.062375] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-25T21:47:16.188874] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T21:47:16.192490] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-25T21:47:16.514366] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T21:47:16.517085] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-25T21:47:16.534708] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-25T21:47:16.540269] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-25T21:47:16.988441] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T21:47:16.993331] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-25T21:47:17.272117] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T21:47:17.274946] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-25T21:47:17.459026] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-25T21:47:17.488702] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-25T21:47:17.511275] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T21:47:17.727999] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-25T21:47:18.140835] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-25T21:47:18.288732] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-25T21:47:19.090739] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:47:19.089588] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-25T21:47:19.169487] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:47:19.888707] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-25T21:47:20.069954] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T21:47:20.662727] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T21:47:20.688739] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-25T21:47:21.447673] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-25T21:47:21.488723] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-25T21:47:22.288808] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-25T21:47:22.731213] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T21:47:22.776038] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-25T21:47:23.088725] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-25T21:47:23.888775] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-25T21:47:24.378312] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-25T21:47:24.656684] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T21:47:24.659873] [INFO ] [REMOTE ] TY: Full fetch complete (11800 records). [2025-09-25T21:47:24.659996] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-25T21:47:24.693899] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-25T21:47:25.108713] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-25T21:47:25.108835] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-25T21:47:25.109221] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-25T21:47:25.109324] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-25T21:47:25.110313] [DEBUG] [LOCAL ] TY: Trimmed 11800 records to 7718 (keeping 200 days of data) [2025-09-25T21:47:25.165605] [DEBUG] [LOCAL ] TY: Primary data saved (7718 records). [2025-09-25T21:47:25.165770] [INFO ] [MAIN ] TY: Full history saved. [2025-09-25T21:47:25.165925] [INFO ] [MAIN ] Update Progress: 2161/2372 symbols completed. TY took 14.2s. Estimated remaining: 28m 4s. Rate: 7.5 symbols/min [2025-09-25T21:47:25.349901] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:25.389116] [DEBUG] [LOCAL ] TYL: Loaded 22299 existing records from primary storage. [2025-09-25T21:47:25.389289] [INFO ] [MAIN ] TYL: Loaded 22299 existing records. [2025-09-25T21:47:25.488743] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-25T21:47:25.600570] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:25.602151] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-25T21:47:25.602200] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-25T21:47:25.602583] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-25T21:47:25.602674] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-25T21:47:25.736437] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-25T21:47:26.008389] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:26.288722] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-25T21:47:26.553744] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-25T21:47:27.088692] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-25T21:47:27.385668] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:47:27.878455] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-25T21:47:27.888721] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-25T21:47:28.688714] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-25T21:47:28.880566] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T21:47:29.488685] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-25T21:47:29.705478] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T21:47:29.711734] [INFO ] [REMOTE ] TXO: Full fetch complete (25960 records). [2025-09-25T21:47:29.711828] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-25T21:47:30.095660] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-25T21:47:30.095752] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-25T21:47:30.096384] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-25T21:47:30.096455] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-25T21:47:30.097335] [DEBUG] [LOCAL ] TXO: Trimmed 25960 records to 18913 (keeping 200 days of data) [2025-09-25T21:47:30.238425] [DEBUG] [LOCAL ] TXO: Primary data saved (18913 records). [2025-09-25T21:47:30.238603] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-25T21:47:30.238786] [INFO ] [MAIN ] Update Progress: 2162/2372 symbols completed. TXO took 19.3s. Estimated remaining: 27m 55s. Rate: 7.5 symbols/min [2025-09-25T21:47:30.293519] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-25T21:47:30.432125] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:30.525013] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-25T21:47:30.525220] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-25T21:47:30.645455] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T21:47:30.734989] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:30.735420] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-25T21:47:30.735470] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-25T21:47:30.735807] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-25T21:47:30.735871] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-25T21:47:31.093828] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-25T21:47:31.138062] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:31.888694] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-25T21:47:32.103093] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T21:47:32.127144] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T21:47:32.688800] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-25T21:47:33.488860] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-25T21:47:34.288810] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-25T21:47:34.400017] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-25T21:47:34.442888] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-25T21:47:34.666174] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T21:47:35.088720] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-25T21:47:35.415049] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:47:35.888758] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-25T21:47:36.132556] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T21:47:36.688855] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-25T21:47:37.403995] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-25T21:47:37.488757] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-25T21:47:38.288856] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-25T21:47:39.088789] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-25T21:47:39.790270] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (3.10 seconds). [2025-09-25T21:47:39.898919] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-25T21:47:39.905471] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-25T21:47:40.231950] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T21:47:40.688740] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-25T21:47:40.881389] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-25T21:47:41.329527] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-25T21:47:41.359327] [INFO ] [REMOTE ] TYG: Full fetch complete (22617 records). [2025-09-25T21:47:41.359559] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-25T21:47:41.417905] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:47:41.493836] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-25T21:47:41.812058] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-25T21:47:41.812180] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-25T21:47:41.812750] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-25T21:47:41.812813] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-25T21:47:41.813498] [DEBUG] [LOCAL ] TYG: Trimmed 22617 records to 14343 (keeping 200 days of data) [2025-09-25T21:47:41.921485] [DEBUG] [LOCAL ] TYG: Primary data saved (14343 records). [2025-09-25T21:47:41.921675] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-25T21:47:41.921868] [INFO ] [MAIN ] Update Progress: 2163/2372 symbols completed. TYG took 31.0s. Estimated remaining: 27m 48s. Rate: 7.5 symbols/min [2025-09-25T21:47:42.110126] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:42.192217] [DEBUG] [LOCAL ] UA: Loaded 50422 existing records from primary storage. [2025-09-25T21:47:42.192382] [INFO ] [MAIN ] UA: Loaded 50422 existing records. [2025-09-25T21:47:42.293729] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-25T21:47:42.388696] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:42.390206] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-25T21:47:42.390275] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-25T21:47:42.390537] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-25T21:47:42.390613] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-25T21:47:42.765743] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:43.088733] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-25T21:47:43.844217] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-25T21:47:43.888724] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-25T21:47:44.213779] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-25T21:47:44.403265] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-25T21:47:44.688745] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-25T21:47:45.488753] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-25T21:47:45.904354] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T21:47:46.288745] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-25T21:47:46.392002] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-25T21:47:47.088697] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-25T21:47:47.185267] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:47:47.888723] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-25T21:47:48.222297] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-25T21:47:48.688730] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-25T21:47:49.423269] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-25T21:47:49.488688] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-25T21:47:49.711119] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-25T21:47:50.288738] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-25T21:47:51.088788] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-25T21:47:51.176367] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-25T21:47:51.185983] [INFO ] [REMOTE ] TXT: Full fetch complete (72254 records). [2025-09-25T21:47:51.186179] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-25T21:47:51.620014] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-25T21:47:51.620122] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-25T21:47:51.621427] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-25T21:47:51.621495] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-25T21:47:51.623136] [DEBUG] [LOCAL ] TXT: Trimmed 72254 records to 50103 (keeping 200 days of data) [2025-09-25T21:47:51.960579] [DEBUG] [LOCAL ] TXT: Primary data saved (50103 records). [2025-09-25T21:47:51.960766] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-25T21:47:51.961014] [INFO ] [MAIN ] Update Progress: 2164/2372 symbols completed. TXT took 41.0s. Estimated remaining: 27m 40s. Rate: 7.5 symbols/min [2025-09-25T21:47:52.142514] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:47:52.211792] [DEBUG] [LOCAL ] UAA: Loaded 53509 existing records from primary storage. [2025-09-25T21:47:52.211960] [INFO ] [MAIN ] UAA: Loaded 53509 existing records. [2025-09-25T21:47:52.271455] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T21:47:52.288865] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-25T21:47:52.471365] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T21:47:52.497613] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:47:52.498079] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-25T21:47:52.498130] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-25T21:47:52.498953] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-25T21:47:52.499015] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-25T21:47:52.690073] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-25T21:47:52.922545] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:47:53.109985] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (3.62 seconds). [2025-09-25T21:47:53.488743] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-25T21:47:53.855155] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:47:54.288688] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-25T21:47:54.563962] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-25T21:47:55.088741] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-25T21:47:55.769469] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-25T21:47:55.888731] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-25T21:47:56.211795] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-25T21:47:56.297208] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:47:56.688721] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-25T21:47:57.488733] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-25T21:47:57.794307] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T21:47:58.288733] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-25T21:47:58.428019] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:47:59.088736] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-25T21:47:59.888696] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-25T21:47:59.986327] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T21:48:00.062441] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-25T21:48:00.649863] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:48:00.654177] [INFO ] [REMOTE ] TYL: Full fetch complete (31388 records). [2025-09-25T21:48:00.654268] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-25T21:48:00.691524] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-25T21:48:00.943408] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-25T21:48:01.204139] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-25T21:48:01.204269] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-25T21:48:01.205270] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-25T21:48:01.205361] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-25T21:48:01.207373] [DEBUG] [LOCAL ] TYL: Trimmed 31388 records to 22453 (keeping 200 days of data) [2025-09-25T21:48:01.389594] [DEBUG] [LOCAL ] TYL: Primary data saved (22453 records). [2025-09-25T21:48:01.389847] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-25T21:48:01.389969] [INFO ] [MAIN ] Update Progress: 2165/2372 symbols completed. TYL took 36.2s. Estimated remaining: 27m 32s. Rate: 7.5 symbols/min [2025-09-25T21:48:01.491158] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-25T21:48:01.674128] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:01.691832] [DEBUG] [LOCAL ] UAN: Loaded 5445 existing records from primary storage. [2025-09-25T21:48:01.692027] [INFO ] [MAIN ] UAN: Loaded 5445 existing records. [2025-09-25T21:48:01.961289] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:01.961580] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-25T21:48:01.961629] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-25T21:48:01.962061] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-25T21:48:01.962126] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-25T21:48:02.306912] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-25T21:48:02.489211] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:02.521810] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T21:48:03.088714] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-25T21:48:03.727166] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-25T21:48:03.888707] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-25T21:48:04.688706] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-25T21:48:04.837458] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-25T21:48:04.989958] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-25T21:48:05.488707] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-25T21:48:05.512001] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-25T21:48:05.579296] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T21:48:06.288736] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-25T21:48:07.088755] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-25T21:48:07.304896] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-25T21:48:07.888730] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-25T21:48:08.437083] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-25T21:48:08.449712] [INFO ] [REMOTE ] UA: Full fetch complete (72933 records). [2025-09-25T21:48:08.449953] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-25T21:48:08.712752] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-25T21:48:08.909678] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-25T21:48:08.909796] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-25T21:48:08.911063] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-25T21:48:08.911133] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-25T21:48:08.913153] [DEBUG] [LOCAL ] UA: Trimmed 72933 records to 50812 (keeping 200 days of data) [2025-09-25T21:48:09.233550] [DEBUG] [LOCAL ] UA: Primary data saved (50812 records). [2025-09-25T21:48:09.233811] [INFO ] [MAIN ] UA: Full history saved. [2025-09-25T21:48:09.233925] [INFO ] [MAIN ] Update Progress: 2166/2372 symbols completed. UA took 27.3s. Estimated remaining: 27m 24s. Rate: 7.5 symbols/min [2025-09-25T21:48:09.419825] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T21:48:09.446457] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:09.488708] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-25T21:48:09.511436] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-25T21:48:09.512629] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-25T21:48:09.715108] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:09.715438] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-25T21:48:09.715485] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-25T21:48:09.716006] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-25T21:48:09.716073] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-25T21:48:10.142594] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:10.148559] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T21:48:10.242180] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (3.15 seconds). [2025-09-25T21:48:10.288670] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-25T21:48:10.549496] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-25T21:48:10.569408] [INFO ] [REMOTE ] U: Full fetch complete (77925 records). [2025-09-25T21:48:10.569617] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-25T21:48:11.028082] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-25T21:48:11.028185] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-25T21:48:11.029535] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-25T21:48:11.029607] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-25T21:48:11.031498] [DEBUG] [LOCAL ] U: Trimmed 77925 records to 54189 (keeping 200 days of data) [2025-09-25T21:48:11.104988] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-25T21:48:11.114013] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-25T21:48:11.411103] [DEBUG] [LOCAL ] U: Primary data saved (54189 records). [2025-09-25T21:48:11.411270] [INFO ] [MAIN ] U: Full history saved. [2025-09-25T21:48:11.412363] [INFO ] [MAIN ] Update Progress: 2167/2372 symbols completed. U took 41.2s. Estimated remaining: 27m 15s. Rate: 7.5 symbols/min [2025-09-25T21:48:11.599448] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:11.677336] [DEBUG] [LOCAL ] UBS: Loaded 52439 existing records from primary storage. [2025-09-25T21:48:11.677496] [INFO ] [MAIN ] UBS: Loaded 52439 existing records. [2025-09-25T21:48:11.870634] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:11.871583] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-25T21:48:11.871659] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-25T21:48:11.872387] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-25T21:48:11.872469] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-25T21:48:11.892227] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-25T21:48:12.258721] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:12.688764] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-25T21:48:12.881362] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T21:48:13.423185] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-25T21:48:13.488703] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-25T21:48:14.131130] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-25T21:48:14.288702] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-25T21:48:14.485768] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-25T21:48:14.931825] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T21:48:15.088799] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-25T21:48:15.889004] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-25T21:48:16.688712] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-25T21:48:17.088855] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T21:48:17.360148] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T21:48:17.488724] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-25T21:48:18.179634] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T21:48:18.181848] [INFO ] [REMOTE ] UAN: Full fetch complete (8205 records). [2025-09-25T21:48:18.181980] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-25T21:48:18.295521] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-25T21:48:18.556504] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-25T21:48:18.674743] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-25T21:48:18.674831] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-25T21:48:18.675085] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-25T21:48:18.675206] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-25T21:48:18.675871] [DEBUG] [LOCAL ] UAN: Trimmed 8205 records to 5475 (keeping 200 days of data) [2025-09-25T21:48:18.713978] [DEBUG] [LOCAL ] UAN: Primary data saved (5475 records). [2025-09-25T21:48:18.714121] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-25T21:48:18.714350] [INFO ] [MAIN ] Update Progress: 2168/2372 symbols completed. UAN took 17.3s. Estimated remaining: 27m 7s. Rate: 7.5 symbols/min [2025-09-25T21:48:18.905777] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:18.978948] [DEBUG] [LOCAL ] UCB: Loaded 38057 existing records from primary storage. [2025-09-25T21:48:18.979174] [INFO ] [MAIN ] UCB: Loaded 38057 existing records. [2025-09-25T21:48:19.089465] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-25T21:48:19.187040] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:19.187446] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-25T21:48:19.187505] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-25T21:48:19.188078] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-25T21:48:19.188179] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-25T21:48:19.564458] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:19.888763] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-25T21:48:20.161672] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:48:20.688821] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-25T21:48:21.103251] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-25T21:48:21.488742] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-25T21:48:21.644844] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.56 seconds). [2025-09-25T21:48:22.225838] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T21:48:22.288731] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-25T21:48:23.044202] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:48:23.088760] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-25T21:48:23.888719] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-25T21:48:24.233724] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T21:48:24.688755] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-25T21:48:25.235527] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-25T21:48:25.488785] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-25T21:48:26.076768] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T21:48:26.188237] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-25T21:48:26.288761] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-25T21:48:27.088819] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-25T21:48:27.657939] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-25T21:48:27.890731] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-25T21:48:28.059743] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T21:48:28.070892] [INFO ] [REMOTE ] UAA: Full fetch complete (77480 records). [2025-09-25T21:48:28.071074] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-25T21:48:28.501561] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-25T21:48:28.501697] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-25T21:48:28.503238] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-25T21:48:28.503532] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-25T21:48:28.506224] [DEBUG] [LOCAL ] UAA: Trimmed 77480 records to 53899 (keeping 200 days of data) [2025-09-25T21:48:28.698546] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-25T21:48:28.772482] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:48:28.903005] [DEBUG] [LOCAL ] UAA: Primary data saved (53899 records). [2025-09-25T21:48:28.903172] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-25T21:48:28.903305] [INFO ] [MAIN ] Update Progress: 2169/2372 symbols completed. UAA took 36.9s. Estimated remaining: 26m 60s. Rate: 7.5 symbols/min [2025-09-25T21:48:29.084590] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:29.144940] [DEBUG] [LOCAL ] UDR: Loaded 51792 existing records from primary storage. [2025-09-25T21:48:29.145102] [INFO ] [MAIN ] UDR: Loaded 51792 existing records. [2025-09-25T21:48:29.336496] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:29.338974] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-25T21:48:29.339052] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-25T21:48:29.339341] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-25T21:48:29.339418] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-25T21:48:29.497102] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-25T21:48:29.751012] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:29.924521] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T21:48:30.288759] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-25T21:48:30.992854] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:48:31.088754] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-25T21:48:31.299496] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-25T21:48:31.888710] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-25T21:48:32.411984] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-25T21:48:32.688717] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-25T21:48:32.841587] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T21:48:33.190176] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T21:48:33.488756] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-25T21:48:34.288742] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-25T21:48:35.088740] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-25T21:48:35.188842] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:48:35.312337] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-09-25T21:48:35.888712] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-25T21:48:36.059327] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-25T21:48:36.235038] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:48:36.688743] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-25T21:48:37.488746] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-25T21:48:38.169201] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T21:48:38.287603] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-25T21:48:38.291914] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-25T21:48:39.088713] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-25T21:48:39.176261] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:48:39.888714] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-25T21:48:40.296956] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T21:48:40.340749] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T21:48:40.688735] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-25T21:48:41.488758] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-25T21:48:41.849804] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T21:48:42.288689] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-25T21:48:42.481618] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T21:48:43.088740] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-25T21:48:43.856020] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-25T21:48:43.888684] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-25T21:48:44.078776] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T21:48:44.688726] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-25T21:48:44.903108] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T21:48:44.918435] [INFO ] [REMOTE ] UBS: Full fetch complete (75614 records). [2025-09-25T21:48:44.918776] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-25T21:48:45.360483] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-25T21:48:45.360677] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-25T21:48:45.361981] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-25T21:48:45.362055] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-25T21:48:45.364355] [DEBUG] [LOCAL ] UBS: Trimmed 75614 records to 52821 (keeping 200 days of data) [2025-09-25T21:48:45.496721] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-25T21:48:45.726292] [DEBUG] [LOCAL ] UBS: Primary data saved (52821 records). [2025-09-25T21:48:45.726457] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-25T21:48:45.727974] [INFO ] [MAIN ] Update Progress: 2170/2372 symbols completed. UBS took 34.3s. Estimated remaining: 26m 53s. Rate: 7.5 symbols/min [2025-09-25T21:48:45.910213] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:45.977161] [DEBUG] [LOCAL ] UE: Loaded 42956 existing records from primary storage. [2025-09-25T21:48:45.977322] [INFO ] [MAIN ] UE: Loaded 42956 existing records. [2025-09-25T21:48:46.184929] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:46.185251] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-25T21:48:46.185298] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-25T21:48:46.185621] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-25T21:48:46.185797] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-25T21:48:46.499376] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:48:46.512261] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-25T21:48:46.613934] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-25T21:48:46.725182] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:46.733266] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-25T21:48:46.741801] [INFO ] [REMOTE ] UCB: Full fetch complete (54709 records). [2025-09-25T21:48:46.741919] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-25T21:48:47.093814] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-25T21:48:47.145076] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-25T21:48:47.145170] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-25T21:48:47.146146] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-25T21:48:47.146211] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-25T21:48:47.147588] [DEBUG] [LOCAL ] UCB: Trimmed 54709 records to 38325 (keeping 200 days of data) [2025-09-25T21:48:47.422445] [DEBUG] [LOCAL ] UCB: Primary data saved (38325 records). [2025-09-25T21:48:47.422677] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-25T21:48:47.422809] [INFO ] [MAIN ] Update Progress: 2171/2372 symbols completed. UCB took 28.7s. Estimated remaining: 26m 44s. Rate: 7.5 symbols/min [2025-09-25T21:48:47.598883] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:47.619130] [DEBUG] [LOCAL ] UFI: Loaded 8118 existing records from primary storage. [2025-09-25T21:48:47.619296] [INFO ] [MAIN ] UFI: Loaded 8118 existing records. [2025-09-25T21:48:47.799238] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:47.799705] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-25T21:48:47.799763] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-25T21:48:47.800047] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-25T21:48:47.800109] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-25T21:48:47.896297] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-25T21:48:48.188573] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:48.262618] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T21:48:48.375621] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-25T21:48:48.681999] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T21:48:48.694758] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-25T21:48:48.696765] [INFO ] [REMOTE ] UBER: Full fetch complete (77978 records). [2025-09-25T21:48:48.696998] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-25T21:48:49.117787] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-25T21:48:49.117887] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-25T21:48:49.119254] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-25T21:48:49.119324] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-25T21:48:49.121124] [DEBUG] [LOCAL ] UBER: Trimmed 77978 records to 54196 (keeping 200 days of data) [2025-09-25T21:48:49.484224] [DEBUG] [LOCAL ] UBER: Primary data saved (54196 records). [2025-09-25T21:48:49.484510] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-25T21:48:49.484684] [INFO ] [MAIN ] Update Progress: 2172/2372 symbols completed. UBER took 40.3s. Estimated remaining: 26m 35s. Rate: 7.5 symbols/min [2025-09-25T21:48:49.497387] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-25T21:48:49.705217] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:48:49.763780] [DEBUG] [LOCAL ] UGI: Loaded 50533 existing records from primary storage. [2025-09-25T21:48:49.763955] [INFO ] [MAIN ] UGI: Loaded 50533 existing records. [2025-09-25T21:48:49.958193] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:48:49.958834] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-25T21:48:49.958888] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-25T21:48:49.959275] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-25T21:48:49.959338] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-25T21:48:50.238002] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-25T21:48:50.245249] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T21:48:50.290450] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-25T21:48:50.417544] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:48:51.088968] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-25T21:48:51.093680] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-25T21:48:51.888756] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-25T21:48:52.646896] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T21:48:52.688673] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-25T21:48:53.488831] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-25T21:48:53.852532] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T21:48:53.914457] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-25T21:48:54.288754] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-25T21:48:54.333105] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:48:55.088836] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-25T21:48:55.859260] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-25T21:48:55.888779] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-25T21:48:55.980924] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T21:48:56.688733] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-25T21:48:57.386038] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-25T21:48:57.488681] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-25T21:48:58.288756] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-25T21:48:58.328312] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-25T21:48:58.368067] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:48:59.088840] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-25T21:48:59.557272] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T21:48:59.888730] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-25T21:48:59.973536] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T21:49:00.688821] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-25T21:49:01.490002] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-25T21:49:01.511838] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-25T21:49:01.522717] [INFO ] [REMOTE ] UDR: Full fetch complete (74446 records). [2025-09-25T21:49:01.522944] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-25T21:49:01.584022] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T21:49:02.017760] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-25T21:49:02.017885] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-25T21:49:02.019310] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-25T21:49:02.019431] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-25T21:49:02.022131] [DEBUG] [LOCAL ] UDR: Trimmed 74446 records to 52177 (keeping 200 days of data) [2025-09-25T21:49:02.298732] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-25T21:49:02.424796] [DEBUG] [LOCAL ] UDR: Primary data saved (52177 records). [2025-09-25T21:49:02.424969] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-25T21:49:02.425192] [INFO ] [MAIN ] Update Progress: 2173/2372 symbols completed. UDR took 33.5s. Estimated remaining: 26m 28s. Rate: 7.5 symbols/min [2025-09-25T21:49:02.628441] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:02.684452] [DEBUG] [LOCAL ] UGP: Loaded 42635 existing records from primary storage. [2025-09-25T21:49:02.684615] [INFO ] [MAIN ] UGP: Loaded 42635 existing records. [2025-09-25T21:49:02.889626] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:02.890084] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-25T21:49:02.890154] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-25T21:49:02.890631] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-25T21:49:02.892575] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-25T21:49:03.090956] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-25T21:49:03.296170] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-25T21:49:03.364003] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:03.545906] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-25T21:49:03.888753] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-25T21:49:03.987970] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T21:49:04.688782] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-25T21:49:05.488747] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-25T21:49:05.646546] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-25T21:49:06.004959] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T21:49:06.288735] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-25T21:49:07.088741] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-25T21:49:07.415704] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-25T21:49:07.888703] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-25T21:49:07.928284] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:49:08.688722] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-25T21:49:08.829225] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T21:49:09.488741] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-25T21:49:09.641900] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-25T21:49:10.075080] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T21:49:10.086124] [INFO ] [REMOTE ] UE: Full fetch complete (61510 records). [2025-09-25T21:49:10.086277] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-25T21:49:10.288759] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-25T21:49:10.553945] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-25T21:49:10.554047] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-25T21:49:10.555107] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-25T21:49:10.555179] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-25T21:49:10.556501] [DEBUG] [LOCAL ] UE: Trimmed 61510 records to 43255 (keeping 200 days of data) [2025-09-25T21:49:10.850306] [DEBUG] [LOCAL ] UE: Primary data saved (43255 records). [2025-09-25T21:49:10.850523] [INFO ] [MAIN ] UE: Full history saved. [2025-09-25T21:49:10.851762] [INFO ] [MAIN ] Update Progress: 2174/2372 symbols completed. UE took 25.1s. Estimated remaining: 26m 20s. Rate: 7.5 symbols/min [2025-09-25T21:49:11.070890] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T21:49:11.070242] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:11.084335] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T21:49:11.092021] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-25T21:49:11.113024] [DEBUG] [LOCAL ] UHAL: Loaded 16535 existing records from primary storage. [2025-09-25T21:49:11.113174] [INFO ] [MAIN ] UHAL: Loaded 16535 existing records. [2025-09-25T21:49:11.301945] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:11.302446] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-25T21:49:11.303043] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-25T21:49:11.303391] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-25T21:49:11.303460] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-25T21:49:11.723848] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:11.839938] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T21:49:11.888703] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-25T21:49:12.688737] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-25T21:49:13.488783] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-25T21:49:14.288730] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-25T21:49:14.386975] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-25T21:49:14.788219] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-25T21:49:15.088774] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-25T21:49:15.888726] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-25T21:49:15.964147] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-25T21:49:15.966136] [INFO ] [REMOTE ] UFI: Full fetch complete (12335 records). [2025-09-25T21:49:15.966214] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-25T21:49:16.447096] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-25T21:49:16.447181] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-25T21:49:16.447490] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-25T21:49:16.447530] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-25T21:49:16.448068] [DEBUG] [LOCAL ] UFI: Trimmed 12335 records to 8169 (keeping 200 days of data) [2025-09-25T21:49:16.503719] [DEBUG] [LOCAL ] UFI: Primary data saved (8169 records). [2025-09-25T21:49:16.503870] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-25T21:49:16.504009] [INFO ] [MAIN ] Update Progress: 2175/2372 symbols completed. UFI took 29.1s. Estimated remaining: 26m 12s. Rate: 7.5 symbols/min [2025-09-25T21:49:16.704638] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:16.762482] [DEBUG] [LOCAL ] UHS: Loaded 41126 existing records from primary storage. [2025-09-25T21:49:16.762684] [INFO ] [MAIN ] UHS: Loaded 41126 existing records. [2025-09-25T21:49:16.983138] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (3.49 seconds). [2025-09-25T21:49:17.011145] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-25T21:49:17.003022] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-25T21:49:17.005032] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T21:49:17.087861] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:17.088986] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-25T21:49:17.089037] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-25T21:49:17.089327] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-25T21:49:17.089388] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-25T21:49:17.462623] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:17.488727] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-25T21:49:18.288691] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-25T21:49:18.795578] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-25T21:49:19.088708] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-25T21:49:19.172717] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T21:49:19.542463] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-25T21:49:19.888715] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-25T21:49:20.083631] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T21:49:20.688733] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-25T21:49:21.361189] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T21:49:21.488708] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-25T21:49:22.293855] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-25T21:49:22.310902] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T21:49:23.072790] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-25T21:49:23.088677] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-25T21:49:23.319367] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T21:49:23.888723] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-25T21:49:24.688765] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-25T21:49:24.830987] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T21:49:25.488701] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-25T21:49:25.768966] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T21:49:25.793987] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-25T21:49:26.288727] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-25T21:49:27.088740] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-25T21:49:27.888769] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-25T21:49:28.289727] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-25T21:49:28.543709] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-25T21:49:28.688761] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-25T21:49:28.751529] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T21:49:29.488691] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-25T21:49:29.615381] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T21:49:29.654863] [INFO ] [REMOTE ] UGI: Full fetch complete (73399 records). [2025-09-25T21:49:29.655112] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-25T21:49:29.659801] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-25T21:49:30.073517] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-25T21:49:30.073620] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-25T21:49:30.074827] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-25T21:49:30.074932] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-25T21:49:30.076945] [DEBUG] [LOCAL ] UGI: Trimmed 73399 records to 50914 (keeping 200 days of data) [2025-09-25T21:49:30.310729] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-25T21:49:30.437546] [DEBUG] [LOCAL ] UGI: Primary data saved (50914 records). [2025-09-25T21:49:30.438026] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-25T21:49:30.438227] [INFO ] [MAIN ] Update Progress: 2176/2372 symbols completed. UGI took 41.0s. Estimated remaining: 26m 4s. Rate: 7.5 symbols/min [2025-09-25T21:49:30.613389] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:30.635316] [DEBUG] [LOCAL ] UHT: Loaded 9977 existing records from primary storage. [2025-09-25T21:49:30.635445] [INFO ] [MAIN ] UHT: Loaded 9977 existing records. [2025-09-25T21:49:30.825883] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:30.826314] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-25T21:49:30.826362] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-25T21:49:30.826979] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-25T21:49:30.827060] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-25T21:49:31.096730] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-25T21:49:31.226808] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:31.258558] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T21:49:31.498776] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T21:49:31.888739] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-25T21:49:32.688731] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-25T21:49:32.874688] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-25T21:49:32.988985] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T21:49:33.488725] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-25T21:49:34.294927] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-25T21:49:34.315416] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-25T21:49:34.658449] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-25T21:49:34.663009] [INFO ] [REMOTE ] UHAL: Full fetch complete (23231 records). [2025-09-25T21:49:34.663104] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-25T21:49:35.093759] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-25T21:49:35.108403] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-25T21:49:35.108522] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-25T21:49:35.109811] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-25T21:49:35.109902] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-25T21:49:35.111052] [DEBUG] [LOCAL ] UHAL: Trimmed 23231 records to 16671 (keeping 200 days of data) [2025-09-25T21:49:35.241976] [DEBUG] [LOCAL ] UHAL: Primary data saved (16671 records). [2025-09-25T21:49:35.242209] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-25T21:49:35.242453] [INFO ] [MAIN ] Update Progress: 2177/2372 symbols completed. UHAL took 24.4s. Estimated remaining: 25m 56s. Rate: 7.5 symbols/min [2025-09-25T21:49:35.287913] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T21:49:35.434603] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:35.457864] [DEBUG] [LOCAL ] UI: Loaded 12758 existing records from primary storage. [2025-09-25T21:49:35.458015] [INFO ] [MAIN ] UI: Loaded 12758 existing records. [2025-09-25T21:49:35.641818] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:35.642208] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-25T21:49:35.642364] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-25T21:49:35.644830] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-25T21:49:35.644897] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-25T21:49:35.889688] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-25T21:49:36.022529] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:36.688763] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-25T21:49:36.782592] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T21:49:36.801743] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-25T21:49:36.807862] [INFO ] [REMOTE ] UGP: Full fetch complete (62086 records). [2025-09-25T21:49:36.808091] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-25T21:49:37.245809] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-25T21:49:37.245957] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-25T21:49:37.247427] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-25T21:49:37.247492] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-25T21:49:37.249141] [DEBUG] [LOCAL ] UGP: Trimmed 62086 records to 42992 (keeping 200 days of data) [2025-09-25T21:49:37.492794] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-25T21:49:37.537248] [DEBUG] [LOCAL ] UGP: Primary data saved (42992 records). [2025-09-25T21:49:37.537415] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-25T21:49:37.537529] [INFO ] [MAIN ] Update Progress: 2178/2372 symbols completed. UGP took 35.1s. Estimated remaining: 25m 48s. Rate: 7.5 symbols/min [2025-09-25T21:49:37.679946] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-25T21:49:37.737865] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:37.789871] [DEBUG] [LOCAL ] UIS: Loaded 37087 existing records from primary storage. [2025-09-25T21:49:37.790103] [INFO ] [MAIN ] UIS: Loaded 37087 existing records. [2025-09-25T21:49:37.977361] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:37.977964] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-25T21:49:37.978022] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-25T21:49:37.978366] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-25T21:49:37.978430] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-25T21:49:38.295200] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-25T21:49:38.343956] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:39.088731] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-25T21:49:39.129114] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T21:49:39.136159] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:49:39.888705] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-25T21:49:40.066223] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T21:49:40.688777] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-25T21:49:41.488777] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-25T21:49:41.595227] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-25T21:49:41.763233] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T21:49:42.288781] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-25T21:49:42.561057] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T21:49:42.996790] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T21:49:43.088769] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-25T21:49:43.888766] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-25T21:49:44.005290] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T21:49:44.688707] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-25T21:49:44.711874] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-25T21:49:45.488735] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-25T21:49:46.107737] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T21:49:46.288743] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-25T21:49:46.390077] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T21:49:47.088736] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-25T21:49:47.117277] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T21:49:47.854884] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-25T21:49:47.888738] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-25T21:49:48.688794] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-25T21:49:49.384393] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-25T21:49:49.488739] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-25T21:49:49.557448] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-25T21:49:50.288735] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-25T21:49:50.996159] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T21:49:51.004042] [INFO ] [REMOTE ] UHS: Full fetch complete (58309 records). [2025-09-25T21:49:51.004240] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-25T21:49:51.095860] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-25T21:49:51.119537] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T21:49:51.480701] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-25T21:49:51.480810] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-25T21:49:51.481832] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-25T21:49:51.481896] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-25T21:49:51.483142] [DEBUG] [LOCAL ] UHS: Trimmed 58309 records to 41433 (keeping 200 days of data) [2025-09-25T21:49:51.775971] [DEBUG] [LOCAL ] UHS: Primary data saved (41433 records). [2025-09-25T21:49:51.776110] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-25T21:49:51.776314] [INFO ] [MAIN ] Update Progress: 2179/2372 symbols completed. UHS took 35.3s. Estimated remaining: 25m 40s. Rate: 7.5 symbols/min [2025-09-25T21:49:51.893815] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-25T21:49:51.984004] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:52.049031] [DEBUG] [LOCAL ] UL: Loaded 53066 existing records from primary storage. [2025-09-25T21:49:52.049254] [INFO ] [MAIN ] UL: Loaded 53066 existing records. [2025-09-25T21:49:52.239055] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:52.239366] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-25T21:49:52.239439] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-25T21:49:52.240137] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-25T21:49:52.240220] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-25T21:49:52.596811] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-25T21:49:52.602521] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T21:49:52.603670] [INFO ] [REMOTE ] UHT: Full fetch complete (15179 records). [2025-09-25T21:49:52.611869] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-25T21:49:52.692491] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-25T21:49:52.762244] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:53.067454] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-25T21:49:53.067536] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-25T21:49:53.067950] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-25T21:49:53.068017] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-25T21:49:53.068569] [DEBUG] [LOCAL ] UHT: Trimmed 15179 records to 10040 (keeping 200 days of data) [2025-09-25T21:49:53.139182] [DEBUG] [LOCAL ] UHT: Primary data saved (10040 records). [2025-09-25T21:49:53.139346] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-25T21:49:53.139482] [INFO ] [MAIN ] Update Progress: 2180/2372 symbols completed. UHT took 22.7s. Estimated remaining: 25m 32s. Rate: 7.5 symbols/min [2025-09-25T21:49:53.316763] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:49:53.358276] [DEBUG] [LOCAL ] ULS: Loaded 39304 existing records from primary storage. [2025-09-25T21:49:53.358465] [INFO ] [MAIN ] ULS: Loaded 39304 existing records. [2025-09-25T21:49:53.493828] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-25T21:49:53.555225] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:49:53.556353] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-25T21:49:53.556404] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-25T21:49:53.556695] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-25T21:49:53.556759] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-25T21:49:53.929161] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:49:54.288750] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-25T21:49:54.430778] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T21:49:54.904332] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T21:49:55.088732] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-25T21:49:55.450284] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-25T21:49:55.888709] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-25T21:49:56.603035] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T21:49:56.688737] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-25T21:49:57.328076] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T21:49:57.488750] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-25T21:49:57.591899] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T21:49:58.288745] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-25T21:49:58.940677] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-25T21:49:59.088680] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-25T21:49:59.129209] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T21:49:59.888706] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-25T21:50:00.688761] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-25T21:50:00.742718] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T21:50:01.375601] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-25T21:50:01.403993] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T21:50:01.488727] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-25T21:50:02.288718] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-25T21:50:02.355020] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-25T21:50:03.088712] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-25T21:50:03.779916] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T21:50:03.820760] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-25T21:50:03.888720] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-25T21:50:04.688749] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-25T21:50:05.488749] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-25T21:50:05.607620] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T21:50:06.288734] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-25T21:50:06.615560] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T21:50:06.669815] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T21:50:07.088773] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-25T21:50:07.894952] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-25T21:50:07.898137] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-25T21:50:08.688686] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-25T21:50:08.726494] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:50:08.968255] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T21:50:08.971763] [INFO ] [REMOTE ] UI: Full fetch complete (18235 records). [2025-09-25T21:50:08.971843] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-25T21:50:09.419272] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-25T21:50:09.419360] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-25T21:50:09.419798] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-25T21:50:09.419862] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-25T21:50:09.420529] [DEBUG] [LOCAL ] UI: Trimmed 18235 records to 12905 (keeping 200 days of data) [2025-09-25T21:50:09.493941] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-25T21:50:09.520840] [DEBUG] [LOCAL ] UI: Primary data saved (12905 records). [2025-09-25T21:50:09.520993] [INFO ] [MAIN ] UI: Full history saved. [2025-09-25T21:50:09.521083] [INFO ] [MAIN ] Update Progress: 2181/2372 symbols completed. UI took 34.3s. Estimated remaining: 25m 24s. Rate: 7.5 symbols/min [2025-09-25T21:50:09.721666] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:09.801088] [DEBUG] [LOCAL ] UMC: Loaded 52717 existing records from primary storage. [2025-09-25T21:50:09.801241] [INFO ] [MAIN ] UMC: Loaded 52717 existing records. [2025-09-25T21:50:10.012732] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:10.013070] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-25T21:50:10.013218] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-25T21:50:10.013544] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-25T21:50:10.013604] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-25T21:50:10.083860] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-25T21:50:10.126459] [INFO ] [REMOTE ] UIS: Full fetch complete (51958 records). [2025-09-25T21:50:10.126911] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-25T21:50:10.290481] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-25T21:50:10.927103] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:11.023977] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-25T21:50:11.024080] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-25T21:50:11.025089] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-25T21:50:11.025155] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-25T21:50:11.035466] [DEBUG] [LOCAL ] UIS: Trimmed 51958 records to 37319 (keeping 200 days of data) [2025-09-25T21:50:11.033768] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T21:50:11.102724] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-25T21:50:11.304396] [DEBUG] [LOCAL ] UIS: Primary data saved (37319 records). [2025-09-25T21:50:11.304575] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-25T21:50:11.304735] [INFO ] [MAIN ] Update Progress: 2182/2372 symbols completed. UIS took 33.8s. Estimated remaining: 25m 16s. Rate: 7.5 symbols/min [2025-09-25T21:50:11.557218] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:11.612474] [DEBUG] [LOCAL ] UMH: Loaded 33525 existing records from primary storage. [2025-09-25T21:50:11.612694] [INFO ] [MAIN ] UMH: Loaded 33525 existing records. [2025-09-25T21:50:11.814602] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:11.814978] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-25T21:50:11.815027] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-25T21:50:11.815271] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-25T21:50:11.815329] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-25T21:50:11.893973] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-25T21:50:12.145947] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-25T21:50:12.325459] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:12.688706] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-25T21:50:13.119195] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-25T21:50:13.496733] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-25T21:50:13.502311] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-25T21:50:14.288879] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-25T21:50:14.562828] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T21:50:15.088681] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-25T21:50:15.616261] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-25T21:50:15.888691] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-25T21:50:16.153281] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T21:50:16.481258] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-25T21:50:16.688761] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-25T21:50:17.488826] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-25T21:50:17.559748] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T21:50:17.563541] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-25T21:50:18.288755] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-25T21:50:19.088811] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-25T21:50:19.625885] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-25T21:50:19.720211] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T21:50:19.888813] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-25T21:50:19.997315] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T21:50:20.008024] [INFO ] [REMOTE ] ULS: Full fetch complete (54335 records). [2025-09-25T21:50:20.008238] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-25T21:50:20.443680] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-25T21:50:20.443823] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-25T21:50:20.445117] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-25T21:50:20.445256] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-25T21:50:20.450117] [DEBUG] [LOCAL ] ULS: Trimmed 54335 records to 39538 (keeping 200 days of data) [2025-09-25T21:50:20.690013] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-25T21:50:20.738216] [DEBUG] [LOCAL ] ULS: Primary data saved (39538 records). [2025-09-25T21:50:20.738367] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-25T21:50:20.738499] [INFO ] [MAIN ] Update Progress: 2183/2372 symbols completed. ULS took 27.6s. Estimated remaining: 25m 8s. Rate: 7.5 symbols/min [2025-09-25T21:50:20.927267] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:20.948382] [DEBUG] [LOCAL ] UNF: Loaded 11900 existing records from primary storage. [2025-09-25T21:50:20.948564] [INFO ] [MAIN ] UNF: Loaded 11900 existing records. [2025-09-25T21:50:21.152935] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:21.153382] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-25T21:50:21.153437] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-25T21:50:21.156727] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-25T21:50:21.156882] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-25T21:50:21.491337] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-25T21:50:21.491260] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-25T21:50:21.641245] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:22.200923] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T21:50:22.288737] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-25T21:50:23.088747] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-25T21:50:23.495194] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T21:50:23.630465] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-25T21:50:23.707418] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-25T21:50:23.888727] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-25T21:50:24.688753] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-25T21:50:25.488787] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-25T21:50:25.924559] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T21:50:25.963010] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T21:50:26.288735] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-25T21:50:27.088819] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-25T21:50:27.311440] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T21:50:27.428126] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T21:50:27.888753] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-25T21:50:28.688777] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-25T21:50:29.098085] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T21:50:29.121755] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T21:50:29.488802] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-25T21:50:30.144079] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T21:50:30.288722] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-25T21:50:31.088737] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-25T21:50:31.324116] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-25T21:50:31.337629] [INFO ] [REMOTE ] UL: Full fetch complete (76870 records). [2025-09-25T21:50:31.337914] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-25T21:50:31.791659] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-25T21:50:31.791767] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-25T21:50:31.793026] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-25T21:50:31.793106] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-25T21:50:31.796171] [DEBUG] [LOCAL ] UL: Trimmed 76870 records to 53455 (keeping 200 days of data) [2025-09-25T21:50:31.836519] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T21:50:31.894387] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-25T21:50:31.920389] [INFO ] [REMOTE ] UMH: Full fetch complete (46536 records). [2025-09-25T21:50:31.920573] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-25T21:50:32.654239] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-25T21:50:32.654380] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-25T21:50:32.657532] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-25T21:50:32.657619] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-25T21:50:32.660632] [DEBUG] [LOCAL ] UMH: Trimmed 46536 records to 33809 (keeping 200 days of data) [2025-09-25T21:50:32.810832] [DEBUG] [LOCAL ] UL: Primary data saved (53455 records). [2025-09-25T21:50:32.811055] [INFO ] [MAIN ] UL: Full history saved. [2025-09-25T21:50:32.811309] [INFO ] [MAIN ] Update Progress: 2184/2372 symbols completed. UL took 41.0s. Estimated remaining: 25m 0s. Rate: 7.5 symbols/min [2025-09-25T21:50:32.900009] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T21:50:32.928306] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-25T21:50:32.931031] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T21:50:33.207285] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:33.215769] [DEBUG] [LOCAL ] UMH: Primary data saved (33809 records). [2025-09-25T21:50:33.215925] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-25T21:50:33.216061] [INFO ] [MAIN ] Update Progress: 2185/2372 symbols completed. UMH took 21.9s. Estimated remaining: 24m 52s. Rate: 7.5 symbols/min [2025-09-25T21:50:33.302318] [DEBUG] [LOCAL ] UNFI: Loaded 41833 existing records from primary storage. [2025-09-25T21:50:33.302472] [INFO ] [MAIN ] UNFI: Loaded 41833 existing records. [2025-09-25T21:50:33.498167] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-25T21:50:33.611069] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:33.680999] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:33.681333] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-25T21:50:33.681404] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-25T21:50:33.681728] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-25T21:50:33.681808] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-25T21:50:33.792984] [DEBUG] [LOCAL ] UNH: Loaded 53794 existing records from primary storage. [2025-09-25T21:50:33.793144] [INFO ] [MAIN ] UNH: Loaded 53794 existing records. [2025-09-25T21:50:34.239090] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:34.239511] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-25T21:50:34.239587] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-25T21:50:34.239995] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-25T21:50:34.240075] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-25T21:50:34.565723] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T21:50:34.569293] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-25T21:50:34.632514] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:34.827316] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T21:50:34.930326] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:35.088739] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-25T21:50:35.791227] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T21:50:35.888747] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-25T21:50:36.672053] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-25T21:50:36.688683] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-25T21:50:37.488793] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-25T21:50:37.738954] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T21:50:37.820844] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-25T21:50:38.288770] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-25T21:50:38.379415] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T21:50:39.088753] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-25T21:50:39.751414] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T21:50:39.888722] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-25T21:50:40.091895] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-25T21:50:40.688759] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-25T21:50:41.466683] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T21:50:41.488679] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-25T21:50:42.288768] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-25T21:50:43.059900] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T21:50:43.088719] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-25T21:50:43.360173] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-25T21:50:43.383915] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-25T21:50:43.888731] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-25T21:50:44.195514] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T21:50:44.385634] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T21:50:44.688723] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-25T21:50:45.488721] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-25T21:50:45.551979] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T21:50:45.555120] [INFO ] [REMOTE ] UNF: Full fetch complete (17186 records). [2025-09-25T21:50:45.555233] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-25T21:50:46.001288] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-25T21:50:46.001384] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-25T21:50:46.001849] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-25T21:50:46.001913] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-25T21:50:46.002535] [DEBUG] [LOCAL ] UNF: Trimmed 17186 records to 11977 (keeping 200 days of data) [2025-09-25T21:50:46.082952] [DEBUG] [LOCAL ] UNF: Primary data saved (11977 records). [2025-09-25T21:50:46.083110] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-25T21:50:46.083261] [INFO ] [MAIN ] Update Progress: 2186/2372 symbols completed. UNF took 25.3s. Estimated remaining: 24m 44s. Rate: 7.5 symbols/min [2025-09-25T21:50:46.267826] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:46.288697] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-25T21:50:46.338852] [DEBUG] [LOCAL ] UNM: Loaded 48699 existing records from primary storage. [2025-09-25T21:50:46.339019] [INFO ] [MAIN ] UNM: Loaded 48699 existing records. [2025-09-25T21:50:46.537257] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:46.537583] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-25T21:50:46.540420] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-25T21:50:46.541074] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-25T21:50:46.541145] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-25T21:50:46.932829] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:47.088702] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-25T21:50:47.278907] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T21:50:47.888721] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-25T21:50:48.093219] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:50:48.688727] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-25T21:50:49.201618] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-25T21:50:49.488757] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-25T21:50:49.570580] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T21:50:50.288704] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-25T21:50:50.411559] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T21:50:51.088733] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-25T21:50:51.250533] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T21:50:51.891496] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-25T21:50:51.897134] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-25T21:50:52.688758] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-25T21:50:53.127120] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-25T21:50:53.199523] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T21:50:53.488726] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-25T21:50:54.288701] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-25T21:50:54.324998] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:50:55.088723] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-25T21:50:55.459033] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T21:50:55.795580] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-25T21:50:55.806558] [INFO ] [REMOTE ] UMC: Full fetch complete (76592 records). [2025-09-25T21:50:55.806792] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-25T21:50:55.894684] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-25T21:50:56.265129] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-25T21:50:56.265233] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-25T21:50:56.266471] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-25T21:50:56.266544] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-25T21:50:56.268301] [DEBUG] [LOCAL ] UMC: Trimmed 76592 records to 53104 (keeping 200 days of data) [2025-09-25T21:50:56.596370] [DEBUG] [LOCAL ] UMC: Primary data saved (53104 records). [2025-09-25T21:50:56.596557] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-25T21:50:56.598257] [INFO ] [MAIN ] Update Progress: 2187/2372 symbols completed. UMC took 47.1s. Estimated remaining: 24m 36s. Rate: 7.5 symbols/min [2025-09-25T21:50:56.688720] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-25T21:50:56.674857] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T21:50:56.757752] [INFO ] [REMOTE ] UNFI: Full fetch complete (58980 records). [2025-09-25T21:50:56.773726] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-25T21:50:56.878554] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:56.930009] [DEBUG] [LOCAL ] UNMA: Loaded 3596 existing records from primary storage. [2025-09-25T21:50:56.930151] [INFO ] [MAIN ] UNMA: Loaded 3596 existing records. [2025-09-25T21:50:57.269068] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:57.269388] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-25T21:50:57.269450] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-25T21:50:57.269724] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-25T21:50:57.269790] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-25T21:50:57.761047] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-25T21:50:57.761169] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-25T21:50:57.762278] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-25T21:50:57.762358] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-25T21:50:57.788133] [DEBUG] [LOCAL ] UNFI: Trimmed 58980 records to 42191 (keeping 200 days of data) [2025-09-25T21:50:58.042108] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:58.042478] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-25T21:50:58.180820] [DEBUG] [LOCAL ] UNFI: Primary data saved (42191 records). [2025-09-25T21:50:58.180964] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-25T21:50:58.181077] [INFO ] [MAIN ] Update Progress: 2188/2372 symbols completed. UNFI took 25.4s. Estimated remaining: 24m 28s. Rate: 7.5 symbols/min [2025-09-25T21:50:58.373726] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:50:58.430527] [DEBUG] [LOCAL ] UNP: Loaded 53251 existing records from primary storage. [2025-09-25T21:50:58.430713] [INFO ] [MAIN ] UNP: Loaded 53251 existing records. [2025-09-25T21:50:58.563219] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-25T21:50:58.596054] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-25T21:50:58.742703] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:50:58.742971] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-25T21:50:58.743018] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-25T21:50:58.743404] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-25T21:50:58.743501] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-25T21:50:58.857080] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-25T21:50:58.898041] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-25T21:50:59.091603] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-25T21:50:59.197345] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:50:59.888716] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-25T21:51:00.688787] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-25T21:51:01.138973] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T21:51:01.167542] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-25T21:51:01.489609] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-25T21:51:01.540820] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.94 seconds). [2025-09-25T21:51:01.548223] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T21:51:02.288712] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-25T21:51:03.088753] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-25T21:51:03.222120] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T21:51:03.656854] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-25T21:51:03.888732] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-25T21:51:04.490626] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T21:51:04.688733] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-25T21:51:05.118228] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-25T21:51:05.488757] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-25T21:51:06.288721] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-25T21:51:06.402330] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:51:06.874361] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-25T21:51:07.088736] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-25T21:51:07.618410] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T21:51:07.888716] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-25T21:51:08.695200] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-25T21:51:08.718167] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.23 seconds). [2025-09-25T21:51:09.488718] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-25T21:51:09.863564] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-25T21:51:09.883263] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-25T21:51:10.288773] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-25T21:51:10.446227] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T21:51:11.088841] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-25T21:51:11.891640] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-25T21:51:12.214053] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-25T21:51:12.527558] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-25T21:51:12.688811] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-25T21:51:13.488859] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-25T21:51:14.137443] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-09-25T21:51:14.279526] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-25T21:51:14.290948] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-25T21:51:14.646522] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-25T21:51:14.696527] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T21:51:15.088759] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-25T21:51:15.888808] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-25T21:51:16.469827] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T21:51:16.471363] [INFO ] [REMOTE ] UNMA: Full fetch complete (5787 records). [2025-09-25T21:51:16.471496] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-25T21:51:16.694753] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-25T21:51:16.878791] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-25T21:51:16.878894] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-25T21:51:16.879095] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-25T21:51:16.879206] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-25T21:51:16.880011] [DEBUG] [LOCAL ] UNMA: Trimmed 5787 records to 3611 (keeping 200 days of data) [2025-09-25T21:51:16.908956] [DEBUG] [LOCAL ] UNMA: Primary data saved (3611 records). [2025-09-25T21:51:16.909095] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-25T21:51:16.909339] [INFO ] [MAIN ] Update Progress: 2189/2372 symbols completed. UNMA took 20.3s. Estimated remaining: 24m 21s. Rate: 7.5 symbols/min [2025-09-25T21:51:17.023268] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:51:17.116996] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-25T21:51:17.162072] [INFO ] [REMOTE ] UNH: Full fetch complete (77866 records). [2025-09-25T21:51:17.162285] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-25T21:51:17.233582] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:17.446239] [DEBUG] [LOCAL ] UP: Loaded 43090 existing records from primary storage. [2025-09-25T21:51:17.446549] [INFO ] [MAIN ] UP: Loaded 43090 existing records. [2025-09-25T21:51:17.519120] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-25T21:51:17.906097] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:17.906443] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-25T21:51:17.906501] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-25T21:51:17.913761] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-25T21:51:17.913846] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-25T21:51:17.954930] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-25T21:51:17.955014] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-25T21:51:17.956197] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-25T21:51:17.956263] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-25T21:51:17.962852] [DEBUG] [LOCAL ] UNH: Trimmed 77866 records to 54184 (keeping 200 days of data) [2025-09-25T21:51:18.371477] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-25T21:51:18.645325] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:18.757214] [DEBUG] [LOCAL ] UNH: Primary data saved (54184 records). [2025-09-25T21:51:18.757396] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-25T21:51:18.757604] [INFO ] [MAIN ] Update Progress: 2190/2372 symbols completed. UNH took 45.5s. Estimated remaining: 24m 12s. Rate: 7.5 symbols/min [2025-09-25T21:51:18.942460] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:19.023535] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-25T21:51:19.023728] [INFO ] [MAIN ] UPS: Loaded 53710 existing records. [2025-09-25T21:51:19.097427] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-25T21:51:19.230987] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:19.231299] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-25T21:51:19.231357] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-25T21:51:19.231722] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-25T21:51:19.231784] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-25T21:51:19.705117] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:19.768872] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-25T21:51:19.783788] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T21:51:19.799490] [INFO ] [REMOTE ] UNM: Full fetch complete (70152 records). [2025-09-25T21:51:19.799715] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-25T21:51:19.894730] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-25T21:51:20.262236] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-25T21:51:20.262342] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-25T21:51:20.263538] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-25T21:51:20.263612] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-25T21:51:20.265414] [DEBUG] [LOCAL ] UNM: Trimmed 70152 records to 49045 (keeping 200 days of data) [2025-09-25T21:51:20.550826] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:51:20.650168] [DEBUG] [LOCAL ] UNM: Primary data saved (49045 records). [2025-09-25T21:51:20.650370] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-25T21:51:20.650624] [INFO ] [MAIN ] Update Progress: 2191/2372 symbols completed. UNM took 34.6s. Estimated remaining: 24m 4s. Rate: 7.5 symbols/min [2025-09-25T21:51:20.689272] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-25T21:51:20.858775] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:20.909357] [DEBUG] [LOCAL ] URI: Loaded 36267 existing records from primary storage. [2025-09-25T21:51:20.909513] [INFO ] [MAIN ] URI: Loaded 36267 existing records. [2025-09-25T21:51:21.098560] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:21.099131] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-25T21:51:21.099190] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-25T21:51:21.099622] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-25T21:51:21.099733] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-25T21:51:21.468543] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:21.488714] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-25T21:51:22.190406] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-25T21:51:22.232448] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-25T21:51:22.288757] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-25T21:51:23.004834] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T21:51:23.088727] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-25T21:51:23.888743] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-25T21:51:24.461675] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-25T21:51:24.537051] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:51:24.688724] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-25T21:51:25.488735] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-25T21:51:25.628067] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T21:51:26.288747] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-25T21:51:26.323725] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T21:51:26.793777] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T21:51:27.088731] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-25T21:51:27.888795] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-25T21:51:28.450778] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-25T21:51:28.688702] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-25T21:51:28.743131] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T21:51:29.488709] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-25T21:51:29.675070] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T21:51:30.288694] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-25T21:51:30.730812] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-25T21:51:30.806159] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:51:31.088748] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-25T21:51:31.744553] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T21:51:31.855885] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T21:51:31.865979] [INFO ] [REMOTE ] UNP: Full fetch complete (76903 records). [2025-09-25T21:51:31.866130] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-25T21:51:31.894726] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-25T21:51:32.296555] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-25T21:51:32.296702] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-25T21:51:32.297931] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-25T21:51:32.297997] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-25T21:51:32.300951] [DEBUG] [LOCAL ] UNP: Trimmed 76903 records to 53641 (keeping 200 days of data) [2025-09-25T21:51:32.663665] [DEBUG] [LOCAL ] UNP: Primary data saved (53641 records). [2025-09-25T21:51:32.663821] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-25T21:51:32.665479] [INFO ] [MAIN ] Update Progress: 2192/2372 symbols completed. UNP took 34.5s. Estimated remaining: 23m 56s. Rate: 7.5 symbols/min [2025-09-25T21:51:32.698748] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-25T21:51:32.855056] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:32.912254] [DEBUG] [LOCAL ] USA: Loaded 35974 existing records from primary storage. [2025-09-25T21:51:32.912415] [INFO ] [MAIN ] USA: Loaded 35974 existing records. [2025-09-25T21:51:33.103298] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:33.105823] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-25T21:51:33.105891] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-25T21:51:33.106198] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-25T21:51:33.106270] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-25T21:51:33.493719] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-25T21:51:33.551375] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:33.559071] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:51:34.288685] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-25T21:51:34.491151] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T21:51:35.088699] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-25T21:51:35.523478] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-25T21:51:35.835040] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T21:51:35.888679] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-25T21:51:36.589368] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T21:51:36.688698] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-25T21:51:37.488772] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-25T21:51:37.543850] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T21:51:38.108427] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T21:51:38.288784] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-25T21:51:39.088743] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-25T21:51:39.821597] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-25T21:51:39.888718] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-25T21:51:40.041342] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T21:51:40.571583] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T21:51:40.688718] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-25T21:51:40.994439] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T21:51:41.488734] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-25T21:51:41.855059] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T21:51:42.288749] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-25T21:51:43.088725] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-25T21:51:43.795822] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-25T21:51:43.850315] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-25T21:51:43.888739] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-25T21:51:44.262546] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-25T21:51:44.688731] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-25T21:51:44.983265] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T21:51:45.488740] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-25T21:51:45.839601] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T21:51:46.288728] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-25T21:51:47.088747] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-25T21:51:47.399196] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T21:51:47.677503] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-25T21:51:47.780821] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T21:51:47.788144] [INFO ] [REMOTE ] URI: Full fetch complete (53723 records). [2025-09-25T21:51:47.788342] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-25T21:51:47.894236] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-25T21:51:48.214238] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-25T21:51:48.214326] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-25T21:51:48.215323] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-25T21:51:48.215387] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-25T21:51:48.216562] [DEBUG] [LOCAL ] URI: Trimmed 53723 records to 36449 (keeping 200 days of data) [2025-09-25T21:51:48.475296] [DEBUG] [LOCAL ] URI: Primary data saved (36449 records). [2025-09-25T21:51:48.475497] [INFO ] [MAIN ] URI: Full history saved. [2025-09-25T21:51:48.475607] [INFO ] [MAIN ] Update Progress: 2193/2372 symbols completed. URI took 27.8s. Estimated remaining: 23m 49s. Rate: 7.5 symbols/min [2025-09-25T21:51:48.658834] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:48.692767] [DEBUG] [LOCAL ] USAC: Loaded 22802 existing records from primary storage. [2025-09-25T21:51:48.692920] [INFO ] [MAIN ] USAC: Loaded 22802 existing records. [2025-09-25T21:51:48.705282] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-25T21:51:48.914374] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:48.916321] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-25T21:51:48.916399] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-25T21:51:48.916784] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-25T21:51:48.916851] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-25T21:51:49.320041] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:49.385862] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:51:49.488727] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-25T21:51:50.288942] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-25T21:51:50.762888] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-25T21:51:51.088757] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-25T21:51:51.138407] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-25T21:51:51.888699] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-25T21:51:51.995259] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-25T21:51:52.009533] [INFO ] [REMOTE ] UP: Full fetch complete (62152 records). [2025-09-25T21:51:52.009783] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-25T21:51:52.424406] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-25T21:51:52.424499] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-25T21:51:52.425713] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-25T21:51:52.425821] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-25T21:51:52.427841] [DEBUG] [LOCAL ] UP: Trimmed 62152 records to 43475 (keeping 200 days of data) [2025-09-25T21:51:52.713788] [DEBUG] [LOCAL ] UP: Primary data saved (43475 records). [2025-09-25T21:51:52.688844] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-25T21:51:52.713977] [INFO ] [MAIN ] UP: Full history saved. [2025-09-25T21:51:52.715684] [INFO ] [MAIN ] Update Progress: 2194/2372 symbols completed. UP took 35.8s. Estimated remaining: 23m 41s. Rate: 7.5 symbols/min [2025-09-25T21:51:52.910606] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:52.988149] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-25T21:51:52.988319] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-25T21:51:53.216101] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T21:51:53.207577] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:53.223570] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-25T21:51:53.223623] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-25T21:51:53.224347] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-25T21:51:53.224456] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-25T21:51:53.489367] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-25T21:51:53.627203] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.54 seconds). [2025-09-25T21:51:53.648847] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T21:51:53.788944] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:54.288834] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-25T21:51:55.008159] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T21:51:55.025757] [INFO ] [REMOTE ] USA: Full fetch complete (51610 records). [2025-09-25T21:51:55.042543] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-25T21:51:55.045225] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:51:55.093806] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-25T21:51:55.149482] [INFO ] [REMOTE ] UPS: Full fetch complete (77755 records). [2025-09-25T21:51:55.154950] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-25T21:51:55.890036] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-25T21:51:55.882696] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-25T21:51:55.926095] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-25T21:51:55.927403] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-25T21:51:55.927501] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-25T21:51:55.956862] [DEBUG] [LOCAL ] USA: Trimmed 51610 records to 36217 (keeping 200 days of data) [2025-09-25T21:51:56.047952] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-25T21:51:56.048068] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-25T21:51:56.048897] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-25T21:51:56.048982] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-25T21:51:56.063849] [DEBUG] [LOCAL ] UPS: Trimmed 77755 records to 54100 (keeping 200 days of data) [2025-09-25T21:51:56.471761] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T21:51:56.605849] [DEBUG] [LOCAL ] USA: Primary data saved (36217 records). [2025-09-25T21:51:56.606026] [INFO ] [MAIN ] USA: Full history saved. [2025-09-25T21:51:56.606210] [INFO ] [MAIN ] Update Progress: 2195/2372 symbols completed. USA took 23.9s. Estimated remaining: 23m 32s. Rate: 7.5 symbols/min [2025-09-25T21:51:56.670358] [DEBUG] [LOCAL ] UPS: Primary data saved (54100 records). [2025-09-25T21:51:56.670506] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-25T21:51:56.693843] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-25T21:51:56.670739] [INFO ] [MAIN ] Update Progress: 2196/2372 symbols completed. UPS took 37.9s. Estimated remaining: 23m 24s. Rate: 7.5 symbols/min [2025-09-25T21:51:56.994761] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:57.069980] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:51:57.123198] [DEBUG] [LOCAL ] USNA: Loaded 18165 existing records from primary storage. [2025-09-25T21:51:57.123354] [INFO ] [MAIN ] USNA: Loaded 18165 existing records. [2025-09-25T21:51:57.275772] [DEBUG] [LOCAL ] USFD: Loaded 51210 existing records from primary storage. [2025-09-25T21:51:57.275961] [INFO ] [MAIN ] USFD: Loaded 51210 existing records. [2025-09-25T21:51:57.428103] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:57.428410] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-25T21:51:57.428468] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-25T21:51:57.428765] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-25T21:51:57.428826] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-25T21:51:57.691857] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:51:57.692574] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-25T21:51:57.692659] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-25T21:51:57.692933] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-25T21:51:57.692994] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-25T21:51:58.020883] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-25T21:51:58.055437] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-25T21:51:58.148371] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:51:58.291805] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-25T21:51:58.323853] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:58.490017] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:51:59.088789] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-25T21:51:59.804500] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T21:51:59.888713] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-25T21:51:59.949830] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-25T21:52:00.688785] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-25T21:52:00.828877] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:52:01.204608] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T21:52:01.488833] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-25T21:52:02.288747] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-25T21:52:02.363287] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-25T21:52:02.473218] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T21:52:03.088837] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-25T21:52:03.729209] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-25T21:52:03.888732] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-25T21:52:04.144379] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T21:52:04.688740] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-25T21:52:05.030851] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T21:52:05.488924] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-25T21:52:06.288713] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-25T21:52:06.564201] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T21:52:06.643122] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-25T21:52:07.088744] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-25T21:52:07.888713] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-25T21:52:07.954764] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T21:52:08.688725] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-25T21:52:09.101601] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-25T21:52:09.129125] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-25T21:52:09.488740] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-25T21:52:10.288743] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-25T21:52:10.438994] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T21:52:11.088736] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-25T21:52:11.442490] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T21:52:11.480370] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-25T21:52:11.888740] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-25T21:52:12.688715] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-25T21:52:12.979285] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T21:52:13.337352] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T21:52:13.488746] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-25T21:52:13.880581] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-25T21:52:14.288783] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-25T21:52:14.700333] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-25T21:52:15.088760] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-25T21:52:15.883320] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T21:52:15.893560] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-25T21:52:15.907555] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-25T21:52:16.688730] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-25T21:52:17.488693] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-25T21:52:17.733206] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T21:52:17.971865] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-25T21:52:18.288695] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-25T21:52:18.531989] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-25T21:52:19.088726] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-25T21:52:19.888717] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-25T21:52:20.025287] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-25T21:52:20.270118] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T21:52:20.688791] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-25T21:52:21.488764] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-25T21:52:21.733376] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T21:52:21.842058] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T21:52:21.848748] [INFO ] [REMOTE ] USAC: Full fetch complete (35763 records). [2025-09-25T21:52:21.848863] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-25T21:52:22.296313] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-25T21:52:22.300103] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-25T21:52:22.300173] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-25T21:52:22.301017] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-25T21:52:22.301097] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-25T21:52:22.302993] [DEBUG] [LOCAL ] USAC: Trimmed 35763 records to 22931 (keeping 200 days of data) [2025-09-25T21:52:22.428216] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-25T21:52:22.436773] [INFO ] [REMOTE ] USNA: Full fetch complete (26534 records). [2025-09-25T21:52:22.437697] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-25T21:52:22.624258] [DEBUG] [LOCAL ] USAC: Primary data saved (22931 records). [2025-09-25T21:52:22.624411] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-25T21:52:22.624580] [INFO ] [MAIN ] Update Progress: 2197/2372 symbols completed. USAC took 34.1s. Estimated remaining: 23m 17s. Rate: 7.5 symbols/min [2025-09-25T21:52:23.081592] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-25T21:52:23.089002] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-25T21:52:23.120628] [INFO ] [REMOTE ] USB: Full fetch complete (77710 records). [2025-09-25T21:52:23.120912] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-25T21:52:23.139105] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-25T21:52:23.139218] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-25T21:52:23.140176] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-25T21:52:23.140276] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-25T21:52:23.151410] [DEBUG] [LOCAL ] USNA: Trimmed 26534 records to 18261 (keeping 200 days of data) [2025-09-25T21:52:23.493011] [DEBUG] [LOCAL ] USNA: Primary data saved (18261 records). [2025-09-25T21:52:23.493192] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-25T21:52:23.493330] [INFO ] [MAIN ] Update Progress: 2198/2372 symbols completed. USNA took 26.8s. Estimated remaining: 23m 9s. Rate: 7.5 symbols/min [2025-09-25T21:52:23.698631] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-25T21:52:23.698767] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-25T21:52:23.699989] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-25T21:52:23.700058] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-25T21:52:23.701683] [DEBUG] [LOCAL ] USB: Trimmed 77710 records to 54078 (keeping 200 days of data) [2025-09-25T21:52:24.044674] [DEBUG] [LOCAL ] USB: Primary data saved (54078 records). [2025-09-25T21:52:24.044833] [INFO ] [MAIN ] USB: Full history saved. [2025-09-25T21:52:24.046014] [INFO ] [MAIN ] Update Progress: 2199/2372 symbols completed. USB took 31.3s. Estimated remaining: 22m 60s. Rate: 7.5 symbols/min [2025-09-25T21:52:24.841084] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T21:52:24.851912] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-25T21:52:26.614989] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T21:52:26.633945] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-25T21:52:28.497587] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T21:52:28.513087] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-25T21:52:30.181534] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T21:52:30.192078] [INFO ] [REMOTE ] USFD: Full fetch complete (73887 records). [2025-09-25T21:52:30.192263] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-25T21:52:30.592604] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-25T21:52:30.592747] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-25T21:52:30.594798] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-25T21:52:30.594873] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-25T21:52:30.598256] [DEBUG] [LOCAL ] USFD: Trimmed 73887 records to 51583 (keeping 200 days of data) [2025-09-25T21:52:30.955557] [DEBUG] [LOCAL ] USFD: Primary data saved (51583 records). [2025-09-25T21:52:30.955808] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-25T21:52:30.956004] [INFO ] [MAIN ] Update Progress: 2200/2372 symbols completed. USFD took 34.3s. Estimated remaining: 22m 52s. Rate: 7.5 symbols/min [2025-09-25T21:52:31.625247] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:31.733712] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:31.741799] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:31.815671] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:31.819744] [DEBUG] [LOCAL ] USPH: Loaded 16566 existing records from primary storage. [2025-09-25T21:52:31.820022] [INFO ] [MAIN ] USPH: Loaded 16566 existing records. [2025-09-25T21:52:31.882452] [DEBUG] [LOCAL ] UTL: Loaded 11080 existing records from primary storage. [2025-09-25T21:52:31.882622] [INFO ] [MAIN ] UTL: Loaded 11080 existing records. [2025-09-25T21:52:32.025269] [DEBUG] [LOCAL ] UTF: Loaded 28610 existing records from primary storage. [2025-09-25T21:52:32.025475] [INFO ] [MAIN ] UTF: Loaded 28610 existing records. [2025-09-25T21:52:32.157067] [DEBUG] [LOCAL ] UTI: Loaded 40510 existing records from primary storage. [2025-09-25T21:52:32.157447] [INFO ] [MAIN ] UTI: Loaded 40510 existing records. [2025-09-25T21:52:32.468912] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:32.469330] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-25T21:52:32.469447] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-25T21:52:32.475002] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-25T21:52:32.475107] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-25T21:52:32.882952] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:32.883287] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-25T21:52:32.883336] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-25T21:52:32.883760] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-25T21:52:32.883844] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-25T21:52:32.912904] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:32.913210] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-25T21:52:32.913260] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-25T21:52:32.913638] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-25T21:52:32.930215] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-25T21:52:32.930127] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:32.935498] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-25T21:52:32.935544] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-25T21:52:32.935872] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-25T21:52:32.935933] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-25T21:52:34.479834] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:34.480675] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-25T21:52:34.484124] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:34.484411] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-25T21:52:34.487289] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:34.487615] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-25T21:52:34.513445] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:34.514057] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-25T21:52:35.412433] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T21:52:35.415314] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-25T21:52:35.525796] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-25T21:52:35.529687] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-25T21:52:35.629551] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-25T21:52:35.635513] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-25T21:52:35.922886] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:52:35.930918] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-25T21:52:36.122109] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-25T21:52:36.125514] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-25T21:52:36.223264] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T21:52:36.227551] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-25T21:52:36.852678] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T21:52:36.855824] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-25T21:52:36.931990] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T21:52:36.941759] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-25T21:52:37.070725] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T21:52:37.087603] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-25T21:52:37.090516] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-25T21:52:37.087270] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-25T21:52:37.869869] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T21:52:37.876237] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-25T21:52:37.885434] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T21:52:37.957588] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T21:52:38.220668] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T21:52:38.288750] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-25T21:52:38.962055] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T21:52:39.088765] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-25T21:52:39.679832] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T21:52:39.888792] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-25T21:52:40.055330] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T21:52:40.520350] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:52:40.688779] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-25T21:52:41.488747] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-25T21:52:42.133861] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-25T21:52:42.288768] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-25T21:52:42.631028] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T21:52:43.088733] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-25T21:52:43.200515] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-25T21:52:43.888742] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-25T21:52:44.225097] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-25T21:52:44.688780] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-25T21:52:44.806955] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T21:52:45.444665] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-25T21:52:45.488767] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-25T21:52:46.288704] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-25T21:52:46.364268] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T21:52:47.088750] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-25T21:52:47.314027] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T21:52:47.322471] [INFO ] [REMOTE ] USPH: Full fetch complete (22571 records). [2025-09-25T21:52:47.322778] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-25T21:52:47.880398] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-25T21:52:47.880506] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-25T21:52:47.881038] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-25T21:52:47.881132] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-25T21:52:47.882027] [DEBUG] [LOCAL ] USPH: Trimmed 22571 records to 16720 (keeping 200 days of data) [2025-09-25T21:52:47.888738] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-25T21:52:48.024554] [DEBUG] [LOCAL ] USPH: Primary data saved (16720 records). [2025-09-25T21:52:48.024766] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-25T21:52:48.024993] [INFO ] [MAIN ] Update Progress: 2201/2372 symbols completed. USPH took 17.1s. Estimated remaining: 22m 45s. Rate: 7.5 symbols/min [2025-09-25T21:52:48.220184] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:48.311010] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-25T21:52:48.312481] [DEBUG] [LOCAL ] UTZ: Loaded 44677 existing records from primary storage. [2025-09-25T21:52:48.318602] [INFO ] [MAIN ] UTZ: Loaded 44677 existing records. [2025-09-25T21:52:48.507797] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:48.508128] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-25T21:52:48.508200] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-25T21:52:48.510362] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-25T21:52:48.510452] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-25T21:52:48.706741] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-25T21:52:48.872865] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T21:52:48.940714] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:49.488734] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-25T21:52:50.027350] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T21:52:50.288725] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-25T21:52:50.796066] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-25T21:52:51.088742] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-25T21:52:51.217283] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-25T21:52:51.888719] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-25T21:52:52.490852] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T21:52:52.688748] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-25T21:52:52.904014] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T21:52:53.488732] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-25T21:52:54.245988] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T21:52:54.288791] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-25T21:52:54.656133] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T21:52:55.088756] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-25T21:52:55.887181] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T21:52:55.892828] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-25T21:52:56.056436] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-25T21:52:56.061940] [INFO ] [REMOTE ] UTL: Full fetch complete (15201 records). [2025-09-25T21:52:56.062088] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-25T21:52:56.466488] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-25T21:52:56.466619] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-25T21:52:56.467050] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-25T21:52:56.470759] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-25T21:52:56.471622] [DEBUG] [LOCAL ] UTL: Trimmed 15201 records to 11165 (keeping 200 days of data) [2025-09-25T21:52:56.550430] [DEBUG] [LOCAL ] UTL: Primary data saved (11165 records). [2025-09-25T21:52:56.550616] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-25T21:52:56.550808] [INFO ] [MAIN ] Update Progress: 2202/2372 symbols completed. UTL took 25.5s. Estimated remaining: 22m 37s. Rate: 7.5 symbols/min [2025-09-25T21:52:56.699819] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-25T21:52:56.738692] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:56.766408] [DEBUG] [LOCAL ] UVE: Loaded 21838 existing records from primary storage. [2025-09-25T21:52:56.766565] [INFO ] [MAIN ] UVE: Loaded 21838 existing records. [2025-09-25T21:52:56.964947] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:56.965460] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-25T21:52:56.965522] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-25T21:52:56.965922] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-25T21:52:56.965983] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-25T21:52:57.201395] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-25T21:52:57.382123] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:57.488799] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-25T21:52:58.202825] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:52:58.210237] [INFO ] [REMOTE ] UTF: Full fetch complete (41433 records). [2025-09-25T21:52:58.210342] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-25T21:52:58.294806] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-25T21:52:58.648522] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-25T21:52:58.648706] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-25T21:52:58.649565] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-25T21:52:58.649629] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-25T21:52:58.651168] [DEBUG] [LOCAL ] UTF: Trimmed 41433 records to 28971 (keeping 200 days of data) [2025-09-25T21:52:58.868312] [DEBUG] [LOCAL ] UTF: Primary data saved (28971 records). [2025-09-25T21:52:58.868461] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-25T21:52:58.868552] [INFO ] [MAIN ] Update Progress: 2203/2372 symbols completed. UTF took 27.9s. Estimated remaining: 22m 28s. Rate: 7.5 symbols/min [2025-09-25T21:52:58.900560] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T21:52:59.103342] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:52:59.099785] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-25T21:52:59.129417] [DEBUG] [LOCAL ] UVV: Loaded 22401 existing records from primary storage. [2025-09-25T21:52:59.129565] [INFO ] [MAIN ] UVV: Loaded 22401 existing records. [2025-09-25T21:52:59.319091] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:52:59.319438] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-25T21:52:59.319487] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-25T21:52:59.319933] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-25T21:52:59.319995] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-25T21:52:59.715174] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:52:59.818842] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:52:59.888711] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-25T21:53:00.148370] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T21:53:00.688703] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-25T21:53:00.946386] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T21:53:01.440760] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-25T21:53:01.488751] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-25T21:53:02.288691] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-25T21:53:02.585779] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-25T21:53:03.088747] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-25T21:53:03.487098] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-25T21:53:03.888757] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-25T21:53:04.606265] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-25T21:53:04.688676] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-25T21:53:04.949469] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-25T21:53:05.488725] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-25T21:53:06.137516] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T21:53:06.288732] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-25T21:53:07.088723] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-25T21:53:07.130293] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T21:53:07.784715] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T21:53:07.793382] [INFO ] [REMOTE ] UTI: Full fetch complete (58058 records). [2025-09-25T21:53:07.793705] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-25T21:53:07.868467] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T21:53:07.895373] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-25T21:53:08.250772] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-25T21:53:08.250881] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-25T21:53:08.252028] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-25T21:53:08.252095] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-25T21:53:08.253462] [DEBUG] [LOCAL ] UTI: Trimmed 58058 records to 40842 (keeping 200 days of data) [2025-09-25T21:53:08.521380] [DEBUG] [LOCAL ] UTI: Primary data saved (40842 records). [2025-09-25T21:53:08.521523] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-25T21:53:08.521672] [INFO ] [MAIN ] Update Progress: 2204/2372 symbols completed. UTI took 37.6s. Estimated remaining: 22m 20s. Rate: 7.5 symbols/min [2025-09-25T21:53:08.695889] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-25T21:53:08.720562] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:08.783461] [DEBUG] [LOCAL ] UWMC: Loaded 52739 existing records from primary storage. [2025-09-25T21:53:08.783680] [INFO ] [MAIN ] UWMC: Loaded 52739 existing records. [2025-09-25T21:53:08.992004] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:08.992566] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-25T21:53:08.992616] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-25T21:53:09.000815] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-25T21:53:09.006719] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-25T21:53:09.007012] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-25T21:53:09.410152] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:09.488727] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-25T21:53:09.960227] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-25T21:53:10.223228] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T21:53:10.288674] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-25T21:53:11.088747] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-25T21:53:11.888866] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-25T21:53:12.688823] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-25T21:53:12.943633] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-25T21:53:13.488843] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-25T21:53:13.592014] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:53:13.626340] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-25T21:53:14.288749] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-25T21:53:14.925567] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-25T21:53:15.088757] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-25T21:53:15.327320] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (5.04 seconds). [2025-09-25T21:53:15.516033] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-25T21:53:15.888815] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-25T21:53:16.595414] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-25T21:53:16.688717] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-25T21:53:17.010735] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T21:53:17.488782] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-25T21:53:17.854928] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-25T21:53:18.288804] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-25T21:53:19.089728] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-25T21:53:19.171347] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T21:53:19.663668] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:53:19.888736] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-25T21:53:20.688711] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-25T21:53:21.026241] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-25T21:53:21.475049] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-25T21:53:21.488754] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-25T21:53:21.985857] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T21:53:22.288762] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-25T21:53:22.743432] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-25T21:53:23.088733] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-25T21:53:23.888755] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-25T21:53:24.110842] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:53:24.141917] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-25T21:53:24.150044] [INFO ] [REMOTE ] UVV: Full fetch complete (29770 records). [2025-09-25T21:53:24.150200] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-25T21:53:24.584435] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-25T21:53:24.584548] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-25T21:53:24.585217] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-25T21:53:24.585322] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-25T21:53:24.587462] [DEBUG] [LOCAL ] UVV: Trimmed 29770 records to 22542 (keeping 200 days of data) [2025-09-25T21:53:24.692716] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-25T21:53:24.754036] [DEBUG] [LOCAL ] UVV: Primary data saved (22542 records). [2025-09-25T21:53:24.754197] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-25T21:53:24.754396] [INFO ] [MAIN ] Update Progress: 2205/2372 symbols completed. UVV took 25.9s. Estimated remaining: 22m 13s. Rate: 7.5 symbols/min [2025-09-25T21:53:24.954252] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:24.967075] [DEBUG] [LOCAL ] UZD: Loaded 6284 existing records from primary storage. [2025-09-25T21:53:24.967196] [INFO ] [MAIN ] UZD: Loaded 6284 existing records. [2025-09-25T21:53:25.229237] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:25.229868] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-25T21:53:25.229916] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-25T21:53:25.230347] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-25T21:53:25.230409] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-25T21:53:25.467135] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T21:53:25.500094] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-25T21:53:25.567673] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-25T21:53:25.572555] [INFO ] [REMOTE ] UTZ: Full fetch complete (63788 records). [2025-09-25T21:53:25.583801] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-25T21:53:25.740228] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:26.127625] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-25T21:53:26.127780] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-25T21:53:26.129043] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-25T21:53:26.129120] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-25T21:53:26.132912] [DEBUG] [LOCAL ] UTZ: Trimmed 63788 records to 45025 (keeping 200 days of data) [2025-09-25T21:53:26.336740] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-25T21:53:26.453933] [DEBUG] [LOCAL ] UTZ: Primary data saved (45025 records). [2025-09-25T21:53:26.454259] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-25T21:53:26.455151] [INFO ] [MAIN ] Update Progress: 2206/2372 symbols completed. UTZ took 38.4s. Estimated remaining: 22m 5s. Rate: 7.5 symbols/min [2025-09-25T21:53:26.662660] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:26.681996] [DEBUG] [LOCAL ] UZE: Loaded 7490 existing records from primary storage. [2025-09-25T21:53:26.682157] [INFO ] [MAIN ] UZE: Loaded 7490 existing records. [2025-09-25T21:53:26.870979] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:26.871251] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-25T21:53:26.871297] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-25T21:53:26.871549] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-25T21:53:26.871608] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-25T21:53:27.093102] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-25T21:53:27.143380] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T21:53:27.170139] [INFO ] [REMOTE ] UVE: Full fetch complete (29648 records). [2025-09-25T21:53:27.184803] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-25T21:53:27.297745] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-25T21:53:27.430458] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:27.735533] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-25T21:53:27.735638] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-25T21:53:27.736350] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-25T21:53:27.736395] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-25T21:53:27.737340] [DEBUG] [LOCAL ] UVE: Trimmed 29648 records to 21997 (keeping 200 days of data) [2025-09-25T21:53:27.873816] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T21:53:27.892275] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-25T21:53:27.903230] [DEBUG] [LOCAL ] UVE: Primary data saved (21997 records). [2025-09-25T21:53:27.903336] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-25T21:53:27.903450] [INFO ] [MAIN ] Update Progress: 2207/2372 symbols completed. UVE took 31.4s. Estimated remaining: 21m 56s. Rate: 7.5 symbols/min [2025-09-25T21:53:28.089514] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:28.103347] [DEBUG] [LOCAL ] UZF: Loaded 6458 existing records from primary storage. [2025-09-25T21:53:28.103509] [INFO ] [MAIN ] UZF: Loaded 6458 existing records. [2025-09-25T21:53:28.292377] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:28.294358] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-25T21:53:28.294409] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-25T21:53:28.294720] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-25T21:53:28.294782] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-25T21:53:28.689160] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-25T21:53:28.707350] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:29.454413] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T21:53:29.488742] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-25T21:53:29.796671] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T21:53:29.958315] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-25T21:53:30.288737] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-25T21:53:31.088737] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-25T21:53:31.850770] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-25T21:53:31.888786] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-25T21:53:32.112178] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T21:53:32.632712] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-25T21:53:32.688710] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-25T21:53:33.250913] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-25T21:53:33.488729] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-25T21:53:34.288744] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-25T21:53:34.890910] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T21:53:35.088693] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-25T21:53:35.502355] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-25T21:53:35.667376] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-25T21:53:35.888741] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-25T21:53:36.688733] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-25T21:53:37.480541] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-25T21:53:37.488674] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-25T21:53:37.700789] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T21:53:37.715097] [INFO ] [REMOTE ] UWMC: Full fetch complete (75476 records). [2025-09-25T21:53:37.715282] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-25T21:53:38.156515] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-25T21:53:38.156635] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-25T21:53:38.158110] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-25T21:53:38.158180] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-25T21:53:38.159823] [DEBUG] [LOCAL ] UWMC: Trimmed 75476 records to 53128 (keeping 200 days of data) [2025-09-25T21:53:38.224598] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-25T21:53:38.288921] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-25T21:53:38.512118] [DEBUG] [LOCAL ] UWMC: Primary data saved (53128 records). [2025-09-25T21:53:38.512292] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-25T21:53:38.513772] [INFO ] [MAIN ] Update Progress: 2208/2372 symbols completed. UWMC took 30.0s. Estimated remaining: 21m 48s. Rate: 7.5 symbols/min [2025-09-25T21:53:38.709803] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:38.788238] [DEBUG] [LOCAL ] V: Loaded 53762 existing records from primary storage. [2025-09-25T21:53:38.788407] [INFO ] [MAIN ] V: Loaded 53762 existing records. [2025-09-25T21:53:38.986254] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:38.986540] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-25T21:53:38.986623] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-25T21:53:38.987137] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-25T21:53:38.987203] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-25T21:53:39.065619] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T21:53:39.091037] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-25T21:53:39.383231] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:39.886396] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-25T21:53:39.888678] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-25T21:53:40.531216] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-25T21:53:40.688732] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-25T21:53:41.399707] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-25T21:53:41.488725] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-25T21:53:42.288733] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-25T21:53:43.021955] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T21:53:43.088738] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-25T21:53:43.711074] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-25T21:53:43.793488] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-25T21:53:43.888731] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-25T21:53:44.481585] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T21:53:44.688740] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-25T21:53:45.358634] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T21:53:45.488748] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-25T21:53:46.288704] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-25T21:53:46.375367] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-25T21:53:47.088858] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-25T21:53:47.888823] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-25T21:53:48.042031] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-25T21:53:48.382389] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T21:53:48.556267] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-25T21:53:48.688726] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-25T21:53:49.488884] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-25T21:53:49.621875] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-25T21:53:50.136842] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-25T21:53:50.139804] [INFO ] [REMOTE ] UZE: Full fetch complete (10130 records). [2025-09-25T21:53:50.139923] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-25T21:53:50.293847] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-25T21:53:50.547438] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-25T21:53:50.547547] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-25T21:53:50.547822] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-25T21:53:50.547927] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-25T21:53:50.549036] [DEBUG] [LOCAL ] UZE: Trimmed 10130 records to 7510 (keeping 200 days of data) [2025-09-25T21:53:50.600056] [DEBUG] [LOCAL ] UZE: Primary data saved (7510 records). [2025-09-25T21:53:50.600208] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-25T21:53:50.600364] [INFO ] [MAIN ] Update Progress: 2209/2372 symbols completed. UZE took 24.1s. Estimated remaining: 21m 41s. Rate: 7.5 symbols/min [2025-09-25T21:53:50.798808] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:50.884900] [DEBUG] [LOCAL ] VAC: Loaded 34540 existing records from primary storage. [2025-09-25T21:53:50.885085] [INFO ] [MAIN ] VAC: Loaded 34540 existing records. [2025-09-25T21:53:51.084695] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:51.085098] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-25T21:53:51.085171] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-25T21:53:51.086009] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-25T21:53:51.086141] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-25T21:53:51.099770] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-25T21:53:51.121067] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-25T21:53:51.123522] [INFO ] [REMOTE ] UZF: Full fetch complete (8833 records). [2025-09-25T21:53:51.123605] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-25T21:53:51.897227] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-25T21:53:51.965087] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-25T21:53:51.965191] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-25T21:53:51.965513] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-25T21:53:51.965592] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-25T21:53:51.969520] [DEBUG] [LOCAL ] UZF: Trimmed 8833 records to 6530 (keeping 200 days of data) [2025-09-25T21:53:51.972473] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:52.021069] [DEBUG] [LOCAL ] UZF: Primary data saved (6530 records). [2025-09-25T21:53:52.021224] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-25T21:53:52.021403] [INFO ] [MAIN ] Update Progress: 2210/2372 symbols completed. UZF took 24.1s. Estimated remaining: 21m 32s. Rate: 7.5 symbols/min [2025-09-25T21:53:52.217596] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:53:52.299359] [DEBUG] [LOCAL ] VAL: Loaded 50416 existing records from primary storage. [2025-09-25T21:53:52.299594] [INFO ] [MAIN ] VAL: Loaded 50416 existing records. [2025-09-25T21:53:52.496376] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:53:52.497414] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-25T21:53:52.497470] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-25T21:53:52.498240] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-25T21:53:52.498301] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-25T21:53:52.690954] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-25T21:53:52.696578] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T21:53:52.925222] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:53:53.207280] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-25T21:53:53.488734] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-25T21:53:53.935031] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T21:53:54.122248] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-25T21:53:54.288733] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-25T21:53:55.088735] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-25T21:53:55.634544] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T21:53:55.888723] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-25T21:53:56.688841] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-25T21:53:57.262574] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T21:53:57.383832] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-25T21:53:57.488732] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-25T21:53:58.112313] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T21:53:58.288748] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-25T21:53:59.034546] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-25T21:53:59.088704] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-25T21:53:59.888846] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-25T21:54:00.630776] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:54:00.676620] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T21:54:00.688712] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-25T21:54:00.769473] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-25T21:54:01.488740] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-25T21:54:02.137791] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T21:54:02.288713] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-25T21:54:02.415860] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-25T21:54:03.088765] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-25T21:54:03.893181] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T21:54:03.902014] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-25T21:54:04.688701] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-25T21:54:04.808979] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T21:54:05.488738] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-25T21:54:06.095586] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-25T21:54:06.223108] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-25T21:54:06.288701] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-25T21:54:07.088735] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-25T21:54:07.283906] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T21:54:07.888756] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-25T21:54:08.057067] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-25T21:54:08.459504] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-25T21:54:08.688766] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-25T21:54:09.318401] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T21:54:09.319922] [INFO ] [REMOTE ] UZD: Full fetch complete (9434 records). [2025-09-25T21:54:09.320015] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-25T21:54:09.512831] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-25T21:54:09.759304] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-25T21:54:09.759402] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-25T21:54:09.759747] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-25T21:54:09.759812] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-25T21:54:09.760488] [DEBUG] [LOCAL ] UZD: Trimmed 9434 records to 6391 (keeping 200 days of data) [2025-09-25T21:54:09.839203] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T21:54:09.860474] [DEBUG] [LOCAL ] UZD: Primary data saved (6391 records). [2025-09-25T21:54:09.860592] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-25T21:54:09.860812] [INFO ] [MAIN ] Update Progress: 2211/2372 symbols completed. UZD took 45.1s. Estimated remaining: 21m 25s. Rate: 7.5 symbols/min [2025-09-25T21:54:10.039957] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:10.126043] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-25T21:54:10.126206] [INFO ] [MAIN ] VALE: Loaded 53694 existing records. [2025-09-25T21:54:10.294684] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-25T21:54:10.322321] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:10.322906] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-25T21:54:10.322978] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-25T21:54:10.323528] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-25T21:54:10.323614] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-25T21:54:10.694150] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:11.088727] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-25T21:54:11.888726] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-25T21:54:12.057177] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-25T21:54:12.202213] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T21:54:12.523474] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-25T21:54:12.688736] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-25T21:54:13.488723] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-25T21:54:13.808871] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-25T21:54:13.975321] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-25T21:54:14.288730] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-25T21:54:15.088692] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-25T21:54:15.229132] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T21:54:15.888750] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-25T21:54:16.131414] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T21:54:16.163465] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-25T21:54:16.169913] [INFO ] [REMOTE ] VAC: Full fetch complete (47892 records). [2025-09-25T21:54:16.170070] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-25T21:54:16.577039] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-25T21:54:16.577124] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-25T21:54:16.578119] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-25T21:54:16.578184] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-25T21:54:16.579279] [DEBUG] [LOCAL ] VAC: Trimmed 47892 records to 34804 (keeping 200 days of data) [2025-09-25T21:54:16.689951] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-25T21:54:16.810503] [DEBUG] [LOCAL ] VAC: Primary data saved (34804 records). [2025-09-25T21:54:16.810677] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-25T21:54:16.810812] [INFO ] [MAIN ] Update Progress: 2212/2372 symbols completed. VAC took 26.2s. Estimated remaining: 21m 17s. Rate: 7.5 symbols/min [2025-09-25T21:54:16.986193] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:16.994388] [DEBUG] [LOCAL ] VATE: Loaded 5627 existing records from primary storage. [2025-09-25T21:54:16.994518] [INFO ] [MAIN ] VATE: Loaded 5627 existing records. [2025-09-25T21:54:17.177264] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:17.177610] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-25T21:54:17.177686] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-25T21:54:17.178016] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-25T21:54:17.178078] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-25T21:54:17.494735] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-25T21:54:17.560103] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:18.140886] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-25T21:54:18.288735] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-25T21:54:18.552263] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-25T21:54:18.640113] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-25T21:54:18.651247] [INFO ] [REMOTE ] V: Full fetch complete (77826 records). [2025-09-25T21:54:18.651441] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-25T21:54:19.114124] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-25T21:54:19.156529] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-25T21:54:19.162829] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-25T21:54:19.164282] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-25T21:54:19.164373] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-25T21:54:19.166203] [DEBUG] [LOCAL ] V: Trimmed 77826 records to 54149 (keeping 200 days of data) [2025-09-25T21:54:19.184222] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T21:54:19.593213] [DEBUG] [LOCAL ] V: Primary data saved (54149 records). [2025-09-25T21:54:19.593370] [INFO ] [MAIN ] V: Full history saved. [2025-09-25T21:54:19.594869] [INFO ] [MAIN ] Update Progress: 2213/2372 symbols completed. V took 41.1s. Estimated remaining: 21m 9s. Rate: 7.5 symbols/min [2025-09-25T21:54:19.780891] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:19.807473] [DEBUG] [LOCAL ] VBF: Loaded 7071 existing records from primary storage. [2025-09-25T21:54:19.807674] [INFO ] [MAIN ] VBF: Loaded 7071 existing records. [2025-09-25T21:54:19.892203] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-25T21:54:20.011796] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:20.012085] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-25T21:54:20.012160] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-25T21:54:20.012418] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-25T21:54:20.012480] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-25T21:54:20.411165] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:20.522835] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-25T21:54:20.688737] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-25T21:54:20.870954] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:54:21.464041] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T21:54:21.488731] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-25T21:54:22.255991] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T21:54:22.288715] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-25T21:54:23.088735] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-25T21:54:23.888726] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-25T21:54:24.393513] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-25T21:54:24.688705] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-25T21:54:24.741780] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:54:24.752869] [INFO ] [REMOTE ] VAL: Full fetch complete (73351 records). [2025-09-25T21:54:24.753023] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-25T21:54:24.774179] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-25T21:54:25.088504] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-25T21:54:25.205201] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-25T21:54:25.205295] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-25T21:54:25.206842] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-25T21:54:25.206909] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-25T21:54:25.208499] [DEBUG] [LOCAL ] VAL: Trimmed 73351 records to 50797 (keeping 200 days of data) [2025-09-25T21:54:25.491604] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-25T21:54:25.533339] [DEBUG] [LOCAL ] VAL: Primary data saved (50797 records). [2025-09-25T21:54:25.533476] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-25T21:54:25.533581] [INFO ] [MAIN ] Update Progress: 2214/2372 symbols completed. VAL took 33.5s. Estimated remaining: 21m 0s. Rate: 7.5 symbols/min [2025-09-25T21:54:25.717763] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:25.739116] [DEBUG] [LOCAL ] VCV: Loaded 13464 existing records from primary storage. [2025-09-25T21:54:25.739249] [INFO ] [MAIN ] VCV: Loaded 13464 existing records. [2025-09-25T21:54:25.928492] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:25.928872] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-25T21:54:25.928922] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-25T21:54:25.929121] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-25T21:54:25.929181] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-25T21:54:26.295775] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-25T21:54:26.333461] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:54:26.340695] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:27.088715] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-25T21:54:27.888742] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-25T21:54:28.141743] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-25T21:54:28.495139] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-25T21:54:28.688693] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-25T21:54:28.736886] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-25T21:54:29.299296] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-25T21:54:29.488733] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-25T21:54:30.288727] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-25T21:54:31.074205] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T21:54:31.088672] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-25T21:54:31.556073] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-25T21:54:31.888736] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-25T21:54:32.021942] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-25T21:54:32.688939] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-25T21:54:33.488703] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-25T21:54:33.625026] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T21:54:33.802680] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-25T21:54:34.288786] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-25T21:54:34.303338] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-25T21:54:35.054845] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-25T21:54:35.088709] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-25T21:54:35.816426] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T21:54:35.888712] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-25T21:54:36.688841] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-25T21:54:37.488743] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-25T21:54:37.580800] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-25T21:54:38.146795] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T21:54:38.202245] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-25T21:54:38.288722] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-25T21:54:38.982443] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-25T21:54:39.088678] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-25T21:54:39.888874] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-25T21:54:40.478921] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-25T21:54:40.688817] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-25T21:54:41.028247] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-25T21:54:41.293185] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T21:54:41.488799] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-25T21:54:42.288753] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-25T21:54:42.549728] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T21:54:43.014407] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-25T21:54:43.088761] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-25T21:54:43.697058] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T21:54:43.888767] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-25T21:54:44.688774] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-25T21:54:45.306840] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-25T21:54:45.488741] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-25T21:54:45.929251] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-25T21:54:45.945419] [INFO ] [REMOTE ] VALE: Full fetch complete (77764 records). [2025-09-25T21:54:45.945691] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-25T21:54:46.206177] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T21:54:46.208345] [INFO ] [REMOTE ] VATE: Full fetch complete (10554 records). [2025-09-25T21:54:46.208478] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-25T21:54:46.294837] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-25T21:54:46.954751] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-25T21:54:46.954916] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-25T21:54:46.956486] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-25T21:54:46.956629] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-25T21:54:46.969454] [DEBUG] [LOCAL ] VALE: Trimmed 77764 records to 54084 (keeping 200 days of data) [2025-09-25T21:54:47.113567] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-25T21:54:47.126964] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-25T21:54:47.127191] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-25T21:54:47.127256] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-25T21:54:47.128248] [DEBUG] [LOCAL ] VATE: Trimmed 10554 records to 5649 (keeping 200 days of data) [2025-09-25T21:54:47.128720] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-25T21:54:47.214072] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T21:54:47.231148] [DEBUG] [LOCAL ] VATE: Primary data saved (5649 records). [2025-09-25T21:54:47.231312] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-25T21:54:47.231517] [INFO ] [MAIN ] Update Progress: 2215/2372 symbols completed. VATE took 30.4s. Estimated remaining: 20m 53s. Rate: 7.5 symbols/min [2025-09-25T21:54:47.471314] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:47.737346] [DEBUG] [LOCAL ] VEEV: Loaded 47121 existing records from primary storage. [2025-09-25T21:54:47.737494] [INFO ] [MAIN ] VEEV: Loaded 47121 existing records. [2025-09-25T21:54:47.797934] [DEBUG] [LOCAL ] VALE: Primary data saved (54084 records). [2025-09-25T21:54:47.798086] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-25T21:54:47.799298] [INFO ] [MAIN ] Update Progress: 2216/2372 symbols completed. VALE took 37.9s. Estimated remaining: 20m 45s. Rate: 7.5 symbols/min [2025-09-25T21:54:47.891780] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-25T21:54:48.164197] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:48.174997] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-25T21:54:48.200742] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-25T21:54:48.232773] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:48.234349] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-25T21:54:48.234527] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-25T21:54:48.272854] [DEBUG] [LOCAL ] VEL: Loaded 13086 existing records from primary storage. [2025-09-25T21:54:48.273007] [INFO ] [MAIN ] VEL: Loaded 13086 existing records. [2025-09-25T21:54:48.433093] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T21:54:48.665784] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T21:54:48.704720] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-25T21:54:48.686900] [INFO ] [REMOTE ] VBF: Full fetch complete (10387 records). [2025-09-25T21:54:48.705921] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-25T21:54:48.788774] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:48.789045] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-25T21:54:48.789093] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-25T21:54:48.789428] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-25T21:54:48.789491] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-25T21:54:49.321895] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:49.503776] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-25T21:54:49.670449] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-25T21:54:49.670596] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-25T21:54:49.670909] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-25T21:54:49.670975] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-25T21:54:49.671827] [DEBUG] [LOCAL ] VBF: Trimmed 10387 records to 7136 (keeping 200 days of data) [2025-09-25T21:54:49.815580] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-25T21:54:49.841897] [DEBUG] [LOCAL ] VBF: Primary data saved (7136 records). [2025-09-25T21:54:49.842067] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-25T21:54:49.842297] [INFO ] [MAIN ] Update Progress: 2217/2372 symbols completed. VBF took 30.2s. Estimated remaining: 20m 37s. Rate: 7.5 symbols/min [2025-09-25T21:54:49.865554] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:50.028809] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:50.105082] [DEBUG] [LOCAL ] VET: Loaded 44066 existing records from primary storage. [2025-09-25T21:54:50.105242] [INFO ] [MAIN ] VET: Loaded 44066 existing records. [2025-09-25T21:54:50.285768] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:50.286045] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-25T21:54:50.286093] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-25T21:54:50.286520] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-25T21:54:50.286582] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-25T21:54:50.291912] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-25T21:54:50.703341] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:51.060493] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-25T21:54:51.088677] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-25T21:54:51.207861] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-25T21:54:51.888771] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-25T21:54:52.120605] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-25T21:54:52.129420] [INFO ] [REMOTE ] VCV: Full fetch complete (19677 records). [2025-09-25T21:54:52.129686] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-25T21:54:52.693895] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-25T21:54:52.745532] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-25T21:54:52.745639] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-25T21:54:52.746343] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-25T21:54:52.746406] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-25T21:54:52.747934] [DEBUG] [LOCAL ] VCV: Trimmed 19677 records to 13629 (keeping 200 days of data) [2025-09-25T21:54:52.861399] [DEBUG] [LOCAL ] VCV: Primary data saved (13629 records). [2025-09-25T21:54:52.861550] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-25T21:54:52.861725] [INFO ] [MAIN ] Update Progress: 2218/2372 symbols completed. VCV took 27.3s. Estimated remaining: 20m 28s. Rate: 7.5 symbols/min [2025-09-25T21:54:53.052621] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:54:53.130085] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-25T21:54:53.130249] [INFO ] [MAIN ] VFC: Loaded 53610 existing records. [2025-09-25T21:54:53.354063] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T21:54:53.384134] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:54:53.385226] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-25T21:54:53.385283] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-25T21:54:53.385596] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-25T21:54:53.385689] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-25T21:54:53.489295] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-25T21:54:53.788121] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:54:54.288687] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-25T21:54:54.397917] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:54:55.054885] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-25T21:54:55.088695] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-25T21:54:55.184052] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-25T21:54:55.888719] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-25T21:54:56.688687] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-25T21:54:56.883679] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-25T21:54:57.004528] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T21:54:57.488728] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-25T21:54:58.288733] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-25T21:54:58.367507] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:54:59.042833] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-25T21:54:59.088712] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-25T21:54:59.353117] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-25T21:54:59.888743] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-25T21:55:00.596011] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T21:55:00.688770] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-25T21:55:01.342732] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T21:55:01.488949] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-25T21:55:02.288713] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-25T21:55:02.560774] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T21:55:02.874205] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T21:55:03.088725] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-25T21:55:03.888746] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-25T21:55:04.214692] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T21:55:04.688735] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-25T21:55:05.123016] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-25T21:55:05.398902] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-25T21:55:05.488693] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-25T21:55:05.605194] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T21:55:06.288759] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-25T21:55:06.430557] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-25T21:55:07.088903] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-25T21:55:07.888826] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-25T21:55:08.530792] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-25T21:55:08.688745] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-25T21:55:08.898042] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:55:09.488815] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-25T21:55:09.536709] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:55:10.288729] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-25T21:55:10.798763] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-25T21:55:11.088746] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-25T21:55:11.287713] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T21:55:11.859063] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-25T21:55:11.861390] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T21:55:11.888677] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-25T21:55:12.688789] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-25T21:55:13.322453] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T21:55:13.488732] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-25T21:55:14.288797] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-25T21:55:14.523019] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-25T21:55:14.637554] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-25T21:55:14.649509] [INFO ] [REMOTE ] VET: Full fetch complete (64416 records). [2025-09-25T21:55:14.649767] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-25T21:55:15.073007] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-25T21:55:15.073119] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-25T21:55:15.074225] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-25T21:55:15.074339] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-25T21:55:15.075851] [DEBUG] [LOCAL ] VET: Trimmed 64416 records to 44385 (keeping 200 days of data) [2025-09-25T21:55:15.088682] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-25T21:55:15.234031] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-25T21:55:15.400269] [DEBUG] [LOCAL ] VET: Primary data saved (44385 records). [2025-09-25T21:55:15.400467] [INFO ] [MAIN ] VET: Full history saved. [2025-09-25T21:55:15.402192] [INFO ] [MAIN ] Update Progress: 2219/2372 symbols completed. VET took 25.6s. Estimated remaining: 20m 21s. Rate: 7.5 symbols/min [2025-09-25T21:55:15.591727] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:15.591898] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-25T21:55:15.591935] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-25T21:55:15.592454] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-25T21:55:15.592513] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-25T21:55:15.592582] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-25T21:55:15.592628] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-25T21:55:15.891004] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-25T21:55:15.990166] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:16.688741] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-25T21:55:16.703507] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T21:55:17.214002] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T21:55:17.488718] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-25T21:55:18.125791] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-25T21:55:18.131992] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T21:55:18.288753] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-25T21:55:18.493467] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:55:18.493878] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-25T21:55:19.088732] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-25T21:55:19.888780] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-25T21:55:20.567633] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-25T21:55:20.688740] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-25T21:55:20.690807] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T21:55:21.488736] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-25T21:55:22.076945] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-25T21:55:22.080875] [INFO ] [REMOTE ] VEL: Full fetch complete (16855 records). [2025-09-25T21:55:22.081001] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-25T21:55:22.296731] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-25T21:55:22.328833] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:55:22.548191] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-25T21:55:22.548320] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-25T21:55:22.548778] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-25T21:55:22.548842] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-25T21:55:22.549531] [DEBUG] [LOCAL ] VEL: Trimmed 16855 records to 13206 (keeping 200 days of data) [2025-09-25T21:55:22.647369] [DEBUG] [LOCAL ] VEL: Primary data saved (13206 records). [2025-09-25T21:55:22.647545] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-25T21:55:22.647859] [INFO ] [MAIN ] Update Progress: 2220/2372 symbols completed. VEL took 34.8s. Estimated remaining: 20m 13s. Rate: 7.5 symbols/min [2025-09-25T21:55:22.855446] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:22.871778] [DEBUG] [LOCAL ] VGI: Loaded 5170 existing records from primary storage. [2025-09-25T21:55:22.871935] [INFO ] [MAIN ] VGI: Loaded 5170 existing records. [2025-09-25T21:55:23.089454] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-25T21:55:23.132356] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:23.132624] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-25T21:55:23.132804] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-25T21:55:23.133147] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-25T21:55:23.133208] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-25T21:55:23.515520] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:23.888713] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-25T21:55:24.215723] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-25T21:55:24.229046] [INFO ] [REMOTE ] VFC: Full fetch complete (77586 records). [2025-09-25T21:55:24.229210] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-25T21:55:24.554101] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T21:55:24.700788] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-25T21:55:24.700872] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-25T21:55:24.702201] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-25T21:55:24.702282] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-25T21:55:24.704018] [DEBUG] [LOCAL ] VFC: Trimmed 77586 records to 54000 (keeping 200 days of data) [2025-09-25T21:55:24.696662] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-25T21:55:25.087043] [DEBUG] [LOCAL ] VFC: Primary data saved (54000 records). [2025-09-25T21:55:25.087266] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-25T21:55:25.087406] [INFO ] [MAIN ] Update Progress: 2221/2372 symbols completed. VFC took 32.2s. Estimated remaining: 20m 5s. Rate: 7.5 symbols/min [2025-09-25T21:55:25.305078] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-25T21:55:25.336762] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:25.356728] [DEBUG] [LOCAL ] VGM: Loaded 18204 existing records from primary storage. [2025-09-25T21:55:25.356882] [INFO ] [MAIN ] VGM: Loaded 18204 existing records. [2025-09-25T21:55:25.493842] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-25T21:55:25.557607] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:25.558904] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-25T21:55:25.558966] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-25T21:55:25.559273] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-25T21:55:25.559349] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-25T21:55:25.944384] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:26.288692] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-25T21:55:26.370462] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T21:55:26.383740] [INFO ] [REMOTE ] VEEV: Full fetch complete (68314 records). [2025-09-25T21:55:26.383917] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-25T21:55:26.819687] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-25T21:55:26.819890] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-25T21:55:26.821209] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-25T21:55:26.821283] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-25T21:55:26.823081] [DEBUG] [LOCAL ] VEEV: Trimmed 68314 records to 47463 (keeping 200 days of data) [2025-09-25T21:55:27.088750] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-25T21:55:27.159978] [DEBUG] [LOCAL ] VEEV: Primary data saved (47463 records). [2025-09-25T21:55:27.160270] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-25T21:55:27.160424] [INFO ] [MAIN ] Update Progress: 2222/2372 symbols completed. VEEV took 39.9s. Estimated remaining: 19m 56s. Rate: 7.5 symbols/min [2025-09-25T21:55:27.358760] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:27.368009] [DEBUG] [LOCAL ] VHI: Loaded 2880 existing records from primary storage. [2025-09-25T21:55:27.368126] [INFO ] [MAIN ] VHI: Loaded 2880 existing records. [2025-09-25T21:55:27.450937] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-25T21:55:27.623439] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:27.625487] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-25T21:55:27.625545] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-25T21:55:27.638992] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-25T21:55:27.639149] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-25T21:55:27.678763] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-25T21:55:27.817509] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-25T21:55:27.888802] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-25T21:55:28.140431] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:28.346013] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-25T21:55:28.688755] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-25T21:55:29.289143] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T21:55:29.488719] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-25T21:55:30.114436] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-25T21:55:30.288746] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-25T21:55:31.088727] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-25T21:55:31.888761] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-25T21:55:32.020707] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-25T21:55:32.249539] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-25T21:55:32.688736] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-25T21:55:32.748359] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-25T21:55:33.417322] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-25T21:55:33.488768] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-25T21:55:34.083924] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T21:55:34.288737] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-25T21:55:34.894896] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T21:55:35.088751] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-25T21:55:35.710296] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-25T21:55:35.888728] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-25T21:55:36.688731] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-25T21:55:37.217115] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-25T21:55:37.488732] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-25T21:55:38.065669] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-25T21:55:38.290022] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-25T21:55:38.292524] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T21:55:38.888331] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-25T21:55:39.088725] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-25T21:55:39.888735] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-25T21:55:40.058924] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-25T21:55:40.424532] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-25T21:55:40.688737] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-25T21:55:41.208115] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-25T21:55:41.488757] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-25T21:55:42.149229] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-25T21:55:42.288732] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-25T21:55:42.871471] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T21:55:43.088725] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-25T21:55:43.888766] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-25T21:55:44.643433] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T21:55:44.647094] [INFO ] [REMOTE ] VGI: Full fetch complete (7781 records). [2025-09-25T21:55:44.647260] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-25T21:55:44.694152] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-25T21:55:44.982994] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-25T21:55:45.290074] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-25T21:55:45.290205] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-25T21:55:45.290603] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-25T21:55:45.290710] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-25T21:55:45.291693] [DEBUG] [LOCAL ] VGI: Trimmed 7781 records to 5203 (keeping 200 days of data) [2025-09-25T21:55:45.338811] [DEBUG] [LOCAL ] VGI: Primary data saved (5203 records). [2025-09-25T21:55:45.338954] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-25T21:55:45.339063] [INFO ] [MAIN ] Update Progress: 2223/2372 symbols completed. VGI took 22.7s. Estimated remaining: 19m 49s. Rate: 7.5 symbols/min [2025-09-25T21:55:45.493980] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-25T21:55:45.579822] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:45.580050] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-25T21:55:45.580186] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-25T21:55:45.580376] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-25T21:55:45.580423] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-25T21:55:45.580469] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-25T21:55:45.580504] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-25T21:55:45.824227] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T21:55:46.031180] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:46.115786] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T21:55:46.288780] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-25T21:55:47.088740] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-25T21:55:47.888829] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-25T21:55:48.091290] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:55:48.091678] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-25T21:55:48.141787] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T21:55:48.332082] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T21:55:48.688732] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-25T21:55:49.488769] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-25T21:55:50.288703] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-25T21:55:50.609987] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T21:55:50.790059] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-25T21:55:50.805980] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-25T21:55:51.088749] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-25T21:55:51.888736] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-25T21:55:52.235087] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-25T21:55:52.688743] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-25T21:55:53.198072] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T21:55:53.199231] [INFO ] [REMOTE ] VHI: Full fetch complete (4598 records). [2025-09-25T21:55:53.199314] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-25T21:55:53.493834] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-25T21:55:53.632735] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-25T21:55:53.632845] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-25T21:55:53.633028] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-25T21:55:53.633091] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-25T21:55:53.633544] [DEBUG] [LOCAL ] VHI: Trimmed 4598 records to 2896 (keeping 200 days of data) [2025-09-25T21:55:53.651707] [DEBUG] [LOCAL ] VHI: Primary data saved (2896 records). [2025-09-25T21:55:53.651775] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-25T21:55:53.651849] [INFO ] [MAIN ] Update Progress: 2224/2372 symbols completed. VHI took 26.5s. Estimated remaining: 19m 41s. Rate: 7.5 symbols/min [2025-09-25T21:55:53.842224] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:53.888576] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-25T21:55:53.922840] [INFO ] [REMOTE ] VG: Full fetch complete (65287 records). [2025-09-25T21:55:53.923032] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-25T21:55:53.945121] [DEBUG] [LOCAL ] VICI: Loaded 53649 existing records from primary storage. [2025-09-25T21:55:53.945301] [INFO ] [MAIN ] VICI: Loaded 53649 existing records. [2025-09-25T21:55:54.289996] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-25T21:55:54.357178] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-25T21:55:54.358537] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:55:54.358598] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:55:54.358661] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-25T21:55:54.358761] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-25T21:55:54.358801] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-25T21:55:54.358856] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-25T21:55:54.358958] [INFO ] [MAIN ] Update Progress: 2225/2372 symbols completed. VG took 39.0s. Estimated remaining: 19m 33s. Rate: 7.5 symbols/min [2025-09-25T21:55:54.411935] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:54.412564] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-25T21:55:54.412618] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-25T21:55:54.437697] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-25T21:55:54.438064] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-25T21:55:54.588507] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:55:54.588897] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-25T21:55:54.660621] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-25T21:55:54.780102] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:54.881926] [DEBUG] [LOCAL ] VIK: Loaded 52500 existing records from primary storage. [2025-09-25T21:55:54.882086] [INFO ] [MAIN ] VIK: Loaded 52500 existing records. [2025-09-25T21:55:55.096776] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-25T21:55:55.235022] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:55.235459] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-25T21:55:55.235508] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-25T21:55:55.243680] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-25T21:55:55.243749] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-25T21:55:55.407065] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:55.701541] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:55.888761] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-25T21:55:56.105357] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:55:56.105745] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-25T21:55:56.157118] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-25T21:55:56.161241] [INFO ] [REMOTE ] VGM: Full fetch complete (26180 records). [2025-09-25T21:55:56.161338] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-25T21:55:56.592328] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-25T21:55:56.592410] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-25T21:55:56.592971] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-25T21:55:56.593040] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-25T21:55:56.593856] [DEBUG] [LOCAL ] VGM: Trimmed 26180 records to 18293 (keeping 200 days of data) [2025-09-25T21:55:56.689060] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-25T21:55:56.712968] [DEBUG] [LOCAL ] VGM: Primary data saved (18293 records). [2025-09-25T21:55:56.713122] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-25T21:55:56.713216] [INFO ] [MAIN ] Update Progress: 2226/2372 symbols completed. VGM took 31.6s. Estimated remaining: 19m 24s. Rate: 7.5 symbols/min [2025-09-25T21:55:56.898727] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:55:56.901848] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:55:56.902094] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-25T21:55:56.958014] [DEBUG] [LOCAL ] VIPS: Loaded 51364 existing records from primary storage. [2025-09-25T21:55:56.958169] [INFO ] [MAIN ] VIPS: Loaded 51364 existing records. [2025-09-25T21:55:57.154510] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:55:57.154859] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-25T21:55:57.154912] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-25T21:55:57.155150] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-25T21:55:57.155210] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-25T21:55:57.492670] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-25T21:55:57.631548] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:55:58.288742] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-25T21:55:59.088737] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-25T21:55:59.634307] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-25T21:55:59.888733] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-25T21:56:00.062952] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T21:56:00.095260] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:56:00.095564] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-25T21:56:00.414667] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T21:56:00.688732] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-25T21:56:01.488759] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-25T21:56:01.720842] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:56:01.721275] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-25T21:56:02.288740] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-25T21:56:02.813556] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T21:56:03.088713] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-25T21:56:03.294519] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:56:03.294893] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-25T21:56:03.888691] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-25T21:56:04.128503] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:56:04.128922] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-25T21:56:04.255364] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-25T21:56:04.688732] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-25T21:56:05.488729] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-25T21:56:06.288732] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-25T21:56:06.521322] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:56:06.521731] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-25T21:56:06.644962] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T21:56:07.088704] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-25T21:56:07.366356] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-25T21:56:07.888746] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-25T21:56:08.688692] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-25T21:56:08.942785] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T21:56:09.309356] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-25T21:56:09.488734] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-25T21:56:10.288693] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-25T21:56:10.327578] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T21:56:11.088702] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-25T21:56:11.417991] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-25T21:56:11.421872] [INFO ] [REMOTE ] VIA: Full fetch complete (2463 records). [2025-09-25T21:56:11.421946] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-25T21:56:11.679240] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-25T21:56:11.698213] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 10 unique days, need 200 days [2025-09-25T21:56:11.698477] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:56:11.698525] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:56:11.698563] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-25T21:56:11.698925] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-25T21:56:11.698992] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-25T21:56:11.699055] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-25T21:56:11.699144] [INFO ] [MAIN ] Update Progress: 2227/2372 symbols completed. VIA took 26.4s. Estimated remaining: 19m 17s. Rate: 7.5 symbols/min [2025-09-25T21:56:11.879414] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:11.888765] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-25T21:56:11.965582] [DEBUG] [LOCAL ] VIRT: Loaded 46870 existing records from primary storage. [2025-09-25T21:56:11.965874] [INFO ] [MAIN ] VIRT: Loaded 46870 existing records. [2025-09-25T21:56:12.159625] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:12.160054] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-25T21:56:12.160256] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-25T21:56:12.160706] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-25T21:56:12.160766] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-25T21:56:12.546909] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:56:12.688724] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-25T21:56:12.998337] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T21:56:13.452307] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T21:56:13.488690] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-25T21:56:14.288724] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-25T21:56:14.449582] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T21:56:15.088880] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-25T21:56:15.311701] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:56:15.776700] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-25T21:56:15.888713] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-25T21:56:16.641540] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T21:56:16.688674] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-25T21:56:17.488776] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-25T21:56:17.749237] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T21:56:18.288692] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-25T21:56:18.327079] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T21:56:18.908437] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T21:56:19.088744] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-25T21:56:19.888895] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-25T21:56:20.048321] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T21:56:20.688768] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-25T21:56:21.357992] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-25T21:56:21.488705] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-25T21:56:21.537418] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-25T21:56:22.163386] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-25T21:56:22.288731] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-25T21:56:23.088783] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-25T21:56:23.668952] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-25T21:56:23.888770] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-25T21:56:24.242445] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-25T21:56:24.635056] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T21:56:24.651806] [INFO ] [REMOTE ] VICI: Full fetch complete (77657 records). [2025-09-25T21:56:24.652016] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-25T21:56:24.691073] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-25T21:56:24.954212] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T21:56:25.167688] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-25T21:56:25.167799] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-25T21:56:25.169058] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-25T21:56:25.169172] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-25T21:56:25.170866] [DEBUG] [LOCAL ] VICI: Trimmed 77657 records to 54039 (keeping 200 days of data) [2025-09-25T21:56:25.507501] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-25T21:56:25.536190] [DEBUG] [LOCAL ] VICI: Primary data saved (54039 records). [2025-09-25T21:56:25.536392] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-25T21:56:25.536632] [INFO ] [MAIN ] Update Progress: 2228/2372 symbols completed. VICI took 31.9s. Estimated remaining: 19m 9s. Rate: 7.5 symbols/min [2025-09-25T21:56:25.812525] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:25.860722] [DEBUG] [LOCAL ] VIST: Loaded 46010 existing records from primary storage. [2025-09-25T21:56:25.860873] [INFO ] [MAIN ] VIST: Loaded 46010 existing records. [2025-09-25T21:56:26.051313] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:26.051632] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-25T21:56:26.051834] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-25T21:56:26.052172] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-25T21:56:26.052231] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-25T21:56:26.308122] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-25T21:56:26.431228] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:56:26.572322] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-25T21:56:27.088696] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-25T21:56:27.431336] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T21:56:27.844498] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T21:56:27.888686] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-25T21:56:28.688709] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-25T21:56:28.865833] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:56:28.878434] [INFO ] [REMOTE ] VIK: Full fetch complete (75866 records). [2025-09-25T21:56:28.878621] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-25T21:56:29.339536] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-25T21:56:29.339671] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-25T21:56:29.340902] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-25T21:56:29.340971] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-25T21:56:29.342595] [DEBUG] [LOCAL ] VIK: Trimmed 75866 records to 52883 (keeping 200 days of data) [2025-09-25T21:56:29.534307] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-25T21:56:29.624619] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T21:56:29.751573] [DEBUG] [LOCAL ] VIK: Primary data saved (52883 records). [2025-09-25T21:56:29.752485] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-25T21:56:29.752858] [INFO ] [MAIN ] Update Progress: 2229/2372 symbols completed. VIK took 35.4s. Estimated remaining: 19m 1s. Rate: 7.5 symbols/min [2025-09-25T21:56:29.943285] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:29.998810] [DEBUG] [LOCAL ] VIV: Loaded 45175 existing records from primary storage. [2025-09-25T21:56:29.998959] [INFO ] [MAIN ] VIV: Loaded 45175 existing records. [2025-09-25T21:56:30.106474] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T21:56:30.244003] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:30.244520] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-25T21:56:30.244584] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-25T21:56:30.245042] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-25T21:56:30.245105] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-25T21:56:30.294745] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-25T21:56:30.647720] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:56:30.875962] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T21:56:31.088739] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-25T21:56:31.888724] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-25T21:56:32.127169] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-25T21:56:32.688715] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-25T21:56:32.802916] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T21:56:33.488746] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-25T21:56:33.540384] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T21:56:33.551123] [INFO ] [REMOTE ] VIPS: Full fetch complete (74626 records). [2025-09-25T21:56:33.551405] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-25T21:56:33.981292] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-25T21:56:33.981456] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-25T21:56:33.984042] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-25T21:56:33.984117] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-25T21:56:33.987447] [DEBUG] [LOCAL ] VIPS: Trimmed 74626 records to 51734 (keeping 200 days of data) [2025-09-25T21:56:34.284875] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T21:56:34.289732] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-25T21:56:34.436441] [DEBUG] [LOCAL ] VIPS: Primary data saved (51734 records). [2025-09-25T21:56:34.437612] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-25T21:56:34.439818] [INFO ] [MAIN ] Update Progress: 2230/2372 symbols completed. VIPS took 37.7s. Estimated remaining: 18m 53s. Rate: 7.5 symbols/min [2025-09-25T21:56:34.652364] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:34.681093] [DEBUG] [LOCAL ] VKQ: Loaded 17393 existing records from primary storage. [2025-09-25T21:56:34.681274] [INFO ] [MAIN ] VKQ: Loaded 17393 existing records. [2025-09-25T21:56:34.879029] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:34.879285] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-25T21:56:34.879333] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-25T21:56:34.879629] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-25T21:56:34.880045] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-25T21:56:35.100747] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-25T21:56:35.208537] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T21:56:35.326069] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:56:35.621849] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T21:56:35.888728] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-25T21:56:36.470084] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T21:56:36.688703] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-25T21:56:36.997738] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-25T21:56:37.488757] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-25T21:56:38.267896] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T21:56:38.288752] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-25T21:56:38.539888] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T21:56:39.088727] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-25T21:56:39.744787] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T21:56:39.764125] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-25T21:56:39.888729] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-25T21:56:40.688733] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-25T21:56:41.488705] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-25T21:56:41.722409] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T21:56:42.288709] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-25T21:56:42.467287] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T21:56:42.516390] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T21:56:43.088735] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-25T21:56:43.742768] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T21:56:43.753052] [INFO ] [REMOTE ] VIRT: Full fetch complete (66942 records). [2025-09-25T21:56:43.753257] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-25T21:56:43.893819] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-25T21:56:44.180667] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-25T21:56:44.180773] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-25T21:56:44.181891] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-25T21:56:44.181956] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-25T21:56:44.183437] [DEBUG] [LOCAL ] VIRT: Trimmed 66942 records to 47172 (keeping 200 days of data) [2025-09-25T21:56:44.516335] [DEBUG] [LOCAL ] VIRT: Primary data saved (47172 records). [2025-09-25T21:56:44.516637] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-25T21:56:44.516795] [INFO ] [MAIN ] Update Progress: 2231/2372 symbols completed. VIRT took 32.8s. Estimated remaining: 18m 45s. Rate: 7.5 symbols/min [2025-09-25T21:56:44.692351] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-25T21:56:44.718415] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:44.768307] [DEBUG] [LOCAL ] VLN: Loaded 28530 existing records from primary storage. [2025-09-25T21:56:44.768470] [INFO ] [MAIN ] VLN: Loaded 28530 existing records. [2025-09-25T21:56:44.943346] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-25T21:56:45.061495] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:45.066483] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-25T21:56:45.066536] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-25T21:56:45.066937] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-25T21:56:45.067062] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-25T21:56:45.283792] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-25T21:56:45.493976] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-25T21:56:45.578486] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:56:45.819055] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T21:56:46.288917] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-25T21:56:47.088726] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-25T21:56:47.182048] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T21:56:47.316336] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-25T21:56:47.888811] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-25T21:56:48.535484] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-25T21:56:48.688732] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-25T21:56:48.984444] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-25T21:56:49.488772] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-25T21:56:50.152138] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T21:56:50.288723] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-25T21:56:51.088744] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-25T21:56:51.215044] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T21:56:51.560415] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-25T21:56:51.888700] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-25T21:56:52.136897] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-25T21:56:52.688856] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-25T21:56:53.488783] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-25T21:56:53.548748] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T21:56:54.289208] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-25T21:56:54.301831] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T21:56:54.344963] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-25T21:56:55.088713] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-25T21:56:55.312175] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-25T21:56:55.888750] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-25T21:56:56.545124] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T21:56:56.688754] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-25T21:56:57.488786] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-25T21:56:57.756261] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-25T21:56:58.288732] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-25T21:56:58.386625] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T21:56:58.503530] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-25T21:56:58.507495] [INFO ] [REMOTE ] VKQ: Full fetch complete (24559 records). [2025-09-25T21:56:58.507630] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-25T21:56:58.964923] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-25T21:56:58.965139] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-25T21:56:58.965716] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-25T21:56:58.965828] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-25T21:56:58.966700] [DEBUG] [LOCAL ] VKQ: Trimmed 24559 records to 17468 (keeping 200 days of data) [2025-09-25T21:56:59.088782] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-25T21:56:59.100914] [DEBUG] [LOCAL ] VKQ: Primary data saved (17468 records). [2025-09-25T21:56:59.101037] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-25T21:56:59.101216] [INFO ] [MAIN ] Update Progress: 2232/2372 symbols completed. VKQ took 24.7s. Estimated remaining: 18m 37s. Rate: 7.5 symbols/min [2025-09-25T21:56:59.285241] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:56:59.368459] [DEBUG] [LOCAL ] VLO: Loaded 53088 existing records from primary storage. [2025-09-25T21:56:59.368624] [INFO ] [MAIN ] VLO: Loaded 53088 existing records. [2025-09-25T21:56:59.558270] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:56:59.558695] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-25T21:56:59.558778] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-25T21:56:59.559155] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-25T21:56:59.559244] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-25T21:56:59.898431] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-25T21:56:59.944282] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T21:56:59.993802] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T21:57:00.064172] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:00.688746] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-25T21:57:01.488704] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-25T21:57:01.599272] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T21:57:02.288753] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-25T21:57:02.370799] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T21:57:02.405690] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T21:57:03.088778] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-25T21:57:03.888715] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-25T21:57:03.946884] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T21:57:04.574016] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-25T21:57:04.688726] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-25T21:57:05.488699] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-25T21:57:05.677610] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-25T21:57:05.690039] [INFO ] [REMOTE ] VIST: Full fetch complete (66897 records). [2025-09-25T21:57:05.690221] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-25T21:57:06.137425] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-25T21:57:06.137567] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-25T21:57:06.138729] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-25T21:57:06.138798] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-25T21:57:06.140246] [DEBUG] [LOCAL ] VIST: Trimmed 66897 records to 46370 (keeping 200 days of data) [2025-09-25T21:57:06.274954] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-25T21:57:06.290072] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-25T21:57:06.306819] [INFO ] [REMOTE ] VIV: Full fetch complete (64653 records). [2025-09-25T21:57:06.307048] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-25T21:57:06.721936] [DEBUG] [LOCAL ] VIST: Primary data saved (46370 records). [2025-09-25T21:57:06.722078] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-25T21:57:06.722214] [INFO ] [MAIN ] Update Progress: 2233/2372 symbols completed. VIST took 41.2s. Estimated remaining: 18m 29s. Rate: 7.5 symbols/min [2025-09-25T21:57:07.097768] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-25T21:57:07.097883] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-25T21:57:07.099150] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-25T21:57:07.099232] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-25T21:57:07.123922] [DEBUG] [LOCAL ] VIV: Trimmed 64653 records to 45434 (keeping 200 days of data) [2025-09-25T21:57:07.129541] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:07.166431] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-25T21:57:07.176508] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-25T21:57:07.328041] [DEBUG] [LOCAL ] VLRS: Loaded 40700 existing records from primary storage. [2025-09-25T21:57:07.328189] [INFO ] [MAIN ] VLRS: Loaded 40700 existing records. [2025-09-25T21:57:07.535237] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:07.535708] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-25T21:57:07.535767] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-25T21:57:07.536092] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-25T21:57:07.536791] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-25T21:57:07.978796] [DEBUG] [LOCAL ] VIV: Primary data saved (45434 records). [2025-09-25T21:57:07.978953] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-25T21:57:07.979081] [INFO ] [MAIN ] Update Progress: 2234/2372 symbols completed. VIV took 38.2s. Estimated remaining: 18m 21s. Rate: 7.5 symbols/min [2025-09-25T21:57:08.322121] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-25T21:57:08.344235] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-25T21:57:08.347121] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:08.375483] [DEBUG] [LOCAL ] VLT: Loaded 4578 existing records from primary storage. [2025-09-25T21:57:08.375624] [INFO ] [MAIN ] VLT: Loaded 4578 existing records. [2025-09-25T21:57:08.472734] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:08.614815] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:08.615913] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-25T21:57:08.615974] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-25T21:57:08.616207] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-25T21:57:08.616266] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-25T21:57:08.689918] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-25T21:57:08.737730] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T21:57:08.771976] [INFO ] [REMOTE ] VLN: Full fetch complete (43262 records). [2025-09-25T21:57:08.772204] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-25T21:57:09.312962] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:09.479319] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-25T21:57:09.479418] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-25T21:57:09.480301] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-25T21:57:09.480365] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-25T21:57:09.481395] [DEBUG] [LOCAL ] VLN: Trimmed 43262 records to 28836 (keeping 200 days of data) [2025-09-25T21:57:09.488695] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-25T21:57:09.666024] [DEBUG] [LOCAL ] VLN: Primary data saved (28836 records). [2025-09-25T21:57:09.666191] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-25T21:57:09.666314] [INFO ] [MAIN ] Update Progress: 2235/2372 symbols completed. VLN took 25.1s. Estimated remaining: 18m 13s. Rate: 7.5 symbols/min [2025-09-25T21:57:09.846862] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:09.905823] [DEBUG] [LOCAL ] VLTO: Loaded 46007 existing records from primary storage. [2025-09-25T21:57:09.906048] [INFO ] [MAIN ] VLTO: Loaded 46007 existing records. [2025-09-25T21:57:10.107662] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:10.108048] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-25T21:57:10.108155] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-25T21:57:10.108569] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-25T21:57:10.108634] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-25T21:57:10.199166] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T21:57:10.321426] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T21:57:10.309741] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-25T21:57:10.469509] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T21:57:10.590176] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:11.088778] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-25T21:57:11.198764] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-25T21:57:11.888730] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-25T21:57:12.377630] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-25T21:57:12.688718] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-25T21:57:12.918857] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-25T21:57:13.488749] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-25T21:57:14.186442] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T21:57:14.288727] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-25T21:57:15.088760] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-25T21:57:15.552050] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-25T21:57:15.888729] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-25T21:57:15.984141] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:57:16.158966] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-25T21:57:16.379293] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T21:57:16.688725] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-25T21:57:17.488787] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-25T21:57:17.493375] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-25T21:57:18.288736] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-25T21:57:19.088725] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-25T21:57:19.169753] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:57:19.518769] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-25T21:57:19.888698] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-25T21:57:20.285064] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-25T21:57:20.688735] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-25T21:57:21.488725] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-25T21:57:21.652479] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-25T21:57:22.082565] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-25T21:57:22.288717] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-25T21:57:22.353374] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T21:57:23.088921] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-25T21:57:23.888764] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-25T21:57:24.077902] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-25T21:57:24.688725] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-25T21:57:24.732461] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T21:57:25.488703] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-25T21:57:25.766741] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T21:57:26.110418] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T21:57:26.288707] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-25T21:57:26.386465] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T21:57:26.893221] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T21:57:27.088786] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-25T21:57:27.888838] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-25T21:57:28.688857] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-25T21:57:28.858481] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T21:57:29.488741] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-25T21:57:29.740742] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T21:57:30.288921] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-25T21:57:30.339962] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:57:30.965230] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T21:57:31.088839] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-25T21:57:31.893830] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-25T21:57:31.922378] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T21:57:32.631262] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-25T21:57:32.633965] [INFO ] [REMOTE ] VLT: Full fetch complete (7508 records). [2025-09-25T21:57:32.634070] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-25T21:57:32.706076] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-25T21:57:32.720081] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T21:57:33.084924] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-25T21:57:33.085034] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-25T21:57:33.085308] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-25T21:57:33.085374] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-25T21:57:33.085892] [DEBUG] [LOCAL ] VLT: Trimmed 7508 records to 4596 (keeping 200 days of data) [2025-09-25T21:57:33.120737] [DEBUG] [LOCAL ] VLT: Primary data saved (4596 records). [2025-09-25T21:57:33.120881] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-25T21:57:33.121062] [INFO ] [MAIN ] Update Progress: 2236/2372 symbols completed. VLT took 25.1s. Estimated remaining: 18m 6s. Rate: 7.5 symbols/min [2025-09-25T21:57:33.305003] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:33.390104] [DEBUG] [LOCAL ] VMC: Loaded 43704 existing records from primary storage. [2025-09-25T21:57:33.390273] [INFO ] [MAIN ] VMC: Loaded 43704 existing records. [2025-09-25T21:57:33.494705] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-25T21:57:33.583635] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:33.583972] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-25T21:57:33.584020] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-25T21:57:33.584336] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-25T21:57:33.584394] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-25T21:57:33.970872] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:34.288702] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-25T21:57:34.565290] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T21:57:35.088732] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-25T21:57:35.212018] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T21:57:35.295259] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T21:57:35.888762] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-25T21:57:36.643148] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T21:57:36.653582] [INFO ] [REMOTE ] VLO: Full fetch complete (76928 records). [2025-09-25T21:57:36.653780] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-25T21:57:36.704710] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-25T21:57:36.737270] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T21:57:37.151982] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-25T21:57:37.152086] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-25T21:57:37.153333] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-25T21:57:37.153432] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-25T21:57:37.155847] [DEBUG] [LOCAL ] VLO: Trimmed 76928 records to 53476 (keeping 200 days of data) [2025-09-25T21:57:37.494200] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-25T21:57:37.548699] [DEBUG] [LOCAL ] VLO: Primary data saved (53476 records). [2025-09-25T21:57:37.548886] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-25T21:57:37.549034] [INFO ] [MAIN ] Update Progress: 2237/2372 symbols completed. VLO took 38.4s. Estimated remaining: 17m 57s. Rate: 7.5 symbols/min [2025-09-25T21:57:38.288789] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-25T21:57:38.463058] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T21:57:39.088771] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-25T21:57:39.135510] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T21:57:39.682591] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-25T21:57:39.693162] [INFO ] [REMOTE ] VLRS: Full fetch complete (58629 records). [2025-09-25T21:57:39.693380] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-25T21:57:39.845669] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T21:57:39.859203] [INFO ] [REMOTE ] VLTO: Full fetch complete (66797 records). [2025-09-25T21:57:39.859394] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-25T21:57:39.889386] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-25T21:57:40.511686] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-25T21:57:40.519901] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-25T21:57:40.521080] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-25T21:57:40.521151] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-25T21:57:40.522476] [DEBUG] [LOCAL ] VLRS: Trimmed 58629 records to 40930 (keeping 200 days of data) [2025-09-25T21:57:40.803658] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-25T21:57:40.803776] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-25T21:57:40.804384] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-25T21:57:40.804428] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-25T21:57:40.849760] [DEBUG] [LOCAL ] VLTO: Trimmed 66797 records to 46368 (keeping 200 days of data) [2025-09-25T21:57:41.075634] [DEBUG] [LOCAL ] VLRS: Primary data saved (40930 records). [2025-09-25T21:57:41.075818] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-25T21:57:41.075946] [INFO ] [MAIN ] Update Progress: 2238/2372 symbols completed. VLRS took 34.4s. Estimated remaining: 17m 49s. Rate: 7.5 symbols/min [2025-09-25T21:57:41.255147] [DEBUG] [LOCAL ] VLTO: Primary data saved (46368 records). [2025-09-25T21:57:41.255326] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-25T21:57:41.255442] [INFO ] [MAIN ] Update Progress: 2239/2372 symbols completed. VLTO took 31.6s. Estimated remaining: 17m 41s. Rate: 7.5 symbols/min [2025-09-25T21:57:41.572296] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T21:57:41.581284] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-25T21:57:43.495257] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-25T21:57:43.507103] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-25T21:57:45.327159] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T21:57:45.338451] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-25T21:57:47.147456] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-25T21:57:47.160873] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-25T21:57:48.870896] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-25T21:57:48.891027] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-25T21:57:50.663345] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T21:57:50.676458] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-25T21:57:52.285960] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T21:57:52.295487] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-25T21:57:52.912926] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-25T21:57:52.922621] [INFO ] [REMOTE ] VMC: Full fetch complete (62616 records). [2025-09-25T21:57:52.922875] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-25T21:57:53.385922] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-25T21:57:53.386042] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-25T21:57:53.387253] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-25T21:57:53.387332] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-25T21:57:53.388943] [DEBUG] [LOCAL ] VMC: Trimmed 62616 records to 43970 (keeping 200 days of data) [2025-09-25T21:57:53.691938] [DEBUG] [LOCAL ] VMC: Primary data saved (43970 records). [2025-09-25T21:57:53.692091] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-25T21:57:53.693542] [INFO ] [MAIN ] Update Progress: 2240/2372 symbols completed. VMC took 20.6s. Estimated remaining: 17m 33s. Rate: 7.5 symbols/min [2025-09-25T21:57:54.478901] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:54.527577] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:54.534804] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:54.537506] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:57:54.553148] [DEBUG] [LOCAL ] VMI: Loaded 15472 existing records from primary storage. [2025-09-25T21:57:54.553313] [INFO ] [MAIN ] VMI: Loaded 15472 existing records. [2025-09-25T21:57:54.595797] [DEBUG] [LOCAL ] VNCE: Loaded 7242 existing records from primary storage. [2025-09-25T21:57:54.595994] [INFO ] [MAIN ] VNCE: Loaded 7242 existing records. [2025-09-25T21:57:54.762221] [DEBUG] [LOCAL ] VMO: Loaded 21024 existing records from primary storage. [2025-09-25T21:57:54.762376] [INFO ] [MAIN ] VMO: Loaded 21024 existing records. [2025-09-25T21:57:54.927365] [DEBUG] [LOCAL ] VNO: Loaded 48973 existing records from primary storage. [2025-09-25T21:57:54.927562] [INFO ] [MAIN ] VNO: Loaded 48973 existing records. [2025-09-25T21:57:55.168098] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:55.174164] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-25T21:57:55.174292] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-25T21:57:55.188777] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-25T21:57:55.189010] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-25T21:57:55.525792] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:55.538612] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-25T21:57:55.538698] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-25T21:57:55.538949] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-25T21:57:55.539009] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-25T21:57:55.565010] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:55.565262] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-25T21:57:55.565309] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-25T21:57:55.565564] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-25T21:57:55.565623] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-25T21:57:55.641880] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:57:55.654081] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-25T21:57:55.654214] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-25T21:57:55.654480] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-25T21:57:55.654541] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-25T21:57:56.909102] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:56.953221] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-25T21:57:57.105207] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:57.105582] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-25T21:57:57.155160] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:57.155589] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-25T21:57:57.170195] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:57:57.170620] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-25T21:57:57.981415] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T21:57:57.985038] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-25T21:57:58.126929] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T21:57:58.132444] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-25T21:57:58.290004] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-25T21:57:58.295857] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-25T21:57:58.916060] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-25T21:57:58.919509] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-25T21:57:58.955820] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T21:57:58.969245] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-25T21:57:59.067751] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-25T21:57:59.072302] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-25T21:57:59.534184] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-25T21:57:59.537581] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-25T21:57:59.585000] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T21:57:59.590909] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-25T21:58:00.224843] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T21:58:00.230699] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-25T21:58:00.276897] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T21:58:00.287528] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-25T21:58:00.462521] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T21:58:00.465816] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-25T21:58:00.614950] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T21:58:00.621171] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-25T21:58:01.226639] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-25T21:58:01.230723] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-25T21:58:01.303314] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T21:58:01.308400] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-25T21:58:01.741730] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T21:58:01.751953] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-25T21:58:01.770118] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-25T21:58:01.780172] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-25T21:58:01.842605] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-25T21:58:02.288758] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-25T21:58:02.467412] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T21:58:02.773703] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-25T21:58:02.946551] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-25T21:58:03.093846] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-25T21:58:03.115145] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T21:58:03.888729] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-25T21:58:04.137944] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T21:58:04.688732] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-25T21:58:04.699274] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-25T21:58:05.488729] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-25T21:58:05.834757] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T21:58:06.136852] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T21:58:06.288760] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-25T21:58:07.088759] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-25T21:58:07.403755] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-25T21:58:07.888710] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-25T21:58:08.173736] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-25T21:58:08.688734] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-25T21:58:09.488719] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-25T21:58:09.735682] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T21:58:09.819623] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T21:58:10.059748] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-25T21:58:10.288734] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-25T21:58:11.088727] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-25T21:58:11.585272] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-25T21:58:11.593309] [INFO ] [REMOTE ] VMO: Full fetch complete (31466 records). [2025-09-25T21:58:11.593467] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-25T21:58:11.894992] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-25T21:58:12.029562] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-25T21:58:12.029700] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-25T21:58:12.030469] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-25T21:58:12.030535] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-25T21:58:12.031578] [DEBUG] [LOCAL ] VMO: Trimmed 31466 records to 21177 (keeping 200 days of data) [2025-09-25T21:58:12.181892] [DEBUG] [LOCAL ] VMO: Primary data saved (21177 records). [2025-09-25T21:58:12.182031] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-25T21:58:12.182143] [INFO ] [MAIN ] Update Progress: 2241/2372 symbols completed. VMO took 18.5s. Estimated remaining: 17m 26s. Rate: 7.5 symbols/min [2025-09-25T21:58:12.381151] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:12.421612] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T21:58:12.441845] [INFO ] [REMOTE ] VNCE: Full fetch complete (15391 records). [2025-09-25T21:58:12.442083] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-25T21:58:12.472376] [DEBUG] [LOCAL ] VNT: Loaded 43902 existing records from primary storage. [2025-09-25T21:58:12.472549] [INFO ] [MAIN ] VNT: Loaded 43902 existing records. [2025-09-25T21:58:12.695838] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-25T21:58:12.937696] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:58:12.955462] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-25T21:58:12.955597] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-25T21:58:12.955943] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-25T21:58:12.956005] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-25T21:58:13.257385] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-25T21:58:13.257527] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-25T21:58:13.257931] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-25T21:58:13.257994] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-25T21:58:13.258607] [DEBUG] [LOCAL ] VNCE: Trimmed 15391 records to 7418 (keeping 200 days of data) [2025-09-25T21:58:13.350520] [DEBUG] [LOCAL ] VNCE: Primary data saved (7418 records). [2025-09-25T21:58:13.350679] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-25T21:58:13.350808] [INFO ] [MAIN ] Update Progress: 2242/2372 symbols completed. VNCE took 19.6s. Estimated remaining: 17m 17s. Rate: 7.5 symbols/min [2025-09-25T21:58:13.758099] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T21:58:13.785126] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-25T21:58:13.803387] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:13.812783] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:13.823232] [DEBUG] [LOCAL ] VOC: Loaded 8934 existing records from primary storage. [2025-09-25T21:58:13.823356] [INFO ] [MAIN ] VOC: Loaded 8934 existing records. [2025-09-25T21:58:13.868113] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-25T21:58:14.026244] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:58:14.026504] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-25T21:58:14.026550] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-25T21:58:14.026895] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-25T21:58:14.026956] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-25T21:58:14.298916] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-25T21:58:14.446576] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:15.088709] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-25T21:58:15.377165] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T21:58:15.523351] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T21:58:15.888721] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-25T21:58:16.651956] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-25T21:58:16.670798] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-25T21:58:16.688690] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-25T21:58:17.488818] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-25T21:58:18.288737] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-25T21:58:18.486512] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-25T21:58:19.088800] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-25T21:58:19.214139] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-25T21:58:19.220820] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-25T21:58:19.888788] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-25T21:58:20.688807] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-25T21:58:20.861449] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-25T21:58:21.046989] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-25T21:58:21.488762] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-25T21:58:22.288734] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-25T21:58:22.330341] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T21:58:23.088733] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-25T21:58:23.126763] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-25T21:58:23.162855] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T21:58:23.888778] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-25T21:58:24.688836] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-25T21:58:24.834253] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T21:58:24.845383] [INFO ] [REMOTE ] VNO: Full fetch complete (70482 records). [2025-09-25T21:58:24.845581] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-25T21:58:25.330854] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-25T21:58:25.330999] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-25T21:58:25.332172] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-25T21:58:25.332345] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-25T21:58:25.335404] [DEBUG] [LOCAL ] VNO: Trimmed 70482 records to 49325 (keeping 200 days of data) [2025-09-25T21:58:25.498742] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-25T21:58:25.729416] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-25T21:58:25.734839] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T21:58:25.765218] [DEBUG] [LOCAL ] VNO: Primary data saved (49325 records). [2025-09-25T21:58:25.765396] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-25T21:58:25.767228] [INFO ] [MAIN ] Update Progress: 2243/2372 symbols completed. VNO took 32.1s. Estimated remaining: 17m 10s. Rate: 7.5 symbols/min [2025-09-25T21:58:25.953995] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:26.014753] [DEBUG] [LOCAL ] VOYA: Loaded 42801 existing records from primary storage. [2025-09-25T21:58:26.014945] [INFO ] [MAIN ] VOYA: Loaded 42801 existing records. [2025-09-25T21:58:26.208038] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:58:26.208727] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-25T21:58:26.209013] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-25T21:58:26.209450] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-25T21:58:26.209520] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-25T21:58:26.293789] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-25T21:58:26.603389] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-25T21:58:26.611952] [INFO ] [REMOTE ] VMI: Full fetch complete (21166 records). [2025-09-25T21:58:26.612136] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-25T21:58:26.666815] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:27.029137] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-25T21:58:27.029228] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-25T21:58:27.029750] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-25T21:58:27.029814] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-25T21:58:27.030743] [DEBUG] [LOCAL ] VMI: Trimmed 21166 records to 15578 (keeping 200 days of data) [2025-09-25T21:58:27.094526] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-25T21:58:27.160553] [DEBUG] [LOCAL ] VMI: Primary data saved (15578 records). [2025-09-25T21:58:27.160757] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-25T21:58:27.160924] [INFO ] [MAIN ] Update Progress: 2244/2372 symbols completed. VMI took 33.5s. Estimated remaining: 17m 1s. Rate: 7.5 symbols/min [2025-09-25T21:58:27.341982] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:27.342191] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-25T21:58:27.342248] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-25T21:58:27.342566] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-25T21:58:27.342620] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-25T21:58:27.342707] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-25T21:58:27.342754] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-25T21:58:27.738530] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:27.888766] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-25T21:58:28.063051] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T21:58:28.110050] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:28.110560] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-25T21:58:28.688764] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-25T21:58:28.750362] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T21:58:29.488927] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-25T21:58:30.268330] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T21:58:30.288677] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-25T21:58:31.080035] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-25T21:58:31.089025] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-25T21:58:31.888767] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-25T21:58:31.933488] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T21:58:32.102424] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:32.102818] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-25T21:58:32.571892] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T21:58:32.688723] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-25T21:58:33.488715] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-25T21:58:33.695718] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:33.696178] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-25T21:58:34.299889] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-25T21:58:34.322151] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-25T21:58:35.088750] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-25T21:58:35.115762] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T21:58:35.888758] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-25T21:58:36.688703] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-25T21:58:36.748788] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T21:58:36.773411] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T21:58:36.911063] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:36.911495] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-25T21:58:37.488755] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-25T21:58:38.288780] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-25T21:58:39.047172] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T21:58:39.056415] [INFO ] [REMOTE ] VNT: Full fetch complete (63523 records). [2025-09-25T21:58:39.056765] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-25T21:58:39.097633] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-25T21:58:39.166545] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T21:58:39.533635] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-25T21:58:39.533810] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-25T21:58:39.535324] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-25T21:58:39.535404] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-25T21:58:39.539415] [DEBUG] [LOCAL ] VNT: Trimmed 63523 records to 44172 (keeping 200 days of data) [2025-09-25T21:58:39.842507] [DEBUG] [LOCAL ] VNT: Primary data saved (44172 records). [2025-09-25T21:58:39.842760] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-25T21:58:39.842968] [INFO ] [MAIN ] Update Progress: 2245/2372 symbols completed. VNT took 27.7s. Estimated remaining: 16m 54s. Rate: 7.5 symbols/min [2025-09-25T21:58:39.895758] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-25T21:58:40.034829] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:40.060434] [DEBUG] [LOCAL ] VPG: Loaded 17215 existing records from primary storage. [2025-09-25T21:58:40.060660] [INFO ] [MAIN ] VPG: Loaded 17215 existing records. [2025-09-25T21:58:40.239499] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:58:40.239945] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-25T21:58:40.240103] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-25T21:58:40.240439] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-25T21:58:40.240520] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-25T21:58:40.617829] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:40.688667] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-25T21:58:40.773595] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T21:58:40.855862] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:58:41.331566] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-25T21:58:41.488748] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-25T21:58:42.256109] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T21:58:42.259013] [INFO ] [REMOTE ] VOC: Full fetch complete (13155 records). [2025-09-25T21:58:42.259119] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-25T21:58:42.289156] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-25T21:58:42.598917] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:42.637757] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-25T21:58:42.774174] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-25T21:58:42.774276] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-25T21:58:42.774672] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-25T21:58:42.774742] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-25T21:58:42.775578] [DEBUG] [LOCAL ] VOC: Trimmed 13155 records to 8970 (keeping 200 days of data) [2025-09-25T21:58:42.848275] [DEBUG] [LOCAL ] VOC: Primary data saved (8970 records). [2025-09-25T21:58:42.848452] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-25T21:58:42.848672] [INFO ] [MAIN ] Update Progress: 2246/2372 symbols completed. VOC took 29.5s. Estimated remaining: 16m 45s. Rate: 7.5 symbols/min [2025-09-25T21:58:43.092813] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-25T21:58:43.127628] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:58:43.143916] [DEBUG] [LOCAL ] VPV: Loaded 5372 existing records from primary storage. [2025-09-25T21:58:43.144099] [INFO ] [MAIN ] VPV: Loaded 5372 existing records. [2025-09-25T21:58:43.401113] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:58:43.401438] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-25T21:58:43.401501] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-25T21:58:43.401915] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-25T21:58:43.401991] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-25T21:58:43.882855] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:58:43.888681] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-25T21:58:43.946889] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-25T21:58:44.688739] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-25T21:58:45.490389] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-25T21:58:45.493421] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-25T21:58:45.523596] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T21:58:45.734370] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T21:58:45.734758] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-25T21:58:46.288735] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-25T21:58:47.088701] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-25T21:58:47.888735] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-25T21:58:47.935344] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-25T21:58:48.036007] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-25T21:58:48.688761] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-25T21:58:49.437094] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T21:58:49.488791] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-25T21:58:50.288725] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-25T21:58:50.575534] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T21:58:51.066622] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-25T21:58:51.088688] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-25T21:58:51.149365] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-25T21:58:51.888741] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-25T21:58:52.312369] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T21:58:52.688726] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-25T21:58:53.471528] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T21:58:53.488693] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-25T21:58:53.585467] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T21:58:54.288754] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-25T21:58:54.326002] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:58:55.088740] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-25T21:58:55.511173] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T21:58:55.733164] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T21:58:55.888733] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-25T21:58:56.645824] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-25T21:58:56.688733] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-25T21:58:57.488729] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-25T21:58:57.761229] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T21:58:58.128783] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T21:58:58.288728] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-25T21:58:58.894354] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-25T21:58:59.088734] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-25T21:58:59.888747] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-25T21:59:00.076268] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T21:59:00.688733] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-25T21:59:01.423568] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-25T21:59:01.435709] [INFO ] [REMOTE ] VOYA: Full fetch complete (62091 records). [2025-09-25T21:59:01.435856] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-25T21:59:01.495850] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-25T21:59:01.878375] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-25T21:59:01.878505] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-25T21:59:01.879722] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-25T21:59:01.879790] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-25T21:59:01.882441] [DEBUG] [LOCAL ] VOYA: Trimmed 62091 records to 43089 (keeping 200 days of data) [2025-09-25T21:59:02.168991] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-25T21:59:02.228593] [DEBUG] [LOCAL ] VOYA: Primary data saved (43089 records). [2025-09-25T21:59:02.228774] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-25T21:59:02.228877] [INFO ] [MAIN ] Update Progress: 2247/2372 symbols completed. VOYA took 36.5s. Estimated remaining: 16m 38s. Rate: 7.5 symbols/min [2025-09-25T21:59:02.292371] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-25T21:59:02.439929] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:02.482636] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T21:59:02.540355] [DEBUG] [LOCAL ] VRE: Loaded 34858 existing records from primary storage. [2025-09-25T21:59:02.540517] [INFO ] [MAIN ] VRE: Loaded 34858 existing records. [2025-09-25T21:59:02.733751] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:02.734020] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-25T21:59:02.734069] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-25T21:59:02.734376] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-25T21:59:02.734444] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-25T21:59:03.031427] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T21:59:03.094825] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-25T21:59:03.205189] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:03.888725] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-25T21:59:04.688770] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-25T21:59:04.877458] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-25T21:59:04.887326] [INFO ] [REMOTE ] VOYG: Full fetch complete (24400 records). [2025-09-25T21:59:04.887520] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-25T21:59:04.984529] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T21:59:05.119321] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-25T21:59:05.122625] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-25T21:59:05.123193] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T21:59:05.123306] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T21:59:05.123432] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-25T21:59:05.123551] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-25T21:59:05.123627] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-25T21:59:05.123755] [INFO ] [REMOTE ] VPV: Full fetch complete (9332 records). [2025-09-25T21:59:05.123862] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-25T21:59:05.162931] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-25T21:59:05.163184] [INFO ] [MAIN ] Update Progress: 2248/2372 symbols completed. VOYG took 38.0s. Estimated remaining: 16m 30s. Rate: 7.5 symbols/min [2025-09-25T21:59:05.485410] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:05.500893] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-25T21:59:05.813028] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-25T21:59:05.813243] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-25T21:59:05.852589] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-25T21:59:05.852713] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-25T21:59:05.853011] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-25T21:59:05.853096] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-25T21:59:05.853715] [DEBUG] [LOCAL ] VPV: Trimmed 9332 records to 5389 (keeping 200 days of data) [2025-09-25T21:59:05.920964] [DEBUG] [LOCAL ] VPV: Primary data saved (5389 records). [2025-09-25T21:59:05.921092] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-25T21:59:05.921259] [INFO ] [MAIN ] Update Progress: 2249/2372 symbols completed. VPV took 23.1s. Estimated remaining: 16m 21s. Rate: 7.5 symbols/min [2025-09-25T21:59:06.206369] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:06.240821] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-25T21:59:06.246717] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-25T21:59:06.293762] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-25T21:59:06.297729] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:06.267691] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-25T21:59:06.301174] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-25T21:59:06.396947] [DEBUG] [LOCAL ] VRTS: Loaded 9142 existing records from primary storage. [2025-09-25T21:59:06.397097] [INFO ] [MAIN ] VRTS: Loaded 9142 existing records. [2025-09-25T21:59:06.773679] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:06.773994] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-25T21:59:06.774051] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-25T21:59:06.774312] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-25T21:59:06.774373] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-25T21:59:06.939535] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T21:59:07.088794] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-25T21:59:07.193214] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T21:59:07.210579] [INFO ] [REMOTE ] VPG: Full fetch complete (23005 records). [2025-09-25T21:59:07.220249] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-25T21:59:07.236595] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:07.598483] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:07.815277] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-25T21:59:07.815376] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-25T21:59:07.815969] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-25T21:59:07.816035] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-25T21:59:07.817148] [DEBUG] [LOCAL ] VPG: Trimmed 23005 records to 17301 (keeping 200 days of data) [2025-09-25T21:59:07.909431] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-25T21:59:07.946084] [DEBUG] [LOCAL ] VPG: Primary data saved (17301 records). [2025-09-25T21:59:07.946266] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-25T21:59:07.946425] [INFO ] [MAIN ] Update Progress: 2250/2372 symbols completed. VPG took 28.1s. Estimated remaining: 16m 13s. Rate: 7.5 symbols/min [2025-09-25T21:59:08.144491] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:08.221559] [DEBUG] [LOCAL ] VSCO: Loaded 52822 existing records from primary storage. [2025-09-25T21:59:08.221751] [INFO ] [MAIN ] VSCO: Loaded 52822 existing records. [2025-09-25T21:59:08.422682] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:08.423669] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-25T21:59:08.431594] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-25T21:59:08.431857] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-25T21:59:08.431917] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-25T21:59:08.584045] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-25T21:59:08.693796] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-25T21:59:08.875959] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:09.149572] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-25T21:59:09.488736] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-25T21:59:10.148595] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-25T21:59:10.288717] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-25T21:59:10.640737] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T21:59:11.088761] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-25T21:59:11.888777] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-25T21:59:12.440468] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-25T21:59:12.688699] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-25T21:59:12.808155] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-25T21:59:13.488796] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-25T21:59:13.791323] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T21:59:13.932192] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-25T21:59:14.144094] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-25T21:59:14.288754] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-25T21:59:15.088796] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-25T21:59:15.888712] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-25T21:59:15.927859] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-25T21:59:16.078047] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-25T21:59:16.688733] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-25T21:59:17.241543] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-25T21:59:17.490723] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-25T21:59:18.172324] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-25T21:59:18.288732] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-25T21:59:19.088727] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-25T21:59:19.208094] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-25T21:59:19.888854] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-25T21:59:19.937002] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-25T21:59:20.004344] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T21:59:20.688732] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-25T21:59:21.488741] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-25T21:59:22.209638] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-25T21:59:22.288704] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-25T21:59:22.293310] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-25T21:59:22.369569] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-25T21:59:23.088728] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-25T21:59:23.803877] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T21:59:23.888735] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-25T21:59:24.225001] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-25T21:59:24.688729] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-25T21:59:25.488721] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-25T21:59:25.599073] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-25T21:59:26.288707] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-25T21:59:26.371788] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-25T21:59:26.939443] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-25T21:59:27.088694] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-25T21:59:27.147416] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T21:59:27.888742] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-25T21:59:28.508953] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T21:59:28.688730] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-25T21:59:29.488743] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-25T21:59:29.727078] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T21:59:30.090372] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-25T21:59:30.288753] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-25T21:59:31.088729] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-25T21:59:31.759747] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-25T21:59:31.776949] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T21:59:31.779110] [INFO ] [REMOTE ] VRTS: Full fetch complete (11293 records). [2025-09-25T21:59:31.779202] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-25T21:59:31.895789] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-25T21:59:32.286978] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-25T21:59:32.466942] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-25T21:59:32.467038] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-25T21:59:32.467312] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-25T21:59:32.467401] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-25T21:59:32.467959] [DEBUG] [LOCAL ] VRTS: Trimmed 11293 records to 9214 (keeping 200 days of data) [2025-09-25T21:59:32.532940] [DEBUG] [LOCAL ] VRTS: Primary data saved (9214 records). [2025-09-25T21:59:32.533123] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-25T21:59:32.533273] [INFO ] [MAIN ] Update Progress: 2251/2372 symbols completed. VRTS took 26.6s. Estimated remaining: 16m 6s. Rate: 7.5 symbols/min [2025-09-25T21:59:32.694832] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-25T21:59:32.720396] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:32.794186] [DEBUG] [LOCAL ] VSH: Loaded 48566 existing records from primary storage. [2025-09-25T21:59:32.794411] [INFO ] [MAIN ] VSH: Loaded 48566 existing records. [2025-09-25T21:59:32.977433] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:32.977928] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-25T21:59:32.977989] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-25T21:59:32.978504] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-25T21:59:32.978564] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-25T21:59:33.382900] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:33.417071] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T21:59:33.425545] [INFO ] [REMOTE ] VRE: Full fetch complete (47757 records). [2025-09-25T21:59:33.425691] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-25T21:59:33.488905] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-25T21:59:33.848863] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-25T21:59:33.848962] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-25T21:59:33.850142] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-25T21:59:33.850209] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-25T21:59:33.851502] [DEBUG] [LOCAL ] VRE: Trimmed 47757 records to 35057 (keeping 200 days of data) [2025-09-25T21:59:34.073546] [DEBUG] [LOCAL ] VRE: Primary data saved (35057 records). [2025-09-25T21:59:34.073731] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-25T21:59:34.073851] [INFO ] [MAIN ] Update Progress: 2252/2372 symbols completed. VRE took 31.8s. Estimated remaining: 15m 58s. Rate: 7.5 symbols/min [2025-09-25T21:59:34.262935] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:34.288799] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-25T21:59:34.334636] [DEBUG] [LOCAL ] VST: Loaded 53720 existing records from primary storage. [2025-09-25T21:59:34.334849] [INFO ] [MAIN ] VST: Loaded 53720 existing records. [2025-09-25T21:59:34.545255] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:34.545627] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-25T21:59:34.545710] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-25T21:59:34.546066] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-25T21:59:34.546126] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-25T21:59:34.728609] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T21:59:34.981728] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:35.088734] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-25T21:59:35.888814] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-25T21:59:36.013887] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-25T21:59:36.070694] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T21:59:36.688756] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-25T21:59:37.172136] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-25T21:59:37.223681] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T21:59:37.488728] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-25T21:59:38.288762] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-25T21:59:39.090709] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-25T21:59:39.144332] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-25T21:59:39.369187] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-25T21:59:39.382010] [INFO ] [REMOTE ] VSCO: Full fetch complete (76197 records). [2025-09-25T21:59:39.382158] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-25T21:59:39.811632] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-25T21:59:39.811770] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-25T21:59:39.813166] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-25T21:59:39.813234] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-25T21:59:39.814887] [DEBUG] [LOCAL ] VSCO: Trimmed 76197 records to 53190 (keeping 200 days of data) [2025-09-25T21:59:39.907590] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-25T21:59:40.153270] [DEBUG] [LOCAL ] VSCO: Primary data saved (53190 records). [2025-09-25T21:59:40.153425] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-25T21:59:40.153552] [INFO ] [MAIN ] Update Progress: 2253/2372 symbols completed. VSCO took 32.2s. Estimated remaining: 15m 50s. Rate: 7.5 symbols/min [2025-09-25T21:59:40.337069] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:40.396553] [DEBUG] [LOCAL ] VSTS: Loaded 49050 existing records from primary storage. [2025-09-25T21:59:40.396762] [INFO ] [MAIN ] VSTS: Loaded 49050 existing records. [2025-09-25T21:59:40.595387] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:40.595800] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-25T21:59:40.595862] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-25T21:59:40.596223] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-25T21:59:40.596286] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-25T21:59:40.847844] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-25T21:59:40.904741] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-25T21:59:40.924228] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T21:59:41.119700] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:41.488727] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-25T21:59:41.988723] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-25T21:59:42.288702] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-25T21:59:42.776083] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T21:59:43.088688] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-25T21:59:43.472338] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-25T21:59:43.888720] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-25T21:59:44.688731] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-25T21:59:44.826717] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T21:59:44.921095] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-25T21:59:44.932722] [INFO ] [REMOTE ] VRT: Full fetch complete (77831 records). [2025-09-25T21:59:44.932918] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-25T21:59:45.351145] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-25T21:59:45.351237] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-25T21:59:45.352439] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-25T21:59:45.352524] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-25T21:59:45.354211] [DEBUG] [LOCAL ] VRT: Trimmed 77831 records to 54143 (keeping 200 days of data) [2025-09-25T21:59:45.489724] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-25T21:59:45.764910] [DEBUG] [LOCAL ] VRT: Primary data saved (54143 records). [2025-09-25T21:59:45.765142] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-25T21:59:45.765305] [INFO ] [MAIN ] Update Progress: 2254/2372 symbols completed. VRT took 40.6s. Estimated remaining: 15m 41s. Rate: 7.5 symbols/min [2025-09-25T21:59:45.949162] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T21:59:46.001729] [DEBUG] [LOCAL ] VTEX: Loaded 43395 existing records from primary storage. [2025-09-25T21:59:46.001902] [INFO ] [MAIN ] VTEX: Loaded 43395 existing records. [2025-09-25T21:59:46.192345] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T21:59:46.192618] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-25T21:59:46.192704] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-25T21:59:46.193014] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-25T21:59:46.193079] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-25T21:59:46.664073] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T21:59:46.664496] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-25T21:59:46.669762] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T21:59:46.747835] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-25T21:59:47.088736] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-25T21:59:47.185503] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-25T21:59:47.761128] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-25T21:59:47.888734] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-25T21:59:48.688850] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-25T21:59:49.488732] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-25T21:59:49.644616] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T21:59:49.885026] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.80 seconds). [2025-09-25T21:59:49.926286] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-25T21:59:50.288745] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-25T21:59:50.954303] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-25T21:59:51.088739] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-25T21:59:51.888749] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-25T21:59:52.040971] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T21:59:52.688724] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-25T21:59:53.278178] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-25T21:59:53.488705] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-25T21:59:53.829143] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-25T21:59:54.052700] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-25T21:59:54.288744] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-25T21:59:55.088706] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-25T21:59:55.183514] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-25T21:59:55.888725] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-25T21:59:56.688716] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-25T21:59:56.762672] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-25T21:59:56.837906] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T21:59:57.488727] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-25T21:59:57.700583] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-25T21:59:58.228908] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T21:59:58.288734] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-25T21:59:59.094824] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-25T21:59:59.116699] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T21:59:59.888735] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-25T22:00:00.690323] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-25T22:00:00.938478] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T22:00:00.976843] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-25T22:00:01.488732] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-25T22:00:01.571553] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T22:00:02.242582] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T22:00:02.288971] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-25T22:00:03.088778] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-25T22:00:03.888759] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-25T22:00:03.982110] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T22:00:03.992720] [INFO ] [REMOTE ] VSH: Full fetch complete (71165 records). [2025-09-25T22:00:03.992968] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-25T22:00:04.502706] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-09-25T22:00:04.605693] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-25T22:00:04.605807] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-25T22:00:04.607028] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-25T22:00:04.607126] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-25T22:00:04.608755] [DEBUG] [LOCAL ] VSH: Trimmed 71165 records to 48887 (keeping 200 days of data) [2025-09-25T22:00:04.721197] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-25T22:00:04.902393] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T22:00:05.006724] [DEBUG] [LOCAL ] VSH: Primary data saved (48887 records). [2025-09-25T22:00:05.007624] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-25T22:00:05.007836] [INFO ] [MAIN ] Update Progress: 2255/2372 symbols completed. VSH took 32.5s. Estimated remaining: 15m 34s. Rate: 7.5 symbols/min [2025-09-25T22:00:05.222536] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:05.277473] [DEBUG] [LOCAL ] VTLE: Loaded 48611 existing records from primary storage. [2025-09-25T22:00:05.277755] [INFO ] [MAIN ] VTLE: Loaded 48611 existing records. [2025-09-25T22:00:05.489807] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-25T22:00:05.489699] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-25T22:00:05.563962] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:05.564250] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-25T22:00:05.564323] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-25T22:00:05.564706] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-25T22:00:05.564797] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-25T22:00:05.578877] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T22:00:05.605884] [INFO ] [REMOTE ] VST: Full fetch complete (77809 records). [2025-09-25T22:00:05.606077] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-25T22:00:06.296860] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-25T22:00:06.379550] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:06.432667] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-25T22:00:06.432785] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-25T22:00:06.434091] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-25T22:00:06.434169] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-25T22:00:06.435949] [DEBUG] [LOCAL ] VST: Trimmed 77809 records to 54110 (keeping 200 days of data) [2025-09-25T22:00:06.815147] [DEBUG] [LOCAL ] VST: Primary data saved (54110 records). [2025-09-25T22:00:06.815321] [INFO ] [MAIN ] VST: Full history saved. [2025-09-25T22:00:06.816541] [INFO ] [MAIN ] Update Progress: 2256/2372 symbols completed. VST took 32.7s. Estimated remaining: 15m 26s. Rate: 7.5 symbols/min [2025-09-25T22:00:06.998935] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:07.031804] [DEBUG] [LOCAL ] VTMX: Loaded 17530 existing records from primary storage. [2025-09-25T22:00:07.031949] [INFO ] [MAIN ] VTMX: Loaded 17530 existing records. [2025-09-25T22:00:07.107722] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-25T22:00:07.250463] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:07.251445] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-25T22:00:07.251497] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-25T22:00:07.251772] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-25T22:00:07.251835] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-25T22:00:07.457470] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-25T22:00:07.693769] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:07.888703] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-25T22:00:08.062293] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T22:00:08.688724] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-25T22:00:08.797943] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T22:00:08.960618] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T22:00:09.488711] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-25T22:00:10.288747] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-25T22:00:10.354331] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T22:00:10.492718] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T22:00:11.088723] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-25T22:00:11.705451] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T22:00:11.888709] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-25T22:00:12.637504] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-25T22:00:12.645960] [INFO ] [REMOTE ] VTEX: Full fetch complete (60806 records). [2025-09-25T22:00:12.646128] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-25T22:00:12.693909] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-25T22:00:13.059232] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-25T22:00:13.059325] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-25T22:00:13.060417] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-25T22:00:13.060494] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-25T22:00:13.062620] [DEBUG] [LOCAL ] VTEX: Trimmed 60806 records to 43673 (keeping 200 days of data) [2025-09-25T22:00:13.329345] [DEBUG] [LOCAL ] VTEX: Primary data saved (43673 records). [2025-09-25T22:00:13.329493] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-25T22:00:13.329664] [INFO ] [MAIN ] Update Progress: 2257/2372 symbols completed. VTEX took 27.6s. Estimated remaining: 15m 18s. Rate: 7.5 symbols/min [2025-09-25T22:00:13.496595] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T22:00:13.506214] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-25T22:00:13.585116] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:13.600936] [DEBUG] [LOCAL ] VTN: Loaded 7212 existing records from primary storage. [2025-09-25T22:00:13.601116] [INFO ] [MAIN ] VTN: Loaded 7212 existing records. [2025-09-25T22:00:13.807908] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:13.808317] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-25T22:00:13.808551] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-25T22:00:13.808872] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-25T22:00:13.808933] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-25T22:00:13.922037] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-25T22:00:14.213976] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:14.288725] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-25T22:00:15.074913] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T22:00:15.088672] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-25T22:00:15.272796] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-25T22:00:15.888780] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-25T22:00:15.897964] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-25T22:00:16.688758] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-25T22:00:17.488740] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-25T22:00:17.866627] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-25T22:00:18.258034] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-25T22:00:18.288756] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-25T22:00:18.382270] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-25T22:00:19.088765] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-25T22:00:19.118496] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T22:00:19.888737] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-25T22:00:20.680905] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-25T22:00:20.688333] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-25T22:00:20.689419] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-25T22:00:21.488708] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-25T22:00:22.288725] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-25T22:00:22.381130] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-25T22:00:22.395036] [INFO ] [REMOTE ] VSTS: Full fetch complete (69873 records). [2025-09-25T22:00:22.395263] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-25T22:00:22.826537] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-25T22:00:22.826710] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-25T22:00:22.828523] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-25T22:00:22.828596] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-25T22:00:22.830728] [DEBUG] [LOCAL ] VSTS: Trimmed 69873 records to 49414 (keeping 200 days of data) [2025-09-25T22:00:23.125113] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-25T22:00:23.170168] [DEBUG] [LOCAL ] VSTS: Primary data saved (49414 records). [2025-09-25T22:00:23.170461] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-25T22:00:23.172410] [INFO ] [MAIN ] Update Progress: 2258/2372 symbols completed. VSTS took 43.0s. Estimated remaining: 15m 10s. Rate: 7.5 symbols/min [2025-09-25T22:00:23.345223] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-25T22:00:23.391418] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-25T22:00:23.429594] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:23.460783] [DEBUG] [LOCAL ] VTOL: Loaded 19720 existing records from primary storage. [2025-09-25T22:00:23.460951] [INFO ] [MAIN ] VTOL: Loaded 19720 existing records. [2025-09-25T22:00:23.642969] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:23.643223] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-25T22:00:23.643269] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-25T22:00:23.643507] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-25T22:00:23.643565] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-25T22:00:23.893284] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-25T22:00:23.978131] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T22:00:24.053723] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:24.688693] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-25T22:00:25.020547] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-25T22:00:25.488734] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-25T22:00:25.748045] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-25T22:00:26.288740] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-25T22:00:26.730406] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-25T22:00:27.092318] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-25T22:00:27.093386] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-25T22:00:27.888705] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-25T22:00:28.134192] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T22:00:28.688782] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-25T22:00:28.809379] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-25T22:00:29.469788] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-25T22:00:29.488743] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-25T22:00:30.027556] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-25T22:00:30.288782] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-25T22:00:31.088760] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-25T22:00:31.888775] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-25T22:00:32.114498] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T22:00:32.294638] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T22:00:32.688744] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-25T22:00:32.968088] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T22:00:33.355157] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-25T22:00:33.488756] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-25T22:00:34.288821] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-25T22:00:34.580124] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-25T22:00:34.583879] [INFO ] [REMOTE ] VTMX: Full fetch complete (26013 records). [2025-09-25T22:00:34.583998] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-25T22:00:35.020009] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-25T22:00:35.020185] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-25T22:00:35.020908] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-25T22:00:35.021043] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-25T22:00:35.023196] [DEBUG] [LOCAL ] VTMX: Trimmed 26013 records to 17636 (keeping 200 days of data) [2025-09-25T22:00:35.107993] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-25T22:00:35.146489] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-25T22:00:35.160522] [INFO ] [REMOTE ] VTN: Full fetch complete (11474 records). [2025-09-25T22:00:35.160699] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-25T22:00:35.249947] [DEBUG] [LOCAL ] VTMX: Primary data saved (17636 records). [2025-09-25T22:00:35.250092] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-25T22:00:35.250233] [INFO ] [MAIN ] Update Progress: 2259/2372 symbols completed. VTMX took 28.4s. Estimated remaining: 15m 2s. Rate: 7.5 symbols/min [2025-09-25T22:00:35.727948] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:35.857747] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-25T22:00:35.858000] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-25T22:00:35.858347] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-25T22:00:35.858409] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-25T22:00:35.859685] [DEBUG] [LOCAL ] VTN: Trimmed 11474 records to 7252 (keeping 200 days of data) [2025-09-25T22:00:35.890818] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-25T22:00:35.980129] [DEBUG] [LOCAL ] VTN: Primary data saved (7252 records). [2025-09-25T22:00:35.980258] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-25T22:00:35.980419] [INFO ] [MAIN ] Update Progress: 2260/2372 symbols completed. VTN took 22.7s. Estimated remaining: 14m 54s. Rate: 7.5 symbols/min [2025-09-25T22:00:35.978615] [DEBUG] [LOCAL ] VTR: Loaded 52846 existing records from primary storage. [2025-09-25T22:00:35.986044] [INFO ] [MAIN ] VTR: Loaded 52846 existing records. [2025-09-25T22:00:36.385869] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:36.426095] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:36.426434] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-25T22:00:36.426489] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-25T22:00:36.426979] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-25T22:00:36.427063] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-25T22:00:36.611614] [DEBUG] [LOCAL ] VTS: Loaded 30559 existing records from primary storage. [2025-09-25T22:00:36.611803] [INFO ] [MAIN ] VTS: Loaded 30559 existing records. [2025-09-25T22:00:37.153043] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-25T22:00:37.150412] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T22:00:37.178804] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-25T22:00:37.187021] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:37.198211] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:37.198493] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-25T22:00:37.198553] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-25T22:00:37.198819] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-25T22:00:37.198880] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-25T22:00:37.493742] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-25T22:00:37.614598] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:38.288744] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-25T22:00:38.514757] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T22:00:38.994362] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T22:00:39.007860] [INFO ] [REMOTE ] VTLE: Full fetch complete (68794 records). [2025-09-25T22:00:39.008059] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-25T22:00:39.096932] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-25T22:00:39.476062] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-25T22:00:39.476170] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-25T22:00:39.477424] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-25T22:00:39.477492] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-25T22:00:39.479834] [DEBUG] [LOCAL ] VTLE: Trimmed 68794 records to 48959 (keeping 200 days of data) [2025-09-25T22:00:39.516233] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-25T22:00:39.861134] [DEBUG] [LOCAL ] VTLE: Primary data saved (48959 records). [2025-09-25T22:00:39.861383] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-25T22:00:39.861707] [INFO ] [MAIN ] Update Progress: 2261/2372 symbols completed. VTLE took 34.9s. Estimated remaining: 14m 45s. Rate: 7.5 symbols/min [2025-09-25T22:00:39.894813] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-25T22:00:40.062331] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:40.113312] [DEBUG] [LOCAL ] VVR: Loaded 30603 existing records from primary storage. [2025-09-25T22:00:40.113565] [INFO ] [MAIN ] VVR: Loaded 30603 existing records. [2025-09-25T22:00:40.317793] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:40.318296] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-25T22:00:40.318351] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-25T22:00:40.318694] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-25T22:00:40.318778] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-25T22:00:40.689898] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-25T22:00:40.806392] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:40.953368] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T22:00:41.195541] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-25T22:00:41.488753] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-25T22:00:41.559593] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T22:00:42.276943] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-25T22:00:42.288680] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-25T22:00:43.088815] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-25T22:00:43.683676] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T22:00:43.888742] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-25T22:00:44.554114] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T22:00:44.688722] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-25T22:00:45.439485] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T22:00:45.488745] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-25T22:00:46.195175] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-25T22:00:46.288733] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-25T22:00:46.469574] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-25T22:00:47.088799] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-25T22:00:47.212105] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-25T22:00:47.888796] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-25T22:00:48.164497] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-25T22:00:48.688736] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-25T22:00:49.488720] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-25T22:00:49.743361] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T22:00:49.795928] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-25T22:00:50.288717] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-25T22:00:50.575813] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T22:00:51.088732] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-25T22:00:51.888688] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-25T22:00:52.043185] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-25T22:00:52.392905] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-25T22:00:52.688693] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-25T22:00:53.001923] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-25T22:00:53.488709] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-25T22:00:54.288734] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-25T22:00:54.645223] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T22:00:54.704280] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T22:00:55.088739] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-25T22:00:55.385778] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-25T22:00:55.888708] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-25T22:00:56.104244] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-25T22:00:56.110477] [INFO ] [REMOTE ] VTS: Full fetch complete (40916 records). [2025-09-25T22:00:56.110599] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-25T22:00:56.506736] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-25T22:00:56.506870] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-25T22:00:56.507783] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-25T22:00:56.507848] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-25T22:00:56.509007] [DEBUG] [LOCAL ] VTS: Trimmed 40916 records to 30775 (keeping 200 days of data) [2025-09-25T22:00:56.694719] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-25T22:00:56.723343] [DEBUG] [LOCAL ] VTS: Primary data saved (30775 records). [2025-09-25T22:00:56.723518] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-25T22:00:56.723688] [INFO ] [MAIN ] Update Progress: 2262/2372 symbols completed. VTS took 20.7s. Estimated remaining: 14m 38s. Rate: 7.5 symbols/min [2025-09-25T22:00:56.907876] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:00:56.967837] [DEBUG] [LOCAL ] VVV: Loaded 50210 existing records from primary storage. [2025-09-25T22:00:56.968003] [INFO ] [MAIN ] VVV: Loaded 50210 existing records. [2025-09-25T22:00:57.162122] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:00:57.162438] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-25T22:00:57.162511] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-25T22:00:57.163119] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-25T22:00:57.163202] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-25T22:00:57.489468] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-25T22:00:57.592215] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:00:57.626420] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T22:00:57.732956] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-25T22:00:58.288715] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-25T22:00:58.533628] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-25T22:00:59.088751] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-25T22:00:59.888738] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-25T22:01:00.266211] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T22:01:00.557803] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-25T22:01:00.575139] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T22:01:00.578691] [INFO ] [REMOTE ] VTOL: Full fetch complete (26139 records). [2025-09-25T22:01:00.578770] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-25T22:01:00.693859] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-25T22:01:00.982400] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-25T22:01:00.982490] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-25T22:01:00.983164] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-25T22:01:00.983229] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-25T22:01:00.985201] [DEBUG] [LOCAL ] VTOL: Trimmed 26139 records to 19814 (keeping 200 days of data) [2025-09-25T22:01:01.145100] [DEBUG] [LOCAL ] VTOL: Primary data saved (19814 records). [2025-09-25T22:01:01.145266] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-25T22:01:01.145360] [INFO ] [MAIN ] Update Progress: 2263/2372 symbols completed. VTOL took 38.0s. Estimated remaining: 14m 30s. Rate: 7.5 symbols/min [2025-09-25T22:01:01.327469] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:01.362532] [DEBUG] [LOCAL ] VVX: Loaded 23347 existing records from primary storage. [2025-09-25T22:01:01.362727] [INFO ] [MAIN ] VVX: Loaded 23347 existing records. [2025-09-25T22:01:01.493864] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-25T22:01:01.572774] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:01.573128] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-25T22:01:01.573178] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-25T22:01:01.573605] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-25T22:01:01.573714] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-25T22:01:01.974750] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:02.288759] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-25T22:01:02.441955] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T22:01:03.088703] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-25T22:01:03.301969] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T22:01:03.329433] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T22:01:03.888773] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-25T22:01:04.688701] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-25T22:01:04.861616] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T22:01:04.923421] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-25T22:01:05.470937] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-25T22:01:05.488687] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-25T22:01:06.288744] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-25T22:01:06.662031] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T22:01:07.088746] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-25T22:01:07.888743] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-25T22:01:07.947675] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-25T22:01:08.688742] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-25T22:01:08.876819] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-25T22:01:09.260689] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-25T22:01:09.488705] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-25T22:01:09.523172] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-25T22:01:10.215822] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-25T22:01:10.226583] [INFO ] [REMOTE ] VTR: Full fetch complete (76341 records). [2025-09-25T22:01:10.226811] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-25T22:01:10.289462] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-25T22:01:10.653623] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-25T22:01:10.653757] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-25T22:01:10.654945] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-25T22:01:10.655014] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-25T22:01:10.656716] [DEBUG] [LOCAL ] VTR: Trimmed 76341 records to 53235 (keeping 200 days of data) [2025-09-25T22:01:11.000083] [DEBUG] [LOCAL ] VTR: Primary data saved (53235 records). [2025-09-25T22:01:11.000253] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-25T22:01:11.000350] [INFO ] [MAIN ] Update Progress: 2264/2372 symbols completed. VTR took 35.7s. Estimated remaining: 14m 22s. Rate: 7.5 symbols/min [2025-09-25T22:01:11.096732] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-25T22:01:11.214309] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:11.277095] [DEBUG] [LOCAL ] VYX: Loaded 49030 existing records from primary storage. [2025-09-25T22:01:11.277266] [INFO ] [MAIN ] VYX: Loaded 49030 existing records. [2025-09-25T22:01:11.429238] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-25T22:01:11.501896] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:11.503385] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-25T22:01:11.503436] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-25T22:01:11.503941] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-25T22:01:11.504022] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-25T22:01:11.889518] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-25T22:01:11.913679] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:12.702770] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T22:01:12.712727] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-25T22:01:13.385791] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T22:01:13.392996] [INFO ] [REMOTE ] VVR: Full fetch complete (45847 records). [2025-09-25T22:01:13.393165] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-25T22:01:13.492086] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-25T22:01:13.804804] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-25T22:01:13.804893] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-25T22:01:13.806043] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-25T22:01:13.806115] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-25T22:01:13.807297] [DEBUG] [LOCAL ] VVR: Trimmed 45847 records to 30917 (keeping 200 days of data) [2025-09-25T22:01:14.009176] [DEBUG] [LOCAL ] VVR: Primary data saved (30917 records). [2025-09-25T22:01:14.009337] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-25T22:01:14.009450] [INFO ] [MAIN ] Update Progress: 2265/2372 symbols completed. VVR took 34.1s. Estimated remaining: 14m 14s. Rate: 7.5 symbols/min [2025-09-25T22:01:14.212084] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:14.281908] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-25T22:01:14.282085] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-25T22:01:14.294451] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-25T22:01:14.376925] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-25T22:01:14.535302] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:14.536501] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-25T22:01:14.536556] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-25T22:01:14.537063] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-25T22:01:14.537129] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-25T22:01:14.713275] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T22:01:14.933787] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:15.088757] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-25T22:01:15.888704] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-25T22:01:16.049090] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T22:01:16.350240] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-25T22:01:16.688743] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-25T22:01:17.443142] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T22:01:17.488689] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-25T22:01:17.817081] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T22:01:18.288748] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-25T22:01:19.088791] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-25T22:01:19.215825] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T22:01:19.803177] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T22:01:19.888737] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-25T22:01:20.688737] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-25T22:01:21.488763] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-25T22:01:21.540518] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-25T22:01:21.606243] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T22:01:21.843922] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T22:01:21.850810] [INFO ] [REMOTE ] VVX: Full fetch complete (33539 records). [2025-09-25T22:01:21.850935] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-25T22:01:22.260445] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-25T22:01:22.260536] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-25T22:01:22.261321] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-25T22:01:22.261385] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-25T22:01:22.262345] [DEBUG] [LOCAL ] VVX: Trimmed 33539 records to 23504 (keeping 200 days of data) [2025-09-25T22:01:22.310659] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-25T22:01:22.423000] [DEBUG] [LOCAL ] VVX: Primary data saved (23504 records). [2025-09-25T22:01:22.423157] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-25T22:01:22.423254] [INFO ] [MAIN ] Update Progress: 2266/2372 symbols completed. VVX took 21.3s. Estimated remaining: 14m 6s. Rate: 7.5 symbols/min [2025-09-25T22:01:22.600910] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:22.667456] [DEBUG] [LOCAL ] W: Loaded 53496 existing records from primary storage. [2025-09-25T22:01:22.667671] [INFO ] [MAIN ] W: Loaded 53496 existing records. [2025-09-25T22:01:22.858684] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:22.859606] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-25T22:01:22.859693] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-25T22:01:22.860037] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-25T22:01:22.860099] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-25T22:01:23.088774] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-25T22:01:23.131384] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-25T22:01:23.302801] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:23.752982] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T22:01:23.888736] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-25T22:01:24.688738] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-25T22:01:25.464233] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-25T22:01:25.488670] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-25T22:01:25.707403] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T22:01:26.288741] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-25T22:01:26.752978] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-25T22:01:27.088728] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-25T22:01:27.658899] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-25T22:01:27.888696] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-25T22:01:28.056046] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-25T22:01:28.350976] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-25T22:01:28.688716] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-25T22:01:29.489010] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-25T22:01:30.252536] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-25T22:01:30.288691] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-25T22:01:30.439009] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-25T22:01:31.088698] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-25T22:01:31.143020] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-25T22:01:31.888810] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-25T22:01:32.671000] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-25T22:01:32.688684] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-25T22:01:32.730681] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-25T22:01:33.202699] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T22:01:33.213456] [INFO ] [REMOTE ] VVV: Full fetch complete (72374 records). [2025-09-25T22:01:33.213669] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-25T22:01:33.493812] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-25T22:01:33.813724] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-25T22:01:33.813830] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-25T22:01:33.815026] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-25T22:01:33.815151] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-25T22:01:33.817382] [DEBUG] [LOCAL ] VVV: Trimmed 72374 records to 50595 (keeping 200 days of data) [2025-09-25T22:01:34.166738] [DEBUG] [LOCAL ] VVV: Primary data saved (50595 records). [2025-09-25T22:01:34.166904] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-25T22:01:34.167151] [INFO ] [MAIN ] Update Progress: 2267/2372 symbols completed. VVV took 37.4s. Estimated remaining: 13m 58s. Rate: 7.5 symbols/min [2025-09-25T22:01:34.293754] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-25T22:01:34.345189] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-25T22:01:34.440900] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:34.518496] [DEBUG] [LOCAL ] WAB: Loaded 44215 existing records from primary storage. [2025-09-25T22:01:34.518722] [INFO ] [MAIN ] WAB: Loaded 44215 existing records. [2025-09-25T22:01:34.706040] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:34.706714] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-25T22:01:34.706770] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-25T22:01:34.707265] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-25T22:01:34.707338] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-25T22:01:35.088702] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-25T22:01:35.097171] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:35.418220] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T22:01:35.888723] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-25T22:01:36.415024] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T22:01:36.508008] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-25T22:01:36.688725] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-25T22:01:37.488757] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-25T22:01:37.730961] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T22:01:38.288769] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-25T22:01:38.411146] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T22:01:38.424240] [INFO ] [REMOTE ] VYX: Full fetch complete (70338 records). [2025-09-25T22:01:38.424426] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-25T22:01:38.890405] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-25T22:01:38.890531] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-25T22:01:38.892023] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-25T22:01:38.892101] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-25T22:01:38.896835] [DEBUG] [LOCAL ] VYX: Trimmed 70338 records to 49359 (keeping 200 days of data) [2025-09-25T22:01:38.908454] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T22:01:39.108331] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-25T22:01:39.250016] [DEBUG] [LOCAL ] VYX: Primary data saved (49359 records). [2025-09-25T22:01:39.250190] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-25T22:01:39.251419] [INFO ] [MAIN ] Update Progress: 2268/2372 symbols completed. VYX took 28.3s. Estimated remaining: 13m 50s. Rate: 7.5 symbols/min [2025-09-25T22:01:39.444076] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:39.519817] [DEBUG] [LOCAL ] WAL: Loaded 45337 existing records from primary storage. [2025-09-25T22:01:39.520027] [INFO ] [MAIN ] WAL: Loaded 45337 existing records. [2025-09-25T22:01:39.712028] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:39.712466] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-25T22:01:39.712530] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-25T22:01:39.712903] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-25T22:01:39.712964] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-25T22:01:39.910496] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-25T22:01:40.147506] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:40.303825] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T22:01:40.688736] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-25T22:01:41.165944] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-25T22:01:41.248471] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-25T22:01:41.488734] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-25T22:01:41.862538] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T22:01:42.288742] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-25T22:01:43.088725] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-25T22:01:43.888750] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-25T22:01:44.060438] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-25T22:01:44.106763] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-25T22:01:44.625539] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-25T22:01:44.688732] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-25T22:01:45.343986] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T22:01:45.488736] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-25T22:01:46.288746] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-25T22:01:47.093860] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-25T22:01:47.113376] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-25T22:01:47.296483] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-25T22:01:47.888734] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-25T22:01:48.127987] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-25T22:01:48.670426] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:01:48.681819] [INFO ] [REMOTE ] VZ: Full fetch complete (77958 records). [2025-09-25T22:01:48.690893] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-25T22:01:48.710819] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-25T22:01:48.691052] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-25T22:01:49.179231] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-25T22:01:49.179375] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-25T22:01:49.180837] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-25T22:01:49.180908] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-25T22:01:49.183491] [DEBUG] [LOCAL ] VZ: Trimmed 77958 records to 54181 (keeping 200 days of data) [2025-09-25T22:01:49.497906] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-25T22:01:49.556857] [DEBUG] [LOCAL ] VZ: Primary data saved (54181 records). [2025-09-25T22:01:49.557054] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-25T22:01:49.557208] [INFO ] [MAIN ] Update Progress: 2269/2372 symbols completed. VZ took 35.5s. Estimated remaining: 13m 42s. Rate: 7.5 symbols/min [2025-09-25T22:01:49.745802] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:01:49.797551] [DEBUG] [LOCAL ] WAT: Loaded 35095 existing records from primary storage. [2025-09-25T22:01:49.797734] [INFO ] [MAIN ] WAT: Loaded 35095 existing records. [2025-09-25T22:01:49.993891] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:01:49.994252] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-25T22:01:49.994313] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-25T22:01:49.997698] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-25T22:01:49.997802] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-25T22:01:50.288741] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-25T22:01:50.535872] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:01:50.724579] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T22:01:51.088736] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-25T22:01:51.364751] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-25T22:01:51.846979] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T22:01:51.888685] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-25T22:01:52.688720] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-25T22:01:52.748591] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-25T22:01:53.488738] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-25T22:01:53.918089] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-25T22:01:54.288761] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-25T22:01:54.340839] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-25T22:01:54.846841] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T22:01:55.088718] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-25T22:01:55.888731] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-25T22:01:56.265566] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-25T22:01:56.614277] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-25T22:01:56.688739] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-25T22:01:57.462232] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T22:01:57.488679] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-25T22:01:58.290622] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-25T22:01:58.293477] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-25T22:01:59.088714] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-25T22:01:59.421615] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-25T22:01:59.437352] [INFO ] [REMOTE ] W: Full fetch complete (77439 records). [2025-09-25T22:01:59.437565] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-25T22:01:59.896754] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-25T22:01:59.896867] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-25T22:01:59.898180] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-25T22:01:59.898275] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-25T22:01:59.898724] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-25T22:01:59.902996] [DEBUG] [LOCAL ] W: Trimmed 77439 records to 53885 (keeping 200 days of data) [2025-09-25T22:02:00.170302] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-25T22:02:00.303611] [DEBUG] [LOCAL ] W: Primary data saved (53885 records). [2025-09-25T22:02:00.303796] [INFO ] [MAIN ] W: Full history saved. [2025-09-25T22:02:00.303930] [INFO ] [MAIN ] Update Progress: 2270/2372 symbols completed. W took 37.9s. Estimated remaining: 13m 34s. Rate: 7.5 symbols/min [2025-09-25T22:02:00.487436] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:00.487628] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-25T22:02:00.487715] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-25T22:02:00.487853] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-25T22:02:00.487905] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-25T22:02:00.487952] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-25T22:02:00.487986] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-25T22:02:00.714103] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-25T22:02:00.923850] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T22:02:00.954821] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:01.427204] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T22:02:01.488746] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-25T22:02:01.712159] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:01.712512] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-25T22:02:02.241345] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-25T22:02:02.288678] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-25T22:02:03.088738] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-25T22:02:03.302380] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:03.302802] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-25T22:02:03.840091] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-25T22:02:03.888771] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-25T22:02:04.120072] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:04.120513] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-25T22:02:04.688745] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-25T22:02:04.944354] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:04.944781] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-25T22:02:05.488766] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-25T22:02:06.288740] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-25T22:02:07.088766] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-25T22:02:07.329728] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-25T22:02:07.710606] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:07.711013] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-25T22:02:07.737590] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T22:02:07.888750] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-25T22:02:08.101461] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:08.101827] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-25T22:02:08.688742] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-25T22:02:08.929295] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:08.929692] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-25T22:02:09.488761] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-25T22:02:10.288689] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-25T22:02:10.729566] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-25T22:02:11.088760] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-25T22:02:11.620927] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-25T22:02:11.888719] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-25T22:02:12.693857] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-25T22:02:12.705223] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T22:02:12.714701] [INFO ] [REMOTE ] WAB: Full fetch complete (64488 records). [2025-09-25T22:02:12.714880] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-25T22:02:12.930848] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T22:02:13.209805] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-25T22:02:13.209901] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-25T22:02:13.211215] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-25T22:02:13.211286] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-25T22:02:13.212747] [DEBUG] [LOCAL ] WAB: Trimmed 64488 records to 44516 (keeping 200 days of data) [2025-09-25T22:02:13.499706] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-25T22:02:13.509004] [DEBUG] [LOCAL ] WAB: Primary data saved (44516 records). [2025-09-25T22:02:13.509149] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-25T22:02:13.509247] [INFO ] [MAIN ] Update Progress: 2271/2372 symbols completed. WAB took 39.3s. Estimated remaining: 13m 26s. Rate: 7.5 symbols/min [2025-09-25T22:02:13.725088] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:13.782255] [DEBUG] [LOCAL ] WBS: Loaded 48737 existing records from primary storage. [2025-09-25T22:02:13.782406] [INFO ] [MAIN ] WBS: Loaded 48737 existing records. [2025-09-25T22:02:13.889870] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:13.902249] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-25T22:02:13.986076] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:13.986397] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-25T22:02:13.986445] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-25T22:02:13.987049] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-25T22:02:13.987122] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-25T22:02:14.293694] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-25T22:02:14.366485] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T22:02:14.442517] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:14.538467] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:02:14.538859] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-25T22:02:15.088757] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-25T22:02:15.888738] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-25T22:02:15.990164] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T22:02:15.993889] [INFO ] [REMOTE ] WBI: Full fetch complete (2222 records). [2025-09-25T22:02:15.993976] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-25T22:02:16.193346] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 7 unique days, need 200 days [2025-09-25T22:02:16.193712] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:02:16.193802] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:02:16.193874] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-25T22:02:16.193967] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-25T22:02:16.194024] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-25T22:02:16.194070] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-25T22:02:16.194138] [INFO ] [MAIN ] Update Progress: 2272/2372 symbols completed. WBI took 15.9s. Estimated remaining: 13m 18s. Rate: 7.5 symbols/min [2025-09-25T22:02:16.380104] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:16.403991] [DEBUG] [LOCAL ] WBX: Loaded 12517 existing records from primary storage. [2025-09-25T22:02:16.404145] [INFO ] [MAIN ] WBX: Loaded 12517 existing records. [2025-09-25T22:02:16.593938] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:16.594308] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-25T22:02:16.594360] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-25T22:02:16.594675] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-25T22:02:16.594747] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-25T22:02:16.693815] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-25T22:02:17.004772] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:17.424975] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T22:02:17.488751] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-25T22:02:18.288706] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-25T22:02:18.415598] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-25T22:02:18.928728] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-25T22:02:19.088711] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-25T22:02:19.888783] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-25T22:02:20.011887] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-25T22:02:20.026421] [INFO ] [REMOTE ] WAL: Full fetch complete (66432 records). [2025-09-25T22:02:20.026617] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-25T22:02:20.135599] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-25T22:02:20.490827] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-25T22:02:20.490930] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-25T22:02:20.492217] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-25T22:02:20.492292] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-25T22:02:20.493921] [DEBUG] [LOCAL ] WAL: Trimmed 66432 records to 45685 (keeping 200 days of data) [2025-09-25T22:02:20.706365] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-25T22:02:20.840128] [DEBUG] [LOCAL ] WAL: Primary data saved (45685 records). [2025-09-25T22:02:20.840375] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-25T22:02:20.842204] [INFO ] [MAIN ] Update Progress: 2273/2372 symbols completed. WAL took 41.6s. Estimated remaining: 13m 10s. Rate: 7.5 symbols/min [2025-09-25T22:02:21.032406] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:21.110619] [DEBUG] [LOCAL ] WCC: Loaded 39967 existing records from primary storage. [2025-09-25T22:02:21.110816] [INFO ] [MAIN ] WCC: Loaded 39967 existing records. [2025-09-25T22:02:21.296508] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:21.297149] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-25T22:02:21.297201] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-25T22:02:21.297493] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-25T22:02:21.297551] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-25T22:02:21.429529] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-25T22:02:21.442122] [INFO ] [REMOTE ] WAT: Full fetch complete (50015 records). [2025-09-25T22:02:21.442341] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-25T22:02:21.515402] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-25T22:02:21.626755] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T22:02:22.195500] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:22.295147] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-25T22:02:22.298480] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-25T22:02:22.298624] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-25T22:02:22.301571] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-25T22:02:22.301920] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-25T22:02:22.306762] [DEBUG] [LOCAL ] WAT: Trimmed 50015 records to 35382 (keeping 200 days of data) [2025-09-25T22:02:22.555038] [DEBUG] [LOCAL ] WAT: Primary data saved (35382 records). [2025-09-25T22:02:22.555249] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-25T22:02:22.555421] [INFO ] [MAIN ] Update Progress: 2274/2372 symbols completed. WAT took 33.0s. Estimated remaining: 13m 2s. Rate: 7.5 symbols/min [2025-09-25T22:02:22.762034] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:22.820436] [DEBUG] [LOCAL ] WCN: Loaded 48029 existing records from primary storage. [2025-09-25T22:02:22.820603] [INFO ] [MAIN ] WCN: Loaded 48029 existing records. [2025-09-25T22:02:22.973274] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T22:02:23.049592] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:23.050035] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-25T22:02:23.050124] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-25T22:02:23.050603] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-25T22:02:23.050828] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-25T22:02:23.089271] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-25T22:02:23.500445] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:23.596314] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T22:02:23.888739] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-25T22:02:24.053436] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-25T22:02:24.688720] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-25T22:02:25.140139] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T22:02:25.488726] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-25T22:02:25.668740] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-25T22:02:26.288798] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-25T22:02:26.966098] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-25T22:02:27.088736] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-25T22:02:27.888762] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-25T22:02:28.069295] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T22:02:28.691424] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-25T22:02:28.704861] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T22:02:28.744623] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T22:02:29.488778] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-25T22:02:30.288740] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-25T22:02:30.452078] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-25T22:02:30.638809] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T22:02:31.088736] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-25T22:02:31.888799] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-25T22:02:32.010025] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T22:02:32.059170] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T22:02:32.688855] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-25T22:02:33.488729] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-25T22:02:34.288752] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-25T22:02:34.566877] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-25T22:02:35.088720] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-25T22:02:35.183277] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-25T22:02:35.456179] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-25T22:02:35.457677] [INFO ] [REMOTE ] WBX: Full fetch complete (25731 records). [2025-09-25T22:02:35.457766] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-25T22:02:35.671917] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (2.98 seconds). [2025-09-25T22:02:35.879839] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-25T22:02:35.889174] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-25T22:02:36.016716] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-25T22:02:36.016820] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-25T22:02:36.017502] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-25T22:02:36.017570] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-25T22:02:36.018524] [DEBUG] [LOCAL ] WBX: Trimmed 25731 records to 12545 (keeping 200 days of data) [2025-09-25T22:02:36.113217] [DEBUG] [LOCAL ] WBX: Primary data saved (12545 records). [2025-09-25T22:02:36.113391] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-25T22:02:36.113700] [INFO ] [MAIN ] Update Progress: 2275/2372 symbols completed. WBX took 19.9s. Estimated remaining: 12m 54s. Rate: 7.5 symbols/min [2025-09-25T22:02:36.297563] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:36.331954] [DEBUG] [LOCAL ] WD: Loaded 23422 existing records from primary storage. [2025-09-25T22:02:36.332104] [INFO ] [MAIN ] WD: Loaded 23422 existing records. [2025-09-25T22:02:36.531590] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:36.532172] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-25T22:02:36.532246] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-25T22:02:36.532511] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-25T22:02:36.532591] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-25T22:02:36.699837] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-25T22:02:36.943999] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:37.488720] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-25T22:02:37.596329] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T22:02:38.258765] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-25T22:02:38.288676] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-25T22:02:38.528324] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-25T22:02:39.088727] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-25T22:02:39.888768] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-25T22:02:40.242120] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-25T22:02:40.688696] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-25T22:02:40.763392] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T22:02:41.065429] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-25T22:02:41.488743] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-25T22:02:42.012103] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-25T22:02:42.288741] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-25T22:02:43.093857] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-25T22:02:43.110201] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-25T22:02:43.422102] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T22:02:43.888728] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-25T22:02:44.688753] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-25T22:02:45.004194] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T22:02:45.488738] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-25T22:02:45.529224] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T22:02:45.954249] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-25T22:02:46.288770] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-25T22:02:47.088714] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-25T22:02:47.122616] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T22:02:47.891720] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T22:02:47.902737] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-25T22:02:48.592962] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-25T22:02:48.688735] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-25T22:02:49.488822] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-25T22:02:49.795228] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T22:02:50.267672] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-25T22:02:50.280049] [INFO ] [REMOTE ] WCC: Full fetch complete (57962 records). [2025-09-25T22:02:50.280237] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-25T22:02:50.294033] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-25T22:02:50.711337] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-25T22:02:50.711445] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-25T22:02:50.712582] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-25T22:02:50.712670] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-25T22:02:50.716926] [DEBUG] [LOCAL ] WCC: Trimmed 57962 records to 40294 (keeping 200 days of data) [2025-09-25T22:02:51.015030] [DEBUG] [LOCAL ] WCC: Primary data saved (40294 records). [2025-09-25T22:02:51.015176] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-25T22:02:51.015288] [INFO ] [MAIN ] Update Progress: 2276/2372 symbols completed. WCC took 30.2s. Estimated remaining: 12m 46s. Rate: 7.5 symbols/min [2025-09-25T22:02:51.092711] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-25T22:02:51.205535] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:02:51.263032] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T22:02:51.294494] [DEBUG] [LOCAL ] WDH: Loaded 17223 existing records from primary storage. [2025-09-25T22:02:51.294688] [INFO ] [MAIN ] WDH: Loaded 17223 existing records. [2025-09-25T22:02:51.491300] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:02:51.492369] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-25T22:02:51.492557] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-25T22:02:51.493094] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-25T22:02:51.493155] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-25T22:02:51.671837] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-25T22:02:51.893743] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-25T22:02:51.936483] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:02:52.541585] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T22:02:52.688745] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-25T22:02:53.345181] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T22:02:53.488735] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-25T22:02:54.288798] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-25T22:02:54.744224] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-25T22:02:55.088749] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-25T22:02:55.616618] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T22:02:55.714335] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-25T22:02:55.728694] [INFO ] [REMOTE ] WCN: Full fetch complete (69427 records). [2025-09-25T22:02:55.728997] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-25T22:02:55.893931] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-25T22:02:55.931771] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-25T22:02:56.232589] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-25T22:02:56.232783] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-25T22:02:56.236892] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-25T22:02:56.237036] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-25T22:02:56.241344] [DEBUG] [LOCAL ] WCN: Trimmed 69427 records to 48385 (keeping 200 days of data) [2025-09-25T22:02:56.601881] [DEBUG] [LOCAL ] WCN: Primary data saved (48385 records). [2025-09-25T22:02:56.602083] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-25T22:02:56.603590] [INFO ] [MAIN ] Update Progress: 2277/2372 symbols completed. WCN took 34.0s. Estimated remaining: 12m 38s. Rate: 7.5 symbols/min [2025-09-25T22:02:56.688759] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-25T22:02:57.489302] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-25T22:02:57.543463] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-25T22:02:57.704945] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-25T22:02:58.288760] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-25T22:02:58.713505] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-25T22:02:59.088702] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-25T22:02:59.365963] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T22:02:59.888852] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-25T22:03:00.688731] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-25T22:03:00.862740] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-25T22:03:00.874358] [INFO ] [REMOTE ] WBS: Full fetch complete (69438 records). [2025-09-25T22:03:00.874607] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-25T22:03:00.979266] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T22:03:01.322322] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-25T22:03:01.322420] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-25T22:03:01.323620] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-25T22:03:01.323711] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-25T22:03:01.325342] [DEBUG] [LOCAL ] WBS: Trimmed 69438 records to 49117 (keeping 200 days of data) [2025-09-25T22:03:01.530294] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-25T22:03:01.664971] [DEBUG] [LOCAL ] WBS: Primary data saved (49117 records). [2025-09-25T22:03:01.665139] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-25T22:03:01.665293] [INFO ] [MAIN ] Update Progress: 2278/2372 symbols completed. WBS took 48.2s. Estimated remaining: 12m 30s. Rate: 7.5 symbols/min [2025-09-25T22:03:01.883446] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T22:03:02.288733] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-25T22:03:02.413883] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-25T22:03:03.088760] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-25T22:03:03.444988] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-25T22:03:03.450797] [INFO ] [REMOTE ] WD: Full fetch complete (32957 records). [2025-09-25T22:03:03.450920] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-25T22:03:03.847487] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-25T22:03:03.847594] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-25T22:03:03.848315] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-25T22:03:03.848379] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-25T22:03:03.849378] [DEBUG] [LOCAL ] WD: Trimmed 32957 records to 23615 (keeping 200 days of data) [2025-09-25T22:03:04.028458] [DEBUG] [LOCAL ] WD: Primary data saved (23615 records). [2025-09-25T22:03:04.028635] [INFO ] [MAIN ] WD: Full history saved. [2025-09-25T22:03:04.028898] [INFO ] [MAIN ] Update Progress: 2279/2372 symbols completed. WD took 27.9s. Estimated remaining: 12m 22s. Rate: 7.5 symbols/min [2025-09-25T22:03:04.066811] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-25T22:03:04.070493] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-25T22:03:05.276467] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-25T22:03:05.282120] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-25T22:03:07.127763] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T22:03:07.132237] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-25T22:03:08.590191] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-25T22:03:08.596859] [INFO ] [REMOTE ] WDH: Full fetch complete (23018 records). [2025-09-25T22:03:08.596993] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-25T22:03:09.033740] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-25T22:03:09.033839] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-25T22:03:09.034462] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-25T22:03:09.034514] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-25T22:03:09.036272] [DEBUG] [LOCAL ] WDH: Trimmed 23018 records to 17486 (keeping 200 days of data) [2025-09-25T22:03:09.145460] [DEBUG] [LOCAL ] WDH: Primary data saved (17486 records). [2025-09-25T22:03:09.145669] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-25T22:03:09.145863] [INFO ] [MAIN ] Update Progress: 2280/2372 symbols completed. WDH took 18.1s. Estimated remaining: 12m 14s. Rate: 7.5 symbols/min [2025-09-25T22:03:09.899219] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:09.897815] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:09.950342] [DEBUG] [LOCAL ] WEA: Loaded 7343 existing records from primary storage. [2025-09-25T22:03:09.950481] [INFO ] [MAIN ] WEA: Loaded 7343 existing records. [2025-09-25T22:03:10.018004] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:10.080564] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:10.105738] [DEBUG] [LOCAL ] WEAV: Loaded 41969 existing records from primary storage. [2025-09-25T22:03:10.105917] [INFO ] [MAIN ] WEAV: Loaded 41969 existing records. [2025-09-25T22:03:10.197312] [DEBUG] [LOCAL ] WDI: Loaded 21004 existing records from primary storage. [2025-09-25T22:03:10.197504] [INFO ] [MAIN ] WDI: Loaded 21004 existing records. [2025-09-25T22:03:10.263317] [DEBUG] [LOCAL ] WDS: Loaded 43599 existing records from primary storage. [2025-09-25T22:03:10.263475] [INFO ] [MAIN ] WDS: Loaded 43599 existing records. [2025-09-25T22:03:10.546092] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:10.561204] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-25T22:03:10.561270] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-25T22:03:10.566798] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-25T22:03:10.566872] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-25T22:03:11.019076] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:11.019356] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-25T22:03:11.019406] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-25T22:03:11.032916] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-25T22:03:11.033065] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-25T22:03:11.028765] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:11.042319] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-25T22:03:11.042384] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-25T22:03:11.050720] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-25T22:03:11.080868] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-25T22:03:11.212720] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:11.218942] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-25T22:03:11.219009] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-25T22:03:11.219270] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-25T22:03:11.219333] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-25T22:03:12.270213] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:12.270703] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-25T22:03:12.444095] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:12.450071] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-25T22:03:12.689535] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:12.690049] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-25T22:03:12.697781] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:12.698147] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-25T22:03:13.062260] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-25T22:03:13.065548] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-25T22:03:13.652839] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-25T22:03:13.658539] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-25T22:03:13.758821] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-25T22:03:13.760815] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-25T22:03:13.940864] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T22:03:13.950104] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-25T22:03:14.029567] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-25T22:03:14.039622] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-25T22:03:14.377508] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T22:03:14.379243] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-25T22:03:14.743016] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-25T22:03:14.747927] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-25T22:03:14.997004] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-25T22:03:15.088743] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-25T22:03:15.374346] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T22:03:15.576404] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-25T22:03:15.594879] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T22:03:15.618927] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-25T22:03:15.888736] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-25T22:03:16.688735] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-25T22:03:17.345007] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-25T22:03:17.488720] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-25T22:03:17.789965] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-25T22:03:18.288715] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-25T22:03:19.088691] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-25T22:03:19.189900] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-25T22:03:19.711237] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T22:03:19.888740] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-25T22:03:20.688741] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-25T22:03:20.949800] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-25T22:03:21.241939] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-25T22:03:21.488697] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-25T22:03:21.649871] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T22:03:22.163530] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-25T22:03:22.288718] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-25T22:03:23.088694] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-25T22:03:23.356406] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-25T22:03:23.888729] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-25T22:03:24.683232] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T22:03:24.688672] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-25T22:03:24.957594] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-25T22:03:25.424747] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-25T22:03:25.488795] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-25T22:03:26.288727] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-25T22:03:27.088715] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-25T22:03:27.383794] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T22:03:27.514901] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T22:03:27.524914] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-25T22:03:27.527221] [INFO ] [REMOTE ] WEA: Full fetch complete (9903 records). [2025-09-25T22:03:27.527302] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-25T22:03:27.895745] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-25T22:03:27.927606] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-25T22:03:27.931749] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-25T22:03:27.932137] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-25T22:03:27.932183] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-25T22:03:27.932914] [DEBUG] [LOCAL ] WEA: Trimmed 9903 records to 7359 (keeping 200 days of data) [2025-09-25T22:03:27.987593] [DEBUG] [LOCAL ] WEA: Primary data saved (7359 records). [2025-09-25T22:03:27.987810] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-25T22:03:27.987949] [INFO ] [MAIN ] Update Progress: 2281/2372 symbols completed. WEA took 18.8s. Estimated remaining: 12m 6s. Rate: 7.5 symbols/min [2025-09-25T22:03:28.179420] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:28.249580] [DEBUG] [LOCAL ] WEC: Loaded 52208 existing records from primary storage. [2025-09-25T22:03:28.249780] [INFO ] [MAIN ] WEC: Loaded 52208 existing records. [2025-09-25T22:03:28.435606] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:28.435892] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-25T22:03:28.435941] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-25T22:03:28.436267] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-25T22:03:28.436327] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-25T22:03:28.699741] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-25T22:03:28.814966] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:29.490099] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-25T22:03:29.505826] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-25T22:03:29.798599] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-25T22:03:30.288753] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-25T22:03:30.403547] [DEBUG] [REMOTE ] WDI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-25T22:03:30.403976] [WARN ] [REMOTE ] WDI: No data returned for month 2025-09 [2025-09-25T22:03:30.404949] [INFO ] [REMOTE ] WDI: Full fetch complete (28399 records). [2025-09-25T22:03:30.405054] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-25T22:03:30.405974] [FATAL] [VALIDATOR ] WDI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T22:03:30.406277] [FATAL] [MAIN ] WDI: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:03:30.406475] [WARN ] [MAIN ] WDI: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:03:30.406729] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-25T22:03:30.406817] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-25T22:03:30.406875] [INFO ] [LOCAL ] WDI: Starting deletion of derivative data. [2025-09-25T22:03:30.407410] [DEBUG] [LOCAL ] WDI: Deleted derivative data file. [2025-09-25T22:03:30.407515] [INFO ] [MAIN ] Update Progress: 2282/2372 symbols completed. WDI took 21.2s. Estimated remaining: 11m 58s. Rate: 7.5 symbols/min [2025-09-25T22:03:30.601218] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:30.688374] [DEBUG] [LOCAL ] WELL: Loaded 52356 existing records from primary storage. [2025-09-25T22:03:30.688537] [INFO ] [MAIN ] WELL: Loaded 52356 existing records. [2025-09-25T22:03:30.884906] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:30.885394] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-25T22:03:30.885444] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-25T22:03:30.885769] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-25T22:03:30.885832] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-25T22:03:31.092337] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-25T22:03:31.175462] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T22:03:31.354874] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:31.888721] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-25T22:03:32.688716] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-25T22:03:32.795527] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-25T22:03:33.501399] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-25T22:03:33.531127] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T22:03:34.233796] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T22:03:34.288742] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-25T22:03:34.953726] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T22:03:35.088715] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-25T22:03:35.854689] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T22:03:35.888673] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-25T22:03:36.455723] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T22:03:36.688763] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-25T22:03:37.488753] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-25T22:03:37.732774] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-25T22:03:38.016969] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-25T22:03:38.288735] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-25T22:03:39.109058] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T22:03:39.124760] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-25T22:03:39.888965] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-25T22:03:39.967492] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-25T22:03:40.688784] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-25T22:03:41.107228] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-25T22:03:41.156499] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T22:03:41.173540] [INFO ] [REMOTE ] WEAV: Full fetch complete (61489 records). [2025-09-25T22:03:41.174840] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-25T22:03:41.494783] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-25T22:03:41.678121] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-25T22:03:41.678235] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-25T22:03:41.679531] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-25T22:03:41.679678] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-25T22:03:41.681244] [DEBUG] [LOCAL ] WEAV: Trimmed 61489 records to 42256 (keeping 200 days of data) [2025-09-25T22:03:41.963067] [DEBUG] [LOCAL ] WEAV: Primary data saved (42256 records). [2025-09-25T22:03:41.963217] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-25T22:03:41.963377] [INFO ] [MAIN ] Update Progress: 2283/2372 symbols completed. WEAV took 32.8s. Estimated remaining: 11m 50s. Rate: 7.5 symbols/min [2025-09-25T22:03:42.183573] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:42.215370] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-25T22:03:42.287579] [DEBUG] [LOCAL ] WES: Loaded 48003 existing records from primary storage. [2025-09-25T22:03:42.287779] [INFO ] [MAIN ] WES: Loaded 48003 existing records. [2025-09-25T22:03:42.293922] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-25T22:03:42.489717] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:42.490443] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-25T22:03:42.490505] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-25T22:03:42.490928] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-25T22:03:42.491090] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-25T22:03:42.860802] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:43.088731] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-25T22:03:43.888773] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-25T22:03:44.431818] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-25T22:03:44.522024] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-25T22:03:44.688731] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-25T22:03:44.763100] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-25T22:03:45.458973] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-25T22:03:45.472782] [INFO ] [REMOTE ] WDS: Full fetch complete (64823 records). [2025-09-25T22:03:45.472979] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-25T22:03:45.490015] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-25T22:03:45.890060] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-25T22:03:45.890155] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-25T22:03:45.891255] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-25T22:03:45.891353] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-25T22:03:45.892968] [DEBUG] [LOCAL ] WDS: Trimmed 64823 records to 43934 (keeping 200 days of data) [2025-09-25T22:03:46.208306] [DEBUG] [LOCAL ] WDS: Primary data saved (43934 records). [2025-09-25T22:03:46.208549] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-25T22:03:46.208798] [INFO ] [MAIN ] Update Progress: 2284/2372 symbols completed. WDS took 37.1s. Estimated remaining: 11m 42s. Rate: 7.5 symbols/min [2025-09-25T22:03:46.294734] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-25T22:03:46.397723] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-25T22:03:46.485055] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:03:46.530371] [DEBUG] [LOCAL ] WEX: Loaded 35325 existing records from primary storage. [2025-09-25T22:03:46.530541] [INFO ] [MAIN ] WEX: Loaded 35325 existing records. [2025-09-25T22:03:46.734767] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:03:46.736209] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-25T22:03:46.736303] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-25T22:03:46.736778] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-25T22:03:46.736847] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-25T22:03:47.109767] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-25T22:03:47.118412] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:03:47.341488] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-25T22:03:47.888697] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-25T22:03:47.930294] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-25T22:03:48.533897] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-25T22:03:48.688746] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-25T22:03:49.273048] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T22:03:49.488739] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-25T22:03:50.288854] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-25T22:03:50.611400] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T22:03:51.088766] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-25T22:03:51.240590] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T22:03:51.888726] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-25T22:03:52.124933] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T22:03:52.562756] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-25T22:03:52.688739] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-25T22:03:53.488774] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-25T22:03:53.842013] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T22:03:54.068848] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T22:03:54.288756] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-25T22:03:55.088737] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-25T22:03:55.312381] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-25T22:03:55.401020] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-25T22:03:55.888750] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-25T22:03:56.688729] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-25T22:03:56.902911] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-25T22:03:57.488748] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-25T22:03:57.547663] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-25T22:03:58.288736] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-25T22:03:58.442413] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T22:03:59.088720] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-25T22:03:59.280112] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-25T22:03:59.850265] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-25T22:03:59.888744] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-25T22:04:00.688694] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-25T22:04:00.733669] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-25T22:04:01.488726] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-25T22:04:02.033221] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-25T22:04:02.294737] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-25T22:04:02.313166] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T22:04:02.337797] [INFO ] [REMOTE ] WELL: Full fetch complete (75731 records). [2025-09-25T22:04:02.338045] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-25T22:04:02.364917] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-25T22:04:02.802949] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-25T22:04:02.803066] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-25T22:04:02.804391] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-25T22:04:02.804560] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-25T22:04:02.808501] [DEBUG] [LOCAL ] WELL: Trimmed 75731 records to 52744 (keeping 200 days of data) [2025-09-25T22:04:03.119378] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-25T22:04:03.173143] [DEBUG] [LOCAL ] WELL: Primary data saved (52744 records). [2025-09-25T22:04:03.173294] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-25T22:04:03.174348] [INFO ] [MAIN ] Update Progress: 2285/2372 symbols completed. WELL took 32.8s. Estimated remaining: 11m 34s. Rate: 7.5 symbols/min [2025-09-25T22:04:03.356488] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:03.377272] [DEBUG] [LOCAL ] WF: Loaded 10830 existing records from primary storage. [2025-09-25T22:04:03.377435] [INFO ] [MAIN ] WF: Loaded 10830 existing records. [2025-09-25T22:04:03.574166] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:03.574761] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-25T22:04:03.574835] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-25T22:04:03.575148] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-25T22:04:03.575228] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-25T22:04:03.879146] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T22:04:03.889960] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-25T22:04:04.007000] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:04.498250] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T22:04:04.688762] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-25T22:04:05.022466] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-25T22:04:05.488729] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-25T22:04:06.264555] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:04:06.274832] [INFO ] [REMOTE ] WEC: Full fetch complete (75477 records). [2025-09-25T22:04:06.275002] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-25T22:04:06.297542] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-25T22:04:06.436245] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-25T22:04:06.757065] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-25T22:04:06.757171] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-25T22:04:06.758411] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-25T22:04:06.758487] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-25T22:04:06.760195] [DEBUG] [LOCAL ] WEC: Trimmed 75477 records to 52584 (keeping 200 days of data) [2025-09-25T22:04:07.096775] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-25T22:04:07.118992] [DEBUG] [LOCAL ] WEC: Primary data saved (52584 records). [2025-09-25T22:04:07.119157] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-25T22:04:07.119274] [INFO ] [MAIN ] Update Progress: 2286/2372 symbols completed. WEC took 39.1s. Estimated remaining: 11m 26s. Rate: 7.5 symbols/min [2025-09-25T22:04:07.216438] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-25T22:04:07.320524] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:07.377126] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-25T22:04:07.377287] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-25T22:04:07.562232] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:07.563097] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-25T22:04:07.563149] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-25T22:04:07.563409] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-25T22:04:07.563470] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-25T22:04:07.898410] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-25T22:04:07.952004] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:08.532400] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T22:04:08.688732] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-25T22:04:09.488699] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-25T22:04:09.649910] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T22:04:10.204929] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-25T22:04:10.288683] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-25T22:04:10.672302] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-25T22:04:10.801477] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-25T22:04:11.088731] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-25T22:04:11.888737] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-25T22:04:12.688724] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-25T22:04:12.791807] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-25T22:04:12.962923] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T22:04:13.488728] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-25T22:04:13.696429] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T22:04:14.138195] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-25T22:04:14.288722] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-25T22:04:15.088725] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-25T22:04:15.889122] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-25T22:04:16.174917] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-25T22:04:16.305027] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-25T22:04:16.311506] [INFO ] [REMOTE ] WEX: Full fetch complete (50836 records). [2025-09-25T22:04:16.311635] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-25T22:04:16.701737] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-25T22:04:16.771389] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-25T22:04:16.771481] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-25T22:04:16.772478] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-25T22:04:16.772544] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-25T22:04:16.774377] [DEBUG] [LOCAL ] WEX: Trimmed 50836 records to 35516 (keeping 200 days of data) [2025-09-25T22:04:16.993363] [DEBUG] [LOCAL ] WEX: Primary data saved (35516 records). [2025-09-25T22:04:16.993548] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-25T22:04:16.993677] [INFO ] [MAIN ] Update Progress: 2287/2372 symbols completed. WEX took 30.8s. Estimated remaining: 11m 18s. Rate: 7.5 symbols/min [2025-09-25T22:04:17.181394] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:17.213933] [DEBUG] [LOCAL ] WFG: Loaded 24893 existing records from primary storage. [2025-09-25T22:04:17.214086] [INFO ] [MAIN ] WFG: Loaded 24893 existing records. [2025-09-25T22:04:17.410685] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:17.411068] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-25T22:04:17.411123] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-25T22:04:17.411392] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-25T22:04:17.411453] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-25T22:04:17.488758] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-25T22:04:17.492909] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-25T22:04:17.783344] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-25T22:04:17.793606] [INFO ] [REMOTE ] WES: Full fetch complete (69812 records). [2025-09-25T22:04:17.793867] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-25T22:04:18.231443] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:18.294721] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-25T22:04:18.749359] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-25T22:04:18.749497] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-25T22:04:18.751036] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-25T22:04:18.751126] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-25T22:04:18.754066] [DEBUG] [LOCAL ] WES: Trimmed 69812 records to 48352 (keeping 200 days of data) [2025-09-25T22:04:19.089899] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-25T22:04:19.105551] [DEBUG] [LOCAL ] WES: Primary data saved (48352 records). [2025-09-25T22:04:19.105726] [INFO ] [MAIN ] WES: Full history saved. [2025-09-25T22:04:19.106759] [INFO ] [MAIN ] Update Progress: 2288/2372 symbols completed. WES took 37.1s. Estimated remaining: 11m 10s. Rate: 7.5 symbols/min [2025-09-25T22:04:19.230765] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-25T22:04:19.327110] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:19.382747] [DEBUG] [LOCAL ] WGO: Loaded 39309 existing records from primary storage. [2025-09-25T22:04:19.382915] [INFO ] [MAIN ] WGO: Loaded 39309 existing records. [2025-09-25T22:04:19.650302] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-25T22:04:19.646901] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:19.661502] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-25T22:04:19.661865] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-25T22:04:19.662117] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-25T22:04:19.662191] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-25T22:04:19.780895] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-25T22:04:19.896708] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-25T22:04:20.102887] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:20.688717] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-25T22:04:21.488726] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-25T22:04:21.992426] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-25T22:04:22.258385] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-25T22:04:22.281945] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T22:04:22.288683] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-25T22:04:23.088747] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-25T22:04:23.817796] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-25T22:04:23.888745] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-25T22:04:24.334885] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-25T22:04:24.688824] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-25T22:04:25.110929] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T22:04:25.488741] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-25T22:04:25.974373] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T22:04:26.288749] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-25T22:04:27.045722] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T22:04:27.048066] [INFO ] [REMOTE ] WF: Full fetch complete (16541 records). [2025-09-25T22:04:27.048145] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-25T22:04:27.093862] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-25T22:04:27.479039] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-25T22:04:27.479155] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-25T22:04:27.479724] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-25T22:04:27.479791] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-25T22:04:27.480503] [DEBUG] [LOCAL ] WF: Trimmed 16541 records to 10863 (keeping 200 days of data) [2025-09-25T22:04:27.557820] [DEBUG] [LOCAL ] WF: Primary data saved (10863 records). [2025-09-25T22:04:27.557983] [INFO ] [MAIN ] WF: Full history saved. [2025-09-25T22:04:27.558081] [INFO ] [MAIN ] Update Progress: 2289/2372 symbols completed. WF took 24.4s. Estimated remaining: 11m 2s. Rate: 7.5 symbols/min [2025-09-25T22:04:27.782476] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:27.818543] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-25T22:04:27.867307] [DEBUG] [LOCAL ] WH: Loaded 45708 existing records from primary storage. [2025-09-25T22:04:27.867477] [INFO ] [MAIN ] WH: Loaded 45708 existing records. [2025-09-25T22:04:27.893352] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-25T22:04:28.075369] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:28.075943] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-25T22:04:28.076003] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-25T22:04:28.076262] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-25T22:04:28.076323] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-25T22:04:28.460012] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:28.548283] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-25T22:04:28.688724] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-25T22:04:29.488742] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-25T22:04:29.815500] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-25T22:04:29.930789] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-25T22:04:30.288754] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-25T22:04:30.729391] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T22:04:31.088722] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-25T22:04:31.888835] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-25T22:04:32.112763] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T22:04:32.318225] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-25T22:04:32.688812] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-25T22:04:33.488888] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-25T22:04:33.741013] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T22:04:34.253945] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-25T22:04:34.288684] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-25T22:04:34.735457] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T22:04:35.088749] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-25T22:04:35.732846] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T22:04:35.888737] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-25T22:04:36.416033] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-25T22:04:36.688798] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-25T22:04:37.488820] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-25T22:04:37.670868] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T22:04:37.737919] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T22:04:38.288827] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-25T22:04:38.842021] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-25T22:04:39.088761] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-25T22:04:39.699088] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T22:04:39.793398] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T22:04:39.888687] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-25T22:04:40.688879] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-25T22:04:41.036526] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T22:04:41.488815] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-25T22:04:41.960091] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-25T22:04:42.288722] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-25T22:04:42.466730] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-25T22:04:43.088797] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-25T22:04:43.899680] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-25T22:04:43.929913] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T22:04:44.680939] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:04:44.690675] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-25T22:04:44.700529] [INFO ] [REMOTE ] WFC: Full fetch complete (77791 records). [2025-09-25T22:04:44.700817] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-25T22:04:44.804266] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T22:04:45.184743] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-25T22:04:45.184908] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-25T22:04:45.186740] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-25T22:04:45.186869] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-25T22:04:45.189219] [DEBUG] [LOCAL ] WFC: Trimmed 77791 records to 54138 (keeping 200 days of data) [2025-09-25T22:04:45.518479] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-25T22:04:45.572509] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-25T22:04:45.611811] [DEBUG] [LOCAL ] WFC: Primary data saved (54138 records). [2025-09-25T22:04:45.612073] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-25T22:04:45.612381] [INFO ] [MAIN ] Update Progress: 2290/2372 symbols completed. WFC took 38.5s. Estimated remaining: 10m 55s. Rate: 7.5 symbols/min [2025-09-25T22:04:45.791588] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:45.852032] [DEBUG] [LOCAL ] WHD: Loaded 40532 existing records from primary storage. [2025-09-25T22:04:45.852255] [INFO ] [MAIN ] WHD: Loaded 40532 existing records. [2025-09-25T22:04:46.042107] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:46.042943] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-25T22:04:46.043026] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-25T22:04:46.043565] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-25T22:04:46.043688] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-25T22:04:46.300816] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-25T22:04:46.442883] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:47.088736] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-25T22:04:47.179970] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T22:04:47.889234] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-25T22:04:47.889078] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-25T22:04:47.999695] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T22:04:48.005944] [INFO ] [REMOTE ] WFG: Full fetch complete (35851 records). [2025-09-25T22:04:48.006079] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-25T22:04:48.390397] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-25T22:04:48.390514] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-25T22:04:48.391462] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-25T22:04:48.391528] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-25T22:04:48.392743] [DEBUG] [LOCAL ] WFG: Trimmed 35851 records to 25074 (keeping 200 days of data) [2025-09-25T22:04:48.568615] [DEBUG] [LOCAL ] WFG: Primary data saved (25074 records). [2025-09-25T22:04:48.568832] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-25T22:04:48.569036] [INFO ] [MAIN ] Update Progress: 2291/2372 symbols completed. WFG took 31.6s. Estimated remaining: 10m 46s. Rate: 7.5 symbols/min [2025-09-25T22:04:48.694756] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-25T22:04:48.757166] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:48.768899] [DEBUG] [LOCAL ] WHG: Loaded 3384 existing records from primary storage. [2025-09-25T22:04:48.769039] [INFO ] [MAIN ] WHG: Loaded 3384 existing records. [2025-09-25T22:04:48.968115] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:48.968435] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-25T22:04:48.968486] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-25T22:04:48.968857] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-25T22:04:48.968921] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-25T22:04:49.293315] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T22:04:49.400890] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:49.488787] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-25T22:04:50.186430] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-25T22:04:50.194083] [INFO ] [REMOTE ] WGO: Full fetch complete (57376 records). [2025-09-25T22:04:50.194280] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-25T22:04:50.293955] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-25T22:04:50.665682] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-25T22:04:50.665830] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-25T22:04:50.667736] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-25T22:04:50.667821] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-25T22:04:50.669734] [DEBUG] [LOCAL ] WGO: Trimmed 57376 records to 39576 (keeping 200 days of data) [2025-09-25T22:04:50.694595] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-25T22:04:50.973698] [DEBUG] [LOCAL ] WGO: Primary data saved (39576 records). [2025-09-25T22:04:50.973900] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-25T22:04:50.974149] [INFO ] [MAIN ] Update Progress: 2292/2372 symbols completed. WGO took 31.9s. Estimated remaining: 10m 38s. Rate: 7.5 symbols/min [2025-09-25T22:04:51.093791] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-25T22:04:51.165709] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:51.232759] [DEBUG] [LOCAL ] WHR: Loaded 48110 existing records from primary storage. [2025-09-25T22:04:51.232946] [INFO ] [MAIN ] WHR: Loaded 48110 existing records. [2025-09-25T22:04:51.415295] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:51.415747] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-25T22:04:51.415804] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-25T22:04:51.416863] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-25T22:04:51.416928] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-25T22:04:51.778683] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:51.856354] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T22:04:51.888732] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-25T22:04:52.418442] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-25T22:04:52.537186] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-25T22:04:52.688764] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-25T22:04:53.488744] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-25T22:04:54.288780] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-25T22:04:54.342806] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T22:04:54.601014] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T22:04:54.611137] [INFO ] [REMOTE ] WH: Full fetch complete (64962 records). [2025-09-25T22:04:54.611287] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-25T22:04:54.787012] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T22:04:55.037184] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-25T22:04:55.037289] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-25T22:04:55.038434] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-25T22:04:55.038502] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-25T22:04:55.039977] [DEBUG] [LOCAL ] WH: Trimmed 64962 records to 46030 (keeping 200 days of data) [2025-09-25T22:04:55.103754] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-25T22:04:55.360662] [DEBUG] [LOCAL ] WH: Primary data saved (46030 records). [2025-09-25T22:04:55.360855] [INFO ] [MAIN ] WH: Full history saved. [2025-09-25T22:04:55.360993] [INFO ] [MAIN ] Update Progress: 2293/2372 symbols completed. WH took 27.8s. Estimated remaining: 10m 30s. Rate: 7.5 symbols/min [2025-09-25T22:04:55.540342] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:04:55.550684] [DEBUG] [LOCAL ] WIA: Loaded 4865 existing records from primary storage. [2025-09-25T22:04:55.550879] [INFO ] [MAIN ] WIA: Loaded 4865 existing records. [2025-09-25T22:04:55.751179] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:04:55.751529] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-25T22:04:55.751579] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-25T22:04:55.751848] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-25T22:04:55.751911] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-25T22:04:55.899733] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-25T22:04:56.148618] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:04:56.628762] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T22:04:56.688747] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-25T22:04:56.902018] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T22:04:57.283701] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-25T22:04:57.488752] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-25T22:04:58.161725] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-25T22:04:58.288751] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-25T22:04:58.811863] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-25T22:04:59.088746] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-25T22:04:59.888790] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-25T22:05:00.504810] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-25T22:05:00.688744] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-25T22:05:00.824955] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T22:05:01.349241] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-25T22:05:01.488774] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-25T22:05:02.288779] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-25T22:05:03.088719] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-25T22:05:03.119512] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T22:05:03.817891] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-25T22:05:03.888698] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-25T22:05:03.930216] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-25T22:05:04.688778] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-25T22:05:05.311110] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-25T22:05:05.429614] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T22:05:05.488714] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-25T22:05:06.288765] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-25T22:05:07.022316] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-25T22:05:07.088720] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-25T22:05:07.623692] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T22:05:07.888752] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-25T22:05:08.563015] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-25T22:05:08.688761] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-25T22:05:08.755820] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T22:05:09.372591] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-25T22:05:09.488724] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-25T22:05:10.126147] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-25T22:05:10.288802] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-25T22:05:10.912917] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-25T22:05:11.088798] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-25T22:05:11.687383] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-25T22:05:11.888766] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-25T22:05:12.494118] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-25T22:05:12.688742] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-25T22:05:13.170760] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-25T22:05:13.488803] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-25T22:05:14.288928] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-25T22:05:15.088801] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-25T22:05:15.321197] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-25T22:05:15.888811] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-25T22:05:15.990227] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-25T22:05:15.991613] [INFO ] [REMOTE ] WHG: Full fetch complete (4652 records). [2025-09-25T22:05:15.993785] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-25T22:05:16.014190] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T22:05:16.040505] [INFO ] [REMOTE ] WHD: Full fetch complete (57269 records). [2025-09-25T22:05:16.040687] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-25T22:05:16.695809] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-25T22:05:16.933552] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-25T22:05:16.939690] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-25T22:05:16.939865] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-25T22:05:16.955702] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-25T22:05:16.956108] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-25T22:05:16.956221] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-25T22:05:16.957339] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-25T22:05:16.957423] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-25T22:05:16.959494] [DEBUG] [LOCAL ] WHG: Trimmed 4652 records to 3397 (keeping 200 days of data) [2025-09-25T22:05:16.973542] [DEBUG] [LOCAL ] WHD: Trimmed 57269 records to 40871 (keeping 200 days of data) [2025-09-25T22:05:16.998506] [DEBUG] [LOCAL ] WHG: Primary data saved (3397 records). [2025-09-25T22:05:16.998771] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-25T22:05:16.998984] [INFO ] [MAIN ] Update Progress: 2294/2372 symbols completed. WHG took 28.4s. Estimated remaining: 10m 23s. Rate: 7.5 symbols/min [2025-09-25T22:05:17.435681] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:17.496838] [DEBUG] [LOCAL ] WHD: Primary data saved (40871 records). [2025-09-25T22:05:17.497003] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-25T22:05:17.497146] [INFO ] [MAIN ] Update Progress: 2295/2372 symbols completed. WHD took 31.9s. Estimated remaining: 10m 14s. Rate: 7.5 symbols/min [2025-09-25T22:05:17.517252] [DEBUG] [LOCAL ] WINN: Loaded 11834 existing records from primary storage. [2025-09-25T22:05:17.517426] [INFO ] [MAIN ] WINN: Loaded 11834 existing records. [2025-09-25T22:05:17.612398] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-25T22:05:17.667805] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-25T22:05:17.717780] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-25T22:05:17.973639] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:17.993804] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:17.994218] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-25T22:05:17.994277] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-25T22:05:17.994582] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-25T22:05:17.998090] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-25T22:05:18.094585] [DEBUG] [LOCAL ] WIT: Loaded 52291 existing records from primary storage. [2025-09-25T22:05:18.101461] [INFO ] [MAIN ] WIT: Loaded 52291 existing records. [2025-09-25T22:05:18.292816] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-25T22:05:18.359239] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-25T22:05:18.367605] [INFO ] [REMOTE ] WIA: Full fetch complete (7290 records). [2025-09-25T22:05:18.378239] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-25T22:05:18.578262] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:18.578544] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-25T22:05:18.605160] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-25T22:05:18.605509] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-25T22:05:18.605571] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-25T22:05:18.981122] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:19.096857] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-25T22:05:19.552419] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-25T22:05:19.552552] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-25T22:05:19.552846] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-25T22:05:19.552922] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-25T22:05:19.553558] [DEBUG] [LOCAL ] WIA: Trimmed 7290 records to 4901 (keeping 200 days of data) [2025-09-25T22:05:19.593047] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:19.602953] [DEBUG] [LOCAL ] WIA: Primary data saved (4901 records). [2025-09-25T22:05:19.603075] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-25T22:05:19.603205] [INFO ] [MAIN ] Update Progress: 2296/2372 symbols completed. WIA took 24.2s. Estimated remaining: 10m 6s. Rate: 7.5 symbols/min [2025-09-25T22:05:19.793973] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:19.821699] [DEBUG] [LOCAL ] WIW: Loaded 20625 existing records from primary storage. [2025-09-25T22:05:19.821858] [INFO ] [MAIN ] WIW: Loaded 20625 existing records. [2025-09-25T22:05:19.889403] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-25T22:05:20.001436] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-25T22:05:20.046902] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:20.047187] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-25T22:05:20.047234] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-25T22:05:20.047580] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-25T22:05:20.047789] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-25T22:05:20.498337] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:20.530605] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-25T22:05:20.688732] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-25T22:05:21.489083] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-25T22:05:21.540738] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-25T22:05:21.876877] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-25T22:05:22.288714] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-25T22:05:22.468889] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-25T22:05:23.088707] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-25T22:05:23.454739] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-25T22:05:23.888720] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-25T22:05:24.653972] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T22:05:24.688705] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-25T22:05:24.881020] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-25T22:05:25.488774] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-25T22:05:26.288781] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-25T22:05:26.572162] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T22:05:26.646234] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-25T22:05:27.088727] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-25T22:05:27.856018] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T22:05:27.888714] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-25T22:05:27.994572] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-25T22:05:28.688702] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-25T22:05:28.863688] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-25T22:05:29.488757] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-25T22:05:30.288698] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-25T22:05:30.360218] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-25T22:05:30.543512] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-25T22:05:31.088788] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-25T22:05:31.888747] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-25T22:05:32.119274] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-25T22:05:32.147172] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T22:05:32.688782] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-25T22:05:33.488761] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-25T22:05:33.635258] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T22:05:33.645144] [INFO ] [REMOTE ] WHR: Full fetch complete (68490 records). [2025-09-25T22:05:33.645359] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-25T22:05:33.757432] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-25T22:05:34.098807] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-25T22:05:34.098957] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-25T22:05:34.100176] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-25T22:05:34.100248] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-25T22:05:34.101874] [DEBUG] [LOCAL ] WHR: Trimmed 68490 records to 48496 (keeping 200 days of data) [2025-09-25T22:05:34.325705] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-25T22:05:34.336058] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-25T22:05:34.476054] [DEBUG] [LOCAL ] WHR: Primary data saved (48496 records). [2025-09-25T22:05:34.476237] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-25T22:05:34.477764] [INFO ] [MAIN ] Update Progress: 2297/2372 symbols completed. WHR took 43.5s. Estimated remaining: 9m 59s. Rate: 7.5 symbols/min [2025-09-25T22:05:34.655442] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:34.719785] [DEBUG] [LOCAL ] WK: Loaded 36687 existing records from primary storage. [2025-09-25T22:05:34.719969] [INFO ] [MAIN ] WK: Loaded 36687 existing records. [2025-09-25T22:05:34.924082] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:34.924745] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-25T22:05:34.925298] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-25T22:05:34.925795] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-25T22:05:34.925879] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-25T22:05:35.093799] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-25T22:05:35.330157] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:35.757376] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T22:05:35.888714] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-25T22:05:36.221227] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T22:05:36.688744] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-25T22:05:37.488774] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-25T22:05:37.702669] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T22:05:38.068912] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T22:05:38.116678] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-25T22:05:38.121490] [INFO ] [REMOTE ] WIW: Full fetch complete (30293 records). [2025-09-25T22:05:38.121603] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-25T22:05:38.293850] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-25T22:05:38.557341] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-25T22:05:38.557446] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-25T22:05:38.558230] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-25T22:05:38.558298] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-25T22:05:38.559364] [DEBUG] [LOCAL ] WIW: Trimmed 30293 records to 20711 (keeping 200 days of data) [2025-09-25T22:05:38.701914] [DEBUG] [LOCAL ] WIW: Primary data saved (20711 records). [2025-09-25T22:05:38.702066] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-25T22:05:38.702155] [INFO ] [MAIN ] Update Progress: 2298/2372 symbols completed. WIW took 19.1s. Estimated remaining: 9m 50s. Rate: 7.5 symbols/min [2025-09-25T22:05:38.879684] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:38.938720] [DEBUG] [LOCAL ] WKC: Loaded 35109 existing records from primary storage. [2025-09-25T22:05:38.938935] [INFO ] [MAIN ] WKC: Loaded 35109 existing records. [2025-09-25T22:05:39.093851] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-25T22:05:39.127838] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:39.128178] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-25T22:05:39.128256] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-25T22:05:39.128546] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-25T22:05:39.128605] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-25T22:05:39.495702] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:39.888748] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-25T22:05:40.155976] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-25T22:05:40.176552] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-25T22:05:40.688720] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-25T22:05:41.469275] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T22:05:41.488683] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-25T22:05:41.598393] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-25T22:05:42.288801] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-25T22:05:42.666176] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T22:05:43.088718] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-25T22:05:43.553258] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-25T22:05:43.888749] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-25T22:05:44.676830] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-25T22:05:44.700909] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-25T22:05:44.703623] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-25T22:05:45.488742] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-25T22:05:45.506559] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-25T22:05:46.288752] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-25T22:05:47.087828] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-25T22:05:47.090909] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-25T22:05:47.278969] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-25T22:05:47.888746] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-25T22:05:48.094763] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-25T22:05:48.400048] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-25T22:05:48.404230] [INFO ] [REMOTE ] WINN: Full fetch complete (17692 records). [2025-09-25T22:05:48.404316] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-25T22:05:48.694810] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-25T22:05:48.814712] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-25T22:05:48.815078] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-25T22:05:48.815743] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-25T22:05:48.815853] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-25T22:05:48.817345] [DEBUG] [LOCAL ] WINN: Trimmed 17692 records to 11895 (keeping 200 days of data) [2025-09-25T22:05:48.905130] [DEBUG] [LOCAL ] WINN: Primary data saved (11895 records). [2025-09-25T22:05:48.905294] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-25T22:05:48.905480] [INFO ] [MAIN ] Update Progress: 2299/2372 symbols completed. WINN took 31.9s. Estimated remaining: 9m 43s. Rate: 7.5 symbols/min [2025-09-25T22:05:49.092009] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:49.163103] [DEBUG] [LOCAL ] WLK: Loaded 45404 existing records from primary storage. [2025-09-25T22:05:49.163389] [INFO ] [MAIN ] WLK: Loaded 45404 existing records. [2025-09-25T22:05:49.356741] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:49.357116] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-25T22:05:49.357167] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-25T22:05:49.358430] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-25T22:05:49.358516] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-25T22:05:49.494379] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-25T22:05:49.773158] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:50.291304] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-25T22:05:50.672893] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-25T22:05:50.711008] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-25T22:05:51.088783] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-25T22:05:51.888722] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-25T22:05:51.948988] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-25T22:05:52.601471] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T22:05:52.688694] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-25T22:05:53.488709] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-25T22:05:53.724211] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-25T22:05:53.911403] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-25T22:05:54.288810] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-25T22:05:54.825181] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-25T22:05:55.088918] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-25T22:05:55.888907] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-25T22:05:56.201193] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-25T22:05:56.213478] [INFO ] [REMOTE ] WIT: Full fetch complete (75584 records). [2025-09-25T22:05:56.213736] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-25T22:05:56.500826] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T22:05:56.700888] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-25T22:05:56.707254] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-25T22:05:56.707314] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-25T22:05:56.708680] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-25T22:05:56.708763] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-25T22:05:56.714115] [DEBUG] [LOCAL ] WIT: Trimmed 75584 records to 52681 (keeping 200 days of data) [2025-09-25T22:05:57.052822] [DEBUG] [LOCAL ] WIT: Primary data saved (52681 records). [2025-09-25T22:05:57.052993] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-25T22:05:57.053240] [INFO ] [MAIN ] Update Progress: 2300/2372 symbols completed. WIT took 39.6s. Estimated remaining: 9m 35s. Rate: 7.5 symbols/min [2025-09-25T22:05:57.256422] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T22:05:57.278796] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:05:57.293053] [DEBUG] [LOCAL ] WLKP: Loaded 6685 existing records from primary storage. [2025-09-25T22:05:57.293204] [INFO ] [MAIN ] WLKP: Loaded 6685 existing records. [2025-09-25T22:05:57.478915] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:05:57.479275] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-25T22:05:57.479356] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-25T22:05:57.479871] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-25T22:05:57.479936] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-25T22:05:57.492287] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-25T22:05:57.880549] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:05:58.289153] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-25T22:05:58.302494] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-25T22:05:59.012736] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-25T22:05:59.088933] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-25T22:05:59.091346] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T22:05:59.888766] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-25T22:06:00.568016] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-25T22:06:00.688753] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-25T22:06:01.450373] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T22:06:01.488787] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-25T22:06:02.190772] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-25T22:06:02.288718] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-25T22:06:02.758157] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-25T22:06:03.088705] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-25T22:06:03.191784] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T22:06:03.888741] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-25T22:06:04.271810] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-25T22:06:04.615979] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-25T22:06:04.688767] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-25T22:06:05.331176] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-25T22:06:05.488765] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-25T22:06:06.288746] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-25T22:06:06.351406] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-25T22:06:07.088715] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-25T22:06:07.515224] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-25T22:06:07.523818] [INFO ] [REMOTE ] WKC: Full fetch complete (51266 records). [2025-09-25T22:06:07.524036] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-25T22:06:07.897734] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-25T22:06:07.948123] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-25T22:06:07.948261] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-25T22:06:07.949665] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-25T22:06:07.949751] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-25T22:06:07.953048] [DEBUG] [LOCAL ] WKC: Trimmed 51266 records to 35324 (keeping 200 days of data) [2025-09-25T22:06:08.209638] [DEBUG] [LOCAL ] WKC: Primary data saved (35324 records). [2025-09-25T22:06:08.209867] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-25T22:06:08.210015] [INFO ] [MAIN ] Update Progress: 2301/2372 symbols completed. WKC took 29.5s. Estimated remaining: 9m 27s. Rate: 7.5 symbols/min [2025-09-25T22:06:08.399627] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:08.399849] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-25T22:06:08.399889] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-25T22:06:08.400061] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-25T22:06:08.400118] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-25T22:06:08.400185] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-25T22:06:08.400243] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-25T22:06:08.690804] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-25T22:06:08.753148] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-25T22:06:08.746765] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-25T22:06:08.861004] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:09.488786] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-25T22:06:10.252236] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-25T22:06:10.260454] [INFO ] [REMOTE ] WK: Full fetch complete (52140 records). [2025-09-25T22:06:10.260634] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-25T22:06:10.291348] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-25T22:06:10.709840] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-25T22:06:10.745395] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-25T22:06:10.745515] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-25T22:06:10.746672] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-25T22:06:10.746747] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-25T22:06:10.748282] [DEBUG] [LOCAL ] WK: Trimmed 52140 records to 37017 (keeping 200 days of data) [2025-09-25T22:06:11.020915] [DEBUG] [LOCAL ] WK: Primary data saved (37017 records). [2025-09-25T22:06:11.021116] [INFO ] [MAIN ] WK: Full history saved. [2025-09-25T22:06:11.021388] [INFO ] [MAIN ] Update Progress: 2302/2372 symbols completed. WK took 36.5s. Estimated remaining: 9m 19s. Rate: 7.5 symbols/min [2025-09-25T22:06:11.094765] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-25T22:06:11.227101] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:11.300598] [DEBUG] [LOCAL ] WLY: Loaded 30036 existing records from primary storage. [2025-09-25T22:06:11.300900] [INFO ] [MAIN ] WLY: Loaded 30036 existing records. [2025-09-25T22:06:11.438957] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-25T22:06:11.459208] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-25T22:06:11.614715] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:06:11.615579] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-25T22:06:11.615628] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-25T22:06:11.616053] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-25T22:06:11.616113] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-25T22:06:11.893866] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-25T22:06:12.032443] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:12.688749] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-25T22:06:12.776494] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T22:06:13.488761] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-25T22:06:14.041419] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T22:06:14.288741] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-25T22:06:15.096246] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-25T22:06:15.113964] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T22:06:15.496285] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-25T22:06:15.576164] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T22:06:15.888708] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-25T22:06:16.372848] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-25T22:06:16.688737] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-25T22:06:17.339462] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-25T22:06:17.488714] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-25T22:06:18.288709] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-25T22:06:18.324265] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-25T22:06:19.088727] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-25T22:06:19.464989] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-25T22:06:19.888735] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-25T22:06:20.180798] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-25T22:06:20.591631] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-25T22:06:20.688734] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-25T22:06:21.488729] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-25T22:06:22.096369] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-25T22:06:22.288776] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-25T22:06:22.950768] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-25T22:06:23.088728] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-25T22:06:23.316476] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T22:06:23.869511] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:06:23.872054] [INFO ] [REMOTE ] WLKP: Full fetch complete (10244 records). [2025-09-25T22:06:23.872132] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-25T22:06:23.893960] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-25T22:06:24.300876] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-25T22:06:24.301016] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-25T22:06:24.301374] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-25T22:06:24.301474] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-25T22:06:24.302067] [DEBUG] [LOCAL ] WLKP: Trimmed 10244 records to 6741 (keeping 200 days of data) [2025-09-25T22:06:24.354595] [DEBUG] [LOCAL ] WLKP: Primary data saved (6741 records). [2025-09-25T22:06:24.354797] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-25T22:06:24.354917] [INFO ] [MAIN ] Update Progress: 2303/2372 symbols completed. WLKP took 27.3s. Estimated remaining: 9m 11s. Rate: 7.5 symbols/min [2025-09-25T22:06:24.596730] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:24.664139] [DEBUG] [LOCAL ] WM: Loaded 50956 existing records from primary storage. [2025-09-25T22:06:24.664320] [INFO ] [MAIN ] WM: Loaded 50956 existing records. [2025-09-25T22:06:24.690523] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-25T22:06:24.873448] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:06:24.874132] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-25T22:06:24.874185] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-25T22:06:24.875329] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-25T22:06:24.875393] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-25T22:06:25.266329] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:25.488809] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-25T22:06:25.715138] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-25T22:06:25.837883] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-25T22:06:26.220619] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-25T22:06:26.288699] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-25T22:06:27.088719] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-25T22:06:27.665353] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T22:06:27.888786] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-25T22:06:28.174237] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-25T22:06:28.688736] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-25T22:06:28.831166] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T22:06:28.996545] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-25T22:06:29.488743] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-25T22:06:29.925107] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-25T22:06:30.288949] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-25T22:06:31.088731] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-25T22:06:31.523611] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-25T22:06:31.524516] [INFO ] [REMOTE ] WLTG: Full fetch complete (1674 records). [2025-09-25T22:06:31.524589] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-25T22:06:31.760130] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-25T22:06:31.760469] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:06:31.760544] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:06:31.760620] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-25T22:06:31.760770] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-25T22:06:31.760828] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-25T22:06:31.760874] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-25T22:06:31.761080] [INFO ] [MAIN ] Update Progress: 2304/2372 symbols completed. WLTG took 23.5s. Estimated remaining: 9m 3s. Rate: 7.5 symbols/min [2025-09-25T22:06:31.900794] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-25T22:06:31.960259] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-25T22:06:32.007335] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:32.008838] [INFO ] [REMOTE ] WLK: Full fetch complete (62821 records). [2025-09-25T22:06:32.009099] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-25T22:06:32.434691] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-25T22:06:32.442908] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-25T22:06:32.563705] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-25T22:06:32.564063] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-25T22:06:32.565495] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-25T22:06:32.565602] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-25T22:06:32.618805] [DEBUG] [LOCAL ] WLK: Trimmed 62821 records to 45752 (keeping 200 days of data) [2025-09-25T22:06:32.728725] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-25T22:06:32.813487] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:06:32.813983] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-25T22:06:32.815999] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-25T22:06:32.818014] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-25T22:06:32.818109] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-25T22:06:33.469741] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:33.475864] [DEBUG] [LOCAL ] WLK: Primary data saved (45752 records). [2025-09-25T22:06:33.476031] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-25T22:06:33.476172] [INFO ] [MAIN ] Update Progress: 2305/2372 symbols completed. WLK took 44.6s. Estimated remaining: 8m 55s. Rate: 7.5 symbols/min [2025-09-25T22:06:33.535054] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-25T22:06:33.534981] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T22:06:33.699966] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:33.721988] [DEBUG] [LOCAL ] WMK: Loaded 14531 existing records from primary storage. [2025-09-25T22:06:33.722187] [INFO ] [MAIN ] WMK: Loaded 14531 existing records. [2025-09-25T22:06:33.907199] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:06:33.908409] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-25T22:06:33.908459] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-25T22:06:33.908775] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-25T22:06:33.908835] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-25T22:06:34.292676] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-25T22:06:34.299689] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:34.911312] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-25T22:06:35.088724] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-25T22:06:35.434612] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-25T22:06:35.507756] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-25T22:06:35.888780] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-25T22:06:36.595117] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-25T22:06:36.688693] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-25T22:06:37.210786] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-25T22:06:37.315875] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-25T22:06:37.488768] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-25T22:06:38.249764] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-25T22:06:38.288707] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-25T22:06:39.088810] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-25T22:06:39.301359] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-25T22:06:39.888721] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-25T22:06:40.688857] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-25T22:06:40.975037] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-25T22:06:41.158436] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-25T22:06:41.488849] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-25T22:06:42.018316] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-25T22:06:42.024590] [INFO ] [REMOTE ] WLY: Full fetch complete (43085 records). [2025-09-25T22:06:42.024765] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-25T22:06:42.294746] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-25T22:06:42.489317] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-25T22:06:42.489469] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-25T22:06:42.491224] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-25T22:06:42.491306] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-25T22:06:42.492843] [DEBUG] [LOCAL ] WLY: Trimmed 43085 records to 30208 (keeping 200 days of data) [2025-09-25T22:06:42.652054] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T22:06:42.775231] [DEBUG] [LOCAL ] WLY: Primary data saved (30208 records). [2025-09-25T22:06:42.775453] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-25T22:06:42.775691] [INFO ] [MAIN ] Update Progress: 2306/2372 symbols completed. WLY took 31.8s. Estimated remaining: 8m 47s. Rate: 7.5 symbols/min [2025-09-25T22:06:42.976862] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:06:43.043545] [DEBUG] [LOCAL ] WMS: Loaded 39665 existing records from primary storage. [2025-09-25T22:06:43.043794] [INFO ] [MAIN ] WMS: Loaded 39665 existing records. [2025-09-25T22:06:43.102738] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-25T22:06:43.244471] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:06:43.245062] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-25T22:06:43.245139] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-25T22:06:43.245612] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-25T22:06:43.245713] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-25T22:06:43.625188] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:06:43.888815] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-25T22:06:44.320233] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-25T22:06:44.690370] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-25T22:06:45.038963] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-25T22:06:45.491066] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-25T22:06:45.504286] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-25T22:06:45.652000] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T22:06:46.288799] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-25T22:06:47.088790] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-25T22:06:47.481047] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T22:06:47.574837] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-25T22:06:47.888721] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-25T22:06:48.077421] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-25T22:06:48.688716] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-25T22:06:49.488718] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-25T22:06:50.189131] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-25T22:06:50.216422] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-25T22:06:50.288676] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-25T22:06:51.088709] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-25T22:06:51.481012] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T22:06:51.878323] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T22:06:51.890340] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-25T22:06:52.655508] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-25T22:06:52.688684] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-25T22:06:53.488701] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-25T22:06:53.820624] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T22:06:54.212831] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T22:06:54.288734] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-25T22:06:54.467807] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-25T22:06:55.088724] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-25T22:06:55.665264] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T22:06:55.888741] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-25T22:06:56.688711] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-25T22:06:57.119780] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-25T22:06:57.460484] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-25T22:06:57.488699] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-25T22:06:58.288759] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-25T22:06:58.726829] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-25T22:06:58.818076] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T22:06:59.088738] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-25T22:06:59.368692] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T22:06:59.372242] [INFO ] [REMOTE ] WMK: Full fetch complete (19438 records). [2025-09-25T22:06:59.372354] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-25T22:06:59.756959] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-25T22:06:59.757138] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-25T22:06:59.757698] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-25T22:06:59.757860] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-25T22:06:59.758536] [DEBUG] [LOCAL ] WMK: Trimmed 19438 records to 14634 (keeping 200 days of data) [2025-09-25T22:06:59.866138] [DEBUG] [LOCAL ] WMK: Primary data saved (14634 records). [2025-09-25T22:06:59.866306] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-25T22:06:59.866446] [INFO ] [MAIN ] Update Progress: 2307/2372 symbols completed. WMK took 26.4s. Estimated remaining: 8m 39s. Rate: 7.5 symbols/min [2025-09-25T22:06:59.898741] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-25T22:07:00.075535] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:00.148706] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-25T22:07:00.148913] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-09-25T22:07:00.351272] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:00.351739] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-25T22:07:00.351813] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-25T22:07:00.352171] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-25T22:07:00.352254] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-25T22:07:00.694757] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-25T22:07:00.742207] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:01.058327] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-25T22:07:01.488752] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-25T22:07:01.936683] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-25T22:07:02.039983] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T22:07:02.264629] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:07:02.279701] [INFO ] [REMOTE ] WM: Full fetch complete (73793 records). [2025-09-25T22:07:02.279930] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-25T22:07:02.289409] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-25T22:07:02.717895] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-25T22:07:02.718018] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-25T22:07:02.719240] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-25T22:07:02.719338] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-25T22:07:02.721776] [DEBUG] [LOCAL ] WM: Trimmed 73793 records to 51342 (keeping 200 days of data) [2025-09-25T22:07:03.076757] [DEBUG] [LOCAL ] WM: Primary data saved (51342 records). [2025-09-25T22:07:03.077205] [INFO ] [MAIN ] WM: Full history saved. [2025-09-25T22:07:03.077414] [INFO ] [MAIN ] Update Progress: 2308/2372 symbols completed. WM took 38.7s. Estimated remaining: 8m 31s. Rate: 7.5 symbols/min [2025-09-25T22:07:03.093912] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-25T22:07:03.278817] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:03.335156] [DEBUG] [LOCAL ] WNC: Loaded 40028 existing records from primary storage. [2025-09-25T22:07:03.335326] [INFO ] [MAIN ] WNC: Loaded 40028 existing records. [2025-09-25T22:07:03.523933] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:03.524602] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-25T22:07:03.524679] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-25T22:07:03.525511] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-25T22:07:03.525586] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-25T22:07:03.897787] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-25T22:07:03.905356] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:04.443480] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-25T22:07:04.688973] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-25T22:07:05.488731] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-25T22:07:05.555230] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-25T22:07:05.567544] [INFO ] [REMOTE ] WMS: Full fetch complete (57318 records). [2025-09-25T22:07:05.567797] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-25T22:07:05.907752] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-25T22:07:05.921836] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.83 seconds). [2025-09-25T22:07:06.113471] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-25T22:07:06.113592] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-25T22:07:06.114875] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-25T22:07:06.114956] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-25T22:07:06.120829] [DEBUG] [LOCAL ] WMS: Trimmed 57318 records to 39993 (keeping 200 days of data) [2025-09-25T22:07:06.328353] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-25T22:07:06.412406] [DEBUG] [LOCAL ] WMS: Primary data saved (39993 records). [2025-09-25T22:07:06.412567] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-25T22:07:06.412765] [INFO ] [MAIN ] Update Progress: 2309/2372 symbols completed. WMS took 23.6s. Estimated remaining: 8m 23s. Rate: 7.5 symbols/min [2025-09-25T22:07:06.589676] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:06.644580] [DEBUG] [LOCAL ] WNS: Loaded 40001 existing records from primary storage. [2025-09-25T22:07:06.644762] [INFO ] [MAIN ] WNS: Loaded 40001 existing records. [2025-09-25T22:07:06.908011] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:06.909491] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-25T22:07:06.909549] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-25T22:07:06.909844] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-25T22:07:06.909903] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-25T22:07:07.098873] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-25T22:07:07.338681] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:07.376828] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T22:07:07.888773] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-25T22:07:07.978425] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-25T22:07:08.688834] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-25T22:07:09.238860] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-25T22:07:09.488769] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-25T22:07:09.810037] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T22:07:09.856082] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-25T22:07:10.288737] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-25T22:07:11.088708] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-25T22:07:11.258620] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T22:07:11.797373] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T22:07:11.888771] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-25T22:07:12.565565] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-25T22:07:12.666952] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:07:12.678695] [INFO ] [REMOTE ] WMB: Full fetch complete (77690 records). [2025-09-25T22:07:12.678928] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-25T22:07:12.693905] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-25T22:07:13.127386] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-25T22:07:13.127526] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-25T22:07:13.129916] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-25T22:07:13.129995] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-25T22:07:13.132112] [DEBUG] [LOCAL ] WMB: Trimmed 77690 records to 54061 (keeping 200 days of data) [2025-09-25T22:07:13.496757] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-25T22:07:13.526783] [DEBUG] [LOCAL ] WMB: Primary data saved (54061 records). [2025-09-25T22:07:13.527036] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-25T22:07:13.527351] [INFO ] [MAIN ] Update Progress: 2310/2372 symbols completed. WMB took 41.8s. Estimated remaining: 8m 15s. Rate: 7.5 symbols/min [2025-09-25T22:07:13.718873] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:13.788332] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-25T22:07:13.788542] [INFO ] [MAIN ] WOLF: Loaded 53532 existing records. [2025-09-25T22:07:13.990730] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:13.992380] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-25T22:07:13.992483] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-25T22:07:13.993063] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-25T22:07:13.993148] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-25T22:07:14.296852] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-25T22:07:14.449717] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:15.088742] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-25T22:07:15.311684] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-25T22:07:15.396998] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-25T22:07:15.482209] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T22:07:15.888703] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-25T22:07:16.688713] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-25T22:07:17.493825] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-25T22:07:17.514158] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-25T22:07:18.288701] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-25T22:07:18.428741] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T22:07:18.696442] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-09-25T22:07:18.946173] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-25T22:07:19.088741] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-25T22:07:19.888736] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-25T22:07:20.541259] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-25T22:07:20.688884] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-25T22:07:20.696328] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-25T22:07:21.488738] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-25T22:07:22.226266] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-25T22:07:22.288722] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-25T22:07:22.590816] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-25T22:07:23.088795] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-25T22:07:23.749683] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-25T22:07:23.809000] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-25T22:07:23.888766] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-25T22:07:24.678358] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-25T22:07:24.690050] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-25T22:07:25.199198] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-25T22:07:25.205124] [INFO ] [REMOTE ] WNC: Full fetch complete (57502 records). [2025-09-25T22:07:25.205242] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-25T22:07:25.494043] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-25T22:07:25.653341] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-25T22:07:25.653453] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-25T22:07:25.654906] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-25T22:07:25.654971] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-25T22:07:25.656467] [DEBUG] [LOCAL ] WNC: Trimmed 57502 records to 40262 (keeping 200 days of data) [2025-09-25T22:07:25.913094] [DEBUG] [LOCAL ] WNC: Primary data saved (40262 records). [2025-09-25T22:07:25.913271] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-25T22:07:25.913437] [INFO ] [MAIN ] Update Progress: 2311/2372 symbols completed. WNC took 22.8s. Estimated remaining: 8m 7s. Rate: 7.5 symbols/min [2025-09-25T22:07:26.091213] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:26.125505] [DEBUG] [LOCAL ] WOR: Loaded 24727 existing records from primary storage. [2025-09-25T22:07:26.125738] [INFO ] [MAIN ] WOR: Loaded 24727 existing records. [2025-09-25T22:07:26.311373] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:26.312036] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-25T22:07:26.312099] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-25T22:07:26.312452] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-25T22:07:26.312512] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-25T22:07:26.306753] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-25T22:07:26.707047] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:27.093835] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-25T22:07:27.118534] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-25T22:07:27.817310] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-25T22:07:27.888748] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-25T22:07:27.961152] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-25T22:07:28.334549] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T22:07:28.688741] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-25T22:07:29.488798] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-25T22:07:30.288764] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-25T22:07:30.463559] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.57 seconds). [2025-09-25T22:07:30.779362] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-25T22:07:30.801001] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T22:07:31.088739] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-25T22:07:31.353024] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-25T22:07:31.888738] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-25T22:07:32.688737] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-25T22:07:33.480385] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-25T22:07:33.493128] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-25T22:07:33.742383] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-25T22:07:33.845493] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T22:07:34.288744] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-25T22:07:35.088740] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-25T22:07:35.597019] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-25T22:07:35.752465] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-25T22:07:35.888787] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-25T22:07:36.573474] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T22:07:36.688771] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-25T22:07:37.488848] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-25T22:07:37.937475] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-25T22:07:38.288818] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-25T22:07:38.606943] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-25T22:07:39.088822] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-25T22:07:39.158482] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-25T22:07:39.888769] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-25T22:07:40.119742] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-25T22:07:40.499105] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-25T22:07:40.507776] [INFO ] [REMOTE ] WNS: Full fetch complete (54973 records). [2025-09-25T22:07:40.507989] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-25T22:07:40.691669] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-25T22:07:40.740880] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-25T22:07:40.976445] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-25T22:07:40.976607] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-25T22:07:40.977928] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-25T22:07:40.978083] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-25T22:07:40.980363] [DEBUG] [LOCAL ] WNS: Trimmed 54973 records to 40320 (keeping 200 days of data) [2025-09-25T22:07:41.268210] [DEBUG] [LOCAL ] WNS: Primary data saved (40320 records). [2025-09-25T22:07:41.268403] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-25T22:07:41.268737] [INFO ] [MAIN ] Update Progress: 2312/2372 symbols completed. WNS took 34.9s. Estimated remaining: 7m 59s. Rate: 7.5 symbols/min [2025-09-25T22:07:41.448664] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:41.504740] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-25T22:07:41.525377] [DEBUG] [LOCAL ] WOW: Loaded 30194 existing records from primary storage. [2025-09-25T22:07:41.525546] [INFO ] [MAIN ] WOW: Loaded 30194 existing records. [2025-09-25T22:07:41.738176] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:41.741173] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-25T22:07:41.741230] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-25T22:07:41.741764] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-25T22:07:41.741839] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-25T22:07:42.121416] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:42.288700] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-25T22:07:43.088882] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-25T22:07:43.370816] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-25T22:07:43.567502] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-25T22:07:43.854705] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-25T22:07:43.888688] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-25T22:07:44.005864] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-25T22:07:44.688813] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-25T22:07:45.456628] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T22:07:45.467593] [INFO ] [REMOTE ] WMT: Full fetch complete (77968 records). [2025-09-25T22:07:45.467805] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-25T22:07:45.492189] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-25T22:07:45.949259] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-25T22:07:45.949365] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-25T22:07:45.950681] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-25T22:07:45.950765] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-25T22:07:45.952454] [DEBUG] [LOCAL ] WMT: Trimmed 77968 records to 54190 (keeping 200 days of data) [2025-09-25T22:07:46.309037] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-25T22:07:46.380823] [DEBUG] [LOCAL ] WMT: Primary data saved (54190 records). [2025-09-25T22:07:46.381001] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-25T22:07:46.381142] [INFO ] [MAIN ] Update Progress: 2313/2372 symbols completed. WMT took 46.5s. Estimated remaining: 7m 51s. Rate: 7.5 symbols/min [2025-09-25T22:07:46.548167] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-25T22:07:46.564177] [INFO ] [REMOTE ] WOLF: Full fetch complete (77599 records). [2025-09-25T22:07:46.564348] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-25T22:07:46.630461] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-25T22:07:46.793807] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:46.952841] [DEBUG] [LOCAL ] WPC: Loaded 48540 existing records from primary storage. [2025-09-25T22:07:46.953041] [INFO ] [MAIN ] WPC: Loaded 48540 existing records. [2025-09-25T22:07:47.090783] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-25T22:07:47.134278] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-25T22:07:47.378168] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:47.378723] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-25T22:07:47.378799] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-25T22:07:47.379214] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-25T22:07:47.379336] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-25T22:07:47.442810] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-25T22:07:47.442940] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-25T22:07:47.444976] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-25T22:07:47.445065] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-25T22:07:47.530874] [DEBUG] [LOCAL ] WOLF: Trimmed 77599 records to 53922 (keeping 200 days of data) [2025-09-25T22:07:47.903748] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-25T22:07:48.073722] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:48.248163] [DEBUG] [LOCAL ] WOLF: Primary data saved (53922 records). [2025-09-25T22:07:48.248351] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-25T22:07:48.249459] [INFO ] [MAIN ] Update Progress: 2314/2372 symbols completed. WOLF took 34.7s. Estimated remaining: 7m 43s. Rate: 7.5 symbols/min [2025-09-25T22:07:48.441356] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-25T22:07:48.474248] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:48.563952] [DEBUG] [LOCAL ] WPM: Loaded 52734 existing records from primary storage. [2025-09-25T22:07:48.564209] [INFO ] [MAIN ] WPM: Loaded 52734 existing records. [2025-09-25T22:07:48.694733] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-25T22:07:48.758893] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:48.759184] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-25T22:07:48.759245] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-25T22:07:48.759563] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-25T22:07:48.759623] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-25T22:07:49.156219] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:49.170850] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T22:07:49.177004] [INFO ] [REMOTE ] WOR: Full fetch complete (36145 records). [2025-09-25T22:07:49.177111] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-25T22:07:49.494788] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-25T22:07:49.620562] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-25T22:07:49.620674] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-25T22:07:49.621496] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-25T22:07:49.621562] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-25T22:07:49.622558] [DEBUG] [LOCAL ] WOR: Trimmed 36145 records to 25005 (keeping 200 days of data) [2025-09-25T22:07:49.812226] [DEBUG] [LOCAL ] WOR: Primary data saved (25005 records). [2025-09-25T22:07:49.812419] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-25T22:07:49.812547] [INFO ] [MAIN ] Update Progress: 2315/2372 symbols completed. WOR took 23.9s. Estimated remaining: 7m 35s. Rate: 7.5 symbols/min [2025-09-25T22:07:50.012229] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:07:50.071526] [DEBUG] [LOCAL ] WPP: Loaded 33738 existing records from primary storage. [2025-09-25T22:07:50.073902] [INFO ] [MAIN ] WPP: Loaded 33738 existing records. [2025-09-25T22:07:50.080902] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T22:07:50.275438] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:07:50.275875] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-25T22:07:50.275929] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-25T22:07:50.276213] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-25T22:07:50.276352] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-25T22:07:50.292973] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-25T22:07:50.656539] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:07:51.088722] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-25T22:07:51.188935] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-25T22:07:51.888745] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-25T22:07:52.152033] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-25T22:07:52.490874] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-25T22:07:52.688735] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-25T22:07:53.488720] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-25T22:07:53.715408] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-25T22:07:54.104182] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-25T22:07:54.288738] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-25T22:07:54.520736] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-25T22:07:55.088739] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-25T22:07:55.888714] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-25T22:07:56.009904] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-25T22:07:56.458710] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T22:07:56.688741] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-25T22:07:57.408104] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T22:07:57.488673] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-25T22:07:57.794378] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T22:07:58.288728] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-25T22:07:59.088707] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-25T22:07:59.445011] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T22:07:59.446326] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-25T22:07:59.888750] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-25T22:08:00.688744] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-25T22:08:01.007358] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T22:08:01.043062] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T22:08:01.488765] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-25T22:08:02.288762] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-25T22:08:02.763697] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-25T22:08:02.825136] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-25T22:08:03.088752] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-25T22:08:03.796303] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T22:08:03.888749] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-25T22:08:04.540419] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-25T22:08:04.688710] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-25T22:08:05.488754] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-25T22:08:05.803066] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-25T22:08:06.135075] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T22:08:06.145092] [INFO ] [REMOTE ] WOW: Full fetch complete (41811 records). [2025-09-25T22:08:06.145233] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-25T22:08:06.293806] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-25T22:08:06.559547] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-25T22:08:06.559741] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-25T22:08:06.560618] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-25T22:08:06.560693] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-25T22:08:06.562921] [DEBUG] [LOCAL ] WOW: Trimmed 41811 records to 30492 (keeping 200 days of data) [2025-09-25T22:08:06.766053] [DEBUG] [LOCAL ] WOW: Primary data saved (30492 records). [2025-09-25T22:08:06.766204] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-25T22:08:06.766317] [INFO ] [MAIN ] Update Progress: 2316/2372 symbols completed. WOW took 25.5s. Estimated remaining: 7m 27s. Rate: 7.5 symbols/min [2025-09-25T22:08:06.947478] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:07.017996] [DEBUG] [LOCAL ] WRB: Loaded 50554 existing records from primary storage. [2025-09-25T22:08:07.018180] [INFO ] [MAIN ] WRB: Loaded 50554 existing records. [2025-09-25T22:08:07.094574] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-25T22:08:07.180876] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T22:08:07.278814] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:07.280943] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-25T22:08:07.281010] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-25T22:08:07.281472] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-25T22:08:07.281533] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-25T22:08:07.683583] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:07.888788] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-25T22:08:07.922000] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-25T22:08:08.688838] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-25T22:08:08.835948] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-25T22:08:09.488795] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-25T22:08:09.776173] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-25T22:08:10.288709] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-25T22:08:10.441738] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-25T22:08:11.088746] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-25T22:08:11.336129] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-25T22:08:11.448147] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-25T22:08:11.888857] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-25T22:08:12.688709] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-25T22:08:13.103714] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-25T22:08:13.488757] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-25T22:08:13.942024] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-25T22:08:14.288865] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-25T22:08:14.591143] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-25T22:08:15.088806] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-25T22:08:15.736146] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-25T22:08:15.888767] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-25T22:08:16.688905] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-25T22:08:16.850799] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-25T22:08:17.234971] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-25T22:08:17.323621] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-25T22:08:17.491521] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-25T22:08:18.288710] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-25T22:08:18.466857] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T22:08:19.088839] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-25T22:08:19.364586] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T22:08:19.375737] [INFO ] [REMOTE ] WPM: Full fetch complete (75852 records). [2025-09-25T22:08:19.375977] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-25T22:08:19.875028] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-25T22:08:19.875171] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-25T22:08:19.876427] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-25T22:08:19.876532] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-25T22:08:19.884780] [DEBUG] [LOCAL ] WPM: Trimmed 75852 records to 53121 (keeping 200 days of data) [2025-09-25T22:08:19.890267] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-25T22:08:19.911405] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-25T22:08:20.314633] [DEBUG] [LOCAL ] WPM: Primary data saved (53121 records). [2025-09-25T22:08:20.315365] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-25T22:08:20.315672] [INFO ] [MAIN ] Update Progress: 2317/2372 symbols completed. WPM took 32.1s. Estimated remaining: 7m 19s. Rate: 7.5 symbols/min [2025-09-25T22:08:20.692966] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-25T22:08:20.697236] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-25T22:08:20.708743] [INFO ] [REMOTE ] WPC: Full fetch complete (70836 records). [2025-09-25T22:08:20.708988] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-25T22:08:21.160119] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-25T22:08:21.160321] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-25T22:08:21.161626] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-25T22:08:21.161752] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-25T22:08:21.163356] [DEBUG] [LOCAL ] WPC: Trimmed 70836 records to 48858 (keeping 200 days of data) [2025-09-25T22:08:21.494722] [DEBUG] [LOCAL ] WPC: Primary data saved (48858 records). [2025-09-25T22:08:21.494895] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-25T22:08:21.495050] [INFO ] [MAIN ] Update Progress: 2318/2372 symbols completed. WPC took 35.1s. Estimated remaining: 7m 11s. Rate: 7.5 symbols/min [2025-09-25T22:08:21.816194] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-25T22:08:21.828913] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-25T22:08:22.045479] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-25T22:08:22.288736] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-25T22:08:23.733092] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-25T22:08:23.750417] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-25T22:08:25.485137] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-25T22:08:25.500254] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-25T22:08:26.794787] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (4.51 seconds). [2025-09-25T22:08:26.801621] [INFO ] [REMOTE ] WPP: Full fetch complete (45157 records). [2025-09-25T22:08:26.801778] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-25T22:08:27.206308] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-25T22:08:27.206430] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-25T22:08:27.207452] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-25T22:08:27.207515] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-25T22:08:27.210563] [DEBUG] [LOCAL ] WPP: Trimmed 45157 records to 34018 (keeping 200 days of data) [2025-09-25T22:08:27.454784] [DEBUG] [LOCAL ] WPP: Primary data saved (34018 records). [2025-09-25T22:08:27.454970] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-25T22:08:27.455166] [INFO ] [MAIN ] Update Progress: 2319/2372 symbols completed. WPP took 37.6s. Estimated remaining: 7m 3s. Rate: 7.5 symbols/min [2025-09-25T22:08:27.631544] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-25T22:08:27.643212] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-25T22:08:30.279877] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-25T22:08:30.291633] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-25T22:08:30.873077] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-25T22:08:30.884217] [INFO ] [REMOTE ] WRB: Full fetch complete (73205 records). [2025-09-25T22:08:30.884441] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-25T22:08:31.331630] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-25T22:08:31.331761] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-25T22:08:31.333015] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-25T22:08:31.333083] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-25T22:08:31.334754] [DEBUG] [LOCAL ] WRB: Trimmed 73205 records to 50934 (keeping 200 days of data) [2025-09-25T22:08:31.697862] [DEBUG] [LOCAL ] WRB: Primary data saved (50934 records). [2025-09-25T22:08:31.698069] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-25T22:08:31.701050] [INFO ] [MAIN ] Update Progress: 2320/2372 symbols completed. WRB took 24.9s. Estimated remaining: 6m 55s. Rate: 7.5 symbols/min [2025-09-25T22:08:32.416420] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:32.431445] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:32.602122] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:32.658326] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:32.671528] [DEBUG] [LOCAL ] WS: Loaded 23893 existing records from primary storage. [2025-09-25T22:08:32.671923] [INFO ] [MAIN ] WS: Loaded 23893 existing records. [2025-09-25T22:08:32.728606] [DEBUG] [LOCAL ] WSM: Loaded 49858 existing records from primary storage. [2025-09-25T22:08:32.728855] [INFO ] [MAIN ] WSM: Loaded 49858 existing records. [2025-09-25T22:08:32.834126] [DEBUG] [LOCAL ] WSO: Loaded 24693 existing records from primary storage. [2025-09-25T22:08:32.834301] [INFO ] [MAIN ] WSO: Loaded 24693 existing records. [2025-09-25T22:08:32.870409] [DEBUG] [LOCAL ] WRBY: Loaded 50878 existing records from primary storage. [2025-09-25T22:08:32.870595] [INFO ] [MAIN ] WRBY: Loaded 50878 existing records. [2025-09-25T22:08:33.488608] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:33.497021] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-25T22:08:33.497100] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-25T22:08:33.500783] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-25T22:08:33.501032] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-25T22:08:33.582744] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:33.650598] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-25T22:08:33.650667] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-25T22:08:33.651361] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-25T22:08:33.651602] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-25T22:08:33.582627] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:33.657731] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-25T22:08:33.657825] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-25T22:08:33.658095] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-25T22:08:33.658153] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-25T22:08:33.650329] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:33.663428] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-25T22:08:33.663472] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-25T22:08:33.680763] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-25T22:08:33.680914] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-25T22:08:35.001688] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:35.040293] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-25T22:08:35.177820] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:35.178637] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-25T22:08:35.223383] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:35.226457] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-25T22:08:35.249271] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:35.249776] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-25T22:08:36.350423] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T22:08:36.355074] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-25T22:08:36.455346] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-25T22:08:36.465494] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-25T22:08:36.582379] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T22:08:36.594622] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-25T22:08:36.879459] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-25T22:08:36.890338] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-25T22:08:37.227705] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T22:08:37.232285] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-25T22:08:37.712838] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T22:08:37.718888] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-25T22:08:37.979148] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-25T22:08:37.990017] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-25T22:08:38.401925] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T22:08:38.407205] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-25T22:08:38.803709] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-25T22:08:38.814904] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-25T22:08:38.872591] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-25T22:08:38.879614] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-25T22:08:39.553017] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T22:08:39.562968] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-25T22:08:40.219614] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-25T22:08:40.226627] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-25T22:08:40.587260] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T22:08:40.596965] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-25T22:08:40.707359] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-25T22:08:40.713311] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-25T22:08:40.862837] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-25T22:08:40.874868] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-25T22:08:41.122692] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-25T22:08:41.488771] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-25T22:08:41.644259] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-25T22:08:42.125829] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-25T22:08:42.288701] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-25T22:08:42.389701] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T22:08:42.721314] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T22:08:43.088746] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-25T22:08:43.888700] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-25T22:08:43.932635] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-25T22:08:43.987474] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-25T22:08:44.688739] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-25T22:08:45.488745] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-25T22:08:45.814503] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-25T22:08:45.868624] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-25T22:08:46.288741] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-25T22:08:46.793923] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-25T22:08:47.088767] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-25T22:08:47.674696] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T22:08:47.888740] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-25T22:08:48.688785] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-25T22:08:48.845097] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T22:08:49.211785] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-25T22:08:49.488779] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-25T22:08:50.288842] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-25T22:08:50.400494] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T22:08:50.705086] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-25T22:08:51.088760] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-25T22:08:51.434027] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-25T22:08:51.888739] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-25T22:08:52.688747] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-25T22:08:53.095727] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-25T22:08:53.488746] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-25T22:08:53.774168] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-25T22:08:53.868947] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T22:08:53.878866] [INFO ] [REMOTE ] WSO: Full fetch complete (34077 records). [2025-09-25T22:08:53.879020] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-25T22:08:54.273185] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-25T22:08:54.273291] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-25T22:08:54.274268] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-25T22:08:54.274333] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-25T22:08:54.275275] [DEBUG] [LOCAL ] WSO: Trimmed 34077 records to 24870 (keeping 200 days of data) [2025-09-25T22:08:54.288752] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-25T22:08:54.467171] [DEBUG] [LOCAL ] WSO: Primary data saved (24870 records). [2025-09-25T22:08:54.467424] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-25T22:08:54.467786] [INFO ] [MAIN ] Update Progress: 2321/2372 symbols completed. WSO took 22.7s. Estimated remaining: 6m 47s. Rate: 7.5 symbols/min [2025-09-25T22:08:54.650129] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:54.695139] [DEBUG] [LOCAL ] WSR: Loaded 23275 existing records from primary storage. [2025-09-25T22:08:54.695363] [INFO ] [MAIN ] WSR: Loaded 23275 existing records. [2025-09-25T22:08:54.883550] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:54.884054] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-25T22:08:54.884106] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-25T22:08:54.884542] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-25T22:08:54.884601] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-25T22:08:55.101795] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-25T22:08:55.213662] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T22:08:55.345617] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:55.888706] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-25T22:08:56.053218] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-25T22:08:56.060223] [INFO ] [REMOTE ] WS: Full fetch complete (36402 records). [2025-09-25T22:08:56.060342] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-25T22:08:56.386838] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-25T22:08:56.550184] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-25T22:08:56.550277] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-25T22:08:56.551120] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-25T22:08:56.551184] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-25T22:08:56.552364] [DEBUG] [LOCAL ] WS: Trimmed 36402 records to 24167 (keeping 200 days of data) [2025-09-25T22:08:56.688786] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-25T22:08:56.738507] [DEBUG] [LOCAL ] WS: Primary data saved (24167 records). [2025-09-25T22:08:56.741716] [INFO ] [MAIN ] WS: Full history saved. [2025-09-25T22:08:56.741870] [INFO ] [MAIN ] Update Progress: 2322/2372 symbols completed. WS took 25.0s. Estimated remaining: 6m 39s. Rate: 7.5 symbols/min [2025-09-25T22:08:56.926049] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:08:56.991241] [DEBUG] [LOCAL ] WST: Loaded 37580 existing records from primary storage. [2025-09-25T22:08:56.991403] [INFO ] [MAIN ] WST: Loaded 37580 existing records. [2025-09-25T22:08:57.193766] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:08:57.194197] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-25T22:08:57.194272] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-25T22:08:57.194570] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-25T22:08:57.194630] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-25T22:08:57.502872] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-25T22:08:57.614478] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:08:57.656170] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-25T22:08:58.288831] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-25T22:08:58.536135] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-25T22:08:58.548406] [INFO ] [REMOTE ] WRBY: Full fetch complete (73384 records). [2025-09-25T22:08:58.548593] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-25T22:08:58.619746] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T22:08:59.046974] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-25T22:08:59.081116] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-25T22:08:59.081217] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-25T22:08:59.082904] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-25T22:08:59.082980] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-25T22:08:59.088169] [DEBUG] [LOCAL ] WRBY: Trimmed 73384 records to 51247 (keeping 200 days of data) [2025-09-25T22:08:59.089748] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-25T22:08:59.086837] [INFO ] [REMOTE ] WSM: Full fetch complete (72153 records). [2025-09-25T22:08:59.091783] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-25T22:08:59.877610] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-25T22:08:59.877767] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-25T22:08:59.879612] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-25T22:08:59.880365] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-25T22:08:59.882685] [DEBUG] [LOCAL ] WSM: Trimmed 72153 records to 50211 (keeping 200 days of data) [2025-09-25T22:08:59.894694] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-25T22:08:59.894575] [DEBUG] [LOCAL ] WRBY: Primary data saved (51247 records). [2025-09-25T22:08:59.896804] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-25T22:08:59.896975] [INFO ] [MAIN ] Update Progress: 2323/2372 symbols completed. WRBY took 28.2s. Estimated remaining: 6m 31s. Rate: 7.5 symbols/min [2025-09-25T22:09:00.096846] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T22:09:00.349477] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:00.472930] [DEBUG] [LOCAL ] WSM: Primary data saved (50211 records). [2025-09-25T22:09:00.473199] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-25T22:09:00.473369] [INFO ] [MAIN ] Update Progress: 2324/2372 symbols completed. WSM took 28.8s. Estimated remaining: 6m 23s. Rate: 7.5 symbols/min [2025-09-25T22:09:00.690617] [DEBUG] [LOCAL ] WT: Loaded 47637 existing records from primary storage. [2025-09-25T22:09:00.697944] [INFO ] [MAIN ] WT: Loaded 47637 existing records. [2025-09-25T22:09:00.704745] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-25T22:09:00.769539] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:01.067001] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:01.067829] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-25T22:09:01.067907] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-25T22:09:01.068315] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-25T22:09:01.068402] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-25T22:09:01.087707] [DEBUG] [LOCAL ] WTI: Loaded 43754 existing records from primary storage. [2025-09-25T22:09:01.120631] [INFO ] [MAIN ] WTI: Loaded 43754 existing records. [2025-09-25T22:09:01.530235] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-25T22:09:01.650868] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-25T22:09:01.744869] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:01.745195] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-25T22:09:01.745256] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-25T22:09:01.745589] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-25T22:09:01.750188] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-25T22:09:01.891091] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-25T22:09:02.233817] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:02.293912] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-25T22:09:02.467619] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:02.807452] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-25T22:09:03.088725] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-25T22:09:03.812319] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-25T22:09:03.888760] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-25T22:09:04.688752] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-25T22:09:04.890049] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-25T22:09:05.488715] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-25T22:09:05.649310] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T22:09:05.998528] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-25T22:09:06.288807] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-25T22:09:07.088705] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-25T22:09:07.863019] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T22:09:07.888707] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-25T22:09:08.589848] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (3.10 seconds). [2025-09-25T22:09:08.688777] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-25T22:09:08.838912] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-25T22:09:09.439539] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T22:09:09.488730] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-25T22:09:09.862862] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-25T22:09:10.288758] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-25T22:09:11.088689] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-25T22:09:11.227680] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T22:09:11.562137] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-25T22:09:11.888773] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-25T22:09:12.688747] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-25T22:09:12.758450] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-25T22:09:13.488751] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-25T22:09:13.607728] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-25T22:09:14.200870] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-25T22:09:14.288738] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-25T22:09:14.350686] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T22:09:15.088770] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-25T22:09:15.899311] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-25T22:09:15.919240] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T22:09:16.688698] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-25T22:09:16.855858] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T22:09:17.273232] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-25T22:09:17.488792] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-25T22:09:18.293918] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-25T22:09:18.312454] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-25T22:09:18.366115] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-25T22:09:19.088737] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-25T22:09:19.745375] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-25T22:09:19.888744] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-25T22:09:20.688702] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-25T22:09:20.809066] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-25T22:09:20.959061] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-25T22:09:21.488746] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-25T22:09:22.288741] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-25T22:09:22.518048] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-25T22:09:23.088734] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-25T22:09:23.268433] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-25T22:09:23.274348] [INFO ] [REMOTE ] WSR: Full fetch complete (32803 records). [2025-09-25T22:09:23.274532] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-25T22:09:23.414028] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-25T22:09:23.753306] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-25T22:09:23.753415] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-25T22:09:23.754172] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-25T22:09:23.754251] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-25T22:09:23.756861] [DEBUG] [LOCAL ] WSR: Trimmed 32803 records to 23424 (keeping 200 days of data) [2025-09-25T22:09:23.888901] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-25T22:09:23.937249] [DEBUG] [LOCAL ] WSR: Primary data saved (23424 records). [2025-09-25T22:09:23.937429] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-25T22:09:23.937668] [INFO ] [MAIN ] Update Progress: 2325/2372 symbols completed. WSR took 29.5s. Estimated remaining: 6m 15s. Rate: 7.5 symbols/min [2025-09-25T22:09:24.151732] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:24.151986] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-25T22:09:24.152034] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-25T22:09:24.152323] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-25T22:09:24.152378] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-25T22:09:24.152450] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-25T22:09:24.152488] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-25T22:09:24.570278] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:24.688792] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-25T22:09:24.809180] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T22:09:25.088722] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-25T22:09:25.488763] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-25T22:09:25.683946] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T22:09:26.288822] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-25T22:09:27.049719] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-25T22:09:27.088760] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-25T22:09:27.584066] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T22:09:27.888730] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-25T22:09:28.688707] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-25T22:09:28.782340] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T22:09:29.115774] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-25T22:09:29.412812] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T22:09:29.421785] [INFO ] [REMOTE ] WTI: Full fetch complete (64158 records). [2025-09-25T22:09:29.421993] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-25T22:09:29.495925] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-25T22:09:29.891770] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-25T22:09:29.891890] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-25T22:09:29.893066] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-25T22:09:29.893171] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-25T22:09:29.894811] [DEBUG] [LOCAL ] WTI: Trimmed 64158 records to 44092 (keeping 200 days of data) [2025-09-25T22:09:30.020226] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-25T22:09:30.199205] [DEBUG] [LOCAL ] WTI: Primary data saved (44092 records). [2025-09-25T22:09:30.199369] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-25T22:09:30.199559] [INFO ] [MAIN ] Update Progress: 2326/2372 symbols completed. WTI took 29.7s. Estimated remaining: 6m 7s. Rate: 7.5 symbols/min [2025-09-25T22:09:30.293791] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-25T22:09:30.403112] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:30.474019] [DEBUG] [LOCAL ] WTRG: Loaded 50931 existing records from primary storage. [2025-09-25T22:09:30.474195] [INFO ] [MAIN ] WTRG: Loaded 50931 existing records. [2025-09-25T22:09:30.699234] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:30.699629] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-25T22:09:30.699803] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-25T22:09:30.700365] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-25T22:09:30.700438] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-25T22:09:31.089635] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-25T22:09:31.119747] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:31.496741] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-25T22:09:31.574816] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-25T22:09:31.888743] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-25T22:09:32.688818] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-25T22:09:33.488772] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-25T22:09:33.644918] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-25T22:09:33.660527] [INFO ] [REMOTE ] WT: Full fetch complete (69033 records). [2025-09-25T22:09:33.660799] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-25T22:09:34.064100] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-25T22:09:34.105186] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-25T22:09:34.105308] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-25T22:09:34.107212] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-25T22:09:34.107316] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-25T22:09:34.110422] [DEBUG] [LOCAL ] WT: Trimmed 69033 records to 47993 (keeping 200 days of data) [2025-09-25T22:09:34.320235] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-25T22:09:34.431535] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-25T22:09:34.503190] [DEBUG] [LOCAL ] WT: Primary data saved (47993 records). [2025-09-25T22:09:34.503363] [INFO ] [MAIN ] WT: Full history saved. [2025-09-25T22:09:34.503543] [INFO ] [MAIN ] Update Progress: 2327/2372 symbols completed. WT took 34.6s. Estimated remaining: 5m 59s. Rate: 7.5 symbols/min [2025-09-25T22:09:34.682270] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:34.716176] [DEBUG] [LOCAL ] WTS: Loaded 18480 existing records from primary storage. [2025-09-25T22:09:34.717185] [INFO ] [MAIN ] WTS: Loaded 18480 existing records. [2025-09-25T22:09:34.802022] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-25T22:09:34.915247] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:34.915520] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-25T22:09:34.915567] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-25T22:09:34.915935] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-25T22:09:34.916007] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-25T22:09:35.089382] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-25T22:09:35.294970] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:35.888808] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-25T22:09:36.662433] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-25T22:09:36.688678] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-25T22:09:36.977483] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-25T22:09:36.988202] [INFO ] [REMOTE ] WST: Full fetch complete (53604 records). [2025-09-25T22:09:36.988396] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-25T22:09:37.062035] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-25T22:09:37.421061] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-25T22:09:37.421182] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-25T22:09:37.422283] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-25T22:09:37.422352] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-25T22:09:37.423932] [DEBUG] [LOCAL ] WST: Trimmed 53604 records to 37866 (keeping 200 days of data) [2025-09-25T22:09:37.500415] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-25T22:09:37.713974] [DEBUG] [LOCAL ] WST: Primary data saved (37866 records). [2025-09-25T22:09:37.714164] [INFO ] [MAIN ] WST: Full history saved. [2025-09-25T22:09:37.714288] [INFO ] [MAIN ] Update Progress: 2328/2372 symbols completed. WST took 41.0s. Estimated remaining: 5m 51s. Rate: 7.5 symbols/min [2025-09-25T22:09:37.901627] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:37.970290] [DEBUG] [LOCAL ] WTTR: Loaded 45054 existing records from primary storage. [2025-09-25T22:09:37.970560] [INFO ] [MAIN ] WTTR: Loaded 45054 existing records. [2025-09-25T22:09:38.156027] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:38.156545] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-25T22:09:38.156665] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-25T22:09:38.156927] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-25T22:09:38.156997] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-25T22:09:38.290729] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-25T22:09:38.375085] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-25T22:09:38.561396] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:38.863737] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-25T22:09:39.088790] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-25T22:09:39.583473] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-25T22:09:39.888737] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-25T22:09:40.362392] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-25T22:09:40.688743] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-25T22:09:41.299130] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-25T22:09:41.302667] [INFO ] [REMOTE ] WTM: Full fetch complete (2251 records). [2025-09-25T22:09:41.302792] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-25T22:09:41.493934] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-25T22:09:41.543456] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-25T22:09:41.544415] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:09:41.544563] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:09:41.544691] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-25T22:09:41.544811] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-25T22:09:41.544895] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-25T22:09:41.545027] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-25T22:09:41.545183] [INFO ] [MAIN ] Update Progress: 2329/2372 symbols completed. WTM took 17.6s. Estimated remaining: 5m 43s. Rate: 7.5 symbols/min [2025-09-25T22:09:41.758665] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:09:41.849036] [DEBUG] [LOCAL ] WU: Loaded 53453 existing records from primary storage. [2025-09-25T22:09:41.849216] [INFO ] [MAIN ] WU: Loaded 53453 existing records. [2025-09-25T22:09:42.047516] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:09:42.047955] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-25T22:09:42.048008] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-25T22:09:42.048333] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-25T22:09:42.048394] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-25T22:09:42.293780] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-25T22:09:42.468465] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:09:43.088721] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-25T22:09:43.263252] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-25T22:09:43.698614] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-25T22:09:43.888684] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-25T22:09:44.209576] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-25T22:09:44.688744] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-25T22:09:45.196240] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T22:09:45.488747] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-25T22:09:46.288734] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-25T22:09:46.493184] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T22:09:47.088733] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-25T22:09:47.118814] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-25T22:09:47.802387] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T22:09:47.888740] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-25T22:09:48.688689] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-25T22:09:48.967030] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T22:09:49.322948] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-25T22:09:49.488742] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-25T22:09:49.937925] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-25T22:09:50.288728] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-25T22:09:51.088697] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-25T22:09:51.180080] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-25T22:09:51.529674] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-25T22:09:51.888720] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-25T22:09:52.688738] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-25T22:09:52.756837] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-25T22:09:53.488778] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-25T22:09:53.647429] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-25T22:09:53.816889] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T22:09:54.288746] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-25T22:09:55.088787] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-25T22:09:55.248240] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T22:09:55.398203] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T22:09:55.712058] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-25T22:09:55.888753] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-25T22:09:56.688749] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-25T22:09:57.425459] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-25T22:09:57.488948] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-25T22:09:58.058100] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-25T22:09:58.288840] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-25T22:09:58.620295] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-25T22:09:59.088742] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-25T22:09:59.888800] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-25T22:10:00.079596] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-25T22:10:00.528216] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T22:10:00.688747] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-25T22:10:01.488833] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-25T22:10:01.589339] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-25T22:10:02.264255] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-25T22:10:02.288699] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-25T22:10:03.094510] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-25T22:10:03.110872] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T22:10:03.888763] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-25T22:10:04.042380] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-25T22:10:04.055732] [INFO ] [REMOTE ] WTRG: Full fetch complete (73253 records). [2025-09-25T22:10:04.056032] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-25T22:10:04.283264] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-25T22:10:04.565265] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-25T22:10:04.565412] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-25T22:10:04.567676] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-25T22:10:04.567800] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-25T22:10:04.570029] [DEBUG] [LOCAL ] WTRG: Trimmed 73253 records to 51278 (keeping 200 days of data) [2025-09-25T22:10:04.689027] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-25T22:10:04.958139] [DEBUG] [LOCAL ] WTRG: Primary data saved (51278 records). [2025-09-25T22:10:04.958349] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-25T22:10:04.958618] [INFO ] [MAIN ] Update Progress: 2330/2372 symbols completed. WTRG took 34.8s. Estimated remaining: 5m 35s. Rate: 7.5 symbols/min [2025-09-25T22:10:05.158145] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:05.225159] [DEBUG] [LOCAL ] WWW: Loaded 49176 existing records from primary storage. [2025-09-25T22:10:05.225446] [INFO ] [MAIN ] WWW: Loaded 49176 existing records. [2025-09-25T22:10:05.448470] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:05.448910] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-25T22:10:05.448970] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-25T22:10:05.449517] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-25T22:10:05.449589] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-25T22:10:05.455890] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-25T22:10:05.466702] [INFO ] [REMOTE ] WTS: Full fetch complete (26331 records). [2025-09-25T22:10:05.466794] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-25T22:10:05.508988] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-25T22:10:06.086289] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-25T22:10:06.289825] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-25T22:10:06.397810] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-25T22:10:06.397917] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-25T22:10:06.398741] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-25T22:10:06.402261] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-25T22:10:06.403095] [DEBUG] [LOCAL ] WTS: Trimmed 26331 records to 18543 (keeping 200 days of data) [2025-09-25T22:10:06.405519] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:06.546599] [DEBUG] [LOCAL ] WTS: Primary data saved (18543 records). [2025-09-25T22:10:06.546811] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-25T22:10:06.546987] [INFO ] [MAIN ] Update Progress: 2331/2372 symbols completed. WTS took 32.0s. Estimated remaining: 5m 27s. Rate: 7.5 symbols/min [2025-09-25T22:10:06.745911] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:06.824236] [DEBUG] [LOCAL ] WY: Loaded 53119 existing records from primary storage. [2025-09-25T22:10:06.824409] [INFO ] [MAIN ] WY: Loaded 53119 existing records. [2025-09-25T22:10:06.946507] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-25T22:10:06.966416] [INFO ] [REMOTE ] WTTR: Full fetch complete (65600 records). [2025-09-25T22:10:06.977117] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-25T22:10:07.088817] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-25T22:10:07.267947] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:07.268341] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-25T22:10:07.268430] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-25T22:10:07.268894] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-25T22:10:07.268958] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-25T22:10:07.924852] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-25T22:10:07.924987] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-25T22:10:07.926439] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-25T22:10:07.926518] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-25T22:10:07.928183] [DEBUG] [LOCAL ] WTTR: Trimmed 65600 records to 45381 (keeping 200 days of data) [2025-09-25T22:10:08.166130] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:08.166451] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-25T22:10:08.318600] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-25T22:10:08.424819] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-25T22:10:08.428500] [DEBUG] [LOCAL ] WTTR: Primary data saved (45381 records). [2025-09-25T22:10:08.428583] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-25T22:10:08.428742] [INFO ] [MAIN ] Update Progress: 2332/2372 symbols completed. WTTR took 30.7s. Estimated remaining: 5m 19s. Rate: 7.5 symbols/min [2025-09-25T22:10:08.619700] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:08.670905] [DEBUG] [LOCAL ] XFLT: Loaded 29992 existing records from primary storage. [2025-09-25T22:10:08.671147] [INFO ] [MAIN ] XFLT: Loaded 29992 existing records. [2025-09-25T22:10:08.690260] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-25T22:10:08.877186] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:08.877738] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-25T22:10:08.877797] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-25T22:10:08.878131] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-25T22:10:08.878260] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-25T22:10:09.250322] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:09.488786] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-25T22:10:10.057857] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-25T22:10:10.147534] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-25T22:10:10.288753] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-25T22:10:11.088698] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-25T22:10:11.451134] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-25T22:10:11.891934] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-25T22:10:11.898820] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T22:10:12.599914] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-25T22:10:12.688804] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-25T22:10:13.488805] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-25T22:10:13.689375] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T22:10:14.288720] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-25T22:10:14.375847] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-25T22:10:15.088742] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-25T22:10:15.389603] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-25T22:10:15.694881] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T22:10:15.888781] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-25T22:10:16.688777] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-25T22:10:16.971342] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-25T22:10:17.264343] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-25T22:10:17.488738] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-25T22:10:17.984925] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T22:10:18.288738] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-25T22:10:19.088706] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-25T22:10:19.457804] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-25T22:10:19.888721] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-25T22:10:20.057262] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T22:10:20.697501] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-25T22:10:20.703980] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-25T22:10:20.919283] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-25T22:10:21.488735] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-25T22:10:22.288731] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-25T22:10:22.615469] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-25T22:10:23.088748] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-25T22:10:23.362923] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-25T22:10:23.375320] [INFO ] [REMOTE ] WU: Full fetch complete (77325 records). [2025-09-25T22:10:23.375579] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-25T22:10:23.844333] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-25T22:10:23.844522] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-25T22:10:23.845982] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-25T22:10:23.846057] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-25T22:10:23.847863] [DEBUG] [LOCAL ] WU: Trimmed 77325 records to 53843 (keeping 200 days of data) [2025-09-25T22:10:23.919853] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-25T22:10:24.088702] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T22:10:24.273800] [DEBUG] [LOCAL ] WU: Primary data saved (53843 records). [2025-09-25T22:10:24.273969] [INFO ] [MAIN ] WU: Full history saved. [2025-09-25T22:10:24.277002] [INFO ] [MAIN ] Update Progress: 2333/2372 symbols completed. WU took 42.7s. Estimated remaining: 5m 11s. Rate: 7.5 symbols/min [2025-09-25T22:10:24.502797] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-25T22:10:24.524260] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:24.610978] [DEBUG] [LOCAL ] XHR: Loaded 44125 existing records from primary storage. [2025-09-25T22:10:24.611239] [INFO ] [MAIN ] XHR: Loaded 44125 existing records. [2025-09-25T22:10:24.689942] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-25T22:10:24.860262] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:24.860633] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-25T22:10:24.860762] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-25T22:10:24.861104] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-25T22:10:24.861214] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-25T22:10:25.351131] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:25.353415] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T22:10:25.488739] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-25T22:10:26.288724] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-25T22:10:26.546703] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-25T22:10:26.949016] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-25T22:10:27.088756] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-25T22:10:27.404969] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-25T22:10:27.888796] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-25T22:10:28.688765] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-25T22:10:28.924609] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-25T22:10:29.488689] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-25T22:10:29.617273] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-25T22:10:29.626807] [INFO ] [REMOTE ] WWW: Full fetch complete (70032 records). [2025-09-25T22:10:29.626946] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-25T22:10:29.934031] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-25T22:10:30.082211] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-25T22:10:30.082306] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-25T22:10:30.084000] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-25T22:10:30.084066] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-25T22:10:30.085790] [DEBUG] [LOCAL ] WWW: Trimmed 70032 records to 49549 (keeping 200 days of data) [2025-09-25T22:10:30.307782] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-25T22:10:30.410992] [DEBUG] [LOCAL ] WWW: Primary data saved (49549 records). [2025-09-25T22:10:30.411210] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-25T22:10:30.411322] [INFO ] [MAIN ] Update Progress: 2334/2372 symbols completed. WWW took 25.5s. Estimated remaining: 5m 3s. Rate: 7.5 symbols/min [2025-09-25T22:10:30.598095] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:30.598346] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-25T22:10:30.598385] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-25T22:10:30.598660] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-25T22:10:30.598720] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-25T22:10:30.598766] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-25T22:10:30.598801] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-25T22:10:30.977290] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:31.088766] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-25T22:10:31.606192] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-25T22:10:31.687896] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-25T22:10:31.888759] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-25T22:10:32.499221] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-25T22:10:32.688747] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-25T22:10:33.488755] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-25T22:10:33.807497] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-25T22:10:34.204734] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-25T22:10:34.288757] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-25T22:10:34.574861] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-25T22:10:35.088732] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-25T22:10:35.552137] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-25T22:10:35.888721] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-25T22:10:36.516310] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-25T22:10:36.664022] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-25T22:10:36.680574] [INFO ] [REMOTE ] WY: Full fetch complete (76838 records). [2025-09-25T22:10:36.680850] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-25T22:10:36.689433] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-25T22:10:37.114591] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-25T22:10:37.114722] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-25T22:10:37.116069] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-25T22:10:37.116140] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-25T22:10:37.117901] [DEBUG] [LOCAL ] WY: Trimmed 76838 records to 53509 (keeping 200 days of data) [2025-09-25T22:10:37.486236] [DEBUG] [LOCAL ] WY: Primary data saved (53509 records). [2025-09-25T22:10:37.486441] [INFO ] [MAIN ] WY: Full history saved. [2025-09-25T22:10:37.486578] [INFO ] [MAIN ] Update Progress: 2335/2372 symbols completed. WY took 30.9s. Estimated remaining: 4m 55s. Rate: 7.5 symbols/min [2025-09-25T22:10:37.491903] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-25T22:10:37.680162] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:37.723544] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:10:37.724118] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-25T22:10:37.751077] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-25T22:10:37.751265] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-25T22:10:37.977607] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:37.978335] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-25T22:10:37.978410] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-25T22:10:37.983040] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-25T22:10:37.983116] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-25T22:10:38.296421] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-25T22:10:38.365352] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-25T22:10:38.455571] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:38.542502] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:10:38.543061] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-25T22:10:39.088783] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-25T22:10:39.888749] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-25T22:10:40.672269] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-25T22:10:40.688677] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-25T22:10:40.758184] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T22:10:40.771936] [INFO ] [REMOTE ] XFLT: Full fetch complete (44316 records). [2025-09-25T22:10:40.772191] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-25T22:10:41.173888] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-25T22:10:41.173984] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-25T22:10:41.174964] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-25T22:10:41.175032] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-25T22:10:41.176206] [DEBUG] [LOCAL ] XFLT: Trimmed 44316 records to 30152 (keeping 200 days of data) [2025-09-25T22:10:41.376890] [DEBUG] [LOCAL ] XFLT: Primary data saved (30152 records). [2025-09-25T22:10:41.377058] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-25T22:10:41.377168] [INFO ] [MAIN ] Update Progress: 2336/2372 symbols completed. XFLT took 32.9s. Estimated remaining: 4m 47s. Rate: 7.5 symbols/min [2025-09-25T22:10:41.495209] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-25T22:10:41.565703] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:41.617133] [DEBUG] [LOCAL ] XPER: Loaded 29606 existing records from primary storage. [2025-09-25T22:10:41.617351] [INFO ] [MAIN ] XPER: Loaded 29606 existing records. [2025-09-25T22:10:41.834187] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:41.834800] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-25T22:10:41.834878] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-25T22:10:41.835462] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-25T22:10:41.835537] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-25T22:10:42.065968] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-25T22:10:42.304150] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-25T22:10:42.355597] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:43.088762] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-25T22:10:43.182716] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-25T22:10:43.888741] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-25T22:10:44.020803] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T22:10:44.477691] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T22:10:44.688789] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-25T22:10:45.488881] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-25T22:10:46.247792] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T22:10:46.288690] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-25T22:10:46.399213] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-25T22:10:47.088728] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-25T22:10:47.413543] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-25T22:10:47.789333] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-25T22:10:47.797913] [INFO ] [REMOTE ] XHR: Full fetch complete (61529 records). [2025-09-25T22:10:47.798171] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-25T22:10:47.894740] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-25T22:10:48.271921] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-25T22:10:48.272044] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-25T22:10:48.273300] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-25T22:10:48.273397] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-25T22:10:48.277577] [DEBUG] [LOCAL ] XHR: Trimmed 61529 records to 44450 (keeping 200 days of data) [2025-09-25T22:10:48.415514] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-25T22:10:48.612615] [DEBUG] [LOCAL ] XHR: Primary data saved (44450 records). [2025-09-25T22:10:48.612807] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-25T22:10:48.613610] [INFO ] [MAIN ] Update Progress: 2337/2372 symbols completed. XHR took 24.3s. Estimated remaining: 4m 39s. Rate: 7.5 symbols/min [2025-09-25T22:10:48.689389] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-25T22:10:48.831013] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:10:48.907986] [DEBUG] [LOCAL ] XPEV: Loaded 53639 existing records from primary storage. [2025-09-25T22:10:48.908179] [INFO ] [MAIN ] XPEV: Loaded 53639 existing records. [2025-09-25T22:10:49.103481] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:10:49.104021] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-25T22:10:49.104083] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-25T22:10:49.104690] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-25T22:10:49.104769] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-25T22:10:49.494748] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-25T22:10:49.620437] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:10:49.652074] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T22:10:49.709023] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-25T22:10:50.288782] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-25T22:10:51.088774] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-25T22:10:51.406757] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-25T22:10:51.888734] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-25T22:10:52.014258] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-25T22:10:52.688778] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-25T22:10:52.858516] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-25T22:10:53.488804] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-25T22:10:53.705861] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-25T22:10:54.288711] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-25T22:10:54.334859] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-25T22:10:55.088763] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-25T22:10:55.152212] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-25T22:10:55.587190] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-25T22:10:55.888726] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-25T22:10:56.688788] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-25T22:10:56.844170] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-25T22:10:56.997814] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-25T22:10:57.488745] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-25T22:10:58.288768] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-25T22:10:58.743183] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-25T22:10:58.869283] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-25T22:10:59.088734] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-25T22:10:59.888732] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-25T22:11:00.695267] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-25T22:11:00.698708] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-25T22:11:01.279717] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-25T22:11:01.488764] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-25T22:11:01.511869] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-25T22:11:02.288744] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-25T22:11:02.455585] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T22:11:03.088735] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-25T22:11:03.888782] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-25T22:11:04.173027] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-25T22:11:04.203236] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T22:11:04.209788] [INFO ] [REMOTE ] XPER: Full fetch complete (43203 records). [2025-09-25T22:11:04.209972] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-25T22:11:04.662356] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-25T22:11:04.662560] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-25T22:11:04.663568] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-25T22:11:04.663665] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-25T22:11:04.664938] [DEBUG] [LOCAL ] XPER: Trimmed 43203 records to 29865 (keeping 200 days of data) [2025-09-25T22:11:04.711720] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-25T22:11:04.849939] [DEBUG] [LOCAL ] XPER: Primary data saved (29865 records). [2025-09-25T22:11:04.850113] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-25T22:11:04.850284] [INFO ] [MAIN ] Update Progress: 2338/2372 symbols completed. XPER took 23.5s. Estimated remaining: 4m 31s. Rate: 7.5 symbols/min [2025-09-25T22:11:05.052623] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-25T22:11:05.153616] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:05.158578] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-25T22:11:05.253298] [DEBUG] [LOCAL ] XPO: Loaded 48080 existing records from primary storage. [2025-09-25T22:11:05.253518] [INFO ] [MAIN ] XPO: Loaded 48080 existing records. [2025-09-25T22:11:05.489902] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-25T22:11:05.537329] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:05.542113] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-25T22:11:05.542256] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-25T22:11:05.542844] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-25T22:11:05.542950] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-25T22:11:06.087364] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:06.288794] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-25T22:11:07.088746] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-25T22:11:07.390068] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-25T22:11:07.804225] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T22:11:07.815679] [INFO ] [REMOTE ] XIFR: Full fetch complete (54935 records). [2025-09-25T22:11:07.815865] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-25T22:11:07.893728] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-25T22:11:07.982628] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-25T22:11:08.109612] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-25T22:11:08.110505] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:11:08.110615] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:11:08.110762] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-25T22:11:08.110860] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-25T22:11:08.110931] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-25T22:11:08.111028] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-25T22:11:08.111149] [INFO ] [MAIN ] Update Progress: 2339/2372 symbols completed. XIFR took 37.7s. Estimated remaining: 4m 23s. Rate: 7.5 symbols/min [2025-09-25T22:11:08.293987] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:08.351452] [DEBUG] [LOCAL ] XPOF: Loaded 38829 existing records from primary storage. [2025-09-25T22:11:08.351715] [INFO ] [MAIN ] XPOF: Loaded 38829 existing records. [2025-09-25T22:11:08.543801] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:08.544177] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-25T22:11:08.544236] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-25T22:11:08.544601] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-25T22:11:08.544703] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-25T22:11:08.694735] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-25T22:11:08.976591] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:09.078164] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-25T22:11:09.488827] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-25T22:11:10.288743] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-25T22:11:10.374078] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-25T22:11:10.778880] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-25T22:11:11.088792] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-25T22:11:11.153541] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-25T22:11:11.888735] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-25T22:11:11.997014] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T22:11:12.688751] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-25T22:11:13.117837] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-25T22:11:13.488717] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-25T22:11:13.999960] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-25T22:11:14.126865] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-25T22:11:14.288749] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-25T22:11:15.088741] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-25T22:11:15.886275] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-25T22:11:15.894053] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-25T22:11:16.401400] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-25T22:11:16.431838] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-25T22:11:16.688759] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-25T22:11:17.190494] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-25T22:11:17.488729] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-25T22:11:18.288705] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-25T22:11:18.429113] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-25T22:11:18.931499] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-25T22:11:19.039437] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T22:11:19.053945] [INFO ] [REMOTE ] XOM: Full fetch complete (77922 records). [2025-09-25T22:11:19.054108] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-25T22:11:19.090145] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-25T22:11:19.492881] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-25T22:11:19.492968] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-25T22:11:19.494300] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-25T22:11:19.494367] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-25T22:11:19.495990] [DEBUG] [LOCAL ] XOM: Trimmed 77922 records to 54183 (keeping 200 days of data) [2025-09-25T22:11:19.907898] [DEBUG] [LOCAL ] XOM: Primary data saved (54183 records). [2025-09-25T22:11:19.908076] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-25T22:11:19.908210] [INFO ] [MAIN ] Update Progress: 2340/2372 symbols completed. XOM took 42.4s. Estimated remaining: 4m 15s. Rate: 7.5 symbols/min [2025-09-25T22:11:19.904722] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-25T22:11:20.095405] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:20.144566] [DEBUG] [LOCAL ] XPRO: Loaded 45971 existing records from primary storage. [2025-09-25T22:11:20.144791] [INFO ] [MAIN ] XPRO: Loaded 45971 existing records. [2025-09-25T22:11:20.331317] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:20.331567] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-25T22:11:20.331611] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-25T22:11:20.332004] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-25T22:11:20.332065] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-25T22:11:20.688832] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-25T22:11:20.712488] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:21.337319] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-25T22:11:21.488674] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-25T22:11:21.717310] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-25T22:11:22.288723] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-25T22:11:22.589987] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-25T22:11:22.982678] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-25T22:11:23.088773] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-25T22:11:23.888758] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-25T22:11:24.647549] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-25T22:11:24.688724] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-25T22:11:24.839898] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-25T22:11:24.854189] [INFO ] [REMOTE ] XPEV: Full fetch complete (77680 records). [2025-09-25T22:11:24.854382] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-25T22:11:25.292444] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-25T22:11:25.292545] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-25T22:11:25.293819] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-25T22:11:25.293887] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-25T22:11:25.295691] [DEBUG] [LOCAL ] XPEV: Trimmed 77680 records to 54029 (keeping 200 days of data) [2025-09-25T22:11:25.436204] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-25T22:11:25.488678] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-25T22:11:25.701066] [DEBUG] [LOCAL ] XPEV: Primary data saved (54029 records). [2025-09-25T22:11:25.701245] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-25T22:11:25.702704] [INFO ] [MAIN ] Update Progress: 2341/2372 symbols completed. XPEV took 37.1s. Estimated remaining: 4m 7s. Rate: 7.5 symbols/min [2025-09-25T22:11:25.885103] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:25.929094] [DEBUG] [LOCAL ] XYF: Loaded 28209 existing records from primary storage. [2025-09-25T22:11:25.929260] [INFO ] [MAIN ] XYF: Loaded 28209 existing records. [2025-09-25T22:11:26.122027] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:26.122403] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-25T22:11:26.122454] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-25T22:11:26.122786] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-25T22:11:26.122888] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-25T22:11:26.296761] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-25T22:11:26.361099] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-25T22:11:26.561229] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:27.097711] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-25T22:11:27.119799] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-25T22:11:27.178790] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-25T22:11:27.888882] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-25T22:11:28.593584] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-25T22:11:28.688732] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-25T22:11:29.116126] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T22:11:29.488719] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-25T22:11:29.896604] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-25T22:11:30.288750] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-25T22:11:31.088734] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-25T22:11:31.161255] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T22:11:31.750096] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-25T22:11:31.888711] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-25T22:11:32.023932] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T22:11:32.688742] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-25T22:11:33.185216] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-25T22:11:33.222604] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-25T22:11:33.488696] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-25T22:11:34.288731] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-25T22:11:35.055524] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T22:11:35.088691] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-25T22:11:35.847709] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-25T22:11:35.888691] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-25T22:11:35.990175] [DEBUG] [REMOTE ] XPO: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-25T22:11:35.990558] [WARN ] [REMOTE ] XPO: No data returned for month 2025-09 [2025-09-25T22:11:35.990763] [INFO ] [REMOTE ] XPO: Full fetch complete (64151 records). [2025-09-25T22:11:35.990918] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-25T22:11:35.992172] [FATAL] [VALIDATOR ] XPO: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-25). Symbol may be delisted or halted. [2025-09-25T22:11:35.992397] [FATAL] [MAIN ] XPO: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:11:35.992479] [WARN ] [MAIN ] XPO: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:11:35.992568] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-25T22:11:35.992726] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-25T22:11:35.992816] [INFO ] [LOCAL ] XPO: Starting deletion of derivative data. [2025-09-25T22:11:35.995493] [DEBUG] [LOCAL ] XPO: Deleted derivative data file. [2025-09-25T22:11:35.995733] [INFO ] [MAIN ] Update Progress: 2342/2372 symbols completed. XPO took 31.1s. Estimated remaining: 3m 59s. Rate: 7.5 symbols/min [2025-09-25T22:11:36.215366] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:36.285762] [DEBUG] [LOCAL ] XYL: Loaded 48124 existing records from primary storage. [2025-09-25T22:11:36.285971] [INFO ] [MAIN ] XYL: Loaded 48124 existing records. [2025-09-25T22:11:36.493768] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:36.494174] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-25T22:11:36.494251] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-25T22:11:36.494638] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-25T22:11:36.494810] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-25T22:11:36.702384] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-25T22:11:36.761006] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-25T22:11:36.959775] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:37.488812] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-25T22:11:37.656489] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-25T22:11:38.288733] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-25T22:11:39.088744] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-25T22:11:39.272510] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T22:11:39.309793] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-25T22:11:39.888750] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-25T22:11:40.466300] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-25T22:11:40.476101] [INFO ] [REMOTE ] XPOF: Full fetch complete (52245 records). [2025-09-25T22:11:40.476270] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-25T22:11:40.706068] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-25T22:11:40.926992] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-25T22:11:40.927099] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-25T22:11:40.928503] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-25T22:11:40.928633] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-25T22:11:40.930433] [DEBUG] [LOCAL ] XPOF: Trimmed 52245 records to 39074 (keeping 200 days of data) [2025-09-25T22:11:41.183812] [DEBUG] [LOCAL ] XPOF: Primary data saved (39074 records). [2025-09-25T22:11:41.183971] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-25T22:11:41.184214] [INFO ] [MAIN ] Update Progress: 2343/2372 symbols completed. XPOF took 33.1s. Estimated remaining: 3m 51s. Rate: 7.5 symbols/min [2025-09-25T22:11:41.382784] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:41.383071] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-25T22:11:41.383128] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-25T22:11:41.383530] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-25T22:11:41.383577] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-25T22:11:41.383620] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-25T22:11:41.383679] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-25T22:11:41.492740] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-25T22:11:41.596376] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-25T22:11:41.736427] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-25T22:11:41.906725] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:42.288719] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-25T22:11:42.502296] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-25T22:11:42.502768] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-25T22:11:43.100674] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-25T22:11:43.128913] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T22:11:43.888779] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-25T22:11:44.451004] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-25T22:11:44.688755] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-25T22:11:45.248473] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-25T22:11:45.488741] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-25T22:11:45.549257] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-25T22:11:46.288847] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-25T22:11:47.088776] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-25T22:11:47.194282] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-25T22:11:47.888792] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-25T22:11:48.659394] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-25T22:11:48.688693] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-25T22:11:49.091458] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-25T22:11:49.443147] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-25T22:11:49.488737] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-25T22:11:49.767938] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-25T22:11:49.780339] [INFO ] [REMOTE ] XPRO: Full fetch complete (66603 records). [2025-09-25T22:11:49.780514] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-25T22:11:50.228037] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-25T22:11:50.228173] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-25T22:11:50.230094] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-25T22:11:50.230164] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-25T22:11:50.232079] [DEBUG] [LOCAL ] XPRO: Trimmed 66603 records to 46275 (keeping 200 days of data) [2025-09-25T22:11:50.289353] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-25T22:11:50.533803] [DEBUG] [LOCAL ] XPRO: Primary data saved (46275 records). [2025-09-25T22:11:50.534060] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-25T22:11:50.534245] [INFO ] [MAIN ] Update Progress: 2344/2372 symbols completed. XPRO took 30.6s. Estimated remaining: 3m 43s. Rate: 7.5 symbols/min [2025-09-25T22:11:50.714390] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:50.768299] [DEBUG] [LOCAL ] YALA: Loaded 37494 existing records from primary storage. [2025-09-25T22:11:50.768503] [INFO ] [MAIN ] YALA: Loaded 37494 existing records. [2025-09-25T22:11:50.967580] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:50.968026] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-25T22:11:50.968107] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-25T22:11:50.968483] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-25T22:11:50.968562] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-25T22:11:51.091814] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-25T22:11:51.181145] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-25T22:11:51.423268] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:51.863696] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-25T22:11:51.888675] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-25T22:11:52.688762] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-25T22:11:53.343776] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T22:11:53.354138] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-25T22:11:53.488732] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-25T22:11:54.288733] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-25T22:11:54.596881] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-25T22:11:54.624188] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-25T22:11:54.631469] [INFO ] [REMOTE ] XYF: Full fetch complete (31672 records). [2025-09-25T22:11:54.631612] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-25T22:11:55.070181] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-25T22:11:55.070299] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-25T22:11:55.071059] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-25T22:11:55.071127] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-25T22:11:55.072316] [DEBUG] [LOCAL ] XYF: Trimmed 31672 records to 28337 (keeping 200 days of data) [2025-09-25T22:11:55.137714] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-25T22:11:55.271880] [DEBUG] [LOCAL ] XYF: Primary data saved (28337 records). [2025-09-25T22:11:55.272057] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-25T22:11:55.272236] [INFO ] [MAIN ] Update Progress: 2345/2372 symbols completed. XYF took 29.6s. Estimated remaining: 3m 35s. Rate: 7.5 symbols/min [2025-09-25T22:11:55.478690] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:11:55.528516] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-25T22:11:55.569802] [DEBUG] [LOCAL ] YELP: Loaded 45313 existing records from primary storage. [2025-09-25T22:11:55.569974] [INFO ] [MAIN ] YELP: Loaded 45313 existing records. [2025-09-25T22:11:55.759041] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:11:55.759532] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-25T22:11:55.759708] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-25T22:11:55.760125] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-25T22:11:55.760186] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-25T22:11:55.902567] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-25T22:11:56.142855] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:11:56.688739] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-25T22:11:57.183145] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T22:11:57.291817] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T22:11:57.488736] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-25T22:11:57.658689] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T22:11:58.201559] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-25T22:11:58.288820] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-25T22:11:59.088762] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-25T22:11:59.888755] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-25T22:11:59.988976] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-25T22:12:00.374831] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-25T22:12:00.688740] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-25T22:12:01.249477] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-25T22:12:01.488745] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-25T22:12:02.288714] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-25T22:12:02.541012] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-25T22:12:03.088794] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-25T22:12:03.507728] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T22:12:03.888742] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-25T22:12:03.980052] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-25T22:12:04.688714] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-25T22:12:04.875506] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-25T22:12:05.488803] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-25T22:12:05.643874] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-25T22:12:06.288762] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-25T22:12:06.965044] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-25T22:12:06.969027] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-25T22:12:07.042406] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T22:12:07.063124] [INFO ] [REMOTE ] XYL: Full fetch complete (69911 records). [2025-09-25T22:12:07.063370] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-25T22:12:07.090937] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-25T22:12:07.515166] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-25T22:12:07.515344] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-25T22:12:07.516779] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-25T22:12:07.516885] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-25T22:12:07.519946] [DEBUG] [LOCAL ] XYL: Trimmed 69911 records to 48470 (keeping 200 days of data) [2025-09-25T22:12:07.881969] [DEBUG] [LOCAL ] XYL: Primary data saved (48470 records). [2025-09-25T22:12:07.882141] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-25T22:12:07.882287] [INFO ] [MAIN ] Update Progress: 2346/2372 symbols completed. XYL took 31.9s. Estimated remaining: 3m 28s. Rate: 7.5 symbols/min [2025-09-25T22:12:07.894828] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-25T22:12:08.086242] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:08.153261] [DEBUG] [LOCAL ] YETI: Loaded 52468 existing records from primary storage. [2025-09-25T22:12:08.153470] [INFO ] [MAIN ] YETI: Loaded 52468 existing records. [2025-09-25T22:12:08.343083] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:08.343697] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-25T22:12:08.343758] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-25T22:12:08.344102] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-25T22:12:08.344163] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-25T22:12:08.694740] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-25T22:12:08.733987] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:09.448853] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-25T22:12:09.488735] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-25T22:12:09.729900] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-25T22:12:10.116297] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-25T22:12:10.288742] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-25T22:12:10.881603] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-25T22:12:11.088744] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-25T22:12:11.888838] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-25T22:12:12.595990] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-25T22:12:12.688705] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-25T22:12:12.842533] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-25T22:12:13.442108] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-25T22:12:13.488709] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-25T22:12:13.933894] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-25T22:12:13.941820] [INFO ] [REMOTE ] YALA: Full fetch complete (46560 records). [2025-09-25T22:12:13.942029] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-25T22:12:14.295770] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-25T22:12:14.393913] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-25T22:12:14.394025] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-25T22:12:14.395192] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-25T22:12:14.395321] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-25T22:12:14.396850] [DEBUG] [LOCAL ] YALA: Trimmed 46560 records to 37777 (keeping 200 days of data) [2025-09-25T22:12:14.630085] [DEBUG] [LOCAL ] YALA: Primary data saved (37777 records). [2025-09-25T22:12:14.630255] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-25T22:12:14.630448] [INFO ] [MAIN ] Update Progress: 2347/2372 symbols completed. YALA took 24.1s. Estimated remaining: 3m 20s. Rate: 7.5 symbols/min [2025-09-25T22:12:14.838520] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:14.892794] [DEBUG] [LOCAL ] YEXT: Loaded 43265 existing records from primary storage. [2025-09-25T22:12:14.892998] [INFO ] [MAIN ] YEXT: Loaded 43265 existing records. [2025-09-25T22:12:15.093990] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-25T22:12:15.167630] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-25T22:12:15.239271] [INFO ] [REMOTE ] XYZ: Full fetch complete (67007 records). [2025-09-25T22:12:15.239516] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-25T22:12:15.260909] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:15.271256] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-25T22:12:15.276118] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-25T22:12:15.286373] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-25T22:12:15.335773] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-25T22:12:15.357376] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T22:12:15.718423] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-09-25T22:12:15.719187] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-25T22:12:15.719248] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-25T22:12:15.719291] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-25T22:12:15.719370] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-25T22:12:15.719428] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-25T22:12:15.719500] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-25T22:12:15.719592] [INFO ] [MAIN ] Update Progress: 2348/2372 symbols completed. XYZ took 34.5s. Estimated remaining: 3m 11s. Rate: 7.5 symbols/min [2025-09-25T22:12:15.895780] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-25T22:12:16.130639] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:16.142526] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:16.216006] [DEBUG] [LOCAL ] YMM: Loaded 52676 existing records from primary storage. [2025-09-25T22:12:16.216231] [INFO ] [MAIN ] YMM: Loaded 52676 existing records. [2025-09-25T22:12:16.411298] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:16.411636] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-25T22:12:16.411725] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-25T22:12:16.412017] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-25T22:12:16.412078] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-25T22:12:16.688777] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-25T22:12:16.659551] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-25T22:12:16.879414] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:17.304378] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-25T22:12:17.488736] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-25T22:12:18.288774] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-25T22:12:18.367380] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-25T22:12:19.088713] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-25T22:12:19.295488] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-25T22:12:19.401613] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-25T22:12:19.888766] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-25T22:12:20.538830] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-25T22:12:20.688738] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-25T22:12:21.488751] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-25T22:12:21.708225] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-25T22:12:22.240089] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-25T22:12:22.288731] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-25T22:12:23.088775] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-25T22:12:23.250803] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-25T22:12:23.774447] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-25T22:12:23.888742] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-25T22:12:24.688728] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-25T22:12:24.869269] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-25T22:12:25.488753] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-25T22:12:25.655781] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-25T22:12:26.288740] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-25T22:12:26.491950] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-25T22:12:27.095105] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-25T22:12:27.114429] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-25T22:12:27.573017] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-25T22:12:27.888766] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-25T22:12:28.570182] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-25T22:12:28.688754] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-25T22:12:29.374881] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-25T22:12:29.488770] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-25T22:12:30.288762] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-25T22:12:30.433131] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-25T22:12:31.088783] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-25T22:12:31.228895] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-25T22:12:31.888689] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-25T22:12:31.932887] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-25T22:12:31.944562] [INFO ] [REMOTE ] YELP: Full fetch complete (64224 records). [2025-09-25T22:12:31.945882] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-25T22:12:32.421677] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-25T22:12:32.421802] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-25T22:12:32.422990] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-25T22:12:32.423059] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-25T22:12:32.427250] [DEBUG] [LOCAL ] YELP: Trimmed 64224 records to 45619 (keeping 200 days of data) [2025-09-25T22:12:32.692726] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-25T22:12:32.756822] [DEBUG] [LOCAL ] YELP: Primary data saved (45619 records). [2025-09-25T22:12:32.757030] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-25T22:12:32.758421] [INFO ] [MAIN ] Update Progress: 2349/2372 symbols completed. YELP took 37.5s. Estimated remaining: 3m 4s. Rate: 7.5 symbols/min [2025-09-25T22:12:32.951789] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:33.027853] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-25T22:12:33.083202] [DEBUG] [LOCAL ] YOU: Loaded 49833 existing records from primary storage. [2025-09-25T22:12:33.083387] [INFO ] [MAIN ] YOU: Loaded 49833 existing records. [2025-09-25T22:12:33.275800] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:33.276204] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-25T22:12:33.276280] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-25T22:12:33.276735] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-25T22:12:33.276817] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-25T22:12:33.490179] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-25T22:12:33.531697] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-25T22:12:33.745759] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:33.848355] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-25T22:12:34.288726] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-25T22:12:35.088717] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-25T22:12:35.288302] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-25T22:12:35.576119] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-25T22:12:35.888731] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-25T22:12:36.620936] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-25T22:12:36.688714] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-25T22:12:37.488719] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-25T22:12:37.584145] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-25T22:12:38.288712] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-25T22:12:38.532840] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-25T22:12:39.088735] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-25T22:12:39.283758] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-25T22:12:39.896509] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-25T22:12:39.916007] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T22:12:40.688744] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-25T22:12:40.804173] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-25T22:12:41.488739] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-25T22:12:41.725607] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-25T22:12:41.898483] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-25T22:12:42.288754] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-25T22:12:43.088722] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-25T22:12:43.313273] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-25T22:12:43.339415] [INFO ] [REMOTE ] YETI: Full fetch complete (75396 records). [2025-09-25T22:12:43.339714] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-25T22:12:43.791692] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-25T22:12:43.791817] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-25T22:12:43.793105] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-25T22:12:43.793192] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-25T22:12:43.794996] [DEBUG] [LOCAL ] YETI: Trimmed 75396 records to 52840 (keeping 200 days of data) [2025-09-25T22:12:43.911741] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-25T22:12:44.180128] [DEBUG] [LOCAL ] YETI: Primary data saved (52840 records). [2025-09-25T22:12:44.180337] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-25T22:12:44.180497] [INFO ] [MAIN ] Update Progress: 2350/2372 symbols completed. YETI took 36.3s. Estimated remaining: 2m 56s. Rate: 7.5 symbols/min [2025-09-25T22:12:44.394694] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-25T22:12:44.412950] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:44.429745] [INFO ] [REMOTE ] YMM: Full fetch complete (76420 records). [2025-09-25T22:12:44.429975] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-25T22:12:44.550586] [DEBUG] [LOCAL ] YPF: Loaded 50499 existing records from primary storage. [2025-09-25T22:12:44.554104] [INFO ] [MAIN ] YPF: Loaded 50499 existing records. [2025-09-25T22:12:45.021939] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:45.053330] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-25T22:12:45.053493] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-25T22:12:45.070406] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-25T22:12:45.070498] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-25T22:12:45.092714] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-25T22:12:45.112638] [INFO ] [REMOTE ] YEXT: Full fetch complete (63513 records). [2025-09-25T22:12:45.112875] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-25T22:12:45.070317] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-25T22:12:45.196914] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-25T22:12:45.625946] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-25T22:12:45.626150] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-25T22:12:45.627984] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-25T22:12:45.628083] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-25T22:12:45.636082] [DEBUG] [LOCAL ] YMM: Trimmed 76420 records to 53043 (keeping 200 days of data) [2025-09-25T22:12:46.501548] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:46.501999] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-25T22:12:46.535354] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-25T22:12:46.535440] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-25T22:12:46.536820] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-25T22:12:46.536921] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-25T22:12:46.541138] [DEBUG] [LOCAL ] YEXT: Trimmed 63513 records to 43579 (keeping 200 days of data) [2025-09-25T22:12:46.560682] [DEBUG] [LOCAL ] YMM: Primary data saved (53043 records). [2025-09-25T22:12:46.560840] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-25T22:12:46.561126] [INFO ] [MAIN ] Update Progress: 2351/2372 symbols completed. YMM took 30.8s. Estimated remaining: 2m 48s. Rate: 7.5 symbols/min [2025-09-25T22:12:47.107089] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:47.116262] [DEBUG] [LOCAL ] YEXT: Primary data saved (43579 records). [2025-09-25T22:12:47.116419] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-25T22:12:47.116615] [INFO ] [MAIN ] Update Progress: 2352/2372 symbols completed. YEXT took 32.5s. Estimated remaining: 2m 40s. Rate: 7.5 symbols/min [2025-09-25T22:12:47.158601] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-25T22:12:47.185068] [DEBUG] [LOCAL ] YRD: Loaded 12584 existing records from primary storage. [2025-09-25T22:12:47.185173] [INFO ] [MAIN ] YRD: Loaded 12584 existing records. [2025-09-25T22:12:47.225617] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-25T22:12:47.539766] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:12:47.578030] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:47.578354] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-25T22:12:47.578405] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-25T22:12:47.578760] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-25T22:12:47.578823] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-25T22:12:47.604197] [DEBUG] [LOCAL ] YSG: Loaded 25192 existing records from primary storage. [2025-09-25T22:12:47.604345] [INFO ] [MAIN ] YSG: Loaded 25192 existing records. [2025-09-25T22:12:48.093179] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:12:48.093589] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-25T22:12:48.093677] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-25T22:12:48.094060] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-25T22:12:48.094122] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-25T22:12:48.343595] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-25T22:12:48.435110] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-25T22:12:48.495358] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:48.511813] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-25T22:12:48.724269] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:12:48.724634] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-25T22:12:49.023777] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T22:12:49.128064] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-25T22:12:49.488886] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-25T22:12:49.792472] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-25T22:12:50.067941] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-25T22:12:50.288762] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-25T22:12:50.887260] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-25T22:12:51.088825] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-25T22:12:51.214423] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-25T22:12:51.799250] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-25T22:12:51.888792] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-25T22:12:52.688702] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-25T22:12:52.923931] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-25T22:12:53.488747] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-25T22:12:54.288794] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-25T22:12:54.439491] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-25T22:12:54.573892] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-25T22:12:55.088775] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-25T22:12:55.169017] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-25T22:12:55.888761] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-25T22:12:56.080394] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-25T22:12:56.688764] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-25T22:12:56.973037] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-25T22:12:57.488746] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-25T22:12:57.505800] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-25T22:12:58.288774] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-25T22:12:59.088746] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-25T22:12:59.249965] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-25T22:12:59.498310] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-25T22:12:59.888764] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-25T22:13:00.688716] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-25T22:13:00.804722] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-25T22:13:00.846576] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-25T22:13:01.269491] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T22:13:01.488769] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-25T22:13:02.288731] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-25T22:13:03.088708] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-25T22:13:03.132956] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T22:13:03.879022] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-25T22:13:03.888669] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-25T22:13:04.142320] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-25T22:13:04.595405] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-25T22:13:04.688708] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-25T22:13:05.488769] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-25T22:13:06.288707] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-25T22:13:06.331072] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-25T22:13:06.687331] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-25T22:13:07.088695] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-25T22:13:07.098097] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-25T22:13:07.101325] [INFO ] [REMOTE ] YRD: Full fetch complete (19149 records). [2025-09-25T22:13:07.101491] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-25T22:13:07.533941] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-25T22:13:07.534997] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-25T22:13:07.535535] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-25T22:13:07.535599] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-25T22:13:07.536283] [DEBUG] [LOCAL ] YRD: Trimmed 19149 records to 12668 (keeping 200 days of data) [2025-09-25T22:13:07.618267] [DEBUG] [LOCAL ] YRD: Primary data saved (12668 records). [2025-09-25T22:13:07.618422] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-25T22:13:07.618569] [INFO ] [MAIN ] Update Progress: 2353/2372 symbols completed. YRD took 21.1s. Estimated remaining: 2m 32s. Rate: 7.5 symbols/min [2025-09-25T22:13:07.845684] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:07.892720] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-25T22:13:07.920589] [DEBUG] [LOCAL ] YUM: Loaded 51236 existing records from primary storage. [2025-09-25T22:13:07.920806] [INFO ] [MAIN ] YUM: Loaded 51236 existing records. [2025-09-25T22:13:08.113786] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:08.114178] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-25T22:13:08.114295] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-25T22:13:08.115042] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-25T22:13:08.115146] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-25T22:13:08.504689] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:08.688724] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-25T22:13:08.983579] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T22:13:09.195199] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-25T22:13:09.488767] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-25T22:13:10.288702] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-25T22:13:10.420790] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-25T22:13:10.775231] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-25T22:13:10.781400] [INFO ] [REMOTE ] YSG: Full fetch complete (32661 records). [2025-09-25T22:13:10.781511] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-25T22:13:11.095745] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-25T22:13:11.190310] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-25T22:13:11.190393] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-25T22:13:11.191090] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-25T22:13:11.191152] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-25T22:13:11.193528] [DEBUG] [LOCAL ] YSG: Trimmed 32661 records to 25342 (keeping 200 days of data) [2025-09-25T22:13:11.355445] [DEBUG] [LOCAL ] YSG: Primary data saved (25342 records). [2025-09-25T22:13:11.355590] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-25T22:13:11.355726] [INFO ] [MAIN ] Update Progress: 2354/2372 symbols completed. YSG took 24.2s. Estimated remaining: 2m 24s. Rate: 7.5 symbols/min [2025-09-25T22:13:11.546005] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:11.612086] [DEBUG] [LOCAL ] YUMC: Loaded 52698 existing records from primary storage. [2025-09-25T22:13:11.612244] [INFO ] [MAIN ] YUMC: Loaded 52698 existing records. [2025-09-25T22:13:11.807722] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:11.808234] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-25T22:13:11.808290] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-25T22:13:11.808596] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-25T22:13:11.808696] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-25T22:13:11.904729] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-25T22:13:12.241085] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-25T22:13:12.275225] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:12.688738] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-25T22:13:13.029036] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-25T22:13:13.488725] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-25T22:13:13.550425] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-25T22:13:13.567036] [INFO ] [REMOTE ] YOU: Full fetch complete (72146 records). [2025-09-25T22:13:13.567219] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-25T22:13:14.019324] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-25T22:13:14.019428] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-25T22:13:14.020629] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-25T22:13:14.020732] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-25T22:13:14.025312] [DEBUG] [LOCAL ] YOU: Trimmed 72146 records to 50190 (keeping 200 days of data) [2025-09-25T22:13:14.288762] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-25T22:13:14.405177] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-25T22:13:14.441325] [DEBUG] [LOCAL ] YOU: Primary data saved (50190 records). [2025-09-25T22:13:14.441518] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-25T22:13:14.442490] [INFO ] [MAIN ] Update Progress: 2355/2372 symbols completed. YOU took 41.7s. Estimated remaining: 2m 16s. Rate: 7.5 symbols/min [2025-09-25T22:13:14.630205] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:14.719894] [DEBUG] [LOCAL ] ZBH: Loaded 51231 existing records from primary storage. [2025-09-25T22:13:14.720054] [INFO ] [MAIN ] ZBH: Loaded 51231 existing records. [2025-09-25T22:13:14.923226] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:14.924332] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-25T22:13:14.924393] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-25T22:13:14.924736] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-25T22:13:14.924798] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-25T22:13:15.089709] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-25T22:13:15.354945] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-25T22:13:15.371250] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:15.888738] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-25T22:13:16.193217] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-25T22:13:16.600692] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-25T22:13:16.688736] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-25T22:13:17.276002] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-25T22:13:17.488758] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-25T22:13:17.905171] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-25T22:13:18.288745] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-25T22:13:19.088771] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-25T22:13:19.362306] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-25T22:13:19.770107] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-25T22:13:19.888738] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-25T22:13:20.688977] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-25T22:13:20.698593] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-25T22:13:21.488752] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-25T22:13:21.571463] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-25T22:13:22.205673] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-25T22:13:22.288702] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-25T22:13:23.033442] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-25T22:13:23.043720] [INFO ] [REMOTE ] YPF: Full fetch complete (73517 records). [2025-09-25T22:13:23.043947] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-25T22:13:23.098094] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-25T22:13:23.510789] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-25T22:13:23.510929] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-25T22:13:23.512187] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-25T22:13:23.512315] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-25T22:13:23.514328] [DEBUG] [LOCAL ] YPF: Trimmed 73517 records to 50878 (keeping 200 days of data) [2025-09-25T22:13:23.866931] [DEBUG] [LOCAL ] YPF: Primary data saved (50878 records). [2025-09-25T22:13:23.867107] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-25T22:13:23.867325] [INFO ] [MAIN ] Update Progress: 2356/2372 symbols completed. YPF took 39.7s. Estimated remaining: 2m 8s. Rate: 7.5 symbols/min [2025-09-25T22:13:23.900855] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-25T22:13:24.081315] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:24.103082] [DEBUG] [LOCAL ] ZEPP: Loaded 16916 existing records from primary storage. [2025-09-25T22:13:24.103228] [INFO ] [MAIN ] ZEPP: Loaded 16916 existing records. [2025-09-25T22:13:24.311323] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:24.311926] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-25T22:13:24.311998] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-25T22:13:24.312421] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-25T22:13:24.312493] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-25T22:13:24.417596] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-25T22:13:24.605326] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-25T22:13:24.692388] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-25T22:13:24.835553] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:25.488737] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-25T22:13:25.759331] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-25T22:13:26.288805] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-25T22:13:26.451383] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-25T22:13:26.931262] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T22:13:27.088729] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-25T22:13:27.888708] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-25T22:13:28.281245] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-25T22:13:28.392662] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-25T22:13:28.688734] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-25T22:13:28.806208] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-25T22:13:29.490510] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-25T22:13:30.263465] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T22:13:30.288692] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-25T22:13:30.749693] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-25T22:13:31.088780] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-25T22:13:31.233985] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-25T22:13:31.888836] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-25T22:13:32.637809] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-25T22:13:32.649003] [INFO ] [REMOTE ] YUM: Full fetch complete (74385 records). [2025-09-25T22:13:32.649196] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-25T22:13:32.693809] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-25T22:13:33.117395] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-25T22:13:33.117508] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-25T22:13:33.118755] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-25T22:13:33.118832] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-25T22:13:33.134936] [DEBUG] [LOCAL ] YUM: Trimmed 74385 records to 51593 (keeping 200 days of data) [2025-09-25T22:13:33.388413] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-25T22:13:33.497408] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-25T22:13:33.547710] [DEBUG] [LOCAL ] YUM: Primary data saved (51593 records). [2025-09-25T22:13:33.547864] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-25T22:13:33.548037] [INFO ] [MAIN ] Update Progress: 2357/2372 symbols completed. YUM took 25.9s. Estimated remaining: 1m 60s. Rate: 7.5 symbols/min [2025-09-25T22:13:34.288732] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-25T22:13:34.336609] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T22:13:34.762242] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-25T22:13:34.980827] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-25T22:13:35.088752] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-25T22:13:35.888749] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-25T22:13:36.688805] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-25T22:13:37.060896] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-25T22:13:37.198119] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-25T22:13:37.488743] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-25T22:13:37.897578] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-25T22:13:38.288756] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-25T22:13:38.998354] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-25T22:13:39.088762] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-25T22:13:39.622835] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-25T22:13:39.888696] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-25T22:13:40.021444] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-25T22:13:40.305397] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-25T22:13:40.688748] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-25T22:13:41.488801] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-25T22:13:42.128199] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T22:13:42.288821] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-25T22:13:43.088723] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-25T22:13:43.235339] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T22:13:43.382935] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-25T22:13:43.888737] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-25T22:13:44.688751] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-25T22:13:44.837191] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-25T22:13:45.156480] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-25T22:13:45.163763] [INFO ] [REMOTE ] ZEPP: Full fetch complete (18457 records). [2025-09-25T22:13:45.163852] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-25T22:13:45.494735] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-25T22:13:45.589279] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-25T22:13:45.589376] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-25T22:13:45.589854] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-25T22:13:45.589917] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-25T22:13:45.590555] [DEBUG] [LOCAL ] ZEPP: Trimmed 18457 records to 17114 (keeping 200 days of data) [2025-09-25T22:13:45.695828] [DEBUG] [LOCAL ] ZEPP: Primary data saved (17114 records). [2025-09-25T22:13:45.695996] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-25T22:13:45.696145] [INFO ] [MAIN ] Update Progress: 2358/2372 symbols completed. ZEPP took 21.8s. Estimated remaining: 1m 52s. Rate: 7.5 symbols/min [2025-09-25T22:13:46.502166] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-25T22:13:46.515753] [INFO ] [REMOTE ] YUMC: Full fetch complete (76183 records). [2025-09-25T22:13:46.515947] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-25T22:13:46.989574] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-25T22:13:46.989746] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-25T22:13:46.991868] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-25T22:13:46.991953] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-25T22:13:47.019144] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-25T22:13:47.029822] [DEBUG] [LOCAL ] YUMC: Trimmed 76183 records to 53072 (keeping 200 days of data) [2025-09-25T22:13:47.035623] [INFO ] [REMOTE ] ZBH: Full fetch complete (73859 records). [2025-09-25T22:13:47.035901] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-25T22:13:47.777827] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-25T22:13:47.777964] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-25T22:13:47.779201] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-25T22:13:47.779267] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-25T22:13:47.796599] [DEBUG] [LOCAL ] ZBH: Trimmed 73859 records to 51599 (keeping 200 days of data) [2025-09-25T22:13:48.032602] [DEBUG] [LOCAL ] YUMC: Primary data saved (53072 records). [2025-09-25T22:13:48.032920] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-25T22:13:48.033131] [INFO ] [MAIN ] Update Progress: 2359/2372 symbols completed. YUMC took 36.7s. Estimated remaining: 1m 44s. Rate: 7.5 symbols/min [2025-09-25T22:13:48.258082] [DEBUG] [LOCAL ] ZBH: Primary data saved (51599 records). [2025-09-25T22:13:48.258239] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-25T22:13:48.259279] [INFO ] [MAIN ] Update Progress: 2360/2372 symbols completed. ZBH took 33.8s. Estimated remaining: 1m 36s. Rate: 7.5 symbols/min [2025-09-25T22:13:48.974784] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:48.994061] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:49.024682] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:49.079878] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:13:49.082573] [DEBUG] [LOCAL ] ZH: Loaded 26784 existing records from primary storage. [2025-09-25T22:13:49.083755] [INFO ] [MAIN ] ZH: Loaded 26784 existing records. [2025-09-25T22:13:49.248303] [DEBUG] [LOCAL ] ZGN: Loaded 40828 existing records from primary storage. [2025-09-25T22:13:49.248486] [INFO ] [MAIN ] ZGN: Loaded 40828 existing records. [2025-09-25T22:13:49.335676] [DEBUG] [LOCAL ] ZIM: Loaded 53525 existing records from primary storage. [2025-09-25T22:13:49.335864] [INFO ] [MAIN ] ZIM: Loaded 53525 existing records. [2025-09-25T22:13:49.444586] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-25T22:13:49.444798] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-25T22:13:50.042485] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:50.042823] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-25T22:13:50.042896] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-25T22:13:50.043399] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-25T22:13:50.043481] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-25T22:13:50.056249] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:50.063056] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-25T22:13:50.063113] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-25T22:13:50.063381] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-25T22:13:50.063444] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-25T22:13:50.141772] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:50.149351] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-25T22:13:50.149426] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-25T22:13:50.149863] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-25T22:13:50.149925] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-25T22:13:50.173560] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:13:50.198297] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-25T22:13:50.198345] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-25T22:13:50.198626] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-25T22:13:50.198730] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-25T22:13:51.776843] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:51.777372] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-25T22:13:51.801420] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:51.798597] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:51.802098] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-25T22:13:51.801859] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-25T22:13:51.796444] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:13:51.805116] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-25T22:13:53.207474] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-25T22:13:53.212790] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-25T22:13:53.555789] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-25T22:13:53.565311] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-25T22:13:53.872301] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-25T22:13:53.877215] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-25T22:13:53.942149] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-25T22:13:53.953577] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-25T22:13:54.583061] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-25T22:13:54.595868] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-25T22:13:54.625323] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-25T22:13:54.639752] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-25T22:13:55.435302] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T22:13:55.447439] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-25T22:13:55.903740] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-25T22:13:55.917996] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-25T22:13:56.007555] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-25T22:13:56.015896] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-25T22:13:56.520258] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-25T22:13:56.688692] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-25T22:13:56.826885] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-25T22:13:57.487386] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-25T22:13:57.496475] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-25T22:13:57.528429] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-25T22:13:58.288753] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-25T22:13:58.990156] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-25T22:13:59.092564] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-25T22:13:59.105363] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-25T22:13:59.507871] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-25T22:13:59.888740] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-25T22:14:00.688747] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-25T22:14:01.494248] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-25T22:14:01.515119] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-25T22:14:01.635546] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-25T22:14:01.775822] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T22:14:02.288786] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-25T22:14:03.082036] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-25T22:14:03.095727] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-25T22:14:03.888694] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-25T22:14:04.126341] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-25T22:14:04.351243] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-25T22:14:04.688737] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-25T22:14:05.488789] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-25T22:14:05.782021] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-25T22:14:06.288815] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-25T22:14:06.880782] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T22:14:07.088732] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-25T22:14:07.334794] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-25T22:14:07.438332] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-25T22:14:07.888746] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-25T22:14:08.220236] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-25T22:14:08.688730] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-25T22:14:09.488797] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-25T22:14:09.950089] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-25T22:14:09.960594] [INFO ] [REMOTE ] ZH: Full fetch complete (40162 records). [2025-09-25T22:14:09.960854] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-25T22:14:10.294430] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-25T22:14:10.302796] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-25T22:14:10.472842] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-25T22:14:10.473799] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-25T22:14:10.474985] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-25T22:14:10.475106] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-25T22:14:10.476346] [DEBUG] [LOCAL ] ZH: Trimmed 40162 records to 27089 (keeping 200 days of data) [2025-09-25T22:14:10.646419] [DEBUG] [LOCAL ] ZH: Primary data saved (27089 records). [2025-09-25T22:14:10.646605] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-25T22:14:10.646843] [INFO ] [MAIN ] Update Progress: 2361/2372 symbols completed. ZH took 22.4s. Estimated remaining: 1m 28s. Rate: 7.5 symbols/min [2025-09-25T22:14:10.844690] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:10.903541] [DEBUG] [LOCAL ] ZIP: Loaded 44382 existing records from primary storage. [2025-09-25T22:14:10.903774] [INFO ] [MAIN ] ZIP: Loaded 44382 existing records. [2025-09-25T22:14:11.088803] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-25T22:14:11.124209] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:11.124531] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-25T22:14:11.124589] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-25T22:14:11.126684] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-25T22:14:11.127118] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-25T22:14:11.543749] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:11.626512] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-25T22:14:11.888796] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-25T22:14:11.927470] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-25T22:14:12.689158] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-25T22:14:12.869105] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-25T22:14:13.488855] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-25T22:14:13.494369] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-25T22:14:14.146851] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-25T22:14:14.288713] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-25T22:14:14.856220] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-25T22:14:15.088759] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-25T22:14:15.737748] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T22:14:15.747257] [INFO ] [REMOTE ] ZGN: Full fetch complete (58248 records). [2025-09-25T22:14:15.747400] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-25T22:14:15.893843] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-25T22:14:16.207257] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-25T22:14:16.207375] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-25T22:14:16.208615] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-25T22:14:16.208714] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-25T22:14:16.211496] [DEBUG] [LOCAL ] ZGN: Trimmed 58248 records to 41076 (keeping 200 days of data) [2025-09-25T22:14:16.494961] [DEBUG] [LOCAL ] ZGN: Primary data saved (41076 records). [2025-09-25T22:14:16.495186] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-25T22:14:16.495391] [INFO ] [MAIN ] Update Progress: 2362/2372 symbols completed. ZGN took 28.2s. Estimated remaining: 1m 20s. Rate: 7.5 symbols/min [2025-09-25T22:14:16.683126] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:16.688749] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-25T22:14:16.737010] [DEBUG] [LOCAL ] ZK: Loaded 40087 existing records from primary storage. [2025-09-25T22:14:16.737202] [INFO ] [MAIN ] ZK: Loaded 40087 existing records. [2025-09-25T22:14:16.949365] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:16.949720] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-25T22:14:16.949789] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-25T22:14:16.950300] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-25T22:14:16.950383] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-25T22:14:17.187582] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-25T22:14:17.209737] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-25T22:14:17.451070] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:17.488738] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-25T22:14:18.288816] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-25T22:14:18.944459] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-25T22:14:19.088732] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-25T22:14:19.207904] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-25T22:14:19.888759] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-25T22:14:20.290636] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-25T22:14:20.468712] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-25T22:14:20.688741] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-25T22:14:21.206298] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-25T22:14:21.488758] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-25T22:14:22.288799] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-25T22:14:23.088724] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-25T22:14:23.193271] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-25T22:14:23.447379] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-25T22:14:23.462805] [INFO ] [REMOTE ] ZIM: Full fetch complete (77504 records). [2025-09-25T22:14:23.463035] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-25T22:14:23.858568] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-25T22:14:23.902601] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-25T22:14:23.977618] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-25T22:14:23.978312] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-25T22:14:23.979738] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-25T22:14:23.979817] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-25T22:14:23.981573] [DEBUG] [LOCAL ] ZIM: Trimmed 77504 records to 53915 (keeping 200 days of data) [2025-09-25T22:14:24.098479] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-25T22:14:24.416044] [DEBUG] [LOCAL ] ZIM: Primary data saved (53915 records). [2025-09-25T22:14:24.416339] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-25T22:14:24.416601] [INFO ] [MAIN ] Update Progress: 2363/2372 symbols completed. ZIM took 36.2s. Estimated remaining: 1m 12s. Rate: 7.5 symbols/min [2025-09-25T22:14:24.597456] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:24.612539] [DEBUG] [LOCAL ] ZKH: Loaded 8000 existing records from primary storage. [2025-09-25T22:14:24.612724] [INFO ] [MAIN ] ZKH: Loaded 8000 existing records. [2025-09-25T22:14:24.693826] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-25T22:14:24.813312] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:24.813703] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-25T22:14:24.813800] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-25T22:14:24.814110] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-25T22:14:24.814169] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-25T22:14:25.215584] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:25.339068] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-25T22:14:25.488736] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-25T22:14:26.052518] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-25T22:14:26.288751] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-25T22:14:26.629339] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-25T22:14:26.642694] [INFO ] [REMOTE ] ZETA: Full fetch complete (77678 records). [2025-09-25T22:14:26.642959] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-25T22:14:27.062288] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-25T22:14:27.062385] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-25T22:14:27.063591] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-25T22:14:27.063687] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-25T22:14:27.065826] [DEBUG] [LOCAL ] ZETA: Trimmed 77678 records to 53985 (keeping 200 days of data) [2025-09-25T22:14:27.127479] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-25T22:14:27.439451] [DEBUG] [LOCAL ] ZETA: Primary data saved (53985 records). [2025-09-25T22:14:27.439672] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-25T22:14:27.439819] [INFO ] [MAIN ] Update Progress: 2364/2372 symbols completed. ZETA took 39.2s. Estimated remaining: 1m 4s. Rate: 7.5 symbols/min [2025-09-25T22:14:27.614936] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-25T22:14:27.675899] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:27.750666] [DEBUG] [LOCAL ] ZTO: Loaded 49977 existing records from primary storage. [2025-09-25T22:14:27.750904] [INFO ] [MAIN ] ZTO: Loaded 49977 existing records. [2025-09-25T22:14:27.883874] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-25T22:14:27.893823] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-25T22:14:27.987694] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:27.988057] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-25T22:14:27.988144] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-25T22:14:27.989147] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-25T22:14:27.989237] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-25T22:14:28.438332] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:28.688764] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-25T22:14:29.488709] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-25T22:14:29.671970] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-25T22:14:30.288796] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-25T22:14:30.461102] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-25T22:14:30.494829] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-25T22:14:31.088769] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-25T22:14:31.871751] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-25T22:14:31.888731] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-25T22:14:32.084581] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-25T22:14:32.396711] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-25T22:14:32.688727] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-25T22:14:33.488754] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-25T22:14:34.064505] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-25T22:14:34.288740] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-25T22:14:34.890248] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-25T22:14:35.088723] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-25T22:14:35.228960] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-25T22:14:35.670064] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-25T22:14:35.888743] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-25T22:14:36.688785] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-25T22:14:36.861886] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-25T22:14:37.488723] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-25T22:14:38.086192] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-25T22:14:38.129809] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-25T22:14:38.288702] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-25T22:14:39.088765] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-25T22:14:39.887900] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-25T22:14:39.897863] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-25T22:14:40.688707] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-25T22:14:40.869612] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-25T22:14:40.939637] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-25T22:14:41.488751] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-25T22:14:41.795445] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-25T22:14:41.803826] [INFO ] [REMOTE ] ZIP: Full fetch complete (59392 records). [2025-09-25T22:14:41.804005] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-25T22:14:42.230593] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-25T22:14:42.230845] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-25T22:14:42.240971] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-25T22:14:42.241069] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-25T22:14:42.243045] [DEBUG] [LOCAL ] ZIP: Trimmed 59392 records to 44679 (keeping 200 days of data) [2025-09-25T22:14:42.329963] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-25T22:14:42.588540] [DEBUG] [LOCAL ] ZIP: Primary data saved (44679 records). [2025-09-25T22:14:42.588761] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-25T22:14:42.588893] [INFO ] [MAIN ] Update Progress: 2365/2372 symbols completed. ZIP took 31.9s. Estimated remaining: 55.9s. Rate: 7.5 symbols/min [2025-09-25T22:14:42.778048] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:42.801490] [DEBUG] [LOCAL ] ZTR: Loaded 16705 existing records from primary storage. [2025-09-25T22:14:42.804719] [INFO ] [MAIN ] ZTR: Loaded 16705 existing records. [2025-09-25T22:14:43.004400] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:43.005127] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-25T22:14:43.005179] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-25T22:14:43.005625] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-25T22:14:43.005726] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-25T22:14:43.044739] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-25T22:14:43.047049] [INFO ] [REMOTE ] ZKH: Full fetch complete (11939 records). [2025-09-25T22:14:43.047125] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-25T22:14:43.093763] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-25T22:14:43.184928] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-25T22:14:43.921378] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-25T22:14:43.930466] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-25T22:14:43.930566] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-25T22:14:43.930985] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-25T22:14:43.931051] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-25T22:14:43.931637] [DEBUG] [LOCAL ] ZKH: Trimmed 11939 records to 8074 (keeping 200 days of data) [2025-09-25T22:14:44.012436] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:44.027242] [DEBUG] [LOCAL ] ZKH: Primary data saved (8074 records). [2025-09-25T22:14:44.027472] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-25T22:14:44.027598] [INFO ] [MAIN ] Update Progress: 2366/2372 symbols completed. ZKH took 19.6s. Estimated remaining: 47.9s. Rate: 7.5 symbols/min [2025-09-25T22:14:44.234935] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:44.288106] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-25T22:14:44.342246] [DEBUG] [LOCAL ] ZTS: Loaded 53002 existing records from primary storage. [2025-09-25T22:14:44.342606] [INFO ] [MAIN ] ZTS: Loaded 53002 existing records. [2025-09-25T22:14:44.532062] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:44.532405] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-25T22:14:44.532452] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-25T22:14:44.532834] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-25T22:14:44.532897] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-25T22:14:44.694741] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-25T22:14:44.935796] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:45.488740] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-25T22:14:45.652486] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-25T22:14:45.982837] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-25T22:14:46.288756] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-25T22:14:47.088771] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-25T22:14:47.360839] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-25T22:14:47.735043] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-25T22:14:47.746951] [INFO ] [REMOTE ] ZK: Full fetch complete (57383 records). [2025-09-25T22:14:47.747142] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-25T22:14:47.893857] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-25T22:14:48.192331] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-25T22:14:48.192439] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-25T22:14:48.193825] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-25T22:14:48.193908] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-25T22:14:48.196220] [DEBUG] [LOCAL ] ZK: Trimmed 57383 records to 40293 (keeping 200 days of data) [2025-09-25T22:14:48.472865] [DEBUG] [LOCAL ] ZK: Primary data saved (40293 records). [2025-09-25T22:14:48.473016] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-25T22:14:48.473151] [INFO ] [MAIN ] Update Progress: 2367/2372 symbols completed. ZK took 32.0s. Estimated remaining: 39.9s. Rate: 7.5 symbols/min [2025-09-25T22:14:48.732308] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:14:48.736710] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-25T22:14:48.793913] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-25T22:14:48.848076] [DEBUG] [LOCAL ] ZVIA: Loaded 35403 existing records from primary storage. [2025-09-25T22:14:48.848270] [INFO ] [MAIN ] ZVIA: Loaded 35403 existing records. [2025-09-25T22:14:49.035907] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:14:49.036372] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-25T22:14:49.036424] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-25T22:14:49.036895] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-25T22:14:49.036967] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-25T22:14:49.458010] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-25T22:14:49.499721] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:14:49.500136] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-25T22:14:49.540485] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-25T22:14:50.288868] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-25T22:14:51.070279] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-25T22:14:51.088685] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-25T22:14:51.534015] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-25T22:14:51.888747] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-25T22:14:52.665001] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T22:14:52.688665] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-25T22:14:52.719050] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-25T22:14:53.488827] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-25T22:14:54.093152] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-25T22:14:54.288764] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-25T22:14:54.304466] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-25T22:14:55.088873] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-25T22:14:55.888838] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-25T22:14:56.688822] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-25T22:14:57.010546] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-25T22:14:57.423893] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (3.14 seconds). [2025-09-25T22:14:57.488711] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-25T22:14:57.910846] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-25T22:14:58.190693] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-25T22:14:58.289148] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-25T22:14:58.303433] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-25T22:14:59.088747] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-25T22:14:59.888703] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-25T22:15:00.180948] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-25T22:15:00.212098] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-25T22:15:00.688778] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-25T22:15:01.280941] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-25T22:15:01.489003] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-25T22:15:02.109000] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-25T22:15:02.288831] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-25T22:15:03.088774] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-25T22:15:03.358473] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-25T22:15:03.888776] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-25T22:15:04.152391] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-25T22:15:04.336039] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-25T22:15:04.688797] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-25T22:15:05.300077] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-25T22:15:05.488752] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-25T22:15:06.288742] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-25T22:15:06.496373] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-25T22:15:06.667295] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-25T22:15:07.088741] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-25T22:15:07.654467] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-25T22:15:07.888743] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-25T22:15:07.994049] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-25T22:15:07.997466] [INFO ] [REMOTE ] ZTR: Full fetch complete (26817 records). [2025-09-25T22:15:07.997593] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-25T22:15:08.467490] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-25T22:15:08.467666] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-25T22:15:08.468368] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-25T22:15:08.468460] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-25T22:15:08.469391] [DEBUG] [LOCAL ] ZTR: Trimmed 26817 records to 16787 (keeping 200 days of data) [2025-09-25T22:15:08.590308] [DEBUG] [LOCAL ] ZTR: Primary data saved (16787 records). [2025-09-25T22:15:08.590500] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-25T22:15:08.590773] [INFO ] [MAIN ] Update Progress: 2368/2372 symbols completed. ZTR took 26.0s. Estimated remaining: 31.9s. Rate: 7.5 symbols/min [2025-09-25T22:15:08.697687] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-25T22:15:08.784311] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-17 to 2025-09-25. [2025-09-25T22:15:08.844943] [DEBUG] [LOCAL ] ZWS: Loaded 42484 existing records from primary storage. [2025-09-25T22:15:08.845115] [INFO ] [MAIN ] ZWS: Loaded 42484 existing records. [2025-09-25T22:15:09.035031] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-03-10, but need from 2024-12-06 for 200 day retention. Performing full refresh. [2025-09-25T22:15:09.035983] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-25T22:15:09.036063] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-25T22:15:09.036639] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-25T22:15:09.036758] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-25T22:15:09.455957] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-12-06 to 2025-09-25 (requires 10 months of data pull). [2025-09-25T22:15:09.488751] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-25T22:15:10.288761] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-25T22:15:10.661661] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-25T22:15:11.000711] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-25T22:15:11.013051] [INFO ] [REMOTE ] ZTO: Full fetch complete (73111 records). [2025-09-25T22:15:11.013252] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-25T22:15:11.096955] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-25T22:15:11.481607] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-25T22:15:11.481741] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-25T22:15:11.482952] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-25T22:15:11.483018] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-25T22:15:11.494567] [DEBUG] [LOCAL ] ZTO: Trimmed 73111 records to 50367 (keeping 200 days of data) [2025-09-25T22:15:11.515748] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-25T22:15:11.801553] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-25T22:15:11.889048] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-25T22:15:11.909384] [DEBUG] [LOCAL ] ZTO: Primary data saved (50367 records). [2025-09-25T22:15:11.909519] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-25T22:15:11.909679] [INFO ] [MAIN ] Update Progress: 2369/2372 symbols completed. ZTO took 44.5s. Estimated remaining: 23.9s. Rate: 7.5 symbols/min [2025-09-25T22:15:12.688724] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-25T22:15:12.765020] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-25T22:15:13.472240] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-25T22:15:13.488668] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-25T22:15:14.230519] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T22:15:14.288712] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-25T22:15:15.048220] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-25T22:15:15.088735] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-25T22:15:15.705513] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-25T22:15:15.712628] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52539 records). [2025-09-25T22:15:15.712770] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-25T22:15:15.905502] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-25T22:15:16.130756] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-25T22:15:16.130857] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-25T22:15:16.132518] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-25T22:15:16.132584] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-25T22:15:16.133827] [DEBUG] [LOCAL ] ZVIA: Trimmed 52539 records to 35664 (keeping 200 days of data) [2025-09-25T22:15:16.348163] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35664 records). [2025-09-25T22:15:16.348371] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-25T22:15:16.348559] [INFO ] [MAIN ] Update Progress: 2370/2372 symbols completed. ZVIA took 27.9s. Estimated remaining: 16.0s. Rate: 7.5 symbols/min [2025-09-25T22:15:16.753019] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-25T22:15:16.765085] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-25T22:15:17.362623] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-25T22:15:17.488732] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-25T22:15:17.584812] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-25T22:15:17.597952] [INFO ] [REMOTE ] ZTS: Full fetch complete (76694 records). [2025-09-25T22:15:17.598141] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-25T22:15:18.024112] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-25T22:15:18.024216] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-25T22:15:18.025423] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-25T22:15:18.025493] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-25T22:15:18.027210] [DEBUG] [LOCAL ] ZTS: Trimmed 76694 records to 53392 (keeping 200 days of data) [2025-09-25T22:15:18.404859] [DEBUG] [LOCAL ] ZTS: Primary data saved (53392 records). [2025-09-25T22:15:18.405087] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-25T22:15:18.408587] [INFO ] [MAIN ] Update Progress: 2371/2372 symbols completed. ZTS took 34.4s. Estimated remaining: 8.0s. Rate: 7.5 symbols/min [2025-09-25T22:15:19.201562] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-25T22:15:19.212200] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-25T22:15:20.728622] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-25T22:15:20.737217] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-25T22:15:22.372571] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-25T22:15:22.380595] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-25T22:15:24.070939] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-25T22:15:24.084691] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-25T22:15:25.620961] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-25T22:15:25.642281] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-25T22:15:26.979566] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-25T22:15:26.990523] [INFO ] [REMOTE ] ZWS: Full fetch complete (62037 records). [2025-09-25T22:15:26.992817] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-25T22:15:27.443478] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-25T22:15:27.443611] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-25T22:15:27.444739] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-25T22:15:27.445030] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-25T22:15:27.446757] [DEBUG] [LOCAL ] ZWS: Trimmed 62037 records to 42806 (keeping 200 days of data) [2025-09-25T22:15:27.742978] [DEBUG] [LOCAL ] ZWS: Primary data saved (42806 records). [2025-09-25T22:15:27.743162] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-25T22:15:27.743470] [INFO ] [MAIN ] Update Progress: 2372/2372 symbols completed. ZWS took 19.2s. Estimated remaining: 0.0s. Rate: 7.5 symbols/min [2025-09-25T22:15:27.754917] [INFO ] [MAIN ] Parallel update completed in 5h 15m 25s [2025-09-25T22:15:27.755340] [WARN ] [MAIN ] Failed symbols (329): AAM, AAMI, AAUC, AB, ABCB, ACA, ACCO, ABT, ACM, ACN... [2025-09-25T22:15:27.755789] [INFO ] [MAIN ] Update success rate: 86.1% (2043/2372 symbols) [2025-09-25T22:15:28.615012] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2043/2372 @ 86.13%)' [2025-09-25T22:15:28.617063] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-25T22:15:28.619116] [INFO ] [STATE ] Last completion updated: 2025-09-25T22:15:28.618791 [2025-09-25T22:15:28.619466] [WARN ] [STATE ] State set to: RUNNING [2025-09-25T22:15:28.619558] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-25T22:15:28.619808] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-25T22:15:28.619872] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-25T22:15:28.623478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-25T22:15:28.623794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-25T22:15:28.624111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-25T22:15:28.624312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-25T22:15:28.624594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-25T22:15:28.624840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-25T22:15:28.625069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-25T22:15:28.625297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-25T22:15:28.627738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-25T22:15:28.628405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSF.csv [2025-09-25T22:15:28.628701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTZ.csv [2025-09-25T22:15:28.629001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-25T22:15:28.629203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-25T22:15:28.629436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-25T22:15:28.629740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-25T22:15:28.629962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-25T22:15:28.630208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-25T22:15:28.630534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-25T22:15:28.632668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-25T22:15:28.632917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-25T22:15:28.633151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-25T22:15:28.633392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-25T22:15:28.633667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-25T22:15:28.633902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-25T22:15:28.634139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-25T22:15:28.634309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-25T22:15:28.634515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-25T22:15:28.634777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-25T22:15:28.635020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-25T22:15:28.635441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-25T22:15:28.635629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-25T22:15:28.635836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-25T22:15:28.636043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-25T22:15:28.636229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-25T22:15:28.636461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-25T22:15:28.636943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-25T22:15:28.637142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-25T22:15:28.637299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-25T22:15:28.637471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-25T22:15:28.637704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-25T22:15:28.637844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-25T22:15:28.637972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-25T22:15:28.638223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-25T22:15:28.638421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-25T22:15:28.638594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-25T22:15:28.638821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-25T22:15:28.639167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-25T22:15:28.639375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-25T22:15:28.639615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-25T22:15:28.639989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-25T22:15:28.640154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-25T22:15:28.640329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-25T22:15:28.640544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-25T22:15:28.642810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-25T22:15:28.643054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-25T22:15:28.643186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-25T22:15:28.643407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-25T22:15:28.643661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-25T22:15:28.643842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-25T22:15:28.644058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-25T22:15:28.644218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-25T22:15:28.644442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-25T22:15:28.644617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-25T22:15:28.644840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-25T22:15:28.645075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-25T22:15:28.645304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-25T22:15:28.645507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-25T22:15:28.645907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-25T22:15:28.646041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-25T22:15:28.646225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-25T22:15:28.646436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-25T22:15:28.646602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-25T22:15:28.646971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-25T22:15:28.647154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-25T22:15:28.647371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-25T22:15:28.647514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-25T22:15:28.647709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-25T22:15:28.647889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-25T22:15:28.648151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-25T22:15:28.648366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-25T22:15:28.648899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-25T22:15:28.649239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-25T22:15:28.649385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-25T22:15:28.649560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OSCR.csv [2025-09-25T22:15:28.649743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-25T22:15:28.649907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-25T22:15:28.650105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-25T22:15:28.650293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-25T22:15:28.650474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-25T22:15:28.651669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-25T22:15:28.651884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-25T22:15:28.652079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-25T22:15:28.652288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-25T22:15:28.652519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-25T22:15:28.652933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-25T22:15:28.653117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-25T22:15:28.653282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-25T22:15:28.653431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-25T22:15:28.653699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-25T22:15:28.653908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-25T22:15:28.654094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-25T22:15:28.654331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-25T22:15:28.654543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-25T22:15:28.654692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-25T22:15:28.654975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-25T22:15:28.655382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-25T22:15:28.655554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-25T22:15:28.657670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-25T22:15:28.657886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-25T22:15:28.658081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-25T22:15:28.658290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-25T22:15:28.658424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-25T22:15:28.658703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-25T22:15:28.658892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-25T22:15:28.659071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-25T22:15:28.659293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-25T22:15:28.659492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-25T22:15:28.659706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-25T22:15:28.659874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-25T22:15:28.660010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-25T22:15:28.660186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-25T22:15:28.660432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-25T22:15:28.660806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-25T22:15:28.660953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-25T22:15:28.661148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-25T22:15:28.661332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-25T22:15:28.661500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-25T22:15:28.661670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-25T22:15:28.661851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-25T22:15:28.662027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-25T22:15:28.662210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-25T22:15:28.662374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-25T22:15:28.662556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-25T22:15:28.662729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-25T22:15:28.662898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-25T22:15:28.663090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-25T22:15:28.663283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-25T22:15:28.663470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-25T22:15:28.663694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-25T22:15:28.663873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-25T22:15:28.664030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-25T22:15:28.664208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-25T22:15:28.664522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVT.csv [2025-09-25T22:15:28.665669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-25T22:15:28.665843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-25T22:15:28.665999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-25T22:15:28.666194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-25T22:15:28.666395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-25T22:15:28.666614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-25T22:15:28.666804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAN.csv [2025-09-25T22:15:28.666945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-25T22:15:28.667528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-25T22:15:28.667845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-25T22:15:28.668082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-25T22:15:28.668259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-25T22:15:28.668449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-25T22:15:28.670667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-25T22:15:28.670839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-25T22:15:28.671063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-25T22:15:28.671184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-25T22:15:28.671530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-25T22:15:28.671834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-25T22:15:28.672018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-25T22:15:28.672231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-25T22:15:28.672423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-25T22:15:28.672588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-25T22:15:28.672781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-25T22:15:28.672942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-25T22:15:28.673155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-25T22:15:28.673287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-25T22:15:28.673408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-25T22:15:28.673606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-25T22:15:28.673798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-25T22:15:28.673970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-25T22:15:28.674140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-25T22:15:28.674262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-25T22:15:28.674390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-25T22:15:28.674629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-25T22:15:28.674856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-25T22:15:28.675051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-25T22:15:28.675276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-25T22:15:28.675441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-25T22:15:28.675616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-25T22:15:28.675815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-25T22:15:28.675986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-25T22:15:28.676175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-25T22:15:28.676338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-25T22:15:28.676545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-25T22:15:28.676742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-25T22:15:28.676905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-25T22:15:28.677046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-25T22:15:28.677144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-25T22:15:28.677286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPA.csv [2025-09-25T22:15:28.677730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-25T22:15:28.677934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-25T22:15:28.678094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-25T22:15:28.678288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-25T22:15:28.678453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-25T22:15:28.678585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-25T22:15:28.678746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-25T22:15:28.678901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-25T22:15:28.679038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-25T22:15:28.679231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-25T22:15:28.679405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRI.csv [2025-09-25T22:15:28.679570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-25T22:15:28.680720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-25T22:15:28.680920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-25T22:15:28.681083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-25T22:15:28.681229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHC.csv [2025-09-25T22:15:28.681367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-25T22:15:28.681544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-25T22:15:28.681736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-25T22:15:28.681884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-25T22:15:28.682013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-25T22:15:28.682444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-25T22:15:28.682613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-25T22:15:28.682781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-25T22:15:28.682980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-25T22:15:28.683124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-25T22:15:28.683305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-25T22:15:28.683467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSG.csv [2025-09-25T22:15:28.683628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-25T22:15:28.684130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-25T22:15:28.684366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-25T22:15:28.684541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-25T22:15:28.686666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-25T22:15:28.686869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-25T22:15:28.686996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-25T22:15:28.687157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-25T22:15:28.687340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-25T22:15:28.687471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-25T22:15:28.687604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-25T22:15:28.688042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-25T22:15:28.688262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-25T22:15:28.688413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-25T22:15:28.688538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-25T22:15:28.688793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-25T22:15:28.688940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-25T22:15:28.689096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-25T22:15:28.689249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-25T22:15:28.689410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-25T22:15:28.689668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-25T22:15:28.689823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-25T22:15:28.689996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-25T22:15:28.690343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-25T22:15:28.690530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-25T22:15:28.690690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-25T22:15:28.690865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-25T22:15:28.691049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-25T22:15:28.691227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-25T22:15:28.691373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRX.csv [2025-09-25T22:15:28.691496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-25T22:15:28.691623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-25T22:15:28.691808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-25T22:15:28.691949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-25T22:15:28.692117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-25T22:15:28.692290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-25T22:15:28.692429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-25T22:15:28.692611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-25T22:15:28.692795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-25T22:15:28.693095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-25T22:15:28.693293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-25T22:15:28.693448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-25T22:15:28.693608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-25T22:15:28.693805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-25T22:15:28.693930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-25T22:15:28.694092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-25T22:15:28.694267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-25T22:15:28.694423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-25T22:15:28.695667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-25T22:15:28.695823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-25T22:15:28.695989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-25T22:15:28.696117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLK.csv [2025-09-25T22:15:28.696237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-25T22:15:28.696415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-25T22:15:28.696591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-25T22:15:28.696750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-25T22:15:28.696949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-25T22:15:28.697164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-25T22:15:28.697284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-25T22:15:28.697481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-25T22:15:28.697625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-25T22:15:28.697868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-25T22:15:28.698024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-25T22:15:28.698168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-25T22:15:28.698336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-25T22:15:28.698534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-25T22:15:28.698724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-25T22:15:28.698914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-25T22:15:28.699092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-25T22:15:28.699257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-25T22:15:28.699423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-25T22:15:28.699589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-25T22:15:28.702074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-25T22:15:28.702212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-25T22:15:28.702401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-25T22:15:28.702578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-25T22:15:28.702743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-25T22:15:28.702927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-25T22:15:28.703076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-25T22:15:28.703221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-25T22:15:28.703379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-25T22:15:28.703563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-25T22:15:28.703768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-25T22:15:28.703939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-25T22:15:28.704075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-25T22:15:28.704254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-25T22:15:28.704397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-25T22:15:28.704632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-25T22:15:28.704801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-25T22:15:28.704933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-25T22:15:28.705101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-25T22:15:28.705294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-25T22:15:28.705440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-25T22:15:28.705585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-25T22:15:28.705777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-25T22:15:28.705934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-25T22:15:28.706084] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-25T22:15:28.706273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-25T22:15:28.706445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-25T22:15:28.706596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-25T22:15:28.706799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-25T22:15:28.706961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIMN.csv [2025-09-25T22:15:28.707086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-25T22:15:28.707197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-25T22:15:28.707375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-25T22:15:28.707548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-25T22:15:28.707738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-25T22:15:28.707874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-25T22:15:28.708125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-25T22:15:28.708266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-25T22:15:28.708393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSV.csv [2025-09-25T22:15:28.708567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-25T22:15:28.708698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-25T22:15:28.708869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-25T22:15:28.709027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-25T22:15:28.709229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-25T22:15:28.709445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-25T22:15:28.710668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-25T22:15:28.710831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-25T22:15:28.710971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-25T22:15:28.711108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-25T22:15:28.711269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-25T22:15:28.711436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-25T22:15:28.711574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-25T22:15:28.711725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-25T22:15:28.711877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-25T22:15:28.711994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-25T22:15:28.712165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-25T22:15:28.712336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-25T22:15:28.712475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-25T22:15:28.712629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-25T22:15:28.712890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-25T22:15:28.713047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-25T22:15:28.713196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-25T22:15:28.713343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-25T22:15:28.713745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-25T22:15:28.713907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-25T22:15:28.714065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-25T22:15:28.714194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-25T22:15:28.714395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-25T22:15:28.714570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-25T22:15:28.716670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-25T22:15:28.716812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-25T22:15:28.716971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-25T22:15:28.717111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THLV.csv [2025-09-25T22:15:28.717243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-25T22:15:28.717389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-25T22:15:28.717499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-25T22:15:28.717668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-25T22:15:28.717815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-25T22:15:28.717981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-25T22:15:28.718129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-25T22:15:28.718279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-25T22:15:28.718412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-25T22:15:28.718546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-25T22:15:28.719192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-25T22:15:28.719531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-25T22:15:28.719660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-25T22:15:28.719858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-25T22:15:28.719990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-25T22:15:28.720122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-25T22:15:28.720276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-25T22:15:28.720440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-25T22:15:28.720584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-25T22:15:28.720780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-25T22:15:28.721000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-25T22:15:28.721191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-25T22:15:28.721370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-25T22:15:28.721509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-25T22:15:28.721721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-25T22:15:28.721873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-25T22:15:28.721968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-25T22:15:28.722109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-25T22:15:28.722274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-25T22:15:28.722470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-25T22:15:28.722720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-25T22:15:28.722880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-25T22:15:28.723062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-25T22:15:28.723206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-25T22:15:28.723322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-25T22:15:28.723513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-25T22:15:28.723625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-25T22:15:28.723799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-25T22:15:28.723958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-25T22:15:28.724125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-25T22:15:28.724256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-25T22:15:28.724422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-25T22:15:28.724574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-25T22:15:28.725703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-25T22:15:28.725839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-25T22:15:28.726000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-25T22:15:28.726105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-25T22:15:28.726276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-25T22:15:28.726461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-25T22:15:28.726604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-25T22:15:28.726797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-25T22:15:28.726910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-25T22:15:28.727058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-25T22:15:28.727219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-25T22:15:28.727340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-25T22:15:28.727491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-25T22:15:28.727657] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-25T22:15:28.727849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-25T22:15:28.728008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-25T22:15:28.728167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-25T22:15:28.728315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-25T22:15:28.728474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-25T22:15:28.728634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-25T22:15:28.728846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-25T22:15:28.728997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-25T22:15:28.729125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-25T22:15:28.729281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-25T22:15:28.729445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-25T22:15:28.732667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-25T22:15:28.733170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-25T22:15:28.733334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-25T22:15:28.733494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-25T22:15:28.733670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-25T22:15:28.733819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-25T22:15:28.733991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-25T22:15:28.734129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-25T22:15:28.734305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-25T22:15:28.734466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-25T22:15:28.734594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-25T22:15:28.734837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-25T22:15:28.735016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-25T22:15:28.735160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-25T22:15:28.735303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-25T22:15:28.735439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-25T22:15:28.735614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-25T22:15:28.735967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-25T22:15:28.736108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-25T22:15:28.736285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPRO.csv [2025-09-25T22:15:28.736441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-25T22:15:28.736619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-25T22:15:28.736770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-25T22:15:28.736888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLTO.csv [2025-09-25T22:15:28.737012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-25T22:15:28.737266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-25T22:15:28.737448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-25T22:15:28.737664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-25T22:15:28.737812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-25T22:15:28.738022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-25T22:15:28.738177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGR.csv [2025-09-25T22:15:28.738315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-25T22:15:28.738482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-25T22:15:28.738610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-25T22:15:28.738766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-25T22:15:28.738916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-25T22:15:28.739035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-25T22:15:28.739181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-25T22:15:28.739310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-25T22:15:28.739425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-25T22:15:28.739548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-25T22:15:28.739700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-25T22:15:28.739856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-25T22:15:28.740077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-25T22:15:28.740231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-25T22:15:28.740375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-25T22:15:28.740575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-25T22:15:28.740772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-25T22:15:28.740912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-25T22:15:28.741072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-25T22:15:28.741243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-25T22:15:28.741401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-25T22:15:28.741547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-25T22:15:28.741740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-25T22:15:28.741853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-25T22:15:28.741982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-25T22:15:28.742121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-25T22:15:28.742237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-25T22:15:28.742362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-25T22:15:28.742489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-25T22:15:28.742658] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-25T22:15:28.742797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-25T22:15:28.742921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-25T22:15:28.743150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-25T22:15:28.743296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-25T22:15:28.743474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-25T22:15:28.743599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-25T22:15:28.743727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-25T22:15:28.743901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-25T22:15:28.744050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-25T22:15:28.744170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-25T22:15:28.744334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HKD.csv [2025-09-25T22:15:28.744854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-25T22:15:28.744987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-25T22:15:28.745130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-25T22:15:28.745228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-25T22:15:28.745355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-25T22:15:28.745508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-25T22:15:28.745662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-25T22:15:28.745770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-25T22:15:28.745879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-25T22:15:28.745995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-25T22:15:28.746095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-25T22:15:28.746189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-25T22:15:28.746322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-25T22:15:28.746538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-25T22:15:28.746717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-25T22:15:28.746860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-25T22:15:28.746988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-25T22:15:28.747143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-25T22:15:28.747266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-25T22:15:28.747393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-25T22:15:28.747573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-25T22:15:28.747788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-25T22:15:28.747949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-25T22:15:28.748048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-25T22:15:28.748133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-25T22:15:28.748314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-25T22:15:28.748463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-25T22:15:28.748624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-25T22:15:28.748870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-25T22:15:28.749032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-25T22:15:28.749182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-25T22:15:28.749299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-25T22:15:28.749467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-25T22:15:28.749573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-25T22:15:28.749723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-25T22:15:28.749849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-25T22:15:28.749973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-25T22:15:28.750103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-25T22:15:28.750245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-25T22:15:28.750396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-25T22:15:28.750517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-25T22:15:28.750756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-25T22:15:28.750953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-25T22:15:28.751106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-25T22:15:28.751289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-25T22:15:28.751406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-25T22:15:28.751571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-25T22:15:28.751721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-25T22:15:28.751856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-25T22:15:28.751968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-25T22:15:28.752116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-25T22:15:28.752228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-25T22:15:28.752347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-25T22:15:28.752489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-25T22:15:28.752589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-25T22:15:28.752711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-25T22:15:28.752845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-25T22:15:28.752949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-25T22:15:28.753057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-25T22:15:28.753219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-25T22:15:28.753383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-25T22:15:28.753503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-25T22:15:28.753712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESAB.csv [2025-09-25T22:15:28.753846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-25T22:15:28.753949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-25T22:15:28.754082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-25T22:15:28.754190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-25T22:15:28.754314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-25T22:15:28.754460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-25T22:15:28.754617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-25T22:15:28.754762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-25T22:15:28.755272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-25T22:15:28.755423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-25T22:15:28.755576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-25T22:15:28.755756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-25T22:15:28.755960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-25T22:15:28.756077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-25T22:15:28.756219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-25T22:15:28.756318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-25T22:15:28.756514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-25T22:15:28.756760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-25T22:15:28.756870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-25T22:15:28.756983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-25T22:15:28.757100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-25T22:15:28.757271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-25T22:15:28.757399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-25T22:15:28.757500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-25T22:15:28.757628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-25T22:15:28.757759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-25T22:15:28.757933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-25T22:15:28.758033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-25T22:15:28.758156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-25T22:15:28.758302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-25T22:15:28.758425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-25T22:15:28.758588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-25T22:15:28.758829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-25T22:15:28.758943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-25T22:15:28.759077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-25T22:15:28.759226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-25T22:15:28.759402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-25T22:15:28.759581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-25T22:15:28.759739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-25T22:15:28.759890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-25T22:15:28.759998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-25T22:15:28.760146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-25T22:15:28.760306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-25T22:15:28.760417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-25T22:15:28.760535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-25T22:15:28.760635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-25T22:15:28.760807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-25T22:15:28.760958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-25T22:15:28.761105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-25T22:15:28.761244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-25T22:15:28.761383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-25T22:15:28.761509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-25T22:15:28.761694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-25T22:15:28.761820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-25T22:15:28.761968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-25T22:15:28.762061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-25T22:15:28.762187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-25T22:15:28.762323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-25T22:15:28.762440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-25T22:15:28.762556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-25T22:15:28.762715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-25T22:15:28.762849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIT.csv [2025-09-25T22:15:28.762997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-25T22:15:28.763118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-25T22:15:28.763225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-25T22:15:28.763366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-25T22:15:28.763504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-25T22:15:28.763637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-25T22:15:28.763789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-25T22:15:28.763911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-25T22:15:28.764077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-25T22:15:28.764231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-25T22:15:28.764338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-25T22:15:28.764469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-25T22:15:28.764622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-25T22:15:28.764816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-25T22:15:28.764933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-25T22:15:28.765067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-25T22:15:28.765204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-25T22:15:28.765675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-25T22:15:28.765825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-25T22:15:28.765950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-25T22:15:28.766093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-25T22:15:28.766374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-25T22:15:28.766484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-25T22:15:28.766629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-25T22:15:28.766880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-25T22:15:28.767029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-25T22:15:28.767225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBRT.csv [2025-09-25T22:15:28.767332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-25T22:15:28.767477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-25T22:15:28.767634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-25T22:15:28.767865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-25T22:15:28.768025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-25T22:15:28.768132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-25T22:15:28.768251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-25T22:15:28.768419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-25T22:15:28.768542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-25T22:15:28.768682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-25T22:15:28.768845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-25T22:15:28.768987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-25T22:15:28.769172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-25T22:15:28.769493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AESI.csv [2025-09-25T22:15:28.769614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-25T22:15:28.769776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-25T22:15:28.769925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-25T22:15:28.770018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-25T22:15:28.770190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-25T22:15:28.770326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-25T22:15:28.770422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-25T22:15:28.770528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-25T22:15:28.770705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-25T22:15:28.770872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-25T22:15:28.771018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-25T22:15:28.771165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-25T22:15:28.771321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-25T22:15:28.771457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-25T22:15:28.771580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-25T22:15:28.771739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-25T22:15:28.771939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-25T22:15:28.772241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-25T22:15:28.772383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-25T22:15:28.772526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-25T22:15:28.772755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-25T22:15:28.772862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-25T22:15:28.773015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-25T22:15:28.773145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-25T22:15:28.773255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-25T22:15:28.773373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-25T22:15:28.773483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-25T22:15:28.773596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-25T22:15:28.773771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-25T22:15:28.773914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-25T22:15:28.774067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-25T22:15:28.774244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-25T22:15:28.774339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-25T22:15:28.774424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-25T22:15:28.774542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-25T22:15:28.774691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-25T22:15:28.774826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDL.csv [2025-09-25T22:15:28.774941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-25T22:15:28.775056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-25T22:15:28.775167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-25T22:15:28.775308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-25T22:15:28.775414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-25T22:15:28.775568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-25T22:15:28.775790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-25T22:15:28.775960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-25T22:15:28.776120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-25T22:15:28.776289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-25T22:15:28.776853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-25T22:15:28.777012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-25T22:15:28.777168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-25T22:15:28.777500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-25T22:15:28.777707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-25T22:15:28.777852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-25T22:15:28.777977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-25T22:15:28.778125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-25T22:15:28.778295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-25T22:15:28.778457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-25T22:15:28.778598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-25T22:15:28.778768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-25T22:15:28.778903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-25T22:15:28.779063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-25T22:15:28.779172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-25T22:15:28.779330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-25T22:15:28.779431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-25T22:15:28.779560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-25T22:15:28.779637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-25T22:15:28.779849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-25T22:15:28.779988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-25T22:15:28.780223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-25T22:15:28.780335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-25T22:15:28.780443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-25T22:15:28.780588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-25T22:15:28.780713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-25T22:15:28.780821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-25T22:15:28.780965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-25T22:15:28.781093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-25T22:15:28.781227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-25T22:15:28.781375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-25T22:15:28.781524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-25T22:15:28.781691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-25T22:15:28.781822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-25T22:15:28.781937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-25T22:15:28.782081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-25T22:15:28.782196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-25T22:15:28.782314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-25T22:15:28.782453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-25T22:15:28.782627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-25T22:15:28.782797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-25T22:15:28.782897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-25T22:15:28.783036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-25T22:15:28.783172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-25T22:15:28.783267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-25T22:15:28.783402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-25T22:15:28.783562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-25T22:15:28.783771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-25T22:15:28.783893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-25T22:15:28.784021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-25T22:15:28.784181] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-25T22:15:28.784320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-25T22:15:28.784439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-25T22:15:28.784544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-25T22:15:28.784702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-25T22:15:28.784853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-25T22:15:28.784999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-25T22:15:28.785137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-25T22:15:28.785323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-25T22:15:28.785438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-25T22:15:28.785546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-25T22:15:28.785679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-25T22:15:28.785835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-25T22:15:28.785933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-25T22:15:28.786036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-25T22:15:28.786210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-25T22:15:28.786333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-25T22:15:28.786537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-25T22:15:28.786756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-25T22:15:28.786854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-25T22:15:28.786939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-25T22:15:28.787086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-25T22:15:28.787182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-25T22:15:28.787298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-25T22:15:28.787440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-25T22:15:28.787537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-25T22:15:28.788035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-25T22:15:28.788196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-25T22:15:28.788351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-25T22:15:28.788470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMO.csv [2025-09-25T22:15:28.788584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-25T22:15:28.788711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-25T22:15:28.788833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-25T22:15:28.788954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-25T22:15:28.789063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAL.csv [2025-09-25T22:15:28.789359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-25T22:15:28.789459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-25T22:15:28.789622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-25T22:15:28.789836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-25T22:15:28.789969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-25T22:15:28.790132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-25T22:15:28.790244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-25T22:15:28.790394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-25T22:15:28.790501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-25T22:15:28.790623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-25T22:15:28.790754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-25T22:15:28.790886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-25T22:15:28.791053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-25T22:15:28.791191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-25T22:15:28.791338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-25T22:15:28.791446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-25T22:15:28.791583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-25T22:15:28.791730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-25T22:15:28.791834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-25T22:15:28.791942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-25T22:15:28.792067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-25T22:15:28.792186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-25T22:15:28.792331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-25T22:15:28.792449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-25T22:15:28.792620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-25T22:15:28.792794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-25T22:15:28.792930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-25T22:15:28.793087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-25T22:15:28.793239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-25T22:15:28.793470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-25T22:15:28.793631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-25T22:15:28.793792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRN.csv [2025-09-25T22:15:28.793959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPN.csv [2025-09-25T22:15:28.794094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-25T22:15:28.794257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-25T22:15:28.794390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-25T22:15:28.794595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-25T22:15:28.794767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-25T22:15:28.794907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-25T22:15:28.795055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-25T22:15:28.795172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-25T22:15:28.795280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-25T22:15:28.795409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-25T22:15:28.795532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-25T22:15:28.795693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-25T22:15:28.795826] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-25T22:15:28.795930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STLA.csv [2025-09-25T22:15:28.796013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-25T22:15:28.796119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-25T22:15:28.796297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-25T22:15:28.796396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-25T22:15:28.796502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-25T22:15:28.796750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-25T22:15:28.796962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-25T22:15:28.797110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-25T22:15:28.797232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-25T22:15:28.797373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-25T22:15:28.797829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-25T22:15:28.798006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-25T22:15:28.798145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-25T22:15:28.798270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-25T22:15:28.798405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-25T22:15:28.798546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-25T22:15:28.798675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-25T22:15:28.798802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-25T22:15:28.798956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-25T22:15:28.799103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFX.csv [2025-09-25T22:15:28.799253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-25T22:15:28.799373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-25T22:15:28.799520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-25T22:15:28.799630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-25T22:15:28.799804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-25T22:15:28.799910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-25T22:15:28.800056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-25T22:15:28.800155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-25T22:15:28.800266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-25T22:15:28.800414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-25T22:15:28.800592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-25T22:15:28.800715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-25T22:15:28.800842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-25T22:15:28.800960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-25T22:15:28.801070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-25T22:15:28.801199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-25T22:15:28.801364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-25T22:15:28.801548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-25T22:15:28.801801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-25T22:15:28.801925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-25T22:15:28.802033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-25T22:15:28.802157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-25T22:15:28.802288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-25T22:15:28.802447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-25T22:15:28.802569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-25T22:15:28.802690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-25T22:15:28.802794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-25T22:15:28.802984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-25T22:15:28.803160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-25T22:15:28.803298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-25T22:15:28.803415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-25T22:15:28.803522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-25T22:15:28.803709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-25T22:15:28.803834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-25T22:15:28.803941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-25T22:15:28.804059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-25T22:15:28.804198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-25T22:15:28.804354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-25T22:15:28.804493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-25T22:15:28.804679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-25T22:15:28.804787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-25T22:15:28.804879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-25T22:15:28.805005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-25T22:15:28.805195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-25T22:15:28.805345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-25T22:15:28.805496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-25T22:15:28.805623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-25T22:15:28.805741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-25T22:15:28.805890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-25T22:15:28.806039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAR.csv [2025-09-25T22:15:28.806161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-25T22:15:28.806254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-25T22:15:28.806377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-25T22:15:28.806552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-25T22:15:28.806731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-25T22:15:28.806848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-25T22:15:28.806983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-25T22:15:28.807150] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-25T22:15:28.807304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-25T22:15:28.807396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-25T22:15:28.807631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-25T22:15:28.808143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-25T22:15:28.808253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-25T22:15:28.808348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-25T22:15:28.808428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-25T22:15:28.808607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBAB.csv [2025-09-25T22:15:28.808750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-25T22:15:28.808846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIV.csv [2025-09-25T22:15:28.808971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-25T22:15:28.809103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-25T22:15:28.809240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-25T22:15:28.809367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-25T22:15:28.809473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-25T22:15:28.809614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-25T22:15:28.809821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-25T22:15:28.809929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-25T22:15:28.810032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-25T22:15:28.810231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-25T22:15:28.810385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-25T22:15:28.810518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-25T22:15:28.810732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-25T22:15:28.810941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-25T22:15:28.811064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-25T22:15:28.811178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-25T22:15:28.811274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-25T22:15:28.811370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-25T22:15:28.811533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-25T22:15:28.811675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-25T22:15:28.811802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-25T22:15:28.811942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-25T22:15:28.812049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-25T22:15:28.812166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-25T22:15:28.812276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-25T22:15:28.812389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-25T22:15:28.812527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COTY.csv [2025-09-25T22:15:28.812696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-25T22:15:28.812827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-25T22:15:28.812921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-25T22:15:28.813063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-25T22:15:28.813225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-25T22:15:28.813342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-25T22:15:28.813440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-25T22:15:28.813547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-25T22:15:28.813815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-25T22:15:28.813950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-25T22:15:28.814099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-25T22:15:28.814228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-25T22:15:28.814327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-25T22:15:28.814434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-25T22:15:28.814529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-25T22:15:28.814602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-25T22:15:28.814758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-25T22:15:28.814898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-25T22:15:28.815051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-25T22:15:28.815165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-25T22:15:28.815275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-25T22:15:28.815417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-25T22:15:28.815534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-25T22:15:28.815675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-25T22:15:28.815827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-25T22:15:28.815976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-25T22:15:28.816103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-25T22:15:28.816211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-25T22:15:28.816309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-25T22:15:28.816403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-25T22:15:28.816575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-25T22:15:28.816753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-25T22:15:28.816888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-25T22:15:28.816997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-25T22:15:28.817105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-25T22:15:28.817210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-25T22:15:28.817317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-25T22:15:28.817492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-25T22:15:28.817622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-25T22:15:28.818087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-25T22:15:28.818227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-25T22:15:28.818358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-25T22:15:28.818465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-25T22:15:28.818595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-25T22:15:28.818768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-25T22:15:28.818924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-25T22:15:28.819034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-25T22:15:28.819203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-25T22:15:28.819311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-25T22:15:28.819416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-25T22:15:28.819565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-25T22:15:28.819821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-25T22:15:28.819922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-25T22:15:28.819991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-25T22:15:28.820074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-25T22:15:28.820176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-25T22:15:28.820307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-25T22:15:28.820399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-25T22:15:28.820526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-25T22:15:28.820680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFSI.csv [2025-09-25T22:15:28.820866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-25T22:15:28.820984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-25T22:15:28.821098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-25T22:15:28.821208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-25T22:15:28.821325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-25T22:15:28.821479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-25T22:15:28.821572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-25T22:15:28.821693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-25T22:15:28.821810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-25T22:15:28.821952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-25T22:15:28.822111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-25T22:15:28.822233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-25T22:15:28.822359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-25T22:15:28.822493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-25T22:15:28.822625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-25T22:15:28.822860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-25T22:15:28.823007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-25T22:15:28.823135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-25T22:15:28.823256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-25T22:15:28.823410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-25T22:15:28.823592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-25T22:15:28.823725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-25T22:15:28.823832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-25T22:15:28.823928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-25T22:15:28.824039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-25T22:15:28.824162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-25T22:15:28.824256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-25T22:15:28.824383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-25T22:15:28.824515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-25T22:15:28.824671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-25T22:15:28.824797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-25T22:15:28.824926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-25T22:15:28.825070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-25T22:15:28.825179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-25T22:15:28.825358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-25T22:15:28.825449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-25T22:15:28.825580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-25T22:15:28.825776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-25T22:15:28.825902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-25T22:15:28.826035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-25T22:15:28.826165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-25T22:15:28.826328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-25T22:15:28.826456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-25T22:15:28.826622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-25T22:15:28.826762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-25T22:15:28.826859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-25T22:15:28.826948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-25T22:15:28.827045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-25T22:15:28.827510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-25T22:15:28.827617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-25T22:15:28.827769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-25T22:15:28.827910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-25T22:15:28.828051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-25T22:15:28.828162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-25T22:15:28.828326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-25T22:15:28.828437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-25T22:15:28.828542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-25T22:15:28.828773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-25T22:15:28.828883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-25T22:15:28.829010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-25T22:15:28.829166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-25T22:15:28.829285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-25T22:15:28.829452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-25T22:15:28.829589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-25T22:15:28.829742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-25T22:15:28.829872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-25T22:15:28.829998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-25T22:15:28.830096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-25T22:15:28.830208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-25T22:15:28.830319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-25T22:15:28.830460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-25T22:15:28.830594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-25T22:15:28.830746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-25T22:15:28.830908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-25T22:15:28.831041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-25T22:15:28.831200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-25T22:15:28.831328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-25T22:15:28.831457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-25T22:15:28.831586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-25T22:15:28.831711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-25T22:15:28.831918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-25T22:15:28.832018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-25T22:15:28.832146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-25T22:15:28.832256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-25T22:15:28.832376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-25T22:15:28.832496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-25T22:15:28.832611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-25T22:15:28.832817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-25T22:15:28.832921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-25T22:15:28.833013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-25T22:15:28.833106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-25T22:15:28.833226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-25T22:15:28.833379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-25T22:15:28.833657] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-25T22:15:28.833787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-25T22:15:28.833937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-25T22:15:28.834037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-25T22:15:28.834120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-25T22:15:28.834266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-25T22:15:28.834408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-25T22:15:28.834503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-25T22:15:28.834613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-25T22:15:28.834785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-25T22:15:28.834884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-25T22:15:28.834956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-25T22:15:28.835040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-25T22:15:28.835178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-25T22:15:28.835283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-25T22:15:28.835426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-25T22:15:28.835571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-25T22:15:28.835775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-25T22:15:28.835886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-25T22:15:28.835981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-25T22:15:28.836060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-25T22:15:28.836228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-25T22:15:28.836331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-25T22:15:28.836483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-25T22:15:28.836633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-25T22:15:28.836801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-25T22:15:28.836941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-25T22:15:28.837037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-25T22:15:28.837118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-25T22:15:28.837250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-25T22:15:28.837344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-25T22:15:28.837470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-25T22:15:28.837601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-25T22:15:28.838041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-25T22:15:28.838155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-25T22:15:28.838290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-25T22:15:28.838411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-25T22:15:28.838532] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-25T22:15:28.838633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-25T22:15:28.838799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-25T22:15:28.838956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-25T22:15:28.839128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-25T22:15:28.839226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRTS.csv [2025-09-25T22:15:28.839314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-25T22:15:28.839448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-25T22:15:28.839604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-25T22:15:28.839733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-25T22:15:28.839871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-25T22:15:28.840016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-25T22:15:28.840141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-25T22:15:28.840271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-25T22:15:28.840418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-25T22:15:28.840525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-25T22:15:28.840679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-25T22:15:28.840789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-25T22:15:28.840898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-25T22:15:28.841018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-25T22:15:28.841141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCL.csv [2025-09-25T22:15:28.841261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-25T22:15:28.841439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-25T22:15:28.841604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-25T22:15:28.841771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-25T22:15:28.841926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMPO.csv [2025-09-25T22:15:28.842056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-25T22:15:28.842198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-25T22:15:28.842353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-25T22:15:28.842467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-25T22:15:28.842601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-25T22:15:28.842722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-25T22:15:28.842849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIR.csv [2025-09-25T22:15:28.842997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-25T22:15:28.843102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-25T22:15:28.843207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-25T22:15:28.843294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-25T22:15:28.843364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-25T22:15:28.843465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-25T22:15:28.843596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-25T22:15:28.843760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-25T22:15:28.843900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-25T22:15:28.844011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-25T22:15:28.844127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-25T22:15:28.844301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-25T22:15:28.844398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-25T22:15:28.844473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-25T22:15:28.844543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-25T22:15:28.844681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-25T22:15:28.844849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-25T22:15:28.844951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-25T22:15:28.845043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-25T22:15:28.845171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-25T22:15:28.845298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-25T22:15:28.845407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-25T22:15:28.845533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-25T22:15:28.845721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-25T22:15:28.845834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-25T22:15:28.845985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-25T22:15:28.846153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-25T22:15:28.846707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-25T22:15:28.846853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-25T22:15:28.847014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-25T22:15:28.847146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-25T22:15:28.847265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-25T22:15:28.847436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-25T22:15:28.847554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-25T22:15:28.847726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-25T22:15:28.847846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-25T22:15:28.847966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-25T22:15:28.848115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-25T22:15:28.848248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-25T22:15:28.848409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-25T22:15:28.848549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-25T22:15:28.848704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-25T22:15:28.848817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-25T22:15:28.848998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-25T22:15:28.849156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-25T22:15:28.849262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-25T22:15:28.849341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-25T22:15:28.849453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-25T22:15:28.849592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-25T22:15:28.849770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-25T22:15:28.849892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-25T22:15:28.849992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-25T22:15:28.850093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-25T22:15:28.850261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-25T22:15:28.850397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-25T22:15:28.850588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-25T22:15:28.850727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-25T22:15:28.850824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-25T22:15:28.850930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-25T22:15:28.851060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-25T22:15:28.851141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-25T22:15:28.851229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-25T22:15:28.851355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-25T22:15:28.851452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-25T22:15:28.851605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-25T22:15:28.851795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-25T22:15:28.851912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-25T22:15:28.852024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-25T22:15:28.852140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-25T22:15:28.852261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-25T22:15:28.852388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-25T22:15:28.852511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-25T22:15:28.852620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-25T22:15:28.852835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-25T22:15:28.852929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-25T22:15:28.853032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-25T22:15:28.853167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-25T22:15:28.853336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-25T22:15:28.853442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-25T22:15:28.853563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-25T22:15:28.853701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-25T22:15:28.853832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-25T22:15:28.853929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-25T22:15:28.854001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-25T22:15:28.854112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-25T22:15:28.854235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-25T22:15:28.854375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-25T22:15:28.854526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-25T22:15:28.854673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-25T22:15:28.854773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-25T22:15:28.854865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-25T22:15:28.854958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-25T22:15:28.855053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-25T22:15:28.855162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-25T22:15:28.855429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-25T22:15:28.855526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-25T22:15:28.855631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-25T22:15:28.855761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-25T22:15:28.856264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-25T22:15:28.856369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-25T22:15:28.856462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-25T22:15:28.856615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-25T22:15:28.856780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-25T22:15:28.856994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-25T22:15:28.857142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-25T22:15:28.857243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-25T22:15:28.857359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-25T22:15:28.857475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-25T22:15:28.857593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-25T22:15:28.857799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-25T22:15:28.857894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-25T22:15:28.857983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-25T22:15:28.858120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-25T22:15:28.858236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-25T22:15:28.858398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-25T22:15:28.858514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPT.csv [2025-09-25T22:15:28.858698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-25T22:15:28.858850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-25T22:15:28.858978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-25T22:15:28.859076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-25T22:15:28.859165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-25T22:15:28.859294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-25T22:15:28.859417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-25T22:15:28.859514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-25T22:15:28.859612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-25T22:15:28.859764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-25T22:15:28.859878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-25T22:15:28.859986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-25T22:15:28.860088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-25T22:15:28.860183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-25T22:15:28.860317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-25T22:15:28.860465] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-25T22:15:28.860626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-25T22:15:28.860782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-25T22:15:28.860896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-25T22:15:28.861025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-25T22:15:28.861153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-25T22:15:28.861261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-25T22:15:28.861387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-25T22:15:28.861537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-25T22:15:28.861639] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-25T22:15:28.861879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-25T22:15:28.862166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-25T22:15:28.862323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-25T22:15:28.862447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-25T22:15:28.862558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-25T22:15:28.862709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-25T22:15:28.862838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-25T22:15:28.862949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-25T22:15:28.863091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-25T22:15:28.863198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-25T22:15:28.863306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-25T22:15:28.863406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-25T22:15:28.863529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-25T22:15:28.863636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-25T22:15:28.863778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-25T22:15:28.863957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-25T22:15:28.864133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-25T22:15:28.864237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-25T22:15:28.864310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-25T22:15:28.864409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-25T22:15:28.864515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-25T22:15:28.864664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-25T22:15:28.864841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-25T22:15:28.864954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-25T22:15:28.865028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-25T22:15:28.865118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-25T22:15:28.865227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-25T22:15:28.865400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-25T22:15:28.865927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-25T22:15:28.866043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-25T22:15:28.866143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-25T22:15:28.866275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-25T22:15:28.866413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-25T22:15:28.866558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-25T22:15:28.866716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-25T22:15:28.866853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-25T22:15:28.866992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-25T22:15:28.867072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-25T22:15:28.867176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-25T22:15:28.867291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-25T22:15:28.867418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-25T22:15:28.867535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-25T22:15:28.867684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-25T22:15:28.867870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-25T22:15:28.867968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-25T22:15:28.868039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-25T22:15:28.868119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-25T22:15:28.868229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-25T22:15:28.868475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-25T22:15:28.868625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-25T22:15:28.868792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-25T22:15:28.868936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-25T22:15:28.869051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-25T22:15:28.869194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-25T22:15:28.869321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-25T22:15:28.869449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-25T22:15:28.869551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-25T22:15:28.869674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-25T22:15:28.869783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-25T22:15:28.869925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-25T22:15:28.870082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-25T22:15:28.870221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-25T22:15:28.870330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-25T22:15:28.870422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-25T22:15:28.870519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-25T22:15:28.870714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-25T22:15:28.870831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-25T22:15:28.870953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-25T22:15:28.871062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-25T22:15:28.871164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-25T22:15:28.871278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-25T22:15:28.871373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-25T22:15:28.871475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-25T22:15:28.871667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-25T22:15:28.871808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-25T22:15:28.871928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-25T22:15:28.872070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-25T22:15:28.872236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-25T22:15:28.872341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-25T22:15:28.872438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-25T22:15:28.872531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-25T22:15:28.872747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-25T22:15:28.872884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-25T22:15:28.873019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-25T22:15:28.873113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-25T22:15:28.873302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-25T22:15:28.873437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-25T22:15:28.873571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-25T22:15:28.873793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-25T22:15:28.873915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-25T22:15:28.874016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-25T22:15:28.874113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-25T22:15:28.874186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-25T22:15:28.874279] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-25T22:15:28.874376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-25T22:15:28.874496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-25T22:15:28.874619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-25T22:15:28.874768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-25T22:15:28.874872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-25T22:15:28.875018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-25T22:15:28.875142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-25T22:15:28.875240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-25T22:15:28.875310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-25T22:15:28.875434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-25T22:15:28.875557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-25T22:15:28.875963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-25T22:15:28.876095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-25T22:15:28.876226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-25T22:15:28.876364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-25T22:15:28.876482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-25T22:15:28.876605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-25T22:15:28.876812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-25T22:15:28.876941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-25T22:15:28.877087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-25T22:15:28.877289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-25T22:15:28.877511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-25T22:15:28.877660] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-25T22:15:28.877811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-25T22:15:28.877962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-25T22:15:28.878106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-25T22:15:28.878215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-25T22:15:28.878310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-25T22:15:28.878422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-25T22:15:28.878571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-25T22:15:28.878701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-25T22:15:28.878827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-25T22:15:28.878945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-25T22:15:28.879038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-25T22:15:28.879110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-25T22:15:28.879209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-25T22:15:28.879334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-25T22:15:28.879427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-25T22:15:28.879520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-25T22:15:28.879622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-25T22:15:28.879841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-25T22:15:28.879962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-25T22:15:28.880053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-25T22:15:28.880122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-25T22:15:28.880189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-25T22:15:28.880264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-25T22:15:28.880374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-25T22:15:28.880507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-25T22:15:28.880626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-25T22:15:28.880780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-25T22:15:28.880918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-25T22:15:28.881037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-25T22:15:28.881160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-25T22:15:28.881298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-25T22:15:28.881468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-25T22:15:28.881575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-25T22:15:28.881722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-25T22:15:28.881834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-25T22:15:28.881940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-25T22:15:28.882107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-25T22:15:28.882251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-25T22:15:28.882370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-25T22:15:28.882504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-25T22:15:28.882615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-25T22:15:28.882781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-25T22:15:28.882894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-25T22:15:28.883069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-25T22:15:28.883209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-25T22:15:28.883344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-25T22:15:28.883471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-25T22:15:28.883590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-25T22:15:28.883713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-25T22:15:28.883851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-25T22:15:28.883978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-25T22:15:28.884085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-25T22:15:28.884215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-25T22:15:28.884829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCI.csv [2025-09-25T22:15:28.884934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-25T22:15:28.885018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-25T22:15:28.885124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-25T22:15:28.885240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-25T22:15:28.885366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-25T22:15:28.885477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-25T22:15:28.885615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-25T22:15:28.885774] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-25T22:15:28.885916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEO.csv [2025-09-25T22:15:28.886016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-25T22:15:28.886189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-25T22:15:28.886336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-25T22:15:28.886453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-25T22:15:28.886619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-25T22:15:28.886815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-25T22:15:28.886941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-25T22:15:28.887053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-25T22:15:28.887180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-25T22:15:28.887301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-25T22:15:28.887401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-25T22:15:28.887473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-25T22:15:28.887588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-25T22:15:28.887732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-25T22:15:28.887848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-25T22:15:28.887952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-25T22:15:28.888070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-25T22:15:28.888167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-25T22:15:28.888261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-25T22:15:28.888374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-25T22:15:28.888474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-25T22:15:28.888628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-25T22:15:28.888767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-25T22:15:28.888897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-25T22:15:28.889001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-25T22:15:28.889097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-25T22:15:28.889186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-25T22:15:28.889306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-25T22:15:28.889400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-25T22:15:28.889553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-25T22:15:28.889737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-25T22:15:28.889863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-25T22:15:28.889955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-25T22:15:28.890041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-25T22:15:28.890132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-25T22:15:28.890249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-25T22:15:28.890348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-25T22:15:28.890445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-25T22:15:28.890569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-25T22:15:28.890719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-25T22:15:28.890863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-25T22:15:28.890979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-25T22:15:28.891075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-25T22:15:28.891224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-25T22:15:28.891413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-25T22:15:28.891541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-25T22:15:28.891691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-25T22:15:28.891853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-25T22:15:28.891961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-25T22:15:28.892075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-25T22:15:28.892194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-25T22:15:28.892281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-25T22:15:28.892349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-25T22:15:28.892466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-25T22:15:28.892558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-25T22:15:28.892627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-25T22:15:28.892772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-25T22:15:28.892877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-25T22:15:28.893064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-25T22:15:28.893258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-25T22:15:28.893375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-25T22:15:28.893853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-25T22:15:28.893974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DGX.csv [2025-09-25T22:15:28.894099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-25T22:15:28.894236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-25T22:15:28.894364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-25T22:15:28.894455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-25T22:15:28.894569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-25T22:15:28.894715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-25T22:15:28.894813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-25T22:15:28.894921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-25T22:15:28.895051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-25T22:15:28.895153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-25T22:15:28.895278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-25T22:15:28.895404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-25T22:15:28.895535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-25T22:15:28.895681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-25T22:15:28.895870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-25T22:15:28.895972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-25T22:15:28.896068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-25T22:15:28.896173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-25T22:15:28.896306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-25T22:15:28.896406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-25T22:15:28.896481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-25T22:15:28.896624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-25T22:15:28.896780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-25T22:15:28.896860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSMC.csv [2025-09-25T22:15:28.896951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-25T22:15:28.897095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-25T22:15:28.897203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-25T22:15:28.897312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-25T22:15:28.897427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-25T22:15:28.897539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-25T22:15:28.897635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-25T22:15:28.897776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-25T22:15:28.897870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-25T22:15:28.898001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-25T22:15:28.898109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-25T22:15:28.898246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-25T22:15:28.898380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-25T22:15:28.898508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-25T22:15:28.898629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-25T22:15:28.898782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-25T22:15:28.898898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-25T22:15:28.898996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-25T22:15:28.899202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-25T22:15:28.899298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-25T22:15:28.899379] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-25T22:15:28.899516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-25T22:15:28.899623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-25T22:15:28.899797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-25T22:15:28.899920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-25T22:15:28.900046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-25T22:15:28.900148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-25T22:15:28.900240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-25T22:15:28.900370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-25T22:15:28.900467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-25T22:15:28.900549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-25T22:15:28.900775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-25T22:15:28.900902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-25T22:15:28.901011] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-25T22:15:28.901105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-25T22:15:28.901185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-25T22:15:28.901294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-25T22:15:28.901422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-25T22:15:28.901537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-25T22:15:28.901689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-25T22:15:28.901783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-25T22:15:28.901884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-25T22:15:28.901997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-25T22:15:28.902160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-25T22:15:28.902254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-25T22:15:28.902391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-25T22:15:28.902507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-25T22:15:28.902636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-25T22:15:28.903077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-25T22:15:28.903173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-25T22:15:28.903317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-25T22:15:28.903412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-25T22:15:28.903504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-25T22:15:28.903663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-25T22:15:28.903779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-25T22:15:28.903905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-25T22:15:28.904002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-25T22:15:28.904073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-25T22:15:28.904199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-25T22:15:28.904342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-25T22:15:28.904491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-25T22:15:28.904599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-25T22:15:28.904752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-25T22:15:28.904881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-25T22:15:28.905006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-25T22:15:28.905145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-25T22:15:28.905262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-25T22:15:28.905382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-25T22:15:28.905537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-25T22:15:28.905631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-25T22:15:28.905794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-25T22:15:28.905919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-25T22:15:28.906060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-25T22:15:28.906154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-25T22:15:28.906252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-25T22:15:28.906344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-25T22:15:28.906429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-25T22:15:28.906574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-25T22:15:28.906733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-25T22:15:28.906884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-25T22:15:28.907006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-25T22:15:28.907143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-25T22:15:28.907284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-25T22:15:28.907435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-25T22:15:28.907536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-25T22:15:28.907748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-25T22:15:28.907899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-25T22:15:28.907998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-25T22:15:28.908099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-25T22:15:28.908228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-25T22:15:28.908396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-25T22:15:28.908526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-25T22:15:28.908637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-25T22:15:28.908824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-25T22:15:28.908976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-25T22:15:28.909114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-25T22:15:28.909207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-25T22:15:28.909325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-25T22:15:28.909422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-25T22:15:28.909519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-25T22:15:28.909616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-25T22:15:28.909737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-25T22:15:28.910105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-25T22:15:28.910235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-25T22:15:28.910366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-25T22:15:28.910489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-25T22:15:28.910590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-25T22:15:28.910731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-25T22:15:28.910828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-25T22:15:28.910921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-25T22:15:28.911014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-25T22:15:28.911112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-25T22:15:28.911215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-25T22:15:28.911324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-25T22:15:28.911453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-25T22:15:28.911545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-25T22:15:28.912059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-25T22:15:28.912166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-25T22:15:28.912287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-25T22:15:28.912421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-25T22:15:28.912520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHD.csv [2025-09-25T22:15:28.912676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-25T22:15:28.912779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-25T22:15:28.912853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UP.csv [2025-09-25T22:15:28.912983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-25T22:15:28.913179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-25T22:15:28.913314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-25T22:15:28.913424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-25T22:15:28.913544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-25T22:15:28.913635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-25T22:15:28.913757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-25T22:15:28.913849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-25T22:15:28.913969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-25T22:15:28.914112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-25T22:15:28.914209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-25T22:15:28.914291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-25T22:15:28.914395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-25T22:15:28.914503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-25T22:15:28.914618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-25T22:15:28.914814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-25T22:15:28.914913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-25T22:15:28.915000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-25T22:15:28.915106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-25T22:15:28.915289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-25T22:15:28.915426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-25T22:15:28.915553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-25T22:15:28.915700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-25T22:15:28.915823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-25T22:15:28.915918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-25T22:15:28.916017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-25T22:15:28.916139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-25T22:15:28.916258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-25T22:15:28.916377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-25T22:15:28.916568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-25T22:15:28.916758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-25T22:15:28.916889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-25T22:15:28.917044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-25T22:15:28.917137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-25T22:15:28.917223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-25T22:15:28.917315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-25T22:15:28.917423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-25T22:15:28.917523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-25T22:15:28.917611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-25T22:15:28.917743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-25T22:15:28.917843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-25T22:15:28.917949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-25T22:15:28.918072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-25T22:15:28.918166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-25T22:15:28.918236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-25T22:15:28.918315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-25T22:15:28.918445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-25T22:15:28.918590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-25T22:15:28.918768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGA.csv [2025-09-25T22:15:28.918869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BE.csv [2025-09-25T22:15:28.918940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-25T22:15:28.919006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-25T22:15:28.919081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-25T22:15:28.919213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-25T22:15:28.919321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-25T22:15:28.919447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-25T22:15:28.919555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-25T22:15:28.919690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-25T22:15:28.919831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-25T22:15:28.919967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-25T22:15:28.920104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-25T22:15:28.920242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-25T22:15:28.920336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-25T22:15:28.920426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-25T22:15:28.920506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-25T22:15:28.920626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-25T22:15:28.921113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-25T22:15:28.921218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-25T22:15:28.921341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-25T22:15:28.921449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-25T22:15:28.921556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-25T22:15:28.921685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-25T22:15:28.921810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-25T22:15:28.921930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-25T22:15:28.922023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-25T22:15:28.922133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-25T22:15:28.922250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-25T22:15:28.922344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-25T22:15:28.922442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-25T22:15:28.922575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-25T22:15:28.922750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-25T22:15:28.922845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-25T22:15:28.922954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-25T22:15:28.923100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-25T22:15:28.923248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-25T22:15:28.923362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-25T22:15:28.923487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-25T22:15:28.923624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-25T22:15:28.923746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-25T22:15:28.923889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-25T22:15:28.923984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-25T22:15:28.924071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-25T22:15:28.924161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-25T22:15:28.924229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-25T22:15:28.924295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-25T22:15:28.924382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-25T22:15:28.924476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-25T22:15:28.924590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-25T22:15:28.924725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-25T22:15:28.924841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-25T22:15:28.924960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKN.csv [2025-09-25T22:15:28.925085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-25T22:15:28.925172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-25T22:15:28.925288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-25T22:15:28.925403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-25T22:15:28.925498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-25T22:15:28.925609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-25T22:15:28.925776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-25T22:15:28.925884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-25T22:15:28.926015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-25T22:15:28.926134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-25T22:15:28.926227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-25T22:15:28.926340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-25T22:15:28.926459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-25T22:15:28.926578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-25T22:15:28.926819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-25T22:15:28.926935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-25T22:15:28.927029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-25T22:15:28.927130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-25T22:15:28.927223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-25T22:15:28.927295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-25T22:15:28.927384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-25T22:15:28.927514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-25T22:15:28.927609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-25T22:15:28.927732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-25T22:15:28.927828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-25T22:15:28.927916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-25T22:15:28.928031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-25T22:15:28.928131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-25T22:15:28.928225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-25T22:15:28.928320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-25T22:15:28.928428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-25T22:15:28.928596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-25T22:15:28.928747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-25T22:15:28.928897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-25T22:15:28.929054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-25T22:15:28.929213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-25T22:15:28.929339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-25T22:15:28.929449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-25T22:15:28.929571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-25T22:15:28.930039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-25T22:15:28.930179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-25T22:15:28.930303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-25T22:15:28.930408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-25T22:15:28.930567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-25T22:15:28.930777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-25T22:15:28.930909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCY.csv [2025-09-25T22:15:28.931020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-25T22:15:28.931153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-25T22:15:28.931281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-25T22:15:28.931420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-25T22:15:28.931553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-25T22:15:28.931673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-25T22:15:28.931790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-25T22:15:28.931903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-25T22:15:28.931999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-25T22:15:28.932077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-25T22:15:28.932173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-25T22:15:28.932267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-25T22:15:28.932359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDO.csv [2025-09-25T22:15:28.932505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-25T22:15:28.932598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-25T22:15:28.932729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-25T22:15:28.932823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-25T22:15:28.932895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-25T22:15:28.933036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-25T22:15:28.933130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-25T22:15:28.933224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-25T22:15:28.933341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-25T22:15:28.933468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-25T22:15:28.933568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-25T22:15:28.933688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-25T22:15:28.933784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-25T22:15:28.933901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-25T22:15:28.934007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-25T22:15:28.934123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-25T22:15:28.934244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-25T22:15:28.934365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-25T22:15:28.934473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-25T22:15:28.934566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-25T22:15:28.934696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-25T22:15:28.934874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-25T22:15:28.934972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-25T22:15:28.935092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-25T22:15:28.935201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-25T22:15:28.935347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-25T22:15:28.935456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-25T22:15:28.935570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-25T22:15:28.935699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-25T22:15:28.935828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-25T22:15:28.935921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-25T22:15:28.936025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-25T22:15:28.936146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-25T22:15:28.936240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-25T22:15:28.936308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-25T22:15:28.936391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-25T22:15:28.936480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-25T22:15:28.936580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-25T22:15:28.936775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBL.csv [2025-09-25T22:15:28.936890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-25T22:15:28.936986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-25T22:15:28.937054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-25T22:15:28.937145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-25T22:15:28.937264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-25T22:15:28.937374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-25T22:15:28.937860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-25T22:15:28.938001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-25T22:15:28.938215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-25T22:15:28.938324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-25T22:15:28.938452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-25T22:15:28.938557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-25T22:15:28.938705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-25T22:15:28.938813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-25T22:15:28.938905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-25T22:15:28.939017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-25T22:15:28.939115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-25T22:15:28.939195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-25T22:15:28.939323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-25T22:15:28.939436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-25T22:15:28.939516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-25T22:15:28.939582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-25T22:15:28.939741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMD.csv [2025-09-25T22:15:28.939877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-25T22:15:28.940020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-25T22:15:28.940112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-25T22:15:28.940211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-25T22:15:28.940303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-25T22:15:28.940395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-25T22:15:28.940526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-25T22:15:28.940678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-25T22:15:28.940771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-25T22:15:28.940843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-25T22:15:28.940909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-25T22:15:28.940993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-25T22:15:28.941112] [INFO ] [LOCAL ] Deleted 1955 derivative data files. [2025-09-25T22:15:28.941169] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-25T22:15:28.943453] [INFO ] [LOCAL ] Found 2043 symbols with primary data. [2025-09-25T22:15:28.944038] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2043 symbols [2025-09-25T22:15:28.945103] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:28.947552] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:28.950172] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:29.097288] [DEBUG] [LOCAL ] A: Loaded 51143 existing records from primary storage. [2025-09-25T22:15:29.097521] [INFO ] [MAIN ] A: Loaded 51143 primary data records. [2025-09-25T22:15:29.129531] [DEBUG] [LOCAL ] AAP: Loaded 52464 existing records from primary storage. [2025-09-25T22:15:29.129734] [INFO ] [MAIN ] AAP: Loaded 52464 primary data records. [2025-09-25T22:15:29.305173] [DEBUG] [LOCAL ] AA: Loaded 54004 existing records from primary storage. [2025-09-25T22:15:29.305346] [INFO ] [MAIN ] AA: Loaded 54004 primary data records. [2025-09-25T22:15:30.251275] [DEBUG] [MAIN ] AAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:30.252131] [INFO ] [MAIN ] AAP: Generated 1807 derivative records from 52464 primary records. [2025-09-25T22:15:30.252201] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-25T22:15:30.313872] [DEBUG] [LOCAL ] AAP: Derivative data saved (1807 records). [2025-09-25T22:15:30.314034] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-25T22:15:30.316481] [INFO ] [MAIN ] Derivative Progress: 1/2043 symbols completed. AAP took 1.4s. Estimated remaining: 46m 43s. Rate: 43.7 symbols/min [2025-09-25T22:15:30.322946] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:30.383184] [DEBUG] [MAIN ] A: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:30.396168] [DEBUG] [MAIN ] AA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:30.397088] [INFO ] [MAIN ] AA: Generated 1807 derivative records from 54004 primary records. [2025-09-25T22:15:30.397154] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-25T22:15:30.395611] [INFO ] [MAIN ] A: Generated 1807 derivative records from 51143 primary records. [2025-09-25T22:15:30.415419] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-25T22:15:30.429574] [DEBUG] [LOCAL ] AAT: Loaded 30881 existing records from primary storage. [2025-09-25T22:15:30.433326] [INFO ] [MAIN ] AAT: Loaded 30881 primary data records. [2025-09-25T22:15:30.450122] [DEBUG] [LOCAL ] AA: Derivative data saved (1807 records). [2025-09-25T22:15:30.450256] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-25T22:15:30.452247] [INFO ] [MAIN ] Derivative Progress: 2/2043 symbols completed. AA took 1.5s. Estimated remaining: 25m 40s. Rate: 79.5 symbols/min [2025-09-25T22:15:30.459257] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:30.454602] [DEBUG] [LOCAL ] A: Derivative data saved (1807 records). [2025-09-25T22:15:30.465621] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-25T22:15:30.476946] [INFO ] [MAIN ] Derivative Progress: 3/2043 symbols completed. A took 1.5s. Estimated remaining: 17m 23s. Rate: 117.4 symbols/min [2025-09-25T22:15:30.483971] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:30.684615] [DEBUG] [LOCAL ] ABBV: Loaded 54076 existing records from primary storage. [2025-09-25T22:15:30.684876] [INFO ] [MAIN ] ABBV: Loaded 54076 primary data records. [2025-09-25T22:15:30.698831] [DEBUG] [LOCAL ] ABEV: Loaded 53665 existing records from primary storage. [2025-09-25T22:15:30.699004] [INFO ] [MAIN ] ABEV: Loaded 53665 primary data records. [2025-09-25T22:15:31.503480] [DEBUG] [MAIN ] ABBV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:31.504423] [INFO ] [MAIN ] ABBV: Generated 1807 derivative records from 54076 primary records. [2025-09-25T22:15:31.504597] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-25T22:15:31.543908] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1807 records). [2025-09-25T22:15:31.544036] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-25T22:15:31.546338] [INFO ] [MAIN ] Derivative Progress: 4/2043 symbols completed. ABBV took 1.1s. Estimated remaining: 22m 7s. Rate: 92.2 symbols/min [2025-09-25T22:15:31.557227] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:31.574733] [DEBUG] [MAIN ] AAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:31.575562] [INFO ] [MAIN ] AAT: Generated 1807 derivative records from 30881 primary records. [2025-09-25T22:15:31.575629] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-25T22:15:31.613325] [DEBUG] [LOCAL ] ABG: Loaded 18922 existing records from primary storage. [2025-09-25T22:15:31.613501] [INFO ] [MAIN ] ABG: Loaded 18922 primary data records. [2025-09-25T22:15:31.654389] [DEBUG] [LOCAL ] AAT: Derivative data saved (1807 records). [2025-09-25T22:15:31.654522] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-25T22:15:31.656719] [INFO ] [MAIN ] Derivative Progress: 5/2043 symbols completed. AAT took 1.3s. Estimated remaining: 18m 26s. Rate: 110.6 symbols/min [2025-09-25T22:15:31.661295] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:31.842354] [DEBUG] [LOCAL ] ABM: Loaded 32713 existing records from primary storage. [2025-09-25T22:15:31.842605] [INFO ] [MAIN ] ABM: Loaded 32713 primary data records. [2025-09-25T22:15:31.955547] [DEBUG] [MAIN ] ABEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:31.956362] [INFO ] [MAIN ] ABEV: Generated 1807 derivative records from 53665 primary records. [2025-09-25T22:15:31.956432] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-25T22:15:32.008890] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1807 records). [2025-09-25T22:15:32.009030] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-25T22:15:32.013400] [INFO ] [MAIN ] Derivative Progress: 6/2043 symbols completed. ABEV took 1.5s. Estimated remaining: 17m 22s. Rate: 117.3 symbols/min [2025-09-25T22:15:32.019016] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:32.508767] [DEBUG] [LOCAL ] ABR: Loaded 52464 existing records from primary storage. [2025-09-25T22:15:32.508947] [INFO ] [MAIN ] ABR: Loaded 52464 primary data records. [2025-09-25T22:15:32.536003] [DEBUG] [MAIN ] ABG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:32.536719] [INFO ] [MAIN ] ABG: Generated 1807 derivative records from 18922 primary records. [2025-09-25T22:15:32.536784] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-25T22:15:32.578799] [DEBUG] [LOCAL ] ABG: Derivative data saved (1807 records). [2025-09-25T22:15:32.578917] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-25T22:15:32.581183] [INFO ] [MAIN ] Derivative Progress: 7/2043 symbols completed. ABG took 1.0s. Estimated remaining: 17m 38s. Rate: 115.5 symbols/min [2025-09-25T22:15:32.589506] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:32.664758] [DEBUG] [LOCAL ] ACEL: Loaded 27254 existing records from primary storage. [2025-09-25T22:15:32.664907] [INFO ] [MAIN ] ACEL: Loaded 27254 primary data records. [2025-09-25T22:15:32.947700] [DEBUG] [MAIN ] ABM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:32.948538] [INFO ] [MAIN ] ABM: Generated 1807 derivative records from 32713 primary records. [2025-09-25T22:15:32.948605] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-25T22:15:33.039836] [DEBUG] [LOCAL ] ABM: Derivative data saved (1807 records). [2025-09-25T22:15:33.039970] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-25T22:15:33.042616] [INFO ] [MAIN ] Derivative Progress: 8/2043 symbols completed. ABM took 1.4s. Estimated remaining: 17m 23s. Rate: 117.1 symbols/min [2025-09-25T22:15:33.051072] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:33.388491] [DEBUG] [MAIN ] ABR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:33.405326] [INFO ] [MAIN ] ABR: Generated 1807 derivative records from 52464 primary records. [2025-09-25T22:15:33.405406] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-25T22:15:33.429371] [DEBUG] [LOCAL ] ABR: Derivative data saved (1807 records). [2025-09-25T22:15:33.429505] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-25T22:15:33.432363] [INFO ] [MAIN ] Derivative Progress: 9/2043 symbols completed. ABR took 1.4s. Estimated remaining: 16m 54s. Rate: 120.3 symbols/min [2025-09-25T22:15:33.432614] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:33.449785] [DEBUG] [MAIN ] ACEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:33.450584] [INFO ] [MAIN ] ACEL: Generated 1807 derivative records from 27254 primary records. [2025-09-25T22:15:33.472113] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-25T22:15:33.487594] [DEBUG] [LOCAL ] ACHR: Loaded 54208 existing records from primary storage. [2025-09-25T22:15:33.487828] [INFO ] [MAIN ] ACHR: Loaded 54208 primary data records. [2025-09-25T22:15:33.547502] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1807 records). [2025-09-25T22:15:33.547719] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-25T22:15:33.550472] [INFO ] [MAIN ] Derivative Progress: 10/2043 symbols completed. ACEL took 1.0s. Estimated remaining: 15m 37s. Rate: 130.2 symbols/min [2025-09-25T22:15:33.567863] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:33.874136] [DEBUG] [LOCAL ] ACP: Loaded 31281 existing records from primary storage. [2025-09-25T22:15:33.874355] [INFO ] [MAIN ] ACP: Loaded 31281 primary data records. [2025-09-25T22:15:33.971550] [DEBUG] [LOCAL ] ACI: Loaded 53659 existing records from primary storage. [2025-09-25T22:15:33.983843] [INFO ] [MAIN ] ACI: Loaded 53659 primary data records. [2025-09-25T22:15:34.003727] [DEBUG] [MAIN ] ACHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:34.004629] [INFO ] [MAIN ] ACHR: Generated 1807 derivative records from 54208 primary records. [2025-09-25T22:15:34.008761] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-25T22:15:34.062500] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1807 records). [2025-09-25T22:15:34.068728] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-25T22:15:34.071600] [INFO ] [MAIN ] Derivative Progress: 11/2043 symbols completed. ACHR took 1.0s. Estimated remaining: 15m 47s. Rate: 128.7 symbols/min [2025-09-25T22:15:34.085503] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:34.137881] [DEBUG] [LOCAL ] ACR: Loaded 6320 existing records from primary storage. [2025-09-25T22:15:34.138112] [INFO ] [MAIN ] ACR: Loaded 6320 primary data records. [2025-09-25T22:15:35.101945] [DEBUG] [MAIN ] ACR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:35.103303] [INFO ] [MAIN ] ACR: Generated 1807 derivative records from 6320 primary records. [2025-09-25T22:15:35.103377] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-25T22:15:35.123568] [DEBUG] [MAIN ] ACP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:35.124319] [INFO ] [MAIN ] ACP: Generated 1807 derivative records from 31281 primary records. [2025-09-25T22:15:35.124383] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-25T22:15:35.152547] [DEBUG] [LOCAL ] ACR: Derivative data saved (1807 records). [2025-09-25T22:15:35.152734] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-25T22:15:35.156291] [DEBUG] [MAIN ] ACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:35.157058] [INFO ] [MAIN ] ACI: Generated 1807 derivative records from 53659 primary records. [2025-09-25T22:15:35.157134] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-25T22:15:35.155074] [INFO ] [MAIN ] Derivative Progress: 12/2043 symbols completed. ACR took 1.1s. Estimated remaining: 17m 31s. Rate: 115.9 symbols/min [2025-09-25T22:15:35.168761] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:35.174003] [DEBUG] [LOCAL ] ACP: Derivative data saved (1807 records). [2025-09-25T22:15:35.178068] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-25T22:15:35.180830] [INFO ] [MAIN ] Derivative Progress: 13/2043 symbols completed. ACP took 1.6s. Estimated remaining: 16m 14s. Rate: 125.1 symbols/min [2025-09-25T22:15:35.192173] [DEBUG] [LOCAL ] ACI: Derivative data saved (1807 records). [2025-09-25T22:15:35.192247] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-25T22:15:35.194792] [INFO ] [MAIN ] Derivative Progress: 14/2043 symbols completed. ACI took 1.8s. Estimated remaining: 15m 6s. Rate: 134.4 symbols/min [2025-09-25T22:15:35.195272] [DEBUG] [LOCAL ] ACV: Loaded 7016 existing records from primary storage. [2025-09-25T22:15:35.195342] [INFO ] [MAIN ] ACV: Loaded 7016 primary data records. [2025-09-25T22:15:35.521413] [DEBUG] [MAIN ] ACV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:35.522188] [INFO ] [MAIN ] ACV: Generated 1807 derivative records from 7016 primary records. [2025-09-25T22:15:35.522254] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-25T22:15:35.537420] [DEBUG] [LOCAL ] ACV: Derivative data saved (1807 records). [2025-09-25T22:15:35.537560] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-25T22:15:35.539804] [INFO ] [MAIN ] Derivative Progress: 15/2043 symbols completed. ACV took 0.4s. Estimated remaining: 14m 52s. Rate: 136.4 symbols/min [2025-09-25T22:15:35.540401] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:35.542741] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:35.545752] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:35.634921] [DEBUG] [LOCAL ] ADCT: Loaded 34394 existing records from primary storage. [2025-09-25T22:15:35.635110] [INFO ] [MAIN ] ADCT: Loaded 34394 primary data records. [2025-09-25T22:15:35.695526] [DEBUG] [LOCAL ] ADNT: Loaded 47786 existing records from primary storage. [2025-09-25T22:15:35.695763] [INFO ] [MAIN ] ADNT: Loaded 47786 primary data records. [2025-09-25T22:15:35.749524] [DEBUG] [LOCAL ] ADT: Loaded 53866 existing records from primary storage. [2025-09-25T22:15:35.749709] [INFO ] [MAIN ] ADT: Loaded 53866 primary data records. [2025-09-25T22:15:36.579481] [DEBUG] [MAIN ] ADNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:36.587619] [INFO ] [MAIN ] ADNT: Generated 1807 derivative records from 47786 primary records. [2025-09-25T22:15:36.587785] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-25T22:15:36.618281] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1807 records). [2025-09-25T22:15:36.623171] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-25T22:15:36.625403] [INFO ] [MAIN ] Derivative Progress: 16/2043 symbols completed. ADNT took 1.1s. Estimated remaining: 16m 13s. Rate: 125.0 symbols/min [2025-09-25T22:15:36.625626] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:36.718743] [DEBUG] [LOCAL ] ADX: Loaded 28005 existing records from primary storage. [2025-09-25T22:15:36.718902] [INFO ] [MAIN ] ADX: Loaded 28005 primary data records. [2025-09-25T22:15:36.796798] [DEBUG] [MAIN ] ADCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:36.797535] [INFO ] [MAIN ] ADCT: Generated 1807 derivative records from 34394 primary records. [2025-09-25T22:15:36.797603] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-25T22:15:36.845153] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1807 records). [2025-09-25T22:15:36.845288] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-25T22:15:36.847502] [INFO ] [MAIN ] Derivative Progress: 17/2043 symbols completed. ADCT took 1.3s. Estimated remaining: 15m 42s. Rate: 129.0 symbols/min [2025-09-25T22:15:36.856462] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:37.152203] [DEBUG] [LOCAL ] AEE: Loaded 50500 existing records from primary storage. [2025-09-25T22:15:37.152422] [INFO ] [MAIN ] AEE: Loaded 50500 primary data records. [2025-09-25T22:15:37.201585] [DEBUG] [MAIN ] ADT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:37.212377] [INFO ] [MAIN ] ADT: Generated 1807 derivative records from 53866 primary records. [2025-09-25T22:15:37.212448] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-25T22:15:37.263745] [DEBUG] [LOCAL ] ADT: Derivative data saved (1807 records). [2025-09-25T22:15:37.263867] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-25T22:15:37.267183] [INFO ] [MAIN ] Derivative Progress: 18/2043 symbols completed. ADT took 1.7s. Estimated remaining: 15m 36s. Rate: 129.8 symbols/min [2025-09-25T22:15:37.267463] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:37.636330] [DEBUG] [MAIN ] ADX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:37.637065] [INFO ] [MAIN ] ADX: Generated 1807 derivative records from 28005 primary records. [2025-09-25T22:15:37.637134] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-25T22:15:37.777410] [DEBUG] [LOCAL ] AEO: Loaded 53946 existing records from primary storage. [2025-09-25T22:15:37.777635] [INFO ] [MAIN ] AEO: Loaded 53946 primary data records. [2025-09-25T22:15:37.767384] [DEBUG] [LOCAL ] ADX: Derivative data saved (1807 records). [2025-09-25T22:15:37.789907] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-25T22:15:37.792153] [INFO ] [MAIN ] Derivative Progress: 19/2043 symbols completed. ADX took 1.2s. Estimated remaining: 15m 43s. Rate: 128.8 symbols/min [2025-09-25T22:15:37.792385] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:37.907751] [DEBUG] [MAIN ] AEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:37.920751] [INFO ] [MAIN ] AEE: Generated 1807 derivative records from 50500 primary records. [2025-09-25T22:15:37.921003] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-25T22:15:37.969800] [DEBUG] [LOCAL ] AEE: Derivative data saved (1807 records). [2025-09-25T22:15:37.969948] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-25T22:15:37.972231] [INFO ] [MAIN ] Derivative Progress: 20/2043 symbols completed. AEE took 1.1s. Estimated remaining: 15m 13s. Rate: 132.9 symbols/min [2025-09-25T22:15:37.972481] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:37.984298] [DEBUG] [LOCAL ] AES: Loaded 54061 existing records from primary storage. [2025-09-25T22:15:37.984485] [INFO ] [MAIN ] AES: Loaded 54061 primary data records. [2025-09-25T22:15:38.145993] [DEBUG] [LOCAL ] AESI: Loaded 49853 existing records from primary storage. [2025-09-25T22:15:38.146164] [INFO ] [MAIN ] AESI: Loaded 49853 primary data records. [2025-09-25T22:15:38.750226] [DEBUG] [MAIN ] AES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:38.751099] [INFO ] [MAIN ] AES: Generated 1807 derivative records from 54061 primary records. [2025-09-25T22:15:38.751165] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-25T22:15:38.827568] [DEBUG] [LOCAL ] AES: Derivative data saved (1807 records). [2025-09-25T22:15:38.832086] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-25T22:15:38.834339] [INFO ] [MAIN ] Derivative Progress: 21/2043 symbols completed. AES took 1.0s. Estimated remaining: 15m 52s. Rate: 127.4 symbols/min [2025-09-25T22:15:38.834544] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:38.895783] [DEBUG] [LOCAL ] AFB: Loaded 11386 existing records from primary storage. [2025-09-25T22:15:38.895938] [INFO ] [MAIN ] AFB: Loaded 11386 primary data records. [2025-09-25T22:15:38.901986] [DEBUG] [MAIN ] AEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:38.902776] [INFO ] [MAIN ] AEO: Generated 1807 derivative records from 53946 primary records. [2025-09-25T22:15:38.902840] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-25T22:15:39.031126] [DEBUG] [LOCAL ] AEO: Derivative data saved (1807 records). [2025-09-25T22:15:39.031274] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-25T22:15:39.033592] [INFO ] [MAIN ] Derivative Progress: 22/2043 symbols completed. AEO took 1.8s. Estimated remaining: 15m 27s. Rate: 130.8 symbols/min [2025-09-25T22:15:39.055057] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:39.246545] [DEBUG] [MAIN ] AESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:39.248531] [INFO ] [MAIN ] AESI: Generated 1807 derivative records from 49853 primary records. [2025-09-25T22:15:39.248600] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-25T22:15:39.312351] [DEBUG] [LOCAL ] AESI: Derivative data saved (1807 records). [2025-09-25T22:15:39.312498] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-25T22:15:39.316738] [DEBUG] [LOCAL ] AFG: Loaded 32808 existing records from primary storage. [2025-09-25T22:15:39.316884] [INFO ] [MAIN ] AFG: Loaded 32808 primary data records. [2025-09-25T22:15:39.316510] [INFO ] [MAIN ] Derivative Progress: 23/2043 symbols completed. AESI took 1.3s. Estimated remaining: 15m 11s. Rate: 133.0 symbols/min [2025-09-25T22:15:39.331082] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:39.385964] [DEBUG] [LOCAL ] AFGB: Loaded 2394 existing records from primary storage. [2025-09-25T22:15:39.386154] [INFO ] [MAIN ] AFGB: Loaded 2394 primary data records. [2025-09-25T22:15:39.990342] [DEBUG] [MAIN ] AFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:39.991022] [INFO ] [MAIN ] AFB: Generated 1807 derivative records from 11386 primary records. [2025-09-25T22:15:39.991087] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-25T22:15:40.021516] [DEBUG] [LOCAL ] AFB: Derivative data saved (1807 records). [2025-09-25T22:15:40.302402] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-25T22:15:40.304864] [INFO ] [MAIN ] Derivative Progress: 24/2043 symbols completed. AFB took 1.5s. Estimated remaining: 15m 56s. Rate: 126.7 symbols/min [2025-09-25T22:15:40.318083] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:40.332128] [DEBUG] [LOCAL ] AFGC: Loaded 2590 existing records from primary storage. [2025-09-25T22:15:40.332277] [INFO ] [MAIN ] AFGC: Loaded 2590 primary data records. [2025-09-25T22:15:40.383455] [DEBUG] [MAIN ] AFGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:40.384117] [INFO ] [MAIN ] AFGB: Generated 1807 derivative records from 2394 primary records. [2025-09-25T22:15:40.384183] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-25T22:15:40.413405] [DEBUG] [MAIN ] AFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:40.413981] [INFO ] [MAIN ] AFG: Generated 1807 derivative records from 32808 primary records. [2025-09-25T22:15:40.414096] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-25T22:15:40.431184] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1807 records). [2025-09-25T22:15:40.431255] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-25T22:15:40.434774] [INFO ] [MAIN ] Derivative Progress: 25/2043 symbols completed. AFGB took 1.1s. Estimated remaining: 15m 28s. Rate: 130.5 symbols/min [2025-09-25T22:15:40.443278] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:40.457793] [DEBUG] [LOCAL ] AFGD: Loaded 1852 existing records from primary storage. [2025-09-25T22:15:40.457885] [INFO ] [MAIN ] AFGD: Loaded 1852 primary data records. [2025-09-25T22:15:40.466839] [DEBUG] [LOCAL ] AFG: Derivative data saved (1807 records). [2025-09-25T22:15:40.466907] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-25T22:15:40.469285] [INFO ] [MAIN ] Derivative Progress: 26/2043 symbols completed. AFG took 1.4s. Estimated remaining: 14m 54s. Rate: 135.3 symbols/min [2025-09-25T22:15:40.469460] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:40.493083] [DEBUG] [LOCAL ] AFGE: Loaded 2508 existing records from primary storage. [2025-09-25T22:15:40.493178] [INFO ] [MAIN ] AFGE: Loaded 2508 primary data records. [2025-09-25T22:15:41.311374] [DEBUG] [MAIN ] AFGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:41.312085] [INFO ] [MAIN ] AFGE: Generated 1807 derivative records from 2508 primary records. [2025-09-25T22:15:41.312153] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-25T22:15:41.350382] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1807 records). [2025-09-25T22:15:41.351956] [DEBUG] [MAIN ] AFGC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:15:41.352549] [INFO ] [MAIN ] AFGC: Generated 1806 derivative records from 2590 primary records. [2025-09-25T22:15:41.352610] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-25T22:15:41.350485] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-25T22:15:41.355085] [INFO ] [MAIN ] Derivative Progress: 27/2043 symbols completed. AFGE took 0.9s. Estimated remaining: 15m 27s. Rate: 130.5 symbols/min [2025-09-25T22:15:41.355279] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:41.425990] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1806 records). [2025-09-25T22:15:41.426106] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-25T22:15:41.428565] [INFO ] [MAIN ] Derivative Progress: 28/2043 symbols completed. AFGC took 1.1s. Estimated remaining: 14m 58s. Rate: 134.6 symbols/min [2025-09-25T22:15:41.500219] [DEBUG] [LOCAL ] AFL: Loaded 53532 existing records from primary storage. [2025-09-25T22:15:41.500378] [INFO ] [MAIN ] AFL: Loaded 53532 primary data records. [2025-09-25T22:15:41.714787] [DEBUG] [MAIN ] AFGD: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:15:41.726497] [INFO ] [MAIN ] AFGD: Generated 1805 derivative records from 1852 primary records. [2025-09-25T22:15:41.732690] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-25T22:15:41.937418] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1805 records). [2025-09-25T22:15:41.937564] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-25T22:15:41.939946] [INFO ] [MAIN ] Derivative Progress: 29/2043 symbols completed. AFGD took 1.5s. Estimated remaining: 15m 3s. Rate: 133.9 symbols/min [2025-09-25T22:15:41.959283] [DEBUG] [MAIN ] AFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:41.960026] [INFO ] [MAIN ] AFL: Generated 1807 derivative records from 53532 primary records. [2025-09-25T22:15:41.960091] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-25T22:15:41.976726] [DEBUG] [LOCAL ] AFL: Derivative data saved (1807 records). [2025-09-25T22:15:41.976850] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-25T22:15:41.982761] [INFO ] [MAIN ] Derivative Progress: 30/2043 symbols completed. AFL took 0.6s. Estimated remaining: 14m 35s. Rate: 138.0 symbols/min [2025-09-25T22:15:41.984140] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:41.984802] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:41.986848] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:42.018062] [DEBUG] [LOCAL ] AGD: Loaded 17874 existing records from primary storage. [2025-09-25T22:15:42.018221] [INFO ] [MAIN ] AGD: Loaded 17874 primary data records. [2025-09-25T22:15:42.193889] [DEBUG] [LOCAL ] AG: Loaded 54033 existing records from primary storage. [2025-09-25T22:15:42.194061] [INFO ] [MAIN ] AG: Loaded 54033 primary data records. [2025-09-25T22:15:42.266614] [DEBUG] [LOCAL ] AGCO: Loaded 42791 existing records from primary storage. [2025-09-25T22:15:42.266836] [INFO ] [MAIN ] AGCO: Loaded 42791 primary data records. [2025-09-25T22:15:43.067883] [DEBUG] [MAIN ] AGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:43.068667] [INFO ] [MAIN ] AGD: Generated 1807 derivative records from 17874 primary records. [2025-09-25T22:15:43.068747] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-25T22:15:43.096104] [DEBUG] [MAIN ] AG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:43.096960] [INFO ] [MAIN ] AG: Generated 1807 derivative records from 54033 primary records. [2025-09-25T22:15:43.097026] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-25T22:15:43.118538] [DEBUG] [LOCAL ] AGD: Derivative data saved (1807 records). [2025-09-25T22:15:43.118627] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-25T22:15:43.129153] [DEBUG] [LOCAL ] AG: Derivative data saved (1807 records). [2025-09-25T22:15:43.129222] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-25T22:15:43.127512] [INFO ] [MAIN ] Derivative Progress: 31/2043 symbols completed. AGD took 1.1s. Estimated remaining: 15m 21s. Rate: 131.1 symbols/min [2025-09-25T22:15:43.140444] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:43.142689] [INFO ] [MAIN ] Derivative Progress: 32/2043 symbols completed. AG took 1.2s. Estimated remaining: 14m 52s. Rate: 135.2 symbols/min [2025-09-25T22:15:43.142865] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:43.284378] [DEBUG] [LOCAL ] AGI: Loaded 53807 existing records from primary storage. [2025-09-25T22:15:43.284530] [INFO ] [MAIN ] AGI: Loaded 53807 primary data records. [2025-09-25T22:15:43.292203] [DEBUG] [LOCAL ] AGL: Loaded 52810 existing records from primary storage. [2025-09-25T22:15:43.292425] [INFO ] [MAIN ] AGL: Loaded 52810 primary data records. [2025-09-25T22:15:43.498533] [DEBUG] [MAIN ] AGCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:43.499390] [INFO ] [MAIN ] AGCO: Generated 1807 derivative records from 42791 primary records. [2025-09-25T22:15:43.499454] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-25T22:15:43.589162] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1807 records). [2025-09-25T22:15:43.589308] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-25T22:15:43.591159] [INFO ] [MAIN ] Derivative Progress: 33/2043 symbols completed. AGCO took 1.6s. Estimated remaining: 14m 52s. Rate: 135.2 symbols/min [2025-09-25T22:15:43.622031] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:44.071635] [DEBUG] [LOCAL ] AGM: Loaded 9994 existing records from primary storage. [2025-09-25T22:15:44.071842] [INFO ] [MAIN ] AGM: Loaded 9994 primary data records. [2025-09-25T22:15:44.149403] [DEBUG] [MAIN ] AGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:44.150198] [INFO ] [MAIN ] AGI: Generated 1807 derivative records from 53807 primary records. [2025-09-25T22:15:44.150273] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-25T22:15:44.204959] [DEBUG] [MAIN ] AGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:44.205971] [INFO ] [MAIN ] AGL: Generated 1807 derivative records from 52810 primary records. [2025-09-25T22:15:44.206062] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-25T22:15:44.214441] [DEBUG] [LOCAL ] AGI: Derivative data saved (1807 records). [2025-09-25T22:15:44.214569] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-25T22:15:44.223985] [INFO ] [MAIN ] Derivative Progress: 34/2043 symbols completed. AGI took 1.1s. Estimated remaining: 15m 3s. Rate: 133.5 symbols/min [2025-09-25T22:15:44.224207] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:44.287086] [DEBUG] [LOCAL ] AGL: Derivative data saved (1807 records). [2025-09-25T22:15:44.287348] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-25T22:15:44.292612] [INFO ] [MAIN ] Derivative Progress: 35/2043 symbols completed. AGL took 1.1s. Estimated remaining: 14m 41s. Rate: 136.8 symbols/min [2025-09-25T22:15:44.317785] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:44.353273] [DEBUG] [LOCAL ] AGO: Loaded 28247 existing records from primary storage. [2025-09-25T22:15:44.353438] [INFO ] [MAIN ] AGO: Loaded 28247 primary data records. [2025-09-25T22:15:44.522005] [DEBUG] [LOCAL ] AGRO: Loaded 33927 existing records from primary storage. [2025-09-25T22:15:44.522205] [INFO ] [MAIN ] AGRO: Loaded 33927 primary data records. [2025-09-25T22:15:45.359869] [DEBUG] [MAIN ] AGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:45.360617] [INFO ] [MAIN ] AGM: Generated 1807 derivative records from 9994 primary records. [2025-09-25T22:15:45.370765] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-25T22:15:45.414261] [DEBUG] [MAIN ] AGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:45.421579] [INFO ] [MAIN ] AGO: Generated 1807 derivative records from 28247 primary records. [2025-09-25T22:15:45.422939] [DEBUG] [MAIN ] AGRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:45.423918] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-25T22:15:45.424764] [INFO ] [MAIN ] AGRO: Generated 1807 derivative records from 33927 primary records. [2025-09-25T22:15:45.426339] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-25T22:15:45.443593] [DEBUG] [LOCAL ] AGM: Derivative data saved (1807 records). [2025-09-25T22:15:45.451931] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-25T22:15:45.456298] [INFO ] [MAIN ] Derivative Progress: 36/2043 symbols completed. AGM took 1.8s. Estimated remaining: 15m 21s. Rate: 130.8 symbols/min [2025-09-25T22:15:45.458750] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:45.460300] [DEBUG] [LOCAL ] AGO: Derivative data saved (1807 records). [2025-09-25T22:15:45.461132] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-25T22:15:45.465228] [INFO ] [MAIN ] Derivative Progress: 37/2043 symbols completed. AGO took 1.2s. Estimated remaining: 14m 56s. Rate: 134.4 symbols/min [2025-09-25T22:15:45.465610] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:45.469265] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1807 records). [2025-09-25T22:15:45.469432] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-25T22:15:45.474993] [INFO ] [MAIN ] Derivative Progress: 38/2043 symbols completed. AGRO took 1.2s. Estimated remaining: 14m 32s. Rate: 137.9 symbols/min [2025-09-25T22:15:45.476714] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:45.539423] [DEBUG] [LOCAL ] AGX: Loaded 33628 existing records from primary storage. [2025-09-25T22:15:45.539584] [INFO ] [MAIN ] AGX: Loaded 33628 primary data records. [2025-09-25T22:15:45.688356] [DEBUG] [LOCAL ] AHR: Loaded 49615 existing records from primary storage. [2025-09-25T22:15:45.688558] [INFO ] [MAIN ] AHR: Loaded 49615 primary data records. [2025-09-25T22:15:45.690036] [DEBUG] [LOCAL ] AHH: Loaded 41636 existing records from primary storage. [2025-09-25T22:15:45.690112] [INFO ] [MAIN ] AHH: Loaded 41636 primary data records. [2025-09-25T22:15:46.685970] [DEBUG] [MAIN ] AGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:46.686736] [INFO ] [MAIN ] AGX: Generated 1807 derivative records from 33628 primary records. [2025-09-25T22:15:46.686805] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-25T22:15:46.692124] [DEBUG] [MAIN ] AHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:46.692590] [INFO ] [MAIN ] AHH: Generated 1807 derivative records from 41636 primary records. [2025-09-25T22:15:46.692671] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-25T22:15:46.708385] [DEBUG] [MAIN ] AHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:46.708926] [INFO ] [MAIN ] AHR: Generated 1807 derivative records from 49615 primary records. [2025-09-25T22:15:46.708984] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-25T22:15:46.735055] [DEBUG] [LOCAL ] AGX: Derivative data saved (1807 records). [2025-09-25T22:15:46.735188] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-25T22:15:46.742280] [DEBUG] [LOCAL ] AHH: Derivative data saved (1807 records). [2025-09-25T22:15:46.742357] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-25T22:15:46.737832] [INFO ] [MAIN ] Derivative Progress: 39/2043 symbols completed. AGX took 1.3s. Estimated remaining: 15m 14s. Rate: 131.5 symbols/min [2025-09-25T22:15:46.745213] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:46.749166] [DEBUG] [LOCAL ] AHR: Derivative data saved (1807 records). [2025-09-25T22:15:46.749261] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-25T22:15:46.752157] [INFO ] [MAIN ] Derivative Progress: 40/2043 symbols completed. AHR took 1.3s. Estimated remaining: 14m 52s. Rate: 134.8 symbols/min [2025-09-25T22:15:46.754870] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:46.758065] [INFO ] [MAIN ] Derivative Progress: 41/2043 symbols completed. AHH took 1.3s. Estimated remaining: 14m 30s. Rate: 138.1 symbols/min [2025-09-25T22:15:46.758239] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:46.770977] [DEBUG] [LOCAL ] AHT: Loaded 6122 existing records from primary storage. [2025-09-25T22:15:46.771134] [INFO ] [MAIN ] AHT: Loaded 6122 primary data records. [2025-09-25T22:15:46.911536] [DEBUG] [LOCAL ] AI: Loaded 54139 existing records from primary storage. [2025-09-25T22:15:46.911743] [INFO ] [MAIN ] AI: Loaded 54139 primary data records. [2025-09-25T22:15:46.967010] [DEBUG] [LOCAL ] AIG: Loaded 53865 existing records from primary storage. [2025-09-25T22:15:46.967192] [INFO ] [MAIN ] AIG: Loaded 53865 primary data records. [2025-09-25T22:15:47.920099] [DEBUG] [MAIN ] AI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:47.920938] [INFO ] [MAIN ] AI: Generated 1807 derivative records from 54139 primary records. [2025-09-25T22:15:47.921006] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-25T22:15:47.934749] [DEBUG] [MAIN ] AHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:47.935514] [INFO ] [MAIN ] AHT: Generated 1807 derivative records from 6122 primary records. [2025-09-25T22:15:47.935576] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-25T22:15:47.945404] [DEBUG] [LOCAL ] AI: Derivative data saved (1807 records). [2025-09-25T22:15:47.945569] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-25T22:15:47.948096] [INFO ] [MAIN ] Derivative Progress: 42/2043 symbols completed. AI took 1.2s. Estimated remaining: 15m 5s. Rate: 132.6 symbols/min [2025-09-25T22:15:47.948425] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:47.967589] [DEBUG] [LOCAL ] AHT: Derivative data saved (1807 records). [2025-09-25T22:15:47.968781] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-25T22:15:47.971031] [INFO ] [MAIN ] Derivative Progress: 43/2043 symbols completed. AHT took 1.2s. Estimated remaining: 14m 45s. Rate: 135.6 symbols/min [2025-09-25T22:15:47.996366] [DEBUG] [MAIN ] AIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:47.997230] [INFO ] [MAIN ] AIG: Generated 1807 derivative records from 53865 primary records. [2025-09-25T22:15:47.997298] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-25T22:15:48.024528] [DEBUG] [LOCAL ] AIG: Derivative data saved (1807 records). [2025-09-25T22:15:48.024739] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-25T22:15:48.027492] [INFO ] [MAIN ] Derivative Progress: 44/2043 symbols completed. AIG took 1.3s. Estimated remaining: 14m 27s. Rate: 138.3 symbols/min [2025-09-25T22:15:48.046126] [DEBUG] [LOCAL ] AIN: Loaded 24757 existing records from primary storage. [2025-09-25T22:15:48.046340] [INFO ] [MAIN ] AIN: Loaded 24757 primary data records. [2025-09-25T22:15:48.507574] [DEBUG] [MAIN ] AIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:48.508588] [INFO ] [MAIN ] AIN: Generated 1807 derivative records from 24757 primary records. [2025-09-25T22:15:48.508692] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-25T22:15:48.532594] [DEBUG] [LOCAL ] AIN: Derivative data saved (1807 records). [2025-09-25T22:15:48.532768] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-25T22:15:48.535723] [INFO ] [MAIN ] Derivative Progress: 45/2043 symbols completed. AIN took 0.6s. Estimated remaining: 14m 30s. Rate: 137.8 symbols/min [2025-09-25T22:15:48.536633] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:48.538160] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:48.540760] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:48.560818] [DEBUG] [LOCAL ] AIO: Loaded 13365 existing records from primary storage. [2025-09-25T22:15:48.561017] [INFO ] [MAIN ] AIO: Loaded 13365 primary data records. [2025-09-25T22:15:48.733958] [DEBUG] [LOCAL ] AIT: Loaded 28128 existing records from primary storage. [2025-09-25T22:15:48.734223] [INFO ] [MAIN ] AIT: Loaded 28128 primary data records. [2025-09-25T22:15:48.744007] [DEBUG] [LOCAL ] AIV: Loaded 40567 existing records from primary storage. [2025-09-25T22:15:48.744260] [INFO ] [MAIN ] AIV: Loaded 40567 primary data records. [2025-09-25T22:15:49.900321] [DEBUG] [MAIN ] AIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:49.901137] [INFO ] [MAIN ] AIT: Generated 1807 derivative records from 28128 primary records. [2025-09-25T22:15:49.901204] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-25T22:15:49.950523] [DEBUG] [LOCAL ] AIT: Derivative data saved (1807 records). [2025-09-25T22:15:49.950723] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-25T22:15:49.953746] [INFO ] [MAIN ] Derivative Progress: 46/2043 symbols completed. AIT took 1.4s. Estimated remaining: 15m 12s. Rate: 131.4 symbols/min [2025-09-25T22:15:49.956978] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:50.016386] [DEBUG] [MAIN ] AIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:50.017353] [INFO ] [MAIN ] AIV: Generated 1807 derivative records from 40567 primary records. [2025-09-25T22:15:50.017420] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-25T22:15:50.039887] [DEBUG] [MAIN ] AIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:50.040731] [INFO ] [MAIN ] AIO: Generated 1807 derivative records from 13365 primary records. [2025-09-25T22:15:50.040797] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-25T22:15:50.066780] [DEBUG] [LOCAL ] AIV: Derivative data saved (1807 records). [2025-09-25T22:15:50.075937] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-25T22:15:50.078262] [INFO ] [MAIN ] Derivative Progress: 47/2043 symbols completed. AIV took 1.5s. Estimated remaining: 14m 58s. Rate: 133.4 symbols/min [2025-09-25T22:15:50.078465] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:50.085274] [DEBUG] [LOCAL ] AIZ: Loaded 30320 existing records from primary storage. [2025-09-25T22:15:50.085424] [INFO ] [MAIN ] AIZ: Loaded 30320 primary data records. [2025-09-25T22:15:50.105398] [DEBUG] [LOCAL ] AIO: Derivative data saved (1807 records). [2025-09-25T22:15:50.105528] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-25T22:15:50.113269] [DEBUG] [LOCAL ] AIZN: Loaded 3914 existing records from primary storage. [2025-09-25T22:15:50.113465] [INFO ] [MAIN ] AIZN: Loaded 3914 primary data records. [2025-09-25T22:15:50.108038] [INFO ] [MAIN ] Derivative Progress: 48/2043 symbols completed. AIO took 1.6s. Estimated remaining: 14m 40s. Rate: 136.1 symbols/min [2025-09-25T22:15:50.119045] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:50.369968] [DEBUG] [LOCAL ] AJG: Loaded 47404 existing records from primary storage. [2025-09-25T22:15:50.370155] [INFO ] [MAIN ] AJG: Loaded 47404 primary data records. [2025-09-25T22:15:51.128874] [DEBUG] [MAIN ] AIZN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:51.129618] [INFO ] [MAIN ] AIZN: Generated 1807 derivative records from 3914 primary records. [2025-09-25T22:15:51.135739] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-25T22:15:51.175241] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1807 records). [2025-09-25T22:15:51.175366] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-25T22:15:51.178024] [INFO ] [MAIN ] Derivative Progress: 49/2043 symbols completed. AIZN took 1.1s. Estimated remaining: 15m 5s. Rate: 132.2 symbols/min [2025-09-25T22:15:51.182425] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:51.205213] [DEBUG] [MAIN ] AIZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:51.206330] [INFO ] [MAIN ] AIZ: Generated 1807 derivative records from 30320 primary records. [2025-09-25T22:15:51.206415] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-25T22:15:51.241098] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1807 records). [2025-09-25T22:15:51.241227] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-25T22:15:51.243793] [INFO ] [MAIN ] Derivative Progress: 50/2043 symbols completed. AIZ took 1.3s. Estimated remaining: 14m 49s. Rate: 134.5 symbols/min [2025-09-25T22:15:51.246587] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:51.412892] [DEBUG] [LOCAL ] AKR: Loaded 46130 existing records from primary storage. [2025-09-25T22:15:51.413063] [INFO ] [MAIN ] AKR: Loaded 46130 primary data records. [2025-09-25T22:15:51.503716] [DEBUG] [MAIN ] AJG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:51.504556] [INFO ] [MAIN ] AJG: Generated 1807 derivative records from 47404 primary records. [2025-09-25T22:15:51.504619] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-25T22:15:51.531761] [DEBUG] [LOCAL ] AL: Loaded 44455 existing records from primary storage. [2025-09-25T22:15:51.531997] [INFO ] [MAIN ] AL: Loaded 44455 primary data records. [2025-09-25T22:15:51.563395] [DEBUG] [LOCAL ] AJG: Derivative data saved (1807 records). [2025-09-25T22:15:51.563602] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-25T22:15:51.603401] [INFO ] [MAIN ] Derivative Progress: 51/2043 symbols completed. AJG took 1.5s. Estimated remaining: 14m 45s. Rate: 135.0 symbols/min [2025-09-25T22:15:51.603802] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:52.002585] [DEBUG] [LOCAL ] ALB: Loaded 53612 existing records from primary storage. [2025-09-25T22:15:52.008903] [INFO ] [MAIN ] ALB: Loaded 53612 primary data records. [2025-09-25T22:15:52.140257] [DEBUG] [MAIN ] AKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:52.141041] [INFO ] [MAIN ] AKR: Generated 1807 derivative records from 46130 primary records. [2025-09-25T22:15:52.141107] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-25T22:15:52.184601] [DEBUG] [LOCAL ] AKR: Derivative data saved (1807 records). [2025-09-25T22:15:52.184741] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-25T22:15:52.186935] [INFO ] [MAIN ] Derivative Progress: 52/2043 symbols completed. AKR took 1.0s. Estimated remaining: 14m 50s. Rate: 134.2 symbols/min [2025-09-25T22:15:52.193466] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:52.327770] [DEBUG] [LOCAL ] ALE: Loaded 30493 existing records from primary storage. [2025-09-25T22:15:52.327924] [INFO ] [MAIN ] ALE: Loaded 30493 primary data records. [2025-09-25T22:15:53.005869] [DEBUG] [MAIN ] AL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:53.006595] [INFO ] [MAIN ] AL: Generated 1807 derivative records from 44455 primary records. [2025-09-25T22:15:53.021738] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-25T22:15:53.061013] [DEBUG] [LOCAL ] AL: Derivative data saved (1807 records). [2025-09-25T22:15:53.061157] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-25T22:15:53.063615] [INFO ] [MAIN ] Derivative Progress: 53/2043 symbols completed. AL took 1.8s. Estimated remaining: 15m 6s. Rate: 131.8 symbols/min [2025-09-25T22:15:53.067096] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:53.099073] [DEBUG] [MAIN ] ALB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:53.099836] [INFO ] [MAIN ] ALB: Generated 1807 derivative records from 53612 primary records. [2025-09-25T22:15:53.099900] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-25T22:15:53.147614] [DEBUG] [LOCAL ] ALB: Derivative data saved (1807 records). [2025-09-25T22:15:53.167818] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-25T22:15:53.170336] [INFO ] [MAIN ] Derivative Progress: 54/2043 symbols completed. ALB took 1.6s. Estimated remaining: 14m 52s. Rate: 133.7 symbols/min [2025-09-25T22:15:53.170560] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:53.201778] [DEBUG] [LOCAL ] ALEX: Loaded 31536 existing records from primary storage. [2025-09-25T22:15:53.201942] [INFO ] [MAIN ] ALEX: Loaded 31536 primary data records. [2025-09-25T22:15:53.288885] [DEBUG] [MAIN ] ALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:53.289663] [INFO ] [MAIN ] ALE: Generated 1807 derivative records from 30493 primary records. [2025-09-25T22:15:53.289734] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-25T22:15:53.311509] [DEBUG] [LOCAL ] ALIT: Loaded 53147 existing records from primary storage. [2025-09-25T22:15:53.324952] [INFO ] [MAIN ] ALIT: Loaded 53147 primary data records. [2025-09-25T22:15:53.354472] [DEBUG] [LOCAL ] ALE: Derivative data saved (1807 records). [2025-09-25T22:15:53.354585] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-25T22:15:53.357089] [INFO ] [MAIN ] Derivative Progress: 55/2043 symbols completed. ALE took 1.2s. Estimated remaining: 14m 42s. Rate: 135.2 symbols/min [2025-09-25T22:15:53.361244] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:53.582319] [DEBUG] [LOCAL ] ALK: Loaded 53452 existing records from primary storage. [2025-09-25T22:15:53.582505] [INFO ] [MAIN ] ALK: Loaded 53452 primary data records. [2025-09-25T22:15:54.395423] [DEBUG] [MAIN ] ALIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:54.396153] [INFO ] [MAIN ] ALIT: Generated 1807 derivative records from 53147 primary records. [2025-09-25T22:15:54.396220] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-25T22:15:54.404992] [DEBUG] [MAIN ] ALK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:54.405474] [INFO ] [MAIN ] ALK: Generated 1807 derivative records from 53452 primary records. [2025-09-25T22:15:54.405533] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-25T22:15:54.425333] [DEBUG] [MAIN ] ALEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:54.425999] [INFO ] [MAIN ] ALEX: Generated 1807 derivative records from 31536 primary records. [2025-09-25T22:15:54.426062] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-25T22:15:54.447331] [DEBUG] [LOCAL ] ALK: Derivative data saved (1807 records). [2025-09-25T22:15:54.447418] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-25T22:15:54.450623] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1807 records). [2025-09-25T22:15:54.450723] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-25T22:15:54.450535] [INFO ] [MAIN ] Derivative Progress: 56/2043 symbols completed. ALK took 1.1s. Estimated remaining: 15m 5s. Rate: 131.7 symbols/min [2025-09-25T22:15:54.453254] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:54.454620] [INFO ] [MAIN ] Derivative Progress: 57/2043 symbols completed. ALIT took 1.3s. Estimated remaining: 14m 49s. Rate: 134.1 symbols/min [2025-09-25T22:15:54.456193] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:54.470954] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1807 records). [2025-09-25T22:15:54.471143] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-25T22:15:54.475341] [INFO ] [MAIN ] Derivative Progress: 58/2043 symbols completed. ALEX took 1.4s. Estimated remaining: 14m 34s. Rate: 136.3 symbols/min [2025-09-25T22:15:54.563624] [DEBUG] [LOCAL ] ALLE: Loaded 45377 existing records from primary storage. [2025-09-25T22:15:54.563830] [INFO ] [MAIN ] ALLE: Loaded 45377 primary data records. [2025-09-25T22:15:54.571074] [DEBUG] [LOCAL ] ALL: Loaded 50565 existing records from primary storage. [2025-09-25T22:15:54.571203] [INFO ] [MAIN ] ALL: Loaded 50565 primary data records. [2025-09-25T22:15:55.131221] [DEBUG] [MAIN ] ALLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:55.132080] [INFO ] [MAIN ] ALLE: Generated 1807 derivative records from 45377 primary records. [2025-09-25T22:15:55.132162] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-25T22:15:55.244342] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1807 records). [2025-09-25T22:15:55.244509] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-25T22:15:55.246444] [INFO ] [MAIN ] Derivative Progress: 59/2043 symbols completed. ALLE took 0.8s. Estimated remaining: 14m 44s. Rate: 134.6 symbols/min [2025-09-25T22:15:55.308040] [DEBUG] [MAIN ] ALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:55.308790] [INFO ] [MAIN ] ALL: Generated 1807 derivative records from 50565 primary records. [2025-09-25T22:15:55.308857] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-25T22:15:55.325044] [DEBUG] [LOCAL ] ALL: Derivative data saved (1807 records). [2025-09-25T22:15:55.325143] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-25T22:15:55.329087] [INFO ] [MAIN ] Derivative Progress: 60/2043 symbols completed. ALL took 0.9s. Estimated remaining: 14m 32s. Rate: 136.4 symbols/min [2025-09-25T22:15:55.329550] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:55.331725] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:55.335187] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:55.423786] [DEBUG] [LOCAL ] ALTG: Loaded 24032 existing records from primary storage. [2025-09-25T22:15:55.424017] [INFO ] [MAIN ] ALTG: Loaded 24032 primary data records. [2025-09-25T22:15:55.432635] [DEBUG] [LOCAL ] ALLY: Loaded 53608 existing records from primary storage. [2025-09-25T22:15:55.439942] [INFO ] [MAIN ] ALLY: Loaded 53608 primary data records. [2025-09-25T22:15:55.475321] [DEBUG] [LOCAL ] ALSN: Loaded 43608 existing records from primary storage. [2025-09-25T22:15:55.475519] [INFO ] [MAIN ] ALSN: Loaded 43608 primary data records. [2025-09-25T22:15:56.480670] [DEBUG] [MAIN ] ALSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:56.481672] [INFO ] [MAIN ] ALSN: Generated 1807 derivative records from 43608 primary records. [2025-09-25T22:15:56.481756] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-25T22:15:56.501964] [DEBUG] [MAIN ] ALLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:56.502934] [INFO ] [MAIN ] ALLY: Generated 1807 derivative records from 53608 primary records. [2025-09-25T22:15:56.503051] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-25T22:15:56.533475] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1807 records). [2025-09-25T22:15:56.533736] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-25T22:15:56.536497] [INFO ] [MAIN ] Derivative Progress: 61/2043 symbols completed. ALSN took 1.2s. Estimated remaining: 14m 57s. Rate: 132.6 symbols/min [2025-09-25T22:15:56.537034] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:56.546551] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1807 records). [2025-09-25T22:15:56.546738] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-25T22:15:56.550468] [INFO ] [MAIN ] Derivative Progress: 62/2043 symbols completed. ALLY took 1.2s. Estimated remaining: 14m 42s. Rate: 134.7 symbols/min [2025-09-25T22:15:56.550734] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:56.559931] [DEBUG] [MAIN ] ALTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:56.560798] [INFO ] [MAIN ] ALTG: Generated 1807 derivative records from 24032 primary records. [2025-09-25T22:15:56.562709] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-25T22:15:56.582609] [DEBUG] [LOCAL ] ALUR: Loaded 10913 existing records from primary storage. [2025-09-25T22:15:56.582812] [INFO ] [MAIN ] ALUR: Loaded 10913 primary data records. [2025-09-25T22:15:56.614284] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1807 records). [2025-09-25T22:15:56.614382] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-25T22:15:56.616837] [INFO ] [MAIN ] Derivative Progress: 63/2043 symbols completed. ALTG took 1.3s. Estimated remaining: 14m 30s. Rate: 136.6 symbols/min [2025-09-25T22:15:56.617104] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:56.649804] [DEBUG] [LOCAL ] ALX: Loaded 6059 existing records from primary storage. [2025-09-25T22:15:56.649934] [INFO ] [MAIN ] ALX: Loaded 6059 primary data records. [2025-09-25T22:15:56.905780] [DEBUG] [LOCAL ] ALV: Loaded 42904 existing records from primary storage. [2025-09-25T22:15:56.913309] [INFO ] [MAIN ] ALV: Loaded 42904 primary data records. [2025-09-25T22:15:57.494660] [DEBUG] [MAIN ] ALUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:57.495452] [INFO ] [MAIN ] ALUR: Generated 1807 derivative records from 10913 primary records. [2025-09-25T22:15:57.495522] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-25T22:15:57.642461] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1807 records). [2025-09-25T22:15:57.642662] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-25T22:15:57.645097] [INFO ] [MAIN ] Derivative Progress: 64/2043 symbols completed. ALUR took 1.1s. Estimated remaining: 14m 48s. Rate: 133.8 symbols/min [2025-09-25T22:15:57.656705] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:57.707095] [DEBUG] [MAIN ] ALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:57.710812] [INFO ] [MAIN ] ALX: Generated 1807 derivative records from 6059 primary records. [2025-09-25T22:15:57.710887] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-25T22:15:57.733386] [DEBUG] [LOCAL ] ALX: Derivative data saved (1807 records). [2025-09-25T22:15:57.733498] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-25T22:15:57.735993] [INFO ] [MAIN ] Derivative Progress: 65/2043 symbols completed. ALX took 1.1s. Estimated remaining: 14m 36s. Rate: 135.5 symbols/min [2025-09-25T22:15:57.738034] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:57.819772] [DEBUG] [LOCAL ] AMBC: Loaded 37246 existing records from primary storage. [2025-09-25T22:15:57.819954] [INFO ] [MAIN ] AMBC: Loaded 37246 primary data records. [2025-09-25T22:15:57.899086] [DEBUG] [LOCAL ] AM: Loaded 52519 existing records from primary storage. [2025-09-25T22:15:57.960957] [INFO ] [MAIN ] AM: Loaded 52519 primary data records. [2025-09-25T22:15:58.188391] [DEBUG] [MAIN ] ALV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:58.200438] [INFO ] [MAIN ] ALV: Generated 1807 derivative records from 42904 primary records. [2025-09-25T22:15:58.200573] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-25T22:15:58.261378] [DEBUG] [LOCAL ] ALV: Derivative data saved (1807 records). [2025-09-25T22:15:58.261662] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-25T22:15:58.281799] [INFO ] [MAIN ] Derivative Progress: 66/2043 symbols completed. ALV took 1.7s. Estimated remaining: 14m 39s. Rate: 135.0 symbols/min [2025-09-25T22:15:58.282116] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:58.504324] [DEBUG] [LOCAL ] AMBP: Loaded 45578 existing records from primary storage. [2025-09-25T22:15:58.504489] [INFO ] [MAIN ] AMBP: Loaded 45578 primary data records. [2025-09-25T22:15:58.778459] [DEBUG] [MAIN ] AMBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:58.787507] [INFO ] [MAIN ] AMBC: Generated 1807 derivative records from 37246 primary records. [2025-09-25T22:15:58.787615] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-25T22:15:58.850479] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1807 records). [2025-09-25T22:15:58.850632] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-25T22:15:58.857604] [INFO ] [MAIN ] Derivative Progress: 67/2043 symbols completed. AMBC took 1.1s. Estimated remaining: 14m 42s. Rate: 134.4 symbols/min [2025-09-25T22:15:58.861170] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:59.098957] [DEBUG] [MAIN ] AM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:59.099797] [INFO ] [MAIN ] AM: Generated 1807 derivative records from 52519 primary records. [2025-09-25T22:15:59.099865] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-25T22:15:59.157014] [DEBUG] [LOCAL ] AMCR: Loaded 54059 existing records from primary storage. [2025-09-25T22:15:59.157184] [INFO ] [MAIN ] AMCR: Loaded 54059 primary data records. [2025-09-25T22:15:59.167199] [DEBUG] [LOCAL ] AM: Derivative data saved (1807 records). [2025-09-25T22:15:59.167326] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-25T22:15:59.169908] [INFO ] [MAIN ] Derivative Progress: 68/2043 symbols completed. AM took 1.5s. Estimated remaining: 14m 38s. Rate: 135.0 symbols/min [2025-09-25T22:15:59.175932] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:59.206875] [DEBUG] [MAIN ] AMBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:15:59.207687] [INFO ] [MAIN ] AMBP: Generated 1807 derivative records from 45578 primary records. [2025-09-25T22:15:59.207759] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-25T22:15:59.259851] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1807 records). [2025-09-25T22:15:59.259997] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-25T22:15:59.262981] [INFO ] [MAIN ] Derivative Progress: 69/2043 symbols completed. AMBP took 1.0s. Estimated remaining: 14m 27s. Rate: 136.5 symbols/min [2025-09-25T22:15:59.284044] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:15:59.331346] [DEBUG] [LOCAL ] AMG: Loaded 20906 existing records from primary storage. [2025-09-25T22:15:59.331531] [INFO ] [MAIN ] AMG: Loaded 20906 primary data records. [2025-09-25T22:15:59.463146] [DEBUG] [LOCAL ] AME: Loaded 48905 existing records from primary storage. [2025-09-25T22:15:59.468892] [INFO ] [MAIN ] AME: Loaded 48905 primary data records. [2025-09-25T22:16:00.227863] [DEBUG] [MAIN ] AMCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:00.229316] [INFO ] [MAIN ] AMCR: Generated 1807 derivative records from 54059 primary records. [2025-09-25T22:16:00.229432] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-25T22:16:00.283092] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1807 records). [2025-09-25T22:16:00.283273] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-25T22:16:00.287460] [INFO ] [MAIN ] Derivative Progress: 70/2043 symbols completed. AMCR took 1.4s. Estimated remaining: 14m 43s. Rate: 134.0 symbols/min [2025-09-25T22:16:00.294159] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:00.541140] [DEBUG] [MAIN ] AMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:00.541974] [INFO ] [MAIN ] AMG: Generated 1807 derivative records from 20906 primary records. [2025-09-25T22:16:00.542052] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-25T22:16:00.589851] [DEBUG] [LOCAL ] AMH: Loaded 52080 existing records from primary storage. [2025-09-25T22:16:00.590253] [INFO ] [MAIN ] AMH: Loaded 52080 primary data records. [2025-09-25T22:16:00.611569] [DEBUG] [LOCAL ] AMG: Derivative data saved (1807 records). [2025-09-25T22:16:00.611770] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-25T22:16:00.615313] [INFO ] [MAIN ] Derivative Progress: 71/2043 symbols completed. AMG took 1.3s. Estimated remaining: 14m 40s. Rate: 134.5 symbols/min [2025-09-25T22:16:00.632087] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:00.650841] [DEBUG] [MAIN ] AME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:00.651709] [INFO ] [MAIN ] AME: Generated 1807 derivative records from 48905 primary records. [2025-09-25T22:16:00.651797] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-25T22:16:00.736475] [DEBUG] [LOCAL ] AME: Derivative data saved (1807 records). [2025-09-25T22:16:00.736750] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-25T22:16:00.739459] [INFO ] [MAIN ] Derivative Progress: 72/2043 symbols completed. AME took 1.6s. Estimated remaining: 14m 30s. Rate: 135.9 symbols/min [2025-09-25T22:16:00.765429] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:00.879284] [DEBUG] [LOCAL ] AMN: Loaded 42296 existing records from primary storage. [2025-09-25T22:16:00.879505] [INFO ] [MAIN ] AMN: Loaded 42296 primary data records. [2025-09-25T22:16:01.168036] [DEBUG] [LOCAL ] AMP: Loaded 32671 existing records from primary storage. [2025-09-25T22:16:01.168260] [INFO ] [MAIN ] AMP: Loaded 32671 primary data records. [2025-09-25T22:16:01.365894] [DEBUG] [MAIN ] AMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:01.367295] [INFO ] [MAIN ] AMH: Generated 1807 derivative records from 52080 primary records. [2025-09-25T22:16:01.367412] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-25T22:16:01.410300] [DEBUG] [LOCAL ] AMH: Derivative data saved (1807 records). [2025-09-25T22:16:01.410557] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-25T22:16:01.413611] [INFO ] [MAIN ] Derivative Progress: 73/2043 symbols completed. AMH took 1.1s. Estimated remaining: 14m 36s. Rate: 134.9 symbols/min [2025-09-25T22:16:01.915793] [DEBUG] [MAIN ] AMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:01.916704] [INFO ] [MAIN ] AMN: Generated 1807 derivative records from 42296 primary records. [2025-09-25T22:16:01.916823] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-25T22:16:01.943387] [DEBUG] [LOCAL ] AMN: Derivative data saved (1807 records). [2025-09-25T22:16:01.943503] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-25T22:16:01.946852] [INFO ] [MAIN ] Derivative Progress: 74/2043 symbols completed. AMN took 1.3s. Estimated remaining: 14m 38s. Rate: 134.5 symbols/min [2025-09-25T22:16:01.952079] [DEBUG] [MAIN ] AMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:01.952887] [INFO ] [MAIN ] AMP: Generated 1807 derivative records from 32671 primary records. [2025-09-25T22:16:01.952953] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-25T22:16:01.970752] [DEBUG] [LOCAL ] AMP: Derivative data saved (1807 records). [2025-09-25T22:16:01.970830] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-25T22:16:01.973223] [INFO ] [MAIN ] Derivative Progress: 75/2043 symbols completed. AMP took 1.2s. Estimated remaining: 14m 27s. Rate: 136.2 symbols/min [2025-09-25T22:16:01.974252] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:01.975991] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:01.976501] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:02.093305] [DEBUG] [LOCAL ] AMRC: Loaded 38678 existing records from primary storage. [2025-09-25T22:16:02.093466] [INFO ] [MAIN ] AMRC: Loaded 38678 primary data records. [2025-09-25T22:16:02.091630] [DEBUG] [LOCAL ] AMPY: Loaded 37778 existing records from primary storage. [2025-09-25T22:16:02.098980] [INFO ] [MAIN ] AMPY: Loaded 37778 primary data records. [2025-09-25T22:16:02.104917] [DEBUG] [LOCAL ] AMR: Loaded 29293 existing records from primary storage. [2025-09-25T22:16:02.105012] [INFO ] [MAIN ] AMR: Loaded 29293 primary data records. [2025-09-25T22:16:03.274894] [DEBUG] [MAIN ] AMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:03.276005] [INFO ] [MAIN ] AMR: Generated 1807 derivative records from 29293 primary records. [2025-09-25T22:16:03.276089] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-25T22:16:03.284784] [DEBUG] [MAIN ] AMPY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:03.285635] [INFO ] [MAIN ] AMPY: Generated 1807 derivative records from 37778 primary records. [2025-09-25T22:16:03.285725] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-25T22:16:03.325334] [DEBUG] [LOCAL ] AMR: Derivative data saved (1807 records). [2025-09-25T22:16:03.325466] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-25T22:16:03.328713] [INFO ] [MAIN ] Derivative Progress: 76/2043 symbols completed. AMR took 1.4s. Estimated remaining: 14m 50s. Rate: 132.6 symbols/min [2025-09-25T22:16:03.332747] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:03.339086] [DEBUG] [MAIN ] AMRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:03.339973] [INFO ] [MAIN ] AMRC: Generated 1807 derivative records from 38678 primary records. [2025-09-25T22:16:03.340038] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-25T22:16:03.342612] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1807 records). [2025-09-25T22:16:03.342710] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-25T22:16:03.345979] [INFO ] [MAIN ] Derivative Progress: 77/2043 symbols completed. AMPY took 1.4s. Estimated remaining: 14m 38s. Rate: 134.3 symbols/min [2025-09-25T22:16:03.359705] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:03.378772] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1807 records). [2025-09-25T22:16:03.378964] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-25T22:16:03.382125] [INFO ] [MAIN ] Derivative Progress: 78/2043 symbols completed. AMRC took 1.4s. Estimated remaining: 14m 28s. Rate: 135.9 symbols/min [2025-09-25T22:16:03.391282] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:03.427920] [DEBUG] [LOCAL ] AMTD: Loaded 3578 existing records from primary storage. [2025-09-25T22:16:03.428130] [INFO ] [MAIN ] AMTD: Loaded 3578 primary data records. [2025-09-25T22:16:03.434222] [DEBUG] [LOCAL ] AMTB: Loaded 20492 existing records from primary storage. [2025-09-25T22:16:03.434304] [INFO ] [MAIN ] AMTB: Loaded 20492 primary data records. [2025-09-25T22:16:03.484246] [DEBUG] [LOCAL ] AMT: Loaded 52833 existing records from primary storage. [2025-09-25T22:16:03.484438] [INFO ] [MAIN ] AMT: Loaded 52833 primary data records. [2025-09-25T22:16:04.419819] [DEBUG] [MAIN ] AMTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:04.420690] [INFO ] [MAIN ] AMTB: Generated 1807 derivative records from 20492 primary records. [2025-09-25T22:16:04.420760] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-25T22:16:04.440862] [DEBUG] [MAIN ] AMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:04.441692] [INFO ] [MAIN ] AMT: Generated 1807 derivative records from 52833 primary records. [2025-09-25T22:16:04.441776] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-25T22:16:04.470592] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1807 records). [2025-09-25T22:16:04.476114] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-25T22:16:04.481139] [DEBUG] [LOCAL ] AMT: Derivative data saved (1807 records). [2025-09-25T22:16:04.481217] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-25T22:16:04.478605] [INFO ] [MAIN ] Derivative Progress: 79/2043 symbols completed. AMTB took 1.1s. Estimated remaining: 14m 43s. Rate: 133.4 symbols/min [2025-09-25T22:16:04.487076] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:04.489686] [INFO ] [MAIN ] Derivative Progress: 80/2043 symbols completed. AMT took 1.2s. Estimated remaining: 14m 32s. Rate: 135.0 symbols/min [2025-09-25T22:16:04.489858] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:04.514377] [DEBUG] [LOCAL ] AMWL: Loaded 8731 existing records from primary storage. [2025-09-25T22:16:04.514538] [INFO ] [MAIN ] AMWL: Loaded 8731 primary data records. [2025-09-25T22:16:04.697756] [DEBUG] [LOCAL ] AMTM: Loaded 51110 existing records from primary storage. [2025-09-25T22:16:04.697953] [INFO ] [MAIN ] AMTM: Loaded 51110 primary data records. [2025-09-25T22:16:05.002125] [DEBUG] [MAIN ] AMTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:05.002956] [INFO ] [MAIN ] AMTD: Generated 1807 derivative records from 3578 primary records. [2025-09-25T22:16:05.003043] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-25T22:16:05.052971] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1807 records). [2025-09-25T22:16:05.053123] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-25T22:16:05.056422] [INFO ] [MAIN ] Derivative Progress: 81/2043 symbols completed. AMTD took 1.7s. Estimated remaining: 14m 35s. Rate: 134.6 symbols/min [2025-09-25T22:16:05.083772] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:05.216612] [DEBUG] [LOCAL ] AMX: Loaded 49543 existing records from primary storage. [2025-09-25T22:16:05.216871] [INFO ] [MAIN ] AMX: Loaded 49543 primary data records. [2025-09-25T22:16:05.658774] [DEBUG] [MAIN ] AMWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:05.659606] [INFO ] [MAIN ] AMWL: Generated 1807 derivative records from 8731 primary records. [2025-09-25T22:16:05.659702] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-25T22:16:05.699457] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1807 records). [2025-09-25T22:16:05.699599] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-25T22:16:05.702081] [INFO ] [MAIN ] Derivative Progress: 82/2043 symbols completed. AMWL took 1.2s. Estimated remaining: 14m 39s. Rate: 133.8 symbols/min [2025-09-25T22:16:05.712957] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:05.749132] [DEBUG] [MAIN ] AMTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:05.749991] [INFO ] [MAIN ] AMTM: Generated 1807 derivative records from 51110 primary records. [2025-09-25T22:16:05.750058] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-25T22:16:05.796424] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1807 records). [2025-09-25T22:16:05.796616] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-25T22:16:05.799459] [INFO ] [MAIN ] Derivative Progress: 83/2043 symbols completed. AMTM took 1.3s. Estimated remaining: 14m 30s. Rate: 135.1 symbols/min [2025-09-25T22:16:05.811446] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:05.820601] [DEBUG] [LOCAL ] AN: Loaded 32630 existing records from primary storage. [2025-09-25T22:16:05.825807] [INFO ] [MAIN ] AN: Loaded 32630 primary data records. [2025-09-25T22:16:05.958331] [DEBUG] [LOCAL ] ANET: Loaded 54156 existing records from primary storage. [2025-09-25T22:16:05.958522] [INFO ] [MAIN ] ANET: Loaded 54156 primary data records. [2025-09-25T22:16:06.413068] [DEBUG] [MAIN ] AMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:06.413826] [INFO ] [MAIN ] AMX: Generated 1807 derivative records from 49543 primary records. [2025-09-25T22:16:06.413891] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-25T22:16:06.455680] [DEBUG] [LOCAL ] AMX: Derivative data saved (1807 records). [2025-09-25T22:16:06.455781] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-25T22:16:06.458570] [INFO ] [MAIN ] Derivative Progress: 84/2043 symbols completed. AMX took 1.4s. Estimated remaining: 14m 35s. Rate: 134.3 symbols/min [2025-09-25T22:16:06.465219] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:06.798414] [DEBUG] [LOCAL ] ANF: Loaded 52603 existing records from primary storage. [2025-09-25T22:16:06.798705] [INFO ] [MAIN ] ANF: Loaded 52603 primary data records. [2025-09-25T22:16:06.812979] [DEBUG] [MAIN ] AN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:06.813698] [INFO ] [MAIN ] AN: Generated 1807 derivative records from 32630 primary records. [2025-09-25T22:16:06.816865] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-25T22:16:06.859118] [DEBUG] [LOCAL ] AN: Derivative data saved (1807 records). [2025-09-25T22:16:06.859272] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-25T22:16:06.862261] [INFO ] [MAIN ] Derivative Progress: 85/2043 symbols completed. AN took 1.1s. Estimated remaining: 14m 33s. Rate: 134.5 symbols/min [2025-09-25T22:16:06.885054] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:06.896747] [DEBUG] [MAIN ] ANET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:06.897521] [INFO ] [MAIN ] ANET: Generated 1807 derivative records from 54156 primary records. [2025-09-25T22:16:06.897704] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-25T22:16:06.959678] [DEBUG] [LOCAL ] ANVS: Loaded 23312 existing records from primary storage. [2025-09-25T22:16:06.959843] [INFO ] [MAIN ] ANVS: Loaded 23312 primary data records. [2025-09-25T22:16:06.971171] [DEBUG] [LOCAL ] ANET: Derivative data saved (1807 records). [2025-09-25T22:16:06.971239] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-25T22:16:06.974111] [INFO ] [MAIN ] Derivative Progress: 86/2043 symbols completed. ANET took 1.2s. Estimated remaining: 14m 25s. Rate: 135.7 symbols/min [2025-09-25T22:16:06.980450] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:07.115397] [DEBUG] [LOCAL ] AOD: Loaded 30246 existing records from primary storage. [2025-09-25T22:16:07.115617] [INFO ] [MAIN ] AOD: Loaded 30246 primary data records. [2025-09-25T22:16:07.774486] [DEBUG] [MAIN ] ANF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:07.775239] [INFO ] [MAIN ] ANF: Generated 1807 derivative records from 52603 primary records. [2025-09-25T22:16:07.775309] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-25T22:16:07.814557] [DEBUG] [LOCAL ] ANF: Derivative data saved (1807 records). [2025-09-25T22:16:07.820209] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-25T22:16:07.823716] [INFO ] [MAIN ] Derivative Progress: 87/2043 symbols completed. ANF took 1.4s. Estimated remaining: 14m 34s. Rate: 134.3 symbols/min [2025-09-25T22:16:07.834082] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:07.877810] [DEBUG] [LOCAL ] AOMR: Loaded 16780 existing records from primary storage. [2025-09-25T22:16:07.877990] [INFO ] [MAIN ] AOMR: Loaded 16780 primary data records. [2025-09-25T22:16:07.921925] [DEBUG] [MAIN ] ANVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:07.922766] [INFO ] [MAIN ] ANVS: Generated 1807 derivative records from 23312 primary records. [2025-09-25T22:16:07.922836] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-25T22:16:08.053257] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1807 records). [2025-09-25T22:16:08.053468] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-25T22:16:08.056627] [INFO ] [MAIN ] Derivative Progress: 88/2043 symbols completed. ANVS took 1.2s. Estimated remaining: 14m 29s. Rate: 135.0 symbols/min [2025-09-25T22:16:08.427548] [DEBUG] [MAIN ] AOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:08.428440] [INFO ] [MAIN ] AOD: Generated 1807 derivative records from 30246 primary records. [2025-09-25T22:16:08.428510] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-25T22:16:08.442161] [DEBUG] [MAIN ] AOMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:08.442875] [INFO ] [MAIN ] AOMR: Generated 1807 derivative records from 16780 primary records. [2025-09-25T22:16:08.442940] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-25T22:16:08.461144] [DEBUG] [LOCAL ] AOD: Derivative data saved (1807 records). [2025-09-25T22:16:08.461263] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-25T22:16:08.464350] [INFO ] [MAIN ] Derivative Progress: 89/2043 symbols completed. AOD took 1.5s. Estimated remaining: 14m 28s. Rate: 135.1 symbols/min [2025-09-25T22:16:08.472386] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1807 records). [2025-09-25T22:16:08.472486] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-25T22:16:08.475528] [INFO ] [MAIN ] Derivative Progress: 90/2043 symbols completed. AOMR took 0.6s. Estimated remaining: 14m 18s. Rate: 136.6 symbols/min [2025-09-25T22:16:08.478868] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:08.481819] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:08.485057] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:08.501938] [DEBUG] [LOCAL ] AP: Loaded 7174 existing records from primary storage. [2025-09-25T22:16:08.502130] [INFO ] [MAIN ] AP: Loaded 7174 primary data records. [2025-09-25T22:16:08.671265] [DEBUG] [LOCAL ] AORT: Loaded 29879 existing records from primary storage. [2025-09-25T22:16:08.685279] [INFO ] [MAIN ] AORT: Loaded 29879 primary data records. [2025-09-25T22:16:08.758049] [DEBUG] [LOCAL ] AON: Loaded 45981 existing records from primary storage. [2025-09-25T22:16:08.758308] [INFO ] [MAIN ] AON: Loaded 45981 primary data records. [2025-09-25T22:16:09.625329] [DEBUG] [MAIN ] AP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:09.626123] [INFO ] [MAIN ] AP: Generated 1807 derivative records from 7174 primary records. [2025-09-25T22:16:09.626189] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-25T22:16:09.664751] [DEBUG] [MAIN ] AON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:09.665447] [INFO ] [MAIN ] AON: Generated 1807 derivative records from 45981 primary records. [2025-09-25T22:16:09.665510] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-25T22:16:09.674843] [DEBUG] [LOCAL ] AP: Derivative data saved (1807 records). [2025-09-25T22:16:09.674914] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-25T22:16:09.677779] [INFO ] [MAIN ] Derivative Progress: 91/2043 symbols completed. AP took 1.2s. Estimated remaining: 14m 34s. Rate: 134.0 symbols/min [2025-09-25T22:16:09.685066] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:09.699592] [DEBUG] [LOCAL ] AON: Derivative data saved (1807 records). [2025-09-25T22:16:09.703446] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-25T22:16:09.708006] [INFO ] [MAIN ] Derivative Progress: 92/2043 symbols completed. AON took 1.2s. Estimated remaining: 14m 24s. Rate: 135.4 symbols/min [2025-09-25T22:16:09.711321] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:09.801900] [DEBUG] [LOCAL ] APAM: Loaded 36716 existing records from primary storage. [2025-09-25T22:16:09.808965] [INFO ] [MAIN ] APAM: Loaded 36716 primary data records. [2025-09-25T22:16:09.854615] [DEBUG] [LOCAL ] APLE: Loaded 52397 existing records from primary storage. [2025-09-25T22:16:09.859748] [INFO ] [MAIN ] APLE: Loaded 52397 primary data records. [2025-09-25T22:16:09.964372] [DEBUG] [MAIN ] AORT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:09.965166] [INFO ] [MAIN ] AORT: Generated 1807 derivative records from 29879 primary records. [2025-09-25T22:16:09.965232] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-25T22:16:10.015373] [DEBUG] [LOCAL ] AORT: Derivative data saved (1807 records). [2025-09-25T22:16:10.015539] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-25T22:16:10.018639] [INFO ] [MAIN ] Derivative Progress: 93/2043 symbols completed. AORT took 1.5s. Estimated remaining: 14m 21s. Rate: 135.8 symbols/min [2025-09-25T22:16:10.027509] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:10.070843] [DEBUG] [LOCAL ] APOS: Loaded 7545 existing records from primary storage. [2025-09-25T22:16:10.071092] [INFO ] [MAIN ] APOS: Loaded 7545 primary data records. [2025-09-25T22:16:10.759209] [DEBUG] [MAIN ] APLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:10.760070] [INFO ] [MAIN ] APLE: Generated 1807 derivative records from 52397 primary records. [2025-09-25T22:16:10.760162] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-25T22:16:10.777334] [DEBUG] [MAIN ] APAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:10.778360] [INFO ] [MAIN ] APAM: Generated 1807 derivative records from 36716 primary records. [2025-09-25T22:16:10.778434] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-25T22:16:10.800182] [DEBUG] [LOCAL ] APLE: Derivative data saved (1807 records). [2025-09-25T22:16:10.800297] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-25T22:16:10.802853] [INFO ] [MAIN ] Derivative Progress: 94/2043 symbols completed. APLE took 1.1s. Estimated remaining: 14m 28s. Rate: 134.7 symbols/min [2025-09-25T22:16:10.821226] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:10.852954] [DEBUG] [LOCAL ] APAM: Derivative data saved (1807 records). [2025-09-25T22:16:10.853087] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-25T22:16:10.855765] [INFO ] [MAIN ] Derivative Progress: 95/2043 symbols completed. APAM took 1.2s. Estimated remaining: 14m 19s. Rate: 136.0 symbols/min [2025-09-25T22:16:10.867422] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:10.965240] [DEBUG] [LOCAL ] AQN: Loaded 52302 existing records from primary storage. [2025-09-25T22:16:10.970145] [INFO ] [MAIN ] AQN: Loaded 52302 primary data records. [2025-09-25T22:16:11.017002] [DEBUG] [LOCAL ] AR: Loaded 53974 existing records from primary storage. [2025-09-25T22:16:11.017162] [INFO ] [MAIN ] AR: Loaded 53974 primary data records. [2025-09-25T22:16:11.720265] [DEBUG] [MAIN ] APOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:11.721082] [INFO ] [MAIN ] APOS: Generated 1807 derivative records from 7545 primary records. [2025-09-25T22:16:11.721163] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-25T22:16:11.771902] [DEBUG] [LOCAL ] APOS: Derivative data saved (1807 records). [2025-09-25T22:16:11.772055] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-25T22:16:11.778960] [DEBUG] [MAIN ] AQN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:11.779674] [INFO ] [MAIN ] AQN: Generated 1807 derivative records from 52302 primary records. [2025-09-25T22:16:11.779741] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-25T22:16:11.774747] [INFO ] [MAIN ] Derivative Progress: 96/2043 symbols completed. APOS took 1.7s. Estimated remaining: 14m 29s. Rate: 134.5 symbols/min [2025-09-25T22:16:11.780876] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:11.823576] [DEBUG] [LOCAL ] AQN: Derivative data saved (1807 records). [2025-09-25T22:16:11.829169] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-25T22:16:11.832224] [INFO ] [MAIN ] Derivative Progress: 97/2043 symbols completed. AQN took 1.0s. Estimated remaining: 14m 20s. Rate: 135.7 symbols/min [2025-09-25T22:16:11.838496] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:11.890301] [DEBUG] [LOCAL ] ARCO: Loaded 44935 existing records from primary storage. [2025-09-25T22:16:11.890496] [INFO ] [MAIN ] ARCO: Loaded 44935 primary data records. [2025-09-25T22:16:11.904894] [DEBUG] [LOCAL ] ARDC: Loaded 14647 existing records from primary storage. [2025-09-25T22:16:11.905050] [INFO ] [MAIN ] ARDC: Loaded 14647 primary data records. [2025-09-25T22:16:12.209256] [DEBUG] [MAIN ] AR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:12.210362] [INFO ] [MAIN ] AR: Generated 1807 derivative records from 53974 primary records. [2025-09-25T22:16:12.210432] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-25T22:16:12.275026] [DEBUG] [LOCAL ] AR: Derivative data saved (1807 records). [2025-09-25T22:16:12.275167] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-25T22:16:12.278678] [INFO ] [MAIN ] Derivative Progress: 98/2043 symbols completed. AR took 1.4s. Estimated remaining: 14m 20s. Rate: 135.7 symbols/min [2025-09-25T22:16:12.288284] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:12.707482] [DEBUG] [LOCAL ] ARDT: Loaded 28351 existing records from primary storage. [2025-09-25T22:16:12.707661] [INFO ] [MAIN ] ARDT: Loaded 28351 primary data records. [2025-09-25T22:16:12.764142] [DEBUG] [MAIN ] ARCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:12.764877] [INFO ] [MAIN ] ARCO: Generated 1807 derivative records from 44935 primary records. [2025-09-25T22:16:12.764942] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-25T22:16:12.830816] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1807 records). [2025-09-25T22:16:12.830948] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-25T22:16:12.833273] [INFO ] [MAIN ] Derivative Progress: 99/2043 symbols completed. ARCO took 1.1s. Estimated remaining: 14m 22s. Rate: 135.3 symbols/min [2025-09-25T22:16:12.836069] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:13.027588] [DEBUG] [MAIN ] ARDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:13.028413] [INFO ] [MAIN ] ARDC: Generated 1807 derivative records from 14647 primary records. [2025-09-25T22:16:13.028480] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-25T22:16:13.026473] [DEBUG] [LOCAL ] ARE: Loaded 50963 existing records from primary storage. [2025-09-25T22:16:13.036976] [INFO ] [MAIN ] ARE: Loaded 50963 primary data records. [2025-09-25T22:16:13.098607] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1807 records). [2025-09-25T22:16:13.098775] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-25T22:16:13.101213] [INFO ] [MAIN ] Derivative Progress: 100/2043 symbols completed. ARDC took 1.3s. Estimated remaining: 14m 18s. Rate: 135.9 symbols/min [2025-09-25T22:16:13.107240] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:13.291984] [DEBUG] [LOCAL ] ARIS: Loaded 42320 existing records from primary storage. [2025-09-25T22:16:13.292136] [INFO ] [MAIN ] ARIS: Loaded 42320 primary data records. [2025-09-25T22:16:13.880432] [DEBUG] [MAIN ] ARE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:13.886841] [INFO ] [MAIN ] ARE: Generated 1807 derivative records from 50963 primary records. [2025-09-25T22:16:13.886948] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-25T22:16:13.918928] [DEBUG] [LOCAL ] ARE: Derivative data saved (1807 records). [2025-09-25T22:16:13.919053] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-25T22:16:13.921903] [INFO ] [MAIN ] Derivative Progress: 101/2043 symbols completed. ARE took 1.1s. Estimated remaining: 14m 25s. Rate: 134.7 symbols/min [2025-09-25T22:16:13.922144] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:13.951835] [DEBUG] [MAIN ] ARDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:13.952768] [INFO ] [MAIN ] ARDT: Generated 1807 derivative records from 28351 primary records. [2025-09-25T22:16:13.952836] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-25T22:16:13.982890] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1807 records). [2025-09-25T22:16:13.983068] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-25T22:16:13.985483] [INFO ] [MAIN ] Derivative Progress: 102/2043 symbols completed. ARDT took 1.7s. Estimated remaining: 14m 17s. Rate: 135.9 symbols/min [2025-09-25T22:16:13.985816] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:14.231964] [DEBUG] [LOCAL ] ARLO: Loaded 44209 existing records from primary storage. [2025-09-25T22:16:14.232176] [INFO ] [MAIN ] ARLO: Loaded 44209 primary data records. [2025-09-25T22:16:14.239395] [DEBUG] [LOCAL ] ARMK: Loaded 50735 existing records from primary storage. [2025-09-25T22:16:14.239526] [INFO ] [MAIN ] ARMK: Loaded 50735 primary data records. [2025-09-25T22:16:14.304454] [DEBUG] [MAIN ] ARIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:14.305168] [INFO ] [MAIN ] ARIS: Generated 1807 derivative records from 42320 primary records. [2025-09-25T22:16:14.305234] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-25T22:16:14.367239] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1807 records). [2025-09-25T22:16:14.367354] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-25T22:16:14.369618] [INFO ] [MAIN ] Derivative Progress: 103/2043 symbols completed. ARIS took 1.3s. Estimated remaining: 14m 16s. Rate: 136.0 symbols/min [2025-09-25T22:16:14.988620] [DEBUG] [MAIN ] ARMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:14.989527] [INFO ] [MAIN ] ARMK: Generated 1807 derivative records from 50735 primary records. [2025-09-25T22:16:14.989597] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-25T22:16:15.013271] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1807 records). [2025-09-25T22:16:15.013343] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-25T22:16:15.019697] [INFO ] [MAIN ] Derivative Progress: 104/2043 symbols completed. ARMK took 1.0s. Estimated remaining: 14m 19s. Rate: 135.4 symbols/min [2025-09-25T22:16:15.036254] [DEBUG] [MAIN ] ARLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:15.036962] [INFO ] [MAIN ] ARLO: Generated 1807 derivative records from 44209 primary records. [2025-09-25T22:16:15.037028] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-25T22:16:15.053740] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1807 records). [2025-09-25T22:16:15.053802] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-25T22:16:15.056393] [INFO ] [MAIN ] Derivative Progress: 105/2043 symbols completed. ARLO took 1.1s. Estimated remaining: 14m 11s. Rate: 136.6 symbols/min [2025-09-25T22:16:15.057028] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:15.057856] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:15.059846] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:15.090764] [DEBUG] [LOCAL ] ASA: Loaded 13926 existing records from primary storage. [2025-09-25T22:16:15.091158] [INFO ] [MAIN ] ASA: Loaded 13926 primary data records. [2025-09-25T22:16:15.231935] [DEBUG] [LOCAL ] ARW: Loaded 33429 existing records from primary storage. [2025-09-25T22:16:15.232184] [INFO ] [MAIN ] ARW: Loaded 33429 primary data records. [2025-09-25T22:16:15.286389] [DEBUG] [LOCAL ] ASAN: Loaded 53132 existing records from primary storage. [2025-09-25T22:16:15.286630] [INFO ] [MAIN ] ASAN: Loaded 53132 primary data records. [2025-09-25T22:16:16.274481] [DEBUG] [MAIN ] ASA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:16.275387] [INFO ] [MAIN ] ASA: Generated 1807 derivative records from 13926 primary records. [2025-09-25T22:16:16.275458] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-25T22:16:16.305699] [DEBUG] [MAIN ] ARW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:16.306492] [INFO ] [MAIN ] ARW: Generated 1807 derivative records from 33429 primary records. [2025-09-25T22:16:16.306587] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-25T22:16:16.343491] [DEBUG] [LOCAL ] ASA: Derivative data saved (1807 records). [2025-09-25T22:16:16.343685] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-25T22:16:16.351275] [DEBUG] [LOCAL ] ARW: Derivative data saved (1807 records). [2025-09-25T22:16:16.351380] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-25T22:16:16.346116] [INFO ] [MAIN ] Derivative Progress: 106/2043 symbols completed. ASA took 1.3s. Estimated remaining: 14m 26s. Rate: 134.2 symbols/min [2025-09-25T22:16:16.353863] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:16.362896] [INFO ] [MAIN ] Derivative Progress: 107/2043 symbols completed. ARW took 1.3s. Estimated remaining: 14m 18s. Rate: 135.4 symbols/min [2025-09-25T22:16:16.363189] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:16.387358] [DEBUG] [MAIN ] ASAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:16.388374] [INFO ] [MAIN ] ASAN: Generated 1807 derivative records from 53132 primary records. [2025-09-25T22:16:16.388438] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-25T22:16:16.452499] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1807 records). [2025-09-25T22:16:16.452687] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-25T22:16:16.468822] [DEBUG] [LOCAL ] ASC: Loaded 37925 existing records from primary storage. [2025-09-25T22:16:16.468912] [INFO ] [MAIN ] ASC: Loaded 37925 primary data records. [2025-09-25T22:16:16.468614] [INFO ] [MAIN ] Derivative Progress: 108/2043 symbols completed. ASAN took 1.4s. Estimated remaining: 14m 11s. Rate: 136.3 symbols/min [2025-09-25T22:16:16.475293] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:16.516982] [DEBUG] [LOCAL ] ASB: Loaded 49933 existing records from primary storage. [2025-09-25T22:16:16.517143] [INFO ] [MAIN ] ASB: Loaded 49933 primary data records. [2025-09-25T22:16:16.564386] [DEBUG] [LOCAL ] ASG: Loaded 20501 existing records from primary storage. [2025-09-25T22:16:16.564568] [INFO ] [MAIN ] ASG: Loaded 20501 primary data records. [2025-09-25T22:16:17.432878] [DEBUG] [MAIN ] ASC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:17.440095] [INFO ] [MAIN ] ASC: Generated 1807 derivative records from 37925 primary records. [2025-09-25T22:16:17.440185] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-25T22:16:17.452774] [DEBUG] [MAIN ] ASB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:17.453364] [INFO ] [MAIN ] ASB: Generated 1807 derivative records from 49933 primary records. [2025-09-25T22:16:17.453424] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-25T22:16:17.488848] [DEBUG] [LOCAL ] ASB: Derivative data saved (1807 records). [2025-09-25T22:16:17.488928] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-25T22:16:17.483713] [DEBUG] [LOCAL ] ASC: Derivative data saved (1807 records). [2025-09-25T22:16:17.492066] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-25T22:16:17.491955] [INFO ] [MAIN ] Derivative Progress: 109/2043 symbols completed. ASB took 1.1s. Estimated remaining: 14m 21s. Rate: 134.7 symbols/min [2025-09-25T22:16:17.498042] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:17.500684] [INFO ] [MAIN ] Derivative Progress: 110/2043 symbols completed. ASC took 1.1s. Estimated remaining: 14m 13s. Rate: 135.9 symbols/min [2025-09-25T22:16:17.500848] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:17.559680] [DEBUG] [LOCAL ] ASGI: Loaded 22522 existing records from primary storage. [2025-09-25T22:16:17.559878] [INFO ] [MAIN ] ASGI: Loaded 22522 primary data records. [2025-09-25T22:16:17.614915] [DEBUG] [LOCAL ] ASH: Loaded 38035 existing records from primary storage. [2025-09-25T22:16:17.615128] [INFO ] [MAIN ] ASH: Loaded 38035 primary data records. [2025-09-25T22:16:17.958270] [DEBUG] [MAIN ] ASG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:17.959093] [INFO ] [MAIN ] ASG: Generated 1807 derivative records from 20501 primary records. [2025-09-25T22:16:17.959163] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-25T22:16:18.046720] [DEBUG] [LOCAL ] ASG: Derivative data saved (1807 records). [2025-09-25T22:16:18.046901] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-25T22:16:18.049545] [INFO ] [MAIN ] Derivative Progress: 111/2043 symbols completed. ASG took 1.6s. Estimated remaining: 14m 15s. Rate: 135.6 symbols/min [2025-09-25T22:16:18.069009] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:18.144394] [DEBUG] [LOCAL ] ASIX: Loaded 22682 existing records from primary storage. [2025-09-25T22:16:18.144586] [INFO ] [MAIN ] ASIX: Loaded 22682 primary data records. [2025-09-25T22:16:18.550786] [DEBUG] [MAIN ] ASGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:18.551587] [INFO ] [MAIN ] ASGI: Generated 1807 derivative records from 22522 primary records. [2025-09-25T22:16:18.551672] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-25T22:16:18.603524] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1807 records). [2025-09-25T22:16:18.603699] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-25T22:16:18.606297] [INFO ] [MAIN ] Derivative Progress: 112/2043 symbols completed. ASGI took 1.1s. Estimated remaining: 14m 16s. Rate: 135.3 symbols/min [2025-09-25T22:16:18.611442] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:18.629509] [DEBUG] [MAIN ] ASH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:18.636291] [INFO ] [MAIN ] ASH: Generated 1807 derivative records from 38035 primary records. [2025-09-25T22:16:18.636424] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-25T22:16:18.712396] [DEBUG] [LOCAL ] ASH: Derivative data saved (1807 records). [2025-09-25T22:16:18.712620] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-25T22:16:18.718480] [INFO ] [MAIN ] Derivative Progress: 113/2043 symbols completed. ASH took 1.2s. Estimated remaining: 14m 10s. Rate: 136.2 symbols/min [2025-09-25T22:16:18.743875] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:18.802165] [DEBUG] [LOCAL ] ASR: Loaded 9322 existing records from primary storage. [2025-09-25T22:16:18.802296] [INFO ] [MAIN ] ASR: Loaded 9322 primary data records. [2025-09-25T22:16:18.798737] [DEBUG] [LOCAL ] ASPN: Loaded 49938 existing records from primary storage. [2025-09-25T22:16:18.807626] [INFO ] [MAIN ] ASPN: Loaded 49938 primary data records. [2025-09-25T22:16:19.639460] [DEBUG] [MAIN ] ASIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:19.640236] [INFO ] [MAIN ] ASIX: Generated 1807 derivative records from 22682 primary records. [2025-09-25T22:16:19.640305] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-25T22:16:19.679191] [DEBUG] [MAIN ] ASR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:19.683550] [INFO ] [MAIN ] ASR: Generated 1807 derivative records from 9322 primary records. [2025-09-25T22:16:19.683623] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-25T22:16:19.704565] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1807 records). [2025-09-25T22:16:19.704702] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-25T22:16:19.707784] [INFO ] [MAIN ] Derivative Progress: 114/2043 symbols completed. ASIX took 1.6s. Estimated remaining: 14m 19s. Rate: 134.7 symbols/min [2025-09-25T22:16:19.715830] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:19.741820] [DEBUG] [LOCAL ] ASR: Derivative data saved (1807 records). [2025-09-25T22:16:19.762747] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-25T22:16:19.766739] [INFO ] [MAIN ] Derivative Progress: 115/2043 symbols completed. ASR took 1.0s. Estimated remaining: 14m 12s. Rate: 135.8 symbols/min [2025-09-25T22:16:19.768895] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:19.814808] [DEBUG] [LOCAL ] ATGE: Loaded 32073 existing records from primary storage. [2025-09-25T22:16:19.815014] [INFO ] [MAIN ] ATGE: Loaded 32073 primary data records. [2025-09-25T22:16:19.865501] [DEBUG] [LOCAL ] ATHM: Loaded 32842 existing records from primary storage. [2025-09-25T22:16:19.873737] [INFO ] [MAIN ] ATHM: Loaded 32842 primary data records. [2025-09-25T22:16:19.912449] [DEBUG] [MAIN ] ASPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:19.913244] [INFO ] [MAIN ] ASPN: Generated 1807 derivative records from 49938 primary records. [2025-09-25T22:16:19.922229] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-25T22:16:19.969598] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1807 records). [2025-09-25T22:16:19.969779] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-25T22:16:19.972624] [INFO ] [MAIN ] Derivative Progress: 116/2043 symbols completed. ASPN took 1.4s. Estimated remaining: 14m 8s. Rate: 136.4 symbols/min [2025-09-25T22:16:19.976808] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:20.233816] [DEBUG] [LOCAL ] ATI: Loaded 51903 existing records from primary storage. [2025-09-25T22:16:20.233993] [INFO ] [MAIN ] ATI: Loaded 51903 primary data records. [2025-09-25T22:16:20.907162] [DEBUG] [MAIN ] ATGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:20.911630] [INFO ] [MAIN ] ATGE: Generated 1807 derivative records from 32073 primary records. [2025-09-25T22:16:20.911760] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-25T22:16:20.919836] [DEBUG] [MAIN ] ATHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:20.924684] [INFO ] [MAIN ] ATHM: Generated 1807 derivative records from 32842 primary records. [2025-09-25T22:16:20.924822] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-25T22:16:20.963378] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1807 records). [2025-09-25T22:16:20.963517] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-25T22:16:20.965677] [INFO ] [MAIN ] Derivative Progress: 117/2043 symbols completed. ATHM took 1.2s. Estimated remaining: 14m 16s. Rate: 134.9 symbols/min [2025-09-25T22:16:20.968935] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:20.977465] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1807 records). [2025-09-25T22:16:20.977570] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-25T22:16:20.980287] [INFO ] [MAIN ] Derivative Progress: 118/2043 symbols completed. ATGE took 1.3s. Estimated remaining: 14m 9s. Rate: 136.1 symbols/min [2025-09-25T22:16:21.043909] [DEBUG] [LOCAL ] ATKR: Loaded 35914 existing records from primary storage. [2025-09-25T22:16:21.044063] [INFO ] [MAIN ] ATKR: Loaded 35914 primary data records. [2025-09-25T22:16:21.202070] [DEBUG] [MAIN ] ATI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:21.202787] [INFO ] [MAIN ] ATI: Generated 1807 derivative records from 51903 primary records. [2025-09-25T22:16:21.202852] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-25T22:16:21.242620] [DEBUG] [LOCAL ] ATI: Derivative data saved (1807 records). [2025-09-25T22:16:21.242731] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-25T22:16:21.245402] [INFO ] [MAIN ] Derivative Progress: 119/2043 symbols completed. ATI took 1.3s. Estimated remaining: 14m 6s. Rate: 136.5 symbols/min [2025-09-25T22:16:21.500000] [DEBUG] [MAIN ] ATKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:21.500695] [INFO ] [MAIN ] ATKR: Generated 1807 derivative records from 35914 primary records. [2025-09-25T22:16:21.500766] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-25T22:16:21.518514] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1807 records). [2025-09-25T22:16:21.518708] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-25T22:16:21.521118] [INFO ] [MAIN ] Derivative Progress: 120/2043 symbols completed. ATKR took 0.6s. Estimated remaining: 14m 3s. Rate: 136.9 symbols/min [2025-09-25T22:16:21.522083] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:21.522940] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:21.525739] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:21.548924] [DEBUG] [LOCAL ] ATS: Loaded 18022 existing records from primary storage. [2025-09-25T22:16:21.549094] [INFO ] [MAIN ] ATS: Loaded 18022 primary data records. [2025-09-25T22:16:21.651023] [DEBUG] [LOCAL ] ATO: Loaded 42204 existing records from primary storage. [2025-09-25T22:16:21.651191] [INFO ] [MAIN ] ATO: Loaded 42204 primary data records. [2025-09-25T22:16:21.658422] [DEBUG] [LOCAL ] ATR: Loaded 30652 existing records from primary storage. [2025-09-25T22:16:21.658521] [INFO ] [MAIN ] ATR: Loaded 30652 primary data records. [2025-09-25T22:16:22.655540] [DEBUG] [MAIN ] ATR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:22.656348] [INFO ] [MAIN ] ATR: Generated 1807 derivative records from 30652 primary records. [2025-09-25T22:16:22.656418] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-25T22:16:22.691488] [DEBUG] [MAIN ] ATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:22.692207] [INFO ] [MAIN ] ATO: Generated 1807 derivative records from 42204 primary records. [2025-09-25T22:16:22.692275] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-25T22:16:22.703448] [DEBUG] [LOCAL ] ATR: Derivative data saved (1807 records). [2025-09-25T22:16:22.703571] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-25T22:16:22.705979] [INFO ] [MAIN ] Derivative Progress: 121/2043 symbols completed. ATR took 1.2s. Estimated remaining: 14m 14s. Rate: 135.0 symbols/min [2025-09-25T22:16:22.726592] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:22.738355] [DEBUG] [LOCAL ] ATO: Derivative data saved (1807 records). [2025-09-25T22:16:22.738520] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-25T22:16:22.741329] [INFO ] [MAIN ] Derivative Progress: 122/2043 symbols completed. ATO took 1.2s. Estimated remaining: 14m 7s. Rate: 136.1 symbols/min [2025-09-25T22:16:22.746999] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:22.792696] [DEBUG] [MAIN ] ATS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:22.793440] [INFO ] [MAIN ] ATS: Generated 1807 derivative records from 18022 primary records. [2025-09-25T22:16:22.793505] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-25T22:16:22.860257] [DEBUG] [LOCAL ] ATS: Derivative data saved (1807 records). [2025-09-25T22:16:22.860416] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-25T22:16:22.862793] [INFO ] [MAIN ] Derivative Progress: 123/2043 symbols completed. ATS took 1.3s. Estimated remaining: 14m 2s. Rate: 136.9 symbols/min [2025-09-25T22:16:22.882157] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:22.884732] [DEBUG] [LOCAL ] AUB: Loaded 46780 existing records from primary storage. [2025-09-25T22:16:22.884835] [INFO ] [MAIN ] AUB: Loaded 46780 primary data records. [2025-09-25T22:16:22.897352] [DEBUG] [LOCAL ] AU: Loaded 53326 existing records from primary storage. [2025-09-25T22:16:22.897510] [INFO ] [MAIN ] AU: Loaded 53326 primary data records. [2025-09-25T22:16:22.916186] [DEBUG] [LOCAL ] AUNA: Loaded 4907 existing records from primary storage. [2025-09-25T22:16:22.916343] [INFO ] [MAIN ] AUNA: Loaded 4907 primary data records. [2025-09-25T22:16:23.662359] [DEBUG] [MAIN ] AUNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:23.663051] [INFO ] [MAIN ] AUNA: Generated 1807 derivative records from 4907 primary records. [2025-09-25T22:16:23.663119] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-25T22:16:23.841963] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1807 records). [2025-09-25T22:16:23.842109] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-25T22:16:23.844397] [INFO ] [MAIN ] Derivative Progress: 124/2043 symbols completed. AUNA took 1.0s. Estimated remaining: 14m 10s. Rate: 135.5 symbols/min [2025-09-25T22:16:23.844692] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:23.938236] [DEBUG] [LOCAL ] AVA: Loaded 39928 existing records from primary storage. [2025-09-25T22:16:23.938417] [INFO ] [MAIN ] AVA: Loaded 39928 primary data records. [2025-09-25T22:16:23.947258] [DEBUG] [MAIN ] AUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:23.947934] [INFO ] [MAIN ] AUB: Generated 1807 derivative records from 46780 primary records. [2025-09-25T22:16:23.947996] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-25T22:16:23.996241] [DEBUG] [LOCAL ] AUB: Derivative data saved (1807 records). [2025-09-25T22:16:23.996368] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-25T22:16:23.998582] [INFO ] [MAIN ] Derivative Progress: 125/2043 symbols completed. AUB took 1.3s. Estimated remaining: 14m 5s. Rate: 136.2 symbols/min [2025-09-25T22:16:24.006382] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:24.049018] [DEBUG] [LOCAL ] AVAL: Loaded 9011 existing records from primary storage. [2025-09-25T22:16:24.049164] [INFO ] [MAIN ] AVAL: Loaded 9011 primary data records. [2025-09-25T22:16:24.197512] [DEBUG] [MAIN ] AU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:24.217212] [INFO ] [MAIN ] AU: Generated 1807 derivative records from 53326 primary records. [2025-09-25T22:16:24.217294] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-25T22:16:24.255381] [DEBUG] [LOCAL ] AU: Derivative data saved (1807 records). [2025-09-25T22:16:24.255484] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-25T22:16:24.258740] [INFO ] [MAIN ] Derivative Progress: 126/2043 symbols completed. AU took 1.5s. Estimated remaining: 14m 2s. Rate: 136.7 symbols/min [2025-09-25T22:16:24.264943] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:24.645703] [DEBUG] [LOCAL ] AVB: Loaded 42140 existing records from primary storage. [2025-09-25T22:16:24.645910] [INFO ] [MAIN ] AVB: Loaded 42140 primary data records. [2025-09-25T22:16:24.791036] [DEBUG] [MAIN ] AVAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:24.791696] [INFO ] [MAIN ] AVAL: Generated 1807 derivative records from 9011 primary records. [2025-09-25T22:16:24.791768] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-25T22:16:24.832697] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1807 records). [2025-09-25T22:16:24.832846] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-25T22:16:24.835241] [INFO ] [MAIN ] Derivative Progress: 127/2043 symbols completed. AVAL took 0.8s. Estimated remaining: 14m 3s. Rate: 136.3 symbols/min [2025-09-25T22:16:24.844543] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:24.921192] [DEBUG] [LOCAL ] AVD: Loaded 22939 existing records from primary storage. [2025-09-25T22:16:24.921339] [INFO ] [MAIN ] AVD: Loaded 22939 primary data records. [2025-09-25T22:16:25.398621] [DEBUG] [MAIN ] AVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:25.399407] [INFO ] [MAIN ] AVB: Generated 1807 derivative records from 42140 primary records. [2025-09-25T22:16:25.399480] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-25T22:16:25.416825] [DEBUG] [MAIN ] AVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:25.417805] [INFO ] [MAIN ] AVA: Generated 1807 derivative records from 39928 primary records. [2025-09-25T22:16:25.417918] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-25T22:16:25.464566] [DEBUG] [LOCAL ] AVB: Derivative data saved (1807 records). [2025-09-25T22:16:25.464720] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-25T22:16:25.467058] [INFO ] [MAIN ] Derivative Progress: 128/2043 symbols completed. AVB took 1.2s. Estimated remaining: 14m 6s. Rate: 135.9 symbols/min [2025-09-25T22:16:25.478000] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:25.495436] [DEBUG] [LOCAL ] AVA: Derivative data saved (1807 records). [2025-09-25T22:16:25.495592] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-25T22:16:25.498278] [INFO ] [MAIN ] Derivative Progress: 129/2043 symbols completed. AVA took 1.7s. Estimated remaining: 13m 59s. Rate: 136.9 symbols/min [2025-09-25T22:16:25.513003] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:25.524915] [DEBUG] [LOCAL ] AVK: Loaded 17966 existing records from primary storage. [2025-09-25T22:16:25.525100] [INFO ] [MAIN ] AVK: Loaded 17966 primary data records. [2025-09-25T22:16:25.698352] [DEBUG] [LOCAL ] AVNS: Loaded 33862 existing records from primary storage. [2025-09-25T22:16:25.698554] [INFO ] [MAIN ] AVNS: Loaded 33862 primary data records. [2025-09-25T22:16:26.306209] [DEBUG] [MAIN ] AVD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:26.307299] [INFO ] [MAIN ] AVD: Generated 1807 derivative records from 22939 primary records. [2025-09-25T22:16:26.307369] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-25T22:16:26.338240] [DEBUG] [LOCAL ] AVD: Derivative data saved (1807 records). [2025-09-25T22:16:26.338354] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-25T22:16:26.340743] [INFO ] [MAIN ] Derivative Progress: 130/2043 symbols completed. AVD took 1.5s. Estimated remaining: 14m 5s. Rate: 135.9 symbols/min [2025-09-25T22:16:26.345221] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:26.469870] [DEBUG] [MAIN ] AVK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:26.470615] [INFO ] [MAIN ] AVK: Generated 1807 derivative records from 17966 primary records. [2025-09-25T22:16:26.473786] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-25T22:16:26.497475] [DEBUG] [LOCAL ] AVK: Derivative data saved (1807 records). [2025-09-25T22:16:26.498179] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-25T22:16:26.500959] [INFO ] [MAIN ] Derivative Progress: 131/2043 symbols completed. AVK took 1.0s. Estimated remaining: 14m 0s. Rate: 136.6 symbols/min [2025-09-25T22:16:26.501417] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:26.538286] [DEBUG] [MAIN ] AVNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:26.540192] [INFO ] [MAIN ] AVNS: Generated 1807 derivative records from 33862 primary records. [2025-09-25T22:16:26.540352] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-25T22:16:26.573032] [DEBUG] [LOCAL ] AWF: Loaded 24455 existing records from primary storage. [2025-09-25T22:16:26.573175] [INFO ] [MAIN ] AWF: Loaded 24455 primary data records. [2025-09-25T22:16:26.587869] [DEBUG] [LOCAL ] AVNT: Loaded 39555 existing records from primary storage. [2025-09-25T22:16:26.588065] [INFO ] [MAIN ] AVNT: Loaded 39555 primary data records. [2025-09-25T22:16:26.616797] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1807 records). [2025-09-25T22:16:26.616899] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-25T22:16:26.619299] [INFO ] [MAIN ] Derivative Progress: 132/2043 symbols completed. AVNS took 1.1s. Estimated remaining: 13m 55s. Rate: 137.3 symbols/min [2025-09-25T22:16:26.619498] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:26.837471] [DEBUG] [LOCAL ] AWI: Loaded 26071 existing records from primary storage. [2025-09-25T22:16:26.837629] [INFO ] [MAIN ] AWI: Loaded 26071 primary data records. [2025-09-25T22:16:27.722412] [DEBUG] [MAIN ] AWF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:27.724697] [INFO ] [MAIN ] AWF: Generated 1807 derivative records from 24455 primary records. [2025-09-25T22:16:27.725173] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-25T22:16:27.753451] [DEBUG] [LOCAL ] AWF: Derivative data saved (1807 records). [2025-09-25T22:16:27.753672] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-25T22:16:27.756326] [INFO ] [MAIN ] Derivative Progress: 133/2043 symbols completed. AWF took 1.3s. Estimated remaining: 14m 5s. Rate: 135.7 symbols/min [2025-09-25T22:16:27.773603] [DEBUG] [MAIN ] AWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:27.786759] [INFO ] [MAIN ] AWI: Generated 1807 derivative records from 26071 primary records. [2025-09-25T22:16:27.786868] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-25T22:16:27.801431] [DEBUG] [MAIN ] AVNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:27.802234] [INFO ] [MAIN ] AVNT: Generated 1807 derivative records from 39555 primary records. [2025-09-25T22:16:27.802300] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-25T22:16:27.824321] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1807 records). [2025-09-25T22:16:27.824483] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-25T22:16:27.837719] [INFO ] [MAIN ] Derivative Progress: 134/2043 symbols completed. AVNT took 1.5s. Estimated remaining: 13m 59s. Rate: 136.5 symbols/min [2025-09-25T22:16:27.847902] [DEBUG] [LOCAL ] AWI: Derivative data saved (1807 records). [2025-09-25T22:16:27.847980] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-25T22:16:27.850253] [INFO ] [MAIN ] Derivative Progress: 135/2043 symbols completed. AWI took 1.2s. Estimated remaining: 13m 53s. Rate: 137.5 symbols/min [2025-09-25T22:16:27.850853] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:27.851803] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:27.852895] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:27.892682] [DEBUG] [LOCAL ] AWP: Loaded 21735 existing records from primary storage. [2025-09-25T22:16:27.892860] [INFO ] [MAIN ] AWP: Loaded 21735 primary data records. [2025-09-25T22:16:27.915109] [DEBUG] [LOCAL ] AWR: Loaded 22806 existing records from primary storage. [2025-09-25T22:16:27.915331] [INFO ] [MAIN ] AWR: Loaded 22806 primary data records. [2025-09-25T22:16:28.081053] [DEBUG] [LOCAL ] AWK: Loaded 49161 existing records from primary storage. [2025-09-25T22:16:28.081227] [INFO ] [MAIN ] AWK: Loaded 49161 primary data records. [2025-09-25T22:16:28.873265] [DEBUG] [MAIN ] AWP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:28.873925] [INFO ] [MAIN ] AWP: Generated 1807 derivative records from 21735 primary records. [2025-09-25T22:16:28.873994] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-25T22:16:28.899023] [DEBUG] [MAIN ] AWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:28.902789] [INFO ] [MAIN ] AWR: Generated 1807 derivative records from 22806 primary records. [2025-09-25T22:16:28.902982] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-25T22:16:28.933592] [DEBUG] [LOCAL ] AWP: Derivative data saved (1807 records). [2025-09-25T22:16:28.933730] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-25T22:16:28.936769] [INFO ] [MAIN ] Derivative Progress: 136/2043 symbols completed. AWP took 1.1s. Estimated remaining: 14m 1s. Rate: 136.0 symbols/min [2025-09-25T22:16:28.942897] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:28.952482] [DEBUG] [LOCAL ] AWR: Derivative data saved (1807 records). [2025-09-25T22:16:28.952582] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-25T22:16:28.955573] [INFO ] [MAIN ] Derivative Progress: 137/2043 symbols completed. AWR took 1.1s. Estimated remaining: 13m 55s. Rate: 137.0 symbols/min [2025-09-25T22:16:28.966593] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:29.027038] [DEBUG] [LOCAL ] AX: Loaded 28738 existing records from primary storage. [2025-09-25T22:16:29.027196] [INFO ] [MAIN ] AX: Loaded 28738 primary data records. [2025-09-25T22:16:29.291269] [DEBUG] [LOCAL ] AXL: Loaded 50863 existing records from primary storage. [2025-09-25T22:16:29.291437] [INFO ] [MAIN ] AXL: Loaded 50863 primary data records. [2025-09-25T22:16:29.337920] [DEBUG] [MAIN ] AWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:29.338489] [INFO ] [MAIN ] AWK: Generated 1807 derivative records from 49161 primary records. [2025-09-25T22:16:29.338551] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-25T22:16:29.392680] [DEBUG] [LOCAL ] AWK: Derivative data saved (1807 records). [2025-09-25T22:16:29.392758] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-25T22:16:29.398347] [INFO ] [MAIN ] Derivative Progress: 138/2043 symbols completed. AWK took 1.5s. Estimated remaining: 13m 55s. Rate: 137.0 symbols/min [2025-09-25T22:16:29.413292] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:29.424340] [DEBUG] [LOCAL ] AXR: Loaded 3174 existing records from primary storage. [2025-09-25T22:16:29.424419] [INFO ] [MAIN ] AXR: Loaded 3174 primary data records. [2025-09-25T22:16:30.170251] [DEBUG] [MAIN ] AX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:30.173863] [INFO ] [MAIN ] AX: Generated 1807 derivative records from 28738 primary records. [2025-09-25T22:16:30.173941] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-25T22:16:30.221515] [DEBUG] [LOCAL ] AX: Derivative data saved (1807 records). [2025-09-25T22:16:30.221693] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-25T22:16:30.224617] [INFO ] [MAIN ] Derivative Progress: 139/2043 symbols completed. AX took 1.3s. Estimated remaining: 13m 59s. Rate: 136.1 symbols/min [2025-09-25T22:16:30.231860] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:30.279587] [DEBUG] [MAIN ] AXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:30.280532] [INFO ] [MAIN ] AXL: Generated 1807 derivative records from 50863 primary records. [2025-09-25T22:16:30.280598] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-25T22:16:30.340153] [DEBUG] [LOCAL ] AXL: Derivative data saved (1807 records). [2025-09-25T22:16:30.340329] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-25T22:16:30.342781] [INFO ] [MAIN ] Derivative Progress: 140/2043 symbols completed. AXL took 1.4s. Estimated remaining: 13m 55s. Rate: 136.8 symbols/min [2025-09-25T22:16:30.343074] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:30.371245] [DEBUG] [LOCAL ] AXS: Loaded 38615 existing records from primary storage. [2025-09-25T22:16:30.371401] [INFO ] [MAIN ] AXS: Loaded 38615 primary data records. [2025-09-25T22:16:30.811983] [DEBUG] [LOCAL ] AXTA: Loaded 52445 existing records from primary storage. [2025-09-25T22:16:30.813982] [INFO ] [MAIN ] AXTA: Loaded 52445 primary data records. [2025-09-25T22:16:30.897637] [DEBUG] [MAIN ] AXR: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:16:30.898409] [INFO ] [MAIN ] AXR: Generated 1805 derivative records from 3174 primary records. [2025-09-25T22:16:30.898475] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-25T22:16:30.931281] [DEBUG] [MAIN ] AXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:30.931942] [INFO ] [MAIN ] AXS: Generated 1807 derivative records from 38615 primary records. [2025-09-25T22:16:30.932007] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-25T22:16:30.951805] [DEBUG] [LOCAL ] AXR: Derivative data saved (1805 records). [2025-09-25T22:16:30.951877] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-25T22:16:30.954612] [INFO ] [MAIN ] Derivative Progress: 141/2043 symbols completed. AXR took 1.5s. Estimated remaining: 13m 56s. Rate: 136.4 symbols/min [2025-09-25T22:16:30.967748] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:31.004383] [DEBUG] [LOCAL ] AXS: Derivative data saved (1807 records). [2025-09-25T22:16:31.004507] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-25T22:16:31.008034] [INFO ] [MAIN ] Derivative Progress: 142/2043 symbols completed. AXS took 0.8s. Estimated remaining: 13m 51s. Rate: 137.3 symbols/min [2025-09-25T22:16:31.020117] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:31.128477] [DEBUG] [LOCAL ] AYI: Loaded 25307 existing records from primary storage. [2025-09-25T22:16:31.128628] [INFO ] [MAIN ] AYI: Loaded 25307 primary data records. [2025-09-25T22:16:31.191815] [DEBUG] [LOCAL ] AZO: Loaded 11599 existing records from primary storage. [2025-09-25T22:16:31.202744] [INFO ] [MAIN ] AZO: Loaded 11599 primary data records. [2025-09-25T22:16:31.823636] [DEBUG] [MAIN ] AXTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:31.824378] [INFO ] [MAIN ] AXTA: Generated 1807 derivative records from 52445 primary records. [2025-09-25T22:16:31.824444] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-25T22:16:31.853085] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1807 records). [2025-09-25T22:16:31.853211] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-25T22:16:31.856009] [INFO ] [MAIN ] Derivative Progress: 143/2043 symbols completed. AXTA took 1.5s. Estimated remaining: 13m 56s. Rate: 136.4 symbols/min [2025-09-25T22:16:31.859602] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:32.064050] [DEBUG] [LOCAL ] BA: Loaded 54181 existing records from primary storage. [2025-09-25T22:16:32.064215] [INFO ] [MAIN ] BA: Loaded 54181 primary data records. [2025-09-25T22:16:32.082367] [DEBUG] [MAIN ] AYI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:16:32.083343] [INFO ] [MAIN ] AYI: Generated 1806 derivative records from 25307 primary records. [2025-09-25T22:16:32.083411] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-25T22:16:32.110068] [DEBUG] [LOCAL ] AYI: Derivative data saved (1806 records). [2025-09-25T22:16:32.110254] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-25T22:16:32.112995] [INFO ] [MAIN ] Derivative Progress: 144/2043 symbols completed. AYI took 1.1s. Estimated remaining: 13m 53s. Rate: 136.8 symbols/min [2025-09-25T22:16:32.113293] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:32.459018] [DEBUG] [LOCAL ] BABA: Loaded 54210 existing records from primary storage. [2025-09-25T22:16:32.459184] [INFO ] [MAIN ] BABA: Loaded 54210 primary data records. [2025-09-25T22:16:32.602824] [DEBUG] [MAIN ] AZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:32.603522] [INFO ] [MAIN ] AZO: Generated 1807 derivative records from 11599 primary records. [2025-09-25T22:16:32.603586] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-25T22:16:32.641021] [DEBUG] [LOCAL ] AZO: Derivative data saved (1807 records). [2025-09-25T22:16:32.641139] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-25T22:16:32.643854] [INFO ] [MAIN ] Derivative Progress: 145/2043 symbols completed. AZO took 1.6s. Estimated remaining: 13m 54s. Rate: 136.6 symbols/min [2025-09-25T22:16:32.651978] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:32.834211] [DEBUG] [LOCAL ] BAC: Loaded 54198 existing records from primary storage. [2025-09-25T22:16:32.834381] [INFO ] [MAIN ] BAC: Loaded 54198 primary data records. [2025-09-25T22:16:33.076713] [DEBUG] [MAIN ] BA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:33.077465] [INFO ] [MAIN ] BA: Generated 1807 derivative records from 54181 primary records. [2025-09-25T22:16:33.077533] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-25T22:16:33.124947] [DEBUG] [LOCAL ] BA: Derivative data saved (1807 records). [2025-09-25T22:16:33.125075] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-25T22:16:33.127433] [INFO ] [MAIN ] Derivative Progress: 146/2043 symbols completed. BA took 1.3s. Estimated remaining: 13m 54s. Rate: 136.5 symbols/min [2025-09-25T22:16:33.138411] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:33.499123] [DEBUG] [MAIN ] BABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:33.500141] [INFO ] [MAIN ] BABA: Generated 1807 derivative records from 54210 primary records. [2025-09-25T22:16:33.500208] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-25T22:16:33.514229] [DEBUG] [LOCAL ] BAH: Loaded 52108 existing records from primary storage. [2025-09-25T22:16:33.514394] [INFO ] [MAIN ] BAH: Loaded 52108 primary data records. [2025-09-25T22:16:33.555782] [DEBUG] [LOCAL ] BABA: Derivative data saved (1807 records). [2025-09-25T22:16:33.555893] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-25T22:16:33.558458] [INFO ] [MAIN ] Derivative Progress: 147/2043 symbols completed. BABA took 1.4s. Estimated remaining: 13m 53s. Rate: 136.5 symbols/min [2025-09-25T22:16:33.570772] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:33.585521] [DEBUG] [MAIN ] BAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:33.586223] [INFO ] [MAIN ] BAC: Generated 1807 derivative records from 54198 primary records. [2025-09-25T22:16:33.586287] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-25T22:16:33.643502] [DEBUG] [LOCAL ] BAC: Derivative data saved (1807 records). [2025-09-25T22:16:33.643631] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-25T22:16:33.647216] [INFO ] [MAIN ] Derivative Progress: 148/2043 symbols completed. BAC took 1.0s. Estimated remaining: 13m 48s. Rate: 137.2 symbols/min [2025-09-25T22:16:33.674125] [DEBUG] [LOCAL ] BAK: Loaded 39033 existing records from primary storage. [2025-09-25T22:16:33.674345] [INFO ] [MAIN ] BAK: Loaded 39033 primary data records. [2025-09-25T22:16:34.119312] [DEBUG] [MAIN ] BAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:34.119989] [INFO ] [MAIN ] BAH: Generated 1807 derivative records from 52108 primary records. [2025-09-25T22:16:34.120056] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-25T22:16:34.149062] [DEBUG] [LOCAL ] BAH: Derivative data saved (1807 records). [2025-09-25T22:16:34.149194] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-25T22:16:34.151499] [INFO ] [MAIN ] Derivative Progress: 149/2043 symbols completed. BAH took 1.0s. Estimated remaining: 13m 49s. Rate: 137.1 symbols/min [2025-09-25T22:16:34.310776] [DEBUG] [MAIN ] BAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:34.311501] [INFO ] [MAIN ] BAK: Generated 1807 derivative records from 39033 primary records. [2025-09-25T22:16:34.311568] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-25T22:16:34.327675] [DEBUG] [LOCAL ] BAK: Derivative data saved (1807 records). [2025-09-25T22:16:34.327798] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-25T22:16:34.330008] [INFO ] [MAIN ] Derivative Progress: 150/2043 symbols completed. BAK took 0.8s. Estimated remaining: 13m 45s. Rate: 137.6 symbols/min [2025-09-25T22:16:34.330481] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:34.332798] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:34.336060] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:34.503775] [DEBUG] [LOCAL ] BAM: Loaded 52391 existing records from primary storage. [2025-09-25T22:16:34.503963] [INFO ] [MAIN ] BAM: Loaded 52391 primary data records. [2025-09-25T22:16:34.513329] [DEBUG] [LOCAL ] BANC: Loaded 51644 existing records from primary storage. [2025-09-25T22:16:34.513536] [INFO ] [MAIN ] BANC: Loaded 51644 primary data records. [2025-09-25T22:16:34.515816] [DEBUG] [LOCAL ] BALL: Loaded 52197 existing records from primary storage. [2025-09-25T22:16:34.516018] [INFO ] [MAIN ] BALL: Loaded 52197 primary data records. [2025-09-25T22:16:35.430371] [DEBUG] [MAIN ] BAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:35.431287] [INFO ] [MAIN ] BAM: Generated 1807 derivative records from 52391 primary records. [2025-09-25T22:16:35.431360] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-25T22:16:35.435672] [DEBUG] [MAIN ] BANC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:35.436237] [INFO ] [MAIN ] BANC: Generated 1807 derivative records from 51644 primary records. [2025-09-25T22:16:35.436299] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-25T22:16:35.477519] [DEBUG] [LOCAL ] BANC: Derivative data saved (1807 records). [2025-09-25T22:16:35.477619] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-25T22:16:35.479811] [INFO ] [MAIN ] Derivative Progress: 151/2043 symbols completed. BANC took 1.1s. Estimated remaining: 13m 54s. Rate: 136.2 symbols/min [2025-09-25T22:16:35.480780] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:35.502496] [DEBUG] [LOCAL ] BAM: Derivative data saved (1807 records). [2025-09-25T22:16:35.502633] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-25T22:16:35.505454] [INFO ] [MAIN ] Derivative Progress: 152/2043 symbols completed. BAM took 1.2s. Estimated remaining: 13m 48s. Rate: 137.0 symbols/min [2025-09-25T22:16:35.512076] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:35.551313] [DEBUG] [LOCAL ] BAP: Loaded 26518 existing records from primary storage. [2025-09-25T22:16:35.551474] [INFO ] [MAIN ] BAP: Loaded 26518 primary data records. [2025-09-25T22:16:35.644110] [DEBUG] [LOCAL ] BARK: Loaded 38678 existing records from primary storage. [2025-09-25T22:16:35.644275] [INFO ] [MAIN ] BARK: Loaded 38678 primary data records. [2025-09-25T22:16:36.146581] [DEBUG] [MAIN ] BALL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:36.158396] [INFO ] [MAIN ] BALL: Generated 1807 derivative records from 52197 primary records. [2025-09-25T22:16:36.158503] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-25T22:16:36.206455] [DEBUG] [LOCAL ] BALL: Derivative data saved (1807 records). [2025-09-25T22:16:36.206634] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-25T22:16:36.209728] [INFO ] [MAIN ] Derivative Progress: 153/2043 symbols completed. BALL took 1.9s. Estimated remaining: 13m 51s. Rate: 136.5 symbols/min [2025-09-25T22:16:36.216397] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:36.487918] [DEBUG] [LOCAL ] BB: Loaded 53311 existing records from primary storage. [2025-09-25T22:16:36.488106] [INFO ] [MAIN ] BB: Loaded 53311 primary data records. [2025-09-25T22:16:36.503863] [DEBUG] [MAIN ] BAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:36.504609] [INFO ] [MAIN ] BAP: Generated 1807 derivative records from 26518 primary records. [2025-09-25T22:16:36.504702] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-25T22:16:36.608166] [DEBUG] [LOCAL ] BAP: Derivative data saved (1807 records). [2025-09-25T22:16:36.608315] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-25T22:16:36.610595] [INFO ] [MAIN ] Derivative Progress: 154/2043 symbols completed. BAP took 1.1s. Estimated remaining: 13m 50s. Rate: 136.6 symbols/min [2025-09-25T22:16:36.632028] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:36.713440] [DEBUG] [MAIN ] BARK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:36.751365] [INFO ] [MAIN ] BARK: Generated 1807 derivative records from 38678 primary records. [2025-09-25T22:16:36.903754] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-25T22:16:36.978787] [DEBUG] [LOCAL ] BBAI: Loaded 54210 existing records from primary storage. [2025-09-25T22:16:36.978940] [INFO ] [MAIN ] BBAI: Loaded 54210 primary data records. [2025-09-25T22:16:36.985003] [DEBUG] [LOCAL ] BARK: Derivative data saved (1807 records). [2025-09-25T22:16:36.985070] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-25T22:16:36.987505] [INFO ] [MAIN ] Derivative Progress: 155/2043 symbols completed. BARK took 1.5s. Estimated remaining: 13m 49s. Rate: 136.7 symbols/min [2025-09-25T22:16:36.991937] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:37.009926] [DEBUG] [MAIN ] BB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:37.010712] [INFO ] [MAIN ] BB: Generated 1807 derivative records from 53311 primary records. [2025-09-25T22:16:37.010778] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-25T22:16:37.063537] [DEBUG] [LOCAL ] BB: Derivative data saved (1807 records). [2025-09-25T22:16:37.063702] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-25T22:16:37.066163] [INFO ] [MAIN ] Derivative Progress: 156/2043 symbols completed. BB took 0.8s. Estimated remaining: 13m 44s. Rate: 137.4 symbols/min [2025-09-25T22:16:37.077938] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:37.148095] [DEBUG] [LOCAL ] BBAR: Loaded 41667 existing records from primary storage. [2025-09-25T22:16:37.148257] [INFO ] [MAIN ] BBAR: Loaded 41667 primary data records. [2025-09-25T22:16:37.382300] [DEBUG] [LOCAL ] BBD: Loaded 53571 existing records from primary storage. [2025-09-25T22:16:37.382565] [INFO ] [MAIN ] BBD: Loaded 53571 primary data records. [2025-09-25T22:16:38.059627] [DEBUG] [MAIN ] BBAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:38.060539] [INFO ] [MAIN ] BBAI: Generated 1807 derivative records from 54210 primary records. [2025-09-25T22:16:38.060607] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-25T22:16:38.089291] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1807 records). [2025-09-25T22:16:38.089369] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-25T22:16:38.091578] [INFO ] [MAIN ] Derivative Progress: 157/2043 symbols completed. BBAI took 1.5s. Estimated remaining: 13m 51s. Rate: 136.2 symbols/min [2025-09-25T22:16:38.106564] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:38.119982] [DEBUG] [MAIN ] BBAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:38.169355] [INFO ] [MAIN ] BBAR: Generated 1807 derivative records from 41667 primary records. [2025-09-25T22:16:38.169458] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-25T22:16:38.273763] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1807 records). [2025-09-25T22:16:38.273914] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-25T22:16:38.276435] [INFO ] [MAIN ] Derivative Progress: 158/2043 symbols completed. BBAR took 1.3s. Estimated remaining: 13m 47s. Rate: 136.7 symbols/min [2025-09-25T22:16:38.276726] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:38.289982] [DEBUG] [LOCAL ] BBDO: Loaded 5030 existing records from primary storage. [2025-09-25T22:16:38.290107] [INFO ] [MAIN ] BBDO: Loaded 5030 primary data records. [2025-09-25T22:16:38.419018] [DEBUG] [LOCAL ] BBDC: Loaded 33540 existing records from primary storage. [2025-09-25T22:16:38.419201] [INFO ] [MAIN ] BBDC: Loaded 33540 primary data records. [2025-09-25T22:16:38.450699] [DEBUG] [MAIN ] BBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:38.451310] [INFO ] [MAIN ] BBD: Generated 1807 derivative records from 53571 primary records. [2025-09-25T22:16:38.451371] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-25T22:16:38.553812] [DEBUG] [LOCAL ] BBD: Derivative data saved (1807 records). [2025-09-25T22:16:38.553949] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-25T22:16:38.556248] [INFO ] [MAIN ] Derivative Progress: 159/2043 symbols completed. BBD took 1.5s. Estimated remaining: 13m 45s. Rate: 137.0 symbols/min [2025-09-25T22:16:38.560776] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:38.733855] [DEBUG] [LOCAL ] BBN: Loaded 18100 existing records from primary storage. [2025-09-25T22:16:38.733989] [INFO ] [MAIN ] BBN: Loaded 18100 primary data records. [2025-09-25T22:16:39.287156] [DEBUG] [MAIN ] BBDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:39.288065] [INFO ] [MAIN ] BBDO: Generated 1807 derivative records from 5030 primary records. [2025-09-25T22:16:39.288138] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-25T22:16:39.355396] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1807 records). [2025-09-25T22:16:39.355577] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-25T22:16:39.482635] [DEBUG] [MAIN ] BBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:39.483515] [INFO ] [MAIN ] BBDC: Generated 1807 derivative records from 33540 primary records. [2025-09-25T22:16:39.483583] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-25T22:16:39.360162] [INFO ] [MAIN ] Derivative Progress: 160/2043 symbols completed. BBDO took 1.1s. Estimated remaining: 13m 49s. Rate: 136.3 symbols/min [2025-09-25T22:16:39.510754] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:39.518521] [DEBUG] [LOCAL ] BBU: Loaded 4332 existing records from primary storage. [2025-09-25T22:16:39.520139] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1807 records). [2025-09-25T22:16:39.520285] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-25T22:16:39.522504] [INFO ] [MAIN ] Derivative Progress: 161/2043 symbols completed. BBDC took 1.4s. Estimated remaining: 13m 45s. Rate: 136.9 symbols/min [2025-09-25T22:16:39.522818] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:39.523734] [INFO ] [MAIN ] BBU: Loaded 4332 primary data records. [2025-09-25T22:16:39.597418] [DEBUG] [LOCAL ] BBUC: Loaded 13336 existing records from primary storage. [2025-09-25T22:16:39.597576] [INFO ] [MAIN ] BBUC: Loaded 13336 primary data records. [2025-09-25T22:16:39.616992] [DEBUG] [MAIN ] BBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:39.617888] [INFO ] [MAIN ] BBN: Generated 1807 derivative records from 18100 primary records. [2025-09-25T22:16:39.617956] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-25T22:16:39.718856] [DEBUG] [LOCAL ] BBN: Derivative data saved (1807 records). [2025-09-25T22:16:39.719029] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-25T22:16:39.722193] [INFO ] [MAIN ] Derivative Progress: 162/2043 symbols completed. BBN took 1.2s. Estimated remaining: 13m 42s. Rate: 137.3 symbols/min [2025-09-25T22:16:39.722451] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:40.370875] [DEBUG] [LOCAL ] BBVA: Loaded 49832 existing records from primary storage. [2025-09-25T22:16:40.371071] [INFO ] [MAIN ] BBVA: Loaded 49832 primary data records. [2025-09-25T22:16:40.442384] [DEBUG] [MAIN ] BBU: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:16:40.451275] [INFO ] [MAIN ] BBU: Generated 1806 derivative records from 4332 primary records. [2025-09-25T22:16:40.451346] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-25T22:16:40.498261] [DEBUG] [LOCAL ] BBU: Derivative data saved (1806 records). [2025-09-25T22:16:40.498356] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-25T22:16:40.500847] [INFO ] [MAIN ] Derivative Progress: 163/2043 symbols completed. BBU took 1.0s. Estimated remaining: 13m 45s. Rate: 136.7 symbols/min [2025-09-25T22:16:40.593283] [DEBUG] [MAIN ] BBUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:40.594322] [INFO ] [MAIN ] BBUC: Generated 1807 derivative records from 13336 primary records. [2025-09-25T22:16:40.594394] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-25T22:16:40.637209] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1807 records). [2025-09-25T22:16:40.637444] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-25T22:16:40.640803] [INFO ] [MAIN ] Derivative Progress: 164/2043 symbols completed. BBUC took 1.1s. Estimated remaining: 13m 41s. Rate: 137.2 symbols/min [2025-09-25T22:16:40.840492] [DEBUG] [MAIN ] BBVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:40.841474] [INFO ] [MAIN ] BBVA: Generated 1807 derivative records from 49832 primary records. [2025-09-25T22:16:40.841550] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-25T22:16:40.870306] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1807 records). [2025-09-25T22:16:40.870562] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-25T22:16:40.874757] [INFO ] [MAIN ] Derivative Progress: 165/2043 symbols completed. BBVA took 1.2s. Estimated remaining: 13m 39s. Rate: 137.6 symbols/min [2025-09-25T22:16:40.876060] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:40.879734] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:40.883804] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:40.974288] [DEBUG] [LOCAL ] BBW: Loaded 26921 existing records from primary storage. [2025-09-25T22:16:40.974445] [INFO ] [MAIN ] BBW: Loaded 26921 primary data records. [2025-09-25T22:16:41.032979] [DEBUG] [LOCAL ] BBY: Loaded 53868 existing records from primary storage. [2025-09-25T22:16:41.033188] [INFO ] [MAIN ] BBY: Loaded 53868 primary data records. [2025-09-25T22:16:41.224528] [DEBUG] [LOCAL ] BBWI: Loaded 53970 existing records from primary storage. [2025-09-25T22:16:41.224749] [INFO ] [MAIN ] BBWI: Loaded 53970 primary data records. [2025-09-25T22:16:42.216573] [DEBUG] [MAIN ] BBW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:42.217219] [INFO ] [MAIN ] BBW: Generated 1807 derivative records from 26921 primary records. [2025-09-25T22:16:42.217285] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-25T22:16:42.291629] [DEBUG] [LOCAL ] BBW: Derivative data saved (1807 records). [2025-09-25T22:16:42.291800] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-25T22:16:42.294858] [INFO ] [MAIN ] Derivative Progress: 166/2043 symbols completed. BBW took 1.4s. Estimated remaining: 13m 49s. Rate: 135.8 symbols/min [2025-09-25T22:16:42.301084] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:42.347488] [DEBUG] [MAIN ] BBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:42.349766] [INFO ] [MAIN ] BBY: Generated 1807 derivative records from 53868 primary records. [2025-09-25T22:16:42.349843] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-25T22:16:42.395001] [DEBUG] [LOCAL ] BBY: Derivative data saved (1807 records). [2025-09-25T22:16:42.395122] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-25T22:16:42.398986] [INFO ] [MAIN ] Derivative Progress: 167/2043 symbols completed. BBY took 1.5s. Estimated remaining: 13m 45s. Rate: 136.4 symbols/min [2025-09-25T22:16:42.400479] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:42.487260] [DEBUG] [LOCAL ] BC: Loaded 44723 existing records from primary storage. [2025-09-25T22:16:42.487415] [INFO ] [MAIN ] BC: Loaded 44723 primary data records. [2025-09-25T22:16:42.614003] [DEBUG] [LOCAL ] BCC: Loaded 28556 existing records from primary storage. [2025-09-25T22:16:42.614197] [INFO ] [MAIN ] BCC: Loaded 28556 primary data records. [2025-09-25T22:16:42.868580] [DEBUG] [MAIN ] BBWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:42.878411] [INFO ] [MAIN ] BBWI: Generated 1807 derivative records from 53970 primary records. [2025-09-25T22:16:42.878483] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-25T22:16:42.936779] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1807 records). [2025-09-25T22:16:42.936905] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-25T22:16:42.939286] [INFO ] [MAIN ] Derivative Progress: 168/2043 symbols completed. BBWI took 2.1s. Estimated remaining: 13m 46s. Rate: 136.2 symbols/min [2025-09-25T22:16:42.941380] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:43.398917] [DEBUG] [LOCAL ] BCE: Loaded 52712 existing records from primary storage. [2025-09-25T22:16:43.399095] [INFO ] [MAIN ] BCE: Loaded 52712 primary data records. [2025-09-25T22:16:43.418841] [DEBUG] [MAIN ] BCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:43.419603] [INFO ] [MAIN ] BCC: Generated 1807 derivative records from 28556 primary records. [2025-09-25T22:16:43.444968] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-25T22:16:43.470622] [DEBUG] [LOCAL ] BCC: Derivative data saved (1807 records). [2025-09-25T22:16:43.470803] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-25T22:16:43.473026] [INFO ] [MAIN ] Derivative Progress: 169/2043 symbols completed. BCC took 1.1s. Estimated remaining: 13m 46s. Rate: 136.1 symbols/min [2025-09-25T22:16:43.473241] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:43.523351] [DEBUG] [MAIN ] BC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:43.524271] [INFO ] [MAIN ] BC: Generated 1807 derivative records from 44723 primary records. [2025-09-25T22:16:43.524340] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-25T22:16:43.607855] [DEBUG] [LOCAL ] BC: Derivative data saved (1807 records). [2025-09-25T22:16:43.608022] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-25T22:16:43.611821] [INFO ] [MAIN ] Derivative Progress: 170/2043 symbols completed. BC took 1.3s. Estimated remaining: 13m 43s. Rate: 136.6 symbols/min [2025-09-25T22:16:43.618161] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:43.819950] [DEBUG] [LOCAL ] BCSF: Loaded 28030 existing records from primary storage. [2025-09-25T22:16:43.820119] [INFO ] [MAIN ] BCSF: Loaded 28030 primary data records. [2025-09-25T22:16:43.826818] [DEBUG] [LOCAL ] BCS: Loaded 53855 existing records from primary storage. [2025-09-25T22:16:43.826996] [INFO ] [MAIN ] BCS: Loaded 53855 primary data records. [2025-09-25T22:16:44.056066] [DEBUG] [MAIN ] BCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:44.057035] [INFO ] [MAIN ] BCE: Generated 1807 derivative records from 52712 primary records. [2025-09-25T22:16:44.057099] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-25T22:16:44.120972] [DEBUG] [LOCAL ] BCE: Derivative data saved (1807 records). [2025-09-25T22:16:44.121128] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-25T22:16:44.123792] [INFO ] [MAIN ] Derivative Progress: 171/2043 symbols completed. BCE took 1.2s. Estimated remaining: 13m 43s. Rate: 136.5 symbols/min [2025-09-25T22:16:44.143853] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:44.369356] [DEBUG] [LOCAL ] BDX: Loaded 52828 existing records from primary storage. [2025-09-25T22:16:44.369571] [INFO ] [MAIN ] BDX: Loaded 52828 primary data records. [2025-09-25T22:16:44.754631] [DEBUG] [MAIN ] BCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:44.755486] [INFO ] [MAIN ] BCS: Generated 1807 derivative records from 53855 primary records. [2025-09-25T22:16:44.755563] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-25T22:16:44.816781] [DEBUG] [LOCAL ] BCS: Derivative data saved (1807 records). [2025-09-25T22:16:44.816937] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-25T22:16:44.819752] [INFO ] [MAIN ] Derivative Progress: 172/2043 symbols completed. BCS took 1.3s. Estimated remaining: 13m 45s. Rate: 136.0 symbols/min [2025-09-25T22:16:44.832248] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:44.889865] [DEBUG] [MAIN ] BCSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:44.890621] [INFO ] [MAIN ] BCSF: Generated 1807 derivative records from 28030 primary records. [2025-09-25T22:16:44.890713] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-25T22:16:44.937366] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1807 records). [2025-09-25T22:16:44.937496] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-25T22:16:44.939792] [INFO ] [MAIN ] Derivative Progress: 173/2043 symbols completed. BCSF took 1.3s. Estimated remaining: 13m 41s. Rate: 136.6 symbols/min [2025-09-25T22:16:44.942996] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:45.021485] [DEBUG] [LOCAL ] BE: Loaded 54043 existing records from primary storage. [2025-09-25T22:16:45.021637] [INFO ] [MAIN ] BE: Loaded 54043 primary data records. [2025-09-25T22:16:45.311878] [DEBUG] [LOCAL ] BEKE: Loaded 53637 existing records from primary storage. [2025-09-25T22:16:45.312070] [INFO ] [MAIN ] BEKE: Loaded 53637 primary data records. [2025-09-25T22:16:45.471387] [DEBUG] [MAIN ] BDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:45.472398] [INFO ] [MAIN ] BDX: Generated 1807 derivative records from 52828 primary records. [2025-09-25T22:16:45.472493] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-25T22:16:45.554849] [DEBUG] [LOCAL ] BDX: Derivative data saved (1807 records). [2025-09-25T22:16:45.555010] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-25T22:16:45.627914] [INFO ] [MAIN ] Derivative Progress: 174/2043 symbols completed. BDX took 1.4s. Estimated remaining: 13m 44s. Rate: 136.1 symbols/min [2025-09-25T22:16:45.628485] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:46.113007] [DEBUG] [MAIN ] BE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:46.113705] [INFO ] [MAIN ] BE: Generated 1807 derivative records from 54043 primary records. [2025-09-25T22:16:46.113801] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-25T22:16:46.111620] [DEBUG] [LOCAL ] BEN: Loaded 53445 existing records from primary storage. [2025-09-25T22:16:46.122159] [INFO ] [MAIN ] BEN: Loaded 53445 primary data records. [2025-09-25T22:16:46.167665] [DEBUG] [LOCAL ] BE: Derivative data saved (1807 records). [2025-09-25T22:16:46.167808] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-25T22:16:46.170021] [INFO ] [MAIN ] Derivative Progress: 175/2043 symbols completed. BE took 1.3s. Estimated remaining: 13m 44s. Rate: 136.0 symbols/min [2025-09-25T22:16:46.180278] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:46.183636] [DEBUG] [MAIN ] BEKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:46.184382] [INFO ] [MAIN ] BEKE: Generated 1807 derivative records from 53637 primary records. [2025-09-25T22:16:46.184448] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-25T22:16:46.207208] [DEBUG] [LOCAL ] BEPH: Loaded 5160 existing records from primary storage. [2025-09-25T22:16:46.207332] [INFO ] [MAIN ] BEPH: Loaded 5160 primary data records. [2025-09-25T22:16:46.244285] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1807 records). [2025-09-25T22:16:46.244411] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-25T22:16:46.247223] [INFO ] [MAIN ] Derivative Progress: 176/2043 symbols completed. BEKE took 1.3s. Estimated remaining: 13m 40s. Rate: 136.6 symbols/min [2025-09-25T22:16:46.263032] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:46.295976] [DEBUG] [LOCAL ] BEPI: Loaded 3452 existing records from primary storage. [2025-09-25T22:16:46.296123] [INFO ] [MAIN ] BEPI: Loaded 3452 primary data records. [2025-09-25T22:16:47.251359] [DEBUG] [MAIN ] BEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:47.254022] [INFO ] [MAIN ] BEN: Generated 1807 derivative records from 53445 primary records. [2025-09-25T22:16:47.255853] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-25T22:16:47.289535] [DEBUG] [MAIN ] BEPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:47.292173] [INFO ] [MAIN ] BEPH: Generated 1807 derivative records from 5160 primary records. [2025-09-25T22:16:47.292574] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-25T22:16:47.294770] [DEBUG] [LOCAL ] BEN: Derivative data saved (1807 records). [2025-09-25T22:16:47.307702] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-25T22:16:47.311024] [INFO ] [MAIN ] Derivative Progress: 177/2043 symbols completed. BEN took 1.7s. Estimated remaining: 13m 46s. Rate: 135.5 symbols/min [2025-09-25T22:16:47.312454] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:47.317170] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1807 records). [2025-09-25T22:16:47.318541] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-25T22:16:47.321213] [INFO ] [MAIN ] Derivative Progress: 178/2043 symbols completed. BEPH took 1.1s. Estimated remaining: 13m 41s. Rate: 136.3 symbols/min [2025-09-25T22:16:47.324698] [DEBUG] [LOCAL ] BEPJ: Loaded 3259 existing records from primary storage. [2025-09-25T22:16:47.324870] [INFO ] [MAIN ] BEPJ: Loaded 3259 primary data records. [2025-09-25T22:16:47.455269] [DEBUG] [MAIN ] BEPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:47.456060] [INFO ] [MAIN ] BEPI: Generated 1807 derivative records from 3452 primary records. [2025-09-25T22:16:47.456134] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-25T22:16:47.499355] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1807 records). [2025-09-25T22:16:47.499552] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-25T22:16:47.502143] [INFO ] [MAIN ] Derivative Progress: 179/2043 symbols completed. BEPI took 1.2s. Estimated remaining: 13m 38s. Rate: 136.7 symbols/min [2025-09-25T22:16:47.775749] [DEBUG] [MAIN ] BEPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:47.776473] [INFO ] [MAIN ] BEPJ: Generated 1807 derivative records from 3259 primary records. [2025-09-25T22:16:47.776569] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-25T22:16:47.791892] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1807 records). [2025-09-25T22:16:47.792018] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-25T22:16:47.794348] [INFO ] [MAIN ] Derivative Progress: 180/2043 symbols completed. BEPJ took 0.5s. Estimated remaining: 13m 36s. Rate: 137.0 symbols/min [2025-09-25T22:16:47.794941] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:47.795916] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:47.796733] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:47.868962] [DEBUG] [LOCAL ] BFK: Loaded 14083 existing records from primary storage. [2025-09-25T22:16:47.869251] [INFO ] [MAIN ] BFK: Loaded 14083 primary data records. [2025-09-25T22:16:47.920956] [DEBUG] [LOCAL ] BFLY: Loaded 52211 existing records from primary storage. [2025-09-25T22:16:47.921122] [INFO ] [MAIN ] BFLY: Loaded 52211 primary data records. [2025-09-25T22:16:47.982869] [DEBUG] [LOCAL ] BFH: Loaded 42012 existing records from primary storage. [2025-09-25T22:16:47.983076] [INFO ] [MAIN ] BFH: Loaded 42012 primary data records. [2025-09-25T22:16:48.909413] [DEBUG] [MAIN ] BFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:48.910444] [INFO ] [MAIN ] BFH: Generated 1807 derivative records from 42012 primary records. [2025-09-25T22:16:48.910521] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-25T22:16:48.916010] [DEBUG] [MAIN ] BFLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:48.917041] [INFO ] [MAIN ] BFLY: Generated 1807 derivative records from 52211 primary records. [2025-09-25T22:16:48.917125] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-25T22:16:48.961620] [DEBUG] [LOCAL ] BFH: Derivative data saved (1807 records). [2025-09-25T22:16:48.961788] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-25T22:16:48.972080] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1807 records). [2025-09-25T22:16:48.972238] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-25T22:16:48.965327] [INFO ] [MAIN ] Derivative Progress: 181/2043 symbols completed. BFH took 1.2s. Estimated remaining: 13m 43s. Rate: 135.7 symbols/min [2025-09-25T22:16:48.975135] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:48.980837] [INFO ] [MAIN ] Derivative Progress: 182/2043 symbols completed. BFLY took 1.2s. Estimated remaining: 13m 38s. Rate: 136.4 symbols/min [2025-09-25T22:16:48.981149] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:49.017592] [DEBUG] [LOCAL ] BFS: Loaded 9144 existing records from primary storage. [2025-09-25T22:16:49.017799] [INFO ] [MAIN ] BFS: Loaded 9144 primary data records. [2025-09-25T22:16:49.026917] [DEBUG] [LOCAL ] BFZ: Loaded 12147 existing records from primary storage. [2025-09-25T22:16:49.027058] [INFO ] [MAIN ] BFZ: Loaded 12147 primary data records. [2025-09-25T22:16:49.225540] [DEBUG] [MAIN ] BFK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:49.226472] [INFO ] [MAIN ] BFK: Generated 1807 derivative records from 14083 primary records. [2025-09-25T22:16:49.226599] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-25T22:16:49.331054] [DEBUG] [LOCAL ] BFK: Derivative data saved (1807 records). [2025-09-25T22:16:49.331182] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-25T22:16:49.333440] [INFO ] [MAIN ] Derivative Progress: 183/2043 symbols completed. BFK took 1.5s. Estimated remaining: 13m 37s. Rate: 136.6 symbols/min [2025-09-25T22:16:49.340998] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:49.537185] [DEBUG] [LOCAL ] BG: Loaded 50757 existing records from primary storage. [2025-09-25T22:16:49.537351] [INFO ] [MAIN ] BG: Loaded 50757 primary data records. [2025-09-25T22:16:50.183336] [DEBUG] [MAIN ] BFZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:50.184285] [INFO ] [MAIN ] BFZ: Generated 1807 derivative records from 12147 primary records. [2025-09-25T22:16:50.184362] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-25T22:16:50.222051] [DEBUG] [MAIN ] BFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:50.222888] [INFO ] [MAIN ] BFS: Generated 1807 derivative records from 9144 primary records. [2025-09-25T22:16:50.222954] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-25T22:16:50.245190] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1807 records). [2025-09-25T22:16:50.245320] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-25T22:16:50.248759] [INFO ] [MAIN ] Derivative Progress: 184/2043 symbols completed. BFZ took 1.3s. Estimated remaining: 13m 41s. Rate: 135.8 symbols/min [2025-09-25T22:16:50.254949] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:50.270746] [DEBUG] [LOCAL ] BFS: Derivative data saved (1807 records). [2025-09-25T22:16:50.270865] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-25T22:16:50.273839] [INFO ] [MAIN ] Derivative Progress: 185/2043 symbols completed. BFS took 1.3s. Estimated remaining: 13m 37s. Rate: 136.5 symbols/min [2025-09-25T22:16:50.282313] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:50.305693] [DEBUG] [LOCAL ] BGB: Loaded 17478 existing records from primary storage. [2025-09-25T22:16:50.305850] [INFO ] [MAIN ] BGB: Loaded 17478 primary data records. [2025-09-25T22:16:50.327636] [DEBUG] [LOCAL ] BGH: Loaded 16544 existing records from primary storage. [2025-09-25T22:16:50.327774] [INFO ] [MAIN ] BGH: Loaded 16544 primary data records. [2025-09-25T22:16:51.010913] [DEBUG] [MAIN ] BG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:51.011878] [INFO ] [MAIN ] BG: Generated 1807 derivative records from 50757 primary records. [2025-09-25T22:16:51.011965] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-25T22:16:51.078283] [DEBUG] [LOCAL ] BG: Derivative data saved (1807 records). [2025-09-25T22:16:51.078403] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-25T22:16:51.081569] [INFO ] [MAIN ] Derivative Progress: 186/2043 symbols completed. BG took 1.7s. Estimated remaining: 13m 40s. Rate: 135.9 symbols/min [2025-09-25T22:16:51.098102] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:51.117057] [DEBUG] [MAIN ] BGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:51.117741] [INFO ] [MAIN ] BGH: Generated 1807 derivative records from 16544 primary records. [2025-09-25T22:16:51.117805] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-25T22:16:51.147525] [DEBUG] [LOCAL ] BGH: Derivative data saved (1807 records). [2025-09-25T22:16:51.147672] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-25T22:16:51.150072] [INFO ] [MAIN ] Derivative Progress: 187/2043 symbols completed. BGH took 0.9s. Estimated remaining: 13m 36s. Rate: 136.5 symbols/min [2025-09-25T22:16:51.153475] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:51.167157] [DEBUG] [LOCAL ] BGR: Loaded 13568 existing records from primary storage. [2025-09-25T22:16:51.167297] [INFO ] [MAIN ] BGR: Loaded 13568 primary data records. [2025-09-25T22:16:51.293794] [DEBUG] [LOCAL ] BGS: Loaded 50823 existing records from primary storage. [2025-09-25T22:16:51.293960] [INFO ] [MAIN ] BGS: Loaded 50823 primary data records. [2025-09-25T22:16:51.326832] [DEBUG] [MAIN ] BGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:51.327515] [INFO ] [MAIN ] BGB: Generated 1807 derivative records from 17478 primary records. [2025-09-25T22:16:51.327578] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-25T22:16:51.409863] [DEBUG] [LOCAL ] BGB: Derivative data saved (1807 records). [2025-09-25T22:16:51.410075] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-25T22:16:51.413057] [INFO ] [MAIN ] Derivative Progress: 188/2043 symbols completed. BGB took 1.2s. Estimated remaining: 13m 34s. Rate: 136.8 symbols/min [2025-09-25T22:16:51.441290] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:51.503946] [DEBUG] [LOCAL ] BGX: Loaded 10782 existing records from primary storage. [2025-09-25T22:16:51.504079] [INFO ] [MAIN ] BGX: Loaded 10782 primary data records. [2025-09-25T22:16:52.378925] [DEBUG] [MAIN ] BGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:52.379588] [INFO ] [MAIN ] BGS: Generated 1807 derivative records from 50823 primary records. [2025-09-25T22:16:52.379673] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-25T22:16:52.390318] [DEBUG] [MAIN ] BGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:52.390883] [INFO ] [MAIN ] BGR: Generated 1807 derivative records from 13568 primary records. [2025-09-25T22:16:52.390944] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-25T22:16:52.465470] [DEBUG] [LOCAL ] BGS: Derivative data saved (1807 records). [2025-09-25T22:16:52.465618] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-25T22:16:52.471986] [INFO ] [MAIN ] Derivative Progress: 189/2043 symbols completed. BGS took 1.3s. Estimated remaining: 13m 39s. Rate: 135.8 symbols/min [2025-09-25T22:16:52.477945] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:52.480964] [DEBUG] [LOCAL ] BGR: Derivative data saved (1807 records). [2025-09-25T22:16:52.481074] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-25T22:16:52.483744] [INFO ] [MAIN ] Derivative Progress: 190/2043 symbols completed. BGR took 1.4s. Estimated remaining: 13m 35s. Rate: 136.5 symbols/min [2025-09-25T22:16:52.489964] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:52.541819] [DEBUG] [LOCAL ] BGY: Loaded 22657 existing records from primary storage. [2025-09-25T22:16:52.541974] [INFO ] [MAIN ] BGY: Loaded 22657 primary data records. [2025-09-25T22:16:52.551732] [DEBUG] [LOCAL ] BH: Loaded 15800 existing records from primary storage. [2025-09-25T22:16:52.551924] [INFO ] [MAIN ] BH: Loaded 15800 primary data records. [2025-09-25T22:16:52.564695] [DEBUG] [MAIN ] BGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:52.565327] [INFO ] [MAIN ] BGX: Generated 1807 derivative records from 10782 primary records. [2025-09-25T22:16:52.565390] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-25T22:16:52.621616] [DEBUG] [LOCAL ] BGX: Derivative data saved (1807 records). [2025-09-25T22:16:52.621804] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-25T22:16:52.626060] [INFO ] [MAIN ] Derivative Progress: 191/2043 symbols completed. BGX took 1.2s. Estimated remaining: 13m 31s. Rate: 136.9 symbols/min [2025-09-25T22:16:52.642111] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:52.825874] [DEBUG] [LOCAL ] BHC: Loaded 47170 existing records from primary storage. [2025-09-25T22:16:52.826030] [INFO ] [MAIN ] BHC: Loaded 47170 primary data records. [2025-09-25T22:16:53.461152] [DEBUG] [MAIN ] BGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:53.462152] [INFO ] [MAIN ] BGY: Generated 1807 derivative records from 22657 primary records. [2025-09-25T22:16:53.462226] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-25T22:16:53.506426] [DEBUG] [LOCAL ] BGY: Derivative data saved (1807 records). [2025-09-25T22:16:53.506613] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-25T22:16:53.522053] [INFO ] [MAIN ] Derivative Progress: 192/2043 symbols completed. BGY took 1.0s. Estimated remaining: 13m 35s. Rate: 136.2 symbols/min [2025-09-25T22:16:53.532814] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:53.600954] [DEBUG] [LOCAL ] BHE: Loaded 25227 existing records from primary storage. [2025-09-25T22:16:53.601119] [INFO ] [MAIN ] BHE: Loaded 25227 primary data records. [2025-09-25T22:16:53.670179] [DEBUG] [MAIN ] BH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:53.670995] [INFO ] [MAIN ] BH: Generated 1807 derivative records from 15800 primary records. [2025-09-25T22:16:53.671066] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-25T22:16:53.731736] [DEBUG] [LOCAL ] BH: Derivative data saved (1807 records). [2025-09-25T22:16:53.731856] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-25T22:16:53.734312] [INFO ] [MAIN ] Derivative Progress: 193/2043 symbols completed. BH took 1.2s. Estimated remaining: 13m 33s. Rate: 136.6 symbols/min [2025-09-25T22:16:54.041303] [DEBUG] [MAIN ] BHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:54.042116] [INFO ] [MAIN ] BHC: Generated 1807 derivative records from 47170 primary records. [2025-09-25T22:16:54.042183] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-25T22:16:54.240602] [DEBUG] [LOCAL ] BHC: Derivative data saved (1807 records). [2025-09-25T22:16:54.240850] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-25T22:16:54.243717] [INFO ] [MAIN ] Derivative Progress: 194/2043 symbols completed. BHC took 1.6s. Estimated remaining: 13m 33s. Rate: 136.5 symbols/min [2025-09-25T22:16:54.270068] [DEBUG] [MAIN ] BHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:54.270826] [INFO ] [MAIN ] BHE: Generated 1807 derivative records from 25227 primary records. [2025-09-25T22:16:54.271019] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-25T22:16:54.287591] [DEBUG] [LOCAL ] BHE: Derivative data saved (1807 records). [2025-09-25T22:16:54.287707] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-25T22:16:54.290126] [INFO ] [MAIN ] Derivative Progress: 195/2043 symbols completed. BHE took 0.8s. Estimated remaining: 13m 29s. Rate: 137.1 symbols/min [2025-09-25T22:16:54.291055] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:54.291910] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:54.292830] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:54.321398] [DEBUG] [LOCAL ] BHR: Loaded 21634 existing records from primary storage. [2025-09-25T22:16:54.321547] [INFO ] [MAIN ] BHR: Loaded 21634 primary data records. [2025-09-25T22:16:54.397848] [DEBUG] [LOCAL ] BHK: Loaded 22729 existing records from primary storage. [2025-09-25T22:16:54.398038] [INFO ] [MAIN ] BHK: Loaded 22729 primary data records. [2025-09-25T22:16:54.441280] [DEBUG] [LOCAL ] BHP: Loaded 53763 existing records from primary storage. [2025-09-25T22:16:54.441438] [INFO ] [MAIN ] BHP: Loaded 53763 primary data records. [2025-09-25T22:16:55.366697] [DEBUG] [MAIN ] BHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:55.367568] [INFO ] [MAIN ] BHR: Generated 1807 derivative records from 21634 primary records. [2025-09-25T22:16:55.367638] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-25T22:16:55.369378] [DEBUG] [MAIN ] BHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:55.369935] [INFO ] [MAIN ] BHK: Generated 1807 derivative records from 22729 primary records. [2025-09-25T22:16:55.369996] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-25T22:16:55.415837] [DEBUG] [LOCAL ] BHR: Derivative data saved (1807 records). [2025-09-25T22:16:55.415972] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-25T22:16:55.422356] [DEBUG] [LOCAL ] BHK: Derivative data saved (1807 records). [2025-09-25T22:16:55.422456] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-25T22:16:55.418757] [INFO ] [MAIN ] Derivative Progress: 196/2043 symbols completed. BHR took 1.1s. Estimated remaining: 13m 35s. Rate: 136.0 symbols/min [2025-09-25T22:16:55.425660] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:55.432010] [INFO ] [MAIN ] Derivative Progress: 197/2043 symbols completed. BHK took 1.1s. Estimated remaining: 13m 30s. Rate: 136.7 symbols/min [2025-09-25T22:16:55.432307] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:55.572750] [DEBUG] [LOCAL ] BHVN: Loaded 50018 existing records from primary storage. [2025-09-25T22:16:55.572939] [INFO ] [MAIN ] BHVN: Loaded 50018 primary data records. [2025-09-25T22:16:55.620285] [DEBUG] [LOCAL ] BILL: Loaded 52715 existing records from primary storage. [2025-09-25T22:16:55.620430] [INFO ] [MAIN ] BILL: Loaded 52715 primary data records. [2025-09-25T22:16:55.767506] [DEBUG] [MAIN ] BHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:55.768198] [INFO ] [MAIN ] BHP: Generated 1807 derivative records from 53763 primary records. [2025-09-25T22:16:55.768263] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-25T22:16:55.820755] [DEBUG] [LOCAL ] BHP: Derivative data saved (1807 records). [2025-09-25T22:16:55.820935] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-25T22:16:55.824251] [INFO ] [MAIN ] Derivative Progress: 198/2043 symbols completed. BHP took 1.5s. Estimated remaining: 13m 30s. Rate: 136.7 symbols/min [2025-09-25T22:16:55.838873] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:56.001714] [DEBUG] [LOCAL ] BIO: Loaded 25432 existing records from primary storage. [2025-09-25T22:16:56.001905] [INFO ] [MAIN ] BIO: Loaded 25432 primary data records. [2025-09-25T22:16:56.610327] [DEBUG] [MAIN ] BHVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:56.611190] [INFO ] [MAIN ] BHVN: Generated 1807 derivative records from 50018 primary records. [2025-09-25T22:16:56.611257] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-25T22:16:56.716566] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1807 records). [2025-09-25T22:16:56.716720] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-25T22:16:56.719214] [INFO ] [MAIN ] Derivative Progress: 199/2043 symbols completed. BHVN took 1.3s. Estimated remaining: 13m 33s. Rate: 136.0 symbols/min [2025-09-25T22:16:56.723678] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:56.864021] [DEBUG] [LOCAL ] BIP: Loaded 39863 existing records from primary storage. [2025-09-25T22:16:56.864177] [INFO ] [MAIN ] BIP: Loaded 39863 primary data records. [2025-09-25T22:16:56.870579] [DEBUG] [MAIN ] BILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:56.871261] [INFO ] [MAIN ] BILL: Generated 1807 derivative records from 52715 primary records. [2025-09-25T22:16:56.871331] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-25T22:16:56.943281] [DEBUG] [LOCAL ] BILL: Derivative data saved (1807 records). [2025-09-25T22:16:56.943404] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-25T22:16:56.946132] [INFO ] [MAIN ] Derivative Progress: 200/2043 symbols completed. BILL took 1.5s. Estimated remaining: 13m 31s. Rate: 136.4 symbols/min [2025-09-25T22:16:56.954460] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:57.078705] [DEBUG] [LOCAL ] BIPC: Loaded 42014 existing records from primary storage. [2025-09-25T22:16:57.078867] [INFO ] [MAIN ] BIPC: Loaded 42014 primary data records. [2025-09-25T22:16:57.824556] [DEBUG] [MAIN ] BIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:57.828908] [INFO ] [MAIN ] BIO: Generated 1807 derivative records from 25432 primary records. [2025-09-25T22:16:57.828992] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-25T22:16:57.858043] [DEBUG] [MAIN ] BIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:57.858794] [INFO ] [MAIN ] BIP: Generated 1807 derivative records from 39863 primary records. [2025-09-25T22:16:57.858859] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-25T22:16:57.889216] [DEBUG] [LOCAL ] BIO: Derivative data saved (1807 records). [2025-09-25T22:16:57.889333] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-25T22:16:57.891760] [INFO ] [MAIN ] Derivative Progress: 201/2043 symbols completed. BIO took 2.1s. Estimated remaining: 13m 35s. Rate: 135.6 symbols/min [2025-09-25T22:16:57.892008] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:57.895722] [DEBUG] [MAIN ] BIPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:57.896391] [INFO ] [MAIN ] BIPC: Generated 1807 derivative records from 42014 primary records. [2025-09-25T22:16:57.896452] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-25T22:16:57.911079] [DEBUG] [LOCAL ] BIPH: Loaded 2608 existing records from primary storage. [2025-09-25T22:16:57.911154] [INFO ] [MAIN ] BIPH: Loaded 2608 primary data records. [2025-09-25T22:16:57.923880] [DEBUG] [LOCAL ] BIP: Derivative data saved (1807 records). [2025-09-25T22:16:57.923950] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-25T22:16:57.931683] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1807 records). [2025-09-25T22:16:57.931788] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-25T22:16:57.926440] [INFO ] [MAIN ] Derivative Progress: 202/2043 symbols completed. BIP took 1.2s. Estimated remaining: 13m 31s. Rate: 136.2 symbols/min [2025-09-25T22:16:57.934493] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:57.948864] [DEBUG] [LOCAL ] BIPI: Loaded 3269 existing records from primary storage. [2025-09-25T22:16:57.948968] [INFO ] [MAIN ] BIPI: Loaded 3269 primary data records. [2025-09-25T22:16:57.961795] [INFO ] [MAIN ] Derivative Progress: 203/2043 symbols completed. BIPC took 1.0s. Estimated remaining: 13m 27s. Rate: 136.8 symbols/min [2025-09-25T22:16:57.970771] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:57.984191] [DEBUG] [LOCAL ] BIPJ: Loaded 3002 existing records from primary storage. [2025-09-25T22:16:57.984310] [INFO ] [MAIN ] BIPJ: Loaded 3002 primary data records. [2025-09-25T22:16:58.973446] [DEBUG] [MAIN ] BIPJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:58.974305] [INFO ] [MAIN ] BIPJ: Generated 1807 derivative records from 3002 primary records. [2025-09-25T22:16:58.974372] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-25T22:16:59.010865] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1807 records). [2025-09-25T22:16:59.011014] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-25T22:16:59.031451] [DEBUG] [MAIN ] BIPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:59.032178] [INFO ] [MAIN ] BIPI: Generated 1807 derivative records from 3269 primary records. [2025-09-25T22:16:59.032242] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-25T22:16:59.014322] [INFO ] [MAIN ] Derivative Progress: 204/2043 symbols completed. BIPJ took 1.0s. Estimated remaining: 13m 32s. Rate: 135.9 symbols/min [2025-09-25T22:16:59.067136] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:59.070982] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1807 records). [2025-09-25T22:16:59.071080] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-25T22:16:59.074286] [INFO ] [MAIN ] Derivative Progress: 205/2043 symbols completed. BIPI took 1.1s. Estimated remaining: 13m 28s. Rate: 136.5 symbols/min [2025-09-25T22:16:59.074486] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:59.119523] [DEBUG] [LOCAL ] BIT: Loaded 22535 existing records from primary storage. [2025-09-25T22:16:59.119708] [INFO ] [MAIN ] BIT: Loaded 22535 primary data records. [2025-09-25T22:16:59.144268] [DEBUG] [MAIN ] BIPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:16:59.145006] [INFO ] [MAIN ] BIPH: Generated 1807 derivative records from 2608 primary records. [2025-09-25T22:16:59.145072] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-25T22:16:59.185466] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1807 records). [2025-09-25T22:16:59.185582] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-25T22:16:59.188006] [INFO ] [MAIN ] Derivative Progress: 206/2043 symbols completed. BIPH took 1.3s. Estimated remaining: 13m 25s. Rate: 137.0 symbols/min [2025-09-25T22:16:59.212038] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:16:59.216375] [DEBUG] [LOCAL ] BIRK: Loaded 51295 existing records from primary storage. [2025-09-25T22:16:59.216481] [INFO ] [MAIN ] BIRK: Loaded 51295 primary data records. [2025-09-25T22:16:59.402597] [DEBUG] [LOCAL ] BJ: Loaded 51779 existing records from primary storage. [2025-09-25T22:16:59.413868] [INFO ] [MAIN ] BJ: Loaded 51779 primary data records. [2025-09-25T22:17:00.133456] [DEBUG] [MAIN ] BIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:00.134429] [INFO ] [MAIN ] BIT: Generated 1807 derivative records from 22535 primary records. [2025-09-25T22:17:00.134500] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-25T22:17:00.185119] [DEBUG] [LOCAL ] BIT: Derivative data saved (1807 records). [2025-09-25T22:17:00.185233] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-25T22:17:00.187900] [INFO ] [MAIN ] Derivative Progress: 207/2043 symbols completed. BIT took 1.1s. Estimated remaining: 13m 29s. Rate: 136.1 symbols/min [2025-09-25T22:17:00.192340] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:00.209932] [DEBUG] [MAIN ] BIRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:00.210624] [INFO ] [MAIN ] BIRK: Generated 1807 derivative records from 51295 primary records. [2025-09-25T22:17:00.210713] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-25T22:17:00.246072] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1807 records). [2025-09-25T22:17:00.246191] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-25T22:17:00.248677] [INFO ] [MAIN ] Derivative Progress: 208/2043 symbols completed. BIRK took 1.2s. Estimated remaining: 13m 26s. Rate: 136.7 symbols/min [2025-09-25T22:17:00.310145] [DEBUG] [LOCAL ] BK: Loaded 53936 existing records from primary storage. [2025-09-25T22:17:00.310291] [INFO ] [MAIN ] BK: Loaded 53936 primary data records. [2025-09-25T22:17:00.593474] [DEBUG] [MAIN ] BJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:00.594157] [INFO ] [MAIN ] BJ: Generated 1807 derivative records from 51779 primary records. [2025-09-25T22:17:00.594222] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-25T22:17:00.614415] [DEBUG] [LOCAL ] BJ: Derivative data saved (1807 records). [2025-09-25T22:17:00.614492] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-25T22:17:00.617002] [INFO ] [MAIN ] Derivative Progress: 209/2043 symbols completed. BJ took 1.4s. Estimated remaining: 13m 24s. Rate: 136.8 symbols/min [2025-09-25T22:17:00.770762] [DEBUG] [MAIN ] BK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:00.771462] [INFO ] [MAIN ] BK: Generated 1807 derivative records from 53936 primary records. [2025-09-25T22:17:00.771526] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-25T22:17:00.789217] [DEBUG] [LOCAL ] BK: Derivative data saved (1807 records). [2025-09-25T22:17:00.789278] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-25T22:17:00.791555] [INFO ] [MAIN ] Derivative Progress: 210/2043 symbols completed. BK took 0.6s. Estimated remaining: 13m 22s. Rate: 137.2 symbols/min [2025-09-25T22:17:00.792054] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:00.795122] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:00.796728] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:00.851390] [DEBUG] [LOCAL ] BKH: Loaded 36896 existing records from primary storage. [2025-09-25T22:17:00.851548] [INFO ] [MAIN ] BKH: Loaded 36896 primary data records. [2025-09-25T22:17:00.969793] [DEBUG] [LOCAL ] BKE: Loaded 34985 existing records from primary storage. [2025-09-25T22:17:00.969957] [INFO ] [MAIN ] BKE: Loaded 34985 primary data records. [2025-09-25T22:17:01.072591] [DEBUG] [LOCAL ] BKD: Loaded 50514 existing records from primary storage. [2025-09-25T22:17:01.097713] [INFO ] [MAIN ] BKD: Loaded 50514 primary data records. [2025-09-25T22:17:01.944234] [DEBUG] [MAIN ] BKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:01.945009] [INFO ] [MAIN ] BKH: Generated 1807 derivative records from 36896 primary records. [2025-09-25T22:17:01.945118] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-25T22:17:01.946378] [DEBUG] [MAIN ] BKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:01.946965] [INFO ] [MAIN ] BKE: Generated 1807 derivative records from 34985 primary records. [2025-09-25T22:17:01.947025] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-25T22:17:01.990524] [DEBUG] [LOCAL ] BKH: Derivative data saved (1807 records). [2025-09-25T22:17:01.992988] [DEBUG] [LOCAL ] BKE: Derivative data saved (1807 records). [2025-09-25T22:17:01.993063] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-25T22:17:02.000323] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-25T22:17:01.996734] [INFO ] [MAIN ] Derivative Progress: 211/2043 symbols completed. BKE took 1.2s. Estimated remaining: 13m 28s. Rate: 136.1 symbols/min [2025-09-25T22:17:02.003390] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:02.006688] [INFO ] [MAIN ] Derivative Progress: 212/2043 symbols completed. BKH took 1.2s. Estimated remaining: 13m 24s. Rate: 136.7 symbols/min [2025-09-25T22:17:02.006838] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:02.039141] [DEBUG] [LOCAL ] BKN: Loaded 7820 existing records from primary storage. [2025-09-25T22:17:02.039281] [INFO ] [MAIN ] BKN: Loaded 7820 primary data records. [2025-09-25T22:17:02.127179] [DEBUG] [LOCAL ] BKKT: Loaded 34785 existing records from primary storage. [2025-09-25T22:17:02.127495] [INFO ] [MAIN ] BKKT: Loaded 34785 primary data records. [2025-09-25T22:17:02.389616] [DEBUG] [MAIN ] BKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:02.390346] [INFO ] [MAIN ] BKD: Generated 1807 derivative records from 50514 primary records. [2025-09-25T22:17:02.390600] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-25T22:17:02.461159] [DEBUG] [LOCAL ] BKD: Derivative data saved (1807 records). [2025-09-25T22:17:02.461288] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-25T22:17:02.464334] [INFO ] [MAIN ] Derivative Progress: 213/2043 symbols completed. BKD took 1.7s. Estimated remaining: 13m 23s. Rate: 136.7 symbols/min [2025-09-25T22:17:02.490918] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:02.928240] [DEBUG] [MAIN ] BKN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:02.929116] [INFO ] [MAIN ] BKN: Generated 1807 derivative records from 7820 primary records. [2025-09-25T22:17:02.929181] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-25T22:17:02.927942] [DEBUG] [MAIN ] BKKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:02.930292] [INFO ] [MAIN ] BKKT: Generated 1807 derivative records from 34785 primary records. [2025-09-25T22:17:02.930356] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-25T22:17:02.982606] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1807 records). [2025-09-25T22:17:02.983747] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-25T22:17:02.986247] [INFO ] [MAIN ] Derivative Progress: 214/2043 symbols completed. BKKT took 1.0s. Estimated remaining: 13m 24s. Rate: 136.5 symbols/min [2025-09-25T22:17:02.986458] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:03.000081] [DEBUG] [LOCAL ] BKT: Loaded 11032 existing records from primary storage. [2025-09-25T22:17:03.000227] [INFO ] [MAIN ] BKT: Loaded 11032 primary data records. [2025-09-25T22:17:03.019192] [DEBUG] [LOCAL ] BKN: Derivative data saved (1807 records). [2025-09-25T22:17:03.019356] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-25T22:17:03.030513] [DEBUG] [LOCAL ] BKSY: Loaded 48651 existing records from primary storage. [2025-09-25T22:17:03.021825] [INFO ] [MAIN ] Derivative Progress: 215/2043 symbols completed. BKN took 1.0s. Estimated remaining: 13m 20s. Rate: 137.1 symbols/min [2025-09-25T22:17:03.030893] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:03.038267] [INFO ] [MAIN ] BKSY: Loaded 48651 primary data records. [2025-09-25T22:17:03.173028] [DEBUG] [LOCAL ] BKU: Loaded 42162 existing records from primary storage. [2025-09-25T22:17:03.173235] [INFO ] [MAIN ] BKU: Loaded 42162 primary data records. [2025-09-25T22:17:04.071172] [DEBUG] [MAIN ] BKSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:04.071908] [INFO ] [MAIN ] BKSY: Generated 1807 derivative records from 48651 primary records. [2025-09-25T22:17:04.071974] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-25T22:17:04.081910] [DEBUG] [MAIN ] BKU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:04.082715] [INFO ] [MAIN ] BKU: Generated 1807 derivative records from 42162 primary records. [2025-09-25T22:17:04.082783] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-25T22:17:04.126814] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1807 records). [2025-09-25T22:17:04.126944] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-25T22:17:04.131752] [INFO ] [MAIN ] Derivative Progress: 216/2043 symbols completed. BKSY took 1.6s. Estimated remaining: 13m 25s. Rate: 136.2 symbols/min [2025-09-25T22:17:04.137902] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:04.145911] [DEBUG] [LOCAL ] BKU: Derivative data saved (1807 records). [2025-09-25T22:17:04.146043] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-25T22:17:04.151743] [INFO ] [MAIN ] Derivative Progress: 217/2043 symbols completed. BKU took 1.1s. Estimated remaining: 13m 21s. Rate: 136.8 symbols/min [2025-09-25T22:17:04.157923] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:04.188192] [DEBUG] [MAIN ] BKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:04.188961] [INFO ] [MAIN ] BKT: Generated 1807 derivative records from 11032 primary records. [2025-09-25T22:17:04.189027] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-25T22:17:04.233040] [DEBUG] [LOCAL ] BKV: Loaded 29986 existing records from primary storage. [2025-09-25T22:17:04.233210] [INFO ] [MAIN ] BKV: Loaded 29986 primary data records. [2025-09-25T22:17:04.247604] [DEBUG] [LOCAL ] BKT: Derivative data saved (1807 records). [2025-09-25T22:17:04.247775] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-25T22:17:04.250433] [INFO ] [MAIN ] Derivative Progress: 218/2043 symbols completed. BKT took 1.3s. Estimated remaining: 13m 18s. Rate: 137.2 symbols/min [2025-09-25T22:17:04.256036] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:04.278185] [DEBUG] [LOCAL ] BLCO: Loaded 35907 existing records from primary storage. [2025-09-25T22:17:04.278338] [INFO ] [MAIN ] BLCO: Loaded 35907 primary data records. [2025-09-25T22:17:04.359255] [DEBUG] [LOCAL ] BLD: Loaded 28248 existing records from primary storage. [2025-09-25T22:17:04.359405] [INFO ] [MAIN ] BLD: Loaded 28248 primary data records. [2025-09-25T22:17:05.177492] [DEBUG] [MAIN ] BKV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:05.178218] [INFO ] [MAIN ] BKV: Generated 1807 derivative records from 29986 primary records. [2025-09-25T22:17:05.178283] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-25T22:17:05.218775] [DEBUG] [MAIN ] BLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:05.219488] [INFO ] [MAIN ] BLCO: Generated 1807 derivative records from 35907 primary records. [2025-09-25T22:17:05.219579] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-25T22:17:05.235945] [DEBUG] [LOCAL ] BKV: Derivative data saved (1807 records). [2025-09-25T22:17:05.239567] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-25T22:17:05.256848] [INFO ] [MAIN ] Derivative Progress: 219/2043 symbols completed. BKV took 1.1s. Estimated remaining: 13m 22s. Rate: 136.4 symbols/min [2025-09-25T22:17:05.374011] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:05.390795] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1807 records). [2025-09-25T22:17:05.390936] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-25T22:17:05.393435] [INFO ] [MAIN ] Derivative Progress: 220/2043 symbols completed. BLCO took 1.2s. Estimated remaining: 13m 19s. Rate: 136.9 symbols/min [2025-09-25T22:17:05.395333] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:05.423528] [DEBUG] [MAIN ] BLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:05.424256] [INFO ] [MAIN ] BLD: Generated 1807 derivative records from 28248 primary records. [2025-09-25T22:17:05.424322] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-25T22:17:05.446398] [DEBUG] [LOCAL ] BLD: Derivative data saved (1807 records). [2025-09-25T22:17:05.446543] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-25T22:17:05.449255] [INFO ] [MAIN ] Derivative Progress: 221/2043 symbols completed. BLD took 1.2s. Estimated remaining: 13m 16s. Rate: 137.4 symbols/min [2025-09-25T22:17:05.449471] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:05.475039] [DEBUG] [LOCAL ] BLE: Loaded 14657 existing records from primary storage. [2025-09-25T22:17:05.475212] [INFO ] [MAIN ] BLE: Loaded 14657 primary data records. [2025-09-25T22:17:05.534905] [DEBUG] [LOCAL ] BLDR: Loaded 52046 existing records from primary storage. [2025-09-25T22:17:05.535067] [INFO ] [MAIN ] BLDR: Loaded 52046 primary data records. [2025-09-25T22:17:05.621587] [DEBUG] [LOCAL ] BLK: Loaded 35037 existing records from primary storage. [2025-09-25T22:17:05.621768] [INFO ] [MAIN ] BLK: Loaded 35037 primary data records. [2025-09-25T22:17:06.620700] [DEBUG] [MAIN ] BLDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:06.621436] [INFO ] [MAIN ] BLDR: Generated 1807 derivative records from 52046 primary records. [2025-09-25T22:17:06.621505] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-25T22:17:06.648632] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1807 records). [2025-09-25T22:17:06.648784] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-25T22:17:06.651322] [INFO ] [MAIN ] Derivative Progress: 222/2043 symbols completed. BLDR took 1.3s. Estimated remaining: 13m 21s. Rate: 136.3 symbols/min [2025-09-25T22:17:06.654111] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:06.688805] [DEBUG] [MAIN ] BLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:06.689521] [INFO ] [MAIN ] BLE: Generated 1807 derivative records from 14657 primary records. [2025-09-25T22:17:06.689587] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-25T22:17:06.721689] [DEBUG] [LOCAL ] BLE: Derivative data saved (1807 records). [2025-09-25T22:17:06.727980] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-25T22:17:06.730758] [INFO ] [MAIN ] Derivative Progress: 223/2043 symbols completed. BLE took 1.3s. Estimated remaining: 13m 18s. Rate: 136.8 symbols/min [2025-09-25T22:17:06.839139] [DEBUG] [LOCAL ] BLND: Loaded 49802 existing records from primary storage. [2025-09-25T22:17:06.839314] [INFO ] [MAIN ] BLND: Loaded 49802 primary data records. [2025-09-25T22:17:06.881514] [DEBUG] [MAIN ] BLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:06.882385] [INFO ] [MAIN ] BLK: Generated 1807 derivative records from 35037 primary records. [2025-09-25T22:17:06.882449] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-25T22:17:06.922276] [DEBUG] [LOCAL ] BLK: Derivative data saved (1807 records). [2025-09-25T22:17:06.922409] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-25T22:17:06.925083] [INFO ] [MAIN ] Derivative Progress: 224/2043 symbols completed. BLK took 1.5s. Estimated remaining: 13m 16s. Rate: 137.2 symbols/min [2025-09-25T22:17:07.210799] [DEBUG] [MAIN ] BLND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:07.211459] [INFO ] [MAIN ] BLND: Generated 1807 derivative records from 49802 primary records. [2025-09-25T22:17:07.211522] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-25T22:17:07.228315] [DEBUG] [LOCAL ] BLND: Derivative data saved (1807 records). [2025-09-25T22:17:07.228412] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-25T22:17:07.231381] [INFO ] [MAIN ] Derivative Progress: 225/2043 symbols completed. BLND took 0.6s. Estimated remaining: 13m 14s. Rate: 137.4 symbols/min [2025-09-25T22:17:07.231904] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:07.235747] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:07.236375] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:07.249112] [DEBUG] [LOCAL ] BME: Loaded 10912 existing records from primary storage. [2025-09-25T22:17:07.249272] [INFO ] [MAIN ] BME: Loaded 10912 primary data records. [2025-09-25T22:17:07.284384] [DEBUG] [LOCAL ] BLW: Loaded 12881 existing records from primary storage. [2025-09-25T22:17:07.284534] [INFO ] [MAIN ] BLW: Loaded 12881 primary data records. [2025-09-25T22:17:07.374688] [DEBUG] [LOCAL ] BMA: Loaded 35339 existing records from primary storage. [2025-09-25T22:17:07.374840] [INFO ] [MAIN ] BMA: Loaded 35339 primary data records. [2025-09-25T22:17:08.229074] [DEBUG] [MAIN ] BME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:08.229788] [INFO ] [MAIN ] BME: Generated 1807 derivative records from 10912 primary records. [2025-09-25T22:17:08.229855] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-25T22:17:08.369986] [DEBUG] [MAIN ] BMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:08.370791] [INFO ] [MAIN ] BMA: Generated 1807 derivative records from 35339 primary records. [2025-09-25T22:17:08.370856] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-25T22:17:08.392706] [DEBUG] [LOCAL ] BME: Derivative data saved (1807 records). [2025-09-25T22:17:08.392835] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-25T22:17:08.398332] [INFO ] [MAIN ] Derivative Progress: 226/2043 symbols completed. BME took 1.2s. Estimated remaining: 13m 20s. Rate: 136.3 symbols/min [2025-09-25T22:17:08.403232] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:08.410254] [DEBUG] [LOCAL ] BMA: Derivative data saved (1807 records). [2025-09-25T22:17:08.410384] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-25T22:17:08.413059] [INFO ] [MAIN ] Derivative Progress: 227/2043 symbols completed. BMA took 1.2s. Estimated remaining: 13m 16s. Rate: 136.9 symbols/min [2025-09-25T22:17:08.422227] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:08.434524] [DEBUG] [LOCAL ] BMN: Loaded 2536 existing records from primary storage. [2025-09-25T22:17:08.442816] [INFO ] [MAIN ] BMN: Loaded 2536 primary data records. [2025-09-25T22:17:08.455590] [DEBUG] [MAIN ] BLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:08.459875] [INFO ] [MAIN ] BLW: Generated 1807 derivative records from 12881 primary records. [2025-09-25T22:17:08.459951] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-25T22:17:08.490188] [DEBUG] [LOCAL ] BMEZ: Loaded 26209 existing records from primary storage. [2025-09-25T22:17:08.490334] [INFO ] [MAIN ] BMEZ: Loaded 26209 primary data records. [2025-09-25T22:17:08.507892] [DEBUG] [LOCAL ] BLW: Derivative data saved (1807 records). [2025-09-25T22:17:08.508024] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-25T22:17:08.511155] [INFO ] [MAIN ] Derivative Progress: 228/2043 symbols completed. BLW took 1.3s. Estimated remaining: 13m 13s. Rate: 137.4 symbols/min [2025-09-25T22:17:08.516213] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:08.694255] [DEBUG] [LOCAL ] BMO: Loaded 41667 existing records from primary storage. [2025-09-25T22:17:08.694545] [INFO ] [MAIN ] BMO: Loaded 41667 primary data records. [2025-09-25T22:17:09.368168] [DEBUG] [MAIN ] BMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:09.368919] [INFO ] [MAIN ] BMN: Generated 1807 derivative records from 2536 primary records. [2025-09-25T22:17:09.368986] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-25T22:17:09.422261] [DEBUG] [LOCAL ] BMN: Derivative data saved (1807 records). [2025-09-25T22:17:09.422399] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-25T22:17:09.425143] [INFO ] [MAIN ] Derivative Progress: 229/2043 symbols completed. BMN took 1.0s. Estimated remaining: 13m 16s. Rate: 136.7 symbols/min [2025-09-25T22:17:09.433523] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:09.449686] [DEBUG] [MAIN ] BMEZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:09.450408] [INFO ] [MAIN ] BMEZ: Generated 1807 derivative records from 26209 primary records. [2025-09-25T22:17:09.450480] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-25T22:17:09.508722] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1807 records). [2025-09-25T22:17:09.508948] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-25T22:17:09.511755] [INFO ] [MAIN ] Derivative Progress: 230/2043 symbols completed. BMEZ took 1.1s. Estimated remaining: 13m 13s. Rate: 137.2 symbols/min [2025-09-25T22:17:09.530943] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:09.570461] [DEBUG] [LOCAL ] BNH: Loaded 4902 existing records from primary storage. [2025-09-25T22:17:09.570606] [INFO ] [MAIN ] BNH: Loaded 4902 primary data records. [2025-09-25T22:17:09.582197] [DEBUG] [LOCAL ] BN: Loaded 53384 existing records from primary storage. [2025-09-25T22:17:09.582366] [INFO ] [MAIN ] BN: Loaded 53384 primary data records. [2025-09-25T22:17:10.308887] [DEBUG] [MAIN ] BN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:10.309593] [INFO ] [MAIN ] BN: Generated 1807 derivative records from 53384 primary records. [2025-09-25T22:17:10.310445] [DEBUG] [MAIN ] BMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:10.311180] [INFO ] [MAIN ] BMO: Generated 1807 derivative records from 41667 primary records. [2025-09-25T22:17:10.311248] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-25T22:17:10.326003] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-25T22:17:10.502281] [DEBUG] [LOCAL ] BMO: Derivative data saved (1807 records). [2025-09-25T22:17:10.502449] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-25T22:17:10.505536] [INFO ] [MAIN ] Derivative Progress: 231/2043 symbols completed. BMO took 2.0s. Estimated remaining: 13m 17s. Rate: 136.5 symbols/min [2025-09-25T22:17:10.514223] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:10.520120] [DEBUG] [LOCAL ] BN: Derivative data saved (1807 records). [2025-09-25T22:17:10.520285] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-25T22:17:10.522994] [INFO ] [MAIN ] Derivative Progress: 232/2043 symbols completed. BN took 1.1s. Estimated remaining: 13m 13s. Rate: 137.0 symbols/min [2025-09-25T22:17:10.523232] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:10.530314] [DEBUG] [LOCAL ] BNJ: Loaded 2610 existing records from primary storage. [2025-09-25T22:17:10.530454] [INFO ] [MAIN ] BNJ: Loaded 2610 primary data records. [2025-09-25T22:17:10.625933] [DEBUG] [MAIN ] BNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:10.626760] [INFO ] [MAIN ] BNH: Generated 1807 derivative records from 4902 primary records. [2025-09-25T22:17:10.626827] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-25T22:17:10.652756] [DEBUG] [LOCAL ] BNH: Derivative data saved (1807 records). [2025-09-25T22:17:10.652863] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-25T22:17:10.655281] [INFO ] [MAIN ] Derivative Progress: 233/2043 symbols completed. BNH took 1.1s. Estimated remaining: 13m 10s. Rate: 137.4 symbols/min [2025-09-25T22:17:10.660998] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:10.971580] [DEBUG] [LOCAL ] BNL: Loaded 47233 existing records from primary storage. [2025-09-25T22:17:10.971879] [INFO ] [MAIN ] BNL: Loaded 47233 primary data records. [2025-09-25T22:17:11.110822] [DEBUG] [LOCAL ] BNS: Loaded 51844 existing records from primary storage. [2025-09-25T22:17:11.111981] [INFO ] [MAIN ] BNS: Loaded 51844 primary data records. [2025-09-25T22:17:11.544327] [DEBUG] [MAIN ] BNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:11.558010] [INFO ] [MAIN ] BNJ: Generated 1807 derivative records from 2610 primary records. [2025-09-25T22:17:11.558446] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-25T22:17:11.740999] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1807 records). [2025-09-25T22:17:11.741249] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-25T22:17:11.744360] [INFO ] [MAIN ] Derivative Progress: 234/2043 symbols completed. BNJ took 1.2s. Estimated remaining: 13m 15s. Rate: 136.6 symbols/min [2025-09-25T22:17:11.745132] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:11.757265] [DEBUG] [LOCAL ] BNT: Loaded 3437 existing records from primary storage. [2025-09-25T22:17:11.757847] [INFO ] [MAIN ] BNT: Loaded 3437 primary data records. [2025-09-25T22:17:11.946833] [DEBUG] [MAIN ] BNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:11.967769] [INFO ] [MAIN ] BNL: Generated 1807 derivative records from 47233 primary records. [2025-09-25T22:17:11.993273] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-25T22:17:12.268665] [DEBUG] [LOCAL ] BNL: Derivative data saved (1807 records). [2025-09-25T22:17:12.283016] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-25T22:17:12.284389] [DEBUG] [MAIN ] BNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:12.288976] [INFO ] [MAIN ] BNS: Generated 1807 derivative records from 51844 primary records. [2025-09-25T22:17:12.287069] [INFO ] [MAIN ] Derivative Progress: 235/2043 symbols completed. BNL took 1.8s. Estimated remaining: 13m 15s. Rate: 136.4 symbols/min [2025-09-25T22:17:12.289569] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-25T22:17:12.292062] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:12.319934] [DEBUG] [LOCAL ] BNS: Derivative data saved (1807 records). [2025-09-25T22:17:12.324942] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-25T22:17:12.328754] [INFO ] [MAIN ] Derivative Progress: 236/2043 symbols completed. BNS took 1.7s. Estimated remaining: 13m 12s. Rate: 137.0 symbols/min [2025-09-25T22:17:12.329154] [DEBUG] [LOCAL ] BNY: Loaded 7428 existing records from primary storage. [2025-09-25T22:17:12.329951] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:12.330495] [INFO ] [MAIN ] BNY: Loaded 7428 primary data records. [2025-09-25T22:17:12.477722] [DEBUG] [MAIN ] BNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:12.479233] [INFO ] [MAIN ] BNT: Generated 1807 derivative records from 3437 primary records. [2025-09-25T22:17:12.479501] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-25T22:17:12.524370] [DEBUG] [LOCAL ] BOC: Loaded 18500 existing records from primary storage. [2025-09-25T22:17:12.538824] [INFO ] [MAIN ] BOC: Loaded 18500 primary data records. [2025-09-25T22:17:12.626028] [DEBUG] [LOCAL ] BNT: Derivative data saved (1807 records). [2025-09-25T22:17:12.626155] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-25T22:17:12.629433] [INFO ] [MAIN ] Derivative Progress: 237/2043 symbols completed. BNT took 0.9s. Estimated remaining: 13m 10s. Rate: 137.1 symbols/min [2025-09-25T22:17:12.684508] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:13.187928] [DEBUG] [LOCAL ] BOH: Loaded 31510 existing records from primary storage. [2025-09-25T22:17:13.188669] [INFO ] [MAIN ] BOH: Loaded 31510 primary data records. [2025-09-25T22:17:13.351277] [DEBUG] [MAIN ] BNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:13.369401] [INFO ] [MAIN ] BNY: Generated 1807 derivative records from 7428 primary records. [2025-09-25T22:17:13.374923] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-25T22:17:13.619354] [DEBUG] [LOCAL ] BNY: Derivative data saved (1807 records). [2025-09-25T22:17:13.619621] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-25T22:17:13.622452] [INFO ] [MAIN ] Derivative Progress: 238/2043 symbols completed. BNY took 1.3s. Estimated remaining: 13m 14s. Rate: 136.4 symbols/min [2025-09-25T22:17:13.644692] [DEBUG] [MAIN ] BOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:13.646318] [INFO ] [MAIN ] BOC: Generated 1807 derivative records from 18500 primary records. [2025-09-25T22:17:13.647338] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-25T22:17:13.667596] [DEBUG] [LOCAL ] BOC: Derivative data saved (1807 records). [2025-09-25T22:17:13.667994] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-25T22:17:13.671061] [INFO ] [MAIN ] Derivative Progress: 239/2043 symbols completed. BOC took 1.3s. Estimated remaining: 13m 10s. Rate: 136.9 symbols/min [2025-09-25T22:17:13.688620] [DEBUG] [MAIN ] BOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:13.689386] [INFO ] [MAIN ] BOH: Generated 1807 derivative records from 31510 primary records. [2025-09-25T22:17:13.689485] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-25T22:17:13.705513] [DEBUG] [LOCAL ] BOH: Derivative data saved (1807 records). [2025-09-25T22:17:13.705577] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-25T22:17:13.708775] [INFO ] [MAIN ] Derivative Progress: 240/2043 symbols completed. BOH took 1.0s. Estimated remaining: 13m 7s. Rate: 137.5 symbols/min [2025-09-25T22:17:13.709707] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:13.710199] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:13.710037] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:13.792566] [DEBUG] [LOCAL ] BOOT: Loaded 41144 existing records from primary storage. [2025-09-25T22:17:13.792803] [INFO ] [MAIN ] BOOT: Loaded 41144 primary data records. [2025-09-25T22:17:13.806780] [DEBUG] [LOCAL ] BOND: Loaded 32348 existing records from primary storage. [2025-09-25T22:17:13.841674] [INFO ] [MAIN ] BOND: Loaded 32348 primary data records. [2025-09-25T22:17:13.960590] [DEBUG] [LOCAL ] BORR: Loaded 51538 existing records from primary storage. [2025-09-25T22:17:13.977411] [INFO ] [MAIN ] BORR: Loaded 51538 primary data records. [2025-09-25T22:17:15.059996] [DEBUG] [MAIN ] BOOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:15.061360] [INFO ] [MAIN ] BOOT: Generated 1807 derivative records from 41144 primary records. [2025-09-25T22:17:15.061474] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-25T22:17:15.092027] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1807 records). [2025-09-25T22:17:15.097969] [DEBUG] [MAIN ] BOND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:15.098682] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-25T22:17:15.103498] [INFO ] [MAIN ] Derivative Progress: 241/2043 symbols completed. BOOT took 1.4s. Estimated remaining: 13m 14s. Rate: 136.2 symbols/min [2025-09-25T22:17:15.105531] [INFO ] [MAIN ] BOND: Generated 1807 derivative records from 32348 primary records. [2025-09-25T22:17:15.106019] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:15.106296] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-25T22:17:15.123445] [DEBUG] [MAIN ] BORR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:15.136665] [INFO ] [MAIN ] BORR: Generated 1807 derivative records from 51538 primary records. [2025-09-25T22:17:15.141417] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-25T22:17:15.141199] [DEBUG] [LOCAL ] BOND: Derivative data saved (1807 records). [2025-09-25T22:17:15.142386] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-25T22:17:15.145556] [INFO ] [MAIN ] Derivative Progress: 242/2043 symbols completed. BOND took 1.4s. Estimated remaining: 13m 10s. Rate: 136.7 symbols/min [2025-09-25T22:17:15.146019] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:15.171411] [DEBUG] [LOCAL ] BORR: Derivative data saved (1807 records). [2025-09-25T22:17:15.171695] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-25T22:17:15.175378] [INFO ] [MAIN ] Derivative Progress: 243/2043 symbols completed. BORR took 1.5s. Estimated remaining: 13m 7s. Rate: 137.2 symbols/min [2025-09-25T22:17:15.184933] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:15.185666] [DEBUG] [LOCAL ] BOW: Loaded 23795 existing records from primary storage. [2025-09-25T22:17:15.186478] [INFO ] [MAIN ] BOW: Loaded 23795 primary data records. [2025-09-25T22:17:15.591387] [DEBUG] [LOCAL ] BOX: Loaded 50653 existing records from primary storage. [2025-09-25T22:17:15.592743] [INFO ] [MAIN ] BOX: Loaded 50653 primary data records. [2025-09-25T22:17:15.670339] [DEBUG] [LOCAL ] BP: Loaded 54101 existing records from primary storage. [2025-09-25T22:17:15.695375] [INFO ] [MAIN ] BP: Loaded 54101 primary data records. [2025-09-25T22:17:16.358918] [DEBUG] [MAIN ] BOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:16.360978] [INFO ] [MAIN ] BOW: Generated 1807 derivative records from 23795 primary records. [2025-09-25T22:17:16.361212] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-25T22:17:16.381797] [DEBUG] [LOCAL ] BOW: Derivative data saved (1807 records). [2025-09-25T22:17:16.382267] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-25T22:17:16.385100] [INFO ] [MAIN ] Derivative Progress: 244/2043 symbols completed. BOW took 1.3s. Estimated remaining: 13m 12s. Rate: 136.3 symbols/min [2025-09-25T22:17:16.385761] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:16.406981] [DEBUG] [MAIN ] BOX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:16.408774] [INFO ] [MAIN ] BOX: Generated 1807 derivative records from 50653 primary records. [2025-09-25T22:17:16.408946] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-25T22:17:16.435052] [DEBUG] [MAIN ] BP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:16.440122] [DEBUG] [LOCAL ] BOX: Derivative data saved (1807 records). [2025-09-25T22:17:16.439808] [INFO ] [MAIN ] BP: Generated 1807 derivative records from 54101 primary records. [2025-09-25T22:17:16.440273] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-25T22:17:16.440415] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-25T22:17:16.443684] [INFO ] [MAIN ] Derivative Progress: 245/2043 symbols completed. BOX took 1.3s. Estimated remaining: 13m 9s. Rate: 136.7 symbols/min [2025-09-25T22:17:16.444860] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:16.465961] [DEBUG] [LOCAL ] BP: Derivative data saved (1807 records). [2025-09-25T22:17:16.466318] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-25T22:17:16.469637] [INFO ] [MAIN ] Derivative Progress: 246/2043 symbols completed. BP took 1.3s. Estimated remaining: 13m 5s. Rate: 137.3 symbols/min [2025-09-25T22:17:16.470052] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:16.503864] [DEBUG] [LOCAL ] BRC: Loaded 19466 existing records from primary storage. [2025-09-25T22:17:16.504088] [INFO ] [MAIN ] BRC: Loaded 19466 primary data records. [2025-09-25T22:17:16.604878] [DEBUG] [LOCAL ] BRBR: Loaded 51612 existing records from primary storage. [2025-09-25T22:17:16.610621] [INFO ] [MAIN ] BRBR: Loaded 51612 primary data records. [2025-09-25T22:17:16.853829] [DEBUG] [LOCAL ] BRCC: Loaded 40672 existing records from primary storage. [2025-09-25T22:17:16.895489] [INFO ] [MAIN ] BRCC: Loaded 40672 primary data records. [2025-09-25T22:17:17.704877] [DEBUG] [MAIN ] BRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:17.706345] [INFO ] [MAIN ] BRC: Generated 1807 derivative records from 19466 primary records. [2025-09-25T22:17:17.706780] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-25T22:17:17.722214] [DEBUG] [MAIN ] BRBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:17.732923] [INFO ] [MAIN ] BRBR: Generated 1807 derivative records from 51612 primary records. [2025-09-25T22:17:17.740541] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-25T22:17:17.741908] [DEBUG] [LOCAL ] BRC: Derivative data saved (1807 records). [2025-09-25T22:17:17.744309] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-25T22:17:17.747355] [INFO ] [MAIN ] Derivative Progress: 247/2043 symbols completed. BRC took 1.3s. Estimated remaining: 13m 11s. Rate: 136.2 symbols/min [2025-09-25T22:17:17.747956] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:17.779044] [DEBUG] [MAIN ] BRCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:17.782350] [INFO ] [MAIN ] BRCC: Generated 1807 derivative records from 40672 primary records. [2025-09-25T22:17:17.783296] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1807 records). [2025-09-25T22:17:17.783689] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-25T22:17:17.783571] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-25T22:17:17.787633] [INFO ] [MAIN ] Derivative Progress: 248/2043 symbols completed. BRBR took 1.4s. Estimated remaining: 13m 8s. Rate: 136.7 symbols/min [2025-09-25T22:17:17.789493] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:17.808888] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1807 records). [2025-09-25T22:17:17.809192] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-25T22:17:17.812312] [INFO ] [MAIN ] Derivative Progress: 249/2043 symbols completed. BRCC took 1.3s. Estimated remaining: 13m 4s. Rate: 137.2 symbols/min [2025-09-25T22:17:17.812818] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:17.902240] [DEBUG] [LOCAL ] BRSP: Loaded 37224 existing records from primary storage. [2025-09-25T22:17:17.916932] [INFO ] [MAIN ] BRSP: Loaded 37224 primary data records. [2025-09-25T22:17:17.920183] [DEBUG] [LOCAL ] BRO: Loaded 52300 existing records from primary storage. [2025-09-25T22:17:17.942842] [INFO ] [MAIN ] BRO: Loaded 52300 primary data records. [2025-09-25T22:17:17.960352] [DEBUG] [LOCAL ] BROS: Loaded 53677 existing records from primary storage. [2025-09-25T22:17:18.062621] [INFO ] [MAIN ] BROS: Loaded 53677 primary data records. [2025-09-25T22:17:19.060128] [DEBUG] [MAIN ] BROS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:19.076083] [INFO ] [MAIN ] BROS: Generated 1807 derivative records from 53677 primary records. [2025-09-25T22:17:19.077699] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-25T22:17:19.077557] [DEBUG] [MAIN ] BRSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:19.081591] [INFO ] [MAIN ] BRSP: Generated 1807 derivative records from 37224 primary records. [2025-09-25T22:17:19.098618] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-25T22:17:19.132187] [DEBUG] [LOCAL ] BROS: Derivative data saved (1807 records). [2025-09-25T22:17:19.133524] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1807 records). [2025-09-25T22:17:19.134365] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-25T22:17:19.134264] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-25T22:17:19.134088] [DEBUG] [MAIN ] BRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:19.138183] [INFO ] [MAIN ] Derivative Progress: 250/2043 symbols completed. BROS took 1.3s. Estimated remaining: 13m 10s. Rate: 136.1 symbols/min [2025-09-25T22:17:19.140885] [INFO ] [MAIN ] Derivative Progress: 251/2043 symbols completed. BRSP took 1.3s. Estimated remaining: 13m 7s. Rate: 136.7 symbols/min [2025-09-25T22:17:19.140759] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:19.143428] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:19.142338] [INFO ] [MAIN ] BRO: Generated 1807 derivative records from 52300 primary records. [2025-09-25T22:17:19.143697] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-25T22:17:19.173347] [DEBUG] [LOCAL ] BRO: Derivative data saved (1807 records). [2025-09-25T22:17:19.173628] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-25T22:17:19.177525] [DEBUG] [LOCAL ] BRT: Loaded 4999 existing records from primary storage. [2025-09-25T22:17:19.182424] [INFO ] [MAIN ] BRT: Loaded 4999 primary data records. [2025-09-25T22:17:19.181966] [INFO ] [MAIN ] Derivative Progress: 252/2043 symbols completed. BRO took 1.4s. Estimated remaining: 13m 3s. Rate: 137.2 symbols/min [2025-09-25T22:17:19.204564] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:19.321375] [DEBUG] [LOCAL ] BRW: Loaded 19574 existing records from primary storage. [2025-09-25T22:17:19.333492] [INFO ] [MAIN ] BRW: Loaded 19574 primary data records. [2025-09-25T22:17:19.809955] [DEBUG] [LOCAL ] BRX: Loaded 52115 existing records from primary storage. [2025-09-25T22:17:19.834954] [INFO ] [MAIN ] BRX: Loaded 52115 primary data records. [2025-09-25T22:17:20.336392] [DEBUG] [MAIN ] BRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:20.355202] [INFO ] [MAIN ] BRT: Generated 1807 derivative records from 4999 primary records. [2025-09-25T22:17:20.359117] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-25T22:17:20.380548] [DEBUG] [LOCAL ] BRT: Derivative data saved (1807 records). [2025-09-25T22:17:20.389676] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-25T22:17:20.395854] [DEBUG] [MAIN ] BRW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:20.398445] [INFO ] [MAIN ] Derivative Progress: 253/2043 symbols completed. BRT took 1.3s. Estimated remaining: 13m 9s. Rate: 136.2 symbols/min [2025-09-25T22:17:20.399804] [INFO ] [MAIN ] BRW: Generated 1807 derivative records from 19574 primary records. [2025-09-25T22:17:20.400274] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-25T22:17:20.420925] [DEBUG] [LOCAL ] BRW: Derivative data saved (1807 records). [2025-09-25T22:17:20.421133] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-25T22:17:20.423884] [INFO ] [MAIN ] Derivative Progress: 254/2043 symbols completed. BRW took 1.3s. Estimated remaining: 13m 5s. Rate: 136.7 symbols/min [2025-09-25T22:17:20.442212] [DEBUG] [MAIN ] BRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:20.443058] [INFO ] [MAIN ] BRX: Generated 1807 derivative records from 52115 primary records. [2025-09-25T22:17:20.443126] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-25T22:17:20.460078] [DEBUG] [LOCAL ] BRX: Derivative data saved (1807 records). [2025-09-25T22:17:20.460149] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-25T22:17:20.463548] [INFO ] [MAIN ] Derivative Progress: 255/2043 symbols completed. BRX took 1.3s. Estimated remaining: 13m 2s. Rate: 137.2 symbols/min [2025-09-25T22:17:20.464528] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:20.464694] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:20.465083] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:20.478903] [DEBUG] [LOCAL ] BSL: Loaded 8077 existing records from primary storage. [2025-09-25T22:17:20.479093] [INFO ] [MAIN ] BSL: Loaded 8077 primary data records. [2025-09-25T22:17:20.836350] [DEBUG] [LOCAL ] BSAC: Loaded 33282 existing records from primary storage. [2025-09-25T22:17:20.864921] [INFO ] [MAIN ] BSAC: Loaded 33282 primary data records. [2025-09-25T22:17:20.887405] [DEBUG] [LOCAL ] BSBR: Loaded 35491 existing records from primary storage. [2025-09-25T22:17:20.922098] [INFO ] [MAIN ] BSBR: Loaded 35491 primary data records. [2025-09-25T22:17:21.653446] [DEBUG] [MAIN ] BSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:21.656172] [INFO ] [MAIN ] BSL: Generated 1807 derivative records from 8077 primary records. [2025-09-25T22:17:21.656609] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-25T22:17:21.712237] [DEBUG] [LOCAL ] BSL: Derivative data saved (1807 records). [2025-09-25T22:17:21.713076] [DEBUG] [MAIN ] BSAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:21.714420] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-25T22:17:21.717885] [INFO ] [MAIN ] Derivative Progress: 256/2043 symbols completed. BSL took 1.3s. Estimated remaining: 13m 7s. Rate: 136.2 symbols/min [2025-09-25T22:17:21.714321] [INFO ] [MAIN ] BSAC: Generated 1807 derivative records from 33282 primary records. [2025-09-25T22:17:21.718271] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-25T22:17:21.720751] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:21.764104] [DEBUG] [MAIN ] BSBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:21.767321] [INFO ] [MAIN ] BSBR: Generated 1807 derivative records from 35491 primary records. [2025-09-25T22:17:21.767439] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-25T22:17:21.766290] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1807 records). [2025-09-25T22:17:21.768793] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-25T22:17:21.772743] [INFO ] [MAIN ] Derivative Progress: 257/2043 symbols completed. BSAC took 1.3s. Estimated remaining: 13m 4s. Rate: 136.7 symbols/min [2025-09-25T22:17:21.774276] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:21.793451] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1807 records). [2025-09-25T22:17:21.793799] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-25T22:17:21.797897] [INFO ] [MAIN ] Derivative Progress: 258/2043 symbols completed. BSBR took 1.3s. Estimated remaining: 13m 1s. Rate: 137.2 symbols/min [2025-09-25T22:17:21.798393] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:21.845897] [DEBUG] [LOCAL ] BSTZ: Loaded 25007 existing records from primary storage. [2025-09-25T22:17:21.856279] [INFO ] [MAIN ] BSTZ: Loaded 25007 primary data records. [2025-09-25T22:17:21.857200] [DEBUG] [LOCAL ] BSM: Loaded 32577 existing records from primary storage. [2025-09-25T22:17:21.884107] [INFO ] [MAIN ] BSM: Loaded 32577 primary data records. [2025-09-25T22:17:22.178414] [DEBUG] [LOCAL ] BSX: Loaded 54078 existing records from primary storage. [2025-09-25T22:17:22.227311] [INFO ] [MAIN ] BSX: Loaded 54078 primary data records. [2025-09-25T22:17:23.041409] [DEBUG] [MAIN ] BSTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:23.042937] [INFO ] [MAIN ] BSTZ: Generated 1807 derivative records from 25007 primary records. [2025-09-25T22:17:23.055840] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-25T22:17:23.062790] [DEBUG] [MAIN ] BSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:23.064381] [INFO ] [MAIN ] BSM: Generated 1807 derivative records from 32577 primary records. [2025-09-25T22:17:23.064725] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-25T22:17:23.082811] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1807 records). [2025-09-25T22:17:23.095916] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-25T22:17:23.105360] [INFO ] [MAIN ] Derivative Progress: 259/2043 symbols completed. BSTZ took 1.3s. Estimated remaining: 13m 6s. Rate: 136.1 symbols/min [2025-09-25T22:17:23.110261] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:23.112157] [DEBUG] [LOCAL ] BSM: Derivative data saved (1807 records). [2025-09-25T22:17:23.112686] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-25T22:17:23.116844] [INFO ] [MAIN ] Derivative Progress: 260/2043 symbols completed. BSM took 1.4s. Estimated remaining: 13m 3s. Rate: 136.6 symbols/min [2025-09-25T22:17:23.118949] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:23.135220] [DEBUG] [MAIN ] BSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:23.136311] [INFO ] [MAIN ] BSX: Generated 1807 derivative records from 54078 primary records. [2025-09-25T22:17:23.136491] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-25T22:17:23.159859] [DEBUG] [LOCAL ] BSX: Derivative data saved (1807 records). [2025-09-25T22:17:23.160138] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-25T22:17:23.164619] [INFO ] [MAIN ] Derivative Progress: 261/2043 symbols completed. BSX took 1.4s. Estimated remaining: 12m 60s. Rate: 137.1 symbols/min [2025-09-25T22:17:23.165203] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:23.195430] [DEBUG] [LOCAL ] BTO: Loaded 8942 existing records from primary storage. [2025-09-25T22:17:23.195621] [INFO ] [MAIN ] BTO: Loaded 8942 primary data records. [2025-09-25T22:17:23.363203] [DEBUG] [LOCAL ] BTE: Loaded 53117 existing records from primary storage. [2025-09-25T22:17:23.390284] [INFO ] [MAIN ] BTE: Loaded 53117 primary data records. [2025-09-25T22:17:23.412317] [DEBUG] [LOCAL ] BTI: Loaded 53946 existing records from primary storage. [2025-09-25T22:17:23.418070] [INFO ] [MAIN ] BTI: Loaded 53946 primary data records. [2025-09-25T22:17:24.396926] [DEBUG] [MAIN ] BTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:24.398340] [INFO ] [MAIN ] BTO: Generated 1807 derivative records from 8942 primary records. [2025-09-25T22:17:24.398548] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-25T22:17:24.419672] [DEBUG] [LOCAL ] BTO: Derivative data saved (1807 records). [2025-09-25T22:17:24.423038] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-25T22:17:24.425465] [INFO ] [MAIN ] Derivative Progress: 262/2043 symbols completed. BTO took 1.3s. Estimated remaining: 13m 5s. Rate: 136.1 symbols/min [2025-09-25T22:17:24.425992] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:24.455420] [DEBUG] [MAIN ] BTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:24.455055] [DEBUG] [MAIN ] BTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:24.456679] [INFO ] [MAIN ] BTI: Generated 1807 derivative records from 53946 primary records. [2025-09-25T22:17:24.457740] [INFO ] [MAIN ] BTE: Generated 1807 derivative records from 53117 primary records. [2025-09-25T22:17:24.456791] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-25T22:17:24.458923] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-25T22:17:24.497243] [DEBUG] [LOCAL ] BTI: Derivative data saved (1807 records). [2025-09-25T22:17:24.500763] [DEBUG] [LOCAL ] BTE: Derivative data saved (1807 records). [2025-09-25T22:17:24.499604] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-25T22:17:24.503904] [INFO ] [MAIN ] Derivative Progress: 263/2043 symbols completed. BTI took 1.4s. Estimated remaining: 13m 2s. Rate: 136.6 symbols/min [2025-09-25T22:17:24.504536] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-25T22:17:24.504998] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:24.515745] [INFO ] [MAIN ] Derivative Progress: 264/2043 symbols completed. BTE took 1.4s. Estimated remaining: 12m 59s. Rate: 137.1 symbols/min [2025-09-25T22:17:24.511820] [DEBUG] [LOCAL ] BTT: Loaded 16032 existing records from primary storage. [2025-09-25T22:17:24.516579] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:24.517280] [INFO ] [MAIN ] BTT: Loaded 16032 primary data records. [2025-09-25T22:17:24.878825] [DEBUG] [LOCAL ] BTZ: Loaded 22899 existing records from primary storage. [2025-09-25T22:17:24.879072] [INFO ] [MAIN ] BTZ: Loaded 22899 primary data records. [2025-09-25T22:17:25.006210] [DEBUG] [LOCAL ] BTU: Loaded 53693 existing records from primary storage. [2025-09-25T22:17:25.011008] [INFO ] [MAIN ] BTU: Loaded 53693 primary data records. [2025-09-25T22:17:25.563215] [DEBUG] [MAIN ] BTT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:25.564688] [INFO ] [MAIN ] BTT: Generated 1807 derivative records from 16032 primary records. [2025-09-25T22:17:25.564933] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-25T22:17:25.586072] [DEBUG] [LOCAL ] BTT: Derivative data saved (1807 records). [2025-09-25T22:17:25.586249] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-25T22:17:25.588977] [INFO ] [MAIN ] Derivative Progress: 265/2043 symbols completed. BTT took 1.2s. Estimated remaining: 13m 3s. Rate: 136.3 symbols/min [2025-09-25T22:17:25.589493] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:25.608461] [DEBUG] [MAIN ] BTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:25.609342] [INFO ] [MAIN ] BTZ: Generated 1807 derivative records from 22899 primary records. [2025-09-25T22:17:25.609572] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-25T22:17:25.627793] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1807 records). [2025-09-25T22:17:25.628044] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-25T22:17:25.630702] [INFO ] [MAIN ] Derivative Progress: 266/2043 symbols completed. BTZ took 1.1s. Estimated remaining: 12m 60s. Rate: 136.8 symbols/min [2025-09-25T22:17:25.631073] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:25.650442] [DEBUG] [MAIN ] BTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:25.651401] [INFO ] [MAIN ] BTU: Generated 1807 derivative records from 53693 primary records. [2025-09-25T22:17:25.651591] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-25T22:17:25.673744] [DEBUG] [LOCAL ] BTU: Derivative data saved (1807 records). [2025-09-25T22:17:25.689128] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-25T22:17:25.692293] [INFO ] [MAIN ] Derivative Progress: 267/2043 symbols completed. BTU took 1.2s. Estimated remaining: 12m 57s. Rate: 137.2 symbols/min [2025-09-25T22:17:25.692868] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:25.725480] [DEBUG] [LOCAL ] BUD: Loaded 53125 existing records from primary storage. [2025-09-25T22:17:25.725771] [INFO ] [MAIN ] BUD: Loaded 53125 primary data records. [2025-09-25T22:17:25.877608] [DEBUG] [LOCAL ] BUR: Loaded 45395 existing records from primary storage. [2025-09-25T22:17:25.923404] [INFO ] [MAIN ] BUR: Loaded 45395 primary data records. [2025-09-25T22:17:26.132427] [DEBUG] [LOCAL ] BURL: Loaded 46617 existing records from primary storage. [2025-09-25T22:17:26.152728] [INFO ] [MAIN ] BURL: Loaded 46617 primary data records. [2025-09-25T22:17:26.875847] [DEBUG] [MAIN ] BUD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:26.877808] [INFO ] [MAIN ] BUD: Generated 1807 derivative records from 53125 primary records. [2025-09-25T22:17:26.878225] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-25T22:17:26.900805] [DEBUG] [LOCAL ] BUD: Derivative data saved (1807 records). [2025-09-25T22:17:26.901549] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-25T22:17:26.904852] [INFO ] [MAIN ] Derivative Progress: 268/2043 symbols completed. BUD took 1.3s. Estimated remaining: 13m 1s. Rate: 136.3 symbols/min [2025-09-25T22:17:26.925012] [DEBUG] [MAIN ] BURL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:26.939040] [INFO ] [MAIN ] BURL: Generated 1807 derivative records from 46617 primary records. [2025-09-25T22:17:26.939497] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-25T22:17:26.939416] [DEBUG] [MAIN ] BUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:26.941207] [INFO ] [MAIN ] BUR: Generated 1807 derivative records from 45395 primary records. [2025-09-25T22:17:26.941532] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-25T22:17:26.965809] [DEBUG] [LOCAL ] BURL: Derivative data saved (1807 records). [2025-09-25T22:17:26.967216] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-25T22:17:26.972770] [INFO ] [MAIN ] Derivative Progress: 269/2043 symbols completed. BURL took 1.3s. Estimated remaining: 12m 58s. Rate: 136.7 symbols/min [2025-09-25T22:17:26.977423] [DEBUG] [LOCAL ] BUR: Derivative data saved (1807 records). [2025-09-25T22:17:26.977554] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-25T22:17:26.980660] [INFO ] [MAIN ] Derivative Progress: 270/2043 symbols completed. BUR took 1.3s. Estimated remaining: 12m 55s. Rate: 137.2 symbols/min [2025-09-25T22:17:26.981671] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:26.981603] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:26.982501] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:27.062870] [DEBUG] [LOCAL ] BV: Loaded 38782 existing records from primary storage. [2025-09-25T22:17:27.063537] [DEBUG] [LOCAL ] BW: Loaded 39935 existing records from primary storage. [2025-09-25T22:17:27.064513] [INFO ] [MAIN ] BW: Loaded 39935 primary data records. [2025-09-25T22:17:27.064576] [INFO ] [MAIN ] BV: Loaded 38782 primary data records. [2025-09-25T22:17:27.131058] [DEBUG] [LOCAL ] BWA: Loaded 52616 existing records from primary storage. [2025-09-25T22:17:27.155798] [INFO ] [MAIN ] BWA: Loaded 52616 primary data records. [2025-09-25T22:17:28.130052] [DEBUG] [MAIN ] BV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:28.128982] [DEBUG] [MAIN ] BW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:28.133781] [INFO ] [MAIN ] BW: Generated 1807 derivative records from 39935 primary records. [2025-09-25T22:17:28.132816] [INFO ] [MAIN ] BV: Generated 1807 derivative records from 38782 primary records. [2025-09-25T22:17:28.134095] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-25T22:17:28.134845] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-25T22:17:28.148211] [DEBUG] [MAIN ] BWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:28.150055] [INFO ] [MAIN ] BWA: Generated 1807 derivative records from 52616 primary records. [2025-09-25T22:17:28.157159] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-25T22:17:28.179675] [DEBUG] [LOCAL ] BV: Derivative data saved (1807 records). [2025-09-25T22:17:28.180239] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-25T22:17:28.194372] [INFO ] [MAIN ] Derivative Progress: 271/2043 symbols completed. BV took 1.2s. Estimated remaining: 12m 60s. Rate: 136.4 symbols/min [2025-09-25T22:17:28.198162] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:28.201750] [DEBUG] [LOCAL ] BW: Derivative data saved (1807 records). [2025-09-25T22:17:28.202215] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-25T22:17:28.201809] [DEBUG] [LOCAL ] BWA: Derivative data saved (1807 records). [2025-09-25T22:17:28.204600] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-25T22:17:28.204517] [INFO ] [MAIN ] Derivative Progress: 272/2043 symbols completed. BW took 1.2s. Estimated remaining: 12m 57s. Rate: 136.8 symbols/min [2025-09-25T22:17:28.208225] [INFO ] [MAIN ] Derivative Progress: 273/2043 symbols completed. BWA took 1.2s. Estimated remaining: 12m 53s. Rate: 137.3 symbols/min [2025-09-25T22:17:28.208420] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:28.209083] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:28.219816] [DEBUG] [LOCAL ] BWNB: Loaded 4463 existing records from primary storage. [2025-09-25T22:17:28.220001] [INFO ] [MAIN ] BWNB: Loaded 4463 primary data records. [2025-09-25T22:17:28.264823] [DEBUG] [LOCAL ] BWG: Loaded 12430 existing records from primary storage. [2025-09-25T22:17:28.301473] [INFO ] [MAIN ] BWG: Loaded 12430 primary data records. [2025-09-25T22:17:28.527758] [DEBUG] [LOCAL ] BWLP: Loaded 32989 existing records from primary storage. [2025-09-25T22:17:28.560025] [INFO ] [MAIN ] BWLP: Loaded 32989 primary data records. [2025-09-25T22:17:29.335814] [DEBUG] [MAIN ] BWNB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:17:29.336548] [DEBUG] [MAIN ] BWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:29.337416] [INFO ] [MAIN ] BWG: Generated 1807 derivative records from 12430 primary records. [2025-09-25T22:17:29.337621] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-25T22:17:29.339177] [INFO ] [MAIN ] BWNB: Generated 1806 derivative records from 4463 primary records. [2025-09-25T22:17:29.339635] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-25T22:17:29.369282] [DEBUG] [LOCAL ] BWG: Derivative data saved (1807 records). [2025-09-25T22:17:29.369929] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1806 records). [2025-09-25T22:17:29.370067] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-25T22:17:29.372255] [INFO ] [MAIN ] Derivative Progress: 274/2043 symbols completed. BWNB took 1.2s. Estimated remaining: 12m 58s. Rate: 136.5 symbols/min [2025-09-25T22:17:29.370162] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-25T22:17:29.373884] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:29.378389] [INFO ] [MAIN ] Derivative Progress: 275/2043 symbols completed. BWG took 1.2s. Estimated remaining: 12m 54s. Rate: 137.0 symbols/min [2025-09-25T22:17:29.379835] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:29.394454] [DEBUG] [MAIN ] BWLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:29.395384] [INFO ] [MAIN ] BWLP: Generated 1807 derivative records from 32989 primary records. [2025-09-25T22:17:29.395504] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-25T22:17:29.414499] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1807 records). [2025-09-25T22:17:29.414673] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-25T22:17:29.417946] [INFO ] [MAIN ] Derivative Progress: 276/2043 symbols completed. BWLP took 1.2s. Estimated remaining: 12m 51s. Rate: 137.5 symbols/min [2025-09-25T22:17:29.418345] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:29.435975] [DEBUG] [LOCAL ] BXC: Loaded 13822 existing records from primary storage. [2025-09-25T22:17:29.436301] [INFO ] [MAIN ] BXC: Loaded 13822 primary data records. [2025-09-25T22:17:29.653058] [DEBUG] [LOCAL ] BX: Loaded 53887 existing records from primary storage. [2025-09-25T22:17:29.676220] [INFO ] [MAIN ] BX: Loaded 53887 primary data records. [2025-09-25T22:17:29.721800] [DEBUG] [LOCAL ] BWXT: Loaded 47108 existing records from primary storage. [2025-09-25T22:17:29.872701] [INFO ] [MAIN ] BWXT: Loaded 47108 primary data records. [2025-09-25T22:17:30.626057] [DEBUG] [MAIN ] BXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:30.627330] [INFO ] [MAIN ] BXC: Generated 1807 derivative records from 13822 primary records. [2025-09-25T22:17:30.627637] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-25T22:17:30.649626] [DEBUG] [LOCAL ] BXC: Derivative data saved (1807 records). [2025-09-25T22:17:30.649924] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-25T22:17:30.652094] [INFO ] [MAIN ] Derivative Progress: 277/2043 symbols completed. BXC took 1.2s. Estimated remaining: 12m 56s. Rate: 136.6 symbols/min [2025-09-25T22:17:30.660615] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:30.667921] [DEBUG] [MAIN ] BX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:30.669242] [INFO ] [MAIN ] BX: Generated 1807 derivative records from 53887 primary records. [2025-09-25T22:17:30.669348] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-25T22:17:30.693129] [DEBUG] [LOCAL ] BX: Derivative data saved (1807 records). [2025-09-25T22:17:30.693479] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-25T22:17:30.696437] [INFO ] [MAIN ] Derivative Progress: 278/2043 symbols completed. BX took 1.3s. Estimated remaining: 12m 53s. Rate: 137.0 symbols/min [2025-09-25T22:17:30.697281] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:30.715389] [DEBUG] [MAIN ] BWXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:30.716312] [INFO ] [MAIN ] BWXT: Generated 1807 derivative records from 47108 primary records. [2025-09-25T22:17:30.716494] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-25T22:17:30.735028] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1807 records). [2025-09-25T22:17:30.735319] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-25T22:17:30.738731] [INFO ] [MAIN ] Derivative Progress: 279/2043 symbols completed. BWXT took 1.4s. Estimated remaining: 12m 50s. Rate: 137.4 symbols/min [2025-09-25T22:17:30.739134] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:30.781313] [DEBUG] [LOCAL ] BXMT: Loaded 47634 existing records from primary storage. [2025-09-25T22:17:30.781529] [INFO ] [MAIN ] BXMT: Loaded 47634 primary data records. [2025-09-25T22:17:30.917945] [DEBUG] [LOCAL ] BY: Loaded 21748 existing records from primary storage. [2025-09-25T22:17:30.918212] [INFO ] [MAIN ] BY: Loaded 21748 primary data records. [2025-09-25T22:17:30.953694] [DEBUG] [LOCAL ] BXP: Loaded 50191 existing records from primary storage. [2025-09-25T22:17:31.021169] [INFO ] [MAIN ] BXP: Loaded 50191 primary data records. [2025-09-25T22:17:31.823608] [DEBUG] [MAIN ] BXMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:31.825949] [INFO ] [MAIN ] BXMT: Generated 1807 derivative records from 47634 primary records. [2025-09-25T22:17:31.826260] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-25T22:17:31.848928] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1807 records). [2025-09-25T22:17:31.849090] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-25T22:17:31.852795] [INFO ] [MAIN ] Derivative Progress: 280/2043 symbols completed. BXMT took 1.2s. Estimated remaining: 12m 54s. Rate: 136.7 symbols/min [2025-09-25T22:17:31.862715] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:31.868743] [DEBUG] [MAIN ] BY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:31.869734] [INFO ] [MAIN ] BY: Generated 1807 derivative records from 21748 primary records. [2025-09-25T22:17:31.869833] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-25T22:17:31.906251] [DEBUG] [LOCAL ] BY: Derivative data saved (1807 records). [2025-09-25T22:17:31.906949] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-25T22:17:31.907339] [DEBUG] [MAIN ] BXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:31.911572] [INFO ] [MAIN ] BXP: Generated 1807 derivative records from 50191 primary records. [2025-09-25T22:17:31.911843] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-25T22:17:31.910572] [INFO ] [MAIN ] Derivative Progress: 281/2043 symbols completed. BY took 1.2s. Estimated remaining: 12m 51s. Rate: 137.1 symbols/min [2025-09-25T22:17:31.912910] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:31.931863] [DEBUG] [LOCAL ] BXP: Derivative data saved (1807 records). [2025-09-25T22:17:31.931948] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-25T22:17:31.935737] [INFO ] [MAIN ] Derivative Progress: 282/2043 symbols completed. BXP took 1.2s. Estimated remaining: 12m 48s. Rate: 137.6 symbols/min [2025-09-25T22:17:31.936147] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:31.985416] [DEBUG] [LOCAL ] BYD: Loaded 45502 existing records from primary storage. [2025-09-25T22:17:31.985847] [INFO ] [MAIN ] BYD: Loaded 45502 primary data records. [2025-09-25T22:17:32.117938] [DEBUG] [LOCAL ] BZH: Loaded 32872 existing records from primary storage. [2025-09-25T22:17:32.118553] [DEBUG] [LOCAL ] CABO: Loaded 17466 existing records from primary storage. [2025-09-25T22:17:32.162405] [INFO ] [MAIN ] CABO: Loaded 17466 primary data records. [2025-09-25T22:17:32.167933] [INFO ] [MAIN ] BZH: Loaded 32872 primary data records. [2025-09-25T22:17:33.209003] [DEBUG] [MAIN ] BYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:33.210684] [INFO ] [MAIN ] BYD: Generated 1807 derivative records from 45502 primary records. [2025-09-25T22:17:33.210955] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-25T22:17:33.246962] [DEBUG] [MAIN ] BZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:33.249005] [INFO ] [MAIN ] BZH: Generated 1807 derivative records from 32872 primary records. [2025-09-25T22:17:33.249635] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-25T22:17:33.275832] [DEBUG] [LOCAL ] BYD: Derivative data saved (1807 records). [2025-09-25T22:17:33.282381] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-25T22:17:33.287376] [INFO ] [MAIN ] Derivative Progress: 283/2043 symbols completed. BYD took 1.4s. Estimated remaining: 12m 53s. Rate: 136.6 symbols/min [2025-09-25T22:17:33.281789] [DEBUG] [MAIN ] CABO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:33.289809] [INFO ] [MAIN ] CABO: Generated 1807 derivative records from 17466 primary records. [2025-09-25T22:17:33.290131] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-25T22:17:33.292603] [DEBUG] [LOCAL ] BZH: Derivative data saved (1807 records). [2025-09-25T22:17:33.292738] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-25T22:17:33.302744] [INFO ] [MAIN ] Derivative Progress: 284/2043 symbols completed. BZH took 1.4s. Estimated remaining: 12m 50s. Rate: 137.0 symbols/min [2025-09-25T22:17:33.311414] [DEBUG] [LOCAL ] CABO: Derivative data saved (1807 records). [2025-09-25T22:17:33.311500] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-25T22:17:33.315261] [INFO ] [MAIN ] Derivative Progress: 285/2043 symbols completed. CABO took 1.4s. Estimated remaining: 12m 47s. Rate: 137.5 symbols/min [2025-09-25T22:17:33.316446] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:33.316610] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:33.317582] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:33.358695] [DEBUG] [LOCAL ] CACI: Loaded 25258 existing records from primary storage. [2025-09-25T22:17:33.358928] [INFO ] [MAIN ] CACI: Loaded 25258 primary data records. [2025-09-25T22:17:33.557435] [DEBUG] [LOCAL ] CAE: Loaded 39345 existing records from primary storage. [2025-09-25T22:17:33.601618] [INFO ] [MAIN ] CAE: Loaded 39345 primary data records. [2025-09-25T22:17:33.752174] [DEBUG] [LOCAL ] CADE: Loaded 49165 existing records from primary storage. [2025-09-25T22:17:33.785318] [INFO ] [MAIN ] CADE: Loaded 49165 primary data records. [2025-09-25T22:17:34.441421] [DEBUG] [MAIN ] CACI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:34.443116] [INFO ] [MAIN ] CACI: Generated 1807 derivative records from 25258 primary records. [2025-09-25T22:17:34.443771] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-25T22:17:34.479374] [DEBUG] [MAIN ] CAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:34.481890] [INFO ] [MAIN ] CAE: Generated 1807 derivative records from 39345 primary records. [2025-09-25T22:17:34.485108] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-25T22:17:34.489019] [DEBUG] [LOCAL ] CACI: Derivative data saved (1807 records). [2025-09-25T22:17:34.514408] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-25T22:17:34.520196] [INFO ] [MAIN ] Derivative Progress: 286/2043 symbols completed. CACI took 1.2s. Estimated remaining: 12m 51s. Rate: 136.6 symbols/min [2025-09-25T22:17:34.521620] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:34.521522] [DEBUG] [MAIN ] CADE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:34.524555] [INFO ] [MAIN ] CADE: Generated 1807 derivative records from 49165 primary records. [2025-09-25T22:17:34.526339] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-25T22:17:34.527368] [DEBUG] [LOCAL ] CAE: Derivative data saved (1807 records). [2025-09-25T22:17:34.530567] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-25T22:17:34.546371] [INFO ] [MAIN ] Derivative Progress: 287/2043 symbols completed. CAE took 1.2s. Estimated remaining: 12m 48s. Rate: 137.1 symbols/min [2025-09-25T22:17:34.550462] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:34.551364] [DEBUG] [LOCAL ] CAF: Loaded 3458 existing records from primary storage. [2025-09-25T22:17:34.552042] [INFO ] [MAIN ] CAF: Loaded 3458 primary data records. [2025-09-25T22:17:34.671331] [DEBUG] [LOCAL ] CADE: Derivative data saved (1807 records). [2025-09-25T22:17:34.677403] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-25T22:17:34.697588] [INFO ] [MAIN ] Derivative Progress: 288/2043 symbols completed. CADE took 1.4s. Estimated remaining: 12m 46s. Rate: 137.4 symbols/min [2025-09-25T22:17:34.742724] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:34.929320] [DEBUG] [LOCAL ] CAG: Loaded 54049 existing records from primary storage. [2025-09-25T22:17:34.929598] [INFO ] [MAIN ] CAG: Loaded 54049 primary data records. [2025-09-25T22:17:35.147609] [DEBUG] [LOCAL ] CAH: Loaded 51826 existing records from primary storage. [2025-09-25T22:17:35.181320] [INFO ] [MAIN ] CAH: Loaded 51826 primary data records. [2025-09-25T22:17:35.420407] [DEBUG] [MAIN ] CAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:35.437591] [INFO ] [MAIN ] CAF: Generated 1807 derivative records from 3458 primary records. [2025-09-25T22:17:35.458269] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-25T22:17:35.612860] [DEBUG] [LOCAL ] CAF: Derivative data saved (1807 records). [2025-09-25T22:17:35.616806] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-25T22:17:35.751720] [INFO ] [MAIN ] Derivative Progress: 289/2043 symbols completed. CAF took 1.2s. Estimated remaining: 12m 50s. Rate: 136.7 symbols/min [2025-09-25T22:17:35.753958] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:35.780048] [DEBUG] [MAIN ] CAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:35.781456] [INFO ] [MAIN ] CAG: Generated 1807 derivative records from 54049 primary records. [2025-09-25T22:17:35.781687] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-25T22:17:35.816569] [DEBUG] [LOCAL ] CAG: Derivative data saved (1807 records). [2025-09-25T22:17:35.816790] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-25T22:17:35.820252] [INFO ] [MAIN ] Derivative Progress: 290/2043 symbols completed. CAG took 1.3s. Estimated remaining: 12m 47s. Rate: 137.1 symbols/min [2025-09-25T22:17:35.821254] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:35.854379] [DEBUG] [MAIN ] CAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:35.856619] [INFO ] [MAIN ] CAH: Generated 1807 derivative records from 51826 primary records. [2025-09-25T22:17:35.856858] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-25T22:17:35.858800] [DEBUG] [LOCAL ] CAL: Loaded 43552 existing records from primary storage. [2025-09-25T22:17:35.859229] [INFO ] [MAIN ] CAL: Loaded 43552 primary data records. [2025-09-25T22:17:35.958931] [DEBUG] [LOCAL ] CAH: Derivative data saved (1807 records). [2025-09-25T22:17:35.971464] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-25T22:17:36.005255] [INFO ] [MAIN ] Derivative Progress: 291/2043 symbols completed. CAH took 1.3s. Estimated remaining: 12m 45s. Rate: 137.4 symbols/min [2025-09-25T22:17:36.006555] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:36.245110] [DEBUG] [LOCAL ] CALX: Loaded 38755 existing records from primary storage. [2025-09-25T22:17:36.246583] [INFO ] [MAIN ] CALX: Loaded 38755 primary data records. [2025-09-25T22:17:36.427033] [DEBUG] [LOCAL ] CANG: Loaded 26949 existing records from primary storage. [2025-09-25T22:17:36.448319] [INFO ] [MAIN ] CANG: Loaded 26949 primary data records. [2025-09-25T22:17:36.968287] [DEBUG] [MAIN ] CAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:36.977578] [INFO ] [MAIN ] CAL: Generated 1807 derivative records from 43552 primary records. [2025-09-25T22:17:36.979930] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-25T22:17:36.997559] [DEBUG] [MAIN ] CALX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:36.998887] [INFO ] [MAIN ] CALX: Generated 1807 derivative records from 38755 primary records. [2025-09-25T22:17:36.999535] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-25T22:17:37.040407] [DEBUG] [LOCAL ] CAL: Derivative data saved (1807 records). [2025-09-25T22:17:37.041195] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-25T22:17:37.045383] [INFO ] [MAIN ] Derivative Progress: 292/2043 symbols completed. CAL took 1.3s. Estimated remaining: 12m 48s. Rate: 136.8 symbols/min [2025-09-25T22:17:37.046135] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:37.046786] [DEBUG] [LOCAL ] CALX: Derivative data saved (1807 records). [2025-09-25T22:17:37.047459] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-25T22:17:37.053103] [INFO ] [MAIN ] Derivative Progress: 293/2043 symbols completed. CALX took 1.2s. Estimated remaining: 12m 45s. Rate: 137.2 symbols/min [2025-09-25T22:17:37.053699] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:37.073894] [DEBUG] [MAIN ] CANG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:37.078724] [INFO ] [MAIN ] CANG: Generated 1807 derivative records from 26949 primary records. [2025-09-25T22:17:37.077772] [DEBUG] [LOCAL ] CAPL: Loaded 5904 existing records from primary storage. [2025-09-25T22:17:37.078971] [INFO ] [MAIN ] CAPL: Loaded 5904 primary data records. [2025-09-25T22:17:37.078894] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-25T22:17:37.203627] [DEBUG] [LOCAL ] CANG: Derivative data saved (1807 records). [2025-09-25T22:17:37.217340] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-25T22:17:37.221715] [INFO ] [MAIN ] Derivative Progress: 294/2043 symbols completed. CANG took 1.2s. Estimated remaining: 12m 43s. Rate: 137.5 symbols/min [2025-09-25T22:17:37.243354] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:37.545111] [DEBUG] [LOCAL ] CARR: Loaded 53984 existing records from primary storage. [2025-09-25T22:17:37.546626] [INFO ] [MAIN ] CARR: Loaded 53984 primary data records. [2025-09-25T22:17:37.716333] [DEBUG] [LOCAL ] CARS: Loaded 40380 existing records from primary storage. [2025-09-25T22:17:37.719107] [INFO ] [MAIN ] CARS: Loaded 40380 primary data records. [2025-09-25T22:17:38.297461] [DEBUG] [MAIN ] CAPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:38.298874] [INFO ] [MAIN ] CAPL: Generated 1807 derivative records from 5904 primary records. [2025-09-25T22:17:38.299765] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-25T22:17:38.339541] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1807 records). [2025-09-25T22:17:38.340101] [DEBUG] [MAIN ] CARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:38.341067] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-25T22:17:38.340981] [INFO ] [MAIN ] CARR: Generated 1807 derivative records from 53984 primary records. [2025-09-25T22:17:38.345357] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-25T22:17:38.345218] [INFO ] [MAIN ] Derivative Progress: 295/2043 symbols completed. CAPL took 1.3s. Estimated remaining: 12m 47s. Rate: 136.8 symbols/min [2025-09-25T22:17:38.355625] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:38.369069] [DEBUG] [LOCAL ] CARR: Derivative data saved (1807 records). [2025-09-25T22:17:38.369302] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-25T22:17:38.373591] [INFO ] [MAIN ] Derivative Progress: 296/2043 symbols completed. CARR took 1.3s. Estimated remaining: 12m 44s. Rate: 137.2 symbols/min [2025-09-25T22:17:38.374027] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:38.387986] [DEBUG] [MAIN ] CARS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:38.388985] [INFO ] [MAIN ] CARS: Generated 1807 derivative records from 40380 primary records. [2025-09-25T22:17:38.389098] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-25T22:17:38.416417] [DEBUG] [LOCAL ] CATO: Loaded 7254 existing records from primary storage. [2025-09-25T22:17:38.418044] [DEBUG] [LOCAL ] CARS: Derivative data saved (1807 records). [2025-09-25T22:17:38.417957] [INFO ] [MAIN ] CATO: Loaded 7254 primary data records. [2025-09-25T22:17:38.418137] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-25T22:17:38.427336] [INFO ] [MAIN ] Derivative Progress: 297/2043 symbols completed. CARS took 1.2s. Estimated remaining: 12m 41s. Rate: 137.6 symbols/min [2025-09-25T22:17:38.453898] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:38.783366] [DEBUG] [LOCAL ] CAT: Loaded 53313 existing records from primary storage. [2025-09-25T22:17:38.783867] [INFO ] [MAIN ] CAT: Loaded 53313 primary data records. [2025-09-25T22:17:38.977805] [DEBUG] [LOCAL ] CAVA: Loaded 53940 existing records from primary storage. [2025-09-25T22:17:39.020716] [INFO ] [MAIN ] CAVA: Loaded 53940 primary data records. [2025-09-25T22:17:39.593459] [DEBUG] [MAIN ] CATO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:39.597080] [INFO ] [MAIN ] CATO: Generated 1807 derivative records from 7254 primary records. [2025-09-25T22:17:39.597548] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-25T22:17:39.631538] [DEBUG] [LOCAL ] CATO: Derivative data saved (1807 records). [2025-09-25T22:17:39.638798] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-25T22:17:39.639288] [DEBUG] [MAIN ] CAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:39.640530] [INFO ] [MAIN ] CAT: Generated 1807 derivative records from 53313 primary records. [2025-09-25T22:17:39.643282] [INFO ] [MAIN ] Derivative Progress: 298/2043 symbols completed. CATO took 1.3s. Estimated remaining: 12m 45s. Rate: 136.8 symbols/min [2025-09-25T22:17:39.643769] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-25T22:17:39.667942] [DEBUG] [LOCAL ] CAT: Derivative data saved (1807 records). [2025-09-25T22:17:39.668251] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-25T22:17:39.672191] [INFO ] [MAIN ] Derivative Progress: 299/2043 symbols completed. CAT took 1.3s. Estimated remaining: 12m 43s. Rate: 137.2 symbols/min [2025-09-25T22:17:39.689770] [DEBUG] [MAIN ] CAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:39.690668] [INFO ] [MAIN ] CAVA: Generated 1807 derivative records from 53940 primary records. [2025-09-25T22:17:39.690740] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-25T22:17:39.707622] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1807 records). [2025-09-25T22:17:39.707748] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-25T22:17:39.713223] [INFO ] [MAIN ] Derivative Progress: 300/2043 symbols completed. CAVA took 1.3s. Estimated remaining: 12m 40s. Rate: 137.6 symbols/min [2025-09-25T22:17:39.714718] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:39.714146] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:39.714926] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:39.732396] [DEBUG] [LOCAL ] CBAN: Loaded 11105 existing records from primary storage. [2025-09-25T22:17:39.732580] [INFO ] [MAIN ] CBAN: Loaded 11105 primary data records. [2025-09-25T22:17:39.868550] [DEBUG] [LOCAL ] CBL: Loaded 16777 existing records from primary storage. [2025-09-25T22:17:39.869393] [INFO ] [MAIN ] CBL: Loaded 16777 primary data records. [2025-09-25T22:17:40.109956] [DEBUG] [LOCAL ] CB: Loaded 50444 existing records from primary storage. [2025-09-25T22:17:40.273425] [INFO ] [MAIN ] CB: Loaded 50444 primary data records. [2025-09-25T22:17:40.816787] [DEBUG] [MAIN ] CBAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:40.819410] [INFO ] [MAIN ] CBAN: Generated 1807 derivative records from 11105 primary records. [2025-09-25T22:17:40.819678] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-25T22:17:40.851738] [DEBUG] [MAIN ] CBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:40.854987] [INFO ] [MAIN ] CBL: Generated 1807 derivative records from 16777 primary records. [2025-09-25T22:17:40.855340] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-25T22:17:40.858871] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1807 records). [2025-09-25T22:17:40.859260] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-25T22:17:40.862827] [INFO ] [MAIN ] Derivative Progress: 301/2043 symbols completed. CBAN took 1.1s. Estimated remaining: 12m 43s. Rate: 136.9 symbols/min [2025-09-25T22:17:40.863221] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:40.882021] [DEBUG] [LOCAL ] CBL: Derivative data saved (1807 records). [2025-09-25T22:17:40.882610] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-25T22:17:40.886419] [INFO ] [MAIN ] Derivative Progress: 302/2043 symbols completed. CBL took 1.2s. Estimated remaining: 12m 41s. Rate: 137.3 symbols/min [2025-09-25T22:17:40.890029] [DEBUG] [LOCAL ] CBNA: Loaded 2908 existing records from primary storage. [2025-09-25T22:17:40.890399] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:40.891716] [INFO ] [MAIN ] CBNA: Loaded 2908 primary data records. [2025-09-25T22:17:41.005060] [DEBUG] [MAIN ] CB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:41.012577] [INFO ] [MAIN ] CB: Generated 1807 derivative records from 50444 primary records. [2025-09-25T22:17:41.028091] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-25T22:17:41.137894] [DEBUG] [LOCAL ] CB: Derivative data saved (1807 records). [2025-09-25T22:17:41.151902] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-25T22:17:41.155494] [INFO ] [MAIN ] Derivative Progress: 303/2043 symbols completed. CB took 1.4s. Estimated remaining: 12m 39s. Rate: 137.5 symbols/min [2025-09-25T22:17:41.288864] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:41.311229] [DEBUG] [LOCAL ] CBRE: Loaded 51010 existing records from primary storage. [2025-09-25T22:17:41.311605] [INFO ] [MAIN ] CBRE: Loaded 51010 primary data records. [2025-09-25T22:17:41.452505] [DEBUG] [LOCAL ] CBT: Loaded 31329 existing records from primary storage. [2025-09-25T22:17:41.458924] [INFO ] [MAIN ] CBT: Loaded 31329 primary data records. [2025-09-25T22:17:41.896681] [DEBUG] [MAIN ] CBNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:42.084229] [INFO ] [MAIN ] CBNA: Generated 1807 derivative records from 2908 primary records. [2025-09-25T22:17:42.090336] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-25T22:17:42.119485] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1807 records). [2025-09-25T22:17:42.121798] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-25T22:17:42.126005] [INFO ] [MAIN ] Derivative Progress: 304/2043 symbols completed. CBNA took 1.3s. Estimated remaining: 12m 42s. Rate: 137.0 symbols/min [2025-09-25T22:17:42.128061] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:42.152245] [DEBUG] [MAIN ] CBRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:42.160437] [INFO ] [MAIN ] CBRE: Generated 1807 derivative records from 51010 primary records. [2025-09-25T22:17:42.160971] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-25T22:17:42.190987] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1807 records). [2025-09-25T22:17:42.190872] [DEBUG] [LOCAL ] CBU: Loaded 23004 existing records from primary storage. [2025-09-25T22:17:42.192127] [INFO ] [MAIN ] CBU: Loaded 23004 primary data records. [2025-09-25T22:17:42.191161] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-25T22:17:42.200846] [INFO ] [MAIN ] Derivative Progress: 305/2043 symbols completed. CBRE took 1.3s. Estimated remaining: 12m 39s. Rate: 137.3 symbols/min [2025-09-25T22:17:42.269595] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:42.269509] [DEBUG] [MAIN ] CBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:42.302086] [INFO ] [MAIN ] CBT: Generated 1807 derivative records from 31329 primary records. [2025-09-25T22:17:42.308679] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-25T22:17:42.420979] [DEBUG] [LOCAL ] CBT: Derivative data saved (1807 records). [2025-09-25T22:17:42.543069] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-25T22:17:42.546306] [INFO ] [MAIN ] Derivative Progress: 306/2043 symbols completed. CBT took 1.3s. Estimated remaining: 12m 38s. Rate: 137.4 symbols/min [2025-09-25T22:17:42.555897] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:42.572794] [DEBUG] [LOCAL ] CBZ: Loaded 33818 existing records from primary storage. [2025-09-25T22:17:42.573163] [INFO ] [MAIN ] CBZ: Loaded 33818 primary data records. [2025-09-25T22:17:42.952740] [DEBUG] [MAIN ] CBU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:42.953880] [INFO ] [MAIN ] CBU: Generated 1807 derivative records from 23004 primary records. [2025-09-25T22:17:42.954847] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-25T22:17:42.966404] [DEBUG] [LOCAL ] CC: Loaded 53416 existing records from primary storage. [2025-09-25T22:17:42.970923] [INFO ] [MAIN ] CC: Loaded 53416 primary data records. [2025-09-25T22:17:42.999690] [DEBUG] [LOCAL ] CBU: Derivative data saved (1807 records). [2025-09-25T22:17:43.016219] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-25T22:17:43.028111] [INFO ] [MAIN ] Derivative Progress: 307/2043 symbols completed. CBU took 0.9s. Estimated remaining: 12m 38s. Rate: 137.4 symbols/min [2025-09-25T22:17:43.065135] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:43.332201] [DEBUG] [MAIN ] CBZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:43.333694] [INFO ] [MAIN ] CBZ: Generated 1807 derivative records from 33818 primary records. [2025-09-25T22:17:43.334076] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-25T22:17:43.351952] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1807 records). [2025-09-25T22:17:43.352115] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-25T22:17:43.372435] [INFO ] [MAIN ] Derivative Progress: 308/2043 symbols completed. CBZ took 1.1s. Estimated remaining: 12m 37s. Rate: 137.5 symbols/min [2025-09-25T22:17:43.373407] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:43.420462] [DEBUG] [MAIN ] CC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:43.425708] [DEBUG] [LOCAL ] CCI: Loaded 53536 existing records from primary storage. [2025-09-25T22:17:43.427599] [INFO ] [MAIN ] CC: Generated 1807 derivative records from 53416 primary records. [2025-09-25T22:17:43.427944] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-25T22:17:43.427818] [INFO ] [MAIN ] CCI: Loaded 53536 primary data records. [2025-09-25T22:17:43.496681] [DEBUG] [LOCAL ] CCIF: Loaded 15490 existing records from primary storage. [2025-09-25T22:17:43.519285] [INFO ] [MAIN ] CCIF: Loaded 15490 primary data records. [2025-09-25T22:17:43.748457] [DEBUG] [LOCAL ] CC: Derivative data saved (1807 records). [2025-09-25T22:17:43.792247] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-25T22:17:43.805768] [INFO ] [MAIN ] Derivative Progress: 309/2043 symbols completed. CC took 1.3s. Estimated remaining: 12m 37s. Rate: 137.5 symbols/min [2025-09-25T22:17:43.979154] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:44.218352] [DEBUG] [MAIN ] CCIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:44.218819] [DEBUG] [MAIN ] CCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:44.219943] [INFO ] [MAIN ] CCIF: Generated 1807 derivative records from 15490 primary records. [2025-09-25T22:17:44.220053] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-25T22:17:44.220726] [INFO ] [MAIN ] CCI: Generated 1807 derivative records from 53536 primary records. [2025-09-25T22:17:44.221787] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-25T22:17:44.268098] [DEBUG] [LOCAL ] CCI: Derivative data saved (1807 records). [2025-09-25T22:17:44.269639] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-25T22:17:44.273616] [INFO ] [MAIN ] Derivative Progress: 310/2043 symbols completed. CCI took 1.2s. Estimated remaining: 12m 37s. Rate: 137.4 symbols/min [2025-09-25T22:17:44.275178] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1807 records). [2025-09-25T22:17:44.275379] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-25T22:17:44.279271] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:44.279117] [INFO ] [MAIN ] Derivative Progress: 311/2043 symbols completed. CCIF took 0.9s. Estimated remaining: 12m 34s. Rate: 137.9 symbols/min [2025-09-25T22:17:44.296955] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:44.297971] [DEBUG] [LOCAL ] CCJ: Loaded 54065 existing records from primary storage. [2025-09-25T22:17:44.298898] [INFO ] [MAIN ] CCJ: Loaded 54065 primary data records. [2025-09-25T22:17:44.685047] [DEBUG] [LOCAL ] CCK: Loaded 46723 existing records from primary storage. [2025-09-25T22:17:44.685612] [INFO ] [MAIN ] CCK: Loaded 46723 primary data records. [2025-09-25T22:17:44.686884] [DEBUG] [LOCAL ] CCL: Loaded 54190 existing records from primary storage. [2025-09-25T22:17:44.692596] [INFO ] [MAIN ] CCL: Loaded 54190 primary data records. [2025-09-25T22:17:45.013241] [DEBUG] [MAIN ] CCJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:45.079994] [INFO ] [MAIN ] CCJ: Generated 1807 derivative records from 54065 primary records. [2025-09-25T22:17:45.225525] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-25T22:17:45.410843] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1807 records). [2025-09-25T22:17:45.411626] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-25T22:17:45.414969] [INFO ] [MAIN ] Derivative Progress: 312/2043 symbols completed. CCJ took 1.4s. Estimated remaining: 12m 37s. Rate: 137.2 symbols/min [2025-09-25T22:17:45.415737] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:45.443841] [DEBUG] [MAIN ] CCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:45.444743] [INFO ] [MAIN ] CCK: Generated 1807 derivative records from 46723 primary records. [2025-09-25T22:17:45.444831] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-25T22:17:45.468993] [DEBUG] [LOCAL ] CCK: Derivative data saved (1807 records). [2025-09-25T22:17:45.469257] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-25T22:17:45.471785] [INFO ] [MAIN ] Derivative Progress: 313/2043 symbols completed. CCK took 1.2s. Estimated remaining: 12m 35s. Rate: 137.6 symbols/min [2025-09-25T22:17:45.504398] [DEBUG] [MAIN ] CCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:45.505491] [INFO ] [MAIN ] CCL: Generated 1807 derivative records from 54190 primary records. [2025-09-25T22:17:45.505682] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-25T22:17:45.537430] [DEBUG] [LOCAL ] CCO: Loaded 48012 existing records from primary storage. [2025-09-25T22:17:45.538164] [INFO ] [MAIN ] CCO: Loaded 48012 primary data records. [2025-09-25T22:17:45.625748] [DEBUG] [LOCAL ] CCL: Derivative data saved (1807 records). [2025-09-25T22:17:45.646131] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-25T22:17:45.652242] [INFO ] [MAIN ] Derivative Progress: 314/2043 symbols completed. CCL took 1.4s. Estimated remaining: 12m 33s. Rate: 137.8 symbols/min [2025-09-25T22:17:45.873103] [DEBUG] [MAIN ] CCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:45.874336] [INFO ] [MAIN ] CCO: Generated 1807 derivative records from 48012 primary records. [2025-09-25T22:17:45.874485] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-25T22:17:45.892849] [DEBUG] [LOCAL ] CCO: Derivative data saved (1807 records). [2025-09-25T22:17:45.893010] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-25T22:17:45.895466] [INFO ] [MAIN ] Derivative Progress: 315/2043 symbols completed. CCO took 0.5s. Estimated remaining: 12m 31s. Rate: 138.0 symbols/min [2025-09-25T22:17:45.896940] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:45.897244] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:45.897384] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:45.912833] [DEBUG] [LOCAL ] CCRD: Loaded 9067 existing records from primary storage. [2025-09-25T22:17:45.913131] [INFO ] [MAIN ] CCRD: Loaded 9067 primary data records. [2025-09-25T22:17:46.051670] [DEBUG] [LOCAL ] CCU: Loaded 23712 existing records from primary storage. [2025-09-25T22:17:46.068128] [INFO ] [MAIN ] CCU: Loaded 23712 primary data records. [2025-09-25T22:17:46.184717] [DEBUG] [LOCAL ] CCS: Loaded 30944 existing records from primary storage. [2025-09-25T22:17:46.353132] [INFO ] [MAIN ] CCS: Loaded 30944 primary data records. [2025-09-25T22:17:47.015839] [DEBUG] [MAIN ] CCRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:47.017689] [INFO ] [MAIN ] CCRD: Generated 1807 derivative records from 9067 primary records. [2025-09-25T22:17:47.017798] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-25T22:17:47.038442] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1807 records). [2025-09-25T22:17:47.038607] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-25T22:17:47.041796] [INFO ] [MAIN ] Derivative Progress: 316/2043 symbols completed. CCRD took 1.1s. Estimated remaining: 12m 35s. Rate: 137.3 symbols/min [2025-09-25T22:17:47.044905] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:47.062987] [DEBUG] [MAIN ] CCU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:47.067771] [INFO ] [MAIN ] CCU: Generated 1807 derivative records from 23712 primary records. [2025-09-25T22:17:47.067930] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-25T22:17:47.093529] [DEBUG] [MAIN ] CCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:47.098768] [INFO ] [MAIN ] CCS: Generated 1807 derivative records from 30944 primary records. [2025-09-25T22:17:47.099697] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-25T22:17:47.117270] [DEBUG] [LOCAL ] CCU: Derivative data saved (1807 records). [2025-09-25T22:17:47.121920] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-25T22:17:47.121780] [DEBUG] [LOCAL ] CCS: Derivative data saved (1807 records). [2025-09-25T22:17:47.122175] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-25T22:17:47.124353] [INFO ] [MAIN ] Derivative Progress: 317/2043 symbols completed. CCU took 1.2s. Estimated remaining: 12m 32s. Rate: 137.6 symbols/min [2025-09-25T22:17:47.127873] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:47.127950] [INFO ] [MAIN ] Derivative Progress: 318/2043 symbols completed. CCS took 1.2s. Estimated remaining: 12m 30s. Rate: 138.1 symbols/min [2025-09-25T22:17:47.128816] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:47.155550] [DEBUG] [LOCAL ] CDLR: Loaded 9877 existing records from primary storage. [2025-09-25T22:17:47.155819] [INFO ] [MAIN ] CDLR: Loaded 9877 primary data records. [2025-09-25T22:17:47.330281] [DEBUG] [LOCAL ] CDE: Loaded 54031 existing records from primary storage. [2025-09-25T22:17:47.358746] [INFO ] [MAIN ] CDE: Loaded 54031 primary data records. [2025-09-25T22:17:47.642064] [DEBUG] [LOCAL ] CDP: Loaded 43032 existing records from primary storage. [2025-09-25T22:17:47.643812] [INFO ] [MAIN ] CDP: Loaded 43032 primary data records. [2025-09-25T22:17:48.218209] [DEBUG] [MAIN ] CDLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:48.220292] [INFO ] [MAIN ] CDLR: Generated 1807 derivative records from 9877 primary records. [2025-09-25T22:17:48.220715] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-25T22:17:48.260573] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1807 records). [2025-09-25T22:17:48.259722] [DEBUG] [MAIN ] CDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:48.260923] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-25T22:17:48.262085] [INFO ] [MAIN ] CDE: Generated 1807 derivative records from 54031 primary records. [2025-09-25T22:17:48.262455] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-25T22:17:48.264942] [INFO ] [MAIN ] Derivative Progress: 319/2043 symbols completed. CDLR took 1.1s. Estimated remaining: 12m 33s. Rate: 137.4 symbols/min [2025-09-25T22:17:48.273789] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:48.288106] [DEBUG] [LOCAL ] CDE: Derivative data saved (1807 records). [2025-09-25T22:17:48.296170] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-25T22:17:48.303499] [INFO ] [MAIN ] Derivative Progress: 320/2043 symbols completed. CDE took 1.3s. Estimated remaining: 12m 30s. Rate: 137.8 symbols/min [2025-09-25T22:17:48.304383] [DEBUG] [MAIN ] CDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:48.304694] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:48.305799] [INFO ] [MAIN ] CDP: Generated 1807 derivative records from 43032 primary records. [2025-09-25T22:17:48.306380] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-25T22:17:48.331881] [DEBUG] [LOCAL ] CDP: Derivative data saved (1807 records). [2025-09-25T22:17:48.332189] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-25T22:17:48.335958] [INFO ] [MAIN ] Derivative Progress: 321/2043 symbols completed. CDP took 1.2s. Estimated remaining: 12m 28s. Rate: 138.2 symbols/min [2025-09-25T22:17:48.336435] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:48.348180] [DEBUG] [LOCAL ] CDRE: Loaded 25608 existing records from primary storage. [2025-09-25T22:17:48.348549] [INFO ] [MAIN ] CDRE: Loaded 25608 primary data records. [2025-09-25T22:17:48.409021] [DEBUG] [LOCAL ] CEE: Loaded 6682 existing records from primary storage. [2025-09-25T22:17:48.424138] [INFO ] [MAIN ] CEE: Loaded 6682 primary data records. [2025-09-25T22:17:48.904810] [DEBUG] [LOCAL ] CE: Loaded 51931 existing records from primary storage. [2025-09-25T22:17:48.908593] [INFO ] [MAIN ] CE: Loaded 51931 primary data records. [2025-09-25T22:17:49.495026] [DEBUG] [MAIN ] CDRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:49.496168] [INFO ] [MAIN ] CDRE: Generated 1807 derivative records from 25608 primary records. [2025-09-25T22:17:49.497364] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-25T22:17:49.530684] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1807 records). [2025-09-25T22:17:49.530927] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-25T22:17:49.530032] [DEBUG] [MAIN ] CEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:49.534367] [INFO ] [MAIN ] Derivative Progress: 322/2043 symbols completed. CDRE took 1.3s. Estimated remaining: 12m 31s. Rate: 137.4 symbols/min [2025-09-25T22:17:49.536432] [INFO ] [MAIN ] CEE: Generated 1807 derivative records from 6682 primary records. [2025-09-25T22:17:49.537152] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-25T22:17:49.537413] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:49.567678] [DEBUG] [MAIN ] CE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:49.568841] [DEBUG] [LOCAL ] CEE: Derivative data saved (1807 records). [2025-09-25T22:17:49.569135] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-25T22:17:49.571333] [INFO ] [MAIN ] Derivative Progress: 323/2043 symbols completed. CEE took 1.2s. Estimated remaining: 12m 29s. Rate: 137.8 symbols/min [2025-09-25T22:17:49.572794] [INFO ] [MAIN ] CE: Generated 1807 derivative records from 51931 primary records. [2025-09-25T22:17:49.572938] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-25T22:17:49.571810] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:49.598427] [DEBUG] [LOCAL ] CE: Derivative data saved (1807 records). [2025-09-25T22:17:49.598664] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-25T22:17:49.601584] [INFO ] [MAIN ] Derivative Progress: 324/2043 symbols completed. CE took 1.3s. Estimated remaining: 12m 26s. Rate: 138.2 symbols/min [2025-09-25T22:17:49.609630] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:49.611634] [DEBUG] [LOCAL ] CEPU: Loaded 26270 existing records from primary storage. [2025-09-25T22:17:49.611859] [INFO ] [MAIN ] CEPU: Loaded 26270 primary data records. [2025-09-25T22:17:49.985926] [DEBUG] [LOCAL ] CF: Loaded 52619 existing records from primary storage. [2025-09-25T22:17:49.986234] [INFO ] [MAIN ] CF: Loaded 52619 primary data records. [2025-09-25T22:17:50.105553] [DEBUG] [LOCAL ] CFG: Loaded 54014 existing records from primary storage. [2025-09-25T22:17:50.123413] [INFO ] [MAIN ] CFG: Loaded 54014 primary data records. [2025-09-25T22:17:50.792773] [DEBUG] [MAIN ] CEPU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:50.794164] [INFO ] [MAIN ] CEPU: Generated 1807 derivative records from 26270 primary records. [2025-09-25T22:17:50.794439] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-25T22:17:50.818885] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1807 records). [2025-09-25T22:17:50.819331] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-25T22:17:50.822135] [INFO ] [MAIN ] Derivative Progress: 325/2043 symbols completed. CEPU took 1.3s. Estimated remaining: 12m 30s. Rate: 137.4 symbols/min [2025-09-25T22:17:50.823077] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:50.844631] [DEBUG] [MAIN ] CF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:50.847543] [INFO ] [MAIN ] CF: Generated 1807 derivative records from 52619 primary records. [2025-09-25T22:17:50.847886] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-25T22:17:50.861460] [DEBUG] [MAIN ] CFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:50.862606] [INFO ] [MAIN ] CFG: Generated 1807 derivative records from 54014 primary records. [2025-09-25T22:17:50.863062] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-25T22:17:50.890366] [DEBUG] [LOCAL ] CF: Derivative data saved (1807 records). [2025-09-25T22:17:50.902560] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-25T22:17:50.906009] [INFO ] [MAIN ] Derivative Progress: 326/2043 symbols completed. CF took 1.3s. Estimated remaining: 12m 28s. Rate: 137.8 symbols/min [2025-09-25T22:17:50.907259] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:50.925511] [DEBUG] [LOCAL ] CFG: Derivative data saved (1807 records). [2025-09-25T22:17:50.925717] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-25T22:17:50.929503] [INFO ] [MAIN ] Derivative Progress: 327/2043 symbols completed. CFG took 1.3s. Estimated remaining: 12m 25s. Rate: 138.2 symbols/min [2025-09-25T22:17:50.931237] [DEBUG] [LOCAL ] CFR: Loaded 33773 existing records from primary storage. [2025-09-25T22:17:50.931407] [INFO ] [MAIN ] CFR: Loaded 33773 primary data records. [2025-09-25T22:17:50.930073] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:51.016040] [DEBUG] [LOCAL ] CGV: Loaded 1421 existing records from primary storage. [2025-09-25T22:17:51.023187] [INFO ] [MAIN ] CGV: Loaded 1421 primary data records. [2025-09-25T22:17:51.327063] [DEBUG] [LOCAL ] CGAU: Loaded 43062 existing records from primary storage. [2025-09-25T22:17:51.498348] [INFO ] [MAIN ] CGAU: Loaded 43062 primary data records. [2025-09-25T22:17:51.990466] [DEBUG] [MAIN ] CGV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:17:51.991383] [DEBUG] [MAIN ] CFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:51.992579] [INFO ] [MAIN ] CGV: Generated 1806 derivative records from 1421 primary records. [2025-09-25T22:17:51.993051] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-25T22:17:51.994164] [INFO ] [MAIN ] CFR: Generated 1807 derivative records from 33773 primary records. [2025-09-25T22:17:52.001555] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-25T22:17:52.025947] [DEBUG] [LOCAL ] CGV: Derivative data saved (1806 records). [2025-09-25T22:17:52.028861] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-25T22:17:52.032189] [INFO ] [MAIN ] Derivative Progress: 328/2043 symbols completed. CGV took 1.1s. Estimated remaining: 12m 28s. Rate: 137.5 symbols/min [2025-09-25T22:17:52.046772] [DEBUG] [LOCAL ] CFR: Derivative data saved (1807 records). [2025-09-25T22:17:52.047011] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-25T22:17:52.047355] [DEBUG] [MAIN ] CGAU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:52.050427] [INFO ] [MAIN ] Derivative Progress: 329/2043 symbols completed. CFR took 1.2s. Estimated remaining: 12m 26s. Rate: 137.9 symbols/min [2025-09-25T22:17:52.051419] [INFO ] [MAIN ] CGAU: Generated 1807 derivative records from 43062 primary records. [2025-09-25T22:17:52.051495] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-25T22:17:52.066908] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1807 records). [2025-09-25T22:17:52.066972] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-25T22:17:52.069758] [INFO ] [MAIN ] Derivative Progress: 330/2043 symbols completed. CGAU took 1.2s. Estimated remaining: 12m 23s. Rate: 138.3 symbols/min [2025-09-25T22:17:52.070916] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:52.070770] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:52.070579] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:52.090355] [DEBUG] [LOCAL ] CHE: Loaded 14915 existing records from primary storage. [2025-09-25T22:17:52.090750] [INFO ] [MAIN ] CHE: Loaded 14915 primary data records. [2025-09-25T22:17:52.226467] [DEBUG] [LOCAL ] CHCT: Loaded 24167 existing records from primary storage. [2025-09-25T22:17:52.226968] [INFO ] [MAIN ] CHCT: Loaded 24167 primary data records. [2025-09-25T22:17:52.644299] [DEBUG] [LOCAL ] CHD: Loaded 52397 existing records from primary storage. [2025-09-25T22:17:52.656601] [INFO ] [MAIN ] CHD: Loaded 52397 primary data records. [2025-09-25T22:17:53.253406] [DEBUG] [MAIN ] CHE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:53.254388] [INFO ] [MAIN ] CHE: Generated 1807 derivative records from 14915 primary records. [2025-09-25T22:17:53.254567] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-25T22:17:53.277883] [DEBUG] [LOCAL ] CHE: Derivative data saved (1807 records). [2025-09-25T22:17:53.278492] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-25T22:17:53.281112] [INFO ] [MAIN ] Derivative Progress: 331/2043 symbols completed. CHE took 1.2s. Estimated remaining: 12m 27s. Rate: 137.6 symbols/min [2025-09-25T22:17:53.289538] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:53.295937] [DEBUG] [MAIN ] CHCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:53.300257] [INFO ] [MAIN ] CHCT: Generated 1807 derivative records from 24167 primary records. [2025-09-25T22:17:53.300888] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-25T22:17:53.337288] [DEBUG] [MAIN ] CHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:53.341446] [INFO ] [MAIN ] CHD: Generated 1807 derivative records from 52397 primary records. [2025-09-25T22:17:53.340599] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1807 records). [2025-09-25T22:17:53.341836] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-25T22:17:53.344746] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-25T22:17:53.344551] [INFO ] [MAIN ] Derivative Progress: 332/2043 symbols completed. CHCT took 1.3s. Estimated remaining: 12m 24s. Rate: 137.9 symbols/min [2025-09-25T22:17:53.355678] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:53.376735] [DEBUG] [LOCAL ] CHD: Derivative data saved (1807 records). [2025-09-25T22:17:53.376935] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-25T22:17:53.379967] [INFO ] [MAIN ] Derivative Progress: 333/2043 symbols completed. CHD took 1.3s. Estimated remaining: 12m 22s. Rate: 138.3 symbols/min [2025-09-25T22:17:53.380432] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:53.398921] [DEBUG] [LOCAL ] CHGG: Loaded 48072 existing records from primary storage. [2025-09-25T22:17:53.399200] [INFO ] [MAIN ] CHGG: Loaded 48072 primary data records. [2025-09-25T22:17:53.601681] [DEBUG] [LOCAL ] CHH: Loaded 32491 existing records from primary storage. [2025-09-25T22:17:53.648118] [DEBUG] [LOCAL ] CHMI: Loaded 22183 existing records from primary storage. [2025-09-25T22:17:53.778614] [INFO ] [MAIN ] CHH: Loaded 32491 primary data records. [2025-09-25T22:17:53.779565] [INFO ] [MAIN ] CHMI: Loaded 22183 primary data records. [2025-09-25T22:17:54.504411] [DEBUG] [MAIN ] CHGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:54.505552] [INFO ] [MAIN ] CHGG: Generated 1807 derivative records from 48072 primary records. [2025-09-25T22:17:54.506154] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-25T22:17:54.539610] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1807 records). [2025-09-25T22:17:54.540364] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-25T22:17:54.559122] [DEBUG] [MAIN ] CHMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:54.558232] [INFO ] [MAIN ] Derivative Progress: 334/2043 symbols completed. CHGG took 1.3s. Estimated remaining: 12m 25s. Rate: 137.6 symbols/min [2025-09-25T22:17:54.560173] [INFO ] [MAIN ] CHMI: Generated 1807 derivative records from 22183 primary records. [2025-09-25T22:17:54.560610] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-25T22:17:54.560432] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:54.585454] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1807 records). [2025-09-25T22:17:54.599725] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-25T22:17:54.600506] [DEBUG] [MAIN ] CHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:54.603300] [INFO ] [MAIN ] Derivative Progress: 335/2043 symbols completed. CHMI took 1.2s. Estimated remaining: 12m 23s. Rate: 138.0 symbols/min [2025-09-25T22:17:54.608371] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:54.608099] [INFO ] [MAIN ] CHH: Generated 1807 derivative records from 32491 primary records. [2025-09-25T22:17:54.607091] [DEBUG] [LOCAL ] CHN: Loaded 4885 existing records from primary storage. [2025-09-25T22:17:54.608623] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-25T22:17:54.608888] [INFO ] [MAIN ] CHN: Loaded 4885 primary data records. [2025-09-25T22:17:54.767022] [DEBUG] [LOCAL ] CHH: Derivative data saved (1807 records). [2025-09-25T22:17:54.767722] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-25T22:17:54.777098] [INFO ] [MAIN ] Derivative Progress: 336/2043 symbols completed. CHH took 1.4s. Estimated remaining: 12m 21s. Rate: 138.2 symbols/min [2025-09-25T22:17:54.846328] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:55.127616] [DEBUG] [LOCAL ] CHPT: Loaded 49531 existing records from primary storage. [2025-09-25T22:17:55.140922] [INFO ] [MAIN ] CHPT: Loaded 49531 primary data records. [2025-09-25T22:17:55.307023] [DEBUG] [LOCAL ] CHT: Loaded 19677 existing records from primary storage. [2025-09-25T22:17:55.330142] [INFO ] [MAIN ] CHT: Loaded 19677 primary data records. [2025-09-25T22:17:55.805206] [DEBUG] [MAIN ] CHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:55.806390] [INFO ] [MAIN ] CHN: Generated 1807 derivative records from 4885 primary records. [2025-09-25T22:17:55.806722] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-25T22:17:55.947815] [DEBUG] [LOCAL ] CHN: Derivative data saved (1807 records). [2025-09-25T22:17:55.949061] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-25T22:17:55.951931] [INFO ] [MAIN ] Derivative Progress: 337/2043 symbols completed. CHN took 1.4s. Estimated remaining: 12m 24s. Rate: 137.5 symbols/min [2025-09-25T22:17:55.952949] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:55.975533] [DEBUG] [MAIN ] CHPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:55.976392] [INFO ] [MAIN ] CHPT: Generated 1807 derivative records from 49531 primary records. [2025-09-25T22:17:55.976810] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-25T22:17:55.998050] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1807 records). [2025-09-25T22:17:55.998314] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-25T22:17:56.001400] [INFO ] [MAIN ] Derivative Progress: 338/2043 symbols completed. CHPT took 1.4s. Estimated remaining: 12m 22s. Rate: 137.9 symbols/min [2025-09-25T22:17:56.014585] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:56.015782] [DEBUG] [MAIN ] CHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:56.016669] [INFO ] [MAIN ] CHT: Generated 1807 derivative records from 19677 primary records. [2025-09-25T22:17:56.016983] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-25T22:17:56.049771] [DEBUG] [LOCAL ] CHT: Derivative data saved (1807 records). [2025-09-25T22:17:56.049954] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-25T22:17:56.052733] [INFO ] [MAIN ] Derivative Progress: 339/2043 symbols completed. CHT took 1.3s. Estimated remaining: 12m 19s. Rate: 138.3 symbols/min [2025-09-25T22:17:56.053295] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:56.071056] [DEBUG] [LOCAL ] CHWY: Loaded 54044 existing records from primary storage. [2025-09-25T22:17:56.071343] [INFO ] [MAIN ] CHWY: Loaded 54044 primary data records. [2025-09-25T22:17:56.208022] [DEBUG] [LOCAL ] CIA: Loaded 17101 existing records from primary storage. [2025-09-25T22:17:56.218767] [INFO ] [MAIN ] CIA: Loaded 17101 primary data records. [2025-09-25T22:17:56.517470] [DEBUG] [LOCAL ] CI: Loaded 50220 existing records from primary storage. [2025-09-25T22:17:56.539138] [INFO ] [MAIN ] CI: Loaded 50220 primary data records. [2025-09-25T22:17:57.106225] [DEBUG] [MAIN ] CHWY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:57.107503] [INFO ] [MAIN ] CHWY: Generated 1807 derivative records from 54044 primary records. [2025-09-25T22:17:57.107922] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-25T22:17:57.130045] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1807 records). [2025-09-25T22:17:57.132512] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-25T22:17:57.135110] [INFO ] [MAIN ] Derivative Progress: 340/2043 symbols completed. CHWY took 1.2s. Estimated remaining: 12m 22s. Rate: 137.7 symbols/min [2025-09-25T22:17:57.135931] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:57.150247] [DEBUG] [MAIN ] CIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:57.151215] [INFO ] [MAIN ] CIA: Generated 1807 derivative records from 17101 primary records. [2025-09-25T22:17:57.151479] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-25T22:17:57.190278] [DEBUG] [LOCAL ] CIA: Derivative data saved (1807 records). [2025-09-25T22:17:57.199834] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-25T22:17:57.202550] [INFO ] [MAIN ] Derivative Progress: 341/2043 symbols completed. CIA took 1.1s. Estimated remaining: 12m 20s. Rate: 138.0 symbols/min [2025-09-25T22:17:57.199622] [DEBUG] [MAIN ] CI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:57.213126] [INFO ] [MAIN ] CI: Generated 1807 derivative records from 50220 primary records. [2025-09-25T22:17:57.213463] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:57.213626] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-25T22:17:57.239976] [DEBUG] [LOCAL ] CIB: Loaded 31225 existing records from primary storage. [2025-09-25T22:17:57.240782] [INFO ] [MAIN ] CIB: Loaded 31225 primary data records. [2025-09-25T22:17:57.354404] [DEBUG] [LOCAL ] CI: Derivative data saved (1807 records). [2025-09-25T22:17:57.382224] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-25T22:17:57.397302] [INFO ] [MAIN ] Derivative Progress: 342/2043 symbols completed. CI took 1.4s. Estimated remaining: 12m 18s. Rate: 138.2 symbols/min [2025-09-25T22:17:57.433057] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:57.651358] [DEBUG] [LOCAL ] CIEN: Loaded 52465 existing records from primary storage. [2025-09-25T22:17:57.652423] [INFO ] [MAIN ] CIEN: Loaded 52465 primary data records. [2025-09-25T22:17:57.721532] [DEBUG] [LOCAL ] CIF: Loaded 4369 existing records from primary storage. [2025-09-25T22:17:57.742404] [INFO ] [MAIN ] CIF: Loaded 4369 primary data records. [2025-09-25T22:17:58.365929] [DEBUG] [MAIN ] CIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:58.368133] [INFO ] [MAIN ] CIB: Generated 1807 derivative records from 31225 primary records. [2025-09-25T22:17:58.368579] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-25T22:17:58.390678] [DEBUG] [LOCAL ] CIB: Derivative data saved (1807 records). [2025-09-25T22:17:58.391165] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-25T22:17:58.393794] [INFO ] [MAIN ] Derivative Progress: 343/2043 symbols completed. CIB took 1.3s. Estimated remaining: 12m 21s. Rate: 137.7 symbols/min [2025-09-25T22:17:58.416303] [DEBUG] [MAIN ] CIEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:58.419061] [INFO ] [MAIN ] CIEN: Generated 1807 derivative records from 52465 primary records. [2025-09-25T22:17:58.419188] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-25T22:17:58.445120] [DEBUG] [MAIN ] CIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:58.448859] [INFO ] [MAIN ] CIF: Generated 1807 derivative records from 4369 primary records. [2025-09-25T22:17:58.449224] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-25T22:17:58.466031] [DEBUG] [LOCAL ] CIF: Derivative data saved (1807 records). [2025-09-25T22:17:58.466995] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-25T22:17:58.470524] [INFO ] [MAIN ] Derivative Progress: 344/2043 symbols completed. CIF took 1.0s. Estimated remaining: 12m 19s. Rate: 138.0 symbols/min [2025-09-25T22:17:58.473185] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1807 records). [2025-09-25T22:17:58.473285] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-25T22:17:58.476115] [INFO ] [MAIN ] Derivative Progress: 345/2043 symbols completed. CIEN took 1.3s. Estimated remaining: 12m 16s. Rate: 138.4 symbols/min [2025-09-25T22:17:58.476927] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:58.477237] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:58.477683] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:58.503274] [DEBUG] [LOCAL ] CII: Loaded 15570 existing records from primary storage. [2025-09-25T22:17:58.503598] [INFO ] [MAIN ] CII: Loaded 15570 primary data records. [2025-09-25T22:17:58.713320] [DEBUG] [LOCAL ] CIM: Loaded 37567 existing records from primary storage. [2025-09-25T22:17:58.759789] [INFO ] [MAIN ] CIM: Loaded 37567 primary data records. [2025-09-25T22:17:58.944247] [DEBUG] [LOCAL ] CIG: Loaded 44114 existing records from primary storage. [2025-09-25T22:17:58.972838] [INFO ] [MAIN ] CIG: Loaded 44114 primary data records. [2025-09-25T22:17:59.630092] [DEBUG] [MAIN ] CII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:59.631486] [INFO ] [MAIN ] CII: Generated 1807 derivative records from 15570 primary records. [2025-09-25T22:17:59.631664] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-25T22:17:59.654888] [DEBUG] [LOCAL ] CII: Derivative data saved (1807 records). [2025-09-25T22:17:59.655229] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-25T22:17:59.657969] [INFO ] [MAIN ] Derivative Progress: 346/2043 symbols completed. CII took 1.2s. Estimated remaining: 12m 19s. Rate: 137.7 symbols/min [2025-09-25T22:17:59.666592] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:17:59.672913] [DEBUG] [MAIN ] CIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:59.674173] [INFO ] [MAIN ] CIM: Generated 1807 derivative records from 37567 primary records. [2025-09-25T22:17:59.674681] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-25T22:17:59.694186] [DEBUG] [LOCAL ] CIMN: Loaded 2678 existing records from primary storage. [2025-09-25T22:17:59.694964] [INFO ] [MAIN ] CIMN: Loaded 2678 primary data records. [2025-09-25T22:17:59.731289] [DEBUG] [MAIN ] CIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:17:59.756903] [INFO ] [MAIN ] CIG: Generated 1807 derivative records from 44114 primary records. [2025-09-25T22:17:59.785183] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-25T22:17:59.825207] [DEBUG] [LOCAL ] CIM: Derivative data saved (1807 records). [2025-09-25T22:17:59.832544] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-25T22:17:59.840240] [INFO ] [MAIN ] Derivative Progress: 347/2043 symbols completed. CIM took 1.4s. Estimated remaining: 12m 18s. Rate: 138.0 symbols/min [2025-09-25T22:17:59.860019] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:00.053877] [DEBUG] [LOCAL ] CIG: Derivative data saved (1807 records). [2025-09-25T22:18:00.059399] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-25T22:18:00.062488] [INFO ] [MAIN ] Derivative Progress: 348/2043 symbols completed. CIG took 1.6s. Estimated remaining: 12m 16s. Rate: 138.2 symbols/min [2025-09-25T22:18:00.062967] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:00.075770] [DEBUG] [LOCAL ] CINT: Loaded 18698 existing records from primary storage. [2025-09-25T22:18:00.076359] [INFO ] [MAIN ] CINT: Loaded 18698 primary data records. [2025-09-25T22:18:00.197100] [DEBUG] [LOCAL ] CIO: Loaded 20205 existing records from primary storage. [2025-09-25T22:18:00.219149] [INFO ] [MAIN ] CIO: Loaded 20205 primary data records. [2025-09-25T22:18:00.606070] [DEBUG] [MAIN ] CIMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:00.769259] [INFO ] [MAIN ] CIMN: Generated 1807 derivative records from 2678 primary records. [2025-09-25T22:18:00.770400] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-25T22:18:00.795140] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1807 records). [2025-09-25T22:18:00.796965] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-25T22:18:00.799452] [INFO ] [MAIN ] Derivative Progress: 349/2043 symbols completed. CIMN took 1.1s. Estimated remaining: 12m 17s. Rate: 137.9 symbols/min [2025-09-25T22:18:00.799966] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:00.819009] [DEBUG] [MAIN ] CINT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:00.820260] [INFO ] [MAIN ] CINT: Generated 1807 derivative records from 18698 primary records. [2025-09-25T22:18:00.821635] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-25T22:18:00.859229] [DEBUG] [MAIN ] CIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:00.861587] [INFO ] [MAIN ] CIO: Generated 1807 derivative records from 20205 primary records. [2025-09-25T22:18:00.862007] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-25T22:18:00.887927] [DEBUG] [LOCAL ] CION: Loaded 29526 existing records from primary storage. [2025-09-25T22:18:00.889366] [DEBUG] [LOCAL ] CINT: Derivative data saved (1807 records). [2025-09-25T22:18:00.891864] [INFO ] [MAIN ] CION: Loaded 29526 primary data records. [2025-09-25T22:18:00.891730] [DEBUG] [LOCAL ] CIO: Derivative data saved (1807 records). [2025-09-25T22:18:00.892047] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-25T22:18:00.892376] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-25T22:18:00.895825] [INFO ] [MAIN ] Derivative Progress: 350/2043 symbols completed. CINT took 1.0s. Estimated remaining: 12m 15s. Rate: 138.2 symbols/min [2025-09-25T22:18:00.907805] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:00.947064] [INFO ] [MAIN ] Derivative Progress: 351/2043 symbols completed. CIO took 0.9s. Estimated remaining: 12m 13s. Rate: 138.5 symbols/min [2025-09-25T22:18:00.985049] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:01.263975] [DEBUG] [LOCAL ] CLCO: Loaded 13067 existing records from primary storage. [2025-09-25T22:18:01.264376] [INFO ] [MAIN ] CLCO: Loaded 13067 primary data records. [2025-09-25T22:18:01.440312] [DEBUG] [LOCAL ] CL: Loaded 54034 existing records from primary storage. [2025-09-25T22:18:01.495830] [INFO ] [MAIN ] CL: Loaded 54034 primary data records. [2025-09-25T22:18:02.030093] [DEBUG] [MAIN ] CION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:02.042760] [INFO ] [MAIN ] CION: Generated 1807 derivative records from 29526 primary records. [2025-09-25T22:18:02.043338] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-25T22:18:02.082742] [DEBUG] [LOCAL ] CION: Derivative data saved (1807 records). [2025-09-25T22:18:02.083456] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-25T22:18:02.083277] [DEBUG] [MAIN ] CLCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:02.086266] [INFO ] [MAIN ] Derivative Progress: 352/2043 symbols completed. CION took 1.3s. Estimated remaining: 12m 16s. Rate: 137.9 symbols/min [2025-09-25T22:18:02.087579] [INFO ] [MAIN ] CLCO: Generated 1807 derivative records from 13067 primary records. [2025-09-25T22:18:02.087961] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-25T22:18:02.088178] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:02.106757] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1807 records). [2025-09-25T22:18:02.107367] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-25T22:18:02.110536] [INFO ] [MAIN ] Derivative Progress: 353/2043 symbols completed. CLCO took 1.1s. Estimated remaining: 12m 13s. Rate: 138.3 symbols/min [2025-09-25T22:18:02.113093] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:02.135554] [DEBUG] [MAIN ] CL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:02.136480] [INFO ] [MAIN ] CL: Generated 1807 derivative records from 54034 primary records. [2025-09-25T22:18:02.146265] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-25T22:18:02.147699] [DEBUG] [LOCAL ] CLDT: Loaded 25900 existing records from primary storage. [2025-09-25T22:18:02.148217] [INFO ] [MAIN ] CLDT: Loaded 25900 primary data records. [2025-09-25T22:18:02.308478] [DEBUG] [LOCAL ] CL: Derivative data saved (1807 records). [2025-09-25T22:18:02.307393] [DEBUG] [LOCAL ] CLH: Loaded 28304 existing records from primary storage. [2025-09-25T22:18:02.319293] [INFO ] [MAIN ] CLH: Loaded 28304 primary data records. [2025-09-25T22:18:02.313941] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-25T22:18:02.354539] [INFO ] [MAIN ] Derivative Progress: 354/2043 symbols completed. CL took 1.5s. Estimated remaining: 12m 12s. Rate: 138.5 symbols/min [2025-09-25T22:18:02.388470] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:02.746863] [DEBUG] [LOCAL ] CLPR: Loaded 11575 existing records from primary storage. [2025-09-25T22:18:02.771456] [INFO ] [MAIN ] CLPR: Loaded 11575 primary data records. [2025-09-25T22:18:03.242906] [DEBUG] [MAIN ] CLDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:03.243984] [INFO ] [MAIN ] CLDT: Generated 1807 derivative records from 25900 primary records. [2025-09-25T22:18:03.244174] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-25T22:18:03.262526] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1807 records). [2025-09-25T22:18:03.264911] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-25T22:18:03.268266] [INFO ] [MAIN ] Derivative Progress: 355/2043 symbols completed. CLDT took 1.2s. Estimated remaining: 12m 14s. Rate: 138.0 symbols/min [2025-09-25T22:18:03.269260] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:03.283799] [DEBUG] [MAIN ] CLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:03.284525] [INFO ] [MAIN ] CLH: Generated 1807 derivative records from 28304 primary records. [2025-09-25T22:18:03.284737] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-25T22:18:03.306065] [DEBUG] [LOCAL ] CLH: Derivative data saved (1807 records). [2025-09-25T22:18:03.306269] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-25T22:18:03.308768] [INFO ] [MAIN ] Derivative Progress: 356/2043 symbols completed. CLH took 1.2s. Estimated remaining: 12m 12s. Rate: 138.4 symbols/min [2025-09-25T22:18:03.309122] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:03.323006] [DEBUG] [MAIN ] CLPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:03.323852] [INFO ] [MAIN ] CLPR: Generated 1807 derivative records from 11575 primary records. [2025-09-25T22:18:03.324016] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-25T22:18:03.341816] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1807 records). [2025-09-25T22:18:03.355831] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-25T22:18:03.359165] [INFO ] [MAIN ] Derivative Progress: 357/2043 symbols completed. CLPR took 1.0s. Estimated remaining: 12m 9s. Rate: 138.7 symbols/min [2025-09-25T22:18:03.359739] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:03.390907] [DEBUG] [LOCAL ] CLS: Loaded 54024 existing records from primary storage. [2025-09-25T22:18:03.391176] [INFO ] [MAIN ] CLS: Loaded 54024 primary data records. [2025-09-25T22:18:03.505422] [DEBUG] [LOCAL ] CLW: Loaded 22067 existing records from primary storage. [2025-09-25T22:18:03.568199] [INFO ] [MAIN ] CLW: Loaded 22067 primary data records. [2025-09-25T22:18:03.648247] [DEBUG] [LOCAL ] CLVT: Loaded 52329 existing records from primary storage. [2025-09-25T22:18:03.762758] [INFO ] [MAIN ] CLVT: Loaded 52329 primary data records. [2025-09-25T22:18:04.525883] [DEBUG] [MAIN ] CLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:04.528242] [INFO ] [MAIN ] CLS: Generated 1807 derivative records from 54024 primary records. [2025-09-25T22:18:04.528545] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-25T22:18:04.565852] [DEBUG] [MAIN ] CLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:04.567910] [INFO ] [MAIN ] CLW: Generated 1807 derivative records from 22067 primary records. [2025-09-25T22:18:04.568178] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-25T22:18:04.581174] [DEBUG] [LOCAL ] CLS: Derivative data saved (1807 records). [2025-09-25T22:18:04.584172] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-25T22:18:04.588108] [INFO ] [MAIN ] Derivative Progress: 358/2043 symbols completed. CLS took 1.3s. Estimated remaining: 12m 13s. Rate: 138.0 symbols/min [2025-09-25T22:18:04.609633] [DEBUG] [MAIN ] CLVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:04.611133] [INFO ] [MAIN ] CLVT: Generated 1807 derivative records from 52329 primary records. [2025-09-25T22:18:04.610276] [DEBUG] [LOCAL ] CLW: Derivative data saved (1807 records). [2025-09-25T22:18:04.611257] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-25T22:18:04.611317] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-25T22:18:04.614026] [INFO ] [MAIN ] Derivative Progress: 359/2043 symbols completed. CLW took 1.3s. Estimated remaining: 12m 10s. Rate: 138.4 symbols/min [2025-09-25T22:18:04.630859] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1807 records). [2025-09-25T22:18:04.630990] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-25T22:18:04.634522] [INFO ] [MAIN ] Derivative Progress: 360/2043 symbols completed. CLVT took 1.3s. Estimated remaining: 12m 8s. Rate: 138.7 symbols/min [2025-09-25T22:18:04.635731] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:04.635820] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:04.635976] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:04.663427] [DEBUG] [LOCAL ] CMBT: Loaded 22580 existing records from primary storage. [2025-09-25T22:18:04.663618] [INFO ] [MAIN ] CMBT: Loaded 22580 primary data records. [2025-09-25T22:18:04.851544] [DEBUG] [LOCAL ] CMC: Loaded 45990 existing records from primary storage. [2025-09-25T22:18:04.891698] [INFO ] [MAIN ] CMC: Loaded 45990 primary data records. [2025-09-25T22:18:04.956784] [DEBUG] [LOCAL ] CMA: Loaded 50401 existing records from primary storage. [2025-09-25T22:18:05.091613] [INFO ] [MAIN ] CMA: Loaded 50401 primary data records. [2025-09-25T22:18:05.754736] [DEBUG] [MAIN ] CMBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:05.756255] [INFO ] [MAIN ] CMBT: Generated 1807 derivative records from 22580 primary records. [2025-09-25T22:18:05.757096] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-25T22:18:05.798319] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1807 records). [2025-09-25T22:18:05.799106] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-25T22:18:05.798999] [DEBUG] [MAIN ] CMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:05.801988] [INFO ] [MAIN ] Derivative Progress: 361/2043 symbols completed. CMBT took 1.2s. Estimated remaining: 12m 11s. Rate: 138.1 symbols/min [2025-09-25T22:18:05.803943] [INFO ] [MAIN ] CMC: Generated 1807 derivative records from 45990 primary records. [2025-09-25T22:18:05.802692] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:05.804695] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-25T22:18:05.819868] [DEBUG] [MAIN ] CMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:05.831004] [INFO ] [MAIN ] CMA: Generated 1807 derivative records from 50401 primary records. [2025-09-25T22:18:05.837699] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-25T22:18:05.840561] [DEBUG] [LOCAL ] CMC: Derivative data saved (1807 records). [2025-09-25T22:18:05.840723] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-25T22:18:05.844332] [DEBUG] [LOCAL ] CMCM: Loaded 4788 existing records from primary storage. [2025-09-25T22:18:05.848500] [INFO ] [MAIN ] CMCM: Loaded 4788 primary data records. [2025-09-25T22:18:05.848242] [INFO ] [MAIN ] Derivative Progress: 362/2043 symbols completed. CMC took 1.2s. Estimated remaining: 12m 9s. Rate: 138.4 symbols/min [2025-09-25T22:18:05.909536] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:05.984417] [DEBUG] [LOCAL ] CMA: Derivative data saved (1807 records). [2025-09-25T22:18:05.984793] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-25T22:18:05.993841] [INFO ] [MAIN ] Derivative Progress: 363/2043 symbols completed. CMA took 1.4s. Estimated remaining: 12m 7s. Rate: 138.7 symbols/min [2025-09-25T22:18:06.015611] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:06.262776] [DEBUG] [LOCAL ] CMI: Loaded 42204 existing records from primary storage. [2025-09-25T22:18:06.263279] [INFO ] [MAIN ] CMI: Loaded 42204 primary data records. [2025-09-25T22:18:06.373166] [DEBUG] [LOCAL ] CMP: Loaded 36661 existing records from primary storage. [2025-09-25T22:18:06.386741] [INFO ] [MAIN ] CMP: Loaded 36661 primary data records. [2025-09-25T22:18:06.526220] [DEBUG] [MAIN ] CMCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:06.582595] [INFO ] [MAIN ] CMCM: Generated 1807 derivative records from 4788 primary records. [2025-09-25T22:18:06.621062] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-25T22:18:06.974952] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1807 records). [2025-09-25T22:18:06.975150] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-25T22:18:06.977579] [INFO ] [MAIN ] Derivative Progress: 364/2043 symbols completed. CMCM took 1.2s. Estimated remaining: 12m 9s. Rate: 138.2 symbols/min [2025-09-25T22:18:06.980681] [INFO ] [MAIN ] CMPO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:07.008174] [DEBUG] [MAIN ] CMI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:18:07.009341] [INFO ] [MAIN ] CMI: Generated 1806 derivative records from 42204 primary records. [2025-09-25T22:18:07.009754] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-25T22:18:07.042880] [DEBUG] [LOCAL ] CMI: Derivative data saved (1806 records). [2025-09-25T22:18:07.043231] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-25T22:18:07.046357] [INFO ] [MAIN ] Derivative Progress: 365/2043 symbols completed. CMI took 1.1s. Estimated remaining: 12m 7s. Rate: 138.5 symbols/min [2025-09-25T22:18:07.054681] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:07.060702] [DEBUG] [MAIN ] CMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:07.062965] [INFO ] [MAIN ] CMP: Generated 1807 derivative records from 36661 primary records. [2025-09-25T22:18:07.063111] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-25T22:18:07.084713] [DEBUG] [LOCAL ] CMPO: Loaded 39856 existing records from primary storage. [2025-09-25T22:18:07.089745] [INFO ] [MAIN ] CMPO: Loaded 39856 primary data records. [2025-09-25T22:18:07.104713] [DEBUG] [LOCAL ] CMP: Derivative data saved (1807 records). [2025-09-25T22:18:07.124182] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-25T22:18:07.150558] [INFO ] [MAIN ] Derivative Progress: 366/2043 symbols completed. CMP took 1.1s. Estimated remaining: 12m 5s. Rate: 138.8 symbols/min [2025-09-25T22:18:07.163419] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:07.261671] [DEBUG] [LOCAL ] CMRE: Loaded 35796 existing records from primary storage. [2025-09-25T22:18:07.289670] [INFO ] [MAIN ] CMRE: Loaded 35796 primary data records. [2025-09-25T22:18:07.725999] [DEBUG] [LOCAL ] CMS: Loaded 52986 existing records from primary storage. [2025-09-25T22:18:07.812882] [INFO ] [MAIN ] CMS: Loaded 52986 primary data records. [2025-09-25T22:18:08.233116] [DEBUG] [MAIN ] CMPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:08.235443] [INFO ] [MAIN ] CMPO: Generated 1807 derivative records from 39856 primary records. [2025-09-25T22:18:08.237315] [DEBUG] [LOCAL ] CMPO: Saving derivative data. [2025-09-25T22:18:08.255586] [DEBUG] [MAIN ] CMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:08.265964] [INFO ] [MAIN ] CMRE: Generated 1807 derivative records from 35796 primary records. [2025-09-25T22:18:08.269781] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-25T22:18:08.274797] [DEBUG] [LOCAL ] CMPO: Derivative data saved (1807 records). [2025-09-25T22:18:08.275537] [INFO ] [MAIN ] CMPO: Successfully saved derivative data. [2025-09-25T22:18:08.277968] [INFO ] [MAIN ] Derivative Progress: 367/2043 symbols completed. CMPO took 1.3s. Estimated remaining: 12m 8s. Rate: 138.2 symbols/min [2025-09-25T22:18:08.280843] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:08.299906] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1807 records). [2025-09-25T22:18:08.300484] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-25T22:18:08.303670] [INFO ] [MAIN ] Derivative Progress: 368/2043 symbols completed. CMRE took 1.2s. Estimated remaining: 12m 5s. Rate: 138.6 symbols/min [2025-09-25T22:18:08.304067] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:08.314059] [DEBUG] [LOCAL ] CMSA: Loaded 3406 existing records from primary storage. [2025-09-25T22:18:08.315335] [INFO ] [MAIN ] CMSA: Loaded 3406 primary data records. [2025-09-25T22:18:08.367936] [DEBUG] [MAIN ] CMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:08.385568] [DEBUG] [LOCAL ] CMSC: Loaded 5103 existing records from primary storage. [2025-09-25T22:18:08.390985] [INFO ] [MAIN ] CMSC: Loaded 5103 primary data records. [2025-09-25T22:18:08.416472] [INFO ] [MAIN ] CMS: Generated 1807 derivative records from 52986 primary records. [2025-09-25T22:18:08.494443] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-25T22:18:08.903901] [DEBUG] [LOCAL ] CMS: Derivative data saved (1807 records). [2025-09-25T22:18:08.991815] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-25T22:18:09.060531] [INFO ] [MAIN ] Derivative Progress: 369/2043 symbols completed. CMS took 1.9s. Estimated remaining: 12m 6s. Rate: 138.3 symbols/min [2025-09-25T22:18:09.061771] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:09.076254] [DEBUG] [LOCAL ] CMSD: Loaded 8149 existing records from primary storage. [2025-09-25T22:18:09.076962] [INFO ] [MAIN ] CMSD: Loaded 8149 primary data records. [2025-09-25T22:18:09.279764] [DEBUG] [MAIN ] CMSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:09.303859] [INFO ] [MAIN ] CMSA: Generated 1807 derivative records from 3406 primary records. [2025-09-25T22:18:09.304012] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-25T22:18:09.460776] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1807 records). [2025-09-25T22:18:09.466171] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-25T22:18:09.466787] [DEBUG] [MAIN ] CMSC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:09.470925] [INFO ] [MAIN ] CMSC: Generated 1807 derivative records from 5103 primary records. [2025-09-25T22:18:09.469698] [INFO ] [MAIN ] Derivative Progress: 370/2043 symbols completed. CMSA took 1.2s. Estimated remaining: 12m 6s. Rate: 138.3 symbols/min [2025-09-25T22:18:09.471829] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:09.472139] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-25T22:18:09.491893] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1807 records). [2025-09-25T22:18:09.492209] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-25T22:18:09.495327] [INFO ] [MAIN ] Derivative Progress: 371/2043 symbols completed. CMSC took 1.2s. Estimated remaining: 12m 4s. Rate: 138.6 symbols/min [2025-09-25T22:18:09.495808] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:09.510070] [DEBUG] [LOCAL ] CMU: Loaded 7283 existing records from primary storage. [2025-09-25T22:18:09.522255] [INFO ] [MAIN ] CMU: Loaded 7283 primary data records. [2025-09-25T22:18:09.688103] [DEBUG] [MAIN ] CMSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:09.661926] [DEBUG] [LOCAL ] CMTG: Loaded 37770 existing records from primary storage. [2025-09-25T22:18:09.699478] [INFO ] [MAIN ] CMSD: Generated 1807 derivative records from 8149 primary records. [2025-09-25T22:18:09.721044] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-25T22:18:09.720852] [INFO ] [MAIN ] CMTG: Loaded 37770 primary data records. [2025-09-25T22:18:10.052759] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1807 records). [2025-09-25T22:18:10.102408] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-25T22:18:10.113367] [INFO ] [MAIN ] Derivative Progress: 372/2043 symbols completed. CMSD took 1.1s. Estimated remaining: 12m 4s. Rate: 138.5 symbols/min [2025-09-25T22:18:10.113850] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:10.345855] [DEBUG] [MAIN ] CMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:10.347539] [INFO ] [MAIN ] CMU: Generated 1807 derivative records from 7283 primary records. [2025-09-25T22:18:10.347739] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-25T22:18:10.386881] [DEBUG] [LOCAL ] CMU: Derivative data saved (1807 records). [2025-09-25T22:18:10.387531] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-25T22:18:10.390109] [INFO ] [MAIN ] Derivative Progress: 373/2043 symbols completed. CMU took 0.9s. Estimated remaining: 12m 3s. Rate: 138.6 symbols/min [2025-09-25T22:18:10.390978] [DEBUG] [LOCAL ] CNA: Loaded 32996 existing records from primary storage. [2025-09-25T22:18:10.391837] [INFO ] [MAIN ] CNA: Loaded 32996 primary data records. [2025-09-25T22:18:10.530952] [DEBUG] [MAIN ] CMTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:10.542368] [INFO ] [MAIN ] CMTG: Generated 1807 derivative records from 37770 primary records. [2025-09-25T22:18:10.547589] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-25T22:18:10.747617] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1807 records). [2025-09-25T22:18:10.747902] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-25T22:18:10.752090] [INFO ] [MAIN ] Derivative Progress: 374/2043 symbols completed. CMTG took 1.3s. Estimated remaining: 12m 2s. Rate: 138.7 symbols/min [2025-09-25T22:18:10.786399] [DEBUG] [MAIN ] CNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:10.787387] [INFO ] [MAIN ] CNA: Generated 1807 derivative records from 32996 primary records. [2025-09-25T22:18:10.787467] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-25T22:18:10.811581] [DEBUG] [LOCAL ] CNA: Derivative data saved (1807 records). [2025-09-25T22:18:10.811689] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-25T22:18:10.815919] [INFO ] [MAIN ] Derivative Progress: 375/2043 symbols completed. CNA took 0.7s. Estimated remaining: 12m 0s. Rate: 139.0 symbols/min [2025-09-25T22:18:10.817073] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:10.817701] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:10.817580] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:10.909271] [DEBUG] [LOCAL ] CNH: Loaded 53949 existing records from primary storage. [2025-09-25T22:18:10.930102] [INFO ] [MAIN ] CNH: Loaded 53949 primary data records. [2025-09-25T22:18:10.931443] [DEBUG] [LOCAL ] CNC: Loaded 54128 existing records from primary storage. [2025-09-25T22:18:10.954378] [INFO ] [MAIN ] CNC: Loaded 54128 primary data records. [2025-09-25T22:18:11.166171] [DEBUG] [LOCAL ] CNI: Loaded 52046 existing records from primary storage. [2025-09-25T22:18:11.205354] [INFO ] [MAIN ] CNI: Loaded 52046 primary data records. [2025-09-25T22:18:11.952821] [DEBUG] [MAIN ] CNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:11.954085] [INFO ] [MAIN ] CNC: Generated 1807 derivative records from 54128 primary records. [2025-09-25T22:18:11.968594] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-25T22:18:11.970774] [DEBUG] [MAIN ] CNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:11.971549] [INFO ] [MAIN ] CNH: Generated 1807 derivative records from 53949 primary records. [2025-09-25T22:18:11.971885] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-25T22:18:12.008747] [DEBUG] [MAIN ] CNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:12.012824] [INFO ] [MAIN ] CNI: Generated 1807 derivative records from 52046 primary records. [2025-09-25T22:18:12.011824] [DEBUG] [LOCAL ] CNC: Derivative data saved (1807 records). [2025-09-25T22:18:12.015980] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-25T22:18:12.015891] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-25T22:18:12.020240] [INFO ] [MAIN ] Derivative Progress: 376/2043 symbols completed. CNC took 1.2s. Estimated remaining: 12m 3s. Rate: 138.3 symbols/min [2025-09-25T22:18:12.024311] [DEBUG] [LOCAL ] CNH: Derivative data saved (1807 records). [2025-09-25T22:18:12.024600] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:12.025800] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-25T22:18:12.035338] [INFO ] [MAIN ] Derivative Progress: 377/2043 symbols completed. CNH took 1.2s. Estimated remaining: 12m 1s. Rate: 138.7 symbols/min [2025-09-25T22:18:12.045832] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:12.047264] [DEBUG] [LOCAL ] CNI: Derivative data saved (1807 records). [2025-09-25T22:18:12.047989] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-25T22:18:12.051553] [INFO ] [MAIN ] Derivative Progress: 378/2043 symbols completed. CNI took 1.2s. Estimated remaining: 11m 58s. Rate: 139.0 symbols/min [2025-09-25T22:18:12.052148] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:12.114975] [DEBUG] [LOCAL ] CNMD: Loaded 32633 existing records from primary storage. [2025-09-25T22:18:12.115131] [INFO ] [MAIN ] CNMD: Loaded 32633 primary data records. [2025-09-25T22:18:12.255358] [DEBUG] [LOCAL ] CNK: Loaded 53281 existing records from primary storage. [2025-09-25T22:18:12.260064] [DEBUG] [LOCAL ] CNM: Loaded 51358 existing records from primary storage. [2025-09-25T22:18:12.260589] [INFO ] [MAIN ] CNM: Loaded 51358 primary data records. [2025-09-25T22:18:12.260424] [INFO ] [MAIN ] CNK: Loaded 53281 primary data records. [2025-09-25T22:18:13.249469] [DEBUG] [MAIN ] CNMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:13.254528] [INFO ] [MAIN ] CNMD: Generated 1807 derivative records from 32633 primary records. [2025-09-25T22:18:13.255991] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-25T22:18:13.283896] [DEBUG] [MAIN ] CNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:13.283233] [DEBUG] [MAIN ] CNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:13.292070] [INFO ] [MAIN ] CNM: Generated 1807 derivative records from 51358 primary records. [2025-09-25T22:18:13.292222] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-25T22:18:13.293251] [INFO ] [MAIN ] CNK: Generated 1807 derivative records from 53281 primary records. [2025-09-25T22:18:13.294839] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-25T22:18:13.334903] [DEBUG] [LOCAL ] CNK: Derivative data saved (1807 records). [2025-09-25T22:18:13.335317] [DEBUG] [LOCAL ] CNM: Derivative data saved (1807 records). [2025-09-25T22:18:13.335680] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-25T22:18:13.335786] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-25T22:18:13.343531] [INFO ] [MAIN ] Derivative Progress: 379/2043 symbols completed. CNM took 1.3s. Estimated remaining: 12m 2s. Rate: 138.3 symbols/min [2025-09-25T22:18:13.350367] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:13.350997] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1807 records). [2025-09-25T22:18:13.351178] [INFO ] [MAIN ] Derivative Progress: 380/2043 symbols completed. CNK took 1.3s. Estimated remaining: 11m 59s. Rate: 138.7 symbols/min [2025-09-25T22:18:13.351367] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-25T22:18:13.354518] [INFO ] [MAIN ] Derivative Progress: 381/2043 symbols completed. CNMD took 1.3s. Estimated remaining: 11m 57s. Rate: 139.0 symbols/min [2025-09-25T22:18:13.354685] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:13.355559] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:13.445111] [DEBUG] [LOCAL ] CNNE: Loaded 37006 existing records from primary storage. [2025-09-25T22:18:13.446134] [INFO ] [MAIN ] CNNE: Loaded 37006 primary data records. [2025-09-25T22:18:13.446014] [DEBUG] [LOCAL ] CNO: Loaded 41654 existing records from primary storage. [2025-09-25T22:18:13.468968] [INFO ] [MAIN ] CNO: Loaded 41654 primary data records. [2025-09-25T22:18:13.675406] [DEBUG] [LOCAL ] CNP: Loaded 53859 existing records from primary storage. [2025-09-25T22:18:13.714177] [INFO ] [MAIN ] CNP: Loaded 53859 primary data records. [2025-09-25T22:18:14.464849] [DEBUG] [MAIN ] CNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:14.468238] [INFO ] [MAIN ] CNO: Generated 1807 derivative records from 41654 primary records. [2025-09-25T22:18:14.468804] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-25T22:18:14.491502] [DEBUG] [MAIN ] CNNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:14.500311] [DEBUG] [LOCAL ] CNO: Derivative data saved (1807 records). [2025-09-25T22:18:14.501470] [INFO ] [MAIN ] CNNE: Generated 1807 derivative records from 37006 primary records. [2025-09-25T22:18:14.501992] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-25T22:18:14.502202] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-25T22:18:14.504272] [INFO ] [MAIN ] Derivative Progress: 382/2043 symbols completed. CNO took 1.2s. Estimated remaining: 11m 60s. Rate: 138.4 symbols/min [2025-09-25T22:18:14.505486] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:14.527112] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1807 records). [2025-09-25T22:18:14.535535] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-25T22:18:14.544112] [INFO ] [MAIN ] Derivative Progress: 383/2043 symbols completed. CNNE took 1.2s. Estimated remaining: 11m 58s. Rate: 138.8 symbols/min [2025-09-25T22:18:14.545033] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:14.544552] [DEBUG] [MAIN ] CNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:14.546100] [INFO ] [MAIN ] CNP: Generated 1807 derivative records from 53859 primary records. [2025-09-25T22:18:14.546831] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-25T22:18:14.566639] [DEBUG] [LOCAL ] CNP: Derivative data saved (1807 records). [2025-09-25T22:18:14.566892] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-25T22:18:14.570736] [INFO ] [MAIN ] Derivative Progress: 384/2043 symbols completed. CNP took 1.2s. Estimated remaining: 11m 56s. Rate: 139.1 symbols/min [2025-09-25T22:18:14.571210] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:14.604533] [DEBUG] [LOCAL ] CNS: Loaded 21094 existing records from primary storage. [2025-09-25T22:18:14.604752] [INFO ] [MAIN ] CNS: Loaded 21094 primary data records. [2025-09-25T22:18:14.755946] [DEBUG] [LOCAL ] CNQ: Loaded 53971 existing records from primary storage. [2025-09-25T22:18:14.773001] [INFO ] [MAIN ] CNQ: Loaded 53971 primary data records. [2025-09-25T22:18:15.101072] [DEBUG] [LOCAL ] CNX: Loaded 51770 existing records from primary storage. [2025-09-25T22:18:15.114412] [INFO ] [MAIN ] CNX: Loaded 51770 primary data records. [2025-09-25T22:18:15.700490] [DEBUG] [MAIN ] CNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:15.702162] [INFO ] [MAIN ] CNS: Generated 1807 derivative records from 21094 primary records. [2025-09-25T22:18:15.702635] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-25T22:18:15.722025] [DEBUG] [LOCAL ] CNS: Derivative data saved (1807 records). [2025-09-25T22:18:15.722200] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-25T22:18:15.724794] [INFO ] [MAIN ] Derivative Progress: 385/2043 symbols completed. CNS took 1.2s. Estimated remaining: 11m 58s. Rate: 138.5 symbols/min [2025-09-25T22:18:15.725385] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:15.744049] [DEBUG] [MAIN ] CNQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:15.745586] [INFO ] [MAIN ] CNQ: Generated 1807 derivative records from 53971 primary records. [2025-09-25T22:18:15.745852] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-25T22:18:15.767480] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1807 records). [2025-09-25T22:18:15.767915] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-25T22:18:15.771117] [INFO ] [MAIN ] Derivative Progress: 386/2043 symbols completed. CNQ took 1.3s. Estimated remaining: 11m 56s. Rate: 138.8 symbols/min [2025-09-25T22:18:15.784554] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:15.786092] [DEBUG] [MAIN ] CNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:15.798192] [INFO ] [MAIN ] CNX: Generated 1807 derivative records from 51770 primary records. [2025-09-25T22:18:15.798274] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-25T22:18:15.815676] [DEBUG] [LOCAL ] CNX: Derivative data saved (1807 records). [2025-09-25T22:18:15.816890] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-25T22:18:15.820109] [INFO ] [MAIN ] Derivative Progress: 387/2043 symbols completed. CNX took 1.2s. Estimated remaining: 11m 54s. Rate: 139.1 symbols/min [2025-09-25T22:18:15.820625] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:15.834147] [DEBUG] [LOCAL ] CODI: Loaded 40015 existing records from primary storage. [2025-09-25T22:18:15.834740] [INFO ] [MAIN ] CODI: Loaded 40015 primary data records. [2025-09-25T22:18:16.197094] [DEBUG] [LOCAL ] COF: Loaded 54000 existing records from primary storage. [2025-09-25T22:18:16.197471] [INFO ] [MAIN ] COF: Loaded 54000 primary data records. [2025-09-25T22:18:16.341051] [DEBUG] [LOCAL ] COHR: Loaded 53754 existing records from primary storage. [2025-09-25T22:18:16.346548] [INFO ] [MAIN ] COHR: Loaded 53754 primary data records. [2025-09-25T22:18:16.973606] [DEBUG] [MAIN ] CODI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:16.974911] [INFO ] [MAIN ] CODI: Generated 1807 derivative records from 40015 primary records. [2025-09-25T22:18:16.975399] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-25T22:18:17.000500] [DEBUG] [LOCAL ] CODI: Derivative data saved (1807 records). [2025-09-25T22:18:17.001692] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-25T22:18:17.004563] [INFO ] [MAIN ] Derivative Progress: 388/2043 symbols completed. CODI took 1.3s. Estimated remaining: 11m 57s. Rate: 138.5 symbols/min [2025-09-25T22:18:17.025343] [DEBUG] [MAIN ] COF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:17.026215] [INFO ] [MAIN ] COF: Generated 1807 derivative records from 54000 primary records. [2025-09-25T22:18:17.026579] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-25T22:18:17.048071] [DEBUG] [LOCAL ] COF: Derivative data saved (1807 records). [2025-09-25T22:18:17.048351] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-25T22:18:17.051194] [INFO ] [MAIN ] Derivative Progress: 389/2043 symbols completed. COF took 1.3s. Estimated remaining: 11m 55s. Rate: 138.8 symbols/min [2025-09-25T22:18:17.064820] [DEBUG] [MAIN ] COHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:17.065682] [INFO ] [MAIN ] COHR: Generated 1807 derivative records from 53754 primary records. [2025-09-25T22:18:17.065753] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-25T22:18:17.081466] [DEBUG] [LOCAL ] COHR: Derivative data saved (1807 records). [2025-09-25T22:18:17.081527] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-25T22:18:17.085387] [INFO ] [MAIN ] Derivative Progress: 390/2043 symbols completed. COHR took 1.3s. Estimated remaining: 11m 53s. Rate: 139.2 symbols/min [2025-09-25T22:18:17.086108] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:17.086531] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:17.086161] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:17.160434] [DEBUG] [LOCAL ] CON: Loaded 39000 existing records from primary storage. [2025-09-25T22:18:17.160712] [INFO ] [MAIN ] CON: Loaded 39000 primary data records. [2025-09-25T22:18:17.289062] [DEBUG] [LOCAL ] COLD: Loaded 52395 existing records from primary storage. [2025-09-25T22:18:17.308289] [INFO ] [MAIN ] COLD: Loaded 52395 primary data records. [2025-09-25T22:18:17.321775] [DEBUG] [LOCAL ] COMP: Loaded 53776 existing records from primary storage. [2025-09-25T22:18:17.343532] [INFO ] [MAIN ] COMP: Loaded 53776 primary data records. [2025-09-25T22:18:18.245523] [DEBUG] [MAIN ] CON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:18.247887] [INFO ] [MAIN ] CON: Generated 1807 derivative records from 39000 primary records. [2025-09-25T22:18:18.248349] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-25T22:18:18.268077] [DEBUG] [LOCAL ] CON: Derivative data saved (1807 records). [2025-09-25T22:18:18.268477] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-25T22:18:18.271026] [INFO ] [MAIN ] Derivative Progress: 391/2043 symbols completed. CON took 1.2s. Estimated remaining: 11m 55s. Rate: 138.5 symbols/min [2025-09-25T22:18:18.271582] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:18.291037] [DEBUG] [MAIN ] COLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:18.292277] [INFO ] [MAIN ] COLD: Generated 1807 derivative records from 52395 primary records. [2025-09-25T22:18:18.292694] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-25T22:18:18.320904] [DEBUG] [LOCAL ] COLD: Derivative data saved (1807 records). [2025-09-25T22:18:18.321196] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-25T22:18:18.323839] [INFO ] [MAIN ] Derivative Progress: 392/2043 symbols completed. COLD took 1.2s. Estimated remaining: 11m 53s. Rate: 138.9 symbols/min [2025-09-25T22:18:18.337426] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:18.338539] [DEBUG] [MAIN ] COMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:18.339842] [INFO ] [MAIN ] COMP: Generated 1807 derivative records from 53776 primary records. [2025-09-25T22:18:18.340092] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-25T22:18:18.365884] [DEBUG] [LOCAL ] COMP: Derivative data saved (1807 records). [2025-09-25T22:18:18.367049] [DEBUG] [LOCAL ] COOK: Loaded 24686 existing records from primary storage. [2025-09-25T22:18:18.367309] [INFO ] [MAIN ] COOK: Loaded 24686 primary data records. [2025-09-25T22:18:18.366162] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-25T22:18:18.371981] [INFO ] [MAIN ] Derivative Progress: 393/2043 symbols completed. COMP took 1.3s. Estimated remaining: 11m 51s. Rate: 139.2 symbols/min [2025-09-25T22:18:18.417362] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:18.735435] [DEBUG] [LOCAL ] COP: Loaded 54117 existing records from primary storage. [2025-09-25T22:18:18.735830] [INFO ] [MAIN ] COP: Loaded 54117 primary data records. [2025-09-25T22:18:18.968264] [DEBUG] [LOCAL ] COR: Loaded 47618 existing records from primary storage. [2025-09-25T22:18:19.131000] [INFO ] [MAIN ] COR: Loaded 47618 primary data records. [2025-09-25T22:18:19.489284] [DEBUG] [MAIN ] COOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:19.490582] [INFO ] [MAIN ] COOK: Generated 1807 derivative records from 24686 primary records. [2025-09-25T22:18:19.491569] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-25T22:18:19.514583] [DEBUG] [LOCAL ] COOK: Derivative data saved (1807 records). [2025-09-25T22:18:19.528714] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-25T22:18:19.529330] [DEBUG] [MAIN ] COP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:19.531587] [INFO ] [MAIN ] Derivative Progress: 394/2043 symbols completed. COOK took 1.3s. Estimated remaining: 11m 54s. Rate: 138.6 symbols/min [2025-09-25T22:18:19.534439] [INFO ] [MAIN ] COP: Generated 1807 derivative records from 54117 primary records. [2025-09-25T22:18:19.533475] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:19.534586] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-25T22:18:19.554971] [DEBUG] [LOCAL ] COP: Derivative data saved (1807 records). [2025-09-25T22:18:19.555138] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-25T22:18:19.557396] [INFO ] [MAIN ] Derivative Progress: 395/2043 symbols completed. COP took 1.2s. Estimated remaining: 11m 52s. Rate: 138.9 symbols/min [2025-09-25T22:18:19.557991] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:19.585004] [DEBUG] [MAIN ] COR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:19.586044] [INFO ] [MAIN ] COR: Generated 1807 derivative records from 47618 primary records. [2025-09-25T22:18:19.586201] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-25T22:18:19.620103] [DEBUG] [LOCAL ] COR: Derivative data saved (1807 records). [2025-09-25T22:18:19.620365] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-25T22:18:19.623050] [INFO ] [MAIN ] Derivative Progress: 396/2043 symbols completed. COR took 1.2s. Estimated remaining: 11m 50s. Rate: 139.2 symbols/min [2025-09-25T22:18:19.634455] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:19.653599] [DEBUG] [LOCAL ] COTY: Loaded 53636 existing records from primary storage. [2025-09-25T22:18:19.653917] [INFO ] [MAIN ] COTY: Loaded 53636 primary data records. [2025-09-25T22:18:19.745828] [DEBUG] [LOCAL ] COUR: Loaded 49322 existing records from primary storage. [2025-09-25T22:18:19.757620] [INFO ] [MAIN ] COUR: Loaded 49322 primary data records. [2025-09-25T22:18:20.186788] [DEBUG] [LOCAL ] CP: Loaded 53664 existing records from primary storage. [2025-09-25T22:18:20.231818] [INFO ] [MAIN ] CP: Loaded 53664 primary data records. [2025-09-25T22:18:20.743444] [DEBUG] [MAIN ] COTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:20.749663] [DEBUG] [MAIN ] COUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:20.751020] [INFO ] [MAIN ] COTY: Generated 1807 derivative records from 53636 primary records. [2025-09-25T22:18:20.751628] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-25T22:18:20.753474] [INFO ] [MAIN ] COUR: Generated 1807 derivative records from 49322 primary records. [2025-09-25T22:18:20.754056] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-25T22:18:20.791510] [DEBUG] [LOCAL ] COTY: Derivative data saved (1807 records). [2025-09-25T22:18:20.791879] [DEBUG] [LOCAL ] COUR: Derivative data saved (1807 records). [2025-09-25T22:18:20.792211] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-25T22:18:20.792446] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-25T22:18:20.795393] [INFO ] [MAIN ] Derivative Progress: 397/2043 symbols completed. COTY took 1.3s. Estimated remaining: 11m 53s. Rate: 138.6 symbols/min [2025-09-25T22:18:20.798960] [INFO ] [MAIN ] Derivative Progress: 398/2043 symbols completed. COUR took 1.2s. Estimated remaining: 11m 50s. Rate: 139.0 symbols/min [2025-09-25T22:18:20.798889] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:20.800472] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:20.821735] [DEBUG] [MAIN ] CP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:20.822688] [INFO ] [MAIN ] CP: Generated 1807 derivative records from 53664 primary records. [2025-09-25T22:18:20.822833] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-25T22:18:20.851454] [DEBUG] [LOCAL ] CP: Derivative data saved (1807 records). [2025-09-25T22:18:20.859989] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-25T22:18:20.862616] [INFO ] [MAIN ] Derivative Progress: 399/2043 symbols completed. CP took 1.2s. Estimated remaining: 11m 48s. Rate: 139.3 symbols/min [2025-09-25T22:18:20.863538] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:20.874402] [DEBUG] [LOCAL ] CPA: Loaded 29076 existing records from primary storage. [2025-09-25T22:18:20.885530] [INFO ] [MAIN ] CPA: Loaded 29076 primary data records. [2025-09-25T22:18:20.919809] [DEBUG] [LOCAL ] CPAY: Loaded 31115 existing records from primary storage. [2025-09-25T22:18:20.938016] [INFO ] [MAIN ] CPAY: Loaded 31115 primary data records. [2025-09-25T22:18:21.083954] [DEBUG] [LOCAL ] CPF: Loaded 15549 existing records from primary storage. [2025-09-25T22:18:21.170726] [INFO ] [MAIN ] CPF: Loaded 15549 primary data records. [2025-09-25T22:18:21.971455] [DEBUG] [MAIN ] CPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:21.973141] [INFO ] [MAIN ] CPA: Generated 1807 derivative records from 29076 primary records. [2025-09-25T22:18:21.973568] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-25T22:18:21.996200] [DEBUG] [LOCAL ] CPA: Derivative data saved (1807 records). [2025-09-25T22:18:22.009982] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-25T22:18:22.013160] [INFO ] [MAIN ] Derivative Progress: 400/2043 symbols completed. CPA took 1.2s. Estimated remaining: 11m 51s. Rate: 138.7 symbols/min [2025-09-25T22:18:22.013601] [DEBUG] [MAIN ] CPAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:22.013953] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:22.015410] [INFO ] [MAIN ] CPAY: Generated 1807 derivative records from 31115 primary records. [2025-09-25T22:18:22.016836] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-25T22:18:22.051280] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1807 records). [2025-09-25T22:18:22.052319] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-25T22:18:22.057054] [INFO ] [MAIN ] Derivative Progress: 401/2043 symbols completed. CPAY took 1.3s. Estimated remaining: 11m 49s. Rate: 139.0 symbols/min [2025-09-25T22:18:22.062960] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:22.062592] [DEBUG] [MAIN ] CPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:22.064385] [INFO ] [MAIN ] CPF: Generated 1807 derivative records from 15549 primary records. [2025-09-25T22:18:22.064686] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-25T22:18:22.089311] [DEBUG] [LOCAL ] CPF: Derivative data saved (1807 records). [2025-09-25T22:18:22.090279] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-25T22:18:22.089806] [DEBUG] [LOCAL ] CPK: Loaded 13470 existing records from primary storage. [2025-09-25T22:18:22.093008] [INFO ] [MAIN ] Derivative Progress: 402/2043 symbols completed. CPF took 1.2s. Estimated remaining: 11m 47s. Rate: 139.3 symbols/min [2025-09-25T22:18:22.093722] [INFO ] [MAIN ] CPK: Loaded 13470 primary data records. [2025-09-25T22:18:22.093617] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:22.473580] [DEBUG] [LOCAL ] CPNG: Loaded 54060 existing records from primary storage. [2025-09-25T22:18:22.474821] [INFO ] [MAIN ] CPNG: Loaded 54060 primary data records. [2025-09-25T22:18:22.577032] [DEBUG] [LOCAL ] CPRI: Loaded 52950 existing records from primary storage. [2025-09-25T22:18:22.597999] [INFO ] [MAIN ] CPRI: Loaded 52950 primary data records. [2025-09-25T22:18:23.175466] [DEBUG] [MAIN ] CPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:23.178225] [INFO ] [MAIN ] CPK: Generated 1807 derivative records from 13470 primary records. [2025-09-25T22:18:23.178533] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-25T22:18:23.201512] [DEBUG] [LOCAL ] CPK: Derivative data saved (1807 records). [2025-09-25T22:18:23.202279] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-25T22:18:23.205385] [INFO ] [MAIN ] Derivative Progress: 403/2043 symbols completed. CPK took 1.2s. Estimated remaining: 11m 49s. Rate: 138.8 symbols/min [2025-09-25T22:18:23.228002] [DEBUG] [MAIN ] CPNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:23.229080] [INFO ] [MAIN ] CPNG: Generated 1807 derivative records from 54060 primary records. [2025-09-25T22:18:23.229291] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-25T22:18:23.251320] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1807 records). [2025-09-25T22:18:23.251639] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-25T22:18:23.253679] [INFO ] [MAIN ] Derivative Progress: 404/2043 symbols completed. CPNG took 1.2s. Estimated remaining: 11m 47s. Rate: 139.1 symbols/min [2025-09-25T22:18:23.266898] [DEBUG] [MAIN ] CPRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:23.267659] [INFO ] [MAIN ] CPRI: Generated 1807 derivative records from 52950 primary records. [2025-09-25T22:18:23.267729] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-25T22:18:23.283518] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1807 records). [2025-09-25T22:18:23.283583] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-25T22:18:23.287012] [INFO ] [MAIN ] Derivative Progress: 405/2043 symbols completed. CPRI took 1.2s. Estimated remaining: 11m 45s. Rate: 139.4 symbols/min [2025-09-25T22:18:23.288111] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:23.288303] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:23.287797] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:23.331037] [DEBUG] [LOCAL ] CQP: Loaded 19937 existing records from primary storage. [2025-09-25T22:18:23.331401] [INFO ] [MAIN ] CQP: Loaded 19937 primary data records. [2025-09-25T22:18:23.344280] [DEBUG] [LOCAL ] CPS: Loaded 26362 existing records from primary storage. [2025-09-25T22:18:23.379306] [INFO ] [MAIN ] CPS: Loaded 26362 primary data records. [2025-09-25T22:18:23.838638] [DEBUG] [LOCAL ] CPT: Loaded 44711 existing records from primary storage. [2025-09-25T22:18:23.899904] [INFO ] [MAIN ] CPT: Loaded 44711 primary data records. [2025-09-25T22:18:24.413125] [DEBUG] [MAIN ] CQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:24.415068] [INFO ] [MAIN ] CQP: Generated 1807 derivative records from 19937 primary records. [2025-09-25T22:18:24.415253] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-25T22:18:24.430930] [DEBUG] [MAIN ] CPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:24.432360] [INFO ] [MAIN ] CPS: Generated 1807 derivative records from 26362 primary records. [2025-09-25T22:18:24.449365] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-25T22:18:24.455158] [DEBUG] [LOCAL ] CQP: Derivative data saved (1807 records). [2025-09-25T22:18:24.455246] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-25T22:18:24.470245] [INFO ] [MAIN ] Derivative Progress: 406/2043 symbols completed. CQP took 1.2s. Estimated remaining: 11m 48s. Rate: 138.8 symbols/min [2025-09-25T22:18:24.474026] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:24.475991] [DEBUG] [LOCAL ] CPS: Derivative data saved (1807 records). [2025-09-25T22:18:24.476228] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-25T22:18:24.478519] [INFO ] [MAIN ] Derivative Progress: 407/2043 symbols completed. CPS took 1.2s. Estimated remaining: 11m 46s. Rate: 139.1 symbols/min [2025-09-25T22:18:24.479117] [INFO ] [MAIN ] CRBD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:24.501976] [DEBUG] [MAIN ] CPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:24.502994] [INFO ] [MAIN ] CPT: Generated 1807 derivative records from 44711 primary records. [2025-09-25T22:18:24.503136] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-25T22:18:24.509147] [DEBUG] [LOCAL ] CRBD: Loaded 9077 existing records from primary storage. [2025-09-25T22:18:24.526840] [INFO ] [MAIN ] CRBD: Loaded 9077 primary data records. [2025-09-25T22:18:24.621805] [DEBUG] [LOCAL ] CR: Loaded 24857 existing records from primary storage. [2025-09-25T22:18:24.628002] [INFO ] [MAIN ] CR: Loaded 24857 primary data records. [2025-09-25T22:18:24.778624] [DEBUG] [LOCAL ] CPT: Derivative data saved (1807 records). [2025-09-25T22:18:24.816605] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-25T22:18:24.857575] [INFO ] [MAIN ] Derivative Progress: 408/2043 symbols completed. CPT took 1.6s. Estimated remaining: 11m 45s. Rate: 139.2 symbols/min [2025-09-25T22:18:24.990148] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:25.236877] [DEBUG] [MAIN ] CRBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:25.254823] [INFO ] [MAIN ] CRBD: Generated 1807 derivative records from 9077 primary records. [2025-09-25T22:18:25.255134] [DEBUG] [LOCAL ] CRBD: Saving derivative data. [2025-09-25T22:18:25.274855] [DEBUG] [LOCAL ] CRBD: Derivative data saved (1807 records). [2025-09-25T22:18:25.279097] [INFO ] [MAIN ] CRBD: Successfully saved derivative data. [2025-09-25T22:18:25.308229] [DEBUG] [MAIN ] CR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:25.309477] [INFO ] [MAIN ] CR: Generated 1807 derivative records from 24857 primary records. [2025-09-25T22:18:25.309633] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-25T22:18:25.315535] [DEBUG] [LOCAL ] CRBG: Loaded 52728 existing records from primary storage. [2025-09-25T22:18:25.312853] [INFO ] [MAIN ] Derivative Progress: 409/2043 symbols completed. CRBD took 0.8s. Estimated remaining: 11m 45s. Rate: 139.1 symbols/min [2025-09-25T22:18:25.316107] [INFO ] [MAIN ] CRBG: Loaded 52728 primary data records. [2025-09-25T22:18:25.323959] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:25.412328] [DEBUG] [LOCAL ] CR: Derivative data saved (1807 records). [2025-09-25T22:18:25.417813] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-25T22:18:25.430935] [INFO ] [MAIN ] Derivative Progress: 410/2043 symbols completed. CR took 1.0s. Estimated remaining: 11m 43s. Rate: 139.4 symbols/min [2025-09-25T22:18:25.448749] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:25.724174] [DEBUG] [LOCAL ] CRC: Loaded 44654 existing records from primary storage. [2025-09-25T22:18:25.724842] [INFO ] [MAIN ] CRC: Loaded 44654 primary data records. [2025-09-25T22:18:25.922437] [DEBUG] [LOCAL ] CRGY: Loaded 52903 existing records from primary storage. [2025-09-25T22:18:25.960421] [INFO ] [MAIN ] CRGY: Loaded 52903 primary data records. [2025-09-25T22:18:26.237466] [DEBUG] [MAIN ] CRBG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:26.238427] [INFO ] [MAIN ] CRBG: Generated 1807 derivative records from 52728 primary records. [2025-09-25T22:18:26.238544] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-25T22:18:26.317013] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1807 records). [2025-09-25T22:18:26.350931] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-25T22:18:26.480498] [INFO ] [MAIN ] Derivative Progress: 411/2043 symbols completed. CRBG took 1.5s. Estimated remaining: 11m 45s. Rate: 138.9 symbols/min [2025-09-25T22:18:26.481471] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:26.505478] [DEBUG] [MAIN ] CRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:26.506586] [INFO ] [MAIN ] CRC: Generated 1807 derivative records from 44654 primary records. [2025-09-25T22:18:26.506904] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-25T22:18:26.527744] [DEBUG] [LOCAL ] CRC: Derivative data saved (1807 records). [2025-09-25T22:18:26.528218] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-25T22:18:26.531440] [INFO ] [MAIN ] Derivative Progress: 412/2043 symbols completed. CRC took 1.2s. Estimated remaining: 11m 43s. Rate: 139.2 symbols/min [2025-09-25T22:18:26.531939] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:26.552633] [DEBUG] [MAIN ] CRGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:26.553824] [INFO ] [MAIN ] CRGY: Generated 1807 derivative records from 52903 primary records. [2025-09-25T22:18:26.553979] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-25T22:18:26.589791] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1807 records). [2025-09-25T22:18:26.589873] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-25T22:18:26.592299] [INFO ] [MAIN ] Derivative Progress: 413/2043 symbols completed. CRGY took 1.2s. Estimated remaining: 11m 41s. Rate: 139.5 symbols/min [2025-09-25T22:18:26.592738] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:26.612669] [DEBUG] [LOCAL ] CRH: Loaded 53856 existing records from primary storage. [2025-09-25T22:18:26.612993] [INFO ] [MAIN ] CRH: Loaded 53856 primary data records. [2025-09-25T22:18:26.943068] [DEBUG] [LOCAL ] CRI: Loaded 50361 existing records from primary storage. [2025-09-25T22:18:27.001383] [INFO ] [MAIN ] CRI: Loaded 50361 primary data records. [2025-09-25T22:18:27.144127] [DEBUG] [LOCAL ] CRK: Loaded 52506 existing records from primary storage. [2025-09-25T22:18:27.155540] [INFO ] [MAIN ] CRK: Loaded 52506 primary data records. [2025-09-25T22:18:27.583400] [DEBUG] [MAIN ] CRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:27.598128] [INFO ] [MAIN ] CRH: Generated 1807 derivative records from 53856 primary records. [2025-09-25T22:18:27.630285] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-25T22:18:27.865077] [DEBUG] [LOCAL ] CRH: Derivative data saved (1807 records). [2025-09-25T22:18:27.866796] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-25T22:18:27.870796] [INFO ] [MAIN ] Derivative Progress: 414/2043 symbols completed. CRH took 1.4s. Estimated remaining: 11m 44s. Rate: 138.8 symbols/min [2025-09-25T22:18:27.872094] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:27.887224] [DEBUG] [MAIN ] CRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:27.889112] [INFO ] [MAIN ] CRI: Generated 1807 derivative records from 50361 primary records. [2025-09-25T22:18:27.889506] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-25T22:18:27.908123] [DEBUG] [LOCAL ] CRI: Derivative data saved (1807 records). [2025-09-25T22:18:27.908447] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-25T22:18:27.911145] [INFO ] [MAIN ] Derivative Progress: 415/2043 symbols completed. CRI took 1.4s. Estimated remaining: 11m 42s. Rate: 139.1 symbols/min [2025-09-25T22:18:27.912237] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:27.946494] [DEBUG] [MAIN ] CRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:27.947375] [INFO ] [MAIN ] CRK: Generated 1807 derivative records from 52506 primary records. [2025-09-25T22:18:27.947541] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-25T22:18:27.964304] [DEBUG] [LOCAL ] CRK: Derivative data saved (1807 records). [2025-09-25T22:18:27.964510] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-25T22:18:27.969232] [INFO ] [MAIN ] Derivative Progress: 416/2043 symbols completed. CRK took 1.4s. Estimated remaining: 11m 40s. Rate: 139.4 symbols/min [2025-09-25T22:18:27.969784] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:27.985880] [DEBUG] [LOCAL ] CRL: Loaded 43547 existing records from primary storage. [2025-09-25T22:18:27.986122] [INFO ] [MAIN ] CRL: Loaded 43547 primary data records. [2025-09-25T22:18:28.085809] [DEBUG] [LOCAL ] CRT: Loaded 4974 existing records from primary storage. [2025-09-25T22:18:28.111968] [INFO ] [MAIN ] CRT: Loaded 4974 primary data records. [2025-09-25T22:18:28.345739] [DEBUG] [LOCAL ] CRM: Loaded 54160 existing records from primary storage. [2025-09-25T22:18:28.470118] [INFO ] [MAIN ] CRM: Loaded 54160 primary data records. [2025-09-25T22:18:29.049353] [DEBUG] [MAIN ] CRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:29.050620] [INFO ] [MAIN ] CRL: Generated 1807 derivative records from 43547 primary records. [2025-09-25T22:18:29.050904] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-25T22:18:29.074001] [DEBUG] [LOCAL ] CRL: Derivative data saved (1807 records). [2025-09-25T22:18:29.074312] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-25T22:18:29.077750] [INFO ] [MAIN ] Derivative Progress: 417/2043 symbols completed. CRL took 1.2s. Estimated remaining: 11m 42s. Rate: 138.9 symbols/min [2025-09-25T22:18:29.078204] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:29.093459] [DEBUG] [MAIN ] CRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:29.094527] [INFO ] [MAIN ] CRT: Generated 1807 derivative records from 4974 primary records. [2025-09-25T22:18:29.094759] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-25T22:18:29.128198] [DEBUG] [LOCAL ] CRT: Derivative data saved (1807 records). [2025-09-25T22:18:29.128398] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-25T22:18:29.125932] [DEBUG] [MAIN ] CRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:29.129344] [INFO ] [MAIN ] CRM: Generated 1807 derivative records from 54160 primary records. [2025-09-25T22:18:29.132499] [INFO ] [MAIN ] Derivative Progress: 418/2043 symbols completed. CRT took 1.2s. Estimated remaining: 11m 40s. Rate: 139.2 symbols/min [2025-09-25T22:18:29.132725] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-25T22:18:29.161886] [DEBUG] [LOCAL ] CRM: Derivative data saved (1807 records). [2025-09-25T22:18:29.162009] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-25T22:18:29.165268] [INFO ] [MAIN ] Derivative Progress: 419/2043 symbols completed. CRM took 1.3s. Estimated remaining: 11m 39s. Rate: 139.5 symbols/min [2025-09-25T22:18:29.180817] [DEBUG] [LOCAL ] CSAN: Loaded 42640 existing records from primary storage. [2025-09-25T22:18:29.181065] [INFO ] [MAIN ] CSAN: Loaded 42640 primary data records. [2025-09-25T22:18:29.505479] [DEBUG] [MAIN ] CSAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:29.506243] [INFO ] [MAIN ] CSAN: Generated 1807 derivative records from 42640 primary records. [2025-09-25T22:18:29.506311] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-25T22:18:29.522992] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1807 records). [2025-09-25T22:18:29.523143] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-25T22:18:29.525947] [INFO ] [MAIN ] Derivative Progress: 420/2043 symbols completed. CSAN took 0.4s. Estimated remaining: 11m 38s. Rate: 139.5 symbols/min [2025-09-25T22:18:29.527245] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:29.527381] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:29.527567] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:29.557504] [DEBUG] [LOCAL ] CSV: Loaded 13101 existing records from primary storage. [2025-09-25T22:18:29.558384] [DEBUG] [LOCAL ] CSR: Loaded 12686 existing records from primary storage. [2025-09-25T22:18:29.558954] [INFO ] [MAIN ] CSV: Loaded 13101 primary data records. [2025-09-25T22:18:29.581351] [INFO ] [MAIN ] CSR: Loaded 12686 primary data records. [2025-09-25T22:18:29.934083] [DEBUG] [LOCAL ] CSTM: Loaded 48051 existing records from primary storage. [2025-09-25T22:18:30.185413] [INFO ] [MAIN ] CSTM: Loaded 48051 primary data records. [2025-09-25T22:18:30.694576] [DEBUG] [MAIN ] CSV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:30.700265] [DEBUG] [MAIN ] CSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:30.702129] [INFO ] [MAIN ] CSR: Generated 1807 derivative records from 12686 primary records. [2025-09-25T22:18:30.701394] [INFO ] [MAIN ] CSV: Generated 1807 derivative records from 13101 primary records. [2025-09-25T22:18:30.702278] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-25T22:18:30.702376] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-25T22:18:30.735476] [DEBUG] [LOCAL ] CSV: Derivative data saved (1807 records). [2025-09-25T22:18:30.735826] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-25T22:18:30.740316] [INFO ] [MAIN ] Derivative Progress: 421/2043 symbols completed. CSV took 1.2s. Estimated remaining: 11m 40s. Rate: 138.9 symbols/min [2025-09-25T22:18:30.741463] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:30.745740] [DEBUG] [LOCAL ] CSR: Derivative data saved (1807 records). [2025-09-25T22:18:30.746096] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-25T22:18:30.748688] [INFO ] [MAIN ] Derivative Progress: 422/2043 symbols completed. CSR took 1.2s. Estimated remaining: 11m 38s. Rate: 139.3 symbols/min [2025-09-25T22:18:30.752002] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:30.760877] [DEBUG] [LOCAL ] CTBB: Loaded 7094 existing records from primary storage. [2025-09-25T22:18:30.763265] [INFO ] [MAIN ] CTBB: Loaded 7094 primary data records. [2025-09-25T22:18:30.827106] [DEBUG] [MAIN ] CSTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:30.827410] [DEBUG] [LOCAL ] CTDD: Loaded 5891 existing records from primary storage. [2025-09-25T22:18:30.833771] [INFO ] [MAIN ] CSTM: Generated 1807 derivative records from 48051 primary records. [2025-09-25T22:18:30.833969] [INFO ] [MAIN ] CTDD: Loaded 5891 primary data records. [2025-09-25T22:18:30.844092] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-25T22:18:31.264580] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1807 records). [2025-09-25T22:18:31.275538] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-25T22:18:31.278502] [INFO ] [MAIN ] Derivative Progress: 423/2043 symbols completed. CSTM took 1.8s. Estimated remaining: 11m 38s. Rate: 139.2 symbols/min [2025-09-25T22:18:31.301784] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:31.543732] [DEBUG] [LOCAL ] CTO: Loaded 28465 existing records from primary storage. [2025-09-25T22:18:31.542982] [DEBUG] [MAIN ] CTBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:31.545013] [INFO ] [MAIN ] CTO: Loaded 28465 primary data records. [2025-09-25T22:18:31.544837] [INFO ] [MAIN ] CTBB: Generated 1807 derivative records from 7094 primary records. [2025-09-25T22:18:31.560290] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-25T22:18:31.638880] [DEBUG] [MAIN ] CTDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:31.664121] [INFO ] [MAIN ] CTDD: Generated 1807 derivative records from 5891 primary records. [2025-09-25T22:18:31.670389] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-25T22:18:31.722792] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1807 records). [2025-09-25T22:18:31.713331] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1807 records). [2025-09-25T22:18:31.759586] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-25T22:18:31.775796] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-25T22:18:31.798984] [INFO ] [MAIN ] Derivative Progress: 424/2043 symbols completed. CTDD took 1.0s. Estimated remaining: 11m 38s. Rate: 139.1 symbols/min [2025-09-25T22:18:31.931425] [INFO ] [MAIN ] Derivative Progress: 425/2043 symbols completed. CTBB took 1.1s. Estimated remaining: 11m 37s. Rate: 139.4 symbols/min [2025-09-25T22:18:31.931859] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:31.932986] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:31.978490] [DEBUG] [LOCAL ] CTOS: Loaded 36991 existing records from primary storage. [2025-09-25T22:18:31.995244] [INFO ] [MAIN ] CTOS: Loaded 36991 primary data records. [2025-09-25T22:18:32.009318] [DEBUG] [MAIN ] CTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:32.074960] [INFO ] [MAIN ] CTO: Generated 1807 derivative records from 28465 primary records. [2025-09-25T22:18:32.089985] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-25T22:18:32.141686] [DEBUG] [LOCAL ] CTRA: Loaded 54038 existing records from primary storage. [2025-09-25T22:18:32.162567] [INFO ] [MAIN ] CTRA: Loaded 54038 primary data records. [2025-09-25T22:18:32.592339] [DEBUG] [LOCAL ] CTO: Derivative data saved (1807 records). [2025-09-25T22:18:32.593242] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-25T22:18:32.595886] [INFO ] [MAIN ] Derivative Progress: 426/2043 symbols completed. CTO took 1.3s. Estimated remaining: 11m 37s. Rate: 139.2 symbols/min [2025-09-25T22:18:32.625135] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:32.856992] [DEBUG] [MAIN ] CTOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:32.857953] [INFO ] [MAIN ] CTOS: Generated 1807 derivative records from 36991 primary records. [2025-09-25T22:18:32.858225] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-25T22:18:32.907530] [DEBUG] [MAIN ] CTRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:32.923055] [INFO ] [MAIN ] CTRA: Generated 1807 derivative records from 54038 primary records. [2025-09-25T22:18:32.925634] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1807 records). [2025-09-25T22:18:32.926058] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-25T22:18:32.925817] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-25T22:18:32.931686] [INFO ] [MAIN ] Derivative Progress: 427/2043 symbols completed. CTOS took 1.0s. Estimated remaining: 11m 36s. Rate: 139.2 symbols/min [2025-09-25T22:18:32.932385] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:32.928315] [DEBUG] [LOCAL ] CTRE: Loaded 49589 existing records from primary storage. [2025-09-25T22:18:32.945076] [INFO ] [MAIN ] CTRE: Loaded 49589 primary data records. [2025-09-25T22:18:32.963333] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1807 records). [2025-09-25T22:18:32.989497] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-25T22:18:33.025122] [INFO ] [MAIN ] Derivative Progress: 428/2043 symbols completed. CTRA took 1.1s. Estimated remaining: 11m 35s. Rate: 139.5 symbols/min [2025-09-25T22:18:33.066774] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:33.324920] [DEBUG] [LOCAL ] CTS: Loaded 19488 existing records from primary storage. [2025-09-25T22:18:33.326061] [INFO ] [MAIN ] CTS: Loaded 19488 primary data records. [2025-09-25T22:18:33.332731] [DEBUG] [LOCAL ] CTRI: Loaded 38243 existing records from primary storage. [2025-09-25T22:18:33.366620] [INFO ] [MAIN ] CTRI: Loaded 38243 primary data records. [2025-09-25T22:18:34.027741] [DEBUG] [MAIN ] CTRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:34.029770] [INFO ] [MAIN ] CTRE: Generated 1807 derivative records from 49589 primary records. [2025-09-25T22:18:34.029963] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-25T22:18:34.054126] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1807 records). [2025-09-25T22:18:34.054623] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-25T22:18:34.058248] [INFO ] [MAIN ] Derivative Progress: 429/2043 symbols completed. CTRE took 1.4s. Estimated remaining: 11m 36s. Rate: 139.0 symbols/min [2025-09-25T22:18:34.059831] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:34.086856] [DEBUG] [MAIN ] CTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:34.102707] [INFO ] [MAIN ] CTS: Generated 1807 derivative records from 19488 primary records. [2025-09-25T22:18:34.102954] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-25T22:18:34.104719] [DEBUG] [MAIN ] CTRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:34.114205] [INFO ] [MAIN ] CTRI: Generated 1807 derivative records from 38243 primary records. [2025-09-25T22:18:34.118911] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-25T22:18:34.123130] [DEBUG] [LOCAL ] CTS: Derivative data saved (1807 records). [2025-09-25T22:18:34.124073] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-25T22:18:34.127515] [INFO ] [MAIN ] Derivative Progress: 430/2043 symbols completed. CTS took 1.1s. Estimated remaining: 11m 35s. Rate: 139.3 symbols/min [2025-09-25T22:18:34.127954] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:34.163220] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1807 records). [2025-09-25T22:18:34.163501] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-25T22:18:34.167103] [INFO ] [MAIN ] Derivative Progress: 431/2043 symbols completed. CTRI took 1.2s. Estimated remaining: 11m 33s. Rate: 139.6 symbols/min [2025-09-25T22:18:34.167629] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:34.192776] [DEBUG] [LOCAL ] CULP: Loaded 3087 existing records from primary storage. [2025-09-25T22:18:34.193146] [INFO ] [MAIN ] CULP: Loaded 3087 primary data records. [2025-09-25T22:18:34.239922] [DEBUG] [LOCAL ] CTVA: Loaded 53612 existing records from primary storage. [2025-09-25T22:18:34.254331] [INFO ] [MAIN ] CTVA: Loaded 53612 primary data records. [2025-09-25T22:18:34.719610] [DEBUG] [LOCAL ] CUK: Loaded 51382 existing records from primary storage. [2025-09-25T22:18:34.990472] [INFO ] [MAIN ] CUK: Loaded 51382 primary data records. [2025-09-25T22:18:35.355929] [DEBUG] [MAIN ] CTVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:35.370462] [INFO ] [MAIN ] CTVA: Generated 1807 derivative records from 53612 primary records. [2025-09-25T22:18:35.371064] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-25T22:18:35.370950] [DEBUG] [MAIN ] CULP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:35.373997] [INFO ] [MAIN ] CULP: Generated 1807 derivative records from 3087 primary records. [2025-09-25T22:18:35.374123] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-25T22:18:35.406347] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1807 records). [2025-09-25T22:18:35.410005] [DEBUG] [LOCAL ] CULP: Derivative data saved (1807 records). [2025-09-25T22:18:35.410114] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-25T22:18:35.410689] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-25T22:18:35.414118] [INFO ] [MAIN ] Derivative Progress: 432/2043 symbols completed. CTVA took 1.4s. Estimated remaining: 11m 35s. Rate: 139.0 symbols/min [2025-09-25T22:18:35.418174] [INFO ] [MAIN ] Derivative Progress: 433/2043 symbols completed. CULP took 1.2s. Estimated remaining: 11m 33s. Rate: 139.3 symbols/min [2025-09-25T22:18:35.418549] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:35.440827] [DEBUG] [MAIN ] CUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:35.441813] [INFO ] [MAIN ] CUK: Generated 1807 derivative records from 51382 primary records. [2025-09-25T22:18:35.441963] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-25T22:18:35.485209] [DEBUG] [LOCAL ] CUK: Derivative data saved (1807 records). [2025-09-25T22:18:35.486011] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-25T22:18:35.490501] [INFO ] [MAIN ] Derivative Progress: 434/2043 symbols completed. CUK took 1.4s. Estimated remaining: 11m 32s. Rate: 139.6 symbols/min [2025-09-25T22:18:35.504517] [DEBUG] [LOCAL ] CURB: Loaded 33144 existing records from primary storage. [2025-09-25T22:18:35.504719] [INFO ] [MAIN ] CURB: Loaded 33144 primary data records. [2025-09-25T22:18:35.833429] [DEBUG] [MAIN ] CURB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:35.834269] [INFO ] [MAIN ] CURB: Generated 1807 derivative records from 33144 primary records. [2025-09-25T22:18:35.834351] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-25T22:18:35.850521] [DEBUG] [LOCAL ] CURB: Derivative data saved (1807 records). [2025-09-25T22:18:35.850584] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-25T22:18:35.853593] [INFO ] [MAIN ] Derivative Progress: 435/2043 symbols completed. CURB took 0.4s. Estimated remaining: 11m 31s. Rate: 139.6 symbols/min [2025-09-25T22:18:35.854984] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:35.854855] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:35.855701] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:35.949951] [DEBUG] [LOCAL ] CUZ: Loaded 49778 existing records from primary storage. [2025-09-25T22:18:35.951671] [INFO ] [MAIN ] CUZ: Loaded 49778 primary data records. [2025-09-25T22:18:35.975696] [DEBUG] [LOCAL ] CVI: Loaded 46801 existing records from primary storage. [2025-09-25T22:18:35.999430] [INFO ] [MAIN ] CVI: Loaded 46801 primary data records. [2025-09-25T22:18:36.084510] [DEBUG] [LOCAL ] CVE: Loaded 53946 existing records from primary storage. [2025-09-25T22:18:36.145089] [INFO ] [MAIN ] CVE: Loaded 53946 primary data records. [2025-09-25T22:18:37.090059] [DEBUG] [MAIN ] CUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:37.092154] [INFO ] [MAIN ] CUZ: Generated 1807 derivative records from 49778 primary records. [2025-09-25T22:18:37.092544] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-25T22:18:37.138098] [DEBUG] [MAIN ] CVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:37.130331] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1807 records). [2025-09-25T22:18:37.143946] [INFO ] [MAIN ] CVI: Generated 1807 derivative records from 46801 primary records. [2025-09-25T22:18:37.142993] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-25T22:18:37.144303] [DEBUG] [MAIN ] CVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:37.148869] [INFO ] [MAIN ] Derivative Progress: 436/2043 symbols completed. CUZ took 1.3s. Estimated remaining: 11m 34s. Rate: 139.0 symbols/min [2025-09-25T22:18:37.149015] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-25T22:18:37.150221] [INFO ] [MAIN ] CVE: Generated 1807 derivative records from 53946 primary records. [2025-09-25T22:18:37.149291] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:37.151064] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-25T22:18:37.199825] [DEBUG] [LOCAL ] CVE: Derivative data saved (1807 records). [2025-09-25T22:18:37.199684] [DEBUG] [LOCAL ] CVI: Derivative data saved (1807 records). [2025-09-25T22:18:37.200037] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-25T22:18:37.200121] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-25T22:18:37.212298] [INFO ] [MAIN ] Derivative Progress: 437/2043 symbols completed. CVE took 1.4s. Estimated remaining: 11m 32s. Rate: 139.3 symbols/min [2025-09-25T22:18:37.212669] [INFO ] [MAIN ] Derivative Progress: 438/2043 symbols completed. CVI took 1.4s. Estimated remaining: 11m 30s. Rate: 139.6 symbols/min [2025-09-25T22:18:37.213605] [DEBUG] [LOCAL ] CVLG: Loaded 15677 existing records from primary storage. [2025-09-25T22:18:37.212895] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:37.214374] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:37.213745] [INFO ] [MAIN ] CVLG: Loaded 15677 primary data records. [2025-09-25T22:18:37.613661] [DEBUG] [LOCAL ] CVNA: Loaded 53395 existing records from primary storage. [2025-09-25T22:18:37.614461] [DEBUG] [LOCAL ] CVS: Loaded 54086 existing records from primary storage. [2025-09-25T22:18:37.614817] [INFO ] [MAIN ] CVS: Loaded 54086 primary data records. [2025-09-25T22:18:37.615407] [INFO ] [MAIN ] CVNA: Loaded 53395 primary data records. [2025-09-25T22:18:38.276613] [DEBUG] [MAIN ] CVLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:38.277985] [INFO ] [MAIN ] CVLG: Generated 1807 derivative records from 15677 primary records. [2025-09-25T22:18:38.278092] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-25T22:18:38.299349] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1807 records). [2025-09-25T22:18:38.299964] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-25T22:18:38.302888] [INFO ] [MAIN ] Derivative Progress: 439/2043 symbols completed. CVLG took 1.2s. Estimated remaining: 11m 32s. Rate: 139.1 symbols/min [2025-09-25T22:18:38.306130] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:38.332700] [DEBUG] [MAIN ] CVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:38.334306] [INFO ] [MAIN ] CVS: Generated 1807 derivative records from 54086 primary records. [2025-09-25T22:18:38.334541] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-25T22:18:38.367275] [DEBUG] [MAIN ] CVNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:38.371802] [DEBUG] [LOCAL ] CVS: Derivative data saved (1807 records). [2025-09-25T22:18:38.372817] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-25T22:18:38.372599] [INFO ] [MAIN ] CVNA: Generated 1807 derivative records from 53395 primary records. [2025-09-25T22:18:38.375132] [INFO ] [MAIN ] Derivative Progress: 440/2043 symbols completed. CVS took 1.2s. Estimated remaining: 11m 30s. Rate: 139.4 symbols/min [2025-09-25T22:18:38.375282] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-25T22:18:38.376273] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:38.409814] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1807 records). [2025-09-25T22:18:38.410109] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-25T22:18:38.413465] [INFO ] [MAIN ] Derivative Progress: 441/2043 symbols completed. CVNA took 1.2s. Estimated remaining: 11m 28s. Rate: 139.7 symbols/min [2025-09-25T22:18:38.414012] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:38.449855] [DEBUG] [LOCAL ] CVX: Loaded 54150 existing records from primary storage. [2025-09-25T22:18:38.450105] [INFO ] [MAIN ] CVX: Loaded 54150 primary data records. [2025-09-25T22:18:38.450609] [DEBUG] [LOCAL ] CW: Loaded 22557 existing records from primary storage. [2025-09-25T22:18:38.450915] [INFO ] [MAIN ] CW: Loaded 22557 primary data records. [2025-09-25T22:18:38.830573] [DEBUG] [LOCAL ] CWAN: Loaded 52772 existing records from primary storage. [2025-09-25T22:18:38.859489] [INFO ] [MAIN ] CWAN: Loaded 52772 primary data records. [2025-09-25T22:18:39.593277] [DEBUG] [MAIN ] CW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:39.607224] [INFO ] [MAIN ] CW: Generated 1807 derivative records from 22557 primary records. [2025-09-25T22:18:39.609069] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-25T22:18:39.608935] [DEBUG] [MAIN ] CVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:39.611185] [INFO ] [MAIN ] CVX: Generated 1807 derivative records from 54150 primary records. [2025-09-25T22:18:39.611339] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-25T22:18:39.643669] [DEBUG] [LOCAL ] CVX: Derivative data saved (1807 records). [2025-09-25T22:18:39.644132] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-25T22:18:39.647470] [INFO ] [MAIN ] Derivative Progress: 442/2043 symbols completed. CVX took 1.3s. Estimated remaining: 11m 31s. Rate: 139.1 symbols/min [2025-09-25T22:18:39.648445] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:39.651587] [DEBUG] [LOCAL ] CW: Derivative data saved (1807 records). [2025-09-25T22:18:39.652172] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-25T22:18:39.654481] [INFO ] [MAIN ] Derivative Progress: 443/2043 symbols completed. CW took 1.3s. Estimated remaining: 11m 29s. Rate: 139.4 symbols/min [2025-09-25T22:18:39.654943] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:39.674696] [DEBUG] [MAIN ] CWAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:39.675739] [INFO ] [MAIN ] CWAN: Generated 1807 derivative records from 52772 primary records. [2025-09-25T22:18:39.675912] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-25T22:18:39.696907] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1807 records). [2025-09-25T22:18:39.697242] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-25T22:18:39.701334] [INFO ] [MAIN ] Derivative Progress: 444/2043 symbols completed. CWAN took 1.3s. Estimated remaining: 11m 27s. Rate: 139.7 symbols/min [2025-09-25T22:18:39.702085] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:39.752451] [DEBUG] [LOCAL ] CWH: Loaded 51776 existing records from primary storage. [2025-09-25T22:18:39.752693] [INFO ] [MAIN ] CWH: Loaded 51776 primary data records. [2025-09-25T22:18:39.887073] [DEBUG] [LOCAL ] CWK: Loaded 49795 existing records from primary storage. [2025-09-25T22:18:39.897953] [INFO ] [MAIN ] CWK: Loaded 49795 primary data records. [2025-09-25T22:18:39.920177] [DEBUG] [LOCAL ] CWT: Loaded 28104 existing records from primary storage. [2025-09-25T22:18:39.932608] [INFO ] [MAIN ] CWT: Loaded 28104 primary data records. [2025-09-25T22:18:40.799304] [DEBUG] [MAIN ] CWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:40.800339] [INFO ] [MAIN ] CWH: Generated 1807 derivative records from 51776 primary records. [2025-09-25T22:18:40.800733] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-25T22:18:40.819079] [DEBUG] [LOCAL ] CWH: Derivative data saved (1807 records). [2025-09-25T22:18:40.819368] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-25T22:18:40.821583] [INFO ] [MAIN ] Derivative Progress: 445/2043 symbols completed. CWH took 1.2s. Estimated remaining: 11m 29s. Rate: 139.2 symbols/min [2025-09-25T22:18:40.822041] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:40.849761] [DEBUG] [MAIN ] CWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:40.856118] [INFO ] [MAIN ] CWK: Generated 1807 derivative records from 49795 primary records. [2025-09-25T22:18:40.855359] [DEBUG] [MAIN ] CWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:40.856289] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-25T22:18:40.857245] [INFO ] [MAIN ] CWT: Generated 1807 derivative records from 28104 primary records. [2025-09-25T22:18:40.857700] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-25T22:18:40.906796] [DEBUG] [LOCAL ] CWK: Derivative data saved (1807 records). [2025-09-25T22:18:40.908113] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-25T22:18:40.910863] [INFO ] [MAIN ] Derivative Progress: 446/2043 symbols completed. CWK took 1.3s. Estimated remaining: 11m 27s. Rate: 139.4 symbols/min [2025-09-25T22:18:40.911276] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:40.908042] [DEBUG] [LOCAL ] CWT: Derivative data saved (1807 records). [2025-09-25T22:18:40.911851] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-25T22:18:40.914539] [INFO ] [MAIN ] Derivative Progress: 447/2043 symbols completed. CWT took 1.2s. Estimated remaining: 11m 25s. Rate: 139.7 symbols/min [2025-09-25T22:18:40.915570] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:40.939855] [DEBUG] [LOCAL ] CXE: Loaded 7230 existing records from primary storage. [2025-09-25T22:18:40.940092] [INFO ] [MAIN ] CXE: Loaded 7230 primary data records. [2025-09-25T22:18:40.941167] [DEBUG] [LOCAL ] CX: Loaded 53229 existing records from primary storage. [2025-09-25T22:18:40.941368] [INFO ] [MAIN ] CX: Loaded 53229 primary data records. [2025-09-25T22:18:41.609400] [DEBUG] [LOCAL ] CXT: Loaded 31343 existing records from primary storage. [2025-09-25T22:18:41.624527] [INFO ] [MAIN ] CXT: Loaded 31343 primary data records. [2025-09-25T22:18:41.993585] [DEBUG] [MAIN ] CX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:42.004420] [INFO ] [MAIN ] CX: Generated 1807 derivative records from 53229 primary records. [2025-09-25T22:18:42.004960] [DEBUG] [MAIN ] CXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:42.005039] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-25T22:18:42.006057] [INFO ] [MAIN ] CXE: Generated 1807 derivative records from 7230 primary records. [2025-09-25T22:18:42.006208] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-25T22:18:42.039142] [DEBUG] [LOCAL ] CX: Derivative data saved (1807 records). [2025-09-25T22:18:42.039399] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-25T22:18:42.042862] [INFO ] [MAIN ] Derivative Progress: 448/2043 symbols completed. CX took 1.2s. Estimated remaining: 11m 27s. Rate: 139.2 symbols/min [2025-09-25T22:18:42.038724] [DEBUG] [LOCAL ] CXE: Derivative data saved (1807 records). [2025-09-25T22:18:42.043679] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-25T22:18:42.046974] [INFO ] [MAIN ] Derivative Progress: 449/2043 symbols completed. CXE took 1.1s. Estimated remaining: 11m 26s. Rate: 139.5 symbols/min [2025-09-25T22:18:42.062276] [DEBUG] [MAIN ] CXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:42.062932] [INFO ] [MAIN ] CXT: Generated 1807 derivative records from 31343 primary records. [2025-09-25T22:18:42.062997] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-25T22:18:42.078881] [DEBUG] [LOCAL ] CXT: Derivative data saved (1807 records). [2025-09-25T22:18:42.078977] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-25T22:18:42.081453] [INFO ] [MAIN ] Derivative Progress: 450/2043 symbols completed. CXT took 1.2s. Estimated remaining: 11m 24s. Rate: 139.8 symbols/min [2025-09-25T22:18:42.082332] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:42.082615] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:42.082262] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:42.102353] [DEBUG] [LOCAL ] DAC: Loaded 12696 existing records from primary storage. [2025-09-25T22:18:42.102551] [INFO ] [MAIN ] DAC: Loaded 12696 primary data records. [2025-09-25T22:18:42.343600] [DEBUG] [LOCAL ] CYD: Loaded 26935 existing records from primary storage. [2025-09-25T22:18:42.454250] [DEBUG] [LOCAL ] CXW: Loaded 44634 existing records from primary storage. [2025-09-25T22:18:42.460001] [INFO ] [MAIN ] CXW: Loaded 44634 primary data records. [2025-09-25T22:18:42.469499] [INFO ] [MAIN ] CYD: Loaded 26935 primary data records. [2025-09-25T22:18:43.302393] [DEBUG] [MAIN ] DAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:43.303899] [INFO ] [MAIN ] DAC: Generated 1807 derivative records from 12696 primary records. [2025-09-25T22:18:43.304192] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-25T22:18:43.325467] [DEBUG] [LOCAL ] DAC: Derivative data saved (1807 records). [2025-09-25T22:18:43.326047] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-25T22:18:43.328669] [INFO ] [MAIN ] Derivative Progress: 451/2043 symbols completed. DAC took 1.2s. Estimated remaining: 11m 26s. Rate: 139.2 symbols/min [2025-09-25T22:18:43.330228] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:43.357476] [DEBUG] [MAIN ] CYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:43.367350] [INFO ] [MAIN ] CYD: Generated 1807 derivative records from 26935 primary records. [2025-09-25T22:18:43.373387] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-25T22:18:43.373295] [DEBUG] [MAIN ] CXW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:43.376086] [INFO ] [MAIN ] CXW: Generated 1807 derivative records from 44634 primary records. [2025-09-25T22:18:43.376213] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-25T22:18:43.392789] [DEBUG] [LOCAL ] CYD: Derivative data saved (1807 records). [2025-09-25T22:18:43.393075] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-25T22:18:43.395748] [INFO ] [MAIN ] Derivative Progress: 452/2043 symbols completed. CYD took 1.3s. Estimated remaining: 11m 24s. Rate: 139.5 symbols/min [2025-09-25T22:18:43.404858] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:43.415550] [DEBUG] [LOCAL ] CXW: Derivative data saved (1807 records). [2025-09-25T22:18:43.430067] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-25T22:18:43.433119] [INFO ] [MAIN ] Derivative Progress: 453/2043 symbols completed. CXW took 1.4s. Estimated remaining: 11m 23s. Rate: 139.8 symbols/min [2025-09-25T22:18:43.433687] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:43.459203] [DEBUG] [LOCAL ] DAL: Loaded 54143 existing records from primary storage. [2025-09-25T22:18:43.464307] [INFO ] [MAIN ] DAL: Loaded 54143 primary data records. [2025-09-25T22:18:43.583434] [DEBUG] [LOCAL ] DAO: Loaded 21360 existing records from primary storage. [2025-09-25T22:18:43.606250] [INFO ] [MAIN ] DAO: Loaded 21360 primary data records. [2025-09-25T22:18:43.852158] [DEBUG] [LOCAL ] DAN: Loaded 49394 existing records from primary storage. [2025-09-25T22:18:43.987954] [INFO ] [MAIN ] DAN: Loaded 49394 primary data records. [2025-09-25T22:18:44.593210] [DEBUG] [MAIN ] DAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:44.595937] [INFO ] [MAIN ] DAL: Generated 1807 derivative records from 54143 primary records. [2025-09-25T22:18:44.598602] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-25T22:18:44.628816] [DEBUG] [MAIN ] DAO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:44.639146] [INFO ] [MAIN ] DAO: Generated 1807 derivative records from 21360 primary records. [2025-09-25T22:18:44.644099] [DEBUG] [LOCAL ] DAL: Derivative data saved (1807 records). [2025-09-25T22:18:44.644302] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-25T22:18:44.644515] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-25T22:18:44.649153] [INFO ] [MAIN ] Derivative Progress: 454/2043 symbols completed. DAL took 1.3s. Estimated remaining: 11m 25s. Rate: 139.2 symbols/min [2025-09-25T22:18:44.659133] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:44.672529] [DEBUG] [LOCAL ] DAO: Derivative data saved (1807 records). [2025-09-25T22:18:44.685966] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-25T22:18:44.685763] [DEBUG] [MAIN ] DAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:44.688780] [INFO ] [MAIN ] Derivative Progress: 455/2043 symbols completed. DAO took 1.3s. Estimated remaining: 11m 23s. Rate: 139.5 symbols/min [2025-09-25T22:18:44.689361] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:44.690274] [INFO ] [MAIN ] DAN: Generated 1807 derivative records from 49394 primary records. [2025-09-25T22:18:44.690509] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-25T22:18:44.709200] [DEBUG] [LOCAL ] DAN: Derivative data saved (1807 records). [2025-09-25T22:18:44.709454] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-25T22:18:44.712060] [INFO ] [MAIN ] Derivative Progress: 456/2043 symbols completed. DAN took 1.3s. Estimated remaining: 11m 21s. Rate: 139.8 symbols/min [2025-09-25T22:18:44.712559] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:44.759686] [DEBUG] [LOCAL ] DAR: Loaded 52219 existing records from primary storage. [2025-09-25T22:18:44.760042] [INFO ] [MAIN ] DAR: Loaded 52219 primary data records. [2025-09-25T22:18:44.876327] [DEBUG] [LOCAL ] DAVA: Loaded 40977 existing records from primary storage. [2025-09-25T22:18:44.882680] [INFO ] [MAIN ] DAVA: Loaded 40977 primary data records. [2025-09-25T22:18:45.247097] [DEBUG] [LOCAL ] DAY: Loaded 50193 existing records from primary storage. [2025-09-25T22:18:45.253493] [INFO ] [MAIN ] DAY: Loaded 50193 primary data records. [2025-09-25T22:18:45.900017] [DEBUG] [MAIN ] DAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:45.901061] [INFO ] [MAIN ] DAR: Generated 1807 derivative records from 52219 primary records. [2025-09-25T22:18:45.901587] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-25T22:18:45.938365] [DEBUG] [MAIN ] DAVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:45.939564] [DEBUG] [LOCAL ] DAR: Derivative data saved (1807 records). [2025-09-25T22:18:45.940430] [INFO ] [MAIN ] DAVA: Generated 1807 derivative records from 40977 primary records. [2025-09-25T22:18:45.940726] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-25T22:18:45.940676] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-25T22:18:45.945016] [INFO ] [MAIN ] Derivative Progress: 457/2043 symbols completed. DAR took 1.3s. Estimated remaining: 11m 24s. Rate: 139.2 symbols/min [2025-09-25T22:18:45.959102] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:45.969531] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1807 records). [2025-09-25T22:18:45.969809] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-25T22:18:45.972352] [INFO ] [MAIN ] Derivative Progress: 458/2043 symbols completed. DAVA took 1.3s. Estimated remaining: 11m 22s. Rate: 139.5 symbols/min [2025-09-25T22:18:45.981404] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:45.987490] [DEBUG] [MAIN ] DAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:45.988926] [INFO ] [MAIN ] DAY: Generated 1807 derivative records from 50193 primary records. [2025-09-25T22:18:45.989375] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-25T22:18:46.012500] [DEBUG] [LOCAL ] DAY: Derivative data saved (1807 records). [2025-09-25T22:18:46.028940] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-25T22:18:46.029215] [DEBUG] [LOCAL ] DBL: Loaded 9203 existing records from primary storage. [2025-09-25T22:18:46.032274] [INFO ] [MAIN ] Derivative Progress: 459/2043 symbols completed. DAY took 1.3s. Estimated remaining: 11m 20s. Rate: 139.7 symbols/min [2025-09-25T22:18:46.032812] [INFO ] [MAIN ] DBL: Loaded 9203 primary data records. [2025-09-25T22:18:46.033098] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:46.166813] [DEBUG] [LOCAL ] DBI: Loaded 45297 existing records from primary storage. [2025-09-25T22:18:46.173139] [INFO ] [MAIN ] DBI: Loaded 45297 primary data records. [2025-09-25T22:18:46.773507] [DEBUG] [LOCAL ] DBRG: Loaded 50157 existing records from primary storage. [2025-09-25T22:18:46.774006] [INFO ] [MAIN ] DBRG: Loaded 50157 primary data records. [2025-09-25T22:18:47.137252] [DEBUG] [MAIN ] DBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:47.139160] [INFO ] [MAIN ] DBL: Generated 1807 derivative records from 9203 primary records. [2025-09-25T22:18:47.139637] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-25T22:18:47.181123] [DEBUG] [MAIN ] DBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:47.182384] [DEBUG] [LOCAL ] DBL: Derivative data saved (1807 records). [2025-09-25T22:18:47.183590] [INFO ] [MAIN ] DBI: Generated 1807 derivative records from 45297 primary records. [2025-09-25T22:18:47.183923] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-25T22:18:47.183838] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-25T22:18:47.187773] [INFO ] [MAIN ] Derivative Progress: 460/2043 symbols completed. DBL took 1.2s. Estimated remaining: 11m 22s. Rate: 139.2 symbols/min [2025-09-25T22:18:47.189195] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:47.224283] [DEBUG] [MAIN ] DBRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:47.225743] [INFO ] [MAIN ] DBRG: Generated 1807 derivative records from 50157 primary records. [2025-09-25T22:18:47.225872] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-25T22:18:47.226500] [DEBUG] [LOCAL ] DBI: Derivative data saved (1807 records). [2025-09-25T22:18:47.227442] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-25T22:18:47.230093] [INFO ] [MAIN ] Derivative Progress: 461/2043 symbols completed. DBI took 1.3s. Estimated remaining: 11m 20s. Rate: 139.5 symbols/min [2025-09-25T22:18:47.243356] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:47.248598] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1807 records). [2025-09-25T22:18:47.248764] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-25T22:18:47.252400] [INFO ] [MAIN ] Derivative Progress: 462/2043 symbols completed. DBRG took 1.2s. Estimated remaining: 11m 19s. Rate: 139.8 symbols/min [2025-09-25T22:18:47.262596] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:47.277506] [DEBUG] [LOCAL ] DCO: Loaded 13929 existing records from primary storage. [2025-09-25T22:18:47.289288] [INFO ] [MAIN ] DCO: Loaded 13929 primary data records. [2025-09-25T22:18:47.324459] [DEBUG] [LOCAL ] DCI: Loaded 37809 existing records from primary storage. [2025-09-25T22:18:47.352783] [INFO ] [MAIN ] DCI: Loaded 37809 primary data records. [2025-09-25T22:18:47.857817] [DEBUG] [LOCAL ] DD: Loaded 53213 existing records from primary storage. [2025-09-25T22:18:47.876314] [INFO ] [MAIN ] DD: Loaded 53213 primary data records. [2025-09-25T22:18:48.648012] [DEBUG] [MAIN ] DCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:48.650629] [INFO ] [MAIN ] DCO: Generated 1807 derivative records from 13929 primary records. [2025-09-25T22:18:48.651684] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-25T22:18:48.674762] [DEBUG] [LOCAL ] DCO: Derivative data saved (1807 records). [2025-09-25T22:18:48.677312] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-25T22:18:48.682387] [INFO ] [MAIN ] Derivative Progress: 463/2043 symbols completed. DCO took 1.4s. Estimated remaining: 11m 22s. Rate: 139.1 symbols/min [2025-09-25T22:18:48.699079] [DEBUG] [MAIN ] DCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:48.700077] [INFO ] [MAIN ] DCI: Generated 1807 derivative records from 37809 primary records. [2025-09-25T22:18:48.700321] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-25T22:18:48.719624] [DEBUG] [LOCAL ] DCI: Derivative data saved (1807 records). [2025-09-25T22:18:48.720036] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-25T22:18:48.723619] [INFO ] [MAIN ] Derivative Progress: 464/2043 symbols completed. DCI took 1.5s. Estimated remaining: 11m 20s. Rate: 139.4 symbols/min [2025-09-25T22:18:48.740630] [DEBUG] [MAIN ] DD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:48.741735] [INFO ] [MAIN ] DD: Generated 1807 derivative records from 53213 primary records. [2025-09-25T22:18:48.741804] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-25T22:18:48.758826] [DEBUG] [LOCAL ] DD: Derivative data saved (1807 records). [2025-09-25T22:18:48.758938] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-25T22:18:48.761697] [INFO ] [MAIN ] Derivative Progress: 465/2043 symbols completed. DD took 1.5s. Estimated remaining: 11m 18s. Rate: 139.6 symbols/min [2025-09-25T22:18:48.762935] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:48.762829] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:48.763852] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:48.769453] [DEBUG] [LOCAL ] DDT: Loaded 2107 existing records from primary storage. [2025-09-25T22:18:48.769813] [INFO ] [MAIN ] DDT: Loaded 2107 primary data records. [2025-09-25T22:18:49.115984] [DEBUG] [LOCAL ] DDL: Loaded 36655 existing records from primary storage. [2025-09-25T22:18:49.130924] [INFO ] [MAIN ] DDL: Loaded 36655 primary data records. [2025-09-25T22:18:49.254288] [DEBUG] [LOCAL ] DE: Loaded 48062 existing records from primary storage. [2025-09-25T22:18:49.269134] [INFO ] [MAIN ] DE: Loaded 48062 primary data records. [2025-09-25T22:18:49.850063] [DEBUG] [MAIN ] DDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:49.851370] [INFO ] [MAIN ] DDT: Generated 1807 derivative records from 2107 primary records. [2025-09-25T22:18:49.851479] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-25T22:18:49.873886] [DEBUG] [LOCAL ] DDT: Derivative data saved (1807 records). [2025-09-25T22:18:49.874444] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-25T22:18:49.877014] [INFO ] [MAIN ] Derivative Progress: 466/2043 symbols completed. DDT took 1.1s. Estimated remaining: 11m 20s. Rate: 139.2 symbols/min [2025-09-25T22:18:49.885450] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:49.891777] [DEBUG] [MAIN ] DDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:49.892835] [INFO ] [MAIN ] DDL: Generated 1807 derivative records from 36655 primary records. [2025-09-25T22:18:49.893062] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-25T22:18:49.924237] [DEBUG] [MAIN ] DE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:49.925902] [INFO ] [MAIN ] DE: Generated 1807 derivative records from 48062 primary records. [2025-09-25T22:18:49.926566] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-25T22:18:49.943206] [DEBUG] [LOCAL ] DDL: Derivative data saved (1807 records). [2025-09-25T22:18:49.943851] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-25T22:18:49.946409] [INFO ] [MAIN ] Derivative Progress: 467/2043 symbols completed. DDL took 1.2s. Estimated remaining: 11m 18s. Rate: 139.4 symbols/min [2025-09-25T22:18:49.959731] [DEBUG] [LOCAL ] DE: Derivative data saved (1807 records). [2025-09-25T22:18:49.960192] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:49.960350] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-25T22:18:49.963338] [INFO ] [MAIN ] Derivative Progress: 468/2043 symbols completed. DE took 1.2s. Estimated remaining: 11m 17s. Rate: 139.7 symbols/min [2025-09-25T22:18:49.964159] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:49.982005] [DEBUG] [LOCAL ] DEA: Loaded 41610 existing records from primary storage. [2025-09-25T22:18:49.982215] [INFO ] [MAIN ] DEA: Loaded 41610 primary data records. [2025-09-25T22:18:50.185100] [DEBUG] [LOCAL ] DEC: Loaded 30878 existing records from primary storage. [2025-09-25T22:18:50.356096] [INFO ] [MAIN ] DEC: Loaded 30878 primary data records. [2025-09-25T22:18:50.449940] [DEBUG] [LOCAL ] DECK: Loaded 53690 existing records from primary storage. [2025-09-25T22:18:50.477632] [INFO ] [MAIN ] DECK: Loaded 53690 primary data records. [2025-09-25T22:18:51.080977] [DEBUG] [MAIN ] DEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:51.082900] [INFO ] [MAIN ] DEA: Generated 1807 derivative records from 41610 primary records. [2025-09-25T22:18:51.083194] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-25T22:18:51.105628] [DEBUG] [LOCAL ] DEA: Derivative data saved (1807 records). [2025-09-25T22:18:51.106096] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-25T22:18:51.108711] [INFO ] [MAIN ] Derivative Progress: 469/2043 symbols completed. DEA took 1.2s. Estimated remaining: 11m 18s. Rate: 139.2 symbols/min [2025-09-25T22:18:51.109872] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:51.144334] [DEBUG] [MAIN ] DECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:51.144081] [DEBUG] [MAIN ] DEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:51.146102] [INFO ] [MAIN ] DECK: Generated 1807 derivative records from 53690 primary records. [2025-09-25T22:18:51.145282] [INFO ] [MAIN ] DEC: Generated 1807 derivative records from 30878 primary records. [2025-09-25T22:18:51.146258] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-25T22:18:51.146325] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-25T22:18:51.177107] [DEBUG] [LOCAL ] DEC: Derivative data saved (1807 records). [2025-09-25T22:18:51.177843] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-25T22:18:51.181458] [INFO ] [MAIN ] Derivative Progress: 470/2043 symbols completed. DEC took 1.2s. Estimated remaining: 11m 17s. Rate: 139.4 symbols/min [2025-09-25T22:18:51.182478] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:51.195473] [DEBUG] [LOCAL ] DECK: Derivative data saved (1807 records). [2025-09-25T22:18:51.196078] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-25T22:18:51.198615] [INFO ] [MAIN ] Derivative Progress: 471/2043 symbols completed. DECK took 1.2s. Estimated remaining: 11m 15s. Rate: 139.7 symbols/min [2025-09-25T22:18:51.199092] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:51.232889] [DEBUG] [LOCAL ] DEO: Loaded 49405 existing records from primary storage. [2025-09-25T22:18:51.233203] [INFO ] [MAIN ] DEO: Loaded 49405 primary data records. [2025-09-25T22:18:51.331528] [DEBUG] [LOCAL ] DFIN: Loaded 23491 existing records from primary storage. [2025-09-25T22:18:51.345344] [INFO ] [MAIN ] DFIN: Loaded 23491 primary data records. [2025-09-25T22:18:51.443950] [DEBUG] [LOCAL ] DFH: Loaded 32932 existing records from primary storage. [2025-09-25T22:18:51.490562] [INFO ] [MAIN ] DFH: Loaded 32932 primary data records. [2025-09-25T22:18:52.360997] [DEBUG] [MAIN ] DEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:52.364044] [INFO ] [MAIN ] DEO: Generated 1807 derivative records from 49405 primary records. [2025-09-25T22:18:52.364247] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-25T22:18:52.394119] [DEBUG] [MAIN ] DFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:52.396610] [INFO ] [MAIN ] DFIN: Generated 1807 derivative records from 23491 primary records. [2025-09-25T22:18:52.398840] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-25T22:18:52.428311] [DEBUG] [LOCAL ] DEO: Derivative data saved (1807 records). [2025-09-25T22:18:52.430123] [DEBUG] [MAIN ] DFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:52.429778] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-25T22:18:52.431827] [INFO ] [MAIN ] DFH: Generated 1807 derivative records from 32932 primary records. [2025-09-25T22:18:52.432849] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-25T22:18:52.436630] [INFO ] [MAIN ] Derivative Progress: 472/2043 symbols completed. DEO took 1.3s. Estimated remaining: 11m 17s. Rate: 139.2 symbols/min [2025-09-25T22:18:52.439764] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1807 records). [2025-09-25T22:18:52.449173] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:52.455216] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-25T22:18:52.458058] [INFO ] [MAIN ] Derivative Progress: 473/2043 symbols completed. DFIN took 1.3s. Estimated remaining: 11m 16s. Rate: 139.4 symbols/min [2025-09-25T22:18:52.459147] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:52.465670] [DEBUG] [LOCAL ] DFH: Derivative data saved (1807 records). [2025-09-25T22:18:52.466086] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-25T22:18:52.470690] [INFO ] [MAIN ] Derivative Progress: 474/2043 symbols completed. DFH took 1.3s. Estimated remaining: 11m 14s. Rate: 139.7 symbols/min [2025-09-25T22:18:52.471529] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:52.487050] [DEBUG] [LOCAL ] DFP: Loaded 11734 existing records from primary storage. [2025-09-25T22:18:52.487439] [INFO ] [MAIN ] DFP: Loaded 11734 primary data records. [2025-09-25T22:18:52.952860] [DEBUG] [LOCAL ] DG: Loaded 53678 existing records from primary storage. [2025-09-25T22:18:52.954247] [INFO ] [MAIN ] DG: Loaded 53678 primary data records. [2025-09-25T22:18:52.955370] [DEBUG] [LOCAL ] DGX: Loaded 45481 existing records from primary storage. [2025-09-25T22:18:52.961352] [INFO ] [MAIN ] DGX: Loaded 45481 primary data records. [2025-09-25T22:18:53.625530] [DEBUG] [MAIN ] DFP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:53.627219] [INFO ] [MAIN ] DFP: Generated 1807 derivative records from 11734 primary records. [2025-09-25T22:18:53.627530] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-25T22:18:53.646171] [DEBUG] [LOCAL ] DFP: Derivative data saved (1807 records). [2025-09-25T22:18:53.647054] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-25T22:18:53.651141] [INFO ] [MAIN ] Derivative Progress: 475/2043 symbols completed. DFP took 1.2s. Estimated remaining: 11m 16s. Rate: 139.2 symbols/min [2025-09-25T22:18:53.652356] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:53.676390] [DEBUG] [MAIN ] DG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:53.677580] [INFO ] [MAIN ] DG: Generated 1807 derivative records from 53678 primary records. [2025-09-25T22:18:53.678056] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-25T22:18:53.702790] [DEBUG] [LOCAL ] DG: Derivative data saved (1807 records). [2025-09-25T22:18:53.710469] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-25T22:18:53.715613] [DEBUG] [LOCAL ] DHF: Loaded 20665 existing records from primary storage. [2025-09-25T22:18:53.718114] [INFO ] [MAIN ] Derivative Progress: 476/2043 symbols completed. DG took 1.3s. Estimated remaining: 11m 14s. Rate: 139.5 symbols/min [2025-09-25T22:18:53.718838] [INFO ] [MAIN ] DHF: Loaded 20665 primary data records. [2025-09-25T22:18:53.719496] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:53.796682] [DEBUG] [MAIN ] DGX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:53.816480] [INFO ] [MAIN ] DGX: Generated 1807 derivative records from 45481 primary records. [2025-09-25T22:18:53.821929] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-25T22:18:53.928145] [DEBUG] [LOCAL ] DGX: Derivative data saved (1807 records). [2025-09-25T22:18:53.962904] [DEBUG] [LOCAL ] DHX: Loaded 13311 existing records from primary storage. [2025-09-25T22:18:53.998692] [INFO ] [MAIN ] DHX: Loaded 13311 primary data records. [2025-09-25T22:18:53.937244] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-25T22:18:54.085436] [INFO ] [MAIN ] Derivative Progress: 477/2043 symbols completed. DGX took 1.6s. Estimated remaining: 11m 13s. Rate: 139.5 symbols/min [2025-09-25T22:18:54.101437] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:54.244161] [DEBUG] [LOCAL ] DIAX: Loaded 12627 existing records from primary storage. [2025-09-25T22:18:54.273979] [INFO ] [MAIN ] DIAX: Loaded 12627 primary data records. [2025-09-25T22:18:54.888543] [DEBUG] [MAIN ] DHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:54.890594] [INFO ] [MAIN ] DHF: Generated 1807 derivative records from 20665 primary records. [2025-09-25T22:18:54.891145] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-25T22:18:54.910680] [DEBUG] [LOCAL ] DHF: Derivative data saved (1807 records). [2025-09-25T22:18:54.911597] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-25T22:18:54.915231] [INFO ] [MAIN ] Derivative Progress: 478/2043 symbols completed. DHF took 1.3s. Estimated remaining: 11m 14s. Rate: 139.2 symbols/min [2025-09-25T22:18:54.934631] [DEBUG] [MAIN ] DHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:54.935982] [INFO ] [MAIN ] DHX: Generated 1807 derivative records from 13311 primary records. [2025-09-25T22:18:54.936370] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-25T22:18:54.955470] [DEBUG] [LOCAL ] DHX: Derivative data saved (1807 records). [2025-09-25T22:18:54.957942] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-25T22:18:54.961792] [INFO ] [MAIN ] Derivative Progress: 479/2043 symbols completed. DHX took 1.2s. Estimated remaining: 11m 13s. Rate: 139.5 symbols/min [2025-09-25T22:18:54.975458] [DEBUG] [MAIN ] DIAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:54.976373] [INFO ] [MAIN ] DIAX: Generated 1807 derivative records from 12627 primary records. [2025-09-25T22:18:54.976444] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-25T22:18:54.992803] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1807 records). [2025-09-25T22:18:54.992884] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-25T22:18:54.995885] [INFO ] [MAIN ] Derivative Progress: 480/2043 symbols completed. DIAX took 0.9s. Estimated remaining: 11m 11s. Rate: 139.8 symbols/min [2025-09-25T22:18:54.996627] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:54.996583] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:54.997147] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:55.040912] [DEBUG] [LOCAL ] DIN: Loaded 37533 existing records from primary storage. [2025-09-25T22:18:55.054378] [INFO ] [MAIN ] DIN: Loaded 37533 primary data records. [2025-09-25T22:18:55.202490] [DEBUG] [LOCAL ] DIS: Loaded 54178 existing records from primary storage. [2025-09-25T22:18:55.260484] [INFO ] [MAIN ] DIS: Loaded 54178 primary data records. [2025-09-25T22:18:55.278013] [DEBUG] [LOCAL ] DINO: Loaded 53341 existing records from primary storage. [2025-09-25T22:18:55.337691] [INFO ] [MAIN ] DINO: Loaded 53341 primary data records. [2025-09-25T22:18:56.124057] [DEBUG] [MAIN ] DIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:56.125776] [INFO ] [MAIN ] DIN: Generated 1807 derivative records from 37533 primary records. [2025-09-25T22:18:56.125948] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-25T22:18:56.149544] [DEBUG] [LOCAL ] DIN: Derivative data saved (1807 records). [2025-09-25T22:18:56.150303] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-25T22:18:56.152417] [INFO ] [MAIN ] Derivative Progress: 481/2043 symbols completed. DIN took 1.2s. Estimated remaining: 11m 13s. Rate: 139.3 symbols/min [2025-09-25T22:18:56.154386] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:56.180019] [DEBUG] [MAIN ] DINO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:56.195568] [INFO ] [MAIN ] DINO: Generated 1807 derivative records from 53341 primary records. [2025-09-25T22:18:56.202821] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-25T22:18:56.202637] [DEBUG] [MAIN ] DIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:56.203639] [INFO ] [MAIN ] DIS: Generated 1807 derivative records from 54178 primary records. [2025-09-25T22:18:56.204772] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-25T22:18:56.236147] [DEBUG] [LOCAL ] DKL: Loaded 19153 existing records from primary storage. [2025-09-25T22:18:56.242890] [INFO ] [MAIN ] DKL: Loaded 19153 primary data records. [2025-09-25T22:18:56.242499] [DEBUG] [LOCAL ] DIS: Derivative data saved (1807 records). [2025-09-25T22:18:56.244126] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-25T22:18:56.260013] [INFO ] [MAIN ] Derivative Progress: 482/2043 symbols completed. DIS took 1.3s. Estimated remaining: 11m 11s. Rate: 139.5 symbols/min [2025-09-25T22:18:56.270287] [DEBUG] [LOCAL ] DINO: Derivative data saved (1807 records). [2025-09-25T22:18:56.281287] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-25T22:18:56.281197] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:56.289495] [INFO ] [MAIN ] Derivative Progress: 483/2043 symbols completed. DINO took 1.3s. Estimated remaining: 11m 10s. Rate: 139.8 symbols/min [2025-09-25T22:18:56.320427] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:56.612903] [DEBUG] [LOCAL ] DLB: Loaded 32368 existing records from primary storage. [2025-09-25T22:18:56.613358] [INFO ] [MAIN ] DLB: Loaded 32368 primary data records. [2025-09-25T22:18:56.847580] [DEBUG] [LOCAL ] DLR: Loaded 51508 existing records from primary storage. [2025-09-25T22:18:57.065295] [INFO ] [MAIN ] DLR: Loaded 51508 primary data records. [2025-09-25T22:18:57.255339] [DEBUG] [MAIN ] DKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:57.282619] [INFO ] [MAIN ] DKL: Generated 1807 derivative records from 19153 primary records. [2025-09-25T22:18:57.395915] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-25T22:18:57.426482] [DEBUG] [LOCAL ] DKL: Derivative data saved (1807 records). [2025-09-25T22:18:57.432340] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-25T22:18:57.434847] [INFO ] [MAIN ] Derivative Progress: 484/2043 symbols completed. DKL took 1.3s. Estimated remaining: 11m 12s. Rate: 139.3 symbols/min [2025-09-25T22:18:57.436977] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:57.463363] [DEBUG] [MAIN ] DLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:57.464583] [INFO ] [MAIN ] DLB: Generated 1807 derivative records from 32368 primary records. [2025-09-25T22:18:57.464780] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-25T22:18:57.492229] [DEBUG] [LOCAL ] DLB: Derivative data saved (1807 records). [2025-09-25T22:18:57.492492] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-25T22:18:57.495758] [INFO ] [MAIN ] Derivative Progress: 485/2043 symbols completed. DLB took 1.2s. Estimated remaining: 11m 10s. Rate: 139.5 symbols/min [2025-09-25T22:18:57.498109] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:57.510751] [DEBUG] [LOCAL ] DLX: Loaded 29145 existing records from primary storage. [2025-09-25T22:18:57.511403] [INFO ] [MAIN ] DLX: Loaded 29145 primary data records. [2025-09-25T22:18:57.567012] [DEBUG] [MAIN ] DLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:57.591506] [INFO ] [MAIN ] DLR: Generated 1807 derivative records from 51508 primary records. [2025-09-25T22:18:57.597837] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-25T22:18:57.694205] [DEBUG] [LOCAL ] DLY: Loaded 19619 existing records from primary storage. [2025-09-25T22:18:57.701181] [INFO ] [MAIN ] DLY: Loaded 19619 primary data records. [2025-09-25T22:18:58.002428] [DEBUG] [LOCAL ] DLR: Derivative data saved (1807 records). [2025-09-25T22:18:58.024296] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-25T22:18:58.043697] [INFO ] [MAIN ] Derivative Progress: 486/2043 symbols completed. DLR took 1.7s. Estimated remaining: 11m 10s. Rate: 139.5 symbols/min [2025-09-25T22:18:58.044090] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:58.104597] [DEBUG] [LOCAL ] DMA: Loaded 4570 existing records from primary storage. [2025-09-25T22:18:58.140596] [INFO ] [MAIN ] DMA: Loaded 4570 primary data records. [2025-09-25T22:18:58.650223] [DEBUG] [MAIN ] DLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:58.651862] [INFO ] [MAIN ] DLX: Generated 1807 derivative records from 29145 primary records. [2025-09-25T22:18:58.652383] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-25T22:18:58.694867] [DEBUG] [MAIN ] DLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:58.699300] [INFO ] [MAIN ] DLY: Generated 1807 derivative records from 19619 primary records. [2025-09-25T22:18:58.699631] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-25T22:18:58.719780] [DEBUG] [LOCAL ] DLX: Derivative data saved (1807 records). [2025-09-25T22:18:58.722799] [DEBUG] [LOCAL ] DLY: Derivative data saved (1807 records). [2025-09-25T22:18:58.723524] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-25T22:18:58.726810] [INFO ] [MAIN ] Derivative Progress: 487/2043 symbols completed. DLY took 1.2s. Estimated remaining: 11m 10s. Rate: 139.3 symbols/min [2025-09-25T22:18:58.723630] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-25T22:18:58.734104] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:58.734324] [INFO ] [MAIN ] Derivative Progress: 488/2043 symbols completed. DLX took 1.3s. Estimated remaining: 11m 8s. Rate: 139.6 symbols/min [2025-09-25T22:18:58.736255] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:58.751139] [DEBUG] [MAIN ] DMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:58.752308] [INFO ] [MAIN ] DMA: Generated 1807 derivative records from 4570 primary records. [2025-09-25T22:18:58.752520] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-25T22:18:58.777556] [DEBUG] [LOCAL ] DMB: Loaded 10216 existing records from primary storage. [2025-09-25T22:18:58.784852] [DEBUG] [LOCAL ] DMA: Derivative data saved (1807 records). [2025-09-25T22:18:58.785019] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-25T22:18:58.789021] [INFO ] [MAIN ] Derivative Progress: 489/2043 symbols completed. DMA took 0.7s. Estimated remaining: 11m 7s. Rate: 139.8 symbols/min [2025-09-25T22:18:58.789301] [INFO ] [MAIN ] DMB: Loaded 10216 primary data records. [2025-09-25T22:18:58.785354] [DEBUG] [LOCAL ] DMO: Loaded 9919 existing records from primary storage. [2025-09-25T22:18:58.802055] [INFO ] [MAIN ] DMO: Loaded 9919 primary data records. [2025-09-25T22:18:58.807584] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:18:59.577724] [DEBUG] [LOCAL ] DNA: Loaded 48681 existing records from primary storage. [2025-09-25T22:18:59.579464] [INFO ] [MAIN ] DNA: Loaded 48681 primary data records. [2025-09-25T22:18:59.942607] [DEBUG] [MAIN ] DMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:59.951886] [INFO ] [MAIN ] DMB: Generated 1807 derivative records from 10216 primary records. [2025-09-25T22:18:59.958024] [DEBUG] [MAIN ] DMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:18:59.957697] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-25T22:18:59.959027] [INFO ] [MAIN ] DMO: Generated 1807 derivative records from 9919 primary records. [2025-09-25T22:18:59.959210] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-25T22:18:59.994188] [DEBUG] [LOCAL ] DMO: Derivative data saved (1807 records). [2025-09-25T22:18:59.995032] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-25T22:18:59.997768] [INFO ] [MAIN ] Derivative Progress: 490/2043 symbols completed. DMO took 1.3s. Estimated remaining: 11m 9s. Rate: 139.3 symbols/min [2025-09-25T22:18:59.998833] [DEBUG] [LOCAL ] DMB: Derivative data saved (1807 records). [2025-09-25T22:18:59.999349] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-25T22:18:59.999148] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:00.002777] [INFO ] [MAIN ] Derivative Progress: 491/2043 symbols completed. DMB took 1.3s. Estimated remaining: 11m 7s. Rate: 139.6 symbols/min [2025-09-25T22:19:00.003458] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:00.024568] [DEBUG] [MAIN ] DNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:00.025424] [INFO ] [MAIN ] DNA: Generated 1807 derivative records from 48681 primary records. [2025-09-25T22:19:00.025542] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-25T22:19:00.056728] [DEBUG] [LOCAL ] DNA: Derivative data saved (1807 records). [2025-09-25T22:19:00.056803] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-25T22:19:00.060058] [INFO ] [MAIN ] Derivative Progress: 492/2043 symbols completed. DNA took 1.3s. Estimated remaining: 11m 6s. Rate: 139.8 symbols/min [2025-09-25T22:19:00.080126] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:00.102955] [DEBUG] [LOCAL ] DNP: Loaded 33558 existing records from primary storage. [2025-09-25T22:19:00.115938] [INFO ] [MAIN ] DNP: Loaded 33558 primary data records. [2025-09-25T22:19:00.128616] [DEBUG] [LOCAL ] DNOW: Loaded 43851 existing records from primary storage. [2025-09-25T22:19:00.162312] [INFO ] [MAIN ] DNOW: Loaded 43851 primary data records. [2025-09-25T22:19:00.519958] [DEBUG] [LOCAL ] DOC: Loaded 53927 existing records from primary storage. [2025-09-25T22:19:00.675621] [INFO ] [MAIN ] DOC: Loaded 53927 primary data records. [2025-09-25T22:19:01.161025] [DEBUG] [MAIN ] DNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:01.162229] [INFO ] [MAIN ] DNP: Generated 1807 derivative records from 33558 primary records. [2025-09-25T22:19:01.175257] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-25T22:19:01.177279] [DEBUG] [MAIN ] DNOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:01.186953] [INFO ] [MAIN ] DNOW: Generated 1807 derivative records from 43851 primary records. [2025-09-25T22:19:01.189684] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-25T22:19:01.212078] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1807 records). [2025-09-25T22:19:01.210936] [DEBUG] [LOCAL ] DNP: Derivative data saved (1807 records). [2025-09-25T22:19:01.212338] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-25T22:19:01.215116] [INFO ] [MAIN ] Derivative Progress: 493/2043 symbols completed. DNOW took 1.2s. Estimated remaining: 11m 7s. Rate: 139.3 symbols/min [2025-09-25T22:19:01.215438] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-25T22:19:01.218477] [INFO ] [MAIN ] Derivative Progress: 494/2043 symbols completed. DNP took 1.2s. Estimated remaining: 11m 6s. Rate: 139.6 symbols/min [2025-09-25T22:19:01.234628] [DEBUG] [MAIN ] DOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:01.235299] [INFO ] [MAIN ] DOC: Generated 1807 derivative records from 53927 primary records. [2025-09-25T22:19:01.235364] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-25T22:19:01.251175] [DEBUG] [LOCAL ] DOC: Derivative data saved (1807 records). [2025-09-25T22:19:01.251252] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-25T22:19:01.254398] [INFO ] [MAIN ] Derivative Progress: 495/2043 symbols completed. DOC took 1.2s. Estimated remaining: 11m 4s. Rate: 139.9 symbols/min [2025-09-25T22:19:01.255391] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:01.255499] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:01.255580] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:01.324570] [DEBUG] [LOCAL ] DOLE: Loaded 38240 existing records from primary storage. [2025-09-25T22:19:01.324801] [INFO ] [MAIN ] DOLE: Loaded 38240 primary data records. [2025-09-25T22:19:01.480527] [DEBUG] [LOCAL ] DOCS: Loaded 51598 existing records from primary storage. [2025-09-25T22:19:01.488817] [DEBUG] [LOCAL ] DOCN: Loaded 50889 existing records from primary storage. [2025-09-25T22:19:01.494156] [INFO ] [MAIN ] DOCN: Loaded 50889 primary data records. [2025-09-25T22:19:01.488968] [INFO ] [MAIN ] DOCS: Loaded 51598 primary data records. [2025-09-25T22:19:02.440751] [DEBUG] [MAIN ] DOLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:02.442342] [INFO ] [MAIN ] DOLE: Generated 1807 derivative records from 38240 primary records. [2025-09-25T22:19:02.443448] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-25T22:19:02.473226] [DEBUG] [MAIN ] DOCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:02.480683] [INFO ] [MAIN ] DOCS: Generated 1807 derivative records from 51598 primary records. [2025-09-25T22:19:02.481869] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-25T22:19:02.482414] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1807 records). [2025-09-25T22:19:02.482560] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-25T22:19:02.495064] [INFO ] [MAIN ] Derivative Progress: 496/2043 symbols completed. DOLE took 1.2s. Estimated remaining: 11m 6s. Rate: 139.4 symbols/min [2025-09-25T22:19:02.501827] [DEBUG] [MAIN ] DOCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:02.501377] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:02.510163] [INFO ] [MAIN ] DOCN: Generated 1807 derivative records from 50889 primary records. [2025-09-25T22:19:02.511810] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-25T22:19:02.537379] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1807 records). [2025-09-25T22:19:02.538169] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-25T22:19:02.540970] [INFO ] [MAIN ] Derivative Progress: 497/2043 symbols completed. DOCS took 1.3s. Estimated remaining: 11m 4s. Rate: 139.6 symbols/min [2025-09-25T22:19:02.542044] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:02.542311] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1807 records). [2025-09-25T22:19:02.542703] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-25T22:19:02.546219] [INFO ] [MAIN ] Derivative Progress: 498/2043 symbols completed. DOCN took 1.3s. Estimated remaining: 11m 3s. Rate: 139.9 symbols/min [2025-09-25T22:19:02.546767] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:02.575225] [DEBUG] [LOCAL ] DOUG: Loaded 35046 existing records from primary storage. [2025-09-25T22:19:02.575512] [INFO ] [MAIN ] DOUG: Loaded 35046 primary data records. [2025-09-25T22:19:02.855972] [DEBUG] [LOCAL ] DOV: Loaded 46044 existing records from primary storage. [2025-09-25T22:19:02.944773] [INFO ] [MAIN ] DOV: Loaded 46044 primary data records. [2025-09-25T22:19:03.008922] [DEBUG] [LOCAL ] DOW: Loaded 54123 existing records from primary storage. [2025-09-25T22:19:03.019413] [INFO ] [MAIN ] DOW: Loaded 54123 primary data records. [2025-09-25T22:19:03.731290] [DEBUG] [MAIN ] DOUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:03.733145] [INFO ] [MAIN ] DOUG: Generated 1807 derivative records from 35046 primary records. [2025-09-25T22:19:03.734039] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-25T22:19:03.756307] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1807 records). [2025-09-25T22:19:03.756720] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-25T22:19:03.759244] [INFO ] [MAIN ] Derivative Progress: 499/2043 symbols completed. DOUG took 1.3s. Estimated remaining: 11m 5s. Rate: 139.4 symbols/min [2025-09-25T22:19:03.759684] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:03.781157] [DEBUG] [MAIN ] DOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:03.782115] [INFO ] [MAIN ] DOV: Generated 1807 derivative records from 46044 primary records. [2025-09-25T22:19:03.783539] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-25T22:19:03.825221] [DEBUG] [MAIN ] DOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:03.827274] [INFO ] [MAIN ] DOW: Generated 1807 derivative records from 54123 primary records. [2025-09-25T22:19:03.827438] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-25T22:19:03.829856] [DEBUG] [LOCAL ] DOV: Derivative data saved (1807 records). [2025-09-25T22:19:03.841015] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-25T22:19:03.847048] [INFO ] [MAIN ] Derivative Progress: 500/2043 symbols completed. DOV took 1.3s. Estimated remaining: 11m 3s. Rate: 139.6 symbols/min [2025-09-25T22:19:03.848116] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:03.859936] [DEBUG] [LOCAL ] DOW: Derivative data saved (1807 records). [2025-09-25T22:19:03.861526] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-25T22:19:03.862239] [DEBUG] [LOCAL ] DQ: Loaded 43526 existing records from primary storage. [2025-09-25T22:19:03.865734] [INFO ] [MAIN ] DQ: Loaded 43526 primary data records. [2025-09-25T22:19:03.865604] [INFO ] [MAIN ] Derivative Progress: 501/2043 symbols completed. DOW took 1.3s. Estimated remaining: 11m 1s. Rate: 139.9 symbols/min [2025-09-25T22:19:03.871720] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:04.238566] [DEBUG] [LOCAL ] DRH: Loaded 50835 existing records from primary storage. [2025-09-25T22:19:04.238917] [INFO ] [MAIN ] DRH: Loaded 50835 primary data records. [2025-09-25T22:19:04.344364] [DEBUG] [LOCAL ] DRI: Loaded 48216 existing records from primary storage. [2025-09-25T22:19:04.371431] [INFO ] [MAIN ] DRI: Loaded 48216 primary data records. [2025-09-25T22:19:04.810383] [DEBUG] [MAIN ] DQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:04.930762] [INFO ] [MAIN ] DQ: Generated 1807 derivative records from 43526 primary records. [2025-09-25T22:19:04.945595] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-25T22:19:04.969507] [DEBUG] [LOCAL ] DQ: Derivative data saved (1807 records). [2025-09-25T22:19:04.969828] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-25T22:19:04.972677] [INFO ] [MAIN ] Derivative Progress: 502/2043 symbols completed. DQ took 1.2s. Estimated remaining: 11m 3s. Rate: 139.4 symbols/min [2025-09-25T22:19:04.973430] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:04.997329] [DEBUG] [MAIN ] DRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:04.998482] [INFO ] [MAIN ] DRH: Generated 1807 derivative records from 50835 primary records. [2025-09-25T22:19:04.998717] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-25T22:19:05.011976] [DEBUG] [LOCAL ] DRLL: Loaded 9694 existing records from primary storage. [2025-09-25T22:19:05.018776] [INFO ] [MAIN ] DRLL: Loaded 9694 primary data records. [2025-09-25T22:19:05.085309] [DEBUG] [MAIN ] DRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:05.116691] [INFO ] [MAIN ] DRI: Generated 1807 derivative records from 48216 primary records. [2025-09-25T22:19:05.127614] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-25T22:19:05.148387] [DEBUG] [LOCAL ] DRH: Derivative data saved (1807 records). [2025-09-25T22:19:05.156923] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-25T22:19:05.162607] [INFO ] [MAIN ] Derivative Progress: 503/2043 symbols completed. DRH took 1.3s. Estimated remaining: 11m 2s. Rate: 139.6 symbols/min [2025-09-25T22:19:05.174476] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:05.375918] [DEBUG] [LOCAL ] DRI: Derivative data saved (1807 records). [2025-09-25T22:19:05.376235] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-25T22:19:05.383279] [INFO ] [MAIN ] Derivative Progress: 504/2043 symbols completed. DRI took 1.5s. Estimated remaining: 11m 1s. Rate: 139.7 symbols/min [2025-09-25T22:19:05.383850] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:05.401719] [DEBUG] [LOCAL ] DSMC: Loaded 1956 existing records from primary storage. [2025-09-25T22:19:05.401880] [INFO ] [MAIN ] DSMC: Loaded 1956 primary data records. [2025-09-25T22:19:05.524380] [DEBUG] [LOCAL ] DSL: Loaded 28428 existing records from primary storage. [2025-09-25T22:19:05.524665] [INFO ] [MAIN ] DSL: Loaded 28428 primary data records. [2025-09-25T22:19:06.113936] [DEBUG] [MAIN ] DRLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:06.125179] [INFO ] [MAIN ] DRLL: Generated 1807 derivative records from 9694 primary records. [2025-09-25T22:19:06.125451] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-25T22:19:06.148797] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1807 records). [2025-09-25T22:19:06.149630] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-25T22:19:06.153293] [INFO ] [MAIN ] Derivative Progress: 505/2043 symbols completed. DRLL took 1.2s. Estimated remaining: 11m 2s. Rate: 139.5 symbols/min [2025-09-25T22:19:06.155105] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:06.178320] [DEBUG] [MAIN ] DSMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:06.186798] [INFO ] [MAIN ] DSMC: Generated 1807 derivative records from 1956 primary records. [2025-09-25T22:19:06.187035] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-25T22:19:06.217343] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1807 records). [2025-09-25T22:19:06.217822] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-25T22:19:06.216804] [DEBUG] [LOCAL ] DSU: Loaded 22429 existing records from primary storage. [2025-09-25T22:19:06.218171] [INFO ] [MAIN ] DSU: Loaded 22429 primary data records. [2025-09-25T22:19:06.220744] [INFO ] [MAIN ] Derivative Progress: 506/2043 symbols completed. DSMC took 0.8s. Estimated remaining: 10m 60s. Rate: 139.7 symbols/min [2025-09-25T22:19:06.259439] [DEBUG] [MAIN ] DSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:06.272184] [INFO ] [MAIN ] DSL: Generated 1807 derivative records from 28428 primary records. [2025-09-25T22:19:06.272384] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-25T22:19:06.248014] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:06.481963] [DEBUG] [LOCAL ] DSL: Derivative data saved (1807 records). [2025-09-25T22:19:06.465857] [DEBUG] [LOCAL ] DSX: Loaded 24488 existing records from primary storage. [2025-09-25T22:19:06.489559] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-25T22:19:06.603263] [INFO ] [MAIN ] Derivative Progress: 507/2043 symbols completed. DSL took 1.4s. Estimated remaining: 10m 59s. Rate: 139.8 symbols/min [2025-09-25T22:19:06.600522] [INFO ] [MAIN ] DSX: Loaded 24488 primary data records. [2025-09-25T22:19:06.618044] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:06.998437] [DEBUG] [MAIN ] DSU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:07.000406] [INFO ] [MAIN ] DSU: Generated 1807 derivative records from 22429 primary records. [2025-09-25T22:19:07.014412] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-25T22:19:07.031858] [DEBUG] [LOCAL ] DT: Loaded 53323 existing records from primary storage. [2025-09-25T22:19:07.033176] [INFO ] [MAIN ] DT: Loaded 53323 primary data records. [2025-09-25T22:19:07.058494] [DEBUG] [LOCAL ] DSU: Derivative data saved (1807 records). [2025-09-25T22:19:07.074573] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-25T22:19:07.078120] [INFO ] [MAIN ] Derivative Progress: 508/2043 symbols completed. DSU took 0.9s. Estimated remaining: 10m 59s. Rate: 139.7 symbols/min [2025-09-25T22:19:07.249009] [DEBUG] [MAIN ] DSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:07.332670] [INFO ] [MAIN ] DSX: Generated 1807 derivative records from 24488 primary records. [2025-09-25T22:19:07.386829] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-25T22:19:07.407855] [DEBUG] [LOCAL ] DSX: Derivative data saved (1807 records). [2025-09-25T22:19:07.408469] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-25T22:19:07.411457] [INFO ] [MAIN ] Derivative Progress: 509/2043 symbols completed. DSX took 1.2s. Estimated remaining: 10m 58s. Rate: 139.8 symbols/min [2025-09-25T22:19:07.432575] [DEBUG] [MAIN ] DT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:07.433252] [INFO ] [MAIN ] DT: Generated 1807 derivative records from 53323 primary records. [2025-09-25T22:19:07.433314] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-25T22:19:07.451616] [DEBUG] [LOCAL ] DT: Derivative data saved (1807 records). [2025-09-25T22:19:07.451715] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-25T22:19:07.454396] [INFO ] [MAIN ] Derivative Progress: 510/2043 symbols completed. DT took 0.8s. Estimated remaining: 10m 57s. Rate: 140.0 symbols/min [2025-09-25T22:19:07.455257] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:07.455040] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:07.455186] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:07.467758] [DEBUG] [LOCAL ] DTB: Loaded 4784 existing records from primary storage. [2025-09-25T22:19:07.468128] [INFO ] [MAIN ] DTB: Loaded 4784 primary data records. [2025-09-25T22:19:07.513984] [DEBUG] [LOCAL ] DTG: Loaded 5918 existing records from primary storage. [2025-09-25T22:19:07.527264] [INFO ] [MAIN ] DTG: Loaded 5918 primary data records. [2025-09-25T22:19:07.870675] [DEBUG] [LOCAL ] DTM: Loaded 44667 existing records from primary storage. [2025-09-25T22:19:07.895510] [INFO ] [MAIN ] DTM: Loaded 44667 primary data records. [2025-09-25T22:19:08.616207] [DEBUG] [MAIN ] DTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:08.617824] [INFO ] [MAIN ] DTG: Generated 1807 derivative records from 5918 primary records. [2025-09-25T22:19:08.619139] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-25T22:19:08.652579] [DEBUG] [MAIN ] DTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:08.654234] [INFO ] [MAIN ] DTB: Generated 1807 derivative records from 4784 primary records. [2025-09-25T22:19:08.655325] [DEBUG] [LOCAL ] DTG: Derivative data saved (1807 records). [2025-09-25T22:19:08.654417] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-25T22:19:08.663098] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-25T22:19:08.671406] [INFO ] [MAIN ] Derivative Progress: 511/2043 symbols completed. DTG took 1.2s. Estimated remaining: 10m 59s. Rate: 139.5 symbols/min [2025-09-25T22:19:08.671942] [DEBUG] [MAIN ] DTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:08.673074] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:08.674072] [INFO ] [MAIN ] DTM: Generated 1807 derivative records from 44667 primary records. [2025-09-25T22:19:08.681276] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-25T22:19:08.705076] [DEBUG] [LOCAL ] DTB: Derivative data saved (1807 records). [2025-09-25T22:19:08.705969] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-25T22:19:08.708632] [INFO ] [MAIN ] Derivative Progress: 512/2043 symbols completed. DTB took 1.3s. Estimated remaining: 10m 57s. Rate: 139.8 symbols/min [2025-09-25T22:19:08.714317] [DEBUG] [LOCAL ] DTW: Loaded 4905 existing records from primary storage. [2025-09-25T22:19:08.713829] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:08.715198] [INFO ] [MAIN ] DTW: Loaded 4905 primary data records. [2025-09-25T22:19:08.716154] [DEBUG] [LOCAL ] DTM: Derivative data saved (1807 records). [2025-09-25T22:19:08.727731] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-25T22:19:08.741947] [INFO ] [MAIN ] Derivative Progress: 513/2043 symbols completed. DTM took 1.3s. Estimated remaining: 10m 56s. Rate: 140.0 symbols/min [2025-09-25T22:19:08.768257] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:08.868593] [DEBUG] [LOCAL ] DUKB: Loaded 6389 existing records from primary storage. [2025-09-25T22:19:08.919311] [INFO ] [MAIN ] DUKB: Loaded 6389 primary data records. [2025-09-25T22:19:09.273485] [DEBUG] [LOCAL ] DUK: Loaded 53849 existing records from primary storage. [2025-09-25T22:19:09.394504] [INFO ] [MAIN ] DUK: Loaded 53849 primary data records. [2025-09-25T22:19:09.745741] [DEBUG] [MAIN ] DTW: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:19:09.747621] [INFO ] [MAIN ] DTW: Generated 1806 derivative records from 4905 primary records. [2025-09-25T22:19:09.748444] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-25T22:19:09.770838] [DEBUG] [LOCAL ] DTW: Derivative data saved (1806 records). [2025-09-25T22:19:09.780531] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-25T22:19:09.788236] [INFO ] [MAIN ] Derivative Progress: 514/2043 symbols completed. DTW took 1.1s. Estimated remaining: 10m 57s. Rate: 139.6 symbols/min [2025-09-25T22:19:09.789208] [DEBUG] [MAIN ] DUKB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:09.790509] [INFO ] [MAIN ] DUKB: Generated 1807 derivative records from 6389 primary records. [2025-09-25T22:19:09.790926] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-25T22:19:09.790785] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:09.809341] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1807 records). [2025-09-25T22:19:09.810144] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-25T22:19:09.812612] [INFO ] [MAIN ] Derivative Progress: 515/2043 symbols completed. DUKB took 1.0s. Estimated remaining: 10m 55s. Rate: 139.9 symbols/min [2025-09-25T22:19:09.813095] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:09.830941] [DEBUG] [MAIN ] DUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:09.831770] [INFO ] [MAIN ] DUK: Generated 1807 derivative records from 53849 primary records. [2025-09-25T22:19:09.831882] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-25T22:19:09.849539] [DEBUG] [LOCAL ] DUK: Derivative data saved (1807 records). [2025-09-25T22:19:09.849786] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-25T22:19:09.852512] [INFO ] [MAIN ] Derivative Progress: 516/2043 symbols completed. DUK took 1.1s. Estimated remaining: 10m 54s. Rate: 140.1 symbols/min [2025-09-25T22:19:09.852938] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:09.915612] [DEBUG] [LOCAL ] DV: Loaded 51659 existing records from primary storage. [2025-09-25T22:19:09.917344] [INFO ] [MAIN ] DV: Loaded 51659 primary data records. [2025-09-25T22:19:09.923333] [DEBUG] [LOCAL ] DVA: Loaded 41631 existing records from primary storage. [2025-09-25T22:19:09.969424] [INFO ] [MAIN ] DVA: Loaded 41631 primary data records. [2025-09-25T22:19:10.226874] [DEBUG] [LOCAL ] DXC: Loaded 50066 existing records from primary storage. [2025-09-25T22:19:10.246428] [INFO ] [MAIN ] DXC: Loaded 50066 primary data records. [2025-09-25T22:19:11.026385] [DEBUG] [MAIN ] DVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:11.040530] [INFO ] [MAIN ] DVA: Generated 1807 derivative records from 41631 primary records. [2025-09-25T22:19:11.040875] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-25T22:19:11.041157] [DEBUG] [MAIN ] DV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:11.043046] [INFO ] [MAIN ] DV: Generated 1807 derivative records from 51659 primary records. [2025-09-25T22:19:11.044010] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-25T22:19:11.072084] [DEBUG] [LOCAL ] DVA: Derivative data saved (1807 records). [2025-09-25T22:19:11.076921] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-25T22:19:11.087773] [INFO ] [MAIN ] Derivative Progress: 517/2043 symbols completed. DVA took 1.3s. Estimated remaining: 10m 56s. Rate: 139.6 symbols/min [2025-09-25T22:19:11.094051] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:11.095632] [DEBUG] [MAIN ] DXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:11.097615] [INFO ] [MAIN ] DXC: Generated 1807 derivative records from 50066 primary records. [2025-09-25T22:19:11.097891] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-25T22:19:11.115002] [DEBUG] [LOCAL ] DV: Derivative data saved (1807 records). [2025-09-25T22:19:11.115923] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-25T22:19:11.118903] [INFO ] [MAIN ] Derivative Progress: 518/2043 symbols completed. DV took 1.3s. Estimated remaining: 10m 54s. Rate: 139.9 symbols/min [2025-09-25T22:19:11.119308] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:11.123516] [DEBUG] [LOCAL ] DXC: Derivative data saved (1807 records). [2025-09-25T22:19:11.123856] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-25T22:19:11.127946] [INFO ] [MAIN ] Derivative Progress: 519/2043 symbols completed. DXC took 1.3s. Estimated remaining: 10m 52s. Rate: 140.2 symbols/min [2025-09-25T22:19:11.128322] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:11.167550] [DEBUG] [LOCAL ] DXYZ: Loaded 36924 existing records from primary storage. [2025-09-25T22:19:11.167937] [INFO ] [MAIN ] DXYZ: Loaded 36924 primary data records. [2025-09-25T22:19:11.313583] [DEBUG] [LOCAL ] DY: Loaded 29924 existing records from primary storage. [2025-09-25T22:19:11.314890] [DEBUG] [LOCAL ] E: Loaded 33635 existing records from primary storage. [2025-09-25T22:19:11.330777] [INFO ] [MAIN ] DY: Loaded 29924 primary data records. [2025-09-25T22:19:11.341162] [INFO ] [MAIN ] E: Loaded 33635 primary data records. [2025-09-25T22:19:12.321677] [DEBUG] [MAIN ] DXYZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:12.323177] [INFO ] [MAIN ] DXYZ: Generated 1807 derivative records from 36924 primary records. [2025-09-25T22:19:12.323701] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-25T22:19:12.345914] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1807 records). [2025-09-25T22:19:12.346183] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-25T22:19:12.348578] [INFO ] [MAIN ] Derivative Progress: 520/2043 symbols completed. DXYZ took 1.3s. Estimated remaining: 10m 54s. Rate: 139.7 symbols/min [2025-09-25T22:19:12.349308] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:12.367552] [DEBUG] [MAIN ] DY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:12.368775] [INFO ] [MAIN ] DY: Generated 1807 derivative records from 29924 primary records. [2025-09-25T22:19:12.369025] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-25T22:19:12.399788] [DEBUG] [MAIN ] E: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:12.401123] [DEBUG] [LOCAL ] DY: Derivative data saved (1807 records). [2025-09-25T22:19:12.402418] [INFO ] [MAIN ] E: Generated 1807 derivative records from 33635 primary records. [2025-09-25T22:19:12.405088] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-25T22:19:12.405377] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-25T22:19:12.408306] [INFO ] [MAIN ] Derivative Progress: 521/2043 symbols completed. DY took 1.3s. Estimated remaining: 10m 53s. Rate: 139.9 symbols/min [2025-09-25T22:19:12.409983] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:12.438437] [DEBUG] [LOCAL ] E: Derivative data saved (1807 records). [2025-09-25T22:19:12.438773] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-25T22:19:12.442294] [INFO ] [MAIN ] Derivative Progress: 522/2043 symbols completed. E took 1.3s. Estimated remaining: 10m 51s. Rate: 140.1 symbols/min [2025-09-25T22:19:12.442860] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:12.462067] [DEBUG] [LOCAL ] EAF: Loaded 43973 existing records from primary storage. [2025-09-25T22:19:12.463566] [INFO ] [MAIN ] EAF: Loaded 43973 primary data records. [2025-09-25T22:19:12.635610] [DEBUG] [LOCAL ] EARN: Loaded 30444 existing records from primary storage. [2025-09-25T22:19:12.658305] [INFO ] [MAIN ] EARN: Loaded 30444 primary data records. [2025-09-25T22:19:12.924367] [DEBUG] [LOCAL ] EAT: Loaded 50179 existing records from primary storage. [2025-09-25T22:19:12.947422] [INFO ] [MAIN ] EAT: Loaded 50179 primary data records. [2025-09-25T22:19:13.506981] [DEBUG] [MAIN ] EAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:13.509402] [INFO ] [MAIN ] EAF: Generated 1807 derivative records from 43973 primary records. [2025-09-25T22:19:13.510044] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-25T22:19:13.532589] [DEBUG] [LOCAL ] EAF: Derivative data saved (1807 records). [2025-09-25T22:19:13.532906] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-25T22:19:13.536331] [INFO ] [MAIN ] Derivative Progress: 523/2043 symbols completed. EAF took 1.2s. Estimated remaining: 10m 53s. Rate: 139.7 symbols/min [2025-09-25T22:19:13.560982] [DEBUG] [MAIN ] EARN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:13.562002] [INFO ] [MAIN ] EARN: Generated 1807 derivative records from 30444 primary records. [2025-09-25T22:19:13.576414] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-25T22:19:13.576890] [DEBUG] [MAIN ] EAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:13.579619] [INFO ] [MAIN ] EAT: Generated 1807 derivative records from 50179 primary records. [2025-09-25T22:19:13.588625] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-25T22:19:13.598042] [DEBUG] [LOCAL ] EARN: Derivative data saved (1807 records). [2025-09-25T22:19:13.606297] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-25T22:19:13.613388] [INFO ] [MAIN ] Derivative Progress: 524/2043 symbols completed. EARN took 1.2s. Estimated remaining: 10m 51s. Rate: 139.9 symbols/min [2025-09-25T22:19:13.619148] [DEBUG] [LOCAL ] EAT: Derivative data saved (1807 records). [2025-09-25T22:19:13.619383] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-25T22:19:13.624017] [INFO ] [MAIN ] Derivative Progress: 525/2043 symbols completed. EAT took 1.2s. Estimated remaining: 10m 50s. Rate: 140.2 symbols/min [2025-09-25T22:19:13.625215] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:13.625534] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:13.625362] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:13.653440] [DEBUG] [LOCAL ] EBF: Loaded 19533 existing records from primary storage. [2025-09-25T22:19:13.653604] [INFO ] [MAIN ] EBF: Loaded 19533 primary data records. [2025-09-25T22:19:13.835082] [DEBUG] [LOCAL ] EB: Loaded 37828 existing records from primary storage. [2025-09-25T22:19:13.840432] [INFO ] [MAIN ] EB: Loaded 37828 primary data records. [2025-09-25T22:19:13.979327] [DEBUG] [LOCAL ] EBR: Loaded 43438 existing records from primary storage. [2025-09-25T22:19:13.990122] [INFO ] [MAIN ] EBR: Loaded 43438 primary data records. [2025-09-25T22:19:14.805989] [DEBUG] [MAIN ] EBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:14.810540] [INFO ] [MAIN ] EBF: Generated 1807 derivative records from 19533 primary records. [2025-09-25T22:19:14.810707] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-25T22:19:14.835478] [DEBUG] [LOCAL ] EBF: Derivative data saved (1807 records). [2025-09-25T22:19:14.836130] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-25T22:19:14.839278] [INFO ] [MAIN ] Derivative Progress: 526/2043 symbols completed. EBF took 1.2s. Estimated remaining: 10m 51s. Rate: 139.7 symbols/min [2025-09-25T22:19:14.840462] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:14.878029] [DEBUG] [MAIN ] EB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:14.880121] [INFO ] [MAIN ] EB: Generated 1807 derivative records from 37828 primary records. [2025-09-25T22:19:14.880309] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-25T22:19:14.878452] [DEBUG] [MAIN ] EBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:14.882206] [INFO ] [MAIN ] EBR: Generated 1807 derivative records from 43438 primary records. [2025-09-25T22:19:14.882709] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-25T22:19:14.902172] [DEBUG] [LOCAL ] EB: Derivative data saved (1807 records). [2025-09-25T22:19:14.902773] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-25T22:19:14.913936] [INFO ] [MAIN ] Derivative Progress: 527/2043 symbols completed. EB took 1.3s. Estimated remaining: 10m 50s. Rate: 139.9 symbols/min [2025-09-25T22:19:14.915050] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:14.937879] [DEBUG] [LOCAL ] EBR: Derivative data saved (1807 records). [2025-09-25T22:19:14.938754] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-25T22:19:14.942306] [INFO ] [MAIN ] Derivative Progress: 528/2043 symbols completed. EBR took 1.3s. Estimated remaining: 10m 48s. Rate: 140.2 symbols/min [2025-09-25T22:19:14.942954] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:14.965416] [DEBUG] [LOCAL ] EBS: Loaded 47102 existing records from primary storage. [2025-09-25T22:19:14.965803] [INFO ] [MAIN ] EBS: Loaded 47102 primary data records. [2025-09-25T22:19:15.385850] [DEBUG] [LOCAL ] EC: Loaded 49689 existing records from primary storage. [2025-09-25T22:19:15.374396] [DEBUG] [LOCAL ] ECC: Loaded 43726 existing records from primary storage. [2025-09-25T22:19:15.387690] [INFO ] [MAIN ] ECC: Loaded 43726 primary data records. [2025-09-25T22:19:15.387361] [INFO ] [MAIN ] EC: Loaded 49689 primary data records. [2025-09-25T22:19:16.089618] [DEBUG] [MAIN ] EBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:16.091328] [INFO ] [MAIN ] EBS: Generated 1807 derivative records from 47102 primary records. [2025-09-25T22:19:16.091877] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-25T22:19:16.111794] [DEBUG] [LOCAL ] EBS: Derivative data saved (1807 records). [2025-09-25T22:19:16.112440] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-25T22:19:16.115674] [INFO ] [MAIN ] Derivative Progress: 529/2043 symbols completed. EBS took 1.3s. Estimated remaining: 10m 50s. Rate: 139.7 symbols/min [2025-09-25T22:19:16.116275] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:16.142972] [DEBUG] [MAIN ] ECC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:16.144249] [INFO ] [MAIN ] ECC: Generated 1807 derivative records from 43726 primary records. [2025-09-25T22:19:16.144463] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-25T22:19:16.171545] [DEBUG] [LOCAL ] ECC: Derivative data saved (1807 records). [2025-09-25T22:19:16.171882] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-25T22:19:16.175702] [INFO ] [MAIN ] Derivative Progress: 530/2043 symbols completed. ECC took 1.2s. Estimated remaining: 10m 49s. Rate: 139.9 symbols/min [2025-09-25T22:19:16.176682] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:16.200942] [DEBUG] [LOCAL ] ECO: Loaded 18686 existing records from primary storage. [2025-09-25T22:19:16.199799] [DEBUG] [MAIN ] EC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:16.202229] [INFO ] [MAIN ] EC: Generated 1807 derivative records from 49689 primary records. [2025-09-25T22:19:16.201268] [INFO ] [MAIN ] ECO: Loaded 18686 primary data records. [2025-09-25T22:19:16.202620] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-25T22:19:16.335758] [DEBUG] [LOCAL ] EC: Derivative data saved (1807 records). [2025-09-25T22:19:16.335994] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-25T22:19:16.344954] [INFO ] [MAIN ] Derivative Progress: 531/2043 symbols completed. EC took 1.4s. Estimated remaining: 10m 48s. Rate: 140.1 symbols/min [2025-09-25T22:19:16.381177] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:16.571965] [DEBUG] [LOCAL ] ECVT: Loaded 43297 existing records from primary storage. [2025-09-25T22:19:16.572903] [INFO ] [MAIN ] ECVT: Loaded 43297 primary data records. [2025-09-25T22:19:16.986622] [DEBUG] [LOCAL ] ED: Loaded 53169 existing records from primary storage. [2025-09-25T22:19:16.987845] [INFO ] [MAIN ] ED: Loaded 53169 primary data records. [2025-09-25T22:19:17.110718] [DEBUG] [MAIN ] ECO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:17.124153] [INFO ] [MAIN ] ECO: Generated 1807 derivative records from 18686 primary records. [2025-09-25T22:19:17.124603] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-25T22:19:17.220719] [DEBUG] [LOCAL ] ECO: Derivative data saved (1807 records). [2025-09-25T22:19:17.228559] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-25T22:19:17.359470] [INFO ] [MAIN ] Derivative Progress: 532/2043 symbols completed. ECO took 1.2s. Estimated remaining: 10m 49s. Rate: 139.7 symbols/min [2025-09-25T22:19:17.359903] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:17.383508] [DEBUG] [MAIN ] ECVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:17.384577] [INFO ] [MAIN ] ECVT: Generated 1807 derivative records from 43297 primary records. [2025-09-25T22:19:17.396411] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-25T22:19:17.425198] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1807 records). [2025-09-25T22:19:17.426261] [DEBUG] [LOCAL ] EDD: Loaded 27227 existing records from primary storage. [2025-09-25T22:19:17.427269] [INFO ] [MAIN ] EDD: Loaded 27227 primary data records. [2025-09-25T22:19:17.426943] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-25T22:19:17.436477] [INFO ] [MAIN ] Derivative Progress: 533/2043 symbols completed. ECVT took 1.3s. Estimated remaining: 10m 47s. Rate: 140.0 symbols/min [2025-09-25T22:19:17.472860] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:17.571328] [DEBUG] [MAIN ] ED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:17.572403] [INFO ] [MAIN ] ED: Generated 1807 derivative records from 53169 primary records. [2025-09-25T22:19:17.588117] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-25T22:19:17.672371] [DEBUG] [LOCAL ] EDF: Loaded 13569 existing records from primary storage. [2025-09-25T22:19:17.675432] [INFO ] [MAIN ] EDF: Loaded 13569 primary data records. [2025-09-25T22:19:17.680888] [DEBUG] [LOCAL ] ED: Derivative data saved (1807 records). [2025-09-25T22:19:17.842513] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-25T22:19:17.876775] [INFO ] [MAIN ] Derivative Progress: 534/2043 symbols completed. ED took 1.5s. Estimated remaining: 10m 47s. Rate: 140.0 symbols/min [2025-09-25T22:19:17.895332] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:18.168607] [DEBUG] [MAIN ] EDD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:18.183408] [INFO ] [MAIN ] EDD: Generated 1807 derivative records from 27227 primary records. [2025-09-25T22:19:18.183869] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-25T22:19:18.185860] [DEBUG] [LOCAL ] EDU: Loaded 45333 existing records from primary storage. [2025-09-25T22:19:18.188712] [INFO ] [MAIN ] EDU: Loaded 45333 primary data records. [2025-09-25T22:19:18.250725] [DEBUG] [LOCAL ] EDD: Derivative data saved (1807 records). [2025-09-25T22:19:18.251056] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-25T22:19:18.255731] [INFO ] [MAIN ] Derivative Progress: 535/2043 symbols completed. EDD took 0.9s. Estimated remaining: 10m 46s. Rate: 140.0 symbols/min [2025-09-25T22:19:18.251412] [DEBUG] [MAIN ] EDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:18.261561] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:18.271195] [INFO ] [MAIN ] EDF: Generated 1807 derivative records from 13569 primary records. [2025-09-25T22:19:18.301566] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-25T22:19:18.411273] [DEBUG] [LOCAL ] EDF: Derivative data saved (1807 records). [2025-09-25T22:19:18.430431] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-25T22:19:18.452023] [INFO ] [MAIN ] Derivative Progress: 536/2043 symbols completed. EDF took 1.0s. Estimated remaining: 10m 45s. Rate: 140.1 symbols/min [2025-09-25T22:19:18.452486] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:18.448515] [DEBUG] [LOCAL ] EFT: Loaded 12767 existing records from primary storage. [2025-09-25T22:19:18.460610] [INFO ] [MAIN ] EFT: Loaded 12767 primary data records. [2025-09-25T22:19:19.012027] [DEBUG] [MAIN ] EDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:19.027968] [INFO ] [MAIN ] EDU: Generated 1807 derivative records from 45333 primary records. [2025-09-25T22:19:19.028181] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-25T22:19:19.030364] [DEBUG] [LOCAL ] EFX: Loaded 45166 existing records from primary storage. [2025-09-25T22:19:19.045380] [INFO ] [MAIN ] EFX: Loaded 45166 primary data records. [2025-09-25T22:19:19.071684] [DEBUG] [LOCAL ] EDU: Derivative data saved (1807 records). [2025-09-25T22:19:19.072577] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-25T22:19:19.096195] [INFO ] [MAIN ] Derivative Progress: 537/2043 symbols completed. EDU took 1.2s. Estimated remaining: 10m 45s. Rate: 140.0 symbols/min [2025-09-25T22:19:19.096774] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:19.289940] [DEBUG] [LOCAL ] EFXT: Loaded 29578 existing records from primary storage. [2025-09-25T22:19:19.313581] [INFO ] [MAIN ] EFXT: Loaded 29578 primary data records. [2025-09-25T22:19:19.331489] [DEBUG] [MAIN ] EFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:19.473472] [INFO ] [MAIN ] EFT: Generated 1807 derivative records from 12767 primary records. [2025-09-25T22:19:19.506130] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-25T22:19:19.691084] [DEBUG] [LOCAL ] EFT: Derivative data saved (1807 records). [2025-09-25T22:19:19.811724] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-25T22:19:19.815379] [INFO ] [MAIN ] Derivative Progress: 538/2043 symbols completed. EFT took 1.6s. Estimated remaining: 10m 46s. Rate: 139.8 symbols/min [2025-09-25T22:19:19.836945] [DEBUG] [MAIN ] EFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:19.838185] [INFO ] [MAIN ] EFX: Generated 1807 derivative records from 45166 primary records. [2025-09-25T22:19:19.838271] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-25T22:19:19.856314] [DEBUG] [LOCAL ] EFX: Derivative data saved (1807 records). [2025-09-25T22:19:19.856571] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-25T22:19:19.859785] [INFO ] [MAIN ] Derivative Progress: 539/2043 symbols completed. EFX took 1.4s. Estimated remaining: 10m 44s. Rate: 140.1 symbols/min [2025-09-25T22:19:19.883356] [DEBUG] [MAIN ] EFXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:19.884447] [INFO ] [MAIN ] EFXT: Generated 1807 derivative records from 29578 primary records. [2025-09-25T22:19:19.884517] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-25T22:19:19.900769] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1807 records). [2025-09-25T22:19:19.900837] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-25T22:19:19.905100] [INFO ] [MAIN ] Derivative Progress: 540/2043 symbols completed. EFXT took 0.8s. Estimated remaining: 10m 43s. Rate: 140.3 symbols/min [2025-09-25T22:19:19.906162] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:19.906806] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:19.906366] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:19.960963] [DEBUG] [LOCAL ] EHAB: Loaded 30109 existing records from primary storage. [2025-09-25T22:19:19.961438] [INFO ] [MAIN ] EHAB: Loaded 30109 primary data records. [2025-09-25T22:19:20.067020] [DEBUG] [LOCAL ] EG: Loaded 28829 existing records from primary storage. [2025-09-25T22:19:20.116308] [DEBUG] [LOCAL ] EGO: Loaded 51905 existing records from primary storage. [2025-09-25T22:19:20.108063] [INFO ] [MAIN ] EG: Loaded 28829 primary data records. [2025-09-25T22:19:20.131480] [INFO ] [MAIN ] EGO: Loaded 51905 primary data records. [2025-09-25T22:19:21.128679] [DEBUG] [MAIN ] EHAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:21.129632] [INFO ] [MAIN ] EHAB: Generated 1807 derivative records from 30109 primary records. [2025-09-25T22:19:21.130502] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-25T22:19:21.160885] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1807 records). [2025-09-25T22:19:21.166087] [DEBUG] [MAIN ] EGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:21.165882] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-25T22:19:21.166971] [INFO ] [MAIN ] EGO: Generated 1807 derivative records from 51905 primary records. [2025-09-25T22:19:21.167253] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-25T22:19:21.170315] [INFO ] [MAIN ] Derivative Progress: 541/2043 symbols completed. EHAB took 1.3s. Estimated remaining: 10m 45s. Rate: 139.8 symbols/min [2025-09-25T22:19:21.171142] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:21.189567] [DEBUG] [LOCAL ] EGO: Derivative data saved (1807 records). [2025-09-25T22:19:21.189764] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-25T22:19:21.192993] [INFO ] [MAIN ] Derivative Progress: 542/2043 symbols completed. EGO took 1.3s. Estimated remaining: 10m 43s. Rate: 140.0 symbols/min [2025-09-25T22:19:21.193937] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:21.215708] [DEBUG] [MAIN ] EG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:21.217200] [INFO ] [MAIN ] EG: Generated 1807 derivative records from 28829 primary records. [2025-09-25T22:19:21.217365] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-25T22:19:21.236258] [DEBUG] [LOCAL ] EHI: Loaded 10411 existing records from primary storage. [2025-09-25T22:19:21.239285] [INFO ] [MAIN ] EHI: Loaded 10411 primary data records. [2025-09-25T22:19:21.406600] [DEBUG] [LOCAL ] EG: Derivative data saved (1807 records). [2025-09-25T22:19:21.439823] [DEBUG] [LOCAL ] EHC: Loaded 41649 existing records from primary storage. [2025-09-25T22:19:21.444342] [INFO ] [MAIN ] EHC: Loaded 41649 primary data records. [2025-09-25T22:19:21.450940] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-25T22:19:21.484352] [INFO ] [MAIN ] Derivative Progress: 543/2043 symbols completed. EG took 1.6s. Estimated remaining: 10m 42s. Rate: 140.1 symbols/min [2025-09-25T22:19:21.651291] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:21.951431] [DEBUG] [LOCAL ] EIC: Loaded 24164 existing records from primary storage. [2025-09-25T22:19:21.952725] [INFO ] [MAIN ] EIC: Loaded 24164 primary data records. [2025-09-25T22:19:22.109892] [DEBUG] [MAIN ] EHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:22.132069] [INFO ] [MAIN ] EHI: Generated 1807 derivative records from 10411 primary records. [2025-09-25T22:19:22.153694] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-25T22:19:22.331685] [DEBUG] [LOCAL ] EHI: Derivative data saved (1807 records). [2025-09-25T22:19:22.332369] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-25T22:19:22.335266] [INFO ] [MAIN ] Derivative Progress: 544/2043 symbols completed. EHI took 1.1s. Estimated remaining: 10m 43s. Rate: 139.9 symbols/min [2025-09-25T22:19:22.336289] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:22.350186] [DEBUG] [MAIN ] EHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:22.351282] [INFO ] [MAIN ] EHC: Generated 1807 derivative records from 41649 primary records. [2025-09-25T22:19:22.352756] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-25T22:19:22.370271] [DEBUG] [LOCAL ] EHC: Derivative data saved (1807 records). [2025-09-25T22:19:22.370749] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-25T22:19:22.373284] [INFO ] [MAIN ] Derivative Progress: 545/2043 symbols completed. EHC took 1.2s. Estimated remaining: 10m 42s. Rate: 140.1 symbols/min [2025-09-25T22:19:22.373895] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:22.392439] [DEBUG] [LOCAL ] EIG: Loaded 20438 existing records from primary storage. [2025-09-25T22:19:22.392854] [INFO ] [MAIN ] EIG: Loaded 20438 primary data records. [2025-09-25T22:19:22.452046] [DEBUG] [MAIN ] EIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:22.487235] [INFO ] [MAIN ] EIC: Generated 1807 derivative records from 24164 primary records. [2025-09-25T22:19:22.517014] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-25T22:19:22.759059] [DEBUG] [LOCAL ] EIC: Derivative data saved (1807 records). [2025-09-25T22:19:22.759363] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-25T22:19:22.761897] [INFO ] [MAIN ] Derivative Progress: 546/2043 symbols completed. EIC took 1.1s. Estimated remaining: 10m 41s. Rate: 140.1 symbols/min [2025-09-25T22:19:22.762221] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:22.787296] [DEBUG] [LOCAL ] EIX: Loaded 53725 existing records from primary storage. [2025-09-25T22:19:22.787989] [INFO ] [MAIN ] EIX: Loaded 53725 primary data records. [2025-09-25T22:19:23.175575] [DEBUG] [MAIN ] EIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:23.177868] [INFO ] [MAIN ] EIG: Generated 1807 derivative records from 20438 primary records. [2025-09-25T22:19:23.179091] [DEBUG] [LOCAL ] EL: Loaded 53791 existing records from primary storage. [2025-09-25T22:19:23.178184] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-25T22:19:23.180109] [INFO ] [MAIN ] EL: Loaded 53791 primary data records. [2025-09-25T22:19:23.291204] [DEBUG] [LOCAL ] EIG: Derivative data saved (1807 records). [2025-09-25T22:19:23.310295] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-25T22:19:23.356889] [INFO ] [MAIN ] Derivative Progress: 547/2043 symbols completed. EIG took 1.0s. Estimated remaining: 10m 41s. Rate: 140.0 symbols/min [2025-09-25T22:19:23.444537] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:23.596982] [DEBUG] [MAIN ] EIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:23.598818] [INFO ] [MAIN ] EIX: Generated 1807 derivative records from 53725 primary records. [2025-09-25T22:19:23.598945] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-25T22:19:23.620293] [DEBUG] [LOCAL ] EIX: Derivative data saved (1807 records). [2025-09-25T22:19:23.620696] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-25T22:19:23.624132] [INFO ] [MAIN ] Derivative Progress: 548/2043 symbols completed. EIX took 1.3s. Estimated remaining: 10m 40s. Rate: 140.1 symbols/min [2025-09-25T22:19:23.626341] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:23.641205] [DEBUG] [MAIN ] EL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:23.642433] [INFO ] [MAIN ] EL: Generated 1807 derivative records from 53791 primary records. [2025-09-25T22:19:23.642795] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-25T22:19:23.677380] [DEBUG] [LOCAL ] ELC: Loaded 3504 existing records from primary storage. [2025-09-25T22:19:23.677845] [INFO ] [MAIN ] ELC: Loaded 3504 primary data records. [2025-09-25T22:19:23.679165] [DEBUG] [LOCAL ] EL: Derivative data saved (1807 records). [2025-09-25T22:19:23.755871] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-25T22:19:23.821469] [INFO ] [MAIN ] Derivative Progress: 549/2043 symbols completed. EL took 1.1s. Estimated remaining: 10m 39s. Rate: 140.2 symbols/min [2025-09-25T22:19:23.822051] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:23.819053] [DEBUG] [LOCAL ] ELAN: Loaded 53595 existing records from primary storage. [2025-09-25T22:19:23.822717] [INFO ] [MAIN ] ELAN: Loaded 53595 primary data records. [2025-09-25T22:19:24.420010] [DEBUG] [LOCAL ] ELF: Loaded 52663 existing records from primary storage. [2025-09-25T22:19:24.426528] [INFO ] [MAIN ] ELF: Loaded 52663 primary data records. [2025-09-25T22:19:24.426392] [DEBUG] [MAIN ] ELC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:24.427441] [INFO ] [MAIN ] ELC: Generated 1807 derivative records from 3504 primary records. [2025-09-25T22:19:24.449362] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-25T22:19:24.556221] [DEBUG] [LOCAL ] ELC: Derivative data saved (1807 records). [2025-09-25T22:19:24.567053] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-25T22:19:24.581992] [INFO ] [MAIN ] Derivative Progress: 550/2043 symbols completed. ELC took 1.0s. Estimated remaining: 10m 40s. Rate: 140.0 symbols/min [2025-09-25T22:19:24.597561] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:24.654885] [DEBUG] [MAIN ] ELAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:24.771775] [INFO ] [MAIN ] ELAN: Generated 1807 derivative records from 53595 primary records. [2025-09-25T22:19:24.777217] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-25T22:19:24.821304] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1807 records). [2025-09-25T22:19:24.821858] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-25T22:19:24.826345] [INFO ] [MAIN ] Derivative Progress: 551/2043 symbols completed. ELAN took 1.5s. Estimated remaining: 10m 39s. Rate: 140.2 symbols/min [2025-09-25T22:19:24.827183] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:24.846229] [DEBUG] [LOCAL ] ELME: Loaded 39528 existing records from primary storage. [2025-09-25T22:19:24.846776] [INFO ] [MAIN ] ELME: Loaded 39528 primary data records. [2025-09-25T22:19:24.999689] [DEBUG] [LOCAL ] ELP: Loaded 25971 existing records from primary storage. [2025-09-25T22:19:25.035202] [DEBUG] [MAIN ] ELF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:25.034811] [INFO ] [MAIN ] ELP: Loaded 25971 primary data records. [2025-09-25T22:19:25.088087] [INFO ] [MAIN ] ELF: Generated 1807 derivative records from 52663 primary records. [2025-09-25T22:19:25.113267] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-25T22:19:25.372271] [DEBUG] [LOCAL ] ELF: Derivative data saved (1807 records). [2025-09-25T22:19:25.391416] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-25T22:19:25.405464] [INFO ] [MAIN ] Derivative Progress: 552/2043 symbols completed. ELF took 1.6s. Estimated remaining: 10m 39s. Rate: 140.1 symbols/min [2025-09-25T22:19:25.438528] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:25.677981] [DEBUG] [MAIN ] ELME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:25.679682] [INFO ] [MAIN ] ELME: Generated 1807 derivative records from 39528 primary records. [2025-09-25T22:19:25.680031] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-25T22:19:25.736605] [DEBUG] [LOCAL ] ELME: Derivative data saved (1807 records). [2025-09-25T22:19:25.737215] [DEBUG] [MAIN ] ELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:25.739466] [INFO ] [MAIN ] ELP: Generated 1807 derivative records from 25971 primary records. [2025-09-25T22:19:25.738217] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-25T22:19:25.739585] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-25T22:19:25.742229] [INFO ] [MAIN ] Derivative Progress: 553/2043 symbols completed. ELME took 1.1s. Estimated remaining: 10m 38s. Rate: 140.1 symbols/min [2025-09-25T22:19:25.760078] [DEBUG] [LOCAL ] ELS: Loaded 49758 existing records from primary storage. [2025-09-25T22:19:25.772971] [INFO ] [MAIN ] ELS: Loaded 49758 primary data records. [2025-09-25T22:19:25.887001] [DEBUG] [LOCAL ] ELP: Derivative data saved (1807 records). [2025-09-25T22:19:25.892910] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-25T22:19:25.900757] [INFO ] [MAIN ] Derivative Progress: 554/2043 symbols completed. ELP took 1.1s. Estimated remaining: 10m 37s. Rate: 140.3 symbols/min [2025-09-25T22:19:26.105574] [DEBUG] [MAIN ] ELS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:26.106347] [INFO ] [MAIN ] ELS: Generated 1807 derivative records from 49758 primary records. [2025-09-25T22:19:26.106419] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-25T22:19:26.121763] [DEBUG] [LOCAL ] ELS: Derivative data saved (1807 records). [2025-09-25T22:19:26.121829] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-25T22:19:26.124667] [INFO ] [MAIN ] Derivative Progress: 555/2043 symbols completed. ELS took 0.7s. Estimated remaining: 10m 36s. Rate: 140.4 symbols/min [2025-09-25T22:19:26.125859] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:26.125924] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:26.125693] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:26.134215] [DEBUG] [LOCAL ] EMF: Loaded 3558 existing records from primary storage. [2025-09-25T22:19:26.134473] [INFO ] [MAIN ] EMF: Loaded 3558 primary data records. [2025-09-25T22:19:26.261952] [DEBUG] [LOCAL ] EMD: Loaded 21179 existing records from primary storage. [2025-09-25T22:19:26.267832] [INFO ] [MAIN ] EMD: Loaded 21179 primary data records. [2025-09-25T22:19:26.816781] [DEBUG] [LOCAL ] ELV: Loaded 50969 existing records from primary storage. [2025-09-25T22:19:26.817465] [INFO ] [MAIN ] ELV: Loaded 50969 primary data records. [2025-09-25T22:19:27.153672] [DEBUG] [MAIN ] EMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:27.154735] [INFO ] [MAIN ] EMF: Generated 1807 derivative records from 3558 primary records. [2025-09-25T22:19:27.157612] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-25T22:19:27.188490] [DEBUG] [LOCAL ] EMF: Derivative data saved (1807 records). [2025-09-25T22:19:27.189058] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-25T22:19:27.191877] [INFO ] [MAIN ] Derivative Progress: 556/2043 symbols completed. EMF took 1.1s. Estimated remaining: 10m 37s. Rate: 140.0 symbols/min [2025-09-25T22:19:27.189395] [DEBUG] [MAIN ] EMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:27.192221] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:27.193183] [INFO ] [MAIN ] EMD: Generated 1807 derivative records from 21179 primary records. [2025-09-25T22:19:27.194076] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-25T22:19:27.211579] [DEBUG] [LOCAL ] EMD: Derivative data saved (1807 records). [2025-09-25T22:19:27.212166] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-25T22:19:27.214692] [INFO ] [MAIN ] Derivative Progress: 557/2043 symbols completed. EMD took 1.1s. Estimated remaining: 10m 36s. Rate: 140.3 symbols/min [2025-09-25T22:19:27.215245] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:27.232404] [DEBUG] [MAIN ] ELV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:27.233235] [INFO ] [MAIN ] ELV: Generated 1807 derivative records from 50969 primary records. [2025-09-25T22:19:27.233347] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-25T22:19:27.254306] [DEBUG] [LOCAL ] ELV: Derivative data saved (1807 records). [2025-09-25T22:19:27.254591] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-25T22:19:27.257263] [INFO ] [MAIN ] Derivative Progress: 558/2043 symbols completed. ELV took 1.1s. Estimated remaining: 10m 34s. Rate: 140.5 symbols/min [2025-09-25T22:19:27.258008] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:27.263746] [DEBUG] [LOCAL ] EMO: Loaded 12593 existing records from primary storage. [2025-09-25T22:19:27.263924] [INFO ] [MAIN ] EMO: Loaded 12593 primary data records. [2025-09-25T22:19:27.372003] [DEBUG] [LOCAL ] EMP: Loaded 3055 existing records from primary storage. [2025-09-25T22:19:27.395497] [INFO ] [MAIN ] EMP: Loaded 3055 primary data records. [2025-09-25T22:19:27.489475] [DEBUG] [LOCAL ] EMN: Loaded 50743 existing records from primary storage. [2025-09-25T22:19:27.494996] [INFO ] [MAIN ] EMN: Loaded 50743 primary data records. [2025-09-25T22:19:28.419697] [DEBUG] [MAIN ] EMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:28.420770] [INFO ] [MAIN ] EMO: Generated 1807 derivative records from 12593 primary records. [2025-09-25T22:19:28.421009] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-25T22:19:28.435254] [DEBUG] [MAIN ] EMP: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:19:28.443351] [INFO ] [MAIN ] EMP: Generated 1806 derivative records from 3055 primary records. [2025-09-25T22:19:28.444588] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-25T22:19:28.460274] [DEBUG] [LOCAL ] EMO: Derivative data saved (1807 records). [2025-09-25T22:19:28.461343] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-25T22:19:28.466888] [INFO ] [MAIN ] Derivative Progress: 559/2043 symbols completed. EMO took 1.3s. Estimated remaining: 10m 36s. Rate: 140.0 symbols/min [2025-09-25T22:19:28.470322] [DEBUG] [LOCAL ] EMP: Derivative data saved (1806 records). [2025-09-25T22:19:28.470808] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-25T22:19:28.474614] [INFO ] [MAIN ] Derivative Progress: 560/2043 symbols completed. EMP took 1.2s. Estimated remaining: 10m 34s. Rate: 140.3 symbols/min [2025-09-25T22:19:28.470563] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:28.475568] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:28.490706] [DEBUG] [MAIN ] EMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:28.491560] [INFO ] [MAIN ] EMN: Generated 1807 derivative records from 50743 primary records. [2025-09-25T22:19:28.491710] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-25T22:19:28.508413] [DEBUG] [LOCAL ] EMN: Derivative data saved (1807 records). [2025-09-25T22:19:28.508572] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-25T22:19:28.511193] [INFO ] [MAIN ] Derivative Progress: 561/2043 symbols completed. EMN took 1.3s. Estimated remaining: 10m 33s. Rate: 140.5 symbols/min [2025-09-25T22:19:28.511730] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:28.517344] [DEBUG] [LOCAL ] ENFY: Loaded 3060 existing records from primary storage. [2025-09-25T22:19:28.517557] [INFO ] [MAIN ] ENFY: Loaded 3060 primary data records. [2025-09-25T22:19:28.885007] [DEBUG] [LOCAL ] ENB: Loaded 53906 existing records from primary storage. [2025-09-25T22:19:28.900970] [INFO ] [MAIN ] ENB: Loaded 53906 primary data records. [2025-09-25T22:19:28.926955] [DEBUG] [LOCAL ] EMR: Loaded 53639 existing records from primary storage. [2025-09-25T22:19:28.953980] [INFO ] [MAIN ] EMR: Loaded 53639 primary data records. [2025-09-25T22:19:29.663798] [DEBUG] [MAIN ] ENFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:29.665050] [INFO ] [MAIN ] ENFY: Generated 1807 derivative records from 3060 primary records. [2025-09-25T22:19:29.666111] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-25T22:19:29.686389] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1807 records). [2025-09-25T22:19:29.686727] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-25T22:19:29.689143] [INFO ] [MAIN ] Derivative Progress: 562/2043 symbols completed. ENFY took 1.2s. Estimated remaining: 10m 34s. Rate: 140.1 symbols/min [2025-09-25T22:19:29.690856] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:29.710546] [DEBUG] [MAIN ] ENB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:29.711591] [INFO ] [MAIN ] ENB: Generated 1807 derivative records from 53906 primary records. [2025-09-25T22:19:29.712470] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-25T22:19:29.753769] [DEBUG] [LOCAL ] ENB: Derivative data saved (1807 records). [2025-09-25T22:19:29.752734] [DEBUG] [MAIN ] EMR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:19:29.754785] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-25T22:19:29.757007] [INFO ] [MAIN ] Derivative Progress: 563/2043 symbols completed. ENB took 1.3s. Estimated remaining: 10m 33s. Rate: 140.3 symbols/min [2025-09-25T22:19:29.757443] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:29.754713] [INFO ] [MAIN ] EMR: Generated 1806 derivative records from 53639 primary records. [2025-09-25T22:19:29.757906] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-25T22:19:29.787035] [DEBUG] [LOCAL ] ENO: Loaded 1948 existing records from primary storage. [2025-09-25T22:19:29.789752] [INFO ] [MAIN ] ENO: Loaded 1948 primary data records. [2025-09-25T22:19:29.789173] [DEBUG] [LOCAL ] ENIC: Loaded 36725 existing records from primary storage. [2025-09-25T22:19:29.790011] [INFO ] [MAIN ] ENIC: Loaded 36725 primary data records. [2025-09-25T22:19:29.804241] [DEBUG] [LOCAL ] EMR: Derivative data saved (1806 records). [2025-09-25T22:19:29.809486] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-25T22:19:29.824331] [INFO ] [MAIN ] Derivative Progress: 564/2043 symbols completed. EMR took 1.4s. Estimated remaining: 10m 32s. Rate: 140.5 symbols/min [2025-09-25T22:19:29.878543] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:30.494262] [DEBUG] [LOCAL ] ENOV: Loaded 45531 existing records from primary storage. [2025-09-25T22:19:30.495672] [INFO ] [MAIN ] ENOV: Loaded 45531 primary data records. [2025-09-25T22:19:30.727629] [DEBUG] [MAIN ] ENO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:30.735757] [INFO ] [MAIN ] ENO: Generated 1807 derivative records from 1948 primary records. [2025-09-25T22:19:30.735945] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-25T22:19:30.894085] [DEBUG] [MAIN ] ENIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:30.896804] [INFO ] [MAIN ] ENIC: Generated 1807 derivative records from 36725 primary records. [2025-09-25T22:19:30.897903] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-25T22:19:30.913680] [DEBUG] [LOCAL ] ENO: Derivative data saved (1807 records). [2025-09-25T22:19:30.914780] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-25T22:19:30.919185] [INFO ] [MAIN ] Derivative Progress: 565/2043 symbols completed. ENO took 1.2s. Estimated remaining: 10m 33s. Rate: 140.1 symbols/min [2025-09-25T22:19:30.922952] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1807 records). [2025-09-25T22:19:30.924054] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-25T22:19:30.926718] [INFO ] [MAIN ] Derivative Progress: 566/2043 symbols completed. ENIC took 1.2s. Estimated remaining: 10m 31s. Rate: 140.3 symbols/min [2025-09-25T22:19:30.923450] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:30.927278] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:30.948864] [DEBUG] [MAIN ] ENOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:30.949813] [INFO ] [MAIN ] ENOV: Generated 1807 derivative records from 45531 primary records. [2025-09-25T22:19:30.949892] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-25T22:19:30.974579] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1807 records). [2025-09-25T22:19:30.981579] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-25T22:19:30.985107] [INFO ] [MAIN ] Derivative Progress: 567/2043 symbols completed. ENOV took 1.1s. Estimated remaining: 10m 30s. Rate: 140.6 symbols/min [2025-09-25T22:19:30.994670] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:30.995531] [DEBUG] [LOCAL ] ENVA: Loaded 25782 existing records from primary storage. [2025-09-25T22:19:30.996262] [INFO ] [MAIN ] ENVA: Loaded 25782 primary data records. [2025-09-25T22:19:31.089960] [DEBUG] [LOCAL ] ENS: Loaded 29684 existing records from primary storage. [2025-09-25T22:19:31.100621] [INFO ] [MAIN ] ENS: Loaded 29684 primary data records. [2025-09-25T22:19:31.338396] [DEBUG] [LOCAL ] EOD: Loaded 14137 existing records from primary storage. [2025-09-25T22:19:31.458498] [INFO ] [MAIN ] EOD: Loaded 14137 primary data records. [2025-09-25T22:19:32.143532] [DEBUG] [MAIN ] ENVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:32.145699] [INFO ] [MAIN ] ENVA: Generated 1807 derivative records from 25782 primary records. [2025-09-25T22:19:32.145938] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-25T22:19:32.183369] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1807 records). [2025-09-25T22:19:32.183687] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-25T22:19:32.182869] [DEBUG] [MAIN ] ENS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:32.186160] [INFO ] [MAIN ] Derivative Progress: 568/2043 symbols completed. ENVA took 1.3s. Estimated remaining: 10m 32s. Rate: 140.1 symbols/min [2025-09-25T22:19:32.187224] [INFO ] [MAIN ] ENS: Generated 1807 derivative records from 29684 primary records. [2025-09-25T22:19:32.187617] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-25T22:19:32.205860] [DEBUG] [LOCAL ] ENS: Derivative data saved (1807 records). [2025-09-25T22:19:32.205963] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-25T22:19:32.208880] [INFO ] [MAIN ] Derivative Progress: 569/2043 symbols completed. ENS took 1.3s. Estimated remaining: 10m 30s. Rate: 140.3 symbols/min [2025-09-25T22:19:32.224666] [DEBUG] [MAIN ] EOD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:32.225454] [INFO ] [MAIN ] EOD: Generated 1807 derivative records from 14137 primary records. [2025-09-25T22:19:32.225520] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-25T22:19:32.240855] [DEBUG] [LOCAL ] EOD: Derivative data saved (1807 records). [2025-09-25T22:19:32.240939] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-25T22:19:32.244875] [INFO ] [MAIN ] Derivative Progress: 570/2043 symbols completed. EOD took 1.3s. Estimated remaining: 10m 29s. Rate: 140.6 symbols/min [2025-09-25T22:19:32.245860] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:32.246209] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:32.247409] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:32.260405] [DEBUG] [LOCAL ] EOI: Loaded 10652 existing records from primary storage. [2025-09-25T22:19:32.260602] [INFO ] [MAIN ] EOI: Loaded 10652 primary data records. [2025-09-25T22:19:32.385277] [DEBUG] [LOCAL ] EOS: Loaded 15445 existing records from primary storage. [2025-09-25T22:19:32.391477] [INFO ] [MAIN ] EOS: Loaded 15445 primary data records. [2025-09-25T22:19:32.793797] [DEBUG] [LOCAL ] EOG: Loaded 53731 existing records from primary storage. [2025-09-25T22:19:32.826996] [INFO ] [MAIN ] EOG: Loaded 53731 primary data records. [2025-09-25T22:19:33.313340] [DEBUG] [MAIN ] EOI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:33.315284] [INFO ] [MAIN ] EOI: Generated 1807 derivative records from 10652 primary records. [2025-09-25T22:19:33.315704] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-25T22:19:33.337156] [DEBUG] [LOCAL ] EOI: Derivative data saved (1807 records). [2025-09-25T22:19:33.339318] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-25T22:19:33.342869] [INFO ] [MAIN ] Derivative Progress: 571/2043 symbols completed. EOI took 1.1s. Estimated remaining: 10m 30s. Rate: 140.2 symbols/min [2025-09-25T22:19:33.344850] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:33.359255] [DEBUG] [MAIN ] EOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:33.360559] [INFO ] [MAIN ] EOS: Generated 1807 derivative records from 15445 primary records. [2025-09-25T22:19:33.360770] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-25T22:19:33.380597] [DEBUG] [LOCAL ] EOT: Loaded 6891 existing records from primary storage. [2025-09-25T22:19:33.385067] [INFO ] [MAIN ] EOT: Loaded 6891 primary data records. [2025-09-25T22:19:33.442798] [DEBUG] [LOCAL ] EOS: Derivative data saved (1807 records). [2025-09-25T22:19:33.484387] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-25T22:19:33.487777] [INFO ] [MAIN ] Derivative Progress: 572/2043 symbols completed. EOS took 1.2s. Estimated remaining: 10m 29s. Rate: 140.3 symbols/min [2025-09-25T22:19:33.488103] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:33.484865] [DEBUG] [MAIN ] EOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:33.508146] [INFO ] [MAIN ] EOG: Generated 1807 derivative records from 53731 primary records. [2025-09-25T22:19:33.517573] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-25T22:19:33.774750] [DEBUG] [LOCAL ] EOG: Derivative data saved (1807 records). [2025-09-25T22:19:33.776327] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-25T22:19:33.775970] [DEBUG] [LOCAL ] EPAC: Loaded 27252 existing records from primary storage. [2025-09-25T22:19:33.776557] [INFO ] [MAIN ] EPAC: Loaded 27252 primary data records. [2025-09-25T22:19:33.781120] [INFO ] [MAIN ] Derivative Progress: 573/2043 symbols completed. EOG took 1.5s. Estimated remaining: 10m 28s. Rate: 140.4 symbols/min [2025-09-25T22:19:33.782633] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:34.181861] [DEBUG] [MAIN ] EOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:34.194945] [INFO ] [MAIN ] EOT: Generated 1807 derivative records from 6891 primary records. [2025-09-25T22:19:34.196213] [DEBUG] [LOCAL ] EPAM: Loaded 40102 existing records from primary storage. [2025-09-25T22:19:34.195393] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-25T22:19:34.196385] [INFO ] [MAIN ] EPAM: Loaded 40102 primary data records. [2025-09-25T22:19:34.314119] [DEBUG] [LOCAL ] EOT: Derivative data saved (1807 records). [2025-09-25T22:19:34.336771] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-25T22:19:34.351269] [INFO ] [MAIN ] Derivative Progress: 574/2043 symbols completed. EOT took 1.0s. Estimated remaining: 10m 28s. Rate: 140.3 symbols/min [2025-09-25T22:19:34.362095] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:34.569352] [DEBUG] [MAIN ] EPAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:34.571759] [INFO ] [MAIN ] EPAC: Generated 1807 derivative records from 27252 primary records. [2025-09-25T22:19:34.572198] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-25T22:19:34.595127] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1807 records). [2025-09-25T22:19:34.595528] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-25T22:19:34.598347] [INFO ] [MAIN ] Derivative Progress: 575/2043 symbols completed. EPAC took 1.1s. Estimated remaining: 10m 27s. Rate: 140.4 symbols/min [2025-09-25T22:19:34.598945] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:34.631425] [DEBUG] [MAIN ] EPAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:34.632229] [INFO ] [MAIN ] EPAM: Generated 1807 derivative records from 40102 primary records. [2025-09-25T22:19:34.632332] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-25T22:19:34.650109] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1807 records). [2025-09-25T22:19:34.650250] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-25T22:19:34.653044] [INFO ] [MAIN ] Derivative Progress: 576/2043 symbols completed. EPAM took 0.9s. Estimated remaining: 10m 26s. Rate: 140.7 symbols/min [2025-09-25T22:19:34.653548] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:34.677392] [DEBUG] [LOCAL ] EPD: Loaded 54001 existing records from primary storage. [2025-09-25T22:19:34.677683] [INFO ] [MAIN ] EPD: Loaded 54001 primary data records. [2025-09-25T22:19:34.880433] [DEBUG] [LOCAL ] EPR: Loaded 44449 existing records from primary storage. [2025-09-25T22:19:34.924102] [INFO ] [MAIN ] EPR: Loaded 44449 primary data records. [2025-09-25T22:19:35.157120] [DEBUG] [LOCAL ] EPRT: Loaded 48991 existing records from primary storage. [2025-09-25T22:19:35.182110] [INFO ] [MAIN ] EPRT: Loaded 48991 primary data records. [2025-09-25T22:19:35.683562] [DEBUG] [MAIN ] EPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:35.706817] [INFO ] [MAIN ] EPD: Generated 1807 derivative records from 54001 primary records. [2025-09-25T22:19:35.709280] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-25T22:19:35.863282] [DEBUG] [LOCAL ] EPD: Derivative data saved (1807 records). [2025-09-25T22:19:35.867495] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-25T22:19:35.870774] [INFO ] [MAIN ] Derivative Progress: 577/2043 symbols completed. EPD took 1.5s. Estimated remaining: 10m 27s. Rate: 140.2 symbols/min [2025-09-25T22:19:35.871294] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:35.885591] [DEBUG] [MAIN ] EPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:35.887816] [INFO ] [MAIN ] EPR: Generated 1807 derivative records from 44449 primary records. [2025-09-25T22:19:35.888035] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-25T22:19:35.908888] [DEBUG] [LOCAL ] EPR: Derivative data saved (1807 records). [2025-09-25T22:19:35.909487] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-25T22:19:35.916426] [INFO ] [MAIN ] Derivative Progress: 578/2043 symbols completed. EPR took 1.3s. Estimated remaining: 10m 26s. Rate: 140.4 symbols/min [2025-09-25T22:19:35.913978] [DEBUG] [LOCAL ] EQBK: Loaded 10987 existing records from primary storage. [2025-09-25T22:19:35.916787] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:35.916954] [INFO ] [MAIN ] EQBK: Loaded 10987 primary data records. [2025-09-25T22:19:36.061990] [DEBUG] [MAIN ] EPRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:36.086939] [INFO ] [MAIN ] EPRT: Generated 1807 derivative records from 48991 primary records. [2025-09-25T22:19:36.124825] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-25T22:19:36.369953] [DEBUG] [LOCAL ] EQR: Loaded 51810 existing records from primary storage. [2025-09-25T22:19:36.371230] [INFO ] [MAIN ] EQR: Loaded 51810 primary data records. [2025-09-25T22:19:36.413360] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1807 records). [2025-09-25T22:19:36.426911] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-25T22:19:36.450395] [INFO ] [MAIN ] Derivative Progress: 579/2043 symbols completed. EPRT took 1.8s. Estimated remaining: 10m 26s. Rate: 140.4 symbols/min [2025-09-25T22:19:36.494363] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:36.750780] [DEBUG] [MAIN ] EQBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:36.752091] [INFO ] [MAIN ] EQBK: Generated 1807 derivative records from 10987 primary records. [2025-09-25T22:19:36.752262] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-25T22:19:36.788524] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1807 records). [2025-09-25T22:19:36.788884] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-25T22:19:36.791313] [INFO ] [MAIN ] Derivative Progress: 580/2043 symbols completed. EQBK took 0.9s. Estimated remaining: 10m 25s. Rate: 140.4 symbols/min [2025-09-25T22:19:36.791952] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:36.801003] [DEBUG] [LOCAL ] EQV: Loaded 2830 existing records from primary storage. [2025-09-25T22:19:36.826016] [INFO ] [MAIN ] EQV: Loaded 2830 primary data records. [2025-09-25T22:19:36.865139] [DEBUG] [LOCAL ] EQT: Loaded 54072 existing records from primary storage. [2025-09-25T22:19:36.900627] [INFO ] [MAIN ] EQT: Loaded 54072 primary data records. [2025-09-25T22:19:36.901028] [DEBUG] [MAIN ] EQR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:36.918018] [INFO ] [MAIN ] EQR: Generated 1807 derivative records from 51810 primary records. [2025-09-25T22:19:36.923609] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-25T22:19:37.143086] [DEBUG] [LOCAL ] EQR: Derivative data saved (1807 records). [2025-09-25T22:19:37.167895] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-25T22:19:37.181233] [INFO ] [MAIN ] Derivative Progress: 581/2043 symbols completed. EQR took 1.3s. Estimated remaining: 10m 25s. Rate: 140.4 symbols/min [2025-09-25T22:19:37.357492] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:37.546849] [DEBUG] [MAIN ] EQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:37.548018] [INFO ] [MAIN ] EQV: Generated 1807 derivative records from 2830 primary records. [2025-09-25T22:19:37.548228] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-25T22:19:37.582818] [DEBUG] [LOCAL ] EQV: Derivative data saved (1807 records). [2025-09-25T22:19:37.583270] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-25T22:19:37.585922] [INFO ] [MAIN ] Derivative Progress: 582/2043 symbols completed. EQV took 0.8s. Estimated remaining: 10m 24s. Rate: 140.4 symbols/min [2025-09-25T22:19:37.599438] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:37.600562] [DEBUG] [MAIN ] EQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:37.601528] [INFO ] [MAIN ] EQT: Generated 1807 derivative records from 54072 primary records. [2025-09-25T22:19:37.601696] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-25T22:19:37.635392] [DEBUG] [LOCAL ] EQT: Derivative data saved (1807 records). [2025-09-25T22:19:37.635547] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-25T22:19:37.638350] [INFO ] [MAIN ] Derivative Progress: 583/2043 symbols completed. EQT took 1.1s. Estimated remaining: 10m 23s. Rate: 140.7 symbols/min [2025-09-25T22:19:37.641135] [DEBUG] [LOCAL ] ERJ: Loaded 51109 existing records from primary storage. [2025-09-25T22:19:37.641392] [INFO ] [MAIN ] ERJ: Loaded 51109 primary data records. [2025-09-25T22:19:37.882474] [DEBUG] [LOCAL ] ERO: Loaded 41546 existing records from primary storage. [2025-09-25T22:19:37.887275] [INFO ] [MAIN ] ERO: Loaded 41546 primary data records. [2025-09-25T22:19:38.361017] [DEBUG] [MAIN ] ERJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:38.363068] [INFO ] [MAIN ] ERJ: Generated 1807 derivative records from 51109 primary records. [2025-09-25T22:19:38.363453] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-25T22:19:38.381437] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1807 records). [2025-09-25T22:19:38.381562] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-25T22:19:38.385132] [INFO ] [MAIN ] Derivative Progress: 584/2043 symbols completed. ERJ took 1.0s. Estimated remaining: 10m 23s. Rate: 140.5 symbols/min [2025-09-25T22:19:38.408009] [DEBUG] [MAIN ] ERO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:38.408940] [INFO ] [MAIN ] ERO: Generated 1807 derivative records from 41546 primary records. [2025-09-25T22:19:38.409010] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-25T22:19:38.428207] [DEBUG] [LOCAL ] ERO: Derivative data saved (1807 records). [2025-09-25T22:19:38.428402] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-25T22:19:38.431049] [INFO ] [MAIN ] Derivative Progress: 585/2043 symbols completed. ERO took 0.8s. Estimated remaining: 10m 22s. Rate: 140.7 symbols/min [2025-09-25T22:19:38.432048] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:38.432205] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:38.432350] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:38.463113] [DEBUG] [LOCAL ] ESE: Loaded 16748 existing records from primary storage. [2025-09-25T22:19:38.463289] [INFO ] [MAIN ] ESE: Loaded 16748 primary data records. [2025-09-25T22:19:38.595340] [DEBUG] [LOCAL ] ESAB: Loaded 26482 existing records from primary storage. [2025-09-25T22:19:38.608961] [INFO ] [MAIN ] ESAB: Loaded 26482 primary data records. [2025-09-25T22:19:38.992592] [DEBUG] [LOCAL ] ES: Loaded 52919 existing records from primary storage. [2025-09-25T22:19:39.020035] [INFO ] [MAIN ] ES: Loaded 52919 primary data records. [2025-09-25T22:19:39.581156] [DEBUG] [MAIN ] ESE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:39.582878] [INFO ] [MAIN ] ESE: Generated 1807 derivative records from 16748 primary records. [2025-09-25T22:19:39.583267] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-25T22:19:39.615479] [DEBUG] [MAIN ] ESAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:39.618948] [INFO ] [MAIN ] ESAB: Generated 1807 derivative records from 26482 primary records. [2025-09-25T22:19:39.619558] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-25T22:19:39.638338] [DEBUG] [LOCAL ] ESE: Derivative data saved (1807 records). [2025-09-25T22:19:39.638770] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-25T22:19:39.641394] [INFO ] [MAIN ] Derivative Progress: 586/2043 symbols completed. ESE took 1.2s. Estimated remaining: 10m 23s. Rate: 140.2 symbols/min [2025-09-25T22:19:39.642935] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1807 records). [2025-09-25T22:19:39.643500] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:39.643618] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-25T22:19:39.646354] [INFO ] [MAIN ] Derivative Progress: 587/2043 symbols completed. ESAB took 1.2s. Estimated remaining: 10m 22s. Rate: 140.5 symbols/min [2025-09-25T22:19:39.647637] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:39.666461] [DEBUG] [MAIN ] ES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:39.667323] [INFO ] [MAIN ] ES: Generated 1807 derivative records from 52919 primary records. [2025-09-25T22:19:39.667432] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-25T22:19:39.693444] [DEBUG] [LOCAL ] ES: Derivative data saved (1807 records). [2025-09-25T22:19:39.693878] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-25T22:19:39.698081] [INFO ] [MAIN ] Derivative Progress: 588/2043 symbols completed. ES took 1.3s. Estimated remaining: 10m 20s. Rate: 140.7 symbols/min [2025-09-25T22:19:39.698622] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:39.762822] [DEBUG] [LOCAL ] ESNT: Loaded 38813 existing records from primary storage. [2025-09-25T22:19:39.763032] [INFO ] [MAIN ] ESNT: Loaded 38813 primary data records. [2025-09-25T22:19:39.764398] [DEBUG] [LOCAL ] ESI: Loaded 51196 existing records from primary storage. [2025-09-25T22:19:39.769716] [INFO ] [MAIN ] ESI: Loaded 51196 primary data records. [2025-09-25T22:19:40.000547] [DEBUG] [LOCAL ] ESRT: Loaded 46733 existing records from primary storage. [2025-09-25T22:19:40.068827] [INFO ] [MAIN ] ESRT: Loaded 46733 primary data records. [2025-09-25T22:19:41.207038] [DEBUG] [MAIN ] ESNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:41.209021] [INFO ] [MAIN ] ESNT: Generated 1807 derivative records from 38813 primary records. [2025-09-25T22:19:41.209590] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-25T22:19:41.242491] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1807 records). [2025-09-25T22:19:41.256184] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-25T22:19:41.256617] [DEBUG] [MAIN ] ESI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:41.261151] [INFO ] [MAIN ] ESI: Generated 1807 derivative records from 51196 primary records. [2025-09-25T22:19:41.259973] [INFO ] [MAIN ] Derivative Progress: 589/2043 symbols completed. ESNT took 1.6s. Estimated remaining: 10m 23s. Rate: 140.1 symbols/min [2025-09-25T22:19:41.261602] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:41.261258] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-25T22:19:41.296034] [DEBUG] [MAIN ] ESRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:41.297469] [INFO ] [MAIN ] ESRT: Generated 1807 derivative records from 46733 primary records. [2025-09-25T22:19:41.297673] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-25T22:19:41.315331] [DEBUG] [LOCAL ] ESI: Derivative data saved (1807 records). [2025-09-25T22:19:41.316116] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-25T22:19:41.319243] [INFO ] [MAIN ] Derivative Progress: 590/2043 symbols completed. ESI took 1.7s. Estimated remaining: 10m 22s. Rate: 140.3 symbols/min [2025-09-25T22:19:41.319678] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:41.322632] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1807 records). [2025-09-25T22:19:41.322770] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-25T22:19:41.326374] [INFO ] [MAIN ] Derivative Progress: 591/2043 symbols completed. ESRT took 1.6s. Estimated remaining: 10m 20s. Rate: 140.5 symbols/min [2025-09-25T22:19:41.336065] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:41.353468] [DEBUG] [LOCAL ] ESS: Loaded 30254 existing records from primary storage. [2025-09-25T22:19:41.353736] [INFO ] [MAIN ] ESS: Loaded 30254 primary data records. [2025-09-25T22:19:41.574603] [DEBUG] [LOCAL ] ESTC: Loaded 50398 existing records from primary storage. [2025-09-25T22:19:41.608721] [INFO ] [MAIN ] ESTC: Loaded 50398 primary data records. [2025-09-25T22:19:41.894900] [DEBUG] [LOCAL ] ET: Loaded 54179 existing records from primary storage. [2025-09-25T22:19:41.895328] [INFO ] [MAIN ] ET: Loaded 54179 primary data records. [2025-09-25T22:19:42.477153] [DEBUG] [MAIN ] ESS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:42.478772] [INFO ] [MAIN ] ESS: Generated 1807 derivative records from 30254 primary records. [2025-09-25T22:19:42.479224] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-25T22:19:42.500762] [DEBUG] [LOCAL ] ESS: Derivative data saved (1807 records). [2025-09-25T22:19:42.501128] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-25T22:19:42.503797] [INFO ] [MAIN ] Derivative Progress: 592/2043 symbols completed. ESS took 1.2s. Estimated remaining: 10m 21s. Rate: 140.1 symbols/min [2025-09-25T22:19:42.505627] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:42.524156] [DEBUG] [MAIN ] ESTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:42.525095] [INFO ] [MAIN ] ESTC: Generated 1807 derivative records from 50398 primary records. [2025-09-25T22:19:42.525269] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-25T22:19:42.564928] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1807 records). [2025-09-25T22:19:42.566911] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-25T22:19:42.569728] [INFO ] [MAIN ] Derivative Progress: 593/2043 symbols completed. ESTC took 1.3s. Estimated remaining: 10m 20s. Rate: 140.3 symbols/min [2025-09-25T22:19:42.570764] [DEBUG] [LOCAL ] ETD: Loaded 27502 existing records from primary storage. [2025-09-25T22:19:42.571464] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:42.571415] [INFO ] [MAIN ] ETD: Loaded 27502 primary data records. [2025-09-25T22:19:42.621793] [DEBUG] [MAIN ] ET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:42.658361] [INFO ] [MAIN ] ET: Generated 1807 derivative records from 54179 primary records. [2025-09-25T22:19:42.682990] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-25T22:19:42.720348] [DEBUG] [LOCAL ] ETG: Loaded 16639 existing records from primary storage. [2025-09-25T22:19:42.732984] [INFO ] [MAIN ] ETG: Loaded 16639 primary data records. [2025-09-25T22:19:43.101781] [DEBUG] [LOCAL ] ET: Derivative data saved (1807 records). [2025-09-25T22:19:43.113282] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-25T22:19:43.146225] [INFO ] [MAIN ] Derivative Progress: 594/2043 symbols completed. ET took 1.8s. Estimated remaining: 10m 20s. Rate: 140.2 symbols/min [2025-09-25T22:19:43.186743] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:43.381053] [DEBUG] [LOCAL ] ETJ: Loaded 16755 existing records from primary storage. [2025-09-25T22:19:43.381993] [INFO ] [MAIN ] ETJ: Loaded 16755 primary data records. [2025-09-25T22:19:43.451480] [DEBUG] [MAIN ] ETD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:43.488098] [INFO ] [MAIN ] ETD: Generated 1807 derivative records from 27502 primary records. [2025-09-25T22:19:43.501186] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-25T22:19:43.742269] [DEBUG] [LOCAL ] ETD: Derivative data saved (1807 records). [2025-09-25T22:19:43.742715] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-25T22:19:43.757791] [INFO ] [MAIN ] Derivative Progress: 595/2043 symbols completed. ETD took 1.3s. Estimated remaining: 10m 20s. Rate: 140.1 symbols/min [2025-09-25T22:19:43.758472] [DEBUG] [MAIN ] ETG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:43.760196] [INFO ] [MAIN ] ETG: Generated 1807 derivative records from 16639 primary records. [2025-09-25T22:19:43.760305] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-25T22:19:43.759337] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:43.782218] [DEBUG] [LOCAL ] ETG: Derivative data saved (1807 records). [2025-09-25T22:19:43.782550] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-25T22:19:43.785661] [INFO ] [MAIN ] Derivative Progress: 596/2043 symbols completed. ETG took 1.2s. Estimated remaining: 10m 19s. Rate: 140.3 symbols/min [2025-09-25T22:19:43.786129] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:43.797979] [DEBUG] [LOCAL ] ETO: Loaded 6531 existing records from primary storage. [2025-09-25T22:19:43.810801] [INFO ] [MAIN ] ETO: Loaded 6531 primary data records. [2025-09-25T22:19:43.810627] [DEBUG] [MAIN ] ETJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:43.833953] [INFO ] [MAIN ] ETJ: Generated 1807 derivative records from 16755 primary records. [2025-09-25T22:19:43.850826] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-25T22:19:44.189159] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1807 records). [2025-09-25T22:19:44.190156] [DEBUG] [LOCAL ] ETN: Loaded 53221 existing records from primary storage. [2025-09-25T22:19:44.190453] [INFO ] [MAIN ] ETN: Loaded 53221 primary data records. [2025-09-25T22:19:44.190370] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-25T22:19:44.205622] [INFO ] [MAIN ] Derivative Progress: 597/2043 symbols completed. ETJ took 1.0s. Estimated remaining: 10m 18s. Rate: 140.3 symbols/min [2025-09-25T22:19:44.230576] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:44.544774] [DEBUG] [LOCAL ] ETW: Loaded 25236 existing records from primary storage. [2025-09-25T22:19:44.548686] [INFO ] [MAIN ] ETW: Loaded 25236 primary data records. [2025-09-25T22:19:44.610204] [DEBUG] [MAIN ] ETO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:44.653730] [INFO ] [MAIN ] ETO: Generated 1807 derivative records from 6531 primary records. [2025-09-25T22:19:44.664598] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-25T22:19:44.907267] [DEBUG] [LOCAL ] ETO: Derivative data saved (1807 records). [2025-09-25T22:19:44.908222] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-25T22:19:44.911150] [INFO ] [MAIN ] Derivative Progress: 598/2043 symbols completed. ETO took 1.1s. Estimated remaining: 10m 19s. Rate: 140.2 symbols/min [2025-09-25T22:19:44.930107] [DEBUG] [MAIN ] ETN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:44.931409] [INFO ] [MAIN ] ETN: Generated 1807 derivative records from 53221 primary records. [2025-09-25T22:19:44.931691] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-25T22:19:44.948842] [DEBUG] [LOCAL ] ETN: Derivative data saved (1807 records). [2025-09-25T22:19:44.948966] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-25T22:19:44.951660] [INFO ] [MAIN ] Derivative Progress: 599/2043 symbols completed. ETN took 1.2s. Estimated remaining: 10m 17s. Rate: 140.4 symbols/min [2025-09-25T22:19:44.970812] [DEBUG] [MAIN ] ETW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:44.971400] [INFO ] [MAIN ] ETW: Generated 1807 derivative records from 25236 primary records. [2025-09-25T22:19:44.971461] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-25T22:19:44.986561] [DEBUG] [LOCAL ] ETW: Derivative data saved (1807 records). [2025-09-25T22:19:44.986627] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-25T22:19:44.989446] [INFO ] [MAIN ] Derivative Progress: 600/2043 symbols completed. ETW took 0.8s. Estimated remaining: 10m 16s. Rate: 140.6 symbols/min [2025-09-25T22:19:44.990290] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:44.990182] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:44.990355] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:44.999510] [DEBUG] [LOCAL ] ETX: Loaded 5002 existing records from primary storage. [2025-09-25T22:19:44.999674] [INFO ] [MAIN ] ETX: Loaded 5002 primary data records. [2025-09-25T22:19:45.102678] [DEBUG] [LOCAL ] EVC: Loaded 19345 existing records from primary storage. [2025-09-25T22:19:45.130348] [INFO ] [MAIN ] EVC: Loaded 19345 primary data records. [2025-09-25T22:19:45.276056] [DEBUG] [LOCAL ] ETY: Loaded 22913 existing records from primary storage. [2025-09-25T22:19:45.404498] [INFO ] [MAIN ] ETY: Loaded 22913 primary data records. [2025-09-25T22:19:46.046541] [DEBUG] [MAIN ] ETX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:46.047855] [INFO ] [MAIN ] ETX: Generated 1807 derivative records from 5002 primary records. [2025-09-25T22:19:46.048091] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-25T22:19:46.081922] [DEBUG] [MAIN ] EVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:46.083907] [INFO ] [MAIN ] EVC: Generated 1807 derivative records from 19345 primary records. [2025-09-25T22:19:46.084374] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-25T22:19:46.085385] [DEBUG] [LOCAL ] ETX: Derivative data saved (1807 records). [2025-09-25T22:19:46.087145] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-25T22:19:46.089744] [INFO ] [MAIN ] Derivative Progress: 601/2043 symbols completed. ETX took 1.1s. Estimated remaining: 10m 17s. Rate: 140.2 symbols/min [2025-09-25T22:19:46.102724] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:46.120418] [DEBUG] [MAIN ] ETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:46.121827] [DEBUG] [LOCAL ] EVC: Derivative data saved (1807 records). [2025-09-25T22:19:46.122060] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-25T22:19:46.122878] [INFO ] [MAIN ] ETY: Generated 1807 derivative records from 22913 primary records. [2025-09-25T22:19:46.125660] [INFO ] [MAIN ] Derivative Progress: 602/2043 symbols completed. EVC took 1.1s. Estimated remaining: 10m 16s. Rate: 140.4 symbols/min [2025-09-25T22:19:46.126033] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:46.126182] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-25T22:19:46.154791] [DEBUG] [LOCAL ] ETY: Derivative data saved (1807 records). [2025-09-25T22:19:46.158748] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-25T22:19:46.161538] [INFO ] [MAIN ] Derivative Progress: 603/2043 symbols completed. ETY took 1.2s. Estimated remaining: 10m 14s. Rate: 140.7 symbols/min [2025-09-25T22:19:46.169624] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:46.174828] [DEBUG] [LOCAL ] EVF: Loaded 9349 existing records from primary storage. [2025-09-25T22:19:46.175041] [INFO ] [MAIN ] EVF: Loaded 9349 primary data records. [2025-09-25T22:19:46.281925] [DEBUG] [LOCAL ] EVEX: Loaded 30253 existing records from primary storage. [2025-09-25T22:19:46.293505] [DEBUG] [LOCAL ] EVG: Loaded 5833 existing records from primary storage. [2025-09-25T22:19:46.293663] [INFO ] [MAIN ] EVEX: Loaded 30253 primary data records. [2025-09-25T22:19:46.297328] [INFO ] [MAIN ] EVG: Loaded 5833 primary data records. [2025-09-25T22:19:47.208168] [DEBUG] [MAIN ] EVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:47.210039] [INFO ] [MAIN ] EVF: Generated 1807 derivative records from 9349 primary records. [2025-09-25T22:19:47.210211] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-25T22:19:47.228111] [DEBUG] [LOCAL ] EVF: Derivative data saved (1807 records). [2025-09-25T22:19:47.228574] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-25T22:19:47.235477] [INFO ] [MAIN ] Derivative Progress: 604/2043 symbols completed. EVF took 1.1s. Estimated remaining: 10m 15s. Rate: 140.3 symbols/min [2025-09-25T22:19:47.236447] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:47.265955] [DEBUG] [MAIN ] EVEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:47.265492] [DEBUG] [MAIN ] EVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:47.267831] [INFO ] [MAIN ] EVG: Generated 1807 derivative records from 5833 primary records. [2025-09-25T22:19:47.267123] [INFO ] [MAIN ] EVEX: Generated 1807 derivative records from 30253 primary records. [2025-09-25T22:19:47.268086] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-25T22:19:47.267935] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-25T22:19:47.305561] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1807 records). [2025-09-25T22:19:47.306315] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-25T22:19:47.311171] [INFO ] [MAIN ] Derivative Progress: 605/2043 symbols completed. EVEX took 1.2s. Estimated remaining: 10m 14s. Rate: 140.5 symbols/min [2025-09-25T22:19:47.312811] [DEBUG] [LOCAL ] EVG: Derivative data saved (1807 records). [2025-09-25T22:19:47.312623] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:47.313025] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-25T22:19:47.316297] [INFO ] [MAIN ] Derivative Progress: 606/2043 symbols completed. EVG took 1.1s. Estimated remaining: 10m 13s. Rate: 140.7 symbols/min [2025-09-25T22:19:47.317015] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:47.352378] [DEBUG] [LOCAL ] EVH: Loaded 49734 existing records from primary storage. [2025-09-25T22:19:47.361056] [INFO ] [MAIN ] EVH: Loaded 49734 primary data records. [2025-09-25T22:19:47.510417] [DEBUG] [LOCAL ] EVTC: Loaded 26605 existing records from primary storage. [2025-09-25T22:19:47.510283] [DEBUG] [LOCAL ] EVR: Loaded 35727 existing records from primary storage. [2025-09-25T22:19:47.516389] [INFO ] [MAIN ] EVTC: Loaded 26605 primary data records. [2025-09-25T22:19:47.521739] [INFO ] [MAIN ] EVR: Loaded 35727 primary data records. [2025-09-25T22:19:48.469505] [DEBUG] [MAIN ] EVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:48.470728] [INFO ] [MAIN ] EVH: Generated 1807 derivative records from 49734 primary records. [2025-09-25T22:19:48.470924] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-25T22:19:48.490036] [DEBUG] [LOCAL ] EVH: Derivative data saved (1807 records). [2025-09-25T22:19:48.494739] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-25T22:19:48.498353] [INFO ] [MAIN ] Derivative Progress: 607/2043 symbols completed. EVH took 1.3s. Estimated remaining: 10m 14s. Rate: 140.3 symbols/min [2025-09-25T22:19:48.498808] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:48.525743] [DEBUG] [MAIN ] EVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:19:48.526019] [DEBUG] [MAIN ] EVTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:48.527855] [INFO ] [MAIN ] EVR: Generated 1806 derivative records from 35727 primary records. [2025-09-25T22:19:48.529167] [INFO ] [MAIN ] EVTC: Generated 1807 derivative records from 26605 primary records. [2025-09-25T22:19:48.529788] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-25T22:19:48.529675] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-25T22:19:48.563520] [DEBUG] [LOCAL ] EVR: Derivative data saved (1806 records). [2025-09-25T22:19:48.563944] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-25T22:19:48.566876] [INFO ] [MAIN ] Derivative Progress: 608/2043 symbols completed. EVR took 1.3s. Estimated remaining: 10m 13s. Rate: 140.5 symbols/min [2025-09-25T22:19:48.568530] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:48.568818] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1807 records). [2025-09-25T22:19:48.569459] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-25T22:19:48.572583] [INFO ] [MAIN ] Derivative Progress: 609/2043 symbols completed. EVTC took 1.3s. Estimated remaining: 10m 11s. Rate: 140.7 symbols/min [2025-09-25T22:19:48.582777] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:48.600112] [DEBUG] [LOCAL ] EVTL: Loaded 37759 existing records from primary storage. [2025-09-25T22:19:48.600507] [INFO ] [MAIN ] EVTL: Loaded 37759 primary data records. [2025-09-25T22:19:48.710761] [DEBUG] [LOCAL ] EVTR: Loaded 23468 existing records from primary storage. [2025-09-25T22:19:48.746095] [INFO ] [MAIN ] EVTR: Loaded 23468 primary data records. [2025-09-25T22:19:48.773057] [DEBUG] [LOCAL ] EXG: Loaded 34473 existing records from primary storage. [2025-09-25T22:19:49.027401] [INFO ] [MAIN ] EXG: Loaded 34473 primary data records. [2025-09-25T22:19:49.712782] [DEBUG] [MAIN ] EVTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:49.714241] [INFO ] [MAIN ] EVTL: Generated 1807 derivative records from 37759 primary records. [2025-09-25T22:19:49.714905] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-25T22:19:49.736155] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1807 records). [2025-09-25T22:19:49.738583] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-25T22:19:49.742156] [INFO ] [MAIN ] Derivative Progress: 610/2043 symbols completed. EVTL took 1.2s. Estimated remaining: 10m 13s. Rate: 140.3 symbols/min [2025-09-25T22:19:49.742953] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:49.756989] [DEBUG] [MAIN ] EVTR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:19:49.758029] [INFO ] [MAIN ] EVTR: Generated 1806 derivative records from 23468 primary records. [2025-09-25T22:19:49.758366] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-25T22:19:49.779997] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1806 records). [2025-09-25T22:19:49.780201] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-25T22:19:49.783224] [INFO ] [MAIN ] Derivative Progress: 611/2043 symbols completed. EVTR took 1.2s. Estimated remaining: 10m 11s. Rate: 140.5 symbols/min [2025-09-25T22:19:49.797257] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:49.798261] [DEBUG] [MAIN ] EXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:49.799337] [INFO ] [MAIN ] EXG: Generated 1807 derivative records from 34473 primary records. [2025-09-25T22:19:49.799439] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-25T22:19:49.820087] [DEBUG] [LOCAL ] EXG: Derivative data saved (1807 records). [2025-09-25T22:19:49.820342] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-25T22:19:49.823839] [INFO ] [MAIN ] Derivative Progress: 612/2043 symbols completed. EXG took 1.2s. Estimated remaining: 10m 10s. Rate: 140.8 symbols/min [2025-09-25T22:19:49.824326] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:49.877700] [DEBUG] [LOCAL ] EXK: Loaded 53514 existing records from primary storage. [2025-09-25T22:19:49.877986] [INFO ] [MAIN ] EXK: Loaded 53514 primary data records. [2025-09-25T22:19:50.021954] [DEBUG] [LOCAL ] EXR: Loaded 45800 existing records from primary storage. [2025-09-25T22:19:50.033182] [INFO ] [MAIN ] EXR: Loaded 45800 primary data records. [2025-09-25T22:19:50.314756] [DEBUG] [LOCAL ] F: Loaded 54210 existing records from primary storage. [2025-09-25T22:19:50.337625] [INFO ] [MAIN ] F: Loaded 54210 primary data records. [2025-09-25T22:19:50.923097] [DEBUG] [MAIN ] EXK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:50.924447] [INFO ] [MAIN ] EXK: Generated 1807 derivative records from 53514 primary records. [2025-09-25T22:19:50.924672] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-25T22:19:50.947279] [DEBUG] [LOCAL ] EXK: Derivative data saved (1807 records). [2025-09-25T22:19:50.947812] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-25T22:19:50.950494] [INFO ] [MAIN ] Derivative Progress: 613/2043 symbols completed. EXK took 1.2s. Estimated remaining: 10m 11s. Rate: 140.4 symbols/min [2025-09-25T22:19:50.964554] [DEBUG] [MAIN ] EXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:50.965545] [INFO ] [MAIN ] EXR: Generated 1807 derivative records from 45800 primary records. [2025-09-25T22:19:50.965729] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-25T22:19:50.984929] [DEBUG] [LOCAL ] EXR: Derivative data saved (1807 records). [2025-09-25T22:19:50.985164] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-25T22:19:50.987869] [INFO ] [MAIN ] Derivative Progress: 614/2043 symbols completed. EXR took 1.2s. Estimated remaining: 10m 10s. Rate: 140.6 symbols/min [2025-09-25T22:19:51.000904] [DEBUG] [MAIN ] F: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:51.001503] [INFO ] [MAIN ] F: Generated 1807 derivative records from 54210 primary records. [2025-09-25T22:19:51.001565] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-25T22:19:51.017369] [DEBUG] [LOCAL ] F: Derivative data saved (1807 records). [2025-09-25T22:19:51.017432] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-25T22:19:51.020023] [INFO ] [MAIN ] Derivative Progress: 615/2043 symbols completed. F took 1.2s. Estimated remaining: 10m 9s. Rate: 140.8 symbols/min [2025-09-25T22:19:51.020739] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:51.020820] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:51.020917] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:51.051370] [DEBUG] [LOCAL ] FBK: Loaded 25859 existing records from primary storage. [2025-09-25T22:19:51.051550] [INFO ] [MAIN ] FBK: Loaded 25859 primary data records. [2025-09-25T22:19:51.240960] [DEBUG] [LOCAL ] FAF: Loaded 42198 existing records from primary storage. [2025-09-25T22:19:51.251492] [INFO ] [MAIN ] FAF: Loaded 42198 primary data records. [2025-09-25T22:19:51.280913] [DEBUG] [LOCAL ] FBIN: Loaded 50757 existing records from primary storage. [2025-09-25T22:19:51.313519] [INFO ] [MAIN ] FBIN: Loaded 50757 primary data records. [2025-09-25T22:19:52.229700] [DEBUG] [MAIN ] FBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:52.230982] [INFO ] [MAIN ] FBK: Generated 1807 derivative records from 25859 primary records. [2025-09-25T22:19:52.231985] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-25T22:19:52.252462] [DEBUG] [LOCAL ] FBK: Derivative data saved (1807 records). [2025-09-25T22:19:52.252869] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-25T22:19:52.255101] [INFO ] [MAIN ] Derivative Progress: 616/2043 symbols completed. FBK took 1.2s. Estimated remaining: 10m 10s. Rate: 140.4 symbols/min [2025-09-25T22:19:52.255531] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:52.275835] [DEBUG] [MAIN ] FBIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:52.277163] [INFO ] [MAIN ] FBIN: Generated 1807 derivative records from 50757 primary records. [2025-09-25T22:19:52.285048] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-25T22:19:52.291527] [DEBUG] [MAIN ] FAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:52.300782] [INFO ] [MAIN ] FAF: Generated 1807 derivative records from 42198 primary records. [2025-09-25T22:19:52.303592] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-25T22:19:52.326361] [DEBUG] [LOCAL ] FAF: Derivative data saved (1807 records). [2025-09-25T22:19:52.327155] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-25T22:19:52.330525] [INFO ] [MAIN ] Derivative Progress: 617/2043 symbols completed. FAF took 1.3s. Estimated remaining: 10m 9s. Rate: 140.6 symbols/min [2025-09-25T22:19:52.327786] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1807 records). [2025-09-25T22:19:52.331077] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:52.330735] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-25T22:19:52.334395] [INFO ] [MAIN ] Derivative Progress: 618/2043 symbols completed. FBIN took 1.3s. Estimated remaining: 10m 7s. Rate: 140.8 symbols/min [2025-09-25T22:19:52.334718] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:52.365778] [DEBUG] [LOCAL ] FC: Loaded 15445 existing records from primary storage. [2025-09-25T22:19:52.366074] [INFO ] [MAIN ] FC: Loaded 15445 primary data records. [2025-09-25T22:19:52.425738] [DEBUG] [LOCAL ] FBP: Loaded 46592 existing records from primary storage. [2025-09-25T22:19:52.455701] [INFO ] [MAIN ] FBP: Loaded 46592 primary data records. [2025-09-25T22:19:52.704493] [DEBUG] [LOCAL ] FBRT: Loaded 34745 existing records from primary storage. [2025-09-25T22:19:52.715238] [INFO ] [MAIN ] FBRT: Loaded 34745 primary data records. [2025-09-25T22:19:53.422282] [DEBUG] [MAIN ] FC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:53.423302] [INFO ] [MAIN ] FC: Generated 1807 derivative records from 15445 primary records. [2025-09-25T22:19:53.423514] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-25T22:19:53.445883] [DEBUG] [LOCAL ] FC: Derivative data saved (1807 records). [2025-09-25T22:19:53.453898] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-25T22:19:53.462430] [DEBUG] [MAIN ] FBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:53.461885] [INFO ] [MAIN ] Derivative Progress: 619/2043 symbols completed. FC took 1.1s. Estimated remaining: 10m 9s. Rate: 140.4 symbols/min [2025-09-25T22:19:53.463927] [INFO ] [MAIN ] FBP: Generated 1807 derivative records from 46592 primary records. [2025-09-25T22:19:53.464311] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:53.464528] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-25T22:19:53.483844] [DEBUG] [LOCAL ] FBP: Derivative data saved (1807 records). [2025-09-25T22:19:53.484297] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-25T22:19:53.490416] [INFO ] [MAIN ] Derivative Progress: 620/2043 symbols completed. FBP took 1.2s. Estimated remaining: 10m 7s. Rate: 140.6 symbols/min [2025-09-25T22:19:53.492483] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:53.511228] [DEBUG] [MAIN ] FBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:53.512437] [INFO ] [MAIN ] FBRT: Generated 1807 derivative records from 34745 primary records. [2025-09-25T22:19:53.512636] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-25T22:19:53.545968] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1807 records). [2025-09-25T22:19:53.546321] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-25T22:19:53.550185] [INFO ] [MAIN ] Derivative Progress: 621/2043 symbols completed. FBRT took 1.2s. Estimated remaining: 10m 6s. Rate: 140.8 symbols/min [2025-09-25T22:19:53.550542] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:53.584720] [DEBUG] [LOCAL ] FCF: Loaded 39973 existing records from primary storage. [2025-09-25T22:19:53.585037] [INFO ] [MAIN ] FCF: Loaded 39973 primary data records. [2025-09-25T22:19:53.585689] [DEBUG] [LOCAL ] FCN: Loaded 26414 existing records from primary storage. [2025-09-25T22:19:53.625242] [INFO ] [MAIN ] FCN: Loaded 26414 primary data records. [2025-09-25T22:19:53.906715] [DEBUG] [LOCAL ] FCPT: Loaded 37647 existing records from primary storage. [2025-09-25T22:19:53.956263] [INFO ] [MAIN ] FCPT: Loaded 37647 primary data records. [2025-09-25T22:19:54.651271] [DEBUG] [MAIN ] FCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:54.652527] [INFO ] [MAIN ] FCF: Generated 1807 derivative records from 39973 primary records. [2025-09-25T22:19:54.652807] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-25T22:19:54.667075] [DEBUG] [MAIN ] FCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:54.668197] [INFO ] [MAIN ] FCN: Generated 1807 derivative records from 26414 primary records. [2025-09-25T22:19:54.676578] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-25T22:19:54.700838] [DEBUG] [LOCAL ] FCN: Derivative data saved (1807 records). [2025-09-25T22:19:54.702204] [DEBUG] [LOCAL ] FCF: Derivative data saved (1807 records). [2025-09-25T22:19:54.702310] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-25T22:19:54.704606] [INFO ] [MAIN ] Derivative Progress: 622/2043 symbols completed. FCF took 1.2s. Estimated remaining: 10m 7s. Rate: 140.4 symbols/min [2025-09-25T22:19:54.704675] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-25T22:19:54.708057] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:54.708376] [INFO ] [MAIN ] Derivative Progress: 623/2043 symbols completed. FCN took 1.2s. Estimated remaining: 10m 6s. Rate: 140.7 symbols/min [2025-09-25T22:19:54.709331] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:54.731096] [DEBUG] [MAIN ] FCPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:54.732070] [INFO ] [MAIN ] FCPT: Generated 1807 derivative records from 37647 primary records. [2025-09-25T22:19:54.732201] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-25T22:19:54.753910] [DEBUG] [LOCAL ] FCT: Loaded 14502 existing records from primary storage. [2025-09-25T22:19:54.755980] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1807 records). [2025-09-25T22:19:54.756092] [INFO ] [MAIN ] FCT: Loaded 14502 primary data records. [2025-09-25T22:19:54.756277] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-25T22:19:54.764790] [INFO ] [MAIN ] Derivative Progress: 624/2043 symbols completed. FCPT took 1.2s. Estimated remaining: 10m 4s. Rate: 140.8 symbols/min [2025-09-25T22:19:54.781862] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:55.133681] [DEBUG] [LOCAL ] FCX: Loaded 54090 existing records from primary storage. [2025-09-25T22:19:55.134684] [INFO ] [MAIN ] FCX: Loaded 54090 primary data records. [2025-09-25T22:19:55.236746] [DEBUG] [LOCAL ] FDP: Loaded 30588 existing records from primary storage. [2025-09-25T22:19:55.260583] [INFO ] [MAIN ] FDP: Loaded 30588 primary data records. [2025-09-25T22:19:55.821169] [DEBUG] [MAIN ] FCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:55.822335] [INFO ] [MAIN ] FCT: Generated 1807 derivative records from 14502 primary records. [2025-09-25T22:19:55.823202] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-25T22:19:55.842402] [DEBUG] [LOCAL ] FCT: Derivative data saved (1807 records). [2025-09-25T22:19:55.842843] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-25T22:19:55.845934] [INFO ] [MAIN ] Derivative Progress: 625/2043 symbols completed. FCT took 1.1s. Estimated remaining: 10m 6s. Rate: 140.5 symbols/min [2025-09-25T22:19:55.846998] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:55.866287] [DEBUG] [MAIN ] FCX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:55.867424] [INFO ] [MAIN ] FCX: Generated 1807 derivative records from 54090 primary records. [2025-09-25T22:19:55.867619] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-25T22:19:55.893048] [DEBUG] [LOCAL ] FCX: Derivative data saved (1807 records). [2025-09-25T22:19:55.893526] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-25T22:19:55.896408] [INFO ] [MAIN ] Derivative Progress: 626/2043 symbols completed. FCX took 1.2s. Estimated remaining: 10m 4s. Rate: 140.7 symbols/min [2025-09-25T22:19:55.897069] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:55.924186] [DEBUG] [MAIN ] FDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:55.925131] [INFO ] [MAIN ] FDP: Generated 1807 derivative records from 30588 primary records. [2025-09-25T22:19:55.925361] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-25T22:19:55.925863] [DEBUG] [LOCAL ] FDS: Loaded 26520 existing records from primary storage. [2025-09-25T22:19:55.926889] [INFO ] [MAIN ] FDS: Loaded 26520 primary data records. [2025-09-25T22:19:56.042518] [DEBUG] [LOCAL ] FDP: Derivative data saved (1807 records). [2025-09-25T22:19:56.059792] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-25T22:19:56.067338] [INFO ] [MAIN ] Derivative Progress: 627/2043 symbols completed. FDP took 1.3s. Estimated remaining: 10m 3s. Rate: 140.8 symbols/min [2025-09-25T22:19:56.083917] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:56.351788] [DEBUG] [LOCAL ] FDX: Loaded 51985 existing records from primary storage. [2025-09-25T22:19:56.352169] [INFO ] [MAIN ] FDX: Loaded 51985 primary data records. [2025-09-25T22:19:56.719124] [DEBUG] [LOCAL ] FE: Loaded 53818 existing records from primary storage. [2025-09-25T22:19:56.719718] [INFO ] [MAIN ] FE: Loaded 53818 primary data records. [2025-09-25T22:19:56.812230] [DEBUG] [MAIN ] FDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:56.837366] [INFO ] [MAIN ] FDS: Generated 1807 derivative records from 26520 primary records. [2025-09-25T22:19:56.850497] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-25T22:19:56.931531] [DEBUG] [LOCAL ] FDS: Derivative data saved (1807 records). [2025-09-25T22:19:56.955991] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-25T22:19:57.072940] [INFO ] [MAIN ] Derivative Progress: 628/2043 symbols completed. FDS took 1.2s. Estimated remaining: 10m 4s. Rate: 140.5 symbols/min [2025-09-25T22:19:57.101291] [DEBUG] [MAIN ] FDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:57.102625] [INFO ] [MAIN ] FDX: Generated 1807 derivative records from 51985 primary records. [2025-09-25T22:19:57.102736] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-25T22:19:57.120920] [DEBUG] [LOCAL ] FDX: Derivative data saved (1807 records). [2025-09-25T22:19:57.121017] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-25T22:19:57.124739] [INFO ] [MAIN ] Derivative Progress: 629/2043 symbols completed. FDX took 1.2s. Estimated remaining: 10m 3s. Rate: 140.7 symbols/min [2025-09-25T22:19:57.144816] [DEBUG] [MAIN ] FE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:57.145661] [INFO ] [MAIN ] FE: Generated 1807 derivative records from 53818 primary records. [2025-09-25T22:19:57.145749] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-25T22:19:57.165219] [DEBUG] [LOCAL ] FE: Derivative data saved (1807 records). [2025-09-25T22:19:57.165329] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-25T22:19:57.168724] [INFO ] [MAIN ] Derivative Progress: 630/2043 symbols completed. FE took 1.1s. Estimated remaining: 10m 2s. Rate: 140.9 symbols/min [2025-09-25T22:19:57.169689] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:57.169849] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:57.170026] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:57.190157] [DEBUG] [LOCAL ] FET: Loaded 12838 existing records from primary storage. [2025-09-25T22:19:57.190376] [INFO ] [MAIN ] FET: Loaded 12838 primary data records. [2025-09-25T22:19:57.331564] [DEBUG] [LOCAL ] FF: Loaded 25640 existing records from primary storage. [2025-09-25T22:19:57.337622] [INFO ] [MAIN ] FF: Loaded 25640 primary data records. [2025-09-25T22:19:57.528441] [DEBUG] [LOCAL ] FERG: Loaded 49361 existing records from primary storage. [2025-09-25T22:19:57.663728] [INFO ] [MAIN ] FERG: Loaded 49361 primary data records. [2025-09-25T22:19:58.298442] [DEBUG] [MAIN ] FET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:58.299960] [INFO ] [MAIN ] FET: Generated 1807 derivative records from 12838 primary records. [2025-09-25T22:19:58.300061] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-25T22:19:58.321670] [DEBUG] [LOCAL ] FET: Derivative data saved (1807 records). [2025-09-25T22:19:58.330183] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-25T22:19:58.338472] [INFO ] [MAIN ] Derivative Progress: 631/2043 symbols completed. FET took 1.2s. Estimated remaining: 10m 3s. Rate: 140.5 symbols/min [2025-09-25T22:19:58.339081] [DEBUG] [MAIN ] FF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:58.339322] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:58.340901] [INFO ] [MAIN ] FF: Generated 1807 derivative records from 25640 primary records. [2025-09-25T22:19:58.341073] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-25T22:19:58.358081] [DEBUG] [LOCAL ] FF: Derivative data saved (1807 records). [2025-09-25T22:19:58.359358] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-25T22:19:58.362207] [INFO ] [MAIN ] Derivative Progress: 632/2043 symbols completed. FF took 1.2s. Estimated remaining: 10m 2s. Rate: 140.7 symbols/min [2025-09-25T22:19:58.362952] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:58.369568] [DEBUG] [LOCAL ] FFA: Loaded 5730 existing records from primary storage. [2025-09-25T22:19:58.369739] [INFO ] [MAIN ] FFA: Loaded 5730 primary data records. [2025-09-25T22:19:58.435752] [DEBUG] [MAIN ] FERG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:58.471704] [INFO ] [MAIN ] FERG: Generated 1807 derivative records from 49361 primary records. [2025-09-25T22:19:58.514566] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-25T22:19:58.526338] [DEBUG] [LOCAL ] FFC: Loaded 16760 existing records from primary storage. [2025-09-25T22:19:58.531734] [INFO ] [MAIN ] FFC: Loaded 16760 primary data records. [2025-09-25T22:19:58.859196] [DEBUG] [LOCAL ] FERG: Derivative data saved (1807 records). [2025-09-25T22:19:58.871852] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-25T22:19:58.881005] [INFO ] [MAIN ] Derivative Progress: 633/2043 symbols completed. FERG took 1.7s. Estimated remaining: 10m 1s. Rate: 140.7 symbols/min [2025-09-25T22:19:58.892396] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:59.133508] [DEBUG] [MAIN ] FFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:59.137506] [INFO ] [MAIN ] FFA: Generated 1807 derivative records from 5730 primary records. [2025-09-25T22:19:59.138215] [DEBUG] [LOCAL ] FFWM: Loaded 36348 existing records from primary storage. [2025-09-25T22:19:59.138349] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-25T22:19:59.139740] [INFO ] [MAIN ] FFWM: Loaded 36348 primary data records. [2025-09-25T22:19:59.282223] [DEBUG] [LOCAL ] FFA: Derivative data saved (1807 records). [2025-09-25T22:19:59.292997] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-25T22:19:59.301149] [INFO ] [MAIN ] Derivative Progress: 634/2043 symbols completed. FFA took 1.0s. Estimated remaining: 10m 1s. Rate: 140.7 symbols/min [2025-09-25T22:19:59.315004] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:59.385023] [DEBUG] [MAIN ] FFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:19:59.500423] [INFO ] [MAIN ] FFC: Generated 1807 derivative records from 16760 primary records. [2025-09-25T22:19:59.516905] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-25T22:19:59.537409] [DEBUG] [LOCAL ] FFC: Derivative data saved (1807 records). [2025-09-25T22:19:59.537751] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-25T22:19:59.540687] [INFO ] [MAIN ] Derivative Progress: 635/2043 symbols completed. FFC took 1.2s. Estimated remaining: 10m 0s. Rate: 140.8 symbols/min [2025-09-25T22:19:59.548321] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:19:59.559127] [DEBUG] [LOCAL ] FGN: Loaded 3905 existing records from primary storage. [2025-09-25T22:19:59.560077] [INFO ] [MAIN ] FGN: Loaded 3905 primary data records. [2025-09-25T22:19:59.609598] [DEBUG] [LOCAL ] FG: Loaded 22680 existing records from primary storage. [2025-09-25T22:19:59.623729] [INFO ] [MAIN ] FG: Loaded 22680 primary data records. [2025-09-25T22:20:00.077904] [DEBUG] [MAIN ] FFWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:00.113504] [INFO ] [MAIN ] FFWM: Generated 1807 derivative records from 36348 primary records. [2025-09-25T22:20:00.213856] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-25T22:20:00.285046] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1807 records). [2025-09-25T22:20:00.285451] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-25T22:20:00.289211] [INFO ] [MAIN ] Derivative Progress: 636/2043 symbols completed. FFWM took 1.4s. Estimated remaining: 10m 0s. Rate: 140.6 symbols/min [2025-09-25T22:20:00.291142] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:00.328427] [DEBUG] [MAIN ] FGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:00.354552] [INFO ] [MAIN ] FGN: Generated 1807 derivative records from 3905 primary records. [2025-09-25T22:20:00.355338] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-25T22:20:00.355702] [DEBUG] [MAIN ] FG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:00.358075] [INFO ] [MAIN ] FG: Generated 1807 derivative records from 22680 primary records. [2025-09-25T22:20:00.365831] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-25T22:20:00.387260] [DEBUG] [LOCAL ] FGN: Derivative data saved (1807 records). [2025-09-25T22:20:00.387808] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-25T22:20:00.398288] [INFO ] [MAIN ] Derivative Progress: 637/2043 symbols completed. FGN took 0.9s. Estimated remaining: 9m 59s. Rate: 140.8 symbols/min [2025-09-25T22:20:00.400042] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:00.401488] [DEBUG] [LOCAL ] FHI: Loaded 40977 existing records from primary storage. [2025-09-25T22:20:00.409677] [DEBUG] [LOCAL ] FG: Derivative data saved (1807 records). [2025-09-25T22:20:00.410372] [INFO ] [MAIN ] FHI: Loaded 40977 primary data records. [2025-09-25T22:20:00.410496] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-25T22:20:00.413676] [INFO ] [MAIN ] Derivative Progress: 638/2043 symbols completed. FG took 1.1s. Estimated remaining: 9m 58s. Rate: 141.0 symbols/min [2025-09-25T22:20:00.425945] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:00.838189] [DEBUG] [LOCAL ] FHN: Loaded 53759 existing records from primary storage. [2025-09-25T22:20:00.838825] [INFO ] [MAIN ] FHN: Loaded 53759 primary data records. [2025-09-25T22:20:00.839942] [DEBUG] [LOCAL ] FI: Loaded 53894 existing records from primary storage. [2025-09-25T22:20:00.853518] [INFO ] [MAIN ] FI: Loaded 53894 primary data records. [2025-09-25T22:20:01.124533] [DEBUG] [MAIN ] FHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:01.163687] [INFO ] [MAIN ] FHI: Generated 1807 derivative records from 40977 primary records. [2025-09-25T22:20:01.178173] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-25T22:20:01.429725] [DEBUG] [LOCAL ] FHI: Derivative data saved (1807 records). [2025-09-25T22:20:01.561707] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-25T22:20:01.565166] [INFO ] [MAIN ] Derivative Progress: 639/2043 symbols completed. FHI took 1.3s. Estimated remaining: 9m 59s. Rate: 140.6 symbols/min [2025-09-25T22:20:01.566758] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:01.635584] [DEBUG] [MAIN ] FHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:01.637626] [DEBUG] [MAIN ] FI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:01.638847] [INFO ] [MAIN ] FI: Generated 1807 derivative records from 53894 primary records. [2025-09-25T22:20:01.639614] [INFO ] [MAIN ] FHN: Generated 1807 derivative records from 53759 primary records. [2025-09-25T22:20:01.640631] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-25T22:20:01.640768] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-25T22:20:01.640556] [DEBUG] [LOCAL ] FICO: Loaded 20525 existing records from primary storage. [2025-09-25T22:20:01.641993] [INFO ] [MAIN ] FICO: Loaded 20525 primary data records. [2025-09-25T22:20:01.804733] [DEBUG] [LOCAL ] FHN: Derivative data saved (1807 records). [2025-09-25T22:20:01.806361] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-25T22:20:01.819981] [INFO ] [MAIN ] Derivative Progress: 640/2043 symbols completed. FHN took 1.4s. Estimated remaining: 9m 58s. Rate: 140.7 symbols/min [2025-09-25T22:20:01.831486] [DEBUG] [LOCAL ] FI: Derivative data saved (1807 records). [2025-09-25T22:20:01.831594] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-25T22:20:01.840393] [INFO ] [MAIN ] Derivative Progress: 641/2043 symbols completed. FI took 1.4s. Estimated remaining: 9m 57s. Rate: 140.9 symbols/min [2025-09-25T22:20:01.840564] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:01.875298] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:02.052190] [DEBUG] [MAIN ] FICO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:02.053390] [INFO ] [MAIN ] FICO: Generated 1807 derivative records from 20525 primary records. [2025-09-25T22:20:02.053487] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-25T22:20:02.080408] [DEBUG] [LOCAL ] FICO: Derivative data saved (1807 records). [2025-09-25T22:20:02.090582] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-25T22:20:02.093339] [INFO ] [MAIN ] Derivative Progress: 642/2043 symbols completed. FICO took 0.5s. Estimated remaining: 9m 56s. Rate: 141.0 symbols/min [2025-09-25T22:20:02.093920] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:02.110086] [DEBUG] [LOCAL ] FIHL: Loaded 40582 existing records from primary storage. [2025-09-25T22:20:02.125031] [INFO ] [MAIN ] FIHL: Loaded 40582 primary data records. [2025-09-25T22:20:02.132587] [DEBUG] [LOCAL ] FIGS: Loaded 49285 existing records from primary storage. [2025-09-25T22:20:02.178992] [INFO ] [MAIN ] FIGS: Loaded 49285 primary data records. [2025-09-25T22:20:02.207447] [DEBUG] [LOCAL ] FINS: Loaded 8280 existing records from primary storage. [2025-09-25T22:20:02.234621] [INFO ] [MAIN ] FINS: Loaded 8280 primary data records. [2025-09-25T22:20:03.222835] [DEBUG] [MAIN ] FIHL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:03.224329] [INFO ] [MAIN ] FIHL: Generated 1807 derivative records from 40582 primary records. [2025-09-25T22:20:03.224599] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-25T22:20:03.262485] [DEBUG] [MAIN ] FIGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:03.272519] [INFO ] [MAIN ] FIGS: Generated 1807 derivative records from 49285 primary records. [2025-09-25T22:20:03.276992] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-25T22:20:03.279628] [DEBUG] [MAIN ] FINS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:03.279804] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1807 records). [2025-09-25T22:20:03.280590] [INFO ] [MAIN ] FINS: Generated 1806 derivative records from 8280 primary records. [2025-09-25T22:20:03.280983] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-25T22:20:03.288490] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-25T22:20:03.292536] [INFO ] [MAIN ] Derivative Progress: 643/2043 symbols completed. FIHL took 1.4s. Estimated remaining: 9m 57s. Rate: 140.6 symbols/min [2025-09-25T22:20:03.314683] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1807 records). [2025-09-25T22:20:03.315261] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-25T22:20:03.318253] [INFO ] [MAIN ] Derivative Progress: 644/2043 symbols completed. FIGS took 1.5s. Estimated remaining: 9m 56s. Rate: 140.8 symbols/min [2025-09-25T22:20:03.319245] [DEBUG] [LOCAL ] FINS: Derivative data saved (1806 records). [2025-09-25T22:20:03.319561] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-25T22:20:03.322403] [INFO ] [MAIN ] Derivative Progress: 645/2043 symbols completed. FINS took 1.2s. Estimated remaining: 9m 55s. Rate: 141.0 symbols/min [2025-09-25T22:20:03.323271] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:03.323425] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:03.323058] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:03.375946] [DEBUG] [LOCAL ] FIX: Loaded 30594 existing records from primary storage. [2025-09-25T22:20:03.376229] [INFO ] [MAIN ] FIX: Loaded 30594 primary data records. [2025-09-25T22:20:03.518789] [DEBUG] [LOCAL ] FINV: Loaded 45475 existing records from primary storage. [2025-09-25T22:20:03.535194] [INFO ] [MAIN ] FINV: Loaded 45475 primary data records. [2025-09-25T22:20:03.568066] [DEBUG] [LOCAL ] FIS: Loaded 53754 existing records from primary storage. [2025-09-25T22:20:03.664225] [INFO ] [MAIN ] FIS: Loaded 53754 primary data records. [2025-09-25T22:20:04.443058] [DEBUG] [MAIN ] FIX: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:04.444217] [INFO ] [MAIN ] FIX: Generated 1806 derivative records from 30594 primary records. [2025-09-25T22:20:04.445403] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-25T22:20:04.476665] [DEBUG] [LOCAL ] FIX: Derivative data saved (1806 records). [2025-09-25T22:20:04.482103] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-25T22:20:04.484547] [INFO ] [MAIN ] Derivative Progress: 646/2043 symbols completed. FIX took 1.2s. Estimated remaining: 9m 56s. Rate: 140.7 symbols/min [2025-09-25T22:20:04.485496] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:04.485274] [DEBUG] [MAIN ] FINV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:04.489864] [INFO ] [MAIN ] FINV: Generated 1807 derivative records from 45475 primary records. [2025-09-25T22:20:04.490881] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-25T22:20:04.527353] [DEBUG] [LOCAL ] FINV: Derivative data saved (1807 records). [2025-09-25T22:20:04.527902] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-25T22:20:04.530622] [INFO ] [MAIN ] Derivative Progress: 647/2043 symbols completed. FINV took 1.2s. Estimated remaining: 9m 55s. Rate: 140.9 symbols/min [2025-09-25T22:20:04.520196] [DEBUG] [MAIN ] FIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:04.534985] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:04.536206] [INFO ] [MAIN ] FIS: Generated 1807 derivative records from 53754 primary records. [2025-09-25T22:20:04.535376] [DEBUG] [LOCAL ] FLC: Loaded 5533 existing records from primary storage. [2025-09-25T22:20:04.536376] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-25T22:20:04.536833] [INFO ] [MAIN ] FLC: Loaded 5533 primary data records. [2025-09-25T22:20:04.638589] [DEBUG] [LOCAL ] FIS: Derivative data saved (1807 records). [2025-09-25T22:20:04.650130] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-25T22:20:04.682312] [INFO ] [MAIN ] Derivative Progress: 648/2043 symbols completed. FIS took 1.4s. Estimated remaining: 9m 54s. Rate: 141.0 symbols/min [2025-09-25T22:20:04.688156] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:04.973842] [DEBUG] [LOCAL ] FLG: Loaded 53717 existing records from primary storage. [2025-09-25T22:20:04.974788] [INFO ] [MAIN ] FLG: Loaded 53717 primary data records. [2025-09-25T22:20:05.143246] [DEBUG] [LOCAL ] FLNG: Loaded 34205 existing records from primary storage. [2025-09-25T22:20:05.143856] [INFO ] [MAIN ] FLNG: Loaded 34205 primary data records. [2025-09-25T22:20:05.701421] [DEBUG] [MAIN ] FLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:05.702429] [INFO ] [MAIN ] FLC: Generated 1807 derivative records from 5533 primary records. [2025-09-25T22:20:05.703091] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-25T22:20:05.726479] [DEBUG] [LOCAL ] FLC: Derivative data saved (1807 records). [2025-09-25T22:20:05.727022] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-25T22:20:05.729356] [INFO ] [MAIN ] Derivative Progress: 649/2043 symbols completed. FLC took 1.2s. Estimated remaining: 9m 55s. Rate: 140.7 symbols/min [2025-09-25T22:20:05.730267] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:05.752619] [DEBUG] [MAIN ] FLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:05.753730] [INFO ] [MAIN ] FLG: Generated 1807 derivative records from 53717 primary records. [2025-09-25T22:20:05.754044] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-25T22:20:05.788044] [DEBUG] [LOCAL ] FLG: Derivative data saved (1807 records). [2025-09-25T22:20:05.788436] [DEBUG] [MAIN ] FLNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:05.788682] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-25T22:20:05.790831] [INFO ] [MAIN ] Derivative Progress: 650/2043 symbols completed. FLG took 1.3s. Estimated remaining: 9m 53s. Rate: 140.9 symbols/min [2025-09-25T22:20:05.792170] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:05.791703] [INFO ] [MAIN ] FLNG: Generated 1807 derivative records from 34205 primary records. [2025-09-25T22:20:05.792277] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-25T22:20:05.810629] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1807 records). [2025-09-25T22:20:05.810940] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-25T22:20:05.814061] [INFO ] [MAIN ] Derivative Progress: 651/2043 symbols completed. FLNG took 1.1s. Estimated remaining: 9m 52s. Rate: 141.1 symbols/min [2025-09-25T22:20:05.828040] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:05.853576] [DEBUG] [LOCAL ] FLO: Loaded 52270 existing records from primary storage. [2025-09-25T22:20:05.853878] [INFO ] [MAIN ] FLO: Loaded 52270 primary data records. [2025-09-25T22:20:06.021061] [DEBUG] [LOCAL ] FLR: Loaded 53507 existing records from primary storage. [2025-09-25T22:20:06.051887] [INFO ] [MAIN ] FLR: Loaded 53507 primary data records. [2025-09-25T22:20:06.322105] [DEBUG] [LOCAL ] FLS: Loaded 50555 existing records from primary storage. [2025-09-25T22:20:06.353019] [INFO ] [MAIN ] FLS: Loaded 50555 primary data records. [2025-09-25T22:20:07.019910] [DEBUG] [MAIN ] FLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:07.022910] [INFO ] [MAIN ] FLO: Generated 1807 derivative records from 52270 primary records. [2025-09-25T22:20:07.023133] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-25T22:20:07.056317] [DEBUG] [MAIN ] FLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:07.057796] [INFO ] [MAIN ] FLR: Generated 1807 derivative records from 53507 primary records. [2025-09-25T22:20:07.058634] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-25T22:20:07.075554] [DEBUG] [LOCAL ] FLO: Derivative data saved (1807 records). [2025-09-25T22:20:07.078956] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-25T22:20:07.079496] [DEBUG] [LOCAL ] FLR: Derivative data saved (1807 records). [2025-09-25T22:20:07.084340] [INFO ] [MAIN ] Derivative Progress: 652/2043 symbols completed. FLO took 1.4s. Estimated remaining: 9m 53s. Rate: 140.6 symbols/min [2025-09-25T22:20:07.084979] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-25T22:20:07.087223] [INFO ] [MAIN ] Derivative Progress: 653/2043 symbols completed. FLR took 1.3s. Estimated remaining: 9m 52s. Rate: 140.9 symbols/min [2025-09-25T22:20:07.084893] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:07.095753] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:07.101764] [DEBUG] [MAIN ] FLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:07.102911] [INFO ] [MAIN ] FLS: Generated 1807 derivative records from 50555 primary records. [2025-09-25T22:20:07.103165] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-25T22:20:07.120606] [DEBUG] [LOCAL ] FLS: Derivative data saved (1807 records). [2025-09-25T22:20:07.120856] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-25T22:20:07.125531] [INFO ] [MAIN ] Derivative Progress: 654/2043 symbols completed. FLS took 1.3s. Estimated remaining: 9m 51s. Rate: 141.1 symbols/min [2025-09-25T22:20:07.126004] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:07.143403] [DEBUG] [LOCAL ] FLXR: Loaded 20150 existing records from primary storage. [2025-09-25T22:20:07.143557] [INFO ] [MAIN ] FLXR: Loaded 20150 primary data records. [2025-09-25T22:20:07.371816] [DEBUG] [LOCAL ] FLUT: Loaded 51237 existing records from primary storage. [2025-09-25T22:20:07.372150] [INFO ] [MAIN ] FLUT: Loaded 51237 primary data records. [2025-09-25T22:20:07.706066] [DEBUG] [LOCAL ] FMC: Loaded 52176 existing records from primary storage. [2025-09-25T22:20:07.712827] [INFO ] [MAIN ] FMC: Loaded 52176 primary data records. [2025-09-25T22:20:08.233018] [DEBUG] [MAIN ] FLXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:08.236117] [INFO ] [MAIN ] FLXR: Generated 1807 derivative records from 20150 primary records. [2025-09-25T22:20:08.236759] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-25T22:20:08.256106] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1807 records). [2025-09-25T22:20:08.256372] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-25T22:20:08.259829] [INFO ] [MAIN ] Derivative Progress: 655/2043 symbols completed. FLXR took 1.2s. Estimated remaining: 9m 52s. Rate: 140.7 symbols/min [2025-09-25T22:20:08.260162] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:08.282441] [DEBUG] [MAIN ] FLUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:08.283856] [INFO ] [MAIN ] FLUT: Generated 1807 derivative records from 51237 primary records. [2025-09-25T22:20:08.284174] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-25T22:20:08.288940] [DEBUG] [LOCAL ] FMN: Loaded 6073 existing records from primary storage. [2025-09-25T22:20:08.289416] [INFO ] [MAIN ] FMN: Loaded 6073 primary data records. [2025-09-25T22:20:08.478257] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1807 records). [2025-09-25T22:20:08.484890] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-25T22:20:08.484741] [DEBUG] [MAIN ] FMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:08.514066] [INFO ] [MAIN ] Derivative Progress: 656/2043 symbols completed. FLUT took 1.4s. Estimated remaining: 9m 51s. Rate: 140.8 symbols/min [2025-09-25T22:20:08.521226] [INFO ] [MAIN ] FMC: Generated 1807 derivative records from 52176 primary records. [2025-09-25T22:20:08.521736] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-25T22:20:08.521601] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:08.668077] [DEBUG] [LOCAL ] FMC: Derivative data saved (1807 records). [2025-09-25T22:20:08.669294] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-25T22:20:08.672565] [INFO ] [MAIN ] Derivative Progress: 657/2043 symbols completed. FMC took 1.5s. Estimated remaining: 9m 50s. Rate: 140.9 symbols/min [2025-09-25T22:20:08.673304] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:08.710913] [DEBUG] [LOCAL ] FMS: Loaded 30619 existing records from primary storage. [2025-09-25T22:20:08.711405] [INFO ] [MAIN ] FMS: Loaded 30619 primary data records. [2025-09-25T22:20:08.746592] [DEBUG] [MAIN ] FMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:08.782947] [INFO ] [MAIN ] FMN: Generated 1807 derivative records from 6073 primary records. [2025-09-25T22:20:08.817083] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-25T22:20:08.936351] [DEBUG] [LOCAL ] FMX: Loaded 41039 existing records from primary storage. [2025-09-25T22:20:08.964102] [INFO ] [MAIN ] FMX: Loaded 41039 primary data records. [2025-09-25T22:20:09.146332] [DEBUG] [LOCAL ] FMN: Derivative data saved (1807 records). [2025-09-25T22:20:09.164882] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-25T22:20:09.173358] [INFO ] [MAIN ] Derivative Progress: 658/2043 symbols completed. FMN took 0.9s. Estimated remaining: 9m 50s. Rate: 140.9 symbols/min [2025-09-25T22:20:09.496441] [DEBUG] [MAIN ] FMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:09.498023] [INFO ] [MAIN ] FMS: Generated 1807 derivative records from 30619 primary records. [2025-09-25T22:20:09.498601] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-25T22:20:09.518807] [DEBUG] [LOCAL ] FMS: Derivative data saved (1807 records). [2025-09-25T22:20:09.519226] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-25T22:20:09.521486] [INFO ] [MAIN ] Derivative Progress: 659/2043 symbols completed. FMS took 1.0s. Estimated remaining: 9m 49s. Rate: 140.9 symbols/min [2025-09-25T22:20:09.538515] [DEBUG] [MAIN ] FMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:09.539334] [INFO ] [MAIN ] FMX: Generated 1807 derivative records from 41039 primary records. [2025-09-25T22:20:09.539400] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-25T22:20:09.555480] [DEBUG] [LOCAL ] FMX: Derivative data saved (1807 records). [2025-09-25T22:20:09.555559] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-25T22:20:09.558627] [INFO ] [MAIN ] Derivative Progress: 660/2043 symbols completed. FMX took 0.9s. Estimated remaining: 9m 48s. Rate: 141.1 symbols/min [2025-09-25T22:20:09.560133] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:09.560003] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:09.560391] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:09.565525] [DEBUG] [LOCAL ] FMY: Loaded 1394 existing records from primary storage. [2025-09-25T22:20:09.565904] [INFO ] [MAIN ] FMY: Loaded 1394 primary data records. [2025-09-25T22:20:09.925211] [DEBUG] [LOCAL ] FN: Loaded 39626 existing records from primary storage. [2025-09-25T22:20:09.926541] [INFO ] [MAIN ] FN: Loaded 39626 primary data records. [2025-09-25T22:20:10.036017] [DEBUG] [LOCAL ] FND: Loaded 52511 existing records from primary storage. [2025-09-25T22:20:10.058405] [INFO ] [MAIN ] FND: Loaded 52511 primary data records. [2025-09-25T22:20:10.524489] [DEBUG] [MAIN ] FMY: Filtered 6966 bins outside market hours, 7770 incomplete bins [2025-09-25T22:20:10.658197] [INFO ] [MAIN ] FMY: Generated 1796 derivative records from 1394 primary records. [2025-09-25T22:20:10.659475] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-25T22:20:10.680013] [DEBUG] [LOCAL ] FMY: Derivative data saved (1796 records). [2025-09-25T22:20:10.681350] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-25T22:20:10.684774] [INFO ] [MAIN ] Derivative Progress: 661/2043 symbols completed. FMY took 1.1s. Estimated remaining: 9m 49s. Rate: 140.8 symbols/min [2025-09-25T22:20:10.686364] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:10.717906] [DEBUG] [MAIN ] FN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:10.719411] [INFO ] [MAIN ] FN: Generated 1807 derivative records from 39626 primary records. [2025-09-25T22:20:10.719837] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-25T22:20:10.747305] [DEBUG] [LOCAL ] FN: Derivative data saved (1807 records). [2025-09-25T22:20:10.755996] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-25T22:20:10.764344] [DEBUG] [MAIN ] FND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:10.763841] [INFO ] [MAIN ] Derivative Progress: 662/2043 symbols completed. FN took 1.2s. Estimated remaining: 9m 48s. Rate: 140.9 symbols/min [2025-09-25T22:20:10.765403] [INFO ] [MAIN ] FND: Generated 1807 derivative records from 52511 primary records. [2025-09-25T22:20:10.765560] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-25T22:20:10.766399] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:10.796177] [DEBUG] [LOCAL ] FND: Derivative data saved (1807 records). [2025-09-25T22:20:10.796473] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-25T22:20:10.800490] [INFO ] [MAIN ] Derivative Progress: 663/2043 symbols completed. FND took 1.2s. Estimated remaining: 9m 47s. Rate: 141.1 symbols/min [2025-09-25T22:20:10.801301] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:10.821561] [DEBUG] [LOCAL ] FNF: Loaded 49513 existing records from primary storage. [2025-09-25T22:20:10.821874] [INFO ] [MAIN ] FNF: Loaded 49513 primary data records. [2025-09-25T22:20:10.951205] [DEBUG] [LOCAL ] FOA: Loaded 13368 existing records from primary storage. [2025-09-25T22:20:10.955488] [INFO ] [MAIN ] FOA: Loaded 13368 primary data records. [2025-09-25T22:20:11.187988] [DEBUG] [LOCAL ] FNV: Loaded 46719 existing records from primary storage. [2025-09-25T22:20:11.332245] [INFO ] [MAIN ] FNV: Loaded 46719 primary data records. [2025-09-25T22:20:11.985466] [DEBUG] [MAIN ] FNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:11.987270] [INFO ] [MAIN ] FNF: Generated 1807 derivative records from 49513 primary records. [2025-09-25T22:20:11.987542] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-25T22:20:12.009673] [DEBUG] [LOCAL ] FNF: Derivative data saved (1807 records). [2025-09-25T22:20:12.012710] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-25T22:20:12.016117] [INFO ] [MAIN ] Derivative Progress: 664/2043 symbols completed. FNF took 1.3s. Estimated remaining: 9m 48s. Rate: 140.7 symbols/min [2025-09-25T22:20:12.024846] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:12.031869] [DEBUG] [MAIN ] FOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:12.033257] [INFO ] [MAIN ] FOA: Generated 1807 derivative records from 13368 primary records. [2025-09-25T22:20:12.033574] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-25T22:20:12.077239] [DEBUG] [LOCAL ] FOF: Loaded 8438 existing records from primary storage. [2025-09-25T22:20:12.078903] [INFO ] [MAIN ] FOF: Loaded 8438 primary data records. [2025-09-25T22:20:12.103240] [DEBUG] [MAIN ] FNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:12.131824] [INFO ] [MAIN ] FNV: Generated 1807 derivative records from 46719 primary records. [2025-09-25T22:20:12.138005] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-25T22:20:12.138598] [DEBUG] [LOCAL ] FOA: Derivative data saved (1807 records). [2025-09-25T22:20:12.148271] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-25T22:20:12.175945] [INFO ] [MAIN ] Derivative Progress: 665/2043 symbols completed. FOA took 1.4s. Estimated remaining: 9m 47s. Rate: 140.9 symbols/min [2025-09-25T22:20:12.181886] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:12.226855] [DEBUG] [LOCAL ] FNV: Derivative data saved (1807 records). [2025-09-25T22:20:12.227521] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-25T22:20:12.251803] [INFO ] [MAIN ] Derivative Progress: 666/2043 symbols completed. FNV took 1.5s. Estimated remaining: 9m 46s. Rate: 141.0 symbols/min [2025-09-25T22:20:12.252192] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:12.453904] [DEBUG] [LOCAL ] FOR: Loaded 20256 existing records from primary storage. [2025-09-25T22:20:12.455403] [INFO ] [MAIN ] FOR: Loaded 20256 primary data records. [2025-09-25T22:20:12.826230] [DEBUG] [LOCAL ] FOUR: Loaded 49917 existing records from primary storage. [2025-09-25T22:20:12.826980] [INFO ] [MAIN ] FOUR: Loaded 49917 primary data records. [2025-09-25T22:20:13.012238] [DEBUG] [MAIN ] FOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:13.072532] [INFO ] [MAIN ] FOF: Generated 1807 derivative records from 8438 primary records. [2025-09-25T22:20:13.072954] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-25T22:20:13.222433] [DEBUG] [LOCAL ] FOF: Derivative data saved (1807 records). [2025-09-25T22:20:13.223413] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-25T22:20:13.227309] [INFO ] [MAIN ] Derivative Progress: 667/2043 symbols completed. FOF took 1.2s. Estimated remaining: 9m 46s. Rate: 140.8 symbols/min [2025-09-25T22:20:13.228343] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:13.257899] [DEBUG] [MAIN ] FOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:13.259586] [INFO ] [MAIN ] FOR: Generated 1807 derivative records from 20256 primary records. [2025-09-25T22:20:13.259853] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-25T22:20:13.283433] [DEBUG] [LOCAL ] FPF: Loaded 17789 existing records from primary storage. [2025-09-25T22:20:13.284750] [INFO ] [MAIN ] FPF: Loaded 17789 primary data records. [2025-09-25T22:20:13.391291] [DEBUG] [MAIN ] FOUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:13.398232] [INFO ] [MAIN ] FOUR: Generated 1807 derivative records from 49917 primary records. [2025-09-25T22:20:13.412101] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-25T22:20:13.412750] [DEBUG] [LOCAL ] FOR: Derivative data saved (1807 records). [2025-09-25T22:20:13.425782] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-25T22:20:13.445243] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1807 records). [2025-09-25T22:20:13.446115] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-25T22:20:13.436785] [INFO ] [MAIN ] Derivative Progress: 668/2043 symbols completed. FOR took 1.3s. Estimated remaining: 9m 46s. Rate: 140.9 symbols/min [2025-09-25T22:20:13.467326] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:13.472814] [INFO ] [MAIN ] Derivative Progress: 669/2043 symbols completed. FOUR took 1.2s. Estimated remaining: 9m 44s. Rate: 141.1 symbols/min [2025-09-25T22:20:13.484514] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:13.778693] [DEBUG] [LOCAL ] FPH: Loaded 19773 existing records from primary storage. [2025-09-25T22:20:13.779008] [INFO ] [MAIN ] FPH: Loaded 19773 primary data records. [2025-09-25T22:20:13.857754] [DEBUG] [LOCAL ] FPI: Loaded 31331 existing records from primary storage. [2025-09-25T22:20:13.886166] [INFO ] [MAIN ] FPI: Loaded 31331 primary data records. [2025-09-25T22:20:14.510573] [DEBUG] [MAIN ] FPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:14.512164] [INFO ] [MAIN ] FPF: Generated 1807 derivative records from 17789 primary records. [2025-09-25T22:20:14.514278] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-25T22:20:14.539930] [DEBUG] [LOCAL ] FPF: Derivative data saved (1807 records). [2025-09-25T22:20:14.541447] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-25T22:20:14.545305] [INFO ] [MAIN ] Derivative Progress: 670/2043 symbols completed. FPF took 1.3s. Estimated remaining: 9m 45s. Rate: 140.8 symbols/min [2025-09-25T22:20:14.545761] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:14.575333] [DEBUG] [MAIN ] FPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:14.577012] [INFO ] [MAIN ] FPH: Generated 1807 derivative records from 19773 primary records. [2025-09-25T22:20:14.577209] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-25T22:20:14.592521] [DEBUG] [MAIN ] FPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:14.610046] [INFO ] [MAIN ] FPI: Generated 1807 derivative records from 31331 primary records. [2025-09-25T22:20:14.610467] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-25T22:20:14.610270] [DEBUG] [LOCAL ] FPH: Derivative data saved (1807 records). [2025-09-25T22:20:14.611594] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-25T22:20:14.622365] [INFO ] [MAIN ] Derivative Progress: 671/2043 symbols completed. FPH took 1.2s. Estimated remaining: 9m 44s. Rate: 140.9 symbols/min [2025-09-25T22:20:14.628583] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:14.644590] [DEBUG] [LOCAL ] FPI: Derivative data saved (1807 records). [2025-09-25T22:20:14.644894] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-25T22:20:14.647901] [INFO ] [MAIN ] Derivative Progress: 672/2043 symbols completed. FPI took 1.2s. Estimated remaining: 9m 43s. Rate: 141.1 symbols/min [2025-09-25T22:20:14.648617] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:14.677196] [DEBUG] [LOCAL ] FR: Loaded 46867 existing records from primary storage. [2025-09-25T22:20:14.677595] [INFO ] [MAIN ] FR: Loaded 46867 primary data records. [2025-09-25T22:20:14.773013] [DEBUG] [LOCAL ] FRGE: Loaded 18502 existing records from primary storage. [2025-09-25T22:20:14.765715] [DEBUG] [LOCAL ] FRA: Loaded 14610 existing records from primary storage. [2025-09-25T22:20:14.778581] [INFO ] [MAIN ] FRGE: Loaded 18502 primary data records. [2025-09-25T22:20:14.791690] [INFO ] [MAIN ] FRA: Loaded 14610 primary data records. [2025-09-25T22:20:15.753183] [DEBUG] [MAIN ] FR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:15.754619] [INFO ] [MAIN ] FR: Generated 1807 derivative records from 46867 primary records. [2025-09-25T22:20:15.755855] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-25T22:20:15.775692] [DEBUG] [LOCAL ] FR: Derivative data saved (1807 records). [2025-09-25T22:20:15.776369] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-25T22:20:15.792066] [INFO ] [MAIN ] Derivative Progress: 673/2043 symbols completed. FR took 1.2s. Estimated remaining: 9m 44s. Rate: 140.8 symbols/min [2025-09-25T22:20:15.792896] [DEBUG] [MAIN ] FRGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:15.794405] [INFO ] [MAIN ] FRGE: Generated 1807 derivative records from 18502 primary records. [2025-09-25T22:20:15.794784] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-25T22:20:15.827936] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1807 records). [2025-09-25T22:20:15.828421] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-25T22:20:15.828335] [DEBUG] [MAIN ] FRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:15.829373] [INFO ] [MAIN ] FRA: Generated 1807 derivative records from 14610 primary records. [2025-09-25T22:20:15.831670] [INFO ] [MAIN ] Derivative Progress: 674/2043 symbols completed. FRGE took 1.2s. Estimated remaining: 9m 43s. Rate: 141.0 symbols/min [2025-09-25T22:20:15.831911] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-25T22:20:15.848416] [DEBUG] [LOCAL ] FRA: Derivative data saved (1807 records). [2025-09-25T22:20:15.848524] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-25T22:20:15.851489] [INFO ] [MAIN ] Derivative Progress: 675/2043 symbols completed. FRA took 1.2s. Estimated remaining: 9m 41s. Rate: 141.2 symbols/min [2025-09-25T22:20:15.852146] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:15.852391] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:15.852610] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:15.903127] [DEBUG] [LOCAL ] FSCO: Loaded 37342 existing records from primary storage. [2025-09-25T22:20:15.918234] [INFO ] [MAIN ] FSCO: Loaded 37342 primary data records. [2025-09-25T22:20:15.991143] [DEBUG] [LOCAL ] FRT: Loaded 42561 existing records from primary storage. [2025-09-25T22:20:16.015928] [INFO ] [MAIN ] FRT: Loaded 42561 primary data records. [2025-09-25T22:20:16.100051] [DEBUG] [LOCAL ] FRO: Loaded 52243 existing records from primary storage. [2025-09-25T22:20:16.121578] [INFO ] [MAIN ] FRO: Loaded 52243 primary data records. [2025-09-25T22:20:17.036484] [DEBUG] [MAIN ] FSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:17.039777] [INFO ] [MAIN ] FSCO: Generated 1807 derivative records from 37342 primary records. [2025-09-25T22:20:17.040255] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-25T22:20:17.074704] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1807 records). [2025-09-25T22:20:17.075095] [DEBUG] [MAIN ] FRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:17.075447] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-25T22:20:17.077828] [INFO ] [MAIN ] Derivative Progress: 676/2043 symbols completed. FSCO took 1.2s. Estimated remaining: 9m 43s. Rate: 140.8 symbols/min [2025-09-25T22:20:17.079062] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:17.078733] [INFO ] [MAIN ] FRT: Generated 1807 derivative records from 42561 primary records. [2025-09-25T22:20:17.087418] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-25T22:20:17.094156] [DEBUG] [MAIN ] FRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:17.106380] [INFO ] [MAIN ] FRO: Generated 1807 derivative records from 52243 primary records. [2025-09-25T22:20:17.106813] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-25T22:20:17.111515] [DEBUG] [LOCAL ] FRT: Derivative data saved (1807 records). [2025-09-25T22:20:17.111612] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-25T22:20:17.121689] [INFO ] [MAIN ] Derivative Progress: 677/2043 symbols completed. FRT took 1.3s. Estimated remaining: 9m 41s. Rate: 141.0 symbols/min [2025-09-25T22:20:17.127841] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:17.130771] [DEBUG] [LOCAL ] FRO: Derivative data saved (1807 records). [2025-09-25T22:20:17.131265] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-25T22:20:17.136375] [INFO ] [MAIN ] Derivative Progress: 678/2043 symbols completed. FRO took 1.3s. Estimated remaining: 9m 40s. Rate: 141.2 symbols/min [2025-09-25T22:20:17.138064] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:17.179420] [DEBUG] [LOCAL ] FSK: Loaded 49795 existing records from primary storage. [2025-09-25T22:20:17.192264] [INFO ] [MAIN ] FSK: Loaded 49795 primary data records. [2025-09-25T22:20:17.356283] [DEBUG] [LOCAL ] FSLY: Loaded 51629 existing records from primary storage. [2025-09-25T22:20:17.419540] [DEBUG] [LOCAL ] FSM: Loaded 53675 existing records from primary storage. [2025-09-25T22:20:17.426913] [INFO ] [MAIN ] FSM: Loaded 53675 primary data records. [2025-09-25T22:20:17.426816] [INFO ] [MAIN ] FSLY: Loaded 51629 primary data records. [2025-09-25T22:20:18.377700] [DEBUG] [MAIN ] FSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:18.380945] [INFO ] [MAIN ] FSK: Generated 1807 derivative records from 49795 primary records. [2025-09-25T22:20:18.381872] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-25T22:20:18.405959] [DEBUG] [LOCAL ] FSK: Derivative data saved (1807 records). [2025-09-25T22:20:18.406868] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-25T22:20:18.409836] [INFO ] [MAIN ] Derivative Progress: 679/2043 symbols completed. FSK took 1.3s. Estimated remaining: 9m 41s. Rate: 140.7 symbols/min [2025-09-25T22:20:18.410796] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:18.443667] [DEBUG] [MAIN ] FSLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:18.449295] [DEBUG] [MAIN ] FSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:18.450349] [INFO ] [MAIN ] FSM: Generated 1807 derivative records from 53675 primary records. [2025-09-25T22:20:18.451344] [INFO ] [MAIN ] FSLY: Generated 1807 derivative records from 51629 primary records. [2025-09-25T22:20:18.451706] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-25T22:20:18.451617] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-25T22:20:18.481368] [DEBUG] [LOCAL ] FSM: Derivative data saved (1807 records). [2025-09-25T22:20:18.485607] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1807 records). [2025-09-25T22:20:18.495521] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-25T22:20:18.495288] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-25T22:20:18.499354] [INFO ] [MAIN ] Derivative Progress: 680/2043 symbols completed. FSLY took 1.4s. Estimated remaining: 9m 40s. Rate: 140.9 symbols/min [2025-09-25T22:20:18.503056] [INFO ] [MAIN ] Derivative Progress: 681/2043 symbols completed. FSM took 1.4s. Estimated remaining: 9m 39s. Rate: 141.1 symbols/min [2025-09-25T22:20:18.502940] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:18.503511] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:18.521339] [DEBUG] [LOCAL ] FSS: Loaded 34689 existing records from primary storage. [2025-09-25T22:20:18.521683] [INFO ] [MAIN ] FSS: Loaded 34689 primary data records. [2025-09-25T22:20:18.568824] [DEBUG] [LOCAL ] FT: Loaded 6371 existing records from primary storage. [2025-09-25T22:20:18.582761] [INFO ] [MAIN ] FT: Loaded 6371 primary data records. [2025-09-25T22:20:18.607184] [DEBUG] [LOCAL ] FTHY: Loaded 11807 existing records from primary storage. [2025-09-25T22:20:18.619875] [INFO ] [MAIN ] FTHY: Loaded 11807 primary data records. [2025-09-25T22:20:19.560634] [DEBUG] [MAIN ] FTHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:19.563524] [INFO ] [MAIN ] FTHY: Generated 1807 derivative records from 11807 primary records. [2025-09-25T22:20:19.563723] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-25T22:20:19.595044] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1807 records). [2025-09-25T22:20:19.609294] [DEBUG] [MAIN ] FT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:19.615357] [INFO ] [MAIN ] FT: Generated 1807 derivative records from 6371 primary records. [2025-09-25T22:20:19.600410] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-25T22:20:19.615791] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-25T22:20:19.619044] [INFO ] [MAIN ] Derivative Progress: 682/2043 symbols completed. FTHY took 1.1s. Estimated remaining: 9m 40s. Rate: 140.8 symbols/min [2025-09-25T22:20:19.620690] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:19.619855] [DEBUG] [MAIN ] FSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:19.632593] [INFO ] [MAIN ] FSS: Generated 1807 derivative records from 34689 primary records. [2025-09-25T22:20:19.637400] [DEBUG] [LOCAL ] FT: Derivative data saved (1807 records). [2025-09-25T22:20:19.637534] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-25T22:20:19.638357] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-25T22:20:19.642551] [INFO ] [MAIN ] Derivative Progress: 683/2043 symbols completed. FT took 1.1s. Estimated remaining: 9m 39s. Rate: 141.0 symbols/min [2025-09-25T22:20:19.643819] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:19.661812] [DEBUG] [LOCAL ] FSS: Derivative data saved (1807 records). [2025-09-25T22:20:19.662009] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-25T22:20:19.665535] [INFO ] [MAIN ] Derivative Progress: 684/2043 symbols completed. FSS took 1.3s. Estimated remaining: 9m 38s. Rate: 141.2 symbols/min [2025-09-25T22:20:19.666164] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:19.706402] [DEBUG] [LOCAL ] FTK: Loaded 32527 existing records from primary storage. [2025-09-25T22:20:19.707084] [INFO ] [MAIN ] FTK: Loaded 32527 primary data records. [2025-09-25T22:20:19.872690] [DEBUG] [LOCAL ] FTS: Loaded 42414 existing records from primary storage. [2025-09-25T22:20:19.897536] [INFO ] [MAIN ] FTS: Loaded 42414 primary data records. [2025-09-25T22:20:20.129240] [DEBUG] [LOCAL ] FTV: Loaded 53303 existing records from primary storage. [2025-09-25T22:20:20.146959] [INFO ] [MAIN ] FTV: Loaded 53303 primary data records. [2025-09-25T22:20:20.853277] [DEBUG] [MAIN ] FTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:20.856362] [INFO ] [MAIN ] FTK: Generated 1807 derivative records from 32527 primary records. [2025-09-25T22:20:20.858011] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-25T22:20:20.894837] [DEBUG] [MAIN ] FTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:20.896625] [INFO ] [MAIN ] FTS: Generated 1807 derivative records from 42414 primary records. [2025-09-25T22:20:20.896765] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-25T22:20:20.898960] [DEBUG] [LOCAL ] FTK: Derivative data saved (1807 records). [2025-09-25T22:20:20.900854] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-25T22:20:20.905432] [INFO ] [MAIN ] Derivative Progress: 685/2043 symbols completed. FTK took 1.3s. Estimated remaining: 9m 39s. Rate: 140.8 symbols/min [2025-09-25T22:20:20.914626] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:20.938092] [DEBUG] [MAIN ] FTV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:20.940774] [INFO ] [MAIN ] FTV: Generated 1807 derivative records from 53303 primary records. [2025-09-25T22:20:20.941004] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-25T22:20:20.938775] [DEBUG] [LOCAL ] FTS: Derivative data saved (1807 records). [2025-09-25T22:20:20.942492] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-25T22:20:20.948357] [DEBUG] [LOCAL ] FTWO: Loaded 1806 existing records from primary storage. [2025-09-25T22:20:20.945606] [INFO ] [MAIN ] Derivative Progress: 686/2043 symbols completed. FTS took 1.3s. Estimated remaining: 9m 38s. Rate: 141.0 symbols/min [2025-09-25T22:20:20.956183] [INFO ] [MAIN ] FTWO: Loaded 1806 primary data records. [2025-09-25T22:20:20.956378] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:21.085332] [DEBUG] [LOCAL ] FTV: Derivative data saved (1807 records). [2025-09-25T22:20:21.086151] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-25T22:20:21.095041] [INFO ] [MAIN ] Derivative Progress: 687/2043 symbols completed. FTV took 1.4s. Estimated remaining: 9m 37s. Rate: 141.1 symbols/min [2025-09-25T22:20:21.116832] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:21.355097] [DEBUG] [LOCAL ] FUBO: Loaded 54088 existing records from primary storage. [2025-09-25T22:20:21.366402] [INFO ] [MAIN ] FUBO: Loaded 54088 primary data records. [2025-09-25T22:20:21.509457] [DEBUG] [LOCAL ] FUL: Loaded 33285 existing records from primary storage. [2025-09-25T22:20:21.502383] [DEBUG] [MAIN ] FTWO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:21.529960] [INFO ] [MAIN ] FTWO: Generated 1806 derivative records from 1806 primary records. [2025-09-25T22:20:21.528516] [INFO ] [MAIN ] FUL: Loaded 33285 primary data records. [2025-09-25T22:20:21.540709] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-25T22:20:21.704833] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1806 records). [2025-09-25T22:20:21.718392] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-25T22:20:21.743304] [INFO ] [MAIN ] Derivative Progress: 688/2043 symbols completed. FTWO took 0.8s. Estimated remaining: 9m 37s. Rate: 141.0 symbols/min [2025-09-25T22:20:22.165254] [DEBUG] [MAIN ] FUBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:22.166311] [INFO ] [MAIN ] FUBO: Generated 1807 derivative records from 54088 primary records. [2025-09-25T22:20:22.166554] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-25T22:20:22.184545] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1807 records). [2025-09-25T22:20:22.184683] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-25T22:20:22.186941] [INFO ] [MAIN ] Derivative Progress: 689/2043 symbols completed. FUBO took 1.2s. Estimated remaining: 9m 36s. Rate: 141.0 symbols/min [2025-09-25T22:20:22.203328] [DEBUG] [MAIN ] FUL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:22.204072] [INFO ] [MAIN ] FUL: Generated 1807 derivative records from 33285 primary records. [2025-09-25T22:20:22.204140] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-25T22:20:22.220443] [DEBUG] [LOCAL ] FUL: Derivative data saved (1807 records). [2025-09-25T22:20:22.220544] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-25T22:20:22.223053] [INFO ] [MAIN ] Derivative Progress: 690/2043 symbols completed. FUL took 1.1s. Estimated remaining: 9m 35s. Rate: 141.2 symbols/min [2025-09-25T22:20:22.224486] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:22.224393] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:22.224209] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:22.255480] [DEBUG] [LOCAL ] FVR: Loaded 22268 existing records from primary storage. [2025-09-25T22:20:22.255757] [INFO ] [MAIN ] FVR: Loaded 22268 primary data records. [2025-09-25T22:20:22.506207] [DEBUG] [LOCAL ] FVRR: Loaded 40472 existing records from primary storage. [2025-09-25T22:20:22.539017] [INFO ] [MAIN ] FVRR: Loaded 40472 primary data records. [2025-09-25T22:20:22.688127] [DEBUG] [LOCAL ] FUN: Loaded 51960 existing records from primary storage. [2025-09-25T22:20:22.729963] [INFO ] [MAIN ] FUN: Loaded 51960 primary data records. [2025-09-25T22:20:23.504441] [DEBUG] [MAIN ] FVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:23.505922] [INFO ] [MAIN ] FVR: Generated 1807 derivative records from 22268 primary records. [2025-09-25T22:20:23.506422] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-25T22:20:23.528827] [DEBUG] [LOCAL ] FVR: Derivative data saved (1807 records). [2025-09-25T22:20:23.533465] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-25T22:20:23.538331] [INFO ] [MAIN ] Derivative Progress: 691/2043 symbols completed. FVR took 1.3s. Estimated remaining: 9m 36s. Rate: 140.7 symbols/min [2025-09-25T22:20:23.539578] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:23.557172] [DEBUG] [MAIN ] FVRR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:23.558372] [INFO ] [MAIN ] FVRR: Generated 1807 derivative records from 40472 primary records. [2025-09-25T22:20:23.558664] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-25T22:20:23.580808] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1807 records). [2025-09-25T22:20:23.581966] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-25T22:20:23.584924] [INFO ] [MAIN ] Derivative Progress: 692/2043 symbols completed. FVRR took 1.4s. Estimated remaining: 9m 35s. Rate: 140.9 symbols/min [2025-09-25T22:20:23.585724] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:23.601018] [DEBUG] [MAIN ] FUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:23.602075] [INFO ] [MAIN ] FUN: Generated 1807 derivative records from 51960 primary records. [2025-09-25T22:20:23.602143] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-25T22:20:23.621797] [DEBUG] [LOCAL ] FUN: Derivative data saved (1807 records). [2025-09-25T22:20:23.622001] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-25T22:20:23.625165] [INFO ] [MAIN ] Derivative Progress: 693/2043 symbols completed. FUN took 1.4s. Estimated remaining: 9m 34s. Rate: 141.1 symbols/min [2025-09-25T22:20:23.625682] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:23.651982] [DEBUG] [LOCAL ] GAM: Loaded 4142 existing records from primary storage. [2025-09-25T22:20:23.652275] [INFO ] [MAIN ] GAM: Loaded 4142 primary data records. [2025-09-25T22:20:23.744200] [DEBUG] [LOCAL ] GAB: Loaded 28167 existing records from primary storage. [2025-09-25T22:20:23.773320] [INFO ] [MAIN ] GAB: Loaded 28167 primary data records. [2025-09-25T22:20:23.795981] [DEBUG] [LOCAL ] G: Loaded 50170 existing records from primary storage. [2025-09-25T22:20:23.825608] [INFO ] [MAIN ] G: Loaded 50170 primary data records. [2025-09-25T22:20:24.741876] [DEBUG] [MAIN ] GAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:24.743415] [INFO ] [MAIN ] GAM: Generated 1807 derivative records from 4142 primary records. [2025-09-25T22:20:24.743626] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-25T22:20:24.786140] [DEBUG] [LOCAL ] GAM: Derivative data saved (1807 records). [2025-09-25T22:20:24.791564] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-25T22:20:24.794466] [INFO ] [MAIN ] Derivative Progress: 694/2043 symbols completed. GAM took 1.2s. Estimated remaining: 9m 35s. Rate: 140.7 symbols/min [2025-09-25T22:20:24.795561] [DEBUG] [MAIN ] G: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:24.795091] [DEBUG] [MAIN ] GAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:24.797170] [INFO ] [MAIN ] G: Generated 1807 derivative records from 50170 primary records. [2025-09-25T22:20:24.795915] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:24.798080] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-25T22:20:24.797980] [INFO ] [MAIN ] GAB: Generated 1807 derivative records from 28167 primary records. [2025-09-25T22:20:24.800571] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-25T22:20:24.825875] [DEBUG] [LOCAL ] G: Derivative data saved (1807 records). [2025-09-25T22:20:24.837206] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-25T22:20:24.841373] [INFO ] [MAIN ] Derivative Progress: 695/2043 symbols completed. G took 1.3s. Estimated remaining: 9m 34s. Rate: 140.9 symbols/min [2025-09-25T22:20:24.842233] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:24.851506] [DEBUG] [LOCAL ] GAB: Derivative data saved (1807 records). [2025-09-25T22:20:24.851722] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-25T22:20:24.855486] [INFO ] [MAIN ] Derivative Progress: 696/2043 symbols completed. GAB took 1.3s. Estimated remaining: 9m 33s. Rate: 141.1 symbols/min [2025-09-25T22:20:24.855851] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:24.893526] [DEBUG] [LOCAL ] GATX: Loaded 18290 existing records from primary storage. [2025-09-25T22:20:24.899975] [DEBUG] [LOCAL ] GBAB: Loaded 13056 existing records from primary storage. [2025-09-25T22:20:24.900134] [INFO ] [MAIN ] GATX: Loaded 18290 primary data records. [2025-09-25T22:20:24.900536] [INFO ] [MAIN ] GBAB: Loaded 13056 primary data records. [2025-09-25T22:20:24.963688] [DEBUG] [LOCAL ] GAP: Loaded 54045 existing records from primary storage. [2025-09-25T22:20:25.000841] [INFO ] [MAIN ] GAP: Loaded 54045 primary data records. [2025-09-25T22:20:25.970185] [DEBUG] [MAIN ] GATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:25.970979] [DEBUG] [MAIN ] GBAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:25.971898] [INFO ] [MAIN ] GATX: Generated 1807 derivative records from 18290 primary records. [2025-09-25T22:20:25.984265] [INFO ] [MAIN ] GBAB: Generated 1807 derivative records from 13056 primary records. [2025-09-25T22:20:25.984625] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-25T22:20:25.985691] [DEBUG] [MAIN ] GAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:25.984761] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-25T22:20:25.986828] [INFO ] [MAIN ] GAP: Generated 1807 derivative records from 54045 primary records. [2025-09-25T22:20:25.986961] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-25T22:20:26.031446] [DEBUG] [LOCAL ] GATX: Derivative data saved (1807 records). [2025-09-25T22:20:26.035426] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1807 records). [2025-09-25T22:20:26.035932] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-25T22:20:26.037233] [DEBUG] [LOCAL ] GAP: Derivative data saved (1807 records). [2025-09-25T22:20:26.037382] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-25T22:20:26.040094] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-25T22:20:26.039920] [INFO ] [MAIN ] Derivative Progress: 697/2043 symbols completed. GATX took 1.2s. Estimated remaining: 9m 34s. Rate: 140.8 symbols/min [2025-09-25T22:20:26.047477] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:26.047631] [INFO ] [MAIN ] Derivative Progress: 698/2043 symbols completed. GBAB took 1.2s. Estimated remaining: 9m 32s. Rate: 141.0 symbols/min [2025-09-25T22:20:26.048051] [INFO ] [MAIN ] Derivative Progress: 699/2043 symbols completed. GAP took 1.3s. Estimated remaining: 9m 31s. Rate: 141.2 symbols/min [2025-09-25T22:20:26.048795] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:26.047936] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:26.120359] [DEBUG] [LOCAL ] GBX: Loaded 29340 existing records from primary storage. [2025-09-25T22:20:26.134068] [INFO ] [MAIN ] GBX: Loaded 29340 primary data records. [2025-09-25T22:20:26.133957] [DEBUG] [LOCAL ] GBCI: Loaded 40385 existing records from primary storage. [2025-09-25T22:20:26.134558] [INFO ] [MAIN ] GBCI: Loaded 40385 primary data records. [2025-09-25T22:20:26.163852] [DEBUG] [LOCAL ] GBTG: Loaded 40531 existing records from primary storage. [2025-09-25T22:20:26.205486] [INFO ] [MAIN ] GBTG: Loaded 40531 primary data records. [2025-09-25T22:20:27.224354] [DEBUG] [MAIN ] GBCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:27.225674] [INFO ] [MAIN ] GBCI: Generated 1807 derivative records from 40385 primary records. [2025-09-25T22:20:27.227127] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-25T22:20:27.260724] [DEBUG] [MAIN ] GBTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:27.265315] [INFO ] [MAIN ] GBTG: Generated 1807 derivative records from 40531 primary records. [2025-09-25T22:20:27.265791] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-25T22:20:27.293577] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1807 records). [2025-09-25T22:20:27.296560] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-25T22:20:27.299679] [INFO ] [MAIN ] Derivative Progress: 700/2043 symbols completed. GBCI took 1.3s. Estimated remaining: 9m 32s. Rate: 140.8 symbols/min [2025-09-25T22:20:27.296992] [DEBUG] [MAIN ] GBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:27.300464] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:27.301825] [INFO ] [MAIN ] GBX: Generated 1807 derivative records from 29340 primary records. [2025-09-25T22:20:27.304219] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-25T22:20:27.304321] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1807 records). [2025-09-25T22:20:27.305264] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-25T22:20:27.309951] [INFO ] [MAIN ] Derivative Progress: 701/2043 symbols completed. GBTG took 1.3s. Estimated remaining: 9m 31s. Rate: 141.0 symbols/min [2025-09-25T22:20:27.317832] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:27.329299] [DEBUG] [LOCAL ] GBX: Derivative data saved (1807 records). [2025-09-25T22:20:27.329508] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-25T22:20:27.332494] [INFO ] [MAIN ] Derivative Progress: 702/2043 symbols completed. GBX took 1.3s. Estimated remaining: 9m 30s. Rate: 141.2 symbols/min [2025-09-25T22:20:27.333008] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:27.385163] [DEBUG] [LOCAL ] GCO: Loaded 25567 existing records from primary storage. [2025-09-25T22:20:27.387035] [INFO ] [MAIN ] GCO: Loaded 25567 primary data records. [2025-09-25T22:20:27.386826] [DEBUG] [LOCAL ] GCTS: Loaded 19961 existing records from primary storage. [2025-09-25T22:20:27.449830] [DEBUG] [LOCAL ] GCI: Loaded 44530 existing records from primary storage. [2025-09-25T22:20:27.440815] [INFO ] [MAIN ] GCTS: Loaded 19961 primary data records. [2025-09-25T22:20:27.464029] [INFO ] [MAIN ] GCI: Loaded 44530 primary data records. [2025-09-25T22:20:28.471803] [DEBUG] [MAIN ] GCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:28.477990] [INFO ] [MAIN ] GCO: Generated 1807 derivative records from 25567 primary records. [2025-09-25T22:20:28.478934] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-25T22:20:28.520018] [DEBUG] [MAIN ] GCTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:28.521035] [DEBUG] [MAIN ] GCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:28.522023] [INFO ] [MAIN ] GCTS: Generated 1807 derivative records from 19961 primary records. [2025-09-25T22:20:28.524462] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-25T22:20:28.525013] [INFO ] [MAIN ] GCI: Generated 1807 derivative records from 44530 primary records. [2025-09-25T22:20:28.526296] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-25T22:20:28.537807] [DEBUG] [LOCAL ] GCO: Derivative data saved (1807 records). [2025-09-25T22:20:28.541401] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-25T22:20:28.544540] [INFO ] [MAIN ] Derivative Progress: 703/2043 symbols completed. GCO took 1.2s. Estimated remaining: 9m 31s. Rate: 140.8 symbols/min [2025-09-25T22:20:28.564328] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1807 records). [2025-09-25T22:20:28.564468] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-25T22:20:28.567974] [INFO ] [MAIN ] Derivative Progress: 704/2043 symbols completed. GCTS took 1.2s. Estimated remaining: 9m 30s. Rate: 141.0 symbols/min [2025-09-25T22:20:28.571577] [DEBUG] [LOCAL ] GCI: Derivative data saved (1807 records). [2025-09-25T22:20:28.571802] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-25T22:20:28.575603] [INFO ] [MAIN ] Derivative Progress: 705/2043 symbols completed. GCI took 1.3s. Estimated remaining: 9m 29s. Rate: 141.2 symbols/min [2025-09-25T22:20:28.576386] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:28.577681] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:28.577524] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:28.591063] [DEBUG] [LOCAL ] GCV: Loaded 7245 existing records from primary storage. [2025-09-25T22:20:28.591609] [INFO ] [MAIN ] GCV: Loaded 7245 primary data records. [2025-09-25T22:20:28.993207] [DEBUG] [LOCAL ] GD: Loaded 47620 existing records from primary storage. [2025-09-25T22:20:28.993882] [INFO ] [MAIN ] GD: Loaded 47620 primary data records. [2025-09-25T22:20:28.995830] [DEBUG] [LOCAL ] GDDY: Loaded 50073 existing records from primary storage. [2025-09-25T22:20:29.014415] [INFO ] [MAIN ] GDDY: Loaded 50073 primary data records. [2025-09-25T22:20:29.762322] [DEBUG] [MAIN ] GCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:29.763615] [INFO ] [MAIN ] GCV: Generated 1807 derivative records from 7245 primary records. [2025-09-25T22:20:29.763924] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-25T22:20:29.785005] [DEBUG] [LOCAL ] GCV: Derivative data saved (1807 records). [2025-09-25T22:20:29.785169] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-25T22:20:29.790073] [INFO ] [MAIN ] Derivative Progress: 706/2043 symbols completed. GCV took 1.2s. Estimated remaining: 9m 30s. Rate: 140.8 symbols/min [2025-09-25T22:20:29.791017] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:29.811233] [DEBUG] [MAIN ] GD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:29.812432] [INFO ] [MAIN ] GD: Generated 1807 derivative records from 47620 primary records. [2025-09-25T22:20:29.812672] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-25T22:20:29.817524] [DEBUG] [LOCAL ] GDIV: Loaded 3707 existing records from primary storage. [2025-09-25T22:20:29.830188] [INFO ] [MAIN ] GDIV: Loaded 3707 primary data records. [2025-09-25T22:20:29.951166] [DEBUG] [MAIN ] GDDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:29.979965] [DEBUG] [LOCAL ] GD: Derivative data saved (1807 records). [2025-09-25T22:20:29.974916] [INFO ] [MAIN ] GDDY: Generated 1807 derivative records from 50073 primary records. [2025-09-25T22:20:29.980396] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-25T22:20:29.983769] [INFO ] [MAIN ] Derivative Progress: 707/2043 symbols completed. GD took 1.4s. Estimated remaining: 9m 29s. Rate: 140.9 symbols/min [2025-09-25T22:20:29.989955] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-25T22:20:30.000330] [INFO ] [MAIN ] GDL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:30.212106] [DEBUG] [LOCAL ] GDL: Loaded 2556 existing records from primary storage. [2025-09-25T22:20:30.213600] [INFO ] [MAIN ] GDL: Loaded 2556 primary data records. [2025-09-25T22:20:30.271903] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1807 records). [2025-09-25T22:20:30.272609] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-25T22:20:30.305284] [INFO ] [MAIN ] Derivative Progress: 708/2043 symbols completed. GDDY took 1.7s. Estimated remaining: 9m 28s. Rate: 141.0 symbols/min [2025-09-25T22:20:30.334596] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:30.582825] [DEBUG] [LOCAL ] GDO: Loaded 6055 existing records from primary storage. [2025-09-25T22:20:30.583595] [INFO ] [MAIN ] GDO: Loaded 6055 primary data records. [2025-09-25T22:20:30.728169] [DEBUG] [MAIN ] GDIV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:30.729997] [INFO ] [MAIN ] GDIV: Generated 1806 derivative records from 3707 primary records. [2025-09-25T22:20:30.736106] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-25T22:20:30.980518] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1806 records). [2025-09-25T22:20:30.981232] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-25T22:20:30.985286] [INFO ] [MAIN ] Derivative Progress: 709/2043 symbols completed. GDIV took 1.2s. Estimated remaining: 9m 28s. Rate: 140.8 symbols/min [2025-09-25T22:20:30.988513] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:31.006199] [DEBUG] [MAIN ] GDL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:31.007538] [INFO ] [MAIN ] GDL: Generated 1806 derivative records from 2556 primary records. [2025-09-25T22:20:31.007754] [DEBUG] [LOCAL ] GDL: Saving derivative data. [2025-09-25T22:20:31.032042] [DEBUG] [LOCAL ] GDL: Derivative data saved (1806 records). [2025-09-25T22:20:31.032721] [INFO ] [MAIN ] GDL: Successfully saved derivative data. [2025-09-25T22:20:31.047675] [INFO ] [MAIN ] Derivative Progress: 710/2043 symbols completed. GDL took 1.1s. Estimated remaining: 9m 27s. Rate: 141.0 symbols/min [2025-09-25T22:20:31.048473] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:31.079603] [DEBUG] [MAIN ] GDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:31.081992] [INFO ] [MAIN ] GDO: Generated 1807 derivative records from 6055 primary records. [2025-09-25T22:20:31.082182] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-25T22:20:31.083100] [DEBUG] [LOCAL ] GDOT: Loaded 38946 existing records from primary storage. [2025-09-25T22:20:31.090827] [INFO ] [MAIN ] GDOT: Loaded 38946 primary data records. [2025-09-25T22:20:31.213153] [DEBUG] [LOCAL ] GDO: Derivative data saved (1807 records). [2025-09-25T22:20:31.222357] [DEBUG] [LOCAL ] GDV: Loaded 19887 existing records from primary storage. [2025-09-25T22:20:31.222623] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-25T22:20:31.230814] [INFO ] [MAIN ] Derivative Progress: 711/2043 symbols completed. GDO took 0.9s. Estimated remaining: 9m 26s. Rate: 141.1 symbols/min [2025-09-25T22:20:31.231217] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:31.237520] [INFO ] [MAIN ] GDV: Loaded 19887 primary data records. [2025-09-25T22:20:31.894602] [DEBUG] [LOCAL ] GE: Loaded 54103 existing records from primary storage. [2025-09-25T22:20:31.895400] [INFO ] [MAIN ] GE: Loaded 54103 primary data records. [2025-09-25T22:20:31.967193] [DEBUG] [MAIN ] GDOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:32.001684] [INFO ] [MAIN ] GDOT: Generated 1807 derivative records from 38946 primary records. [2025-09-25T22:20:32.001990] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-25T22:20:32.139095] [DEBUG] [MAIN ] GDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:32.270151] [INFO ] [MAIN ] GDV: Generated 1807 derivative records from 19887 primary records. [2025-09-25T22:20:32.270497] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1807 records). [2025-09-25T22:20:32.270917] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-25T22:20:32.274403] [INFO ] [MAIN ] Derivative Progress: 712/2043 symbols completed. GDOT took 1.3s. Estimated remaining: 9m 27s. Rate: 140.8 symbols/min [2025-09-25T22:20:32.274819] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:32.270841] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-25T22:20:32.306034] [DEBUG] [LOCAL ] GDV: Derivative data saved (1807 records). [2025-09-25T22:20:32.306215] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-25T22:20:32.310527] [INFO ] [MAIN ] Derivative Progress: 713/2043 symbols completed. GDV took 1.3s. Estimated remaining: 9m 26s. Rate: 141.0 symbols/min [2025-09-25T22:20:32.311200] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:32.321621] [DEBUG] [LOCAL ] GEF: Loaded 20843 existing records from primary storage. [2025-09-25T22:20:32.321980] [INFO ] [MAIN ] GEF: Loaded 20843 primary data records. [2025-09-25T22:20:32.470629] [DEBUG] [MAIN ] GE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:32.492545] [INFO ] [MAIN ] GE: Generated 1807 derivative records from 54103 primary records. [2025-09-25T22:20:32.536414] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-25T22:20:32.564395] [DEBUG] [LOCAL ] GEL: Loaded 34035 existing records from primary storage. [2025-09-25T22:20:32.565537] [INFO ] [MAIN ] GEL: Loaded 34035 primary data records. [2025-09-25T22:20:32.820253] [DEBUG] [LOCAL ] GE: Derivative data saved (1807 records). [2025-09-25T22:20:32.825880] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-25T22:20:32.884629] [INFO ] [MAIN ] Derivative Progress: 714/2043 symbols completed. GE took 1.7s. Estimated remaining: 9m 26s. Rate: 140.9 symbols/min [2025-09-25T22:20:32.909295] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:33.060127] [DEBUG] [MAIN ] GEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:33.061280] [INFO ] [MAIN ] GEF: Generated 1807 derivative records from 20843 primary records. [2025-09-25T22:20:33.061531] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-25T22:20:33.081020] [DEBUG] [LOCAL ] GEF: Derivative data saved (1807 records). [2025-09-25T22:20:33.081340] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-25T22:20:33.084703] [INFO ] [MAIN ] Derivative Progress: 715/2043 symbols completed. GEF took 0.8s. Estimated remaining: 9m 25s. Rate: 141.1 symbols/min [2025-09-25T22:20:33.102089] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:33.123931] [DEBUG] [MAIN ] GEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:33.125188] [INFO ] [MAIN ] GEL: Generated 1807 derivative records from 34035 primary records. [2025-09-25T22:20:33.139243] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-25T22:20:33.143900] [DEBUG] [LOCAL ] GENI: Loaded 53298 existing records from primary storage. [2025-09-25T22:20:33.144604] [INFO ] [MAIN ] GENI: Loaded 53298 primary data records. [2025-09-25T22:20:33.502682] [DEBUG] [LOCAL ] GEL: Derivative data saved (1807 records). [2025-09-25T22:20:33.520962] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-25T22:20:33.520559] [DEBUG] [LOCAL ] GEO: Loaded 52453 existing records from primary storage. [2025-09-25T22:20:33.521206] [INFO ] [MAIN ] GEO: Loaded 52453 primary data records. [2025-09-25T22:20:33.525135] [INFO ] [MAIN ] Derivative Progress: 716/2043 symbols completed. GEL took 1.2s. Estimated remaining: 9m 24s. Rate: 141.0 symbols/min [2025-09-25T22:20:33.572954] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:34.016261] [DEBUG] [MAIN ] GENI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:34.018240] [INFO ] [MAIN ] GENI: Generated 1807 derivative records from 53298 primary records. [2025-09-25T22:20:34.018743] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-25T22:20:34.043027] [DEBUG] [LOCAL ] GES: Loaded 40204 existing records from primary storage. [2025-09-25T22:20:34.043571] [INFO ] [MAIN ] GES: Loaded 40204 primary data records. [2025-09-25T22:20:34.245016] [DEBUG] [LOCAL ] GENI: Derivative data saved (1807 records). [2025-09-25T22:20:34.275349] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-25T22:20:34.279674] [INFO ] [MAIN ] Derivative Progress: 717/2043 symbols completed. GENI took 1.4s. Estimated remaining: 9m 25s. Rate: 140.9 symbols/min [2025-09-25T22:20:34.344639] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:34.366777] [DEBUG] [MAIN ] GEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:34.367829] [INFO ] [MAIN ] GEO: Generated 1807 derivative records from 52453 primary records. [2025-09-25T22:20:34.393308] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-25T22:20:34.636637] [DEBUG] [LOCAL ] GEO: Derivative data saved (1807 records). [2025-09-25T22:20:34.637210] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-25T22:20:34.640748] [INFO ] [MAIN ] Derivative Progress: 718/2043 symbols completed. GEO took 1.5s. Estimated remaining: 9m 24s. Rate: 140.9 symbols/min [2025-09-25T22:20:34.662014] [DEBUG] [LOCAL ] GETY: Loaded 36145 existing records from primary storage. [2025-09-25T22:20:34.663121] [INFO ] [MAIN ] GETY: Loaded 36145 primary data records. [2025-09-25T22:20:34.942708] [DEBUG] [MAIN ] GES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:35.048307] [INFO ] [MAIN ] GES: Generated 1807 derivative records from 40204 primary records. [2025-09-25T22:20:35.080409] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-25T22:20:35.113851] [DEBUG] [LOCAL ] GES: Derivative data saved (1807 records). [2025-09-25T22:20:35.114012] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-25T22:20:35.117963] [INFO ] [MAIN ] Derivative Progress: 719/2043 symbols completed. GES took 1.6s. Estimated remaining: 9m 24s. Rate: 140.9 symbols/min [2025-09-25T22:20:35.136931] [DEBUG] [MAIN ] GETY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:35.137724] [INFO ] [MAIN ] GETY: Generated 1807 derivative records from 36145 primary records. [2025-09-25T22:20:35.137793] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-25T22:20:35.154932] [DEBUG] [LOCAL ] GETY: Derivative data saved (1807 records). [2025-09-25T22:20:35.155084] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-25T22:20:35.158020] [INFO ] [MAIN ] Derivative Progress: 720/2043 symbols completed. GETY took 0.8s. Estimated remaining: 9m 23s. Rate: 141.1 symbols/min [2025-09-25T22:20:35.158847] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:35.159146] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:35.159785] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:35.175360] [DEBUG] [LOCAL ] GF: Loaded 3206 existing records from primary storage. [2025-09-25T22:20:35.175508] [INFO ] [MAIN ] GF: Loaded 3206 primary data records. [2025-09-25T22:20:35.407138] [DEBUG] [LOCAL ] GFF: Loaded 30968 existing records from primary storage. [2025-09-25T22:20:35.424338] [INFO ] [MAIN ] GFF: Loaded 30968 primary data records. [2025-09-25T22:20:35.692492] [DEBUG] [LOCAL ] GEV: Loaded 53499 existing records from primary storage. [2025-09-25T22:20:35.713748] [INFO ] [MAIN ] GEV: Loaded 53499 primary data records. [2025-09-25T22:20:36.335271] [DEBUG] [MAIN ] GF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:36.337121] [INFO ] [MAIN ] GF: Generated 1807 derivative records from 3206 primary records. [2025-09-25T22:20:36.337322] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-25T22:20:36.358330] [DEBUG] [LOCAL ] GF: Derivative data saved (1807 records). [2025-09-25T22:20:36.358978] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-25T22:20:36.369238] [INFO ] [MAIN ] Derivative Progress: 721/2043 symbols completed. GF took 1.2s. Estimated remaining: 9m 24s. Rate: 140.7 symbols/min [2025-09-25T22:20:36.375075] [DEBUG] [MAIN ] GFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:36.376181] [INFO ] [MAIN ] GFF: Generated 1807 derivative records from 30968 primary records. [2025-09-25T22:20:36.376271] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-25T22:20:36.376456] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:36.413607] [DEBUG] [LOCAL ] GFF: Derivative data saved (1807 records). [2025-09-25T22:20:36.413916] [DEBUG] [MAIN ] GEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:36.414141] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-25T22:20:36.416920] [INFO ] [MAIN ] Derivative Progress: 722/2043 symbols completed. GFF took 1.3s. Estimated remaining: 9m 23s. Rate: 140.9 symbols/min [2025-09-25T22:20:36.417831] [INFO ] [MAIN ] GEV: Generated 1807 derivative records from 53499 primary records. [2025-09-25T22:20:36.418283] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:36.419020] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-25T22:20:36.439228] [DEBUG] [LOCAL ] GEV: Derivative data saved (1807 records). [2025-09-25T22:20:36.439520] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-25T22:20:36.442481] [INFO ] [MAIN ] Derivative Progress: 723/2043 symbols completed. GEV took 1.3s. Estimated remaining: 9m 21s. Rate: 141.1 symbols/min [2025-09-25T22:20:36.442944] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:36.469623] [DEBUG] [LOCAL ] GFR: Loaded 8522 existing records from primary storage. [2025-09-25T22:20:36.469858] [INFO ] [MAIN ] GFR: Loaded 8522 primary data records. [2025-09-25T22:20:36.612491] [DEBUG] [LOCAL ] GFI: Loaded 53499 existing records from primary storage. [2025-09-25T22:20:36.618829] [INFO ] [MAIN ] GFI: Loaded 53499 primary data records. [2025-09-25T22:20:36.972775] [DEBUG] [LOCAL ] GFL: Loaded 48414 existing records from primary storage. [2025-09-25T22:20:36.974358] [INFO ] [MAIN ] GFL: Loaded 48414 primary data records. [2025-09-25T22:20:37.563665] [DEBUG] [MAIN ] GFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:37.564859] [INFO ] [MAIN ] GFR: Generated 1807 derivative records from 8522 primary records. [2025-09-25T22:20:37.565106] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-25T22:20:37.609249] [DEBUG] [LOCAL ] GFR: Derivative data saved (1807 records). [2025-09-25T22:20:37.609761] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-25T22:20:37.609563] [DEBUG] [MAIN ] GFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:37.610703] [INFO ] [MAIN ] GFI: Generated 1807 derivative records from 53499 primary records. [2025-09-25T22:20:37.610946] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-25T22:20:37.614886] [INFO ] [MAIN ] Derivative Progress: 724/2043 symbols completed. GFR took 1.2s. Estimated remaining: 9m 22s. Rate: 140.7 symbols/min [2025-09-25T22:20:37.617462] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:37.653053] [DEBUG] [LOCAL ] GFI: Derivative data saved (1807 records). [2025-09-25T22:20:37.653933] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-25T22:20:37.653838] [DEBUG] [MAIN ] GFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:37.657502] [INFO ] [MAIN ] Derivative Progress: 725/2043 symbols completed. GFI took 1.3s. Estimated remaining: 9m 21s. Rate: 140.9 symbols/min [2025-09-25T22:20:37.658569] [INFO ] [MAIN ] GFL: Generated 1807 derivative records from 48414 primary records. [2025-09-25T22:20:37.658975] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:37.658885] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-25T22:20:37.678260] [DEBUG] [LOCAL ] GFL: Derivative data saved (1807 records). [2025-09-25T22:20:37.678595] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-25T22:20:37.681858] [INFO ] [MAIN ] Derivative Progress: 726/2043 symbols completed. GFL took 1.3s. Estimated remaining: 9m 20s. Rate: 141.1 symbols/min [2025-09-25T22:20:37.682388] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:37.724126] [DEBUG] [LOCAL ] GGT: Loaded 14231 existing records from primary storage. [2025-09-25T22:20:37.724274] [INFO ] [MAIN ] GGT: Loaded 14231 primary data records. [2025-09-25T22:20:37.868579] [DEBUG] [LOCAL ] GGB: Loaded 51429 existing records from primary storage. [2025-09-25T22:20:37.869967] [INFO ] [MAIN ] GGB: Loaded 51429 primary data records. [2025-09-25T22:20:37.869838] [DEBUG] [LOCAL ] GGG: Loaded 41294 existing records from primary storage. [2025-09-25T22:20:37.880848] [INFO ] [MAIN ] GGG: Loaded 41294 primary data records. [2025-09-25T22:20:38.886411] [DEBUG] [MAIN ] GGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:38.890450] [INFO ] [MAIN ] GGT: Generated 1807 derivative records from 14231 primary records. [2025-09-25T22:20:38.891090] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-25T22:20:38.927981] [DEBUG] [MAIN ] GGB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:38.932353] [INFO ] [MAIN ] GGB: Generated 1807 derivative records from 51429 primary records. [2025-09-25T22:20:38.932589] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-25T22:20:38.934548] [DEBUG] [LOCAL ] GGT: Derivative data saved (1807 records). [2025-09-25T22:20:38.936029] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-25T22:20:38.938281] [INFO ] [MAIN ] Derivative Progress: 727/2043 symbols completed. GGT took 1.3s. Estimated remaining: 9m 21s. Rate: 140.7 symbols/min [2025-09-25T22:20:38.946172] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:38.961893] [DEBUG] [MAIN ] GGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:38.967227] [INFO ] [MAIN ] GGG: Generated 1807 derivative records from 41294 primary records. [2025-09-25T22:20:38.968407] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-25T22:20:38.974185] [DEBUG] [LOCAL ] GGB: Derivative data saved (1807 records). [2025-09-25T22:20:38.974367] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-25T22:20:38.984465] [DEBUG] [LOCAL ] GGZ: Loaded 2457 existing records from primary storage. [2025-09-25T22:20:38.991524] [INFO ] [MAIN ] Derivative Progress: 728/2043 symbols completed. GGB took 1.4s. Estimated remaining: 9m 20s. Rate: 140.9 symbols/min [2025-09-25T22:20:38.991766] [INFO ] [MAIN ] GGZ: Loaded 2457 primary data records. [2025-09-25T22:20:39.004634] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:39.120071] [DEBUG] [LOCAL ] GGG: Derivative data saved (1807 records). [2025-09-25T22:20:39.120335] [DEBUG] [LOCAL ] GHC: Loaded 2651 existing records from primary storage. [2025-09-25T22:20:39.126362] [INFO ] [MAIN ] GHC: Loaded 2651 primary data records. [2025-09-25T22:20:39.120949] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-25T22:20:39.134822] [INFO ] [MAIN ] Derivative Progress: 729/2043 symbols completed. GGG took 1.5s. Estimated remaining: 9m 19s. Rate: 141.0 symbols/min [2025-09-25T22:20:39.185956] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:39.471701] [DEBUG] [LOCAL ] GHG: Loaded 3210 existing records from primary storage. [2025-09-25T22:20:39.494112] [INFO ] [MAIN ] GHG: Loaded 3210 primary data records. [2025-09-25T22:20:40.042281] [DEBUG] [MAIN ] GGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:40.044516] [INFO ] [MAIN ] GGZ: Generated 1807 derivative records from 2457 primary records. [2025-09-25T22:20:40.044881] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-25T22:20:40.073192] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1807 records). [2025-09-25T22:20:40.079760] [DEBUG] [MAIN ] GHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:40.082439] [INFO ] [MAIN ] GHC: Generated 1807 derivative records from 2651 primary records. [2025-09-25T22:20:40.082731] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-25T22:20:40.080893] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-25T22:20:40.085096] [INFO ] [MAIN ] Derivative Progress: 730/2043 symbols completed. GGZ took 1.1s. Estimated remaining: 9m 20s. Rate: 140.8 symbols/min [2025-09-25T22:20:40.086616] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:40.110513] [DEBUG] [MAIN ] GHG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:40.117289] [INFO ] [MAIN ] GHG: Generated 1806 derivative records from 3210 primary records. [2025-09-25T22:20:40.117872] [DEBUG] [LOCAL ] GHC: Derivative data saved (1807 records). [2025-09-25T22:20:40.118028] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-25T22:20:40.118105] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-25T22:20:40.121382] [INFO ] [MAIN ] Derivative Progress: 731/2043 symbols completed. GHC took 1.1s. Estimated remaining: 9m 19s. Rate: 140.9 symbols/min [2025-09-25T22:20:40.122237] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:40.131634] [DEBUG] [LOCAL ] GHI: Loaded 6903 existing records from primary storage. [2025-09-25T22:20:40.135585] [INFO ] [MAIN ] GHI: Loaded 6903 primary data records. [2025-09-25T22:20:40.195839] [DEBUG] [LOCAL ] GHG: Derivative data saved (1806 records). [2025-09-25T22:20:40.220737] [DEBUG] [LOCAL ] GHLD: Loaded 4144 existing records from primary storage. [2025-09-25T22:20:40.233930] [INFO ] [MAIN ] GHLD: Loaded 4144 primary data records. [2025-09-25T22:20:40.220870] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-25T22:20:40.273681] [INFO ] [MAIN ] Derivative Progress: 732/2043 symbols completed. GHG took 1.1s. Estimated remaining: 9m 18s. Rate: 141.1 symbols/min [2025-09-25T22:20:40.306076] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:40.655475] [DEBUG] [LOCAL ] GHM: Loaded 14240 existing records from primary storage. [2025-09-25T22:20:40.691504] [INFO ] [MAIN ] GHM: Loaded 14240 primary data records. [2025-09-25T22:20:41.240442] [DEBUG] [MAIN ] GHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:41.242389] [INFO ] [MAIN ] GHI: Generated 1807 derivative records from 6903 primary records. [2025-09-25T22:20:41.243960] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-25T22:20:41.278041] [DEBUG] [MAIN ] GHLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:41.280075] [INFO ] [MAIN ] GHLD: Generated 1807 derivative records from 4144 primary records. [2025-09-25T22:20:41.280494] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-25T22:20:41.283621] [DEBUG] [LOCAL ] GHI: Derivative data saved (1807 records). [2025-09-25T22:20:41.283900] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-25T22:20:41.287041] [INFO ] [MAIN ] Derivative Progress: 733/2043 symbols completed. GHI took 1.2s. Estimated remaining: 9m 18s. Rate: 140.8 symbols/min [2025-09-25T22:20:41.304628] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1807 records). [2025-09-25T22:20:41.305977] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-25T22:20:41.310176] [INFO ] [MAIN ] Derivative Progress: 734/2043 symbols completed. GHLD took 1.2s. Estimated remaining: 9m 17s. Rate: 141.0 symbols/min [2025-09-25T22:20:41.324233] [DEBUG] [MAIN ] GHM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:41.325067] [INFO ] [MAIN ] GHM: Generated 1807 derivative records from 14240 primary records. [2025-09-25T22:20:41.325136] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-25T22:20:41.343785] [DEBUG] [LOCAL ] GHM: Derivative data saved (1807 records). [2025-09-25T22:20:41.343893] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-25T22:20:41.347770] [INFO ] [MAIN ] Derivative Progress: 735/2043 symbols completed. GHM took 1.0s. Estimated remaining: 9m 16s. Rate: 141.2 symbols/min [2025-09-25T22:20:41.348620] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:41.349041] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:41.348836] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:41.375455] [DEBUG] [LOCAL ] GIC: Loaded 13732 existing records from primary storage. [2025-09-25T22:20:41.384487] [INFO ] [MAIN ] GIC: Loaded 13732 primary data records. [2025-09-25T22:20:41.484083] [DEBUG] [LOCAL ] GHY: Loaded 20903 existing records from primary storage. [2025-09-25T22:20:41.505626] [INFO ] [MAIN ] GHY: Loaded 20903 primary data records. [2025-09-25T22:20:41.541862] [DEBUG] [LOCAL ] GIB: Loaded 32311 existing records from primary storage. [2025-09-25T22:20:41.579268] [INFO ] [MAIN ] GIB: Loaded 32311 primary data records. [2025-09-25T22:20:42.497855] [DEBUG] [MAIN ] GIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:42.499590] [INFO ] [MAIN ] GIC: Generated 1807 derivative records from 13732 primary records. [2025-09-25T22:20:42.500302] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-25T22:20:42.552901] [DEBUG] [LOCAL ] GIC: Derivative data saved (1807 records). [2025-09-25T22:20:42.553894] [DEBUG] [MAIN ] GIB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:42.554951] [INFO ] [MAIN ] GIB: Generated 1807 derivative records from 32311 primary records. [2025-09-25T22:20:42.555279] [DEBUG] [MAIN ] GHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:42.553992] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-25T22:20:42.556072] [INFO ] [MAIN ] GHY: Generated 1807 derivative records from 20903 primary records. [2025-09-25T22:20:42.555379] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-25T22:20:42.559621] [INFO ] [MAIN ] Derivative Progress: 736/2043 symbols completed. GIC took 1.2s. Estimated remaining: 9m 17s. Rate: 140.8 symbols/min [2025-09-25T22:20:42.560739] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-25T22:20:42.574499] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:42.579345] [DEBUG] [LOCAL ] GIB: Derivative data saved (1807 records). [2025-09-25T22:20:42.586736] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-25T22:20:42.591685] [INFO ] [MAIN ] Derivative Progress: 737/2043 symbols completed. GIB took 1.2s. Estimated remaining: 9m 16s. Rate: 141.0 symbols/min [2025-09-25T22:20:42.596406] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:42.606150] [DEBUG] [LOCAL ] GHY: Derivative data saved (1807 records). [2025-09-25T22:20:42.606407] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-25T22:20:42.610385] [INFO ] [MAIN ] Derivative Progress: 738/2043 symbols completed. GHY took 1.3s. Estimated remaining: 9m 15s. Rate: 141.2 symbols/min [2025-09-25T22:20:42.611270] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:42.686733] [DEBUG] [LOCAL ] GIL: Loaded 43565 existing records from primary storage. [2025-09-25T22:20:42.687207] [INFO ] [MAIN ] GIL: Loaded 43565 primary data records. [2025-09-25T22:20:42.823738] [DEBUG] [LOCAL ] GIS: Loaded 54065 existing records from primary storage. [2025-09-25T22:20:42.837431] [INFO ] [MAIN ] GIS: Loaded 54065 primary data records. [2025-09-25T22:20:42.838344] [DEBUG] [LOCAL ] GKOS: Loaded 43265 existing records from primary storage. [2025-09-25T22:20:42.887334] [INFO ] [MAIN ] GKOS: Loaded 43265 primary data records. [2025-09-25T22:20:43.812796] [DEBUG] [MAIN ] GIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:43.816581] [INFO ] [MAIN ] GIL: Generated 1807 derivative records from 43565 primary records. [2025-09-25T22:20:43.817374] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-25T22:20:43.852849] [DEBUG] [MAIN ] GIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:43.852983] [DEBUG] [LOCAL ] GIL: Derivative data saved (1807 records). [2025-09-25T22:20:43.868134] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-25T22:20:43.870638] [INFO ] [MAIN ] Derivative Progress: 739/2043 symbols completed. GIL took 1.3s. Estimated remaining: 9m 16s. Rate: 140.8 symbols/min [2025-09-25T22:20:43.867775] [INFO ] [MAIN ] GIS: Generated 1807 derivative records from 54065 primary records. [2025-09-25T22:20:43.872058] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:43.872178] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-25T22:20:43.871812] [DEBUG] [MAIN ] GKOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:43.873635] [INFO ] [MAIN ] GKOS: Generated 1807 derivative records from 43265 primary records. [2025-09-25T22:20:43.874480] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-25T22:20:43.905229] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1807 records). [2025-09-25T22:20:43.906236] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-25T22:20:43.909457] [INFO ] [MAIN ] Derivative Progress: 740/2043 symbols completed. GKOS took 1.3s. Estimated remaining: 9m 15s. Rate: 141.0 symbols/min [2025-09-25T22:20:43.910268] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:43.920593] [DEBUG] [LOCAL ] GIS: Derivative data saved (1807 records). [2025-09-25T22:20:43.920919] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-25T22:20:43.923620] [INFO ] [MAIN ] Derivative Progress: 741/2043 symbols completed. GIS took 1.3s. Estimated remaining: 9m 13s. Rate: 141.2 symbols/min [2025-09-25T22:20:43.924057] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:43.945011] [DEBUG] [LOCAL ] GLP: Loaded 9528 existing records from primary storage. [2025-09-25T22:20:43.945155] [INFO ] [MAIN ] GLP: Loaded 9528 primary data records. [2025-09-25T22:20:44.082126] [DEBUG] [LOCAL ] GL: Loaded 38157 existing records from primary storage. [2025-09-25T22:20:44.088023] [INFO ] [MAIN ] GL: Loaded 38157 primary data records. [2025-09-25T22:20:44.276047] [DEBUG] [LOCAL ] GLOB: Loaded 47734 existing records from primary storage. [2025-09-25T22:20:44.430440] [INFO ] [MAIN ] GLOB: Loaded 47734 primary data records. [2025-09-25T22:20:45.110794] [DEBUG] [MAIN ] GLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:45.112627] [INFO ] [MAIN ] GLP: Generated 1807 derivative records from 9528 primary records. [2025-09-25T22:20:45.113207] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-25T22:20:45.129297] [DEBUG] [MAIN ] GL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:45.130943] [INFO ] [MAIN ] GL: Generated 1807 derivative records from 38157 primary records. [2025-09-25T22:20:45.141406] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-25T22:20:45.191409] [DEBUG] [MAIN ] GLOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:45.192566] [DEBUG] [LOCAL ] GLP: Derivative data saved (1807 records). [2025-09-25T22:20:45.194768] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-25T22:20:45.194918] [INFO ] [MAIN ] GLOB: Generated 1807 derivative records from 47734 primary records. [2025-09-25T22:20:45.197723] [INFO ] [MAIN ] Derivative Progress: 742/2043 symbols completed. GLP took 1.3s. Estimated remaining: 9m 15s. Rate: 140.8 symbols/min [2025-09-25T22:20:45.200133] [DEBUG] [LOCAL ] GL: Derivative data saved (1807 records). [2025-09-25T22:20:45.197884] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-25T22:20:45.201020] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-25T22:20:45.201146] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:45.204951] [INFO ] [MAIN ] Derivative Progress: 743/2043 symbols completed. GL took 1.3s. Estimated remaining: 9m 13s. Rate: 141.0 symbols/min [2025-09-25T22:20:45.218856] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:45.237075] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1807 records). [2025-09-25T22:20:45.237349] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-25T22:20:45.241298] [INFO ] [MAIN ] Derivative Progress: 744/2043 symbols completed. GLOB took 1.3s. Estimated remaining: 9m 12s. Rate: 141.1 symbols/min [2025-09-25T22:20:45.241783] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:45.317365] [DEBUG] [LOCAL ] GLW: Loaded 54025 existing records from primary storage. [2025-09-25T22:20:45.335087] [INFO ] [MAIN ] GLW: Loaded 54025 primary data records. [2025-09-25T22:20:45.428806] [DEBUG] [LOCAL ] GM: Loaded 54118 existing records from primary storage. [2025-09-25T22:20:45.471432] [INFO ] [MAIN ] GM: Loaded 54118 primary data records. [2025-09-25T22:20:45.553267] [DEBUG] [LOCAL ] GME: Loaded 54151 existing records from primary storage. [2025-09-25T22:20:45.591938] [INFO ] [MAIN ] GME: Loaded 54151 primary data records. [2025-09-25T22:20:46.436829] [DEBUG] [MAIN ] GLW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:46.439738] [INFO ] [MAIN ] GLW: Generated 1807 derivative records from 54025 primary records. [2025-09-25T22:20:46.439844] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-25T22:20:46.461411] [DEBUG] [LOCAL ] GLW: Derivative data saved (1807 records). [2025-09-25T22:20:46.461565] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-25T22:20:46.473016] [INFO ] [MAIN ] Derivative Progress: 745/2043 symbols completed. GLW took 1.3s. Estimated remaining: 9m 13s. Rate: 140.8 symbols/min [2025-09-25T22:20:46.479048] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:46.479423] [DEBUG] [MAIN ] GM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:46.481564] [INFO ] [MAIN ] GM: Generated 1807 derivative records from 54118 primary records. [2025-09-25T22:20:46.482069] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-25T22:20:46.531439] [DEBUG] [LOCAL ] GM: Derivative data saved (1807 records). [2025-09-25T22:20:46.531916] [DEBUG] [MAIN ] GME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:46.532395] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-25T22:20:46.536724] [INFO ] [MAIN ] GME: Generated 1807 derivative records from 54151 primary records. [2025-09-25T22:20:46.535579] [INFO ] [MAIN ] Derivative Progress: 746/2043 symbols completed. GM took 1.3s. Estimated remaining: 9m 12s. Rate: 140.9 symbols/min [2025-09-25T22:20:46.537066] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-25T22:20:46.537593] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:46.568364] [DEBUG] [LOCAL ] GME: Derivative data saved (1807 records). [2025-09-25T22:20:46.568772] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-25T22:20:46.572581] [INFO ] [MAIN ] Derivative Progress: 747/2043 symbols completed. GME took 1.3s. Estimated remaining: 9m 11s. Rate: 141.1 symbols/min [2025-09-25T22:20:46.573195] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:46.593508] [DEBUG] [LOCAL ] GMED: Loaded 48718 existing records from primary storage. [2025-09-25T22:20:46.594176] [INFO ] [MAIN ] GMED: Loaded 48718 primary data records. [2025-09-25T22:20:46.730301] [DEBUG] [LOCAL ] GNE: Loaded 17844 existing records from primary storage. [2025-09-25T22:20:46.738824] [INFO ] [MAIN ] GNE: Loaded 17844 primary data records. [2025-09-25T22:20:46.827204] [DEBUG] [LOCAL ] GMRE: Loaded 37959 existing records from primary storage. [2025-09-25T22:20:46.873107] [INFO ] [MAIN ] GMRE: Loaded 37959 primary data records. [2025-09-25T22:20:47.761750] [DEBUG] [MAIN ] GMED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:47.762871] [INFO ] [MAIN ] GMED: Generated 1807 derivative records from 48718 primary records. [2025-09-25T22:20:47.763573] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-25T22:20:47.800398] [DEBUG] [LOCAL ] GMED: Derivative data saved (1807 records). [2025-09-25T22:20:47.800942] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-25T22:20:47.803127] [INFO ] [MAIN ] Derivative Progress: 748/2043 symbols completed. GMED took 1.3s. Estimated remaining: 9m 12s. Rate: 140.8 symbols/min [2025-09-25T22:20:47.800770] [DEBUG] [MAIN ] GNE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:47.804468] [INFO ] [MAIN ] GNE: Generated 1807 derivative records from 17844 primary records. [2025-09-25T22:20:47.804711] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-25T22:20:47.822246] [DEBUG] [LOCAL ] GNE: Derivative data saved (1807 records). [2025-09-25T22:20:47.823183] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-25T22:20:47.826472] [INFO ] [MAIN ] Derivative Progress: 749/2043 symbols completed. GNE took 1.3s. Estimated remaining: 9m 11s. Rate: 140.9 symbols/min [2025-09-25T22:20:47.839552] [DEBUG] [MAIN ] GMRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:47.840242] [INFO ] [MAIN ] GMRE: Generated 1807 derivative records from 37959 primary records. [2025-09-25T22:20:47.840305] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-25T22:20:47.856887] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1807 records). [2025-09-25T22:20:47.856995] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-25T22:20:47.859855] [INFO ] [MAIN ] Derivative Progress: 750/2043 symbols completed. GMRE took 1.3s. Estimated remaining: 9m 10s. Rate: 141.1 symbols/min [2025-09-25T22:20:47.860580] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:47.860902] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:47.861598] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:47.938107] [DEBUG] [LOCAL ] GNK: Loaded 40802 existing records from primary storage. [2025-09-25T22:20:47.938916] [INFO ] [MAIN ] GNK: Loaded 40802 primary data records. [2025-09-25T22:20:47.952824] [DEBUG] [LOCAL ] GNL: Loaded 47530 existing records from primary storage. [2025-09-25T22:20:47.970503] [INFO ] [MAIN ] GNL: Loaded 47530 primary data records. [2025-09-25T22:20:47.978236] [DEBUG] [LOCAL ] GNRC: Loaded 45546 existing records from primary storage. [2025-09-25T22:20:48.004081] [INFO ] [MAIN ] GNRC: Loaded 45546 primary data records. [2025-09-25T22:20:49.008333] [DEBUG] [MAIN ] GNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:49.014896] [INFO ] [MAIN ] GNK: Generated 1807 derivative records from 40802 primary records. [2025-09-25T22:20:49.015730] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-25T22:20:49.015556] [DEBUG] [MAIN ] GNRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:49.030925] [INFO ] [MAIN ] GNRC: Generated 1807 derivative records from 45546 primary records. [2025-09-25T22:20:49.031831] [DEBUG] [MAIN ] GNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:49.041023] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-25T22:20:49.046453] [INFO ] [MAIN ] GNL: Generated 1807 derivative records from 47530 primary records. [2025-09-25T22:20:49.046665] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-25T22:20:49.076803] [DEBUG] [LOCAL ] GNK: Derivative data saved (1807 records). [2025-09-25T22:20:49.078757] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-25T22:20:49.082078] [INFO ] [MAIN ] Derivative Progress: 751/2043 symbols completed. GNK took 1.2s. Estimated remaining: 9m 11s. Rate: 140.8 symbols/min [2025-09-25T22:20:49.084148] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:49.088416] [DEBUG] [LOCAL ] GNL: Derivative data saved (1807 records). [2025-09-25T22:20:49.089436] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-25T22:20:49.089331] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1807 records). [2025-09-25T22:20:49.092324] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-25T22:20:49.092216] [INFO ] [MAIN ] Derivative Progress: 752/2043 symbols completed. GNL took 1.2s. Estimated remaining: 9m 10s. Rate: 140.9 symbols/min [2025-09-25T22:20:49.099495] [INFO ] [MAIN ] Derivative Progress: 753/2043 symbols completed. GNRC took 1.2s. Estimated remaining: 9m 8s. Rate: 141.1 symbols/min [2025-09-25T22:20:49.099705] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:49.100634] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:49.105038] [DEBUG] [LOCAL ] GNT: Loaded 8105 existing records from primary storage. [2025-09-25T22:20:49.105725] [INFO ] [MAIN ] GNT: Loaded 8105 primary data records. [2025-09-25T22:20:49.193704] [DEBUG] [LOCAL ] GNTY: Loaded 7283 existing records from primary storage. [2025-09-25T22:20:49.205166] [INFO ] [MAIN ] GNTY: Loaded 7283 primary data records. [2025-09-25T22:20:49.698588] [DEBUG] [LOCAL ] GNW: Loaded 51708 existing records from primary storage. [2025-09-25T22:20:49.783130] [INFO ] [MAIN ] GNW: Loaded 51708 primary data records. [2025-09-25T22:20:50.222953] [DEBUG] [MAIN ] GNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:50.224439] [INFO ] [MAIN ] GNT: Generated 1807 derivative records from 8105 primary records. [2025-09-25T22:20:50.237902] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-25T22:20:50.237782] [DEBUG] [MAIN ] GNTY: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:50.238870] [INFO ] [MAIN ] GNTY: Generated 1806 derivative records from 7283 primary records. [2025-09-25T22:20:50.240882] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-25T22:20:50.273083] [DEBUG] [LOCAL ] GNT: Derivative data saved (1807 records). [2025-09-25T22:20:50.273003] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1806 records). [2025-09-25T22:20:50.273256] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-25T22:20:50.273450] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-25T22:20:50.275529] [INFO ] [MAIN ] Derivative Progress: 754/2043 symbols completed. GNT took 1.2s. Estimated remaining: 9m 9s. Rate: 140.8 symbols/min [2025-09-25T22:20:50.276870] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:50.279587] [INFO ] [MAIN ] Derivative Progress: 755/2043 symbols completed. GNTY took 1.2s. Estimated remaining: 9m 8s. Rate: 141.0 symbols/min [2025-09-25T22:20:50.281919] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:50.296316] [DEBUG] [MAIN ] GNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:50.297292] [INFO ] [MAIN ] GNW: Generated 1807 derivative records from 51708 primary records. [2025-09-25T22:20:50.297469] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-25T22:20:50.314546] [DEBUG] [LOCAL ] GNW: Derivative data saved (1807 records). [2025-09-25T22:20:50.314703] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-25T22:20:50.317213] [INFO ] [MAIN ] Derivative Progress: 756/2043 symbols completed. GNW took 1.2s. Estimated remaining: 9m 7s. Rate: 141.1 symbols/min [2025-09-25T22:20:50.317701] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:50.358574] [DEBUG] [LOCAL ] GOLF: Loaded 31843 existing records from primary storage. [2025-09-25T22:20:50.358856] [INFO ] [MAIN ] GOLF: Loaded 31843 primary data records. [2025-09-25T22:20:50.494021] [DEBUG] [LOCAL ] GOF: Loaded 43105 existing records from primary storage. [2025-09-25T22:20:50.494312] [INFO ] [MAIN ] GOF: Loaded 43105 primary data records. [2025-09-25T22:20:50.820935] [DEBUG] [LOCAL ] GOOS: Loaded 45704 existing records from primary storage. [2025-09-25T22:20:50.861024] [INFO ] [MAIN ] GOOS: Loaded 45704 primary data records. [2025-09-25T22:20:51.428113] [DEBUG] [MAIN ] GOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:51.429870] [INFO ] [MAIN ] GOLF: Generated 1807 derivative records from 31843 primary records. [2025-09-25T22:20:51.429999] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-25T22:20:51.465869] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1807 records). [2025-09-25T22:20:51.465587] [DEBUG] [MAIN ] GOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:51.466851] [INFO ] [MAIN ] GOF: Generated 1807 derivative records from 43105 primary records. [2025-09-25T22:20:51.466982] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-25T22:20:51.469422] [INFO ] [MAIN ] Derivative Progress: 757/2043 symbols completed. GOLF took 1.2s. Estimated remaining: 9m 8s. Rate: 140.8 symbols/min [2025-09-25T22:20:51.470142] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:51.469680] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-25T22:20:51.489052] [DEBUG] [LOCAL ] GOF: Derivative data saved (1807 records). [2025-09-25T22:20:51.489577] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-25T22:20:51.493291] [INFO ] [MAIN ] Derivative Progress: 758/2043 symbols completed. GOF took 1.2s. Estimated remaining: 9m 7s. Rate: 141.0 symbols/min [2025-09-25T22:20:51.493689] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:51.510719] [DEBUG] [MAIN ] GOOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:51.511818] [INFO ] [MAIN ] GOOS: Generated 1807 derivative records from 45704 primary records. [2025-09-25T22:20:51.512027] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-25T22:20:51.539216] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1807 records). [2025-09-25T22:20:51.539405] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-25T22:20:51.541989] [INFO ] [MAIN ] Derivative Progress: 759/2043 symbols completed. GOOS took 1.2s. Estimated remaining: 9m 6s. Rate: 141.2 symbols/min [2025-09-25T22:20:51.542418] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:51.558561] [DEBUG] [LOCAL ] GOTU: Loaded 39241 existing records from primary storage. [2025-09-25T22:20:51.559054] [INFO ] [MAIN ] GOTU: Loaded 39241 primary data records. [2025-09-25T22:20:51.667606] [DEBUG] [LOCAL ] GPI: Loaded 15035 existing records from primary storage. [2025-09-25T22:20:51.698225] [INFO ] [MAIN ] GPI: Loaded 15035 primary data records. [2025-09-25T22:20:52.097820] [DEBUG] [LOCAL ] GPC: Loaded 46980 existing records from primary storage. [2025-09-25T22:20:52.115250] [INFO ] [MAIN ] GPC: Loaded 46980 primary data records. [2025-09-25T22:20:52.660847] [DEBUG] [MAIN ] GOTU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:52.663169] [INFO ] [MAIN ] GOTU: Generated 1807 derivative records from 39241 primary records. [2025-09-25T22:20:52.663386] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-25T22:20:52.684812] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1807 records). [2025-09-25T22:20:52.685432] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-25T22:20:52.688075] [INFO ] [MAIN ] Derivative Progress: 760/2043 symbols completed. GOTU took 1.2s. Estimated remaining: 9m 7s. Rate: 140.9 symbols/min [2025-09-25T22:20:52.688561] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:52.707701] [DEBUG] [MAIN ] GPI: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:20:52.708986] [INFO ] [MAIN ] GPI: Generated 1806 derivative records from 15035 primary records. [2025-09-25T22:20:52.709206] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-25T22:20:52.724983] [DEBUG] [LOCAL ] GPJA: Loaded 4119 existing records from primary storage. [2025-09-25T22:20:52.725956] [DEBUG] [MAIN ] GPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:52.726058] [INFO ] [MAIN ] GPJA: Loaded 4119 primary data records. [2025-09-25T22:20:52.734551] [INFO ] [MAIN ] GPC: Generated 1807 derivative records from 46980 primary records. [2025-09-25T22:20:52.747412] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-25T22:20:52.820583] [DEBUG] [LOCAL ] GPI: Derivative data saved (1806 records). [2025-09-25T22:20:52.834559] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-25T22:20:52.841793] [INFO ] [MAIN ] Derivative Progress: 761/2043 symbols completed. GPI took 1.3s. Estimated remaining: 9m 6s. Rate: 141.0 symbols/min [2025-09-25T22:20:52.864496] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:52.865124] [DEBUG] [LOCAL ] GPC: Derivative data saved (1807 records). [2025-09-25T22:20:52.865766] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-25T22:20:52.882161] [INFO ] [MAIN ] Derivative Progress: 762/2043 symbols completed. GPC took 1.4s. Estimated remaining: 9m 5s. Rate: 141.1 symbols/min [2025-09-25T22:20:52.893451] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:53.112556] [DEBUG] [LOCAL ] GPMT: Loaded 26703 existing records from primary storage. [2025-09-25T22:20:53.112897] [INFO ] [MAIN ] GPMT: Loaded 26703 primary data records. [2025-09-25T22:20:53.318681] [DEBUG] [LOCAL ] GPK: Loaded 53051 existing records from primary storage. [2025-09-25T22:20:53.329851] [INFO ] [MAIN ] GPK: Loaded 53051 primary data records. [2025-09-25T22:20:53.648856] [DEBUG] [MAIN ] GPJA: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:20:53.650499] [INFO ] [MAIN ] GPJA: Generated 1805 derivative records from 4119 primary records. [2025-09-25T22:20:53.651056] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-25T22:20:53.754038] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1805 records). [2025-09-25T22:20:53.922451] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-25T22:20:53.938502] [INFO ] [MAIN ] Derivative Progress: 763/2043 symbols completed. GPJA took 1.3s. Estimated remaining: 9m 5s. Rate: 140.9 symbols/min [2025-09-25T22:20:53.961795] [DEBUG] [MAIN ] GPMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:53.962555] [INFO ] [MAIN ] GPMT: Generated 1807 derivative records from 26703 primary records. [2025-09-25T22:20:53.962768] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-25T22:20:53.979948] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1807 records). [2025-09-25T22:20:53.980239] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-25T22:20:53.982679] [INFO ] [MAIN ] Derivative Progress: 764/2043 symbols completed. GPMT took 1.1s. Estimated remaining: 9m 4s. Rate: 141.0 symbols/min [2025-09-25T22:20:53.998351] [DEBUG] [MAIN ] GPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:53.999038] [INFO ] [MAIN ] GPK: Generated 1807 derivative records from 53051 primary records. [2025-09-25T22:20:53.999101] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-25T22:20:54.015029] [DEBUG] [LOCAL ] GPK: Derivative data saved (1807 records). [2025-09-25T22:20:54.015097] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-25T22:20:54.017785] [INFO ] [MAIN ] Derivative Progress: 765/2043 symbols completed. GPK took 1.2s. Estimated remaining: 9m 3s. Rate: 141.2 symbols/min [2025-09-25T22:20:54.018487] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:54.018614] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:54.018813] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:54.053270] [DEBUG] [LOCAL ] GPOR: Loaded 23115 existing records from primary storage. [2025-09-25T22:20:54.053413] [INFO ] [MAIN ] GPOR: Loaded 23115 primary data records. [2025-09-25T22:20:54.197148] [DEBUG] [LOCAL ] GPRK: Loaded 39489 existing records from primary storage. [2025-09-25T22:20:54.223122] [INFO ] [MAIN ] GPRK: Loaded 39489 primary data records. [2025-09-25T22:20:54.254997] [DEBUG] [LOCAL ] GPN: Loaded 52461 existing records from primary storage. [2025-09-25T22:20:54.330333] [INFO ] [MAIN ] GPN: Loaded 52461 primary data records. [2025-09-25T22:20:55.086193] [DEBUG] [MAIN ] GPOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:55.087942] [INFO ] [MAIN ] GPOR: Generated 1807 derivative records from 23115 primary records. [2025-09-25T22:20:55.089444] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-25T22:20:55.121418] [DEBUG] [MAIN ] GPRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:55.127214] [INFO ] [MAIN ] GPRK: Generated 1807 derivative records from 39489 primary records. [2025-09-25T22:20:55.127470] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1807 records). [2025-09-25T22:20:55.127692] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-25T22:20:55.129045] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-25T22:20:55.131441] [INFO ] [MAIN ] Derivative Progress: 766/2043 symbols completed. GPOR took 1.1s. Estimated remaining: 9m 4s. Rate: 140.9 symbols/min [2025-09-25T22:20:55.155348] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:55.157145] [DEBUG] [MAIN ] GPN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:55.159685] [INFO ] [MAIN ] GPN: Generated 1807 derivative records from 52461 primary records. [2025-09-25T22:20:55.160466] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-25T22:20:55.180517] [DEBUG] [LOCAL ] GPN: Derivative data saved (1807 records). [2025-09-25T22:20:55.180885] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-25T22:20:55.183563] [INFO ] [MAIN ] Derivative Progress: 767/2043 symbols completed. GPN took 1.2s. Estimated remaining: 9m 3s. Rate: 141.1 symbols/min [2025-09-25T22:20:55.180769] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1807 records). [2025-09-25T22:20:55.184123] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:55.184035] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-25T22:20:55.187967] [INFO ] [MAIN ] Derivative Progress: 768/2043 symbols completed. GPRK took 1.2s. Estimated remaining: 9m 2s. Rate: 141.2 symbols/min [2025-09-25T22:20:55.188417] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:55.215061] [DEBUG] [LOCAL ] GRC: Loaded 8993 existing records from primary storage. [2025-09-25T22:20:55.216237] [INFO ] [MAIN ] GRC: Loaded 8993 primary data records. [2025-09-25T22:20:55.233700] [DEBUG] [LOCAL ] GRBK: Loaded 27195 existing records from primary storage. [2025-09-25T22:20:55.268262] [INFO ] [MAIN ] GRBK: Loaded 27195 primary data records. [2025-09-25T22:20:55.367772] [DEBUG] [LOCAL ] GRDN: Loaded 19994 existing records from primary storage. [2025-09-25T22:20:55.429089] [INFO ] [MAIN ] GRDN: Loaded 19994 primary data records. [2025-09-25T22:20:56.295382] [DEBUG] [MAIN ] GRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:56.296620] [INFO ] [MAIN ] GRC: Generated 1807 derivative records from 8993 primary records. [2025-09-25T22:20:56.301007] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-25T22:20:56.349739] [DEBUG] [LOCAL ] GRC: Derivative data saved (1807 records). [2025-09-25T22:20:56.350383] [DEBUG] [MAIN ] GRBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:56.328928] [DEBUG] [MAIN ] GRDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:56.351320] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-25T22:20:56.351250] [INFO ] [MAIN ] GRBK: Generated 1807 derivative records from 27195 primary records. [2025-09-25T22:20:56.352265] [INFO ] [MAIN ] GRDN: Generated 1807 derivative records from 19994 primary records. [2025-09-25T22:20:56.352463] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-25T22:20:56.355924] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-25T22:20:56.354738] [INFO ] [MAIN ] Derivative Progress: 769/2043 symbols completed. GRC took 1.2s. Estimated remaining: 9m 2s. Rate: 140.9 symbols/min [2025-09-25T22:20:56.368616] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:56.399091] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1807 records). [2025-09-25T22:20:56.399228] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-25T22:20:56.398277] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1807 records). [2025-09-25T22:20:56.401869] [INFO ] [MAIN ] Derivative Progress: 770/2043 symbols completed. GRDN took 1.2s. Estimated remaining: 9m 1s. Rate: 141.1 symbols/min [2025-09-25T22:20:56.402440] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:56.403108] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-25T22:20:56.406401] [INFO ] [MAIN ] Derivative Progress: 771/2043 symbols completed. GRBK took 1.3s. Estimated remaining: 9m 0s. Rate: 141.3 symbols/min [2025-09-25T22:20:56.407036] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:56.463866] [DEBUG] [LOCAL ] GRMN: Loaded 41576 existing records from primary storage. [2025-09-25T22:20:56.464187] [INFO ] [MAIN ] GRMN: Loaded 41576 primary data records. [2025-09-25T22:20:56.638800] [DEBUG] [LOCAL ] GRNT: Loaded 34006 existing records from primary storage. [2025-09-25T22:20:56.654927] [DEBUG] [LOCAL ] GRND: Loaded 50356 existing records from primary storage. [2025-09-25T22:20:56.652504] [INFO ] [MAIN ] GRNT: Loaded 34006 primary data records. [2025-09-25T22:20:56.655303] [INFO ] [MAIN ] GRND: Loaded 50356 primary data records. [2025-09-25T22:20:57.575315] [DEBUG] [MAIN ] GRMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:57.576415] [INFO ] [MAIN ] GRMN: Generated 1807 derivative records from 41576 primary records. [2025-09-25T22:20:57.576973] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-25T22:20:57.600352] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1807 records). [2025-09-25T22:20:57.614248] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-25T22:20:57.622810] [DEBUG] [MAIN ] GRND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:57.631232] [INFO ] [MAIN ] Derivative Progress: 772/2043 symbols completed. GRMN took 1.3s. Estimated remaining: 9m 1s. Rate: 140.9 symbols/min [2025-09-25T22:20:57.629072] [INFO ] [MAIN ] GRND: Generated 1807 derivative records from 50356 primary records. [2025-09-25T22:20:57.632185] [DEBUG] [MAIN ] GRNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:57.631793] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-25T22:20:57.632282] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:57.633247] [INFO ] [MAIN ] GRNT: Generated 1807 derivative records from 34006 primary records. [2025-09-25T22:20:57.633635] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-25T22:20:57.669012] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1807 records). [2025-09-25T22:20:57.665673] [DEBUG] [LOCAL ] GRND: Derivative data saved (1807 records). [2025-09-25T22:20:57.669235] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-25T22:20:57.673301] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-25T22:20:57.676061] [INFO ] [MAIN ] Derivative Progress: 773/2043 symbols completed. GRND took 1.3s. Estimated remaining: 9m 0s. Rate: 141.1 symbols/min [2025-09-25T22:20:57.679232] [INFO ] [MAIN ] Derivative Progress: 774/2043 symbols completed. GRNT took 1.3s. Estimated remaining: 8m 59s. Rate: 141.3 symbols/min [2025-09-25T22:20:57.679171] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:57.679927] [DEBUG] [LOCAL ] GROV: Loaded 9156 existing records from primary storage. [2025-09-25T22:20:57.680114] [INFO ] [MAIN ] GROV: Loaded 9156 primary data records. [2025-09-25T22:20:57.680291] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:57.766792] [DEBUG] [LOCAL ] GRX: Loaded 4508 existing records from primary storage. [2025-09-25T22:20:57.799043] [INFO ] [MAIN ] GRX: Loaded 4508 primary data records. [2025-09-25T22:20:58.406685] [DEBUG] [LOCAL ] GS: Loaded 52395 existing records from primary storage. [2025-09-25T22:20:58.408969] [INFO ] [MAIN ] GS: Loaded 52395 primary data records. [2025-09-25T22:20:58.757255] [DEBUG] [MAIN ] GROV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:58.759043] [INFO ] [MAIN ] GROV: Generated 1807 derivative records from 9156 primary records. [2025-09-25T22:20:58.759765] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-25T22:20:58.788143] [DEBUG] [MAIN ] GRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:58.789857] [INFO ] [MAIN ] GRX: Generated 1807 derivative records from 4508 primary records. [2025-09-25T22:20:58.790341] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-25T22:20:58.812353] [DEBUG] [LOCAL ] GRX: Derivative data saved (1807 records). [2025-09-25T22:20:58.813229] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-25T22:20:58.813163] [DEBUG] [LOCAL ] GROV: Derivative data saved (1807 records). [2025-09-25T22:20:58.813389] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-25T22:20:58.815987] [INFO ] [MAIN ] Derivative Progress: 775/2043 symbols completed. GRX took 1.1s. Estimated remaining: 8m 60s. Rate: 141.0 symbols/min [2025-09-25T22:20:58.818854] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:58.819265] [INFO ] [MAIN ] Derivative Progress: 776/2043 symbols completed. GROV took 1.2s. Estimated remaining: 8m 59s. Rate: 141.1 symbols/min [2025-09-25T22:20:58.819963] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:58.839396] [DEBUG] [MAIN ] GS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:58.840231] [INFO ] [MAIN ] GS: Generated 1807 derivative records from 52395 primary records. [2025-09-25T22:20:58.840383] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-25T22:20:58.862899] [DEBUG] [LOCAL ] GS: Derivative data saved (1807 records). [2025-09-25T22:20:58.863186] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-25T22:20:58.865793] [INFO ] [MAIN ] Derivative Progress: 777/2043 symbols completed. GS took 1.2s. Estimated remaining: 8m 58s. Rate: 141.3 symbols/min [2025-09-25T22:20:58.875494] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:20:58.908411] [DEBUG] [LOCAL ] GSBD: Loaded 39474 existing records from primary storage. [2025-09-25T22:20:58.908692] [INFO ] [MAIN ] GSBD: Loaded 39474 primary data records. [2025-09-25T22:20:59.060686] [DEBUG] [LOCAL ] GSK: Loaded 53882 existing records from primary storage. [2025-09-25T22:20:59.073118] [DEBUG] [LOCAL ] GSL: Loaded 33647 existing records from primary storage. [2025-09-25T22:20:59.083685] [INFO ] [MAIN ] GSL: Loaded 33647 primary data records. [2025-09-25T22:20:59.088939] [INFO ] [MAIN ] GSK: Loaded 53882 primary data records. [2025-09-25T22:20:59.959095] [DEBUG] [MAIN ] GSBD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:20:59.960228] [INFO ] [MAIN ] GSBD: Generated 1807 derivative records from 39474 primary records. [2025-09-25T22:20:59.960493] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-25T22:20:59.980455] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1807 records). [2025-09-25T22:20:59.981240] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-25T22:20:59.984665] [INFO ] [MAIN ] Derivative Progress: 778/2043 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 58s. Rate: 141.0 symbols/min [2025-09-25T22:21:00.001490] [DEBUG] [MAIN ] GSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:00.002773] [INFO ] [MAIN ] GSL: Generated 1807 derivative records from 33647 primary records. [2025-09-25T22:21:00.003049] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-25T22:21:00.022968] [DEBUG] [LOCAL ] GSL: Derivative data saved (1807 records). [2025-09-25T22:21:00.036234] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-25T22:21:00.038724] [INFO ] [MAIN ] Derivative Progress: 779/2043 symbols completed. GSL took 1.2s. Estimated remaining: 8m 57s. Rate: 141.2 symbols/min [2025-09-25T22:21:00.036149] [DEBUG] [MAIN ] GSK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:00.039747] [INFO ] [MAIN ] GSK: Generated 1807 derivative records from 53882 primary records. [2025-09-25T22:21:00.039847] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-25T22:21:00.056349] [DEBUG] [LOCAL ] GSK: Derivative data saved (1807 records). [2025-09-25T22:21:00.056449] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-25T22:21:00.061319] [INFO ] [MAIN ] Derivative Progress: 780/2043 symbols completed. GSK took 1.2s. Estimated remaining: 8m 56s. Rate: 141.3 symbols/min [2025-09-25T22:21:00.062024] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:00.062180] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:00.062731] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:00.165807] [DEBUG] [LOCAL ] GTES: Loaded 51024 existing records from primary storage. [2025-09-25T22:21:00.166858] [INFO ] [MAIN ] GTES: Loaded 51024 primary data records. [2025-09-25T22:21:00.166597] [DEBUG] [LOCAL ] GTN: Loaded 46009 existing records from primary storage. [2025-09-25T22:21:00.174339] [INFO ] [MAIN ] GTN: Loaded 46009 primary data records. [2025-09-25T22:21:00.220750] [DEBUG] [LOCAL ] GTLS: Loaded 43161 existing records from primary storage. [2025-09-25T22:21:00.304297] [INFO ] [MAIN ] GTLS: Loaded 43161 primary data records. [2025-09-25T22:21:01.244070] [DEBUG] [MAIN ] GTES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:01.253337] [INFO ] [MAIN ] GTES: Generated 1807 derivative records from 51024 primary records. [2025-09-25T22:21:01.253607] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-25T22:21:01.280560] [DEBUG] [MAIN ] GTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:01.272953] [DEBUG] [MAIN ] GTLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:01.281611] [INFO ] [MAIN ] GTN: Generated 1807 derivative records from 46009 primary records. [2025-09-25T22:21:01.286884] [INFO ] [MAIN ] GTLS: Generated 1807 derivative records from 43161 primary records. [2025-09-25T22:21:01.286102] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-25T22:21:01.288185] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-25T22:21:01.322672] [DEBUG] [LOCAL ] GTN: Derivative data saved (1807 records). [2025-09-25T22:21:01.302037] [DEBUG] [LOCAL ] GTES: Derivative data saved (1807 records). [2025-09-25T22:21:01.324117] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-25T22:21:01.329422] [INFO ] [MAIN ] Derivative Progress: 781/2043 symbols completed. GTN took 1.3s. Estimated remaining: 8m 57s. Rate: 141.0 symbols/min [2025-09-25T22:21:01.324224] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-25T22:21:01.330041] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1807 records). [2025-09-25T22:21:01.334017] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:01.333885] [INFO ] [MAIN ] Derivative Progress: 782/2043 symbols completed. GTES took 1.3s. Estimated remaining: 8m 56s. Rate: 141.2 symbols/min [2025-09-25T22:21:01.334178] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-25T22:21:01.339253] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:01.339162] [INFO ] [MAIN ] Derivative Progress: 783/2043 symbols completed. GTLS took 1.3s. Estimated remaining: 8m 55s. Rate: 141.3 symbols/min [2025-09-25T22:21:01.340717] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:01.360192] [DEBUG] [LOCAL ] GUG: Loaded 12087 existing records from primary storage. [2025-09-25T22:21:01.360436] [INFO ] [MAIN ] GUG: Loaded 12087 primary data records. [2025-09-25T22:21:01.501338] [DEBUG] [LOCAL ] GTY: Loaded 30597 existing records from primary storage. [2025-09-25T22:21:01.502010] [INFO ] [MAIN ] GTY: Loaded 30597 primary data records. [2025-09-25T22:21:01.733116] [DEBUG] [LOCAL ] GVA: Loaded 33882 existing records from primary storage. [2025-09-25T22:21:01.825808] [INFO ] [MAIN ] GVA: Loaded 33882 primary data records. [2025-09-25T22:21:02.467240] [DEBUG] [MAIN ] GUG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:02.468777] [INFO ] [MAIN ] GUG: Generated 1807 derivative records from 12087 primary records. [2025-09-25T22:21:02.469190] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-25T22:21:02.492956] [DEBUG] [LOCAL ] GUG: Derivative data saved (1807 records). [2025-09-25T22:21:02.493704] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-25T22:21:02.496137] [INFO ] [MAIN ] Derivative Progress: 784/2043 symbols completed. GUG took 1.2s. Estimated remaining: 8m 56s. Rate: 141.0 symbols/min [2025-09-25T22:21:02.505352] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:02.511561] [DEBUG] [MAIN ] GTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:02.512836] [INFO ] [MAIN ] GTY: Generated 1807 derivative records from 30597 primary records. [2025-09-25T22:21:02.513281] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-25T22:21:02.539932] [DEBUG] [LOCAL ] GTY: Derivative data saved (1807 records). [2025-09-25T22:21:02.540522] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-25T22:21:02.543059] [INFO ] [MAIN ] Derivative Progress: 785/2043 symbols completed. GTY took 1.2s. Estimated remaining: 8m 55s. Rate: 141.2 symbols/min [2025-09-25T22:21:02.551842] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:02.557299] [DEBUG] [MAIN ] GVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:02.565354] [INFO ] [MAIN ] GVA: Generated 1807 derivative records from 33882 primary records. [2025-09-25T22:21:02.566174] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-25T22:21:02.566054] [DEBUG] [LOCAL ] GWH: Loaded 15688 existing records from primary storage. [2025-09-25T22:21:02.566952] [INFO ] [MAIN ] GWH: Loaded 15688 primary data records. [2025-09-25T22:21:02.668082] [DEBUG] [LOCAL ] GVA: Derivative data saved (1807 records). [2025-09-25T22:21:02.690312] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-25T22:21:02.732507] [INFO ] [MAIN ] Derivative Progress: 786/2043 symbols completed. GVA took 1.4s. Estimated remaining: 8m 54s. Rate: 141.3 symbols/min [2025-09-25T22:21:02.743949] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:02.977530] [DEBUG] [LOCAL ] GWRE: Loaded 41257 existing records from primary storage. [2025-09-25T22:21:02.987130] [INFO ] [MAIN ] GWRE: Loaded 41257 primary data records. [2025-09-25T22:21:03.119504] [DEBUG] [LOCAL ] GWW: Loaded 20010 existing records from primary storage. [2025-09-25T22:21:03.119969] [INFO ] [MAIN ] GWW: Loaded 20010 primary data records. [2025-09-25T22:21:03.679817] [DEBUG] [MAIN ] GWH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:03.680698] [INFO ] [MAIN ] GWH: Generated 1807 derivative records from 15688 primary records. [2025-09-25T22:21:03.681056] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-25T22:21:03.702956] [DEBUG] [LOCAL ] GWH: Derivative data saved (1807 records). [2025-09-25T22:21:03.711446] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-25T22:21:03.718701] [INFO ] [MAIN ] Derivative Progress: 787/2043 symbols completed. GWH took 1.2s. Estimated remaining: 8m 54s. Rate: 141.0 symbols/min [2025-09-25T22:21:03.720197] [DEBUG] [MAIN ] GWRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:03.719806] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:03.721355] [INFO ] [MAIN ] GWRE: Generated 1807 derivative records from 41257 primary records. [2025-09-25T22:21:03.721969] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-25T22:21:03.756127] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1807 records). [2025-09-25T22:21:03.755100] [DEBUG] [MAIN ] GWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:03.756319] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-25T22:21:03.758840] [INFO ] [MAIN ] Derivative Progress: 788/2043 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 53s. Rate: 141.2 symbols/min [2025-09-25T22:21:03.759786] [INFO ] [MAIN ] GWW: Generated 1807 derivative records from 20010 primary records. [2025-09-25T22:21:03.759990] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-25T22:21:03.761116] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:03.778454] [DEBUG] [LOCAL ] GWW: Derivative data saved (1807 records). [2025-09-25T22:21:03.778563] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-25T22:21:03.781440] [INFO ] [MAIN ] Derivative Progress: 789/2043 symbols completed. GWW took 1.0s. Estimated remaining: 8m 52s. Rate: 141.4 symbols/min [2025-09-25T22:21:03.782053] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:03.785431] [DEBUG] [LOCAL ] GYLD: Loaded 1558 existing records from primary storage. [2025-09-25T22:21:03.796304] [INFO ] [MAIN ] GYLD: Loaded 1558 primary data records. [2025-09-25T22:21:03.919921] [DEBUG] [LOCAL ] GXO: Loaded 47927 existing records from primary storage. [2025-09-25T22:21:03.933525] [INFO ] [MAIN ] GXO: Loaded 47927 primary data records. [2025-09-25T22:21:04.358962] [DEBUG] [LOCAL ] H: Loaded 45216 existing records from primary storage. [2025-09-25T22:21:04.492636] [INFO ] [MAIN ] H: Loaded 45216 primary data records. [2025-09-25T22:21:04.907847] [DEBUG] [MAIN ] GYLD: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:21:04.910347] [INFO ] [MAIN ] GYLD: Generated 1805 derivative records from 1558 primary records. [2025-09-25T22:21:04.911073] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-25T22:21:04.928945] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1805 records). [2025-09-25T22:21:04.929255] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-25T22:21:04.944514] [INFO ] [MAIN ] Derivative Progress: 790/2043 symbols completed. GYLD took 1.2s. Estimated remaining: 8m 53s. Rate: 141.1 symbols/min [2025-09-25T22:21:04.947035] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:04.946813] [DEBUG] [MAIN ] GXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:04.948581] [INFO ] [MAIN ] GXO: Generated 1807 derivative records from 47927 primary records. [2025-09-25T22:21:04.948789] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-25T22:21:04.967600] [DEBUG] [LOCAL ] GXO: Derivative data saved (1807 records). [2025-09-25T22:21:04.967966] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-25T22:21:04.970541] [INFO ] [MAIN ] Derivative Progress: 791/2043 symbols completed. GXO took 1.3s. Estimated remaining: 8m 52s. Rate: 141.2 symbols/min [2025-09-25T22:21:04.971027] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:04.987849] [DEBUG] [MAIN ] H: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:04.988711] [INFO ] [MAIN ] H: Generated 1807 derivative records from 45216 primary records. [2025-09-25T22:21:04.988901] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-25T22:21:05.015934] [DEBUG] [LOCAL ] H: Derivative data saved (1807 records). [2025-09-25T22:21:05.016177] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-25T22:21:05.019210] [INFO ] [MAIN ] Derivative Progress: 792/2043 symbols completed. H took 1.2s. Estimated remaining: 8m 51s. Rate: 141.4 symbols/min [2025-09-25T22:21:05.019683] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:05.035820] [DEBUG] [LOCAL ] HAE: Loaded 39857 existing records from primary storage. [2025-09-25T22:21:05.036071] [INFO ] [MAIN ] HAE: Loaded 39857 primary data records. [2025-09-25T22:21:05.181216] [DEBUG] [LOCAL ] HAFN: Loaded 43874 existing records from primary storage. [2025-09-25T22:21:05.202260] [INFO ] [MAIN ] HAFN: Loaded 43874 primary data records. [2025-09-25T22:21:05.559532] [DEBUG] [LOCAL ] HAL: Loaded 54108 existing records from primary storage. [2025-09-25T22:21:05.599569] [INFO ] [MAIN ] HAL: Loaded 54108 primary data records. [2025-09-25T22:21:06.110839] [DEBUG] [MAIN ] HAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:06.112269] [INFO ] [MAIN ] HAE: Generated 1807 derivative records from 39857 primary records. [2025-09-25T22:21:06.112718] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-25T22:21:06.134198] [DEBUG] [LOCAL ] HAE: Derivative data saved (1807 records). [2025-09-25T22:21:06.136676] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-25T22:21:06.139736] [INFO ] [MAIN ] Derivative Progress: 793/2043 symbols completed. HAE took 1.2s. Estimated remaining: 8m 52s. Rate: 141.1 symbols/min [2025-09-25T22:21:06.155616] [DEBUG] [MAIN ] HAFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:06.156854] [INFO ] [MAIN ] HAFN: Generated 1807 derivative records from 43874 primary records. [2025-09-25T22:21:06.157089] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-25T22:21:06.174238] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1807 records). [2025-09-25T22:21:06.174411] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-25T22:21:06.177486] [INFO ] [MAIN ] Derivative Progress: 794/2043 symbols completed. HAFN took 1.2s. Estimated remaining: 8m 50s. Rate: 141.3 symbols/min [2025-09-25T22:21:06.201724] [DEBUG] [MAIN ] HAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:06.202667] [INFO ] [MAIN ] HAL: Generated 1807 derivative records from 54108 primary records. [2025-09-25T22:21:06.202748] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-25T22:21:06.220687] [DEBUG] [LOCAL ] HAL: Derivative data saved (1807 records). [2025-09-25T22:21:06.220851] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-25T22:21:06.224219] [INFO ] [MAIN ] Derivative Progress: 795/2043 symbols completed. HAL took 1.2s. Estimated remaining: 8m 49s. Rate: 141.4 symbols/min [2025-09-25T22:21:06.225108] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:06.225533] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:06.225274] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:06.239152] [DEBUG] [LOCAL ] HBB: Loaded 6893 existing records from primary storage. [2025-09-25T22:21:06.239365] [INFO ] [MAIN ] HBB: Loaded 6893 primary data records. [2025-09-25T22:21:06.612452] [DEBUG] [LOCAL ] HASI: Loaded 47537 existing records from primary storage. [2025-09-25T22:21:06.612784] [INFO ] [MAIN ] HASI: Loaded 47537 primary data records. [2025-09-25T22:21:06.614207] [DEBUG] [LOCAL ] HAYW: Loaded 49080 existing records from primary storage. [2025-09-25T22:21:06.637620] [INFO ] [MAIN ] HAYW: Loaded 49080 primary data records. [2025-09-25T22:21:07.367472] [DEBUG] [MAIN ] HBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:07.368439] [INFO ] [MAIN ] HBB: Generated 1807 derivative records from 6893 primary records. [2025-09-25T22:21:07.368850] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-25T22:21:07.386931] [DEBUG] [LOCAL ] HBB: Derivative data saved (1807 records). [2025-09-25T22:21:07.387332] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-25T22:21:07.390162] [INFO ] [MAIN ] Derivative Progress: 796/2043 symbols completed. HBB took 1.2s. Estimated remaining: 8m 50s. Rate: 141.1 symbols/min [2025-09-25T22:21:07.390609] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:07.412565] [DEBUG] [MAIN ] HASI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:07.414471] [INFO ] [MAIN ] HASI: Generated 1807 derivative records from 47537 primary records. [2025-09-25T22:21:07.414690] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-25T22:21:07.445064] [DEBUG] [MAIN ] HAYW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:07.451151] [DEBUG] [LOCAL ] HASI: Derivative data saved (1807 records). [2025-09-25T22:21:07.450495] [INFO ] [MAIN ] HAYW: Generated 1807 derivative records from 49080 primary records. [2025-09-25T22:21:07.451296] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-25T22:21:07.451428] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-25T22:21:07.453937] [INFO ] [MAIN ] Derivative Progress: 797/2043 symbols completed. HASI took 1.2s. Estimated remaining: 8m 49s. Rate: 141.3 symbols/min [2025-09-25T22:21:07.455606] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:07.473842] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1807 records). [2025-09-25T22:21:07.474084] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-25T22:21:07.477599] [INFO ] [MAIN ] Derivative Progress: 798/2043 symbols completed. HAYW took 1.3s. Estimated remaining: 8m 48s. Rate: 141.4 symbols/min [2025-09-25T22:21:07.478263] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:07.519159] [DEBUG] [LOCAL ] HBI: Loaded 53387 existing records from primary storage. [2025-09-25T22:21:07.519467] [INFO ] [MAIN ] HBI: Loaded 53387 primary data records. [2025-09-25T22:21:07.759205] [DEBUG] [LOCAL ] HBM: Loaded 53293 existing records from primary storage. [2025-09-25T22:21:07.759681] [INFO ] [MAIN ] HBM: Loaded 53293 primary data records. [2025-09-25T22:21:07.973112] [DEBUG] [LOCAL ] HCA: Loaded 47438 existing records from primary storage. [2025-09-25T22:21:07.997253] [INFO ] [MAIN ] HCA: Loaded 47438 primary data records. [2025-09-25T22:21:08.581274] [DEBUG] [MAIN ] HBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:08.582760] [INFO ] [MAIN ] HBI: Generated 1807 derivative records from 53387 primary records. [2025-09-25T22:21:08.582994] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-25T22:21:08.602052] [DEBUG] [LOCAL ] HBI: Derivative data saved (1807 records). [2025-09-25T22:21:08.603103] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-25T22:21:08.606279] [INFO ] [MAIN ] Derivative Progress: 799/2043 symbols completed. HBI took 1.2s. Estimated remaining: 8m 49s. Rate: 141.1 symbols/min [2025-09-25T22:21:08.607559] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:08.627788] [DEBUG] [MAIN ] HBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:08.628637] [INFO ] [MAIN ] HBM: Generated 1807 derivative records from 53293 primary records. [2025-09-25T22:21:08.628754] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-25T22:21:08.646312] [DEBUG] [LOCAL ] HBM: Derivative data saved (1807 records). [2025-09-25T22:21:08.646737] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-25T22:21:08.649146] [INFO ] [MAIN ] Derivative Progress: 800/2043 symbols completed. HBM took 1.2s. Estimated remaining: 8m 48s. Rate: 141.3 symbols/min [2025-09-25T22:21:08.649607] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:08.677239] [DEBUG] [MAIN ] HCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:08.678237] [INFO ] [MAIN ] HCA: Generated 1807 derivative records from 47438 primary records. [2025-09-25T22:21:08.678426] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-25T22:21:08.703113] [DEBUG] [LOCAL ] HCI: Loaded 13999 existing records from primary storage. [2025-09-25T22:21:08.713109] [INFO ] [MAIN ] HCI: Loaded 13999 primary data records. [2025-09-25T22:21:08.718877] [DEBUG] [LOCAL ] HCA: Derivative data saved (1807 records). [2025-09-25T22:21:08.745937] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-25T22:21:08.788489] [INFO ] [MAIN ] Derivative Progress: 801/2043 symbols completed. HCA took 1.3s. Estimated remaining: 8m 47s. Rate: 141.4 symbols/min [2025-09-25T22:21:08.837896] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:08.840502] [DEBUG] [LOCAL ] HCC: Loaded 45714 existing records from primary storage. [2025-09-25T22:21:08.852562] [INFO ] [MAIN ] HCC: Loaded 45714 primary data records. [2025-09-25T22:21:09.457342] [DEBUG] [LOCAL ] HD: Loaded 53902 existing records from primary storage. [2025-09-25T22:21:09.458032] [INFO ] [MAIN ] HD: Loaded 53902 primary data records. [2025-09-25T22:21:09.674563] [DEBUG] [MAIN ] HCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:09.725842] [INFO ] [MAIN ] HCI: Generated 1807 derivative records from 13999 primary records. [2025-09-25T22:21:09.851353] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-25T22:21:09.890953] [DEBUG] [LOCAL ] HCI: Derivative data saved (1807 records). [2025-09-25T22:21:09.892035] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-25T22:21:09.894441] [INFO ] [MAIN ] Derivative Progress: 802/2043 symbols completed. HCI took 1.2s. Estimated remaining: 8m 48s. Rate: 141.1 symbols/min [2025-09-25T22:21:09.895519] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:09.894968] [DEBUG] [MAIN ] HCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:09.896697] [INFO ] [MAIN ] HCC: Generated 1807 derivative records from 45714 primary records. [2025-09-25T22:21:09.897218] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-25T22:21:09.919932] [DEBUG] [LOCAL ] HCC: Derivative data saved (1807 records). [2025-09-25T22:21:09.920087] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-25T22:21:09.922844] [INFO ] [MAIN ] Derivative Progress: 803/2043 symbols completed. HCC took 1.3s. Estimated remaining: 8m 47s. Rate: 141.3 symbols/min [2025-09-25T22:21:09.923369] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:09.947075] [DEBUG] [MAIN ] HD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:09.948767] [INFO ] [MAIN ] HD: Generated 1807 derivative records from 53902 primary records. [2025-09-25T22:21:09.948906] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-25T22:21:09.986541] [DEBUG] [LOCAL ] HD: Derivative data saved (1807 records). [2025-09-25T22:21:09.986911] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-25T22:21:09.989763] [INFO ] [MAIN ] Derivative Progress: 804/2043 symbols completed. HD took 1.2s. Estimated remaining: 8m 46s. Rate: 141.4 symbols/min [2025-09-25T22:21:09.990390] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:10.020564] [DEBUG] [LOCAL ] HDB: Loaded 52305 existing records from primary storage. [2025-09-25T22:21:10.020842] [INFO ] [MAIN ] HDB: Loaded 52305 primary data records. [2025-09-25T22:21:10.148309] [DEBUG] [LOCAL ] HE: Loaded 49539 existing records from primary storage. [2025-09-25T22:21:10.161248] [INFO ] [MAIN ] HE: Loaded 49539 primary data records. [2025-09-25T22:21:10.239120] [DEBUG] [LOCAL ] HEI: Loaded 32653 existing records from primary storage. [2025-09-25T22:21:10.312179] [INFO ] [MAIN ] HEI: Loaded 32653 primary data records. [2025-09-25T22:21:11.126636] [DEBUG] [MAIN ] HDB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:11.127605] [INFO ] [MAIN ] HDB: Generated 1807 derivative records from 52305 primary records. [2025-09-25T22:21:11.127971] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-25T22:21:11.149767] [DEBUG] [LOCAL ] HDB: Derivative data saved (1807 records). [2025-09-25T22:21:11.163413] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-25T22:21:11.166029] [INFO ] [MAIN ] Derivative Progress: 805/2043 symbols completed. HDB took 1.3s. Estimated remaining: 8m 46s. Rate: 141.1 symbols/min [2025-09-25T22:21:11.166928] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:11.163768] [DEBUG] [MAIN ] HE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:11.168336] [INFO ] [MAIN ] HE: Generated 1807 derivative records from 49539 primary records. [2025-09-25T22:21:11.168711] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-25T22:21:11.190410] [DEBUG] [LOCAL ] HE: Derivative data saved (1807 records). [2025-09-25T22:21:11.207363] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-25T22:21:11.208186] [DEBUG] [MAIN ] HEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:11.211334] [INFO ] [MAIN ] Derivative Progress: 806/2043 symbols completed. HE took 1.3s. Estimated remaining: 8m 45s. Rate: 141.3 symbols/min [2025-09-25T22:21:11.212447] [INFO ] [MAIN ] HEI: Generated 1807 derivative records from 32653 primary records. [2025-09-25T22:21:11.212792] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:11.207815] [DEBUG] [LOCAL ] HEQ: Loaded 6173 existing records from primary storage. [2025-09-25T22:21:11.213106] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-25T22:21:11.214077] [INFO ] [MAIN ] HEQ: Loaded 6173 primary data records. [2025-09-25T22:21:11.253409] [DEBUG] [LOCAL ] HEI: Derivative data saved (1807 records). [2025-09-25T22:21:11.270748] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-25T22:21:11.273898] [INFO ] [MAIN ] Derivative Progress: 807/2043 symbols completed. HEI took 1.3s. Estimated remaining: 8m 44s. Rate: 141.4 symbols/min [2025-09-25T22:21:11.294343] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:11.618014] [DEBUG] [LOCAL ] HFRO: Loaded 17616 existing records from primary storage. [2025-09-25T22:21:11.618492] [INFO ] [MAIN ] HFRO: Loaded 17616 primary data records. [2025-09-25T22:21:11.737185] [DEBUG] [LOCAL ] HESM: Loaded 48522 existing records from primary storage. [2025-09-25T22:21:11.750995] [INFO ] [MAIN ] HESM: Loaded 48522 primary data records. [2025-09-25T22:21:12.313796] [DEBUG] [MAIN ] HEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:12.316144] [INFO ] [MAIN ] HEQ: Generated 1807 derivative records from 6173 primary records. [2025-09-25T22:21:12.316283] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-25T22:21:12.335324] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1807 records). [2025-09-25T22:21:12.335737] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-25T22:21:12.338325] [INFO ] [MAIN ] Derivative Progress: 808/2043 symbols completed. HEQ took 1.2s. Estimated remaining: 8m 45s. Rate: 141.2 symbols/min [2025-09-25T22:21:12.359182] [DEBUG] [MAIN ] HFRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:12.360234] [INFO ] [MAIN ] HFRO: Generated 1807 derivative records from 17616 primary records. [2025-09-25T22:21:12.360452] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-25T22:21:12.377984] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1807 records). [2025-09-25T22:21:12.378226] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-25T22:21:12.381211] [INFO ] [MAIN ] Derivative Progress: 809/2043 symbols completed. HFRO took 1.1s. Estimated remaining: 8m 44s. Rate: 141.3 symbols/min [2025-09-25T22:21:12.397266] [DEBUG] [MAIN ] HESM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:12.398078] [INFO ] [MAIN ] HESM: Generated 1807 derivative records from 48522 primary records. [2025-09-25T22:21:12.398159] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-25T22:21:12.414556] [DEBUG] [LOCAL ] HESM: Derivative data saved (1807 records). [2025-09-25T22:21:12.414634] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-25T22:21:12.417843] [INFO ] [MAIN ] Derivative Progress: 810/2043 symbols completed. HESM took 1.2s. Estimated remaining: 8m 43s. Rate: 141.5 symbols/min [2025-09-25T22:21:12.418713] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:12.419148] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:12.419327] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:12.442117] [DEBUG] [LOCAL ] HGTY: Loaded 13226 existing records from primary storage. [2025-09-25T22:21:12.448203] [INFO ] [MAIN ] HGTY: Loaded 13226 primary data records. [2025-09-25T22:21:12.462961] [DEBUG] [LOCAL ] HGER: Loaded 13284 existing records from primary storage. [2025-09-25T22:21:12.471684] [INFO ] [MAIN ] HGER: Loaded 13284 primary data records. [2025-09-25T22:21:12.990376] [DEBUG] [LOCAL ] HGV: Loaded 47168 existing records from primary storage. [2025-09-25T22:21:13.126337] [INFO ] [MAIN ] HGV: Loaded 47168 primary data records. [2025-09-25T22:21:13.556267] [DEBUG] [MAIN ] HGER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:13.558451] [INFO ] [MAIN ] HGER: Generated 1807 derivative records from 13284 primary records. [2025-09-25T22:21:13.572234] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-25T22:21:13.572611] [DEBUG] [MAIN ] HGTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:13.574526] [INFO ] [MAIN ] HGTY: Generated 1807 derivative records from 13226 primary records. [2025-09-25T22:21:13.575024] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-25T22:21:13.595241] [DEBUG] [LOCAL ] HGER: Derivative data saved (1807 records). [2025-09-25T22:21:13.604035] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-25T22:21:13.609992] [INFO ] [MAIN ] Derivative Progress: 811/2043 symbols completed. HGER took 1.2s. Estimated remaining: 8m 44s. Rate: 141.2 symbols/min [2025-09-25T22:21:13.614567] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1807 records). [2025-09-25T22:21:13.615276] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:13.614983] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-25T22:21:13.618318] [INFO ] [MAIN ] Derivative Progress: 812/2043 symbols completed. HGTY took 1.2s. Estimated remaining: 8m 43s. Rate: 141.4 symbols/min [2025-09-25T22:21:13.619295] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:13.638875] [DEBUG] [MAIN ] HGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:13.640006] [INFO ] [MAIN ] HGV: Generated 1807 derivative records from 47168 primary records. [2025-09-25T22:21:13.640171] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-25T22:21:13.658346] [DEBUG] [LOCAL ] HGV: Derivative data saved (1807 records). [2025-09-25T22:21:13.658613] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-25T22:21:13.672520] [INFO ] [MAIN ] Derivative Progress: 813/2043 symbols completed. HGV took 1.3s. Estimated remaining: 8m 42s. Rate: 141.5 symbols/min [2025-09-25T22:21:13.673117] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:13.695956] [DEBUG] [LOCAL ] HHH: Loaded 32833 existing records from primary storage. [2025-09-25T22:21:13.696230] [INFO ] [MAIN ] HHH: Loaded 32833 primary data records. [2025-09-25T22:21:13.801836] [DEBUG] [LOCAL ] HI: Loaded 35414 existing records from primary storage. [2025-09-25T22:21:13.812621] [INFO ] [MAIN ] HI: Loaded 35414 primary data records. [2025-09-25T22:21:14.294063] [DEBUG] [LOCAL ] HIG: Loaded 51610 existing records from primary storage. [2025-09-25T22:21:14.407199] [INFO ] [MAIN ] HIG: Loaded 51610 primary data records. [2025-09-25T22:21:14.780697] [DEBUG] [MAIN ] HHH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:14.782893] [INFO ] [MAIN ] HHH: Generated 1807 derivative records from 32833 primary records. [2025-09-25T22:21:14.784605] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-25T22:21:14.815182] [DEBUG] [LOCAL ] HHH: Derivative data saved (1807 records). [2025-09-25T22:21:14.815620] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-25T22:21:14.815491] [DEBUG] [MAIN ] HI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:14.819206] [INFO ] [MAIN ] HI: Generated 1807 derivative records from 35414 primary records. [2025-09-25T22:21:14.818293] [INFO ] [MAIN ] Derivative Progress: 814/2043 symbols completed. HHH took 1.2s. Estimated remaining: 8m 42s. Rate: 141.2 symbols/min [2025-09-25T22:21:14.819355] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-25T22:21:14.820050] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:14.838024] [DEBUG] [LOCAL ] HI: Derivative data saved (1807 records). [2025-09-25T22:21:14.838439] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-25T22:21:14.841263] [INFO ] [MAIN ] Derivative Progress: 815/2043 symbols completed. HI took 1.2s. Estimated remaining: 8m 41s. Rate: 141.4 symbols/min [2025-09-25T22:21:14.841681] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:14.858831] [DEBUG] [MAIN ] HIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:14.859582] [INFO ] [MAIN ] HIG: Generated 1807 derivative records from 51610 primary records. [2025-09-25T22:21:14.859745] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-25T22:21:14.877232] [DEBUG] [LOCAL ] HIG: Derivative data saved (1807 records). [2025-09-25T22:21:14.886060] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-25T22:21:14.888968] [INFO ] [MAIN ] Derivative Progress: 816/2043 symbols completed. HIG took 1.2s. Estimated remaining: 8m 40s. Rate: 141.5 symbols/min [2025-09-25T22:21:14.889598] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:14.905986] [DEBUG] [LOCAL ] HII: Loaded 35496 existing records from primary storage. [2025-09-25T22:21:14.906209] [INFO ] [MAIN ] HII: Loaded 35496 primary data records. [2025-09-25T22:21:15.091307] [DEBUG] [LOCAL ] HIO: Loaded 23776 existing records from primary storage. [2025-09-25T22:21:15.097638] [DEBUG] [LOCAL ] HIMS: Loaded 54207 existing records from primary storage. [2025-09-25T22:21:15.136261] [INFO ] [MAIN ] HIO: Loaded 23776 primary data records. [2025-09-25T22:21:15.160624] [INFO ] [MAIN ] HIMS: Loaded 54207 primary data records. [2025-09-25T22:21:16.041340] [DEBUG] [MAIN ] HII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:16.043032] [INFO ] [MAIN ] HII: Generated 1807 derivative records from 35496 primary records. [2025-09-25T22:21:16.043551] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-25T22:21:16.066604] [DEBUG] [LOCAL ] HII: Derivative data saved (1807 records). [2025-09-25T22:21:16.067229] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-25T22:21:16.069372] [INFO ] [MAIN ] Derivative Progress: 817/2043 symbols completed. HII took 1.2s. Estimated remaining: 8m 41s. Rate: 141.2 symbols/min [2025-09-25T22:21:16.069867] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:16.091862] [DEBUG] [MAIN ] HIMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:16.106204] [INFO ] [MAIN ] HIMS: Generated 1807 derivative records from 54207 primary records. [2025-09-25T22:21:16.111789] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-25T22:21:16.105287] [DEBUG] [MAIN ] HIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:16.112777] [INFO ] [MAIN ] HIO: Generated 1807 derivative records from 23776 primary records. [2025-09-25T22:21:16.114085] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-25T22:21:16.149296] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1807 records). [2025-09-25T22:21:16.150168] [DEBUG] [LOCAL ] HIPO: Loaded 22682 existing records from primary storage. [2025-09-25T22:21:16.151392] [INFO ] [MAIN ] HIPO: Loaded 22682 primary data records. [2025-09-25T22:21:16.149799] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-25T22:21:16.162469] [INFO ] [MAIN ] Derivative Progress: 818/2043 symbols completed. HIMS took 1.3s. Estimated remaining: 8m 40s. Rate: 141.4 symbols/min [2025-09-25T22:21:16.169482] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:16.169571] [DEBUG] [LOCAL ] HIO: Derivative data saved (1807 records). [2025-09-25T22:21:16.175303] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-25T22:21:16.184793] [INFO ] [MAIN ] Derivative Progress: 819/2043 symbols completed. HIO took 1.3s. Estimated remaining: 8m 39s. Rate: 141.5 symbols/min [2025-09-25T22:21:16.196458] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:16.338368] [DEBUG] [LOCAL ] HIX: Loaded 20487 existing records from primary storage. [2025-09-25T22:21:16.371767] [INFO ] [MAIN ] HIX: Loaded 20487 primary data records. [2025-09-25T22:21:16.661560] [DEBUG] [LOCAL ] HIW: Loaded 45015 existing records from primary storage. [2025-09-25T22:21:16.677944] [INFO ] [MAIN ] HIW: Loaded 45015 primary data records. [2025-09-25T22:21:17.227700] [DEBUG] [MAIN ] HIPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:17.229383] [INFO ] [MAIN ] HIPO: Generated 1807 derivative records from 22682 primary records. [2025-09-25T22:21:17.229496] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-25T22:21:17.254236] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1807 records). [2025-09-25T22:21:17.255330] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-25T22:21:17.257922] [INFO ] [MAIN ] Derivative Progress: 820/2043 symbols completed. HIPO took 1.2s. Estimated remaining: 8m 39s. Rate: 141.3 symbols/min [2025-09-25T22:21:17.259192] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:17.273998] [DEBUG] [MAIN ] HIX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:17.275162] [INFO ] [MAIN ] HIX: Generated 1807 derivative records from 20487 primary records. [2025-09-25T22:21:17.275690] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-25T22:21:17.301024] [DEBUG] [LOCAL ] HIX: Derivative data saved (1807 records). [2025-09-25T22:21:17.314567] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-25T22:21:17.317902] [INFO ] [MAIN ] Derivative Progress: 821/2043 symbols completed. HIX took 1.1s. Estimated remaining: 8m 39s. Rate: 141.4 symbols/min [2025-09-25T22:21:17.318722] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:17.318430] [DEBUG] [MAIN ] HIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:17.327594] [INFO ] [MAIN ] HIW: Generated 1807 derivative records from 45015 primary records. [2025-09-25T22:21:17.327827] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-25T22:21:17.326774] [DEBUG] [LOCAL ] HKD: Loaded 18493 existing records from primary storage. [2025-09-25T22:21:17.327941] [INFO ] [MAIN ] HKD: Loaded 18493 primary data records. [2025-09-25T22:21:17.414680] [DEBUG] [LOCAL ] HIW: Derivative data saved (1807 records). [2025-09-25T22:21:17.427325] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-25T22:21:17.437021] [INFO ] [MAIN ] Derivative Progress: 822/2043 symbols completed. HIW took 1.3s. Estimated remaining: 8m 38s. Rate: 141.5 symbols/min [2025-09-25T22:21:17.459353] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:17.706703] [DEBUG] [LOCAL ] HL: Loaded 54061 existing records from primary storage. [2025-09-25T22:21:17.718590] [INFO ] [MAIN ] HL: Loaded 54061 primary data records. [2025-09-25T22:21:17.863912] [DEBUG] [LOCAL ] HLF: Loaded 49031 existing records from primary storage. [2025-09-25T22:21:17.874674] [INFO ] [MAIN ] HLF: Loaded 49031 primary data records. [2025-09-25T22:21:18.206092] [DEBUG] [MAIN ] HKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:18.233557] [INFO ] [MAIN ] HKD: Generated 1807 derivative records from 18493 primary records. [2025-09-25T22:21:18.246185] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-25T22:21:18.479938] [DEBUG] [LOCAL ] HKD: Derivative data saved (1807 records). [2025-09-25T22:21:18.480504] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-25T22:21:18.483423] [INFO ] [MAIN ] Derivative Progress: 823/2043 symbols completed. HKD took 1.2s. Estimated remaining: 8m 38s. Rate: 141.3 symbols/min [2025-09-25T22:21:18.503045] [DEBUG] [MAIN ] HL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:18.503999] [INFO ] [MAIN ] HL: Generated 1807 derivative records from 54061 primary records. [2025-09-25T22:21:18.504288] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-25T22:21:18.524499] [DEBUG] [LOCAL ] HL: Derivative data saved (1807 records). [2025-09-25T22:21:18.524823] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-25T22:21:18.527832] [INFO ] [MAIN ] Derivative Progress: 824/2043 symbols completed. HL took 1.2s. Estimated remaining: 8m 37s. Rate: 141.4 symbols/min [2025-09-25T22:21:18.540764] [DEBUG] [MAIN ] HLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:18.541522] [INFO ] [MAIN ] HLF: Generated 1807 derivative records from 49031 primary records. [2025-09-25T22:21:18.541587] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-25T22:21:18.557003] [DEBUG] [LOCAL ] HLF: Derivative data saved (1807 records). [2025-09-25T22:21:18.557124] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-25T22:21:18.560387] [INFO ] [MAIN ] Derivative Progress: 825/2043 symbols completed. HLF took 1.1s. Estimated remaining: 8m 36s. Rate: 141.6 symbols/min [2025-09-25T22:21:18.560985] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:18.561229] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:18.561275] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:18.618370] [DEBUG] [LOCAL ] HLIO: Loaded 28351 existing records from primary storage. [2025-09-25T22:21:18.628417] [DEBUG] [LOCAL ] HLLY: Loaded 33705 existing records from primary storage. [2025-09-25T22:21:18.628595] [INFO ] [MAIN ] HLIO: Loaded 28351 primary data records. [2025-09-25T22:21:18.629278] [DEBUG] [LOCAL ] HLI: Loaded 31388 existing records from primary storage. [2025-09-25T22:21:18.628765] [INFO ] [MAIN ] HLLY: Loaded 33705 primary data records. [2025-09-25T22:21:18.641582] [INFO ] [MAIN ] HLI: Loaded 31388 primary data records. [2025-09-25T22:21:19.669135] [DEBUG] [MAIN ] HLLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:19.670569] [INFO ] [MAIN ] HLLY: Generated 1807 derivative records from 33705 primary records. [2025-09-25T22:21:19.683616] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-25T22:21:19.698142] [DEBUG] [MAIN ] HLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:19.698599] [DEBUG] [MAIN ] HLIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:19.699549] [INFO ] [MAIN ] HLIO: Generated 1807 derivative records from 28351 primary records. [2025-09-25T22:21:19.700308] [INFO ] [MAIN ] HLI: Generated 1807 derivative records from 31388 primary records. [2025-09-25T22:21:19.699703] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-25T22:21:19.701195] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-25T22:21:19.730114] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1807 records). [2025-09-25T22:21:19.748082] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1807 records). [2025-09-25T22:21:19.747124] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-25T22:21:19.757948] [INFO ] [MAIN ] Derivative Progress: 826/2043 symbols completed. HLLY took 1.2s. Estimated remaining: 8m 37s. Rate: 141.3 symbols/min [2025-09-25T22:21:19.754572] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-25T22:21:19.764808] [DEBUG] [LOCAL ] HLI: Derivative data saved (1807 records). [2025-09-25T22:21:19.768061] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:19.768321] [INFO ] [MAIN ] Derivative Progress: 827/2043 symbols completed. HLIO took 1.2s. Estimated remaining: 8m 36s. Rate: 141.4 symbols/min [2025-09-25T22:21:19.769425] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:19.769045] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-25T22:21:19.772845] [INFO ] [MAIN ] Derivative Progress: 828/2043 symbols completed. HLI took 1.2s. Estimated remaining: 8m 35s. Rate: 141.6 symbols/min [2025-09-25T22:21:19.773404] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:19.853937] [DEBUG] [LOCAL ] HLX: Loaded 48349 existing records from primary storage. [2025-09-25T22:21:19.854302] [INFO ] [MAIN ] HLX: Loaded 48349 primary data records. [2025-09-25T22:21:19.974892] [DEBUG] [LOCAL ] HLT: Loaded 51092 existing records from primary storage. [2025-09-25T22:21:19.996449] [DEBUG] [LOCAL ] HLN: Loaded 53477 existing records from primary storage. [2025-09-25T22:21:20.000464] [INFO ] [MAIN ] HLT: Loaded 51092 primary data records. [2025-09-25T22:21:20.000610] [INFO ] [MAIN ] HLN: Loaded 53477 primary data records. [2025-09-25T22:21:20.964225] [DEBUG] [MAIN ] HLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:20.966281] [INFO ] [MAIN ] HLX: Generated 1807 derivative records from 48349 primary records. [2025-09-25T22:21:20.966823] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-25T22:21:20.987402] [DEBUG] [LOCAL ] HLX: Derivative data saved (1807 records). [2025-09-25T22:21:20.987823] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-25T22:21:20.990201] [INFO ] [MAIN ] Derivative Progress: 829/2043 symbols completed. HLX took 1.2s. Estimated remaining: 8m 36s. Rate: 141.3 symbols/min [2025-09-25T22:21:20.990716] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:21.027009] [DEBUG] [MAIN ] HLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:21.026668] [DEBUG] [MAIN ] HLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:21.028877] [INFO ] [MAIN ] HLN: Generated 1807 derivative records from 53477 primary records. [2025-09-25T22:21:21.028037] [INFO ] [MAIN ] HLT: Generated 1807 derivative records from 51092 primary records. [2025-09-25T22:21:21.029143] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-25T22:21:21.029229] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-25T22:21:21.058638] [DEBUG] [LOCAL ] HLT: Derivative data saved (1807 records). [2025-09-25T22:21:21.063403] [DEBUG] [LOCAL ] HLN: Derivative data saved (1807 records). [2025-09-25T22:21:21.074474] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-25T22:21:21.074338] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-25T22:21:21.077007] [INFO ] [MAIN ] Derivative Progress: 830/2043 symbols completed. HLT took 1.3s. Estimated remaining: 8m 35s. Rate: 141.4 symbols/min [2025-09-25T22:21:21.077377] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:21.080456] [INFO ] [MAIN ] Derivative Progress: 831/2043 symbols completed. HLN took 1.3s. Estimated remaining: 8m 34s. Rate: 141.6 symbols/min [2025-09-25T22:21:21.080852] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:21.107401] [DEBUG] [LOCAL ] HMC: Loaded 47152 existing records from primary storage. [2025-09-25T22:21:21.107577] [INFO ] [MAIN ] HMC: Loaded 47152 primary data records. [2025-09-25T22:21:21.243132] [DEBUG] [LOCAL ] HMN: Loaded 23517 existing records from primary storage. [2025-09-25T22:21:21.258993] [INFO ] [MAIN ] HMN: Loaded 23517 primary data records. [2025-09-25T22:21:21.591534] [DEBUG] [LOCAL ] HMY: Loaded 53525 existing records from primary storage. [2025-09-25T22:21:21.619057] [INFO ] [MAIN ] HMY: Loaded 53525 primary data records. [2025-09-25T22:21:22.219963] [DEBUG] [MAIN ] HMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:22.221559] [INFO ] [MAIN ] HMC: Generated 1807 derivative records from 47152 primary records. [2025-09-25T22:21:22.221894] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-25T22:21:22.243927] [DEBUG] [LOCAL ] HMC: Derivative data saved (1807 records). [2025-09-25T22:21:22.244215] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-25T22:21:22.247051] [INFO ] [MAIN ] Derivative Progress: 832/2043 symbols completed. HMC took 1.3s. Estimated remaining: 8m 34s. Rate: 141.3 symbols/min [2025-09-25T22:21:22.247414] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:22.264168] [DEBUG] [MAIN ] HMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:22.265623] [INFO ] [MAIN ] HMN: Generated 1807 derivative records from 23517 primary records. [2025-09-25T22:21:22.265863] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-25T22:21:22.282882] [DEBUG] [LOCAL ] HMN: Derivative data saved (1807 records). [2025-09-25T22:21:22.283103] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-25T22:21:22.287066] [INFO ] [MAIN ] Derivative Progress: 833/2043 symbols completed. HMN took 1.2s. Estimated remaining: 8m 33s. Rate: 141.4 symbols/min [2025-09-25T22:21:22.287959] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:22.306625] [DEBUG] [MAIN ] HMY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:22.307693] [INFO ] [MAIN ] HMY: Generated 1807 derivative records from 53525 primary records. [2025-09-25T22:21:22.307863] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-25T22:21:22.342264] [DEBUG] [LOCAL ] HMY: Derivative data saved (1807 records). [2025-09-25T22:21:22.343164] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-25T22:21:22.355582] [INFO ] [MAIN ] Derivative Progress: 834/2043 symbols completed. HMY took 1.3s. Estimated remaining: 8m 32s. Rate: 141.6 symbols/min [2025-09-25T22:21:22.357544] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:22.358728] [DEBUG] [LOCAL ] HNI: Loaded 29093 existing records from primary storage. [2025-09-25T22:21:22.359013] [INFO ] [MAIN ] HNI: Loaded 29093 primary data records. [2025-09-25T22:21:22.589826] [DEBUG] [LOCAL ] HOG: Loaded 51604 existing records from primary storage. [2025-09-25T22:21:22.631791] [INFO ] [MAIN ] HOG: Loaded 51604 primary data records. [2025-09-25T22:21:22.881431] [DEBUG] [LOCAL ] HOMB: Loaded 43979 existing records from primary storage. [2025-09-25T22:21:22.892908] [INFO ] [MAIN ] HOMB: Loaded 43979 primary data records. [2025-09-25T22:21:23.442619] [DEBUG] [MAIN ] HNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:23.443759] [INFO ] [MAIN ] HNI: Generated 1807 derivative records from 29093 primary records. [2025-09-25T22:21:23.443918] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-25T22:21:23.462431] [DEBUG] [LOCAL ] HNI: Derivative data saved (1807 records). [2025-09-25T22:21:23.463090] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-25T22:21:23.465620] [INFO ] [MAIN ] Derivative Progress: 835/2043 symbols completed. HNI took 1.2s. Estimated remaining: 8m 33s. Rate: 141.3 symbols/min [2025-09-25T22:21:23.466430] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:23.485725] [DEBUG] [MAIN ] HOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:23.486913] [INFO ] [MAIN ] HOG: Generated 1807 derivative records from 51604 primary records. [2025-09-25T22:21:23.487230] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-25T22:21:23.507229] [DEBUG] [LOCAL ] HOG: Derivative data saved (1807 records). [2025-09-25T22:21:23.507442] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-25T22:21:23.509677] [INFO ] [MAIN ] Derivative Progress: 836/2043 symbols completed. HOG took 1.2s. Estimated remaining: 8m 32s. Rate: 141.5 symbols/min [2025-09-25T22:21:23.511849] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:23.529541] [DEBUG] [MAIN ] HOMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:23.541458] [INFO ] [MAIN ] HOMB: Generated 1807 derivative records from 43979 primary records. [2025-09-25T22:21:23.541801] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-25T22:21:23.565928] [DEBUG] [LOCAL ] HOV: Loaded 13886 existing records from primary storage. [2025-09-25T22:21:23.583423] [INFO ] [MAIN ] HOV: Loaded 13886 primary data records. [2025-09-25T22:21:23.585038] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1807 records). [2025-09-25T22:21:23.585262] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-25T22:21:23.591505] [DEBUG] [LOCAL ] HOUS: Loaded 44514 existing records from primary storage. [2025-09-25T22:21:23.613756] [INFO ] [MAIN ] Derivative Progress: 837/2043 symbols completed. HOMB took 1.3s. Estimated remaining: 8m 31s. Rate: 141.6 symbols/min [2025-09-25T22:21:23.645212] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:23.631386] [INFO ] [MAIN ] HOUS: Loaded 44514 primary data records. [2025-09-25T22:21:24.361900] [DEBUG] [LOCAL ] HP: Loaded 51932 existing records from primary storage. [2025-09-25T22:21:24.363358] [INFO ] [MAIN ] HP: Loaded 51932 primary data records. [2025-09-25T22:21:24.757172] [DEBUG] [MAIN ] HOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:24.758518] [INFO ] [MAIN ] HOV: Generated 1807 derivative records from 13886 primary records. [2025-09-25T22:21:24.758631] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-25T22:21:24.795265] [DEBUG] [LOCAL ] HOV: Derivative data saved (1807 records). [2025-09-25T22:21:24.797382] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-25T22:21:24.800213] [INFO ] [MAIN ] Derivative Progress: 838/2043 symbols completed. HOV took 1.3s. Estimated remaining: 8m 32s. Rate: 141.3 symbols/min [2025-09-25T22:21:24.800694] [DEBUG] [MAIN ] HOUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:24.802037] [INFO ] [MAIN ] HOUS: Generated 1807 derivative records from 44514 primary records. [2025-09-25T22:21:24.802219] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-25T22:21:24.820364] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1807 records). [2025-09-25T22:21:24.820579] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-25T22:21:24.823286] [INFO ] [MAIN ] Derivative Progress: 839/2043 symbols completed. HOUS took 1.4s. Estimated remaining: 8m 31s. Rate: 141.5 symbols/min [2025-09-25T22:21:24.840438] [DEBUG] [MAIN ] HP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:24.841090] [INFO ] [MAIN ] HP: Generated 1807 derivative records from 51932 primary records. [2025-09-25T22:21:24.841155] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-25T22:21:24.857348] [DEBUG] [LOCAL ] HP: Derivative data saved (1807 records). [2025-09-25T22:21:24.857444] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-25T22:21:24.859987] [INFO ] [MAIN ] Derivative Progress: 840/2043 symbols completed. HP took 1.2s. Estimated remaining: 8m 30s. Rate: 141.6 symbols/min [2025-09-25T22:21:24.861170] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:24.861104] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:24.860791] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:24.882124] [DEBUG] [LOCAL ] HPF: Loaded 7349 existing records from primary storage. [2025-09-25T22:21:24.882621] [INFO ] [MAIN ] HPF: Loaded 7349 primary data records. [2025-09-25T22:21:25.005853] [DEBUG] [LOCAL ] HPI: Loaded 10226 existing records from primary storage. [2025-09-25T22:21:25.010499] [INFO ] [MAIN ] HPI: Loaded 10226 primary data records. [2025-09-25T22:21:25.394541] [DEBUG] [LOCAL ] HPE: Loaded 54087 existing records from primary storage. [2025-09-25T22:21:25.410703] [INFO ] [MAIN ] HPE: Loaded 54087 primary data records. [2025-09-25T22:21:25.975635] [DEBUG] [MAIN ] HPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:25.978125] [INFO ] [MAIN ] HPF: Generated 1807 derivative records from 7349 primary records. [2025-09-25T22:21:25.978410] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-25T22:21:26.002315] [DEBUG] [LOCAL ] HPF: Derivative data saved (1807 records). [2025-09-25T22:21:26.002690] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-25T22:21:26.006289] [INFO ] [MAIN ] Derivative Progress: 841/2043 symbols completed. HPF took 1.1s. Estimated remaining: 8m 30s. Rate: 141.3 symbols/min [2025-09-25T22:21:26.008393] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:26.023977] [DEBUG] [MAIN ] HPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:26.025156] [INFO ] [MAIN ] HPI: Generated 1807 derivative records from 10226 primary records. [2025-09-25T22:21:26.025257] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-25T22:21:26.044991] [DEBUG] [LOCAL ] HPI: Derivative data saved (1807 records). [2025-09-25T22:21:26.046135] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-25T22:21:26.048817] [INFO ] [MAIN ] Derivative Progress: 842/2043 symbols completed. HPI took 1.2s. Estimated remaining: 8m 29s. Rate: 141.5 symbols/min [2025-09-25T22:21:26.049393] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:26.064021] [DEBUG] [MAIN ] HPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:26.064954] [INFO ] [MAIN ] HPE: Generated 1807 derivative records from 54087 primary records. [2025-09-25T22:21:26.065080] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-25T22:21:26.097400] [DEBUG] [LOCAL ] HPE: Derivative data saved (1807 records). [2025-09-25T22:21:26.097676] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-25T22:21:26.100515] [INFO ] [MAIN ] Derivative Progress: 843/2043 symbols completed. HPE took 1.2s. Estimated remaining: 8m 28s. Rate: 141.6 symbols/min [2025-09-25T22:21:26.100906] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:26.130384] [DEBUG] [LOCAL ] HPS: Loaded 10230 existing records from primary storage. [2025-09-25T22:21:26.132125] [INFO ] [MAIN ] HPS: Loaded 10230 primary data records. [2025-09-25T22:21:26.131966] [DEBUG] [LOCAL ] HPP: Loaded 51214 existing records from primary storage. [2025-09-25T22:21:26.137545] [INFO ] [MAIN ] HPP: Loaded 51214 primary data records. [2025-09-25T22:21:26.505487] [DEBUG] [LOCAL ] HPQ: Loaded 54058 existing records from primary storage. [2025-09-25T22:21:26.518562] [INFO ] [MAIN ] HPQ: Loaded 54058 primary data records. [2025-09-25T22:21:27.260388] [DEBUG] [MAIN ] HPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:27.263045] [INFO ] [MAIN ] HPS: Generated 1807 derivative records from 10230 primary records. [2025-09-25T22:21:27.265673] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-25T22:21:27.294847] [DEBUG] [MAIN ] HPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:27.297415] [INFO ] [MAIN ] HPP: Generated 1807 derivative records from 51214 primary records. [2025-09-25T22:21:27.298283] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-25T22:21:27.318142] [DEBUG] [LOCAL ] HPS: Derivative data saved (1807 records). [2025-09-25T22:21:27.321936] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-25T22:21:27.323202] [DEBUG] [LOCAL ] HPP: Derivative data saved (1807 records). [2025-09-25T22:21:27.328372] [INFO ] [MAIN ] Derivative Progress: 844/2043 symbols completed. HPS took 1.2s. Estimated remaining: 8m 29s. Rate: 141.3 symbols/min [2025-09-25T22:21:27.325504] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-25T22:21:27.333452] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:27.333314] [INFO ] [MAIN ] Derivative Progress: 845/2043 symbols completed. HPP took 1.3s. Estimated remaining: 8m 28s. Rate: 141.5 symbols/min [2025-09-25T22:21:27.347142] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:27.348598] [DEBUG] [MAIN ] HPQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:27.350880] [INFO ] [MAIN ] HPQ: Generated 1807 derivative records from 54058 primary records. [2025-09-25T22:21:27.351192] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-25T22:21:27.369250] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1807 records). [2025-09-25T22:21:27.369525] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-25T22:21:27.373033] [INFO ] [MAIN ] Derivative Progress: 846/2043 symbols completed. HPQ took 1.3s. Estimated remaining: 8m 27s. Rate: 141.6 symbols/min [2025-09-25T22:21:27.373515] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:27.395330] [DEBUG] [LOCAL ] HQL: Loaded 15972 existing records from primary storage. [2025-09-25T22:21:27.395691] [INFO ] [MAIN ] HQL: Loaded 15972 primary data records. [2025-09-25T22:21:27.471679] [DEBUG] [LOCAL ] HQH: Loaded 25135 existing records from primary storage. [2025-09-25T22:21:27.495313] [INFO ] [MAIN ] HQH: Loaded 25135 primary data records. [2025-09-25T22:21:27.985927] [DEBUG] [LOCAL ] HR: Loaded 52347 existing records from primary storage. [2025-09-25T22:21:27.998565] [INFO ] [MAIN ] HR: Loaded 52347 primary data records. [2025-09-25T22:21:28.488289] [DEBUG] [MAIN ] HQL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:28.490317] [INFO ] [MAIN ] HQL: Generated 1807 derivative records from 15972 primary records. [2025-09-25T22:21:28.490558] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-25T22:21:28.527721] [DEBUG] [MAIN ] HQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:28.527838] [DEBUG] [LOCAL ] HQL: Derivative data saved (1807 records). [2025-09-25T22:21:28.528187] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-25T22:21:28.531347] [INFO ] [MAIN ] Derivative Progress: 847/2043 symbols completed. HQL took 1.2s. Estimated remaining: 8m 28s. Rate: 141.3 symbols/min [2025-09-25T22:21:28.531866] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:28.533307] [INFO ] [MAIN ] HQH: Generated 1807 derivative records from 25135 primary records. [2025-09-25T22:21:28.533451] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-25T22:21:28.578891] [DEBUG] [MAIN ] HR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:28.579035] [DEBUG] [LOCAL ] HQH: Derivative data saved (1807 records). [2025-09-25T22:21:28.580388] [INFO ] [MAIN ] HR: Generated 1807 derivative records from 52347 primary records. [2025-09-25T22:21:28.579349] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-25T22:21:28.585032] [INFO ] [MAIN ] Derivative Progress: 848/2043 symbols completed. HQH took 1.3s. Estimated remaining: 8m 27s. Rate: 141.5 symbols/min [2025-09-25T22:21:28.585514] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:28.585822] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-25T22:21:28.605541] [DEBUG] [LOCAL ] HR: Derivative data saved (1807 records). [2025-09-25T22:21:28.605697] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-25T22:21:28.609346] [INFO ] [MAIN ] Derivative Progress: 849/2043 symbols completed. HR took 1.2s. Estimated remaining: 8m 26s. Rate: 141.6 symbols/min [2025-09-25T22:21:28.609872] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:28.663283] [DEBUG] [LOCAL ] HRB: Loaded 48936 existing records from primary storage. [2025-09-25T22:21:28.670913] [INFO ] [MAIN ] HRB: Loaded 48936 primary data records. [2025-09-25T22:21:28.814962] [DEBUG] [LOCAL ] HRI: Loaded 33319 existing records from primary storage. [2025-09-25T22:21:28.826539] [INFO ] [MAIN ] HRI: Loaded 33319 primary data records. [2025-09-25T22:21:29.161007] [DEBUG] [LOCAL ] HRL: Loaded 53474 existing records from primary storage. [2025-09-25T22:21:29.191531] [INFO ] [MAIN ] HRL: Loaded 53474 primary data records. [2025-09-25T22:21:29.794364] [DEBUG] [MAIN ] HRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:29.796782] [INFO ] [MAIN ] HRB: Generated 1807 derivative records from 48936 primary records. [2025-09-25T22:21:29.797303] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-25T22:21:29.819597] [DEBUG] [LOCAL ] HRB: Derivative data saved (1807 records). [2025-09-25T22:21:29.822335] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-25T22:21:29.826064] [INFO ] [MAIN ] Derivative Progress: 850/2043 symbols completed. HRB took 1.3s. Estimated remaining: 8m 27s. Rate: 141.3 symbols/min [2025-09-25T22:21:29.826791] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:29.842168] [DEBUG] [MAIN ] HRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:29.844128] [INFO ] [MAIN ] HRI: Generated 1807 derivative records from 33319 primary records. [2025-09-25T22:21:29.846683] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-25T22:21:29.876751] [DEBUG] [MAIN ] HRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:29.878913] [INFO ] [MAIN ] HRL: Generated 1807 derivative records from 53474 primary records. [2025-09-25T22:21:29.880508] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-25T22:21:29.893381] [DEBUG] [LOCAL ] HRI: Derivative data saved (1807 records). [2025-09-25T22:21:29.907237] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-25T22:21:29.912777] [INFO ] [MAIN ] Derivative Progress: 851/2043 symbols completed. HRI took 1.3s. Estimated remaining: 8m 26s. Rate: 141.5 symbols/min [2025-09-25T22:21:29.913836] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:29.915863] [DEBUG] [LOCAL ] HRL: Derivative data saved (1807 records). [2025-09-25T22:21:29.916203] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-25T22:21:29.922081] [INFO ] [MAIN ] Derivative Progress: 852/2043 symbols completed. HRL took 1.3s. Estimated remaining: 8m 25s. Rate: 141.6 symbols/min [2025-09-25T22:21:29.922369] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:29.935295] [DEBUG] [LOCAL ] HRTG: Loaded 33404 existing records from primary storage. [2025-09-25T22:21:29.935500] [INFO ] [MAIN ] HRTG: Loaded 33404 primary data records. [2025-09-25T22:21:30.057798] [DEBUG] [LOCAL ] HSHP: Loaded 15656 existing records from primary storage. [2025-09-25T22:21:30.069411] [INFO ] [MAIN ] HSHP: Loaded 15656 primary data records. [2025-09-25T22:21:30.407473] [DEBUG] [LOCAL ] HSBC: Loaded 51502 existing records from primary storage. [2025-09-25T22:21:30.408232] [INFO ] [MAIN ] HSBC: Loaded 51502 primary data records. [2025-09-25T22:21:31.079289] [DEBUG] [MAIN ] HRTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:31.082125] [INFO ] [MAIN ] HRTG: Generated 1807 derivative records from 33404 primary records. [2025-09-25T22:21:31.082823] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-25T22:21:31.108216] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1807 records). [2025-09-25T22:21:31.108736] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-25T22:21:31.113012] [INFO ] [MAIN ] Derivative Progress: 853/2043 symbols completed. HRTG took 1.3s. Estimated remaining: 8m 25s. Rate: 141.3 symbols/min [2025-09-25T22:21:31.132575] [DEBUG] [MAIN ] HSHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:31.134194] [INFO ] [MAIN ] HSHP: Generated 1807 derivative records from 15656 primary records. [2025-09-25T22:21:31.134295] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-25T22:21:31.168551] [DEBUG] [MAIN ] HSBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:31.169665] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1807 records). [2025-09-25T22:21:31.169917] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-25T22:21:31.170824] [INFO ] [MAIN ] HSBC: Generated 1807 derivative records from 51502 primary records. [2025-09-25T22:21:31.175420] [INFO ] [MAIN ] Derivative Progress: 854/2043 symbols completed. HSHP took 1.3s. Estimated remaining: 8m 24s. Rate: 141.5 symbols/min [2025-09-25T22:21:31.175579] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-25T22:21:31.192039] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1807 records). [2025-09-25T22:21:31.192144] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-25T22:21:31.196796] [INFO ] [MAIN ] Derivative Progress: 855/2043 symbols completed. HSBC took 1.3s. Estimated remaining: 8m 23s. Rate: 141.6 symbols/min [2025-09-25T22:21:31.198106] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:31.197957] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:31.198316] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:31.230132] [DEBUG] [LOCAL ] HTD: Loaded 13643 existing records from primary storage. [2025-09-25T22:21:31.230395] [INFO ] [MAIN ] HTD: Loaded 13643 primary data records. [2025-09-25T22:21:31.455668] [DEBUG] [LOCAL ] HSY: Loaded 50791 existing records from primary storage. [2025-09-25T22:21:31.632406] [INFO ] [MAIN ] HSY: Loaded 50791 primary data records. [2025-09-25T22:21:31.633482] [DEBUG] [LOCAL ] HTGC: Loaded 47908 existing records from primary storage. [2025-09-25T22:21:31.633938] [INFO ] [MAIN ] HTGC: Loaded 47908 primary data records. [2025-09-25T22:21:32.309968] [DEBUG] [MAIN ] HTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:32.311699] [INFO ] [MAIN ] HTD: Generated 1807 derivative records from 13643 primary records. [2025-09-25T22:21:32.312066] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-25T22:21:32.334926] [DEBUG] [LOCAL ] HTD: Derivative data saved (1807 records). [2025-09-25T22:21:32.335320] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-25T22:21:32.346831] [INFO ] [MAIN ] Derivative Progress: 856/2043 symbols completed. HTD took 1.1s. Estimated remaining: 8m 24s. Rate: 141.3 symbols/min [2025-09-25T22:21:32.352518] [DEBUG] [MAIN ] HSY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:32.353797] [INFO ] [MAIN ] HSY: Generated 1807 derivative records from 50791 primary records. [2025-09-25T22:21:32.354142] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-25T22:21:32.355214] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:32.376552] [DEBUG] [LOCAL ] HSY: Derivative data saved (1807 records). [2025-09-25T22:21:32.376905] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-25T22:21:32.380308] [INFO ] [MAIN ] Derivative Progress: 857/2043 symbols completed. HSY took 1.2s. Estimated remaining: 8m 23s. Rate: 141.5 symbols/min [2025-09-25T22:21:32.380714] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:32.395667] [DEBUG] [MAIN ] HTGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:32.396758] [INFO ] [MAIN ] HTGC: Generated 1807 derivative records from 47908 primary records. [2025-09-25T22:21:32.396976] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-25T22:21:32.426190] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1807 records). [2025-09-25T22:21:32.426440] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-25T22:21:32.430124] [INFO ] [MAIN ] Derivative Progress: 858/2043 symbols completed. HTGC took 1.2s. Estimated remaining: 8m 22s. Rate: 141.6 symbols/min [2025-09-25T22:21:32.430821] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:32.447111] [DEBUG] [LOCAL ] HTH: Loaded 32572 existing records from primary storage. [2025-09-25T22:21:32.447437] [INFO ] [MAIN ] HTH: Loaded 32572 primary data records. [2025-09-25T22:21:32.592841] [DEBUG] [LOCAL ] HUBB: Loaded 37414 existing records from primary storage. [2025-09-25T22:21:32.609210] [INFO ] [MAIN ] HUBB: Loaded 37414 primary data records. [2025-09-25T22:21:32.753537] [DEBUG] [LOCAL ] HUBS: Loaded 39738 existing records from primary storage. [2025-09-25T22:21:32.788493] [INFO ] [MAIN ] HUBS: Loaded 39738 primary data records. [2025-09-25T22:21:33.625472] [DEBUG] [MAIN ] HTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:33.626732] [INFO ] [MAIN ] HTH: Generated 1807 derivative records from 32572 primary records. [2025-09-25T22:21:33.626880] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-25T22:21:33.664112] [DEBUG] [MAIN ] HUBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:33.665478] [DEBUG] [LOCAL ] HTH: Derivative data saved (1807 records). [2025-09-25T22:21:33.666570] [INFO ] [MAIN ] HUBB: Generated 1807 derivative records from 37414 primary records. [2025-09-25T22:21:33.667525] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-25T22:21:33.666949] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-25T22:21:33.673464] [INFO ] [MAIN ] Derivative Progress: 859/2043 symbols completed. HTH took 1.3s. Estimated remaining: 8m 23s. Rate: 141.3 symbols/min [2025-09-25T22:21:33.682620] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:33.706342] [DEBUG] [MAIN ] HUBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:33.708088] [INFO ] [MAIN ] HUBS: Generated 1807 derivative records from 39738 primary records. [2025-09-25T22:21:33.708258] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-25T22:21:33.708787] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1807 records). [2025-09-25T22:21:33.709512] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-25T22:21:33.712434] [INFO ] [MAIN ] Derivative Progress: 860/2043 symbols completed. HUBB took 1.3s. Estimated remaining: 8m 22s. Rate: 141.5 symbols/min [2025-09-25T22:21:33.713774] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:33.733367] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1807 records). [2025-09-25T22:21:33.733701] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-25T22:21:33.737715] [INFO ] [MAIN ] Derivative Progress: 861/2043 symbols completed. HUBS took 1.3s. Estimated remaining: 8m 21s. Rate: 141.6 symbols/min [2025-09-25T22:21:33.738218] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:33.794443] [DEBUG] [LOCAL ] HUM: Loaded 49222 existing records from primary storage. [2025-09-25T22:21:33.794833] [INFO ] [MAIN ] HUM: Loaded 49222 primary data records. [2025-09-25T22:21:33.938234] [DEBUG] [LOCAL ] HUN: Loaded 53586 existing records from primary storage. [2025-09-25T22:21:33.952859] [INFO ] [MAIN ] HUN: Loaded 53586 primary data records. [2025-09-25T22:21:33.980417] [DEBUG] [LOCAL ] HUYA: Loaded 44671 existing records from primary storage. [2025-09-25T22:21:34.060902] [INFO ] [MAIN ] HUYA: Loaded 44671 primary data records. [2025-09-25T22:21:34.890144] [DEBUG] [MAIN ] HUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:34.893686] [INFO ] [MAIN ] HUM: Generated 1807 derivative records from 49222 primary records. [2025-09-25T22:21:34.893960] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-25T22:21:34.921798] [DEBUG] [LOCAL ] HUM: Derivative data saved (1807 records). [2025-09-25T22:21:34.922625] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-25T22:21:34.937913] [INFO ] [MAIN ] Derivative Progress: 862/2043 symbols completed. HUM took 1.3s. Estimated remaining: 8m 21s. Rate: 141.3 symbols/min [2025-09-25T22:21:34.939059] [DEBUG] [MAIN ] HUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:34.940383] [INFO ] [MAIN ] HUN: Generated 1807 derivative records from 53586 primary records. [2025-09-25T22:21:34.939347] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:34.941180] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-25T22:21:34.963609] [DEBUG] [LOCAL ] HUN: Derivative data saved (1807 records). [2025-09-25T22:21:34.969866] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-25T22:21:34.972575] [INFO ] [MAIN ] Derivative Progress: 863/2043 symbols completed. HUN took 1.3s. Estimated remaining: 8m 20s. Rate: 141.5 symbols/min [2025-09-25T22:21:34.991915] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:34.992927] [DEBUG] [MAIN ] HUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:35.001806] [INFO ] [MAIN ] HUYA: Generated 1807 derivative records from 44671 primary records. [2025-09-25T22:21:35.000247] [DEBUG] [LOCAL ] HVT: Loaded 16061 existing records from primary storage. [2025-09-25T22:21:35.002209] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-25T22:21:35.002339] [INFO ] [MAIN ] HVT: Loaded 16061 primary data records. [2025-09-25T22:21:35.149962] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1807 records). [2025-09-25T22:21:35.150521] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-25T22:21:35.170132] [INFO ] [MAIN ] Derivative Progress: 864/2043 symbols completed. HUYA took 1.4s. Estimated remaining: 8m 20s. Rate: 141.6 symbols/min [2025-09-25T22:21:35.237900] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:35.405036] [DEBUG] [LOCAL ] HWM: Loaded 53388 existing records from primary storage. [2025-09-25T22:21:35.405375] [INFO ] [MAIN ] HWM: Loaded 53388 primary data records. [2025-09-25T22:21:35.600999] [DEBUG] [LOCAL ] HXL: Loaded 46282 existing records from primary storage. [2025-09-25T22:21:35.628856] [INFO ] [MAIN ] HXL: Loaded 46282 primary data records. [2025-09-25T22:21:35.921445] [DEBUG] [MAIN ] HVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:35.930242] [INFO ] [MAIN ] HVT: Generated 1807 derivative records from 16061 primary records. [2025-09-25T22:21:35.930744] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-25T22:21:36.206331] [DEBUG] [LOCAL ] HVT: Derivative data saved (1807 records). [2025-09-25T22:21:36.206791] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-25T22:21:36.209601] [INFO ] [MAIN ] Derivative Progress: 865/2043 symbols completed. HVT took 1.3s. Estimated remaining: 8m 20s. Rate: 141.3 symbols/min [2025-09-25T22:21:36.210162] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:36.240997] [DEBUG] [LOCAL ] HY: Loaded 10146 existing records from primary storage. [2025-09-25T22:21:36.241169] [INFO ] [MAIN ] HY: Loaded 10146 primary data records. [2025-09-25T22:21:36.253438] [DEBUG] [MAIN ] HWM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:36.287842] [INFO ] [MAIN ] HWM: Generated 1807 derivative records from 53388 primary records. [2025-09-25T22:21:36.341079] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-25T22:21:36.585104] [DEBUG] [LOCAL ] HWM: Derivative data saved (1807 records). [2025-09-25T22:21:36.586093] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-25T22:21:36.588819] [INFO ] [MAIN ] Derivative Progress: 866/2043 symbols completed. HWM took 1.6s. Estimated remaining: 8m 20s. Rate: 141.3 symbols/min [2025-09-25T22:21:36.589298] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:36.605032] [DEBUG] [MAIN ] HXL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:36.606404] [INFO ] [MAIN ] HXL: Generated 1807 derivative records from 46282 primary records. [2025-09-25T22:21:36.607679] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-25T22:21:36.630438] [DEBUG] [LOCAL ] HYI: Loaded 9110 existing records from primary storage. [2025-09-25T22:21:36.631698] [INFO ] [MAIN ] HYI: Loaded 9110 primary data records. [2025-09-25T22:21:36.685392] [DEBUG] [LOCAL ] HXL: Derivative data saved (1807 records). [2025-09-25T22:21:36.709162] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-25T22:21:36.719615] [INFO ] [MAIN ] Derivative Progress: 867/2043 symbols completed. HXL took 1.5s. Estimated remaining: 8m 19s. Rate: 141.4 symbols/min [2025-09-25T22:21:36.738397] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:36.860597] [DEBUG] [MAIN ] HY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:36.984113] [INFO ] [MAIN ] HY: Generated 1807 derivative records from 10146 primary records. [2025-09-25T22:21:36.985140] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-25T22:21:37.025803] [DEBUG] [LOCAL ] HY: Derivative data saved (1807 records). [2025-09-25T22:21:37.026757] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-25T22:21:37.030133] [INFO ] [MAIN ] Derivative Progress: 868/2043 symbols completed. HY took 0.8s. Estimated remaining: 8m 18s. Rate: 141.5 symbols/min [2025-09-25T22:21:37.044401] [DEBUG] [LOCAL ] HYT: Loaded 33532 existing records from primary storage. [2025-09-25T22:21:37.044777] [INFO ] [MAIN ] HYT: Loaded 33532 primary data records. [2025-09-25T22:21:37.346711] [DEBUG] [MAIN ] HYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:37.401297] [INFO ] [MAIN ] HYI: Generated 1807 derivative records from 9110 primary records. [2025-09-25T22:21:37.410447] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-25T22:21:37.444180] [DEBUG] [LOCAL ] HYI: Derivative data saved (1807 records). [2025-09-25T22:21:37.444342] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-25T22:21:37.447431] [INFO ] [MAIN ] Derivative Progress: 869/2043 symbols completed. HYI took 0.9s. Estimated remaining: 8m 18s. Rate: 141.5 symbols/min [2025-09-25T22:21:37.469462] [DEBUG] [MAIN ] HYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:37.470481] [INFO ] [MAIN ] HYT: Generated 1807 derivative records from 33532 primary records. [2025-09-25T22:21:37.470553] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-25T22:21:37.488609] [DEBUG] [LOCAL ] HYT: Derivative data saved (1807 records). [2025-09-25T22:21:37.488832] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-25T22:21:37.492065] [INFO ] [MAIN ] Derivative Progress: 870/2043 symbols completed. HYT took 0.8s. Estimated remaining: 8m 17s. Rate: 141.6 symbols/min [2025-09-25T22:21:37.493024] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:37.493417] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:37.493732] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:37.509046] [DEBUG] [LOCAL ] HYTR: Loaded 3189 existing records from primary storage. [2025-09-25T22:21:37.509311] [INFO ] [MAIN ] HYTR: Loaded 3189 primary data records. [2025-09-25T22:21:37.553525] [DEBUG] [LOCAL ] IAE: Loaded 6040 existing records from primary storage. [2025-09-25T22:21:37.586126] [INFO ] [MAIN ] IAE: Loaded 6040 primary data records. [2025-09-25T22:21:37.787081] [DEBUG] [LOCAL ] HZO: Loaded 29552 existing records from primary storage. [2025-09-25T22:21:37.818045] [INFO ] [MAIN ] HZO: Loaded 29552 primary data records. [2025-09-25T22:21:38.635144] [DEBUG] [MAIN ] HYTR: Filtered 6966 bins outside market hours, 7766 incomplete bins [2025-09-25T22:21:38.637398] [INFO ] [MAIN ] HYTR: Generated 1800 derivative records from 3189 primary records. [2025-09-25T22:21:38.640534] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-25T22:21:38.671311] [DEBUG] [MAIN ] IAE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:38.670971] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1800 records). [2025-09-25T22:21:38.672127] [INFO ] [MAIN ] IAE: Generated 1807 derivative records from 6040 primary records. [2025-09-25T22:21:38.672540] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-25T22:21:38.672809] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-25T22:21:38.675802] [INFO ] [MAIN ] Derivative Progress: 871/2043 symbols completed. HYTR took 1.2s. Estimated remaining: 8m 18s. Rate: 141.3 symbols/min [2025-09-25T22:21:38.677585] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:38.695230] [DEBUG] [LOCAL ] IAE: Derivative data saved (1807 records). [2025-09-25T22:21:38.697280] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-25T22:21:38.700045] [INFO ] [MAIN ] Derivative Progress: 872/2043 symbols completed. IAE took 1.2s. Estimated remaining: 8m 17s. Rate: 141.5 symbols/min [2025-09-25T22:21:38.700562] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:38.715384] [DEBUG] [MAIN ] HZO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:38.716415] [INFO ] [MAIN ] HZO: Generated 1807 derivative records from 29552 primary records. [2025-09-25T22:21:38.716576] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-25T22:21:38.734880] [DEBUG] [LOCAL ] HZO: Derivative data saved (1807 records). [2025-09-25T22:21:38.735039] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-25T22:21:38.738107] [INFO ] [MAIN ] Derivative Progress: 873/2043 symbols completed. HZO took 1.2s. Estimated remaining: 8m 16s. Rate: 141.6 symbols/min [2025-09-25T22:21:38.738702] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:38.795495] [DEBUG] [LOCAL ] IAG: Loaded 53835 existing records from primary storage. [2025-09-25T22:21:38.795906] [INFO ] [MAIN ] IAG: Loaded 53835 primary data records. [2025-09-25T22:21:38.942004] [DEBUG] [LOCAL ] IBM: Loaded 54026 existing records from primary storage. [2025-09-25T22:21:38.947854] [INFO ] [MAIN ] IBM: Loaded 54026 primary data records. [2025-09-25T22:21:39.287335] [DEBUG] [LOCAL ] IBN: Loaded 53266 existing records from primary storage. [2025-09-25T22:21:39.304158] [INFO ] [MAIN ] IBN: Loaded 53266 primary data records. [2025-09-25T22:21:39.923964] [DEBUG] [MAIN ] IAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:39.925739] [INFO ] [MAIN ] IAG: Generated 1807 derivative records from 53835 primary records. [2025-09-25T22:21:39.926069] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-25T22:21:39.954531] [DEBUG] [LOCAL ] IAG: Derivative data saved (1807 records). [2025-09-25T22:21:39.957147] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-25T22:21:39.960007] [INFO ] [MAIN ] Derivative Progress: 874/2043 symbols completed. IAG took 1.3s. Estimated remaining: 8m 16s. Rate: 141.3 symbols/min [2025-09-25T22:21:39.960766] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:39.976346] [DEBUG] [MAIN ] IBM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:39.977380] [INFO ] [MAIN ] IBM: Generated 1807 derivative records from 54026 primary records. [2025-09-25T22:21:39.977631] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-25T22:21:39.998864] [DEBUG] [LOCAL ] IBM: Derivative data saved (1807 records). [2025-09-25T22:21:39.999322] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-25T22:21:40.002511] [INFO ] [MAIN ] Derivative Progress: 875/2043 symbols completed. IBM took 1.3s. Estimated remaining: 8m 15s. Rate: 141.5 symbols/min [2025-09-25T22:21:40.003141] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:40.017987] [DEBUG] [MAIN ] IBN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:40.027887] [INFO ] [MAIN ] IBN: Generated 1807 derivative records from 53266 primary records. [2025-09-25T22:21:40.028167] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-25T22:21:40.055952] [DEBUG] [LOCAL ] IBN: Derivative data saved (1807 records). [2025-09-25T22:21:40.056163] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-25T22:21:40.060503] [INFO ] [MAIN ] Derivative Progress: 876/2043 symbols completed. IBN took 1.3s. Estimated remaining: 8m 14s. Rate: 141.6 symbols/min [2025-09-25T22:21:40.057429] [DEBUG] [LOCAL ] IBP: Loaded 29439 existing records from primary storage. [2025-09-25T22:21:40.061071] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:40.060825] [INFO ] [MAIN ] IBP: Loaded 29439 primary data records. [2025-09-25T22:21:40.253178] [DEBUG] [LOCAL ] IBTA: Loaded 38211 existing records from primary storage. [2025-09-25T22:21:40.288739] [INFO ] [MAIN ] IBTA: Loaded 38211 primary data records. [2025-09-25T22:21:40.649715] [DEBUG] [LOCAL ] ICE: Loaded 53415 existing records from primary storage. [2025-09-25T22:21:40.774010] [INFO ] [MAIN ] ICE: Loaded 53415 primary data records. [2025-09-25T22:21:41.153765] [DEBUG] [MAIN ] IBP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:41.154585] [INFO ] [MAIN ] IBP: Generated 1807 derivative records from 29439 primary records. [2025-09-25T22:21:41.154805] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-25T22:21:41.191043] [DEBUG] [LOCAL ] IBP: Derivative data saved (1807 records). [2025-09-25T22:21:41.191405] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-25T22:21:41.193933] [INFO ] [MAIN ] Derivative Progress: 877/2043 symbols completed. IBP took 1.2s. Estimated remaining: 8m 15s. Rate: 141.4 symbols/min [2025-09-25T22:21:41.195518] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:41.195298] [DEBUG] [MAIN ] IBTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:41.196758] [INFO ] [MAIN ] IBTA: Generated 1807 derivative records from 38211 primary records. [2025-09-25T22:21:41.197001] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-25T22:21:41.216621] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1807 records). [2025-09-25T22:21:41.217073] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-25T22:21:41.219616] [INFO ] [MAIN ] Derivative Progress: 878/2043 symbols completed. IBTA took 1.2s. Estimated remaining: 8m 14s. Rate: 141.5 symbols/min [2025-09-25T22:21:41.220169] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:41.240310] [DEBUG] [MAIN ] ICE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:41.241246] [INFO ] [MAIN ] ICE: Generated 1807 derivative records from 53415 primary records. [2025-09-25T22:21:41.251281] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-25T22:21:41.274899] [DEBUG] [LOCAL ] ICE: Derivative data saved (1807 records). [2025-09-25T22:21:41.285440] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-25T22:21:41.289375] [INFO ] [MAIN ] Derivative Progress: 879/2043 symbols completed. ICE took 1.2s. Estimated remaining: 8m 13s. Rate: 141.6 symbols/min [2025-09-25T22:21:41.296960] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:41.298728] [DEBUG] [LOCAL ] ICL: Loaded 38902 existing records from primary storage. [2025-09-25T22:21:41.299366] [INFO ] [MAIN ] ICL: Loaded 38902 primary data records. [2025-09-25T22:21:41.424981] [DEBUG] [LOCAL ] IDE: Loaded 8650 existing records from primary storage. [2025-09-25T22:21:41.429689] [INFO ] [MAIN ] IDE: Loaded 8650 primary data records. [2025-09-25T22:21:41.429535] [DEBUG] [LOCAL ] IDA: Loaded 32201 existing records from primary storage. [2025-09-25T22:21:41.435122] [INFO ] [MAIN ] IDA: Loaded 32201 primary data records. [2025-09-25T22:21:42.415087] [DEBUG] [MAIN ] ICL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:42.417232] [INFO ] [MAIN ] ICL: Generated 1807 derivative records from 38902 primary records. [2025-09-25T22:21:42.417713] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-25T22:21:42.444141] [DEBUG] [LOCAL ] ICL: Derivative data saved (1807 records). [2025-09-25T22:21:42.451101] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-25T22:21:42.453191] [INFO ] [MAIN ] Derivative Progress: 880/2043 symbols completed. ICL took 1.3s. Estimated remaining: 8m 14s. Rate: 141.4 symbols/min [2025-09-25T22:21:42.455826] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:42.454709] [DEBUG] [MAIN ] IDE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:42.457151] [INFO ] [MAIN ] IDE: Generated 1807 derivative records from 8650 primary records. [2025-09-25T22:21:42.457475] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-25T22:21:42.471842] [DEBUG] [MAIN ] IDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:42.487632] [INFO ] [MAIN ] IDA: Generated 1807 derivative records from 32201 primary records. [2025-09-25T22:21:42.490755] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-25T22:21:42.498038] [DEBUG] [LOCAL ] IDE: Derivative data saved (1807 records). [2025-09-25T22:21:42.498211] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-25T22:21:42.508583] [INFO ] [MAIN ] Derivative Progress: 881/2043 symbols completed. IDE took 1.2s. Estimated remaining: 8m 13s. Rate: 141.5 symbols/min [2025-09-25T22:21:42.522397] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:42.523862] [DEBUG] [LOCAL ] IDA: Derivative data saved (1807 records). [2025-09-25T22:21:42.524445] [DEBUG] [LOCAL ] IDT: Loaded 17791 existing records from primary storage. [2025-09-25T22:21:42.524572] [INFO ] [MAIN ] IDT: Loaded 17791 primary data records. [2025-09-25T22:21:42.524896] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-25T22:21:42.532885] [INFO ] [MAIN ] Derivative Progress: 882/2043 symbols completed. IDA took 1.3s. Estimated remaining: 8m 12s. Rate: 141.7 symbols/min [2025-09-25T22:21:42.550761] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:42.913599] [DEBUG] [LOCAL ] IEX: Loaded 38697 existing records from primary storage. [2025-09-25T22:21:42.914135] [INFO ] [MAIN ] IEX: Loaded 38697 primary data records. [2025-09-25T22:21:43.054314] [DEBUG] [LOCAL ] IFF: Loaded 51351 existing records from primary storage. [2025-09-25T22:21:43.061824] [INFO ] [MAIN ] IFF: Loaded 51351 primary data records. [2025-09-25T22:21:43.482696] [DEBUG] [MAIN ] IDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:43.616130] [INFO ] [MAIN ] IDT: Generated 1807 derivative records from 17791 primary records. [2025-09-25T22:21:43.616591] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-25T22:21:43.637038] [DEBUG] [LOCAL ] IDT: Derivative data saved (1807 records). [2025-09-25T22:21:43.637927] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-25T22:21:43.640731] [INFO ] [MAIN ] Derivative Progress: 883/2043 symbols completed. IDT took 1.2s. Estimated remaining: 8m 12s. Rate: 141.4 symbols/min [2025-09-25T22:21:43.661557] [DEBUG] [MAIN ] IEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:43.662409] [INFO ] [MAIN ] IEX: Generated 1807 derivative records from 38697 primary records. [2025-09-25T22:21:43.662677] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-25T22:21:43.694039] [DEBUG] [MAIN ] IFF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:43.693841] [DEBUG] [LOCAL ] IEX: Derivative data saved (1807 records). [2025-09-25T22:21:43.694172] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-25T22:21:43.694911] [INFO ] [MAIN ] IFF: Generated 1807 derivative records from 51351 primary records. [2025-09-25T22:21:43.697180] [INFO ] [MAIN ] Derivative Progress: 884/2043 symbols completed. IEX took 1.2s. Estimated remaining: 8m 11s. Rate: 141.5 symbols/min [2025-09-25T22:21:43.697276] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-25T22:21:43.713037] [DEBUG] [LOCAL ] IFF: Derivative data saved (1807 records). [2025-09-25T22:21:43.713121] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-25T22:21:43.715743] [INFO ] [MAIN ] Derivative Progress: 885/2043 symbols completed. IFF took 1.2s. Estimated remaining: 8m 10s. Rate: 141.7 symbols/min [2025-09-25T22:21:43.716411] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:43.716346] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:43.716711] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:43.729270] [DEBUG] [LOCAL ] IGA: Loaded 9727 existing records from primary storage. [2025-09-25T22:21:43.729457] [INFO ] [MAIN ] IGA: Loaded 9727 primary data records. [2025-09-25T22:21:43.854009] [DEBUG] [LOCAL ] IFN: Loaded 18336 existing records from primary storage. [2025-09-25T22:21:43.858222] [INFO ] [MAIN ] IFN: Loaded 18336 primary data records. [2025-09-25T22:21:44.015384] [DEBUG] [LOCAL ] IFS: Loaded 23244 existing records from primary storage. [2025-09-25T22:21:44.028915] [INFO ] [MAIN ] IFS: Loaded 23244 primary data records. [2025-09-25T22:21:44.816437] [DEBUG] [MAIN ] IGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:44.819065] [INFO ] [MAIN ] IGA: Generated 1807 derivative records from 9727 primary records. [2025-09-25T22:21:44.819863] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-25T22:21:44.838895] [DEBUG] [LOCAL ] IGA: Derivative data saved (1807 records). [2025-09-25T22:21:44.839180] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-25T22:21:44.841560] [INFO ] [MAIN ] Derivative Progress: 886/2043 symbols completed. IGA took 1.1s. Estimated remaining: 8m 11s. Rate: 141.4 symbols/min [2025-09-25T22:21:44.842316] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:44.857081] [DEBUG] [MAIN ] IFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:44.858479] [INFO ] [MAIN ] IFN: Generated 1807 derivative records from 18336 primary records. [2025-09-25T22:21:44.858620] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-25T22:21:44.893840] [DEBUG] [MAIN ] IFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:44.895619] [INFO ] [MAIN ] IFS: Generated 1807 derivative records from 23244 primary records. [2025-09-25T22:21:44.903010] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-25T22:21:44.904668] [DEBUG] [LOCAL ] IGD: Loaded 19050 existing records from primary storage. [2025-09-25T22:21:44.906302] [INFO ] [MAIN ] IGD: Loaded 19050 primary data records. [2025-09-25T22:21:44.937124] [DEBUG] [LOCAL ] IFN: Derivative data saved (1807 records). [2025-09-25T22:21:44.957539] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-25T22:21:44.973263] [INFO ] [MAIN ] Derivative Progress: 887/2043 symbols completed. IFN took 1.3s. Estimated remaining: 8m 10s. Rate: 141.5 symbols/min [2025-09-25T22:21:44.996412] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:45.045509] [DEBUG] [LOCAL ] IFS: Derivative data saved (1807 records). [2025-09-25T22:21:45.059198] [DEBUG] [LOCAL ] IGI: Loaded 3710 existing records from primary storage. [2025-09-25T22:21:45.069849] [INFO ] [MAIN ] IGI: Loaded 3710 primary data records. [2025-09-25T22:21:45.069744] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-25T22:21:45.077900] [INFO ] [MAIN ] Derivative Progress: 888/2043 symbols completed. IFS took 1.4s. Estimated remaining: 8m 9s. Rate: 141.7 symbols/min [2025-09-25T22:21:45.153353] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:45.658380] [DEBUG] [LOCAL ] IGR: Loaded 30674 existing records from primary storage. [2025-09-25T22:21:45.658889] [INFO ] [MAIN ] IGR: Loaded 30674 primary data records. [2025-09-25T22:21:45.680564] [DEBUG] [MAIN ] IGD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:45.727593] [INFO ] [MAIN ] IGD: Generated 1807 derivative records from 19050 primary records. [2025-09-25T22:21:45.733730] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-25T22:21:45.885274] [DEBUG] [MAIN ] IGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:45.877449] [DEBUG] [LOCAL ] IGD: Derivative data saved (1807 records). [2025-09-25T22:21:45.892142] [INFO ] [MAIN ] IGI: Generated 1807 derivative records from 3710 primary records. [2025-09-25T22:21:45.892442] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-25T22:21:45.892950] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-25T22:21:45.896296] [INFO ] [MAIN ] Derivative Progress: 889/2043 symbols completed. IGD took 1.1s. Estimated remaining: 8m 9s. Rate: 141.5 symbols/min [2025-09-25T22:21:45.908746] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:46.004174] [DEBUG] [LOCAL ] IH: Loaded 3429 existing records from primary storage. [2025-09-25T22:21:46.019140] [DEBUG] [LOCAL ] IGI: Derivative data saved (1807 records). [2025-09-25T22:21:46.209143] [INFO ] [MAIN ] IH: Loaded 3429 primary data records. [2025-09-25T22:21:46.215983] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-25T22:21:46.231447] [INFO ] [MAIN ] Derivative Progress: 890/2043 symbols completed. IGI took 1.2s. Estimated remaining: 8m 9s. Rate: 141.5 symbols/min [2025-09-25T22:21:46.259325] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:46.364436] [DEBUG] [LOCAL ] IHD: Loaded 7189 existing records from primary storage. [2025-09-25T22:21:46.378419] [INFO ] [MAIN ] IHD: Loaded 7189 primary data records. [2025-09-25T22:21:46.999266] [DEBUG] [MAIN ] IGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:47.082817] [INFO ] [MAIN ] IGR: Generated 1807 derivative records from 30674 primary records. [2025-09-25T22:21:47.088910] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-25T22:21:47.146031] [DEBUG] [LOCAL ] IGR: Derivative data saved (1807 records). [2025-09-25T22:21:47.146446] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-25T22:21:47.162813] [INFO ] [MAIN ] Derivative Progress: 891/2043 symbols completed. IGR took 2.0s. Estimated remaining: 8m 9s. Rate: 141.3 symbols/min [2025-09-25T22:21:47.163402] [DEBUG] [MAIN ] IH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:47.164211] [INFO ] [MAIN ] IH: Generated 1807 derivative records from 3429 primary records. [2025-09-25T22:21:47.164818] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-25T22:21:47.165409] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:47.182285] [DEBUG] [LOCAL ] IH: Derivative data saved (1807 records). [2025-09-25T22:21:47.183349] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-25T22:21:47.185848] [INFO ] [MAIN ] Derivative Progress: 892/2043 symbols completed. IH took 1.3s. Estimated remaining: 8m 8s. Rate: 141.5 symbols/min [2025-09-25T22:21:47.188905] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:47.204161] [DEBUG] [MAIN ] IHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:47.211368] [INFO ] [MAIN ] IHD: Generated 1807 derivative records from 7189 primary records. [2025-09-25T22:21:47.211677] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-25T22:21:47.236218] [DEBUG] [LOCAL ] IHG: Loaded 24781 existing records from primary storage. [2025-09-25T22:21:47.237034] [INFO ] [MAIN ] IHG: Loaded 24781 primary data records. [2025-09-25T22:21:47.294099] [DEBUG] [LOCAL ] IHD: Derivative data saved (1807 records). [2025-09-25T22:21:47.334084] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-25T22:21:47.361383] [INFO ] [MAIN ] Derivative Progress: 893/2043 symbols completed. IHD took 1.1s. Estimated remaining: 8m 7s. Rate: 141.6 symbols/min [2025-09-25T22:21:47.379311] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:47.401263] [DEBUG] [LOCAL ] IHS: Loaded 39219 existing records from primary storage. [2025-09-25T22:21:47.453164] [INFO ] [MAIN ] IHS: Loaded 39219 primary data records. [2025-09-25T22:21:47.665365] [DEBUG] [LOCAL ] IIF: Loaded 5769 existing records from primary storage. [2025-09-25T22:21:47.680373] [INFO ] [MAIN ] IIF: Loaded 5769 primary data records. [2025-09-25T22:21:48.292861] [DEBUG] [MAIN ] IHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:48.294089] [INFO ] [MAIN ] IHG: Generated 1807 derivative records from 24781 primary records. [2025-09-25T22:21:48.294283] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-25T22:21:48.314218] [DEBUG] [LOCAL ] IHG: Derivative data saved (1807 records). [2025-09-25T22:21:48.314672] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-25T22:21:48.317177] [INFO ] [MAIN ] Derivative Progress: 894/2043 symbols completed. IHG took 1.2s. Estimated remaining: 8m 8s. Rate: 141.4 symbols/min [2025-09-25T22:21:48.318298] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:48.337515] [DEBUG] [MAIN ] IHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:48.340260] [INFO ] [MAIN ] IHS: Generated 1807 derivative records from 39219 primary records. [2025-09-25T22:21:48.340443] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-25T22:21:48.370797] [DEBUG] [MAIN ] IIF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:48.382698] [DEBUG] [LOCAL ] IHS: Derivative data saved (1807 records). [2025-09-25T22:21:48.383275] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-25T22:21:48.383154] [DEBUG] [LOCAL ] IIM: Loaded 15993 existing records from primary storage. [2025-09-25T22:21:48.380782] [INFO ] [MAIN ] IIF: Generated 1807 derivative records from 5769 primary records. [2025-09-25T22:21:48.386067] [INFO ] [MAIN ] Derivative Progress: 895/2043 symbols completed. IHS took 1.2s. Estimated remaining: 8m 7s. Rate: 141.5 symbols/min [2025-09-25T22:21:48.386219] [INFO ] [MAIN ] IIM: Loaded 15993 primary data records. [2025-09-25T22:21:48.386608] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:48.386917] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-25T22:21:48.605346] [DEBUG] [LOCAL ] IIF: Derivative data saved (1807 records). [2025-09-25T22:21:48.736770] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-25T22:21:48.740063] [INFO ] [MAIN ] Derivative Progress: 896/2043 symbols completed. IIF took 1.4s. Estimated remaining: 8m 6s. Rate: 141.5 symbols/min [2025-09-25T22:21:48.741398] [DEBUG] [LOCAL ] IIPR: Loaded 29843 existing records from primary storage. [2025-09-25T22:21:48.741889] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:48.742104] [INFO ] [MAIN ] IIPR: Loaded 29843 primary data records. [2025-09-25T22:21:49.152811] [DEBUG] [LOCAL ] IMAX: Loaded 43076 existing records from primary storage. [2025-09-25T22:21:49.154809] [INFO ] [MAIN ] IMAX: Loaded 43076 primary data records. [2025-09-25T22:21:49.203895] [DEBUG] [MAIN ] IIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:49.227925] [INFO ] [MAIN ] IIM: Generated 1807 derivative records from 15993 primary records. [2025-09-25T22:21:49.245835] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-25T22:21:49.349013] [DEBUG] [LOCAL ] IIM: Derivative data saved (1807 records). [2025-09-25T22:21:49.354611] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-25T22:21:49.357810] [INFO ] [MAIN ] Derivative Progress: 897/2043 symbols completed. IIM took 1.0s. Estimated remaining: 8m 6s. Rate: 141.5 symbols/min [2025-09-25T22:21:49.363523] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:49.572360] [DEBUG] [MAIN ] IIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:49.573364] [INFO ] [MAIN ] IIPR: Generated 1807 derivative records from 29843 primary records. [2025-09-25T22:21:49.573506] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-25T22:21:49.599365] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1807 records). [2025-09-25T22:21:49.599551] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-25T22:21:49.602354] [INFO ] [MAIN ] Derivative Progress: 898/2043 symbols completed. IIPR took 1.2s. Estimated remaining: 8m 5s. Rate: 141.5 symbols/min [2025-09-25T22:21:49.632625] [DEBUG] [MAIN ] IMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:49.633330] [INFO ] [MAIN ] IMAX: Generated 1807 derivative records from 43076 primary records. [2025-09-25T22:21:49.633434] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-25T22:21:49.666315] [DEBUG] [LOCAL ] INFA: Loaded 50299 existing records from primary storage. [2025-09-25T22:21:49.668111] [INFO ] [MAIN ] INFA: Loaded 50299 primary data records. [2025-09-25T22:21:49.668002] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1807 records). [2025-09-25T22:21:49.668379] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-25T22:21:49.738357] [INFO ] [MAIN ] Derivative Progress: 899/2043 symbols completed. IMAX took 1.0s. Estimated remaining: 8m 5s. Rate: 141.7 symbols/min [2025-09-25T22:21:49.994901] [DEBUG] [MAIN ] INFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:49.995621] [INFO ] [MAIN ] INFA: Generated 1807 derivative records from 50299 primary records. [2025-09-25T22:21:49.995714] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-25T22:21:50.017724] [DEBUG] [LOCAL ] INFA: Derivative data saved (1807 records). [2025-09-25T22:21:50.018066] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-25T22:21:50.020751] [INFO ] [MAIN ] Derivative Progress: 900/2043 symbols completed. INFA took 0.7s. Estimated remaining: 8m 4s. Rate: 141.7 symbols/min [2025-09-25T22:21:50.021502] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:50.021583] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:50.022635] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:50.056583] [DEBUG] [LOCAL ] INGM: Loaded 28961 existing records from primary storage. [2025-09-25T22:21:50.056864] [INFO ] [MAIN ] INGM: Loaded 28961 primary data records. [2025-09-25T22:21:50.283934] [DEBUG] [LOCAL ] ING: Loaded 51166 existing records from primary storage. [2025-09-25T22:21:50.238032] [DEBUG] [LOCAL ] INFY: Loaded 53988 existing records from primary storage. [2025-09-25T22:21:50.444225] [INFO ] [MAIN ] ING: Loaded 51166 primary data records. [2025-09-25T22:21:50.445231] [INFO ] [MAIN ] INFY: Loaded 53988 primary data records. [2025-09-25T22:21:51.202629] [DEBUG] [MAIN ] INGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:51.204228] [INFO ] [MAIN ] INGM: Generated 1807 derivative records from 28961 primary records. [2025-09-25T22:21:51.205064] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-25T22:21:51.225839] [DEBUG] [LOCAL ] INGM: Derivative data saved (1807 records). [2025-09-25T22:21:51.226474] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-25T22:21:51.228960] [INFO ] [MAIN ] Derivative Progress: 901/2043 symbols completed. INGM took 1.2s. Estimated remaining: 8m 5s. Rate: 141.4 symbols/min [2025-09-25T22:21:51.229698] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:51.267497] [DEBUG] [MAIN ] ING: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:51.273857] [INFO ] [MAIN ] ING: Generated 1807 derivative records from 51166 primary records. [2025-09-25T22:21:51.274409] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-25T22:21:51.274246] [DEBUG] [MAIN ] INFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:51.276521] [INFO ] [MAIN ] INFY: Generated 1807 derivative records from 53988 primary records. [2025-09-25T22:21:51.277054] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-25T22:21:51.322085] [DEBUG] [LOCAL ] ING: Derivative data saved (1807 records). [2025-09-25T22:21:51.323090] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-25T22:21:51.326573] [INFO ] [MAIN ] Derivative Progress: 902/2043 symbols completed. ING took 1.3s. Estimated remaining: 8m 4s. Rate: 141.5 symbols/min [2025-09-25T22:21:51.328512] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:51.342207] [DEBUG] [LOCAL ] INFY: Derivative data saved (1807 records). [2025-09-25T22:21:51.343080] [DEBUG] [LOCAL ] INGR: Loaded 33657 existing records from primary storage. [2025-09-25T22:21:51.343472] [INFO ] [MAIN ] INGR: Loaded 33657 primary data records. [2025-09-25T22:21:51.343386] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-25T22:21:51.346394] [INFO ] [MAIN ] Derivative Progress: 903/2043 symbols completed. INFY took 1.3s. Estimated remaining: 8m 3s. Rate: 141.7 symbols/min [2025-09-25T22:21:51.369280] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:51.724936] [DEBUG] [LOCAL ] INN: Loaded 42206 existing records from primary storage. [2025-09-25T22:21:51.726319] [INFO ] [MAIN ] INN: Loaded 42206 primary data records. [2025-09-25T22:21:51.794683] [DEBUG] [LOCAL ] INSP: Loaded 37201 existing records from primary storage. [2025-09-25T22:21:51.795505] [INFO ] [MAIN ] INSP: Loaded 37201 primary data records. [2025-09-25T22:21:52.452868] [DEBUG] [MAIN ] INGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:52.453991] [INFO ] [MAIN ] INGR: Generated 1807 derivative records from 33657 primary records. [2025-09-25T22:21:52.454266] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-25T22:21:52.473819] [DEBUG] [LOCAL ] INGR: Derivative data saved (1807 records). [2025-09-25T22:21:52.474192] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-25T22:21:52.477181] [INFO ] [MAIN ] Derivative Progress: 904/2043 symbols completed. INGR took 1.2s. Estimated remaining: 8m 3s. Rate: 141.4 symbols/min [2025-09-25T22:21:52.477815] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:52.497668] [DEBUG] [MAIN ] INN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:52.499429] [INFO ] [MAIN ] INN: Generated 1807 derivative records from 42206 primary records. [2025-09-25T22:21:52.499635] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-25T22:21:52.522865] [DEBUG] [MAIN ] INSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:52.527281] [INFO ] [MAIN ] INSP: Generated 1807 derivative records from 37201 primary records. [2025-09-25T22:21:52.528683] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-25T22:21:52.531590] [DEBUG] [LOCAL ] INN: Derivative data saved (1807 records). [2025-09-25T22:21:52.532681] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-25T22:21:52.535259] [INFO ] [MAIN ] Derivative Progress: 905/2043 symbols completed. INN took 1.2s. Estimated remaining: 8m 2s. Rate: 141.6 symbols/min [2025-09-25T22:21:52.543042] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:52.562293] [DEBUG] [LOCAL ] INSP: Derivative data saved (1807 records). [2025-09-25T22:21:52.562466] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-25T22:21:52.565080] [INFO ] [MAIN ] Derivative Progress: 906/2043 symbols completed. INSP took 1.2s. Estimated remaining: 8m 1s. Rate: 141.7 symbols/min [2025-09-25T22:21:52.578256] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:52.579428] [DEBUG] [LOCAL ] INSW: Loaded 40590 existing records from primary storage. [2025-09-25T22:21:52.579966] [INFO ] [MAIN ] INSW: Loaded 40590 primary data records. [2025-09-25T22:21:52.825537] [DEBUG] [LOCAL ] INVX: Loaded 29093 existing records from primary storage. [2025-09-25T22:21:52.840828] [INFO ] [MAIN ] INVX: Loaded 29093 primary data records. [2025-09-25T22:21:52.996027] [DEBUG] [LOCAL ] INVH: Loaded 53530 existing records from primary storage. [2025-09-25T22:21:53.002040] [INFO ] [MAIN ] INVH: Loaded 53530 primary data records. [2025-09-25T22:21:53.741668] [DEBUG] [MAIN ] INSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:53.743278] [INFO ] [MAIN ] INSW: Generated 1807 derivative records from 40590 primary records. [2025-09-25T22:21:53.743839] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-25T22:21:53.764432] [DEBUG] [LOCAL ] INSW: Derivative data saved (1807 records). [2025-09-25T22:21:53.766738] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-25T22:21:53.769776] [INFO ] [MAIN ] Derivative Progress: 907/2043 symbols completed. INSW took 1.3s. Estimated remaining: 8m 2s. Rate: 141.4 symbols/min [2025-09-25T22:21:53.770402] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:53.789611] [DEBUG] [MAIN ] INVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:53.804061] [INFO ] [MAIN ] INVX: Generated 1807 derivative records from 29093 primary records. [2025-09-25T22:21:53.804675] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-25T22:21:53.805059] [DEBUG] [MAIN ] INVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:53.807155] [INFO ] [MAIN ] INVH: Generated 1807 derivative records from 53530 primary records. [2025-09-25T22:21:53.807551] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-25T22:21:53.837523] [DEBUG] [LOCAL ] INVH: Derivative data saved (1807 records). [2025-09-25T22:21:53.837994] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-25T22:21:53.841524] [INFO ] [MAIN ] Derivative Progress: 908/2043 symbols completed. INVH took 1.3s. Estimated remaining: 8m 1s. Rate: 141.5 symbols/min [2025-09-25T22:21:53.842281] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:53.847570] [DEBUG] [LOCAL ] INVX: Derivative data saved (1807 records). [2025-09-25T22:21:53.847837] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-25T22:21:53.850438] [INFO ] [MAIN ] Derivative Progress: 909/2043 symbols completed. INVX took 1.3s. Estimated remaining: 8m 0s. Rate: 141.7 symbols/min [2025-09-25T22:21:53.850987] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:53.920212] [DEBUG] [LOCAL ] IONQ: Loaded 54178 existing records from primary storage. [2025-09-25T22:21:53.920675] [INFO ] [MAIN ] IONQ: Loaded 54178 primary data records. [2025-09-25T22:21:54.030463] [DEBUG] [LOCAL ] IOT: Loaded 53859 existing records from primary storage. [2025-09-25T22:21:54.035899] [INFO ] [MAIN ] IOT: Loaded 53859 primary data records. [2025-09-25T22:21:54.296274] [DEBUG] [LOCAL ] IP: Loaded 53703 existing records from primary storage. [2025-09-25T22:21:54.421952] [INFO ] [MAIN ] IP: Loaded 53703 primary data records. [2025-09-25T22:21:55.009817] [DEBUG] [MAIN ] IONQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:55.011874] [INFO ] [MAIN ] IONQ: Generated 1807 derivative records from 54178 primary records. [2025-09-25T22:21:55.012026] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-25T22:21:55.044581] [DEBUG] [MAIN ] IOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:55.046238] [INFO ] [MAIN ] IOT: Generated 1807 derivative records from 53859 primary records. [2025-09-25T22:21:55.047168] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1807 records). [2025-09-25T22:21:55.047328] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-25T22:21:55.047573] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-25T22:21:55.050090] [INFO ] [MAIN ] Derivative Progress: 910/2043 symbols completed. IONQ took 1.3s. Estimated remaining: 8m 1s. Rate: 141.4 symbols/min [2025-09-25T22:21:55.051474] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:55.068289] [DEBUG] [LOCAL ] IOT: Derivative data saved (1807 records). [2025-09-25T22:21:55.068451] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-25T22:21:55.071117] [INFO ] [MAIN ] Derivative Progress: 911/2043 symbols completed. IOT took 1.2s. Estimated remaining: 7m 60s. Rate: 141.6 symbols/min [2025-09-25T22:21:55.071523] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:55.090245] [DEBUG] [MAIN ] IP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:55.091343] [INFO ] [MAIN ] IP: Generated 1807 derivative records from 53703 primary records. [2025-09-25T22:21:55.091440] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-25T22:21:55.126026] [DEBUG] [LOCAL ] IP: Derivative data saved (1807 records). [2025-09-25T22:21:55.127240] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-25T22:21:55.126943] [DEBUG] [LOCAL ] IPI: Loaded 21545 existing records from primary storage. [2025-09-25T22:21:55.127384] [INFO ] [MAIN ] IPI: Loaded 21545 primary data records. [2025-09-25T22:21:55.130291] [INFO ] [MAIN ] Derivative Progress: 912/2043 symbols completed. IP took 1.3s. Estimated remaining: 7m 59s. Rate: 141.7 symbols/min [2025-09-25T22:21:55.130937] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:55.311809] [DEBUG] [LOCAL ] IQI: Loaded 18062 existing records from primary storage. [2025-09-25T22:21:55.349325] [DEBUG] [LOCAL ] IPG: Loaded 53721 existing records from primary storage. [2025-09-25T22:21:55.355701] [INFO ] [MAIN ] IPG: Loaded 53721 primary data records. [2025-09-25T22:21:55.342382] [INFO ] [MAIN ] IQI: Loaded 18062 primary data records. [2025-09-25T22:21:56.244628] [DEBUG] [MAIN ] IPI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:56.245555] [INFO ] [MAIN ] IPI: Generated 1807 derivative records from 21545 primary records. [2025-09-25T22:21:56.246039] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-25T22:21:56.266260] [DEBUG] [LOCAL ] IPI: Derivative data saved (1807 records). [2025-09-25T22:21:56.268266] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-25T22:21:56.270603] [INFO ] [MAIN ] Derivative Progress: 913/2043 symbols completed. IPI took 1.2s. Estimated remaining: 7m 59s. Rate: 141.4 symbols/min [2025-09-25T22:21:56.284830] [DEBUG] [MAIN ] IPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:56.285511] [INFO ] [MAIN ] IPG: Generated 1807 derivative records from 53721 primary records. [2025-09-25T22:21:56.285790] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-25T22:21:56.304242] [DEBUG] [LOCAL ] IPG: Derivative data saved (1807 records). [2025-09-25T22:21:56.304413] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-25T22:21:56.307020] [INFO ] [MAIN ] Derivative Progress: 914/2043 symbols completed. IPG took 1.3s. Estimated remaining: 7m 58s. Rate: 141.6 symbols/min [2025-09-25T22:21:56.320238] [DEBUG] [MAIN ] IQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:56.320910] [INFO ] [MAIN ] IQI: Generated 1807 derivative records from 18062 primary records. [2025-09-25T22:21:56.320973] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-25T22:21:56.336306] [DEBUG] [LOCAL ] IQI: Derivative data saved (1807 records). [2025-09-25T22:21:56.336376] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-25T22:21:56.339155] [INFO ] [MAIN ] Derivative Progress: 915/2043 symbols completed. IQI took 1.2s. Estimated remaining: 7m 58s. Rate: 141.7 symbols/min [2025-09-25T22:21:56.339916] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:56.340016] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:56.339859] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:56.431803] [DEBUG] [LOCAL ] IRM: Loaded 49808 existing records from primary storage. [2025-09-25T22:21:56.433879] [INFO ] [MAIN ] IRM: Loaded 49808 primary data records. [2025-09-25T22:21:56.447841] [DEBUG] [LOCAL ] IQV: Loaded 50564 existing records from primary storage. [2025-09-25T22:21:56.449201] [INFO ] [MAIN ] IQV: Loaded 50564 primary data records. [2025-09-25T22:21:56.493621] [DEBUG] [LOCAL ] IR: Loaded 53084 existing records from primary storage. [2025-09-25T22:21:56.526719] [INFO ] [MAIN ] IR: Loaded 53084 primary data records. [2025-09-25T22:21:57.441372] [DEBUG] [MAIN ] IR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:57.444953] [INFO ] [MAIN ] IR: Generated 1807 derivative records from 53084 primary records. [2025-09-25T22:21:57.452825] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-25T22:21:57.459117] [DEBUG] [MAIN ] IRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:57.481497] [INFO ] [MAIN ] IRM: Generated 1807 derivative records from 49808 primary records. [2025-09-25T22:21:57.485153] [DEBUG] [MAIN ] IQV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:57.488172] [INFO ] [MAIN ] IQV: Generated 1807 derivative records from 50564 primary records. [2025-09-25T22:21:57.490218] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-25T22:21:57.488701] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-25T22:21:57.490302] [DEBUG] [LOCAL ] IR: Derivative data saved (1807 records). [2025-09-25T22:21:57.511005] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-25T22:21:57.520025] [INFO ] [MAIN ] Derivative Progress: 916/2043 symbols completed. IR took 1.2s. Estimated remaining: 7m 58s. Rate: 141.4 symbols/min [2025-09-25T22:21:57.520725] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:57.525183] [DEBUG] [LOCAL ] IRM: Derivative data saved (1807 records). [2025-09-25T22:21:57.525841] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-25T22:21:57.528347] [INFO ] [MAIN ] Derivative Progress: 917/2043 symbols completed. IRM took 1.2s. Estimated remaining: 7m 57s. Rate: 141.6 symbols/min [2025-09-25T22:21:57.529390] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:57.533343] [DEBUG] [LOCAL ] IQV: Derivative data saved (1807 records). [2025-09-25T22:21:57.533563] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-25T22:21:57.536429] [INFO ] [MAIN ] Derivative Progress: 918/2043 symbols completed. IQV took 1.2s. Estimated remaining: 7m 56s. Rate: 141.7 symbols/min [2025-09-25T22:21:57.536982] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:57.565137] [DEBUG] [LOCAL ] IRS: Loaded 21983 existing records from primary storage. [2025-09-25T22:21:57.565503] [INFO ] [MAIN ] IRS: Loaded 21983 primary data records. [2025-09-25T22:21:57.640897] [DEBUG] [LOCAL ] ISD: Loaded 15685 existing records from primary storage. [2025-09-25T22:21:57.660262] [INFO ] [MAIN ] ISD: Loaded 15685 primary data records. [2025-09-25T22:21:57.924796] [DEBUG] [LOCAL ] IRT: Loaded 50769 existing records from primary storage. [2025-09-25T22:21:57.935683] [INFO ] [MAIN ] IRT: Loaded 50769 primary data records. [2025-09-25T22:21:58.672984] [DEBUG] [MAIN ] IRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:58.674274] [INFO ] [MAIN ] IRS: Generated 1807 derivative records from 21983 primary records. [2025-09-25T22:21:58.674670] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-25T22:21:58.699904] [DEBUG] [MAIN ] ISD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:58.707752] [DEBUG] [LOCAL ] IRS: Derivative data saved (1807 records). [2025-09-25T22:21:58.708881] [INFO ] [MAIN ] ISD: Generated 1807 derivative records from 15685 primary records. [2025-09-25T22:21:58.709158] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-25T22:21:58.709710] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-25T22:21:58.711961] [INFO ] [MAIN ] Derivative Progress: 919/2043 symbols completed. IRS took 1.2s. Estimated remaining: 7m 57s. Rate: 141.5 symbols/min [2025-09-25T22:21:58.713707] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:58.745430] [DEBUG] [MAIN ] IRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:58.747393] [INFO ] [MAIN ] IRT: Generated 1807 derivative records from 50769 primary records. [2025-09-25T22:21:58.747983] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-25T22:21:58.758527] [DEBUG] [LOCAL ] ISD: Derivative data saved (1807 records). [2025-09-25T22:21:58.764057] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-25T22:21:58.771289] [INFO ] [MAIN ] Derivative Progress: 920/2043 symbols completed. ISD took 1.2s. Estimated remaining: 7m 56s. Rate: 141.6 symbols/min [2025-09-25T22:21:58.778104] [DEBUG] [LOCAL ] IRT: Derivative data saved (1807 records). [2025-09-25T22:21:58.773006] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:58.778525] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-25T22:21:58.781984] [INFO ] [MAIN ] Derivative Progress: 921/2043 symbols completed. IRT took 1.3s. Estimated remaining: 7m 55s. Rate: 141.8 symbols/min [2025-09-25T22:21:58.782567] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:58.814026] [DEBUG] [LOCAL ] IT: Loaded 41941 existing records from primary storage. [2025-09-25T22:21:58.814332] [INFO ] [MAIN ] IT: Loaded 41941 primary data records. [2025-09-25T22:21:58.972796] [DEBUG] [LOCAL ] ITGR: Loaded 31817 existing records from primary storage. [2025-09-25T22:21:58.978711] [INFO ] [MAIN ] ITGR: Loaded 31817 primary data records. [2025-09-25T22:21:58.994787] [DEBUG] [LOCAL ] ITT: Loaded 33310 existing records from primary storage. [2025-09-25T22:21:59.093009] [INFO ] [MAIN ] ITT: Loaded 33310 primary data records. [2025-09-25T22:21:59.931298] [DEBUG] [MAIN ] IT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:21:59.933245] [INFO ] [MAIN ] IT: Generated 1806 derivative records from 41941 primary records. [2025-09-25T22:21:59.933512] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-25T22:21:59.953869] [DEBUG] [LOCAL ] IT: Derivative data saved (1806 records). [2025-09-25T22:21:59.954237] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-25T22:21:59.958366] [INFO ] [MAIN ] Derivative Progress: 922/2043 symbols completed. IT took 1.2s. Estimated remaining: 7m 55s. Rate: 141.5 symbols/min [2025-09-25T22:21:59.959407] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:21:59.976559] [DEBUG] [MAIN ] ITGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:21:59.977527] [INFO ] [MAIN ] ITGR: Generated 1807 derivative records from 31817 primary records. [2025-09-25T22:21:59.977761] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-25T22:22:00.007551] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1807 records). [2025-09-25T22:22:00.003204] [DEBUG] [MAIN ] ITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:00.008448] [INFO ] [MAIN ] ITT: Generated 1807 derivative records from 33310 primary records. [2025-09-25T22:22:00.008576] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-25T22:22:00.008633] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-25T22:22:00.013712] [INFO ] [MAIN ] Derivative Progress: 923/2043 symbols completed. ITGR took 1.2s. Estimated remaining: 7m 55s. Rate: 141.6 symbols/min [2025-09-25T22:22:00.022050] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:00.031443] [DEBUG] [LOCAL ] ITT: Derivative data saved (1807 records). [2025-09-25T22:22:00.031629] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-25T22:22:00.034590] [INFO ] [MAIN ] Derivative Progress: 924/2043 symbols completed. ITT took 1.3s. Estimated remaining: 7m 54s. Rate: 141.8 symbols/min [2025-09-25T22:22:00.035056] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:00.078146] [DEBUG] [LOCAL ] ITUB: Loaded 53694 existing records from primary storage. [2025-09-25T22:22:00.088735] [INFO ] [MAIN ] ITUB: Loaded 53694 primary data records. [2025-09-25T22:22:00.264216] [DEBUG] [LOCAL ] ITW: Loaded 46541 existing records from primary storage. [2025-09-25T22:22:00.294785] [INFO ] [MAIN ] ITW: Loaded 46541 primary data records. [2025-09-25T22:22:00.321155] [DEBUG] [LOCAL ] IVR: Loaded 48228 existing records from primary storage. [2025-09-25T22:22:00.455934] [INFO ] [MAIN ] IVR: Loaded 48228 primary data records. [2025-09-25T22:22:01.152392] [DEBUG] [MAIN ] ITUB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:01.153870] [INFO ] [MAIN ] ITUB: Generated 1807 derivative records from 53694 primary records. [2025-09-25T22:22:01.154987] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-25T22:22:01.177299] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1807 records). [2025-09-25T22:22:01.177468] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-25T22:22:01.179733] [INFO ] [MAIN ] Derivative Progress: 925/2043 symbols completed. ITUB took 1.2s. Estimated remaining: 7m 54s. Rate: 141.5 symbols/min [2025-09-25T22:22:01.180291] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:01.200697] [DEBUG] [MAIN ] ITW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:01.201938] [INFO ] [MAIN ] ITW: Generated 1807 derivative records from 46541 primary records. [2025-09-25T22:22:01.202154] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-25T22:22:01.221988] [DEBUG] [LOCAL ] ITW: Derivative data saved (1807 records). [2025-09-25T22:22:01.222325] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-25T22:22:01.225620] [INFO ] [MAIN ] Derivative Progress: 926/2043 symbols completed. ITW took 1.2s. Estimated remaining: 7m 53s. Rate: 141.6 symbols/min [2025-09-25T22:22:01.227347] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:01.255133] [DEBUG] [MAIN ] IVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:01.256237] [INFO ] [MAIN ] IVR: Generated 1807 derivative records from 48228 primary records. [2025-09-25T22:22:01.256389] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-25T22:22:01.289324] [DEBUG] [LOCAL ] IVR: Derivative data saved (1807 records). [2025-09-25T22:22:01.289725] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-25T22:22:01.291098] [DEBUG] [LOCAL ] IVT: Loaded 31117 existing records from primary storage. [2025-09-25T22:22:01.295757] [INFO ] [MAIN ] Derivative Progress: 927/2043 symbols completed. IVR took 1.3s. Estimated remaining: 7m 52s. Rate: 141.8 symbols/min [2025-09-25T22:22:01.296671] [INFO ] [MAIN ] IVT: Loaded 31117 primary data records. [2025-09-25T22:22:01.296892] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:01.505881] [DEBUG] [LOCAL ] IX: Loaded 22798 existing records from primary storage. [2025-09-25T22:22:01.667911] [INFO ] [MAIN ] IX: Loaded 22798 primary data records. [2025-09-25T22:22:01.701313] [DEBUG] [LOCAL ] IVZ: Loaded 53522 existing records from primary storage. [2025-09-25T22:22:01.738710] [INFO ] [MAIN ] IVZ: Loaded 53522 primary data records. [2025-09-25T22:22:02.451461] [DEBUG] [MAIN ] IVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:02.453172] [INFO ] [MAIN ] IVT: Generated 1807 derivative records from 31117 primary records. [2025-09-25T22:22:02.453999] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-25T22:22:02.472869] [DEBUG] [LOCAL ] IVT: Derivative data saved (1807 records). [2025-09-25T22:22:02.474552] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-25T22:22:02.477568] [INFO ] [MAIN ] Derivative Progress: 928/2043 symbols completed. IVT took 1.3s. Estimated remaining: 7m 53s. Rate: 141.5 symbols/min [2025-09-25T22:22:02.495999] [DEBUG] [MAIN ] IX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:02.497299] [INFO ] [MAIN ] IX: Generated 1807 derivative records from 22798 primary records. [2025-09-25T22:22:02.497584] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-25T22:22:02.517415] [DEBUG] [LOCAL ] IX: Derivative data saved (1807 records). [2025-09-25T22:22:02.517817] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-25T22:22:02.520201] [INFO ] [MAIN ] Derivative Progress: 929/2043 symbols completed. IX took 1.2s. Estimated remaining: 7m 52s. Rate: 141.6 symbols/min [2025-09-25T22:22:02.533265] [DEBUG] [MAIN ] IVZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:02.534041] [INFO ] [MAIN ] IVZ: Generated 1807 derivative records from 53522 primary records. [2025-09-25T22:22:02.534108] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-25T22:22:02.550301] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1807 records). [2025-09-25T22:22:02.550397] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-25T22:22:02.553624] [INFO ] [MAIN ] Derivative Progress: 930/2043 symbols completed. IVZ took 1.3s. Estimated remaining: 7m 51s. Rate: 141.8 symbols/min [2025-09-25T22:22:02.554408] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:02.554963] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:02.554684] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:02.620255] [DEBUG] [LOCAL ] J: Loaded 40657 existing records from primary storage. [2025-09-25T22:22:02.643889] [INFO ] [MAIN ] J: Loaded 40657 primary data records. [2025-09-25T22:22:02.680950] [DEBUG] [LOCAL ] JBI: Loaded 44143 existing records from primary storage. [2025-09-25T22:22:02.681096] [DEBUG] [LOCAL ] JBGS: Loaded 42776 existing records from primary storage. [2025-09-25T22:22:02.693795] [INFO ] [MAIN ] JBI: Loaded 44143 primary data records. [2025-09-25T22:22:02.716245] [INFO ] [MAIN ] JBGS: Loaded 42776 primary data records. [2025-09-25T22:22:03.675110] [DEBUG] [MAIN ] J: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:03.676230] [INFO ] [MAIN ] J: Generated 1807 derivative records from 40657 primary records. [2025-09-25T22:22:03.676337] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-25T22:22:03.699969] [DEBUG] [LOCAL ] J: Derivative data saved (1807 records). [2025-09-25T22:22:03.728099] [DEBUG] [MAIN ] JBGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:03.727477] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-25T22:22:03.729741] [INFO ] [MAIN ] JBGS: Generated 1807 derivative records from 42776 primary records. [2025-09-25T22:22:03.731904] [INFO ] [MAIN ] Derivative Progress: 931/2043 symbols completed. J took 1.2s. Estimated remaining: 7m 52s. Rate: 141.5 symbols/min [2025-09-25T22:22:03.728708] [DEBUG] [MAIN ] JBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:03.733502] [INFO ] [MAIN ] JBI: Generated 1807 derivative records from 44143 primary records. [2025-09-25T22:22:03.732095] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-25T22:22:03.733732] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:03.734743] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-25T22:22:03.766950] [DEBUG] [LOCAL ] JBI: Derivative data saved (1807 records). [2025-09-25T22:22:03.767626] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-25T22:22:03.771539] [INFO ] [MAIN ] Derivative Progress: 932/2043 symbols completed. JBI took 1.2s. Estimated remaining: 7m 51s. Rate: 141.6 symbols/min [2025-09-25T22:22:03.772745] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:03.780802] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1807 records). [2025-09-25T22:22:03.781032] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-25T22:22:03.783955] [INFO ] [MAIN ] Derivative Progress: 933/2043 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 50s. Rate: 141.8 symbols/min [2025-09-25T22:22:03.784291] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:03.789750] [DEBUG] [LOCAL ] JCE: Loaded 6504 existing records from primary storage. [2025-09-25T22:22:03.790479] [INFO ] [MAIN ] JCE: Loaded 6504 primary data records. [2025-09-25T22:22:04.028742] [DEBUG] [LOCAL ] JBL: Loaded 48770 existing records from primary storage. [2025-09-25T22:22:04.151680] [INFO ] [MAIN ] JBL: Loaded 48770 primary data records. [2025-09-25T22:22:04.361057] [DEBUG] [LOCAL ] JCI: Loaded 53937 existing records from primary storage. [2025-09-25T22:22:04.388692] [INFO ] [MAIN ] JCI: Loaded 53937 primary data records. [2025-09-25T22:22:04.810042] [DEBUG] [MAIN ] JCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:04.937291] [INFO ] [MAIN ] JCE: Generated 1807 derivative records from 6504 primary records. [2025-09-25T22:22:04.939181] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-25T22:22:04.957603] [DEBUG] [LOCAL ] JCE: Derivative data saved (1807 records). [2025-09-25T22:22:04.958068] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-25T22:22:04.960155] [INFO ] [MAIN ] Derivative Progress: 934/2043 symbols completed. JCE took 1.2s. Estimated remaining: 7m 50s. Rate: 141.5 symbols/min [2025-09-25T22:22:04.960820] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:04.983498] [DEBUG] [MAIN ] JBL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:04.985585] [INFO ] [MAIN ] JBL: Generated 1807 derivative records from 48770 primary records. [2025-09-25T22:22:04.985802] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-25T22:22:05.007409] [DEBUG] [LOCAL ] JBL: Derivative data saved (1807 records). [2025-09-25T22:22:05.007878] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-25T22:22:05.010562] [INFO ] [MAIN ] Derivative Progress: 935/2043 symbols completed. JBL took 1.3s. Estimated remaining: 7m 49s. Rate: 141.6 symbols/min [2025-09-25T22:22:05.010908] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:05.041315] [DEBUG] [MAIN ] JCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:05.042324] [INFO ] [MAIN ] JCI: Generated 1807 derivative records from 53937 primary records. [2025-09-25T22:22:05.042492] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-25T22:22:05.076421] [DEBUG] [LOCAL ] JEF: Loaded 50382 existing records from primary storage. [2025-09-25T22:22:05.077284] [INFO ] [MAIN ] JEF: Loaded 50382 primary data records. [2025-09-25T22:22:05.154106] [DEBUG] [LOCAL ] JCI: Derivative data saved (1807 records). [2025-09-25T22:22:05.169911] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-25T22:22:05.183745] [INFO ] [MAIN ] Derivative Progress: 936/2043 symbols completed. JCI took 1.4s. Estimated remaining: 7m 49s. Rate: 141.7 symbols/min [2025-09-25T22:22:05.218484] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:05.279970] [DEBUG] [LOCAL ] JELD: Loaded 46491 existing records from primary storage. [2025-09-25T22:22:05.300156] [INFO ] [MAIN ] JELD: Loaded 46491 primary data records. [2025-09-25T22:22:05.513851] [DEBUG] [LOCAL ] JEQ: Loaded 9203 existing records from primary storage. [2025-09-25T22:22:05.531253] [INFO ] [MAIN ] JEQ: Loaded 9203 primary data records. [2025-09-25T22:22:06.155452] [DEBUG] [MAIN ] JEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:06.157025] [INFO ] [MAIN ] JEF: Generated 1807 derivative records from 50382 primary records. [2025-09-25T22:22:06.157302] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-25T22:22:06.183890] [DEBUG] [LOCAL ] JEF: Derivative data saved (1807 records). [2025-09-25T22:22:06.184540] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-25T22:22:06.187404] [INFO ] [MAIN ] Derivative Progress: 937/2043 symbols completed. JEF took 1.2s. Estimated remaining: 7m 49s. Rate: 141.5 symbols/min [2025-09-25T22:22:06.196810] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:06.202985] [DEBUG] [MAIN ] JELD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:06.204264] [INFO ] [MAIN ] JELD: Generated 1807 derivative records from 46491 primary records. [2025-09-25T22:22:06.204763] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-25T22:22:06.242378] [DEBUG] [MAIN ] JEQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:06.244011] [INFO ] [MAIN ] JEQ: Generated 1807 derivative records from 9203 primary records. [2025-09-25T22:22:06.244603] [DEBUG] [LOCAL ] JELD: Derivative data saved (1807 records). [2025-09-25T22:22:06.244896] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-25T22:22:06.245210] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-25T22:22:06.258902] [INFO ] [MAIN ] Derivative Progress: 938/2043 symbols completed. JELD took 1.2s. Estimated remaining: 7m 48s. Rate: 141.7 symbols/min [2025-09-25T22:22:06.260223] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:06.276692] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1807 records). [2025-09-25T22:22:06.286839] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-25T22:22:06.292148] [INFO ] [MAIN ] Derivative Progress: 939/2043 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 47s. Rate: 141.8 symbols/min [2025-09-25T22:22:06.292770] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:06.297417] [DEBUG] [LOCAL ] JFR: Loaded 30635 existing records from primary storage. [2025-09-25T22:22:06.298463] [INFO ] [MAIN ] JFR: Loaded 30635 primary data records. [2025-09-25T22:22:06.339043] [DEBUG] [LOCAL ] JGH: Loaded 11018 existing records from primary storage. [2025-09-25T22:22:06.374301] [INFO ] [MAIN ] JGH: Loaded 11018 primary data records. [2025-09-25T22:22:06.896700] [DEBUG] [LOCAL ] JHG: Loaded 48212 existing records from primary storage. [2025-09-25T22:22:06.903173] [INFO ] [MAIN ] JHG: Loaded 48212 primary data records. [2025-09-25T22:22:07.430917] [DEBUG] [MAIN ] JFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:07.433344] [INFO ] [MAIN ] JFR: Generated 1807 derivative records from 30635 primary records. [2025-09-25T22:22:07.433683] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-25T22:22:07.466915] [DEBUG] [MAIN ] JGH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:07.468597] [INFO ] [MAIN ] JGH: Generated 1807 derivative records from 11018 primary records. [2025-09-25T22:22:07.468937] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-25T22:22:07.486695] [DEBUG] [LOCAL ] JFR: Derivative data saved (1807 records). [2025-09-25T22:22:07.487000] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-25T22:22:07.489571] [INFO ] [MAIN ] Derivative Progress: 940/2043 symbols completed. JFR took 1.3s. Estimated remaining: 7m 48s. Rate: 141.5 symbols/min [2025-09-25T22:22:07.491326] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:07.497616] [DEBUG] [LOCAL ] JGH: Derivative data saved (1807 records). [2025-09-25T22:22:07.503556] [DEBUG] [LOCAL ] JHI: Loaded 3617 existing records from primary storage. [2025-09-25T22:22:07.503351] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-25T22:22:07.508539] [INFO ] [MAIN ] Derivative Progress: 941/2043 symbols completed. JGH took 1.2s. Estimated remaining: 7m 47s. Rate: 141.7 symbols/min [2025-09-25T22:22:07.504615] [INFO ] [MAIN ] JHI: Loaded 3617 primary data records. [2025-09-25T22:22:07.520481] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:07.641553] [DEBUG] [LOCAL ] JHS: Loaded 2864 existing records from primary storage. [2025-09-25T22:22:07.633871] [DEBUG] [MAIN ] JHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:07.642424] [INFO ] [MAIN ] JHS: Loaded 2864 primary data records. [2025-09-25T22:22:07.659268] [INFO ] [MAIN ] JHG: Generated 1807 derivative records from 48212 primary records. [2025-09-25T22:22:07.681868] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-25T22:22:08.010387] [DEBUG] [LOCAL ] JHG: Derivative data saved (1807 records). [2025-09-25T22:22:08.019637] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-25T22:22:08.026627] [INFO ] [MAIN ] Derivative Progress: 942/2043 symbols completed. JHG took 1.7s. Estimated remaining: 7m 46s. Rate: 141.6 symbols/min [2025-09-25T22:22:08.027525] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:08.259994] [DEBUG] [MAIN ] JHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:08.261156] [INFO ] [MAIN ] JHI: Generated 1807 derivative records from 3617 primary records. [2025-09-25T22:22:08.261427] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-25T22:22:08.296552] [DEBUG] [LOCAL ] JHI: Derivative data saved (1807 records). [2025-09-25T22:22:08.296997] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-25T22:22:08.300785] [INFO ] [MAIN ] Derivative Progress: 943/2043 symbols completed. JHI took 0.8s. Estimated remaining: 7m 46s. Rate: 141.7 symbols/min [2025-09-25T22:22:08.334814] [DEBUG] [MAIN ] JHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:08.335796] [INFO ] [MAIN ] JHS: Generated 1807 derivative records from 2864 primary records. [2025-09-25T22:22:08.335892] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-25T22:22:08.337458] [DEBUG] [LOCAL ] JHX: Loaded 50827 existing records from primary storage. [2025-09-25T22:22:08.338333] [INFO ] [MAIN ] JHX: Loaded 50827 primary data records. [2025-09-25T22:22:08.464390] [DEBUG] [LOCAL ] JHS: Derivative data saved (1807 records). [2025-09-25T22:22:08.464997] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-25T22:22:08.468939] [INFO ] [MAIN ] Derivative Progress: 944/2043 symbols completed. JHS took 1.0s. Estimated remaining: 7m 45s. Rate: 141.8 symbols/min [2025-09-25T22:22:08.732608] [DEBUG] [MAIN ] JHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:08.733351] [INFO ] [MAIN ] JHX: Generated 1807 derivative records from 50827 primary records. [2025-09-25T22:22:08.733415] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-25T22:22:08.749282] [DEBUG] [LOCAL ] JHX: Derivative data saved (1807 records). [2025-09-25T22:22:08.749358] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-25T22:22:08.752228] [INFO ] [MAIN ] Derivative Progress: 945/2043 symbols completed. JHX took 0.7s. Estimated remaining: 7m 45s. Rate: 141.8 symbols/min [2025-09-25T22:22:08.753581] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:08.753345] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:08.753926] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:08.781937] [DEBUG] [LOCAL ] JILL: Loaded 16873 existing records from primary storage. [2025-09-25T22:22:08.782242] [INFO ] [MAIN ] JILL: Loaded 16873 primary data records. [2025-09-25T22:22:08.970038] [DEBUG] [LOCAL ] JLL: Loaded 32288 existing records from primary storage. [2025-09-25T22:22:09.033806] [DEBUG] [LOCAL ] JKS: Loaded 40399 existing records from primary storage. [2025-09-25T22:22:08.992171] [INFO ] [MAIN ] JLL: Loaded 32288 primary data records. [2025-09-25T22:22:09.043504] [INFO ] [MAIN ] JKS: Loaded 40399 primary data records. [2025-09-25T22:22:09.907299] [DEBUG] [MAIN ] JILL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:09.908955] [INFO ] [MAIN ] JILL: Generated 1807 derivative records from 16873 primary records. [2025-09-25T22:22:09.910240] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-25T22:22:09.937181] [DEBUG] [LOCAL ] JILL: Derivative data saved (1807 records). [2025-09-25T22:22:09.938146] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-25T22:22:09.940868] [INFO ] [MAIN ] Derivative Progress: 946/2043 symbols completed. JILL took 1.2s. Estimated remaining: 7m 45s. Rate: 141.5 symbols/min [2025-09-25T22:22:09.941351] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:09.982488] [DEBUG] [MAIN ] JLL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:09.984327] [INFO ] [MAIN ] JLL: Generated 1807 derivative records from 32288 primary records. [2025-09-25T22:22:09.982943] [DEBUG] [LOCAL ] JLS: Loaded 4110 existing records from primary storage. [2025-09-25T22:22:09.984945] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-25T22:22:09.984836] [DEBUG] [MAIN ] JKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:09.985346] [INFO ] [MAIN ] JLS: Loaded 4110 primary data records. [2025-09-25T22:22:09.992772] [INFO ] [MAIN ] JKS: Generated 1807 derivative records from 40399 primary records. [2025-09-25T22:22:10.027912] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-25T22:22:10.063773] [DEBUG] [LOCAL ] JLL: Derivative data saved (1807 records). [2025-09-25T22:22:10.079683] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-25T22:22:10.121490] [INFO ] [MAIN ] Derivative Progress: 947/2043 symbols completed. JLL took 1.4s. Estimated remaining: 7m 44s. Rate: 141.6 symbols/min [2025-09-25T22:22:10.133954] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:10.141179] [DEBUG] [LOCAL ] JKS: Derivative data saved (1807 records). [2025-09-25T22:22:10.147359] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-25T22:22:10.161176] [INFO ] [MAIN ] Derivative Progress: 948/2043 symbols completed. JKS took 1.4s. Estimated remaining: 7m 43s. Rate: 141.8 symbols/min [2025-09-25T22:22:10.173235] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:10.431850] [DEBUG] [LOCAL ] JMIA: Loaded 50895 existing records from primary storage. [2025-09-25T22:22:10.432547] [INFO ] [MAIN ] JMIA: Loaded 50895 primary data records. [2025-09-25T22:22:10.501729] [DEBUG] [MAIN ] JLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:10.531794] [INFO ] [MAIN ] JLS: Generated 1807 derivative records from 4110 primary records. [2025-09-25T22:22:10.585506] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-25T22:22:10.586345] [DEBUG] [LOCAL ] JNJ: Loaded 54143 existing records from primary storage. [2025-09-25T22:22:10.587710] [INFO ] [MAIN ] JNJ: Loaded 54143 primary data records. [2025-09-25T22:22:10.809599] [DEBUG] [LOCAL ] JLS: Derivative data saved (1807 records). [2025-09-25T22:22:11.014823] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-25T22:22:11.052091] [INFO ] [MAIN ] Derivative Progress: 949/2043 symbols completed. JLS took 1.1s. Estimated remaining: 7m 44s. Rate: 141.6 symbols/min [2025-09-25T22:22:11.084786] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:11.268093] [DEBUG] [MAIN ] JMIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:11.269271] [INFO ] [MAIN ] JMIA: Generated 1807 derivative records from 50895 primary records. [2025-09-25T22:22:11.269806] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-25T22:22:11.303103] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1807 records). [2025-09-25T22:22:11.304321] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-25T22:22:11.307043] [INFO ] [MAIN ] Derivative Progress: 950/2043 symbols completed. JMIA took 1.2s. Estimated remaining: 7m 43s. Rate: 141.7 symbols/min [2025-09-25T22:22:11.308154] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:11.323810] [DEBUG] [MAIN ] JNJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:11.340925] [INFO ] [MAIN ] JNJ: Generated 1807 derivative records from 54143 primary records. [2025-09-25T22:22:11.341107] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-25T22:22:11.343037] [DEBUG] [LOCAL ] JOBY: Loaded 54189 existing records from primary storage. [2025-09-25T22:22:11.343699] [INFO ] [MAIN ] JOBY: Loaded 54189 primary data records. [2025-09-25T22:22:11.474005] [DEBUG] [LOCAL ] JOE: Loaded 24733 existing records from primary storage. [2025-09-25T22:22:11.487974] [INFO ] [MAIN ] JOE: Loaded 24733 primary data records. [2025-09-25T22:22:11.511446] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1807 records). [2025-09-25T22:22:11.562880] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-25T22:22:11.590378] [INFO ] [MAIN ] Derivative Progress: 951/2043 symbols completed. JNJ took 1.4s. Estimated remaining: 7m 42s. Rate: 141.7 symbols/min [2025-09-25T22:22:11.611466] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:11.937785] [DEBUG] [LOCAL ] JOF: Loaded 7145 existing records from primary storage. [2025-09-25T22:22:11.938253] [INFO ] [MAIN ] JOF: Loaded 7145 primary data records. [2025-09-25T22:22:12.432950] [DEBUG] [MAIN ] JOBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:12.434373] [INFO ] [MAIN ] JOBY: Generated 1807 derivative records from 54189 primary records. [2025-09-25T22:22:12.434476] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-25T22:22:12.454476] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1807 records). [2025-09-25T22:22:12.454637] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-25T22:22:12.457449] [INFO ] [MAIN ] Derivative Progress: 952/2043 symbols completed. JOBY took 1.4s. Estimated remaining: 7m 42s. Rate: 141.6 symbols/min [2025-09-25T22:22:12.457976] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:12.471702] [DEBUG] [MAIN ] JOE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:12.472964] [INFO ] [MAIN ] JOE: Generated 1807 derivative records from 24733 primary records. [2025-09-25T22:22:12.474050] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-25T22:22:12.490874] [DEBUG] [LOCAL ] JOE: Derivative data saved (1807 records). [2025-09-25T22:22:12.491214] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-25T22:22:12.493617] [INFO ] [MAIN ] Derivative Progress: 953/2043 symbols completed. JOE took 1.2s. Estimated remaining: 7m 42s. Rate: 141.7 symbols/min [2025-09-25T22:22:12.494251] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:12.527434] [DEBUG] [MAIN ] JOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:12.528703] [INFO ] [MAIN ] JOF: Generated 1807 derivative records from 7145 primary records. [2025-09-25T22:22:12.528986] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-25T22:22:12.561705] [DEBUG] [LOCAL ] JPC: Loaded 37351 existing records from primary storage. [2025-09-25T22:22:12.562778] [INFO ] [MAIN ] JPC: Loaded 37351 primary data records. [2025-09-25T22:22:12.625915] [DEBUG] [LOCAL ] JOF: Derivative data saved (1807 records). [2025-09-25T22:22:12.657148] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-25T22:22:12.670193] [INFO ] [MAIN ] Derivative Progress: 954/2043 symbols completed. JOF took 1.1s. Estimated remaining: 7m 41s. Rate: 141.8 symbols/min [2025-09-25T22:22:12.670664] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:12.932220] [DEBUG] [LOCAL ] JPM: Loaded 54184 existing records from primary storage. [2025-09-25T22:22:12.942725] [INFO ] [MAIN ] JPM: Loaded 54184 primary data records. [2025-09-25T22:22:13.097062] [DEBUG] [LOCAL ] JQC: Loaded 33842 existing records from primary storage. [2025-09-25T22:22:13.108380] [INFO ] [MAIN ] JQC: Loaded 33842 primary data records. [2025-09-25T22:22:13.595547] [DEBUG] [MAIN ] JPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:13.606190] [INFO ] [MAIN ] JPC: Generated 1807 derivative records from 37351 primary records. [2025-09-25T22:22:13.733415] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-25T22:22:13.759393] [DEBUG] [LOCAL ] JPC: Derivative data saved (1807 records). [2025-09-25T22:22:13.761372] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-25T22:22:13.765511] [INFO ] [MAIN ] Derivative Progress: 955/2043 symbols completed. JPC took 1.3s. Estimated remaining: 7m 41s. Rate: 141.5 symbols/min [2025-09-25T22:22:13.767341] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:13.783366] [DEBUG] [MAIN ] JPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:13.784514] [INFO ] [MAIN ] JPM: Generated 1807 derivative records from 54184 primary records. [2025-09-25T22:22:13.784938] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-25T22:22:13.808950] [DEBUG] [LOCAL ] JPM: Derivative data saved (1807 records). [2025-09-25T22:22:13.811522] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-25T22:22:13.815794] [INFO ] [MAIN ] Derivative Progress: 956/2043 symbols completed. JPM took 1.3s. Estimated remaining: 7m 40s. Rate: 141.7 symbols/min [2025-09-25T22:22:13.836124] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:13.836948] [DEBUG] [LOCAL ] JRI: Loaded 14986 existing records from primary storage. [2025-09-25T22:22:13.838275] [DEBUG] [MAIN ] JQC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:13.838374] [INFO ] [MAIN ] JRI: Loaded 14986 primary data records. [2025-09-25T22:22:13.840032] [INFO ] [MAIN ] JQC: Generated 1807 derivative records from 33842 primary records. [2025-09-25T22:22:13.853150] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-25T22:22:13.954018] [DEBUG] [LOCAL ] JQC: Derivative data saved (1807 records). [2025-09-25T22:22:13.954199] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-25T22:22:13.981219] [DEBUG] [LOCAL ] JRS: Loaded 11185 existing records from primary storage. [2025-09-25T22:22:13.987685] [INFO ] [MAIN ] Derivative Progress: 957/2043 symbols completed. JQC took 1.3s. Estimated remaining: 7m 40s. Rate: 141.8 symbols/min [2025-09-25T22:22:13.988036] [INFO ] [MAIN ] JRS: Loaded 11185 primary data records. [2025-09-25T22:22:14.036313] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:14.597049] [DEBUG] [LOCAL ] JXN: Loaded 46259 existing records from primary storage. [2025-09-25T22:22:14.597772] [INFO ] [MAIN ] JXN: Loaded 46259 primary data records. [2025-09-25T22:22:14.793425] [DEBUG] [MAIN ] JRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:14.815072] [INFO ] [MAIN ] JRI: Generated 1807 derivative records from 14986 primary records. [2025-09-25T22:22:14.823240] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-25T22:22:14.992618] [DEBUG] [LOCAL ] JRI: Derivative data saved (1807 records). [2025-09-25T22:22:14.993578] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-25T22:22:14.996760] [INFO ] [MAIN ] Derivative Progress: 958/2043 symbols completed. JRI took 1.2s. Estimated remaining: 7m 40s. Rate: 141.6 symbols/min [2025-09-25T22:22:14.994124] [DEBUG] [MAIN ] JRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:14.998480] [INFO ] [MAIN ] JRS: Generated 1807 derivative records from 11185 primary records. [2025-09-25T22:22:14.999258] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-25T22:22:15.018629] [DEBUG] [LOCAL ] JRS: Derivative data saved (1807 records). [2025-09-25T22:22:15.020282] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-25T22:22:15.023827] [INFO ] [MAIN ] Derivative Progress: 959/2043 symbols completed. JRS took 1.2s. Estimated remaining: 7m 39s. Rate: 141.7 symbols/min [2025-09-25T22:22:15.042720] [DEBUG] [MAIN ] JXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:15.043586] [INFO ] [MAIN ] JXN: Generated 1807 derivative records from 46259 primary records. [2025-09-25T22:22:15.043683] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-25T22:22:15.060335] [DEBUG] [LOCAL ] JXN: Derivative data saved (1807 records). [2025-09-25T22:22:15.060408] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-25T22:22:15.063897] [INFO ] [MAIN ] Derivative Progress: 960/2043 symbols completed. JXN took 1.1s. Estimated remaining: 7m 38s. Rate: 141.8 symbols/min [2025-09-25T22:22:15.065035] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:15.065347] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:15.065600] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:15.090350] [DEBUG] [LOCAL ] KAI: Loaded 13650 existing records from primary storage. [2025-09-25T22:22:15.090894] [INFO ] [MAIN ] KAI: Loaded 13650 primary data records. [2025-09-25T22:22:15.272161] [DEBUG] [LOCAL ] KAR: Loaded 40122 existing records from primary storage. [2025-09-25T22:22:15.342377] [INFO ] [MAIN ] KAR: Loaded 40122 primary data records. [2025-09-25T22:22:15.521048] [DEBUG] [LOCAL ] K: Loaded 50249 existing records from primary storage. [2025-09-25T22:22:15.547624] [INFO ] [MAIN ] K: Loaded 50249 primary data records. [2025-09-25T22:22:16.241285] [DEBUG] [MAIN ] KAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:16.245998] [INFO ] [MAIN ] KAI: Generated 1807 derivative records from 13650 primary records. [2025-09-25T22:22:16.246212] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-25T22:22:16.271467] [DEBUG] [LOCAL ] KAI: Derivative data saved (1807 records). [2025-09-25T22:22:16.280551] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-25T22:22:16.284532] [INFO ] [MAIN ] Derivative Progress: 961/2043 symbols completed. KAI took 1.2s. Estimated remaining: 7m 39s. Rate: 141.6 symbols/min [2025-09-25T22:22:16.285667] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:16.293297] [DEBUG] [MAIN ] K: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:16.294677] [INFO ] [MAIN ] K: Generated 1807 derivative records from 50249 primary records. [2025-09-25T22:22:16.294917] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-25T22:22:16.310371] [DEBUG] [MAIN ] KAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:16.320704] [INFO ] [MAIN ] KAR: Generated 1807 derivative records from 40122 primary records. [2025-09-25T22:22:16.324147] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-25T22:22:16.355436] [DEBUG] [LOCAL ] KAR: Derivative data saved (1807 records). [2025-09-25T22:22:16.355307] [DEBUG] [LOCAL ] K: Derivative data saved (1807 records). [2025-09-25T22:22:16.355634] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-25T22:22:16.355975] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-25T22:22:16.358794] [INFO ] [MAIN ] Derivative Progress: 962/2043 symbols completed. KAR took 1.3s. Estimated remaining: 7m 38s. Rate: 141.7 symbols/min [2025-09-25T22:22:16.359226] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:16.362684] [INFO ] [MAIN ] Derivative Progress: 963/2043 symbols completed. K took 1.3s. Estimated remaining: 7m 37s. Rate: 141.8 symbols/min [2025-09-25T22:22:16.363707] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:16.375208] [DEBUG] [LOCAL ] KB: Loaded 24295 existing records from primary storage. [2025-09-25T22:22:16.375597] [INFO ] [MAIN ] KB: Loaded 24295 primary data records. [2025-09-25T22:22:16.509372] [DEBUG] [LOCAL ] KBDC: Loaded 21035 existing records from primary storage. [2025-09-25T22:22:16.520130] [INFO ] [MAIN ] KBDC: Loaded 21035 primary data records. [2025-09-25T22:22:16.888195] [DEBUG] [LOCAL ] KBH: Loaded 49303 existing records from primary storage. [2025-09-25T22:22:16.909497] [INFO ] [MAIN ] KBH: Loaded 49303 primary data records. [2025-09-25T22:22:17.532851] [DEBUG] [MAIN ] KB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:17.535264] [INFO ] [MAIN ] KB: Generated 1807 derivative records from 24295 primary records. [2025-09-25T22:22:17.535997] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-25T22:22:17.558415] [DEBUG] [LOCAL ] KB: Derivative data saved (1807 records). [2025-09-25T22:22:17.558779] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-25T22:22:17.563170] [INFO ] [MAIN ] Derivative Progress: 964/2043 symbols completed. KB took 1.3s. Estimated remaining: 7m 37s. Rate: 141.5 symbols/min [2025-09-25T22:22:17.571777] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:17.578629] [DEBUG] [MAIN ] KBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:17.579934] [INFO ] [MAIN ] KBDC: Generated 1807 derivative records from 21035 primary records. [2025-09-25T22:22:17.580223] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-25T22:22:17.599317] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1807 records). [2025-09-25T22:22:17.599622] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-25T22:22:17.602064] [INFO ] [MAIN ] Derivative Progress: 965/2043 symbols completed. KBDC took 1.2s. Estimated remaining: 7m 37s. Rate: 141.7 symbols/min [2025-09-25T22:22:17.602573] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:17.621591] [DEBUG] [MAIN ] KBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:17.622564] [INFO ] [MAIN ] KBH: Generated 1807 derivative records from 49303 primary records. [2025-09-25T22:22:17.622738] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-25T22:22:17.640557] [DEBUG] [LOCAL ] KBH: Derivative data saved (1807 records). [2025-09-25T22:22:17.640896] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-25T22:22:17.651029] [INFO ] [MAIN ] Derivative Progress: 966/2043 symbols completed. KBH took 1.3s. Estimated remaining: 7m 36s. Rate: 141.8 symbols/min [2025-09-25T22:22:17.651561] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:17.671821] [DEBUG] [LOCAL ] KEN: Loaded 4776 existing records from primary storage. [2025-09-25T22:22:17.672079] [INFO ] [MAIN ] KEN: Loaded 4776 primary data records. [2025-09-25T22:22:17.850693] [DEBUG] [LOCAL ] KBR: Loaded 48536 existing records from primary storage. [2025-09-25T22:22:17.886557] [INFO ] [MAIN ] KBR: Loaded 48536 primary data records. [2025-09-25T22:22:17.876156] [DEBUG] [LOCAL ] KD: Loaded 52678 existing records from primary storage. [2025-09-25T22:22:17.886793] [INFO ] [MAIN ] KD: Loaded 52678 primary data records. [2025-09-25T22:22:18.735768] [DEBUG] [MAIN ] KEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:18.737104] [INFO ] [MAIN ] KEN: Generated 1807 derivative records from 4776 primary records. [2025-09-25T22:22:18.737322] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-25T22:22:18.758070] [DEBUG] [LOCAL ] KEN: Derivative data saved (1807 records). [2025-09-25T22:22:18.772261] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-25T22:22:18.774543] [DEBUG] [MAIN ] KD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:18.775895] [INFO ] [MAIN ] KD: Generated 1807 derivative records from 52678 primary records. [2025-09-25T22:22:18.776051] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-25T22:22:18.778538] [INFO ] [MAIN ] Derivative Progress: 967/2043 symbols completed. KEN took 1.1s. Estimated remaining: 7m 36s. Rate: 141.6 symbols/min [2025-09-25T22:22:18.779627] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:18.813336] [DEBUG] [MAIN ] KBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:18.815961] [INFO ] [MAIN ] KBR: Generated 1807 derivative records from 48536 primary records. [2025-09-25T22:22:18.816365] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-25T22:22:18.833840] [DEBUG] [LOCAL ] KD: Derivative data saved (1807 records). [2025-09-25T22:22:18.834875] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-25T22:22:18.839838] [INFO ] [MAIN ] Derivative Progress: 968/2043 symbols completed. KD took 1.2s. Estimated remaining: 7m 35s. Rate: 141.7 symbols/min [2025-09-25T22:22:18.840731] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:18.854973] [DEBUG] [LOCAL ] KBR: Derivative data saved (1807 records). [2025-09-25T22:22:18.855085] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-25T22:22:18.857999] [INFO ] [MAIN ] Derivative Progress: 969/2043 symbols completed. KBR took 1.3s. Estimated remaining: 7m 34s. Rate: 141.8 symbols/min [2025-09-25T22:22:18.858391] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:18.871161] [DEBUG] [LOCAL ] KEP: Loaded 30936 existing records from primary storage. [2025-09-25T22:22:18.871415] [INFO ] [MAIN ] KEP: Loaded 30936 primary data records. [2025-09-25T22:22:19.045669] [DEBUG] [LOCAL ] KEX: Loaded 38367 existing records from primary storage. [2025-09-25T22:22:19.097168] [INFO ] [MAIN ] KEX: Loaded 38367 primary data records. [2025-09-25T22:22:19.348967] [DEBUG] [LOCAL ] KEYS: Loaded 43637 existing records from primary storage. [2025-09-25T22:22:19.361847] [INFO ] [MAIN ] KEYS: Loaded 43637 primary data records. [2025-09-25T22:22:20.027226] [DEBUG] [MAIN ] KEP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:20.029054] [INFO ] [MAIN ] KEP: Generated 1807 derivative records from 30936 primary records. [2025-09-25T22:22:20.029162] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-25T22:22:20.049923] [DEBUG] [LOCAL ] KEP: Derivative data saved (1807 records). [2025-09-25T22:22:20.050143] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-25T22:22:20.052856] [INFO ] [MAIN ] Derivative Progress: 970/2043 symbols completed. KEP took 1.3s. Estimated remaining: 7m 35s. Rate: 141.6 symbols/min [2025-09-25T22:22:20.055102] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:20.075317] [DEBUG] [LOCAL ] KF: Loaded 2476 existing records from primary storage. [2025-09-25T22:22:20.075690] [INFO ] [MAIN ] KF: Loaded 2476 primary data records. [2025-09-25T22:22:20.081301] [DEBUG] [MAIN ] KEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:20.089949] [INFO ] [MAIN ] KEX: Generated 1807 derivative records from 38367 primary records. [2025-09-25T22:22:20.095816] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-25T22:22:20.268798] [DEBUG] [MAIN ] KEYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:20.288170] [INFO ] [MAIN ] KEYS: Generated 1807 derivative records from 43637 primary records. [2025-09-25T22:22:20.332045] [DEBUG] [LOCAL ] KEX: Derivative data saved (1807 records). [2025-09-25T22:22:20.332157] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-25T22:22:20.333095] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-25T22:22:20.335639] [INFO ] [MAIN ] Derivative Progress: 971/2043 symbols completed. KEX took 1.5s. Estimated remaining: 7m 34s. Rate: 141.6 symbols/min [2025-09-25T22:22:20.343471] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:20.487928] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1807 records). [2025-09-25T22:22:20.488716] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-25T22:22:20.493298] [INFO ] [MAIN ] Derivative Progress: 972/2043 symbols completed. KEYS took 1.6s. Estimated remaining: 7m 33s. Rate: 141.7 symbols/min [2025-09-25T22:22:20.494122] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:20.504489] [DEBUG] [LOCAL ] KFRC: Loaded 19601 existing records from primary storage. [2025-09-25T22:22:20.504894] [INFO ] [MAIN ] KFRC: Loaded 19601 primary data records. [2025-09-25T22:22:20.610829] [DEBUG] [LOCAL ] KFS: Loaded 8422 existing records from primary storage. [2025-09-25T22:22:20.634685] [INFO ] [MAIN ] KFS: Loaded 8422 primary data records. [2025-09-25T22:22:20.990481] [DEBUG] [MAIN ] KF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:20.997195] [INFO ] [MAIN ] KF: Generated 1807 derivative records from 2476 primary records. [2025-09-25T22:22:20.997723] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-25T22:22:21.228277] [DEBUG] [LOCAL ] KF: Derivative data saved (1807 records). [2025-09-25T22:22:21.229438] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-25T22:22:21.231919] [INFO ] [MAIN ] Derivative Progress: 973/2043 symbols completed. KF took 1.2s. Estimated remaining: 7m 33s. Rate: 141.6 symbols/min [2025-09-25T22:22:21.254157] [DEBUG] [MAIN ] KFRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:21.255139] [INFO ] [MAIN ] KFRC: Generated 1807 derivative records from 19601 primary records. [2025-09-25T22:22:21.255371] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-25T22:22:21.276250] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1807 records). [2025-09-25T22:22:21.276543] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-25T22:22:21.279045] [INFO ] [MAIN ] Derivative Progress: 974/2043 symbols completed. KFRC took 0.9s. Estimated remaining: 7m 33s. Rate: 141.7 symbols/min [2025-09-25T22:22:21.294052] [DEBUG] [MAIN ] KFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:21.294815] [INFO ] [MAIN ] KFS: Generated 1807 derivative records from 8422 primary records. [2025-09-25T22:22:21.294879] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-25T22:22:21.310787] [DEBUG] [LOCAL ] KFS: Derivative data saved (1807 records). [2025-09-25T22:22:21.310860] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-25T22:22:21.313602] [INFO ] [MAIN ] Derivative Progress: 975/2043 symbols completed. KFS took 0.8s. Estimated remaining: 7m 32s. Rate: 141.9 symbols/min [2025-09-25T22:22:21.314205] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:21.314473] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:21.314720] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:21.348037] [DEBUG] [LOCAL ] KFY: Loaded 30872 existing records from primary storage. [2025-09-25T22:22:21.348293] [INFO ] [MAIN ] KFY: Loaded 30872 primary data records. [2025-09-25T22:22:21.525444] [DEBUG] [LOCAL ] KGS: Loaded 46108 existing records from primary storage. [2025-09-25T22:22:21.524416] [DEBUG] [LOCAL ] KGC: Loaded 54089 existing records from primary storage. [2025-09-25T22:22:21.531031] [INFO ] [MAIN ] KGC: Loaded 54089 primary data records. [2025-09-25T22:22:21.541541] [INFO ] [MAIN ] KGS: Loaded 46108 primary data records. [2025-09-25T22:22:22.459200] [DEBUG] [MAIN ] KFY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:22.460166] [INFO ] [MAIN ] KFY: Generated 1807 derivative records from 30872 primary records. [2025-09-25T22:22:22.460672] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-25T22:22:22.482638] [DEBUG] [LOCAL ] KFY: Derivative data saved (1807 records). [2025-09-25T22:22:22.484971] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-25T22:22:22.488550] [INFO ] [MAIN ] Derivative Progress: 976/2043 symbols completed. KFY took 1.2s. Estimated remaining: 7m 32s. Rate: 141.6 symbols/min [2025-09-25T22:22:22.505722] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:22.506961] [DEBUG] [MAIN ] KGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:22.507950] [INFO ] [MAIN ] KGS: Generated 1807 derivative records from 46108 primary records. [2025-09-25T22:22:22.516532] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-25T22:22:22.522688] [DEBUG] [MAIN ] KGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:22.524707] [INFO ] [MAIN ] KGC: Generated 1807 derivative records from 54089 primary records. [2025-09-25T22:22:22.525307] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-25T22:22:22.557822] [DEBUG] [LOCAL ] KGS: Derivative data saved (1807 records). [2025-09-25T22:22:22.558216] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-25T22:22:22.562773] [INFO ] [MAIN ] Derivative Progress: 977/2043 symbols completed. KGS took 1.2s. Estimated remaining: 7m 31s. Rate: 141.7 symbols/min [2025-09-25T22:22:22.564511] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:22.567739] [DEBUG] [LOCAL ] KGC: Derivative data saved (1807 records). [2025-09-25T22:22:22.568009] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-25T22:22:22.571184] [INFO ] [MAIN ] Derivative Progress: 978/2043 symbols completed. KGC took 1.3s. Estimated remaining: 7m 30s. Rate: 141.9 symbols/min [2025-09-25T22:22:22.572010] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:22.631963] [DEBUG] [LOCAL ] KIO: Loaded 21449 existing records from primary storage. [2025-09-25T22:22:22.633516] [INFO ] [MAIN ] KIO: Loaded 21449 primary data records. [2025-09-25T22:22:22.669900] [DEBUG] [LOCAL ] KIM: Loaded 53446 existing records from primary storage. [2025-09-25T22:22:22.683433] [INFO ] [MAIN ] KIM: Loaded 53446 primary data records. [2025-09-25T22:22:22.951003] [DEBUG] [LOCAL ] KKR: Loaded 53891 existing records from primary storage. [2025-09-25T22:22:22.996728] [INFO ] [MAIN ] KKR: Loaded 53891 primary data records. [2025-09-25T22:22:23.707962] [DEBUG] [MAIN ] KIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:23.724797] [INFO ] [MAIN ] KIO: Generated 1807 derivative records from 21449 primary records. [2025-09-25T22:22:23.725370] [DEBUG] [MAIN ] KIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:23.727041] [INFO ] [MAIN ] KIM: Generated 1807 derivative records from 53446 primary records. [2025-09-25T22:22:23.726049] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-25T22:22:23.727421] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-25T22:22:23.768176] [DEBUG] [LOCAL ] KIO: Derivative data saved (1807 records). [2025-09-25T22:22:23.768558] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-25T22:22:23.771746] [INFO ] [MAIN ] Derivative Progress: 979/2043 symbols completed. KIO took 1.2s. Estimated remaining: 7m 31s. Rate: 141.6 symbols/min [2025-09-25T22:22:23.772162] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:23.774108] [DEBUG] [LOCAL ] KIM: Derivative data saved (1807 records). [2025-09-25T22:22:23.789345] [DEBUG] [MAIN ] KKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:23.790630] [INFO ] [MAIN ] KKR: Generated 1807 derivative records from 53891 primary records. [2025-09-25T22:22:23.789444] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-25T22:22:23.791132] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-25T22:22:23.796681] [INFO ] [MAIN ] Derivative Progress: 980/2043 symbols completed. KIM took 1.3s. Estimated remaining: 7m 30s. Rate: 141.7 symbols/min [2025-09-25T22:22:23.812931] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:23.822313] [DEBUG] [LOCAL ] KKR: Derivative data saved (1807 records). [2025-09-25T22:22:23.827007] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-25T22:22:23.831238] [INFO ] [MAIN ] Derivative Progress: 981/2043 symbols completed. KKR took 1.3s. Estimated remaining: 7m 29s. Rate: 141.9 symbols/min [2025-09-25T22:22:23.831732] [DEBUG] [LOCAL ] KKRS: Loaded 5781 existing records from primary storage. [2025-09-25T22:22:23.832091] [INFO ] [MAIN ] KKRS: Loaded 5781 primary data records. [2025-09-25T22:22:23.837622] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:24.263492] [DEBUG] [LOCAL ] KLC: Loaded 36807 existing records from primary storage. [2025-09-25T22:22:24.274128] [INFO ] [MAIN ] KLC: Loaded 36807 primary data records. [2025-09-25T22:22:24.343804] [DEBUG] [LOCAL ] KLG: Loaded 42246 existing records from primary storage. [2025-09-25T22:22:24.366949] [INFO ] [MAIN ] KLG: Loaded 42246 primary data records. [2025-09-25T22:22:24.961761] [DEBUG] [MAIN ] KKRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:24.965182] [INFO ] [MAIN ] KKRS: Generated 1807 derivative records from 5781 primary records. [2025-09-25T22:22:24.965417] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-25T22:22:24.986449] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1807 records). [2025-09-25T22:22:24.986796] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-25T22:22:24.990667] [INFO ] [MAIN ] Derivative Progress: 982/2043 symbols completed. KKRS took 1.2s. Estimated remaining: 7m 30s. Rate: 141.6 symbols/min [2025-09-25T22:22:24.991181] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:25.011041] [DEBUG] [MAIN ] KLC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:25.013199] [INFO ] [MAIN ] KLC: Generated 1807 derivative records from 36807 primary records. [2025-09-25T22:22:25.013956] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-25T22:22:25.044510] [DEBUG] [MAIN ] KLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:25.046409] [INFO ] [MAIN ] KLG: Generated 1807 derivative records from 42246 primary records. [2025-09-25T22:22:25.046866] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-25T22:22:25.063471] [DEBUG] [LOCAL ] KLC: Derivative data saved (1807 records). [2025-09-25T22:22:25.065555] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-25T22:22:25.069107] [INFO ] [MAIN ] Derivative Progress: 983/2043 symbols completed. KLC took 1.3s. Estimated remaining: 7m 29s. Rate: 141.7 symbols/min [2025-09-25T22:22:25.071445] [DEBUG] [LOCAL ] KLG: Derivative data saved (1807 records). [2025-09-25T22:22:25.071889] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-25T22:22:25.087519] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:25.090353] [INFO ] [MAIN ] Derivative Progress: 984/2043 symbols completed. KLG took 1.3s. Estimated remaining: 7m 28s. Rate: 141.9 symbols/min [2025-09-25T22:22:25.091284] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:25.098298] [DEBUG] [LOCAL ] KMPB: Loaded 3623 existing records from primary storage. [2025-09-25T22:22:25.099702] [INFO ] [MAIN ] KMPB: Loaded 3623 primary data records. [2025-09-25T22:22:25.188917] [DEBUG] [LOCAL ] KMI: Loaded 54083 existing records from primary storage. [2025-09-25T22:22:25.242384] [INFO ] [MAIN ] KMI: Loaded 54083 primary data records. [2025-09-25T22:22:25.544797] [DEBUG] [LOCAL ] KMPR: Loaded 38785 existing records from primary storage. [2025-09-25T22:22:25.594199] [INFO ] [MAIN ] KMPR: Loaded 38785 primary data records. [2025-09-25T22:22:26.231037] [DEBUG] [MAIN ] KMPB: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:22:26.232359] [INFO ] [MAIN ] KMPB: Generated 1806 derivative records from 3623 primary records. [2025-09-25T22:22:26.232987] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-25T22:22:26.265208] [DEBUG] [MAIN ] KMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:26.267008] [INFO ] [MAIN ] KMI: Generated 1807 derivative records from 54083 primary records. [2025-09-25T22:22:26.268255] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-25T22:22:26.269191] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1806 records). [2025-09-25T22:22:26.270677] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-25T22:22:26.284945] [INFO ] [MAIN ] Derivative Progress: 985/2043 symbols completed. KMPB took 1.2s. Estimated remaining: 7m 28s. Rate: 141.6 symbols/min [2025-09-25T22:22:26.286136] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:26.294333] [DEBUG] [LOCAL ] KMI: Derivative data saved (1807 records). [2025-09-25T22:22:26.302548] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-25T22:22:26.314214] [INFO ] [MAIN ] Derivative Progress: 986/2043 symbols completed. KMI took 1.3s. Estimated remaining: 7m 27s. Rate: 141.7 symbols/min [2025-09-25T22:22:26.316285] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:26.317372] [DEBUG] [MAIN ] KMPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:26.318857] [INFO ] [MAIN ] KMPR: Generated 1807 derivative records from 38785 primary records. [2025-09-25T22:22:26.319074] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-25T22:22:26.336928] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1807 records). [2025-09-25T22:22:26.337104] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-25T22:22:26.340176] [INFO ] [MAIN ] Derivative Progress: 987/2043 symbols completed. KMPR took 1.2s. Estimated remaining: 7m 27s. Rate: 141.9 symbols/min [2025-09-25T22:22:26.340630] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:26.398823] [DEBUG] [LOCAL ] KMT: Loaded 43390 existing records from primary storage. [2025-09-25T22:22:26.410628] [INFO ] [MAIN ] KMT: Loaded 43390 primary data records. [2025-09-25T22:22:26.466330] [DEBUG] [LOCAL ] KMX: Loaded 53507 existing records from primary storage. [2025-09-25T22:22:26.534896] [INFO ] [MAIN ] KMX: Loaded 53507 primary data records. [2025-09-25T22:22:26.562660] [DEBUG] [LOCAL ] KN: Loaded 39156 existing records from primary storage. [2025-09-25T22:22:26.580802] [INFO ] [MAIN ] KN: Loaded 39156 primary data records. [2025-09-25T22:22:27.475114] [DEBUG] [MAIN ] KMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:27.476225] [INFO ] [MAIN ] KMT: Generated 1807 derivative records from 43390 primary records. [2025-09-25T22:22:27.476711] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-25T22:22:27.497995] [DEBUG] [LOCAL ] KMT: Derivative data saved (1807 records). [2025-09-25T22:22:27.500460] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-25T22:22:27.517059] [INFO ] [MAIN ] Derivative Progress: 988/2043 symbols completed. KMT took 1.2s. Estimated remaining: 7m 27s. Rate: 141.6 symbols/min [2025-09-25T22:22:27.514563] [DEBUG] [MAIN ] KMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:27.530033] [DEBUG] [MAIN ] KN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:27.531571] [INFO ] [MAIN ] KN: Generated 1807 derivative records from 39156 primary records. [2025-09-25T22:22:27.531030] [INFO ] [MAIN ] KMX: Generated 1807 derivative records from 53507 primary records. [2025-09-25T22:22:27.531714] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-25T22:22:27.531766] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-25T22:22:27.564209] [DEBUG] [LOCAL ] KMX: Derivative data saved (1807 records). [2025-09-25T22:22:27.564328] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-25T22:22:27.563194] [DEBUG] [LOCAL ] KN: Derivative data saved (1807 records). [2025-09-25T22:22:27.567476] [INFO ] [MAIN ] Derivative Progress: 989/2043 symbols completed. KMX took 1.3s. Estimated remaining: 7m 26s. Rate: 141.8 symbols/min [2025-09-25T22:22:27.567753] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-25T22:22:27.570676] [INFO ] [MAIN ] Derivative Progress: 990/2043 symbols completed. KN took 1.2s. Estimated remaining: 7m 25s. Rate: 141.9 symbols/min [2025-09-25T22:22:27.571410] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:27.571467] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:27.571669] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:27.586227] [DEBUG] [LOCAL ] KNOP: Loaded 10121 existing records from primary storage. [2025-09-25T22:22:27.586367] [INFO ] [MAIN ] KNOP: Loaded 10121 primary data records. [2025-09-25T22:22:27.722070] [DEBUG] [LOCAL ] KNSL: Loaded 18261 existing records from primary storage. [2025-09-25T22:22:27.748323] [INFO ] [MAIN ] KNSL: Loaded 18261 primary data records. [2025-09-25T22:22:28.037018] [DEBUG] [LOCAL ] KNF: Loaded 36152 existing records from primary storage. [2025-09-25T22:22:28.052523] [INFO ] [MAIN ] KNF: Loaded 36152 primary data records. [2025-09-25T22:22:28.676466] [DEBUG] [MAIN ] KNOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:28.677493] [INFO ] [MAIN ] KNOP: Generated 1807 derivative records from 10121 primary records. [2025-09-25T22:22:28.678748] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-25T22:22:28.708758] [DEBUG] [MAIN ] KNSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:28.711507] [INFO ] [MAIN ] KNSL: Generated 1807 derivative records from 18261 primary records. [2025-09-25T22:22:28.711864] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-25T22:22:28.714063] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1807 records). [2025-09-25T22:22:28.714158] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-25T22:22:28.716927] [INFO ] [MAIN ] Derivative Progress: 991/2043 symbols completed. KNOP took 1.1s. Estimated remaining: 7m 26s. Rate: 141.6 symbols/min [2025-09-25T22:22:28.724634] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:28.738888] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1807 records). [2025-09-25T22:22:28.739400] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-25T22:22:28.750883] [INFO ] [MAIN ] Derivative Progress: 992/2043 symbols completed. KNSL took 1.2s. Estimated remaining: 7m 25s. Rate: 141.8 symbols/min [2025-09-25T22:22:28.757234] [DEBUG] [MAIN ] KNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:28.758346] [INFO ] [MAIN ] KNF: Generated 1807 derivative records from 36152 primary records. [2025-09-25T22:22:28.758708] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-25T22:22:28.759034] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:28.780899] [DEBUG] [LOCAL ] KNF: Derivative data saved (1807 records). [2025-09-25T22:22:28.781183] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-25T22:22:28.784493] [INFO ] [MAIN ] Derivative Progress: 993/2043 symbols completed. KNF took 1.2s. Estimated remaining: 7m 24s. Rate: 141.9 symbols/min [2025-09-25T22:22:28.785084] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:28.845309] [DEBUG] [LOCAL ] KNTK: Loaded 46447 existing records from primary storage. [2025-09-25T22:22:28.845697] [INFO ] [MAIN ] KNTK: Loaded 46447 primary data records. [2025-09-25T22:22:28.929801] [DEBUG] [LOCAL ] KNX: Loaded 52981 existing records from primary storage. [2025-09-25T22:22:28.944618] [INFO ] [MAIN ] KNX: Loaded 52981 primary data records. [2025-09-25T22:22:28.996373] [DEBUG] [LOCAL ] KODK: Loaded 43657 existing records from primary storage. [2025-09-25T22:22:29.045510] [INFO ] [MAIN ] KODK: Loaded 43657 primary data records. [2025-09-25T22:22:29.995129] [DEBUG] [MAIN ] KNTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:30.010062] [INFO ] [MAIN ] KNTK: Generated 1807 derivative records from 46447 primary records. [2025-09-25T22:22:30.010830] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-25T22:22:30.010522] [DEBUG] [MAIN ] KNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:30.013339] [INFO ] [MAIN ] KNX: Generated 1807 derivative records from 52981 primary records. [2025-09-25T22:22:30.013907] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-25T22:22:30.050363] [DEBUG] [LOCAL ] KNX: Derivative data saved (1807 records). [2025-09-25T22:22:30.050520] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-25T22:22:30.053384] [INFO ] [MAIN ] Derivative Progress: 994/2043 symbols completed. KNX took 1.3s. Estimated remaining: 7m 24s. Rate: 141.6 symbols/min [2025-09-25T22:22:30.048362] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1807 records). [2025-09-25T22:22:30.066702] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:30.066568] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-25T22:22:30.068050] [DEBUG] [MAIN ] KODK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:30.070514] [INFO ] [MAIN ] Derivative Progress: 995/2043 symbols completed. KNTK took 1.3s. Estimated remaining: 7m 24s. Rate: 141.8 symbols/min [2025-09-25T22:22:30.071623] [INFO ] [MAIN ] KODK: Generated 1807 derivative records from 43657 primary records. [2025-09-25T22:22:30.071993] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:30.072231] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-25T22:22:30.090291] [DEBUG] [LOCAL ] KODK: Derivative data saved (1807 records). [2025-09-25T22:22:30.090608] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-25T22:22:30.093396] [INFO ] [MAIN ] Derivative Progress: 996/2043 symbols completed. KODK took 1.3s. Estimated remaining: 7m 23s. Rate: 141.9 symbols/min [2025-09-25T22:22:30.099404] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:30.111106] [DEBUG] [LOCAL ] KORE: Loaded 1990 existing records from primary storage. [2025-09-25T22:22:30.116579] [INFO ] [MAIN ] KORE: Loaded 1990 primary data records. [2025-09-25T22:22:30.148964] [DEBUG] [LOCAL ] KOP: Loaded 17944 existing records from primary storage. [2025-09-25T22:22:30.179378] [INFO ] [MAIN ] KOP: Loaded 17944 primary data records. [2025-09-25T22:22:30.173946] [DEBUG] [LOCAL ] KOF: Loaded 26094 existing records from primary storage. [2025-09-25T22:22:30.200603] [INFO ] [MAIN ] KOF: Loaded 26094 primary data records. [2025-09-25T22:22:31.280701] [DEBUG] [MAIN ] KOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:31.297713] [DEBUG] [MAIN ] KORE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:31.297089] [INFO ] [MAIN ] KOF: Generated 1807 derivative records from 26094 primary records. [2025-09-25T22:22:31.300624] [INFO ] [MAIN ] KORE: Generated 1807 derivative records from 1990 primary records. [2025-09-25T22:22:31.301141] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-25T22:22:31.301354] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-25T22:22:31.335859] [DEBUG] [MAIN ] KOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:31.344787] [INFO ] [MAIN ] KOP: Generated 1807 derivative records from 17944 primary records. [2025-09-25T22:22:31.345473] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-25T22:22:31.356357] [DEBUG] [LOCAL ] KORE: Derivative data saved (1807 records). [2025-09-25T22:22:31.363308] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-25T22:22:31.367439] [INFO ] [MAIN ] Derivative Progress: 997/2043 symbols completed. KORE took 1.3s. Estimated remaining: 7m 23s. Rate: 141.6 symbols/min [2025-09-25T22:22:31.369137] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:31.371933] [DEBUG] [LOCAL ] KOF: Derivative data saved (1807 records). [2025-09-25T22:22:31.372694] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-25T22:22:31.375549] [INFO ] [MAIN ] Derivative Progress: 998/2043 symbols completed. KOF took 1.3s. Estimated remaining: 7m 22s. Rate: 141.8 symbols/min [2025-09-25T22:22:31.377026] [DEBUG] [LOCAL ] KOP: Derivative data saved (1807 records). [2025-09-25T22:22:31.377171] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:31.377521] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-25T22:22:31.381160] [INFO ] [MAIN ] Derivative Progress: 999/2043 symbols completed. KOP took 1.3s. Estimated remaining: 7m 21s. Rate: 141.9 symbols/min [2025-09-25T22:22:31.381688] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:31.456217] [DEBUG] [LOCAL ] KOS: Loaded 53448 existing records from primary storage. [2025-09-25T22:22:31.457229] [INFO ] [MAIN ] KOS: Loaded 53448 primary data records. [2025-09-25T22:22:31.540708] [DEBUG] [LOCAL ] KRC: Loaded 48747 existing records from primary storage. [2025-09-25T22:22:31.560798] [INFO ] [MAIN ] KRC: Loaded 48747 primary data records. [2025-09-25T22:22:31.541900] [DEBUG] [LOCAL ] KR: Loaded 54072 existing records from primary storage. [2025-09-25T22:22:31.622800] [INFO ] [MAIN ] KR: Loaded 54072 primary data records. [2025-09-25T22:22:32.537979] [DEBUG] [MAIN ] KOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:32.554216] [DEBUG] [MAIN ] KRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:32.553622] [INFO ] [MAIN ] KOS: Generated 1807 derivative records from 53448 primary records. [2025-09-25T22:22:32.555303] [INFO ] [MAIN ] KRC: Generated 1807 derivative records from 48747 primary records. [2025-09-25T22:22:32.555745] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-25T22:22:32.555679] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-25T22:22:32.593782] [DEBUG] [LOCAL ] KOS: Derivative data saved (1807 records). [2025-09-25T22:22:32.607302] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-25T22:22:32.611442] [INFO ] [MAIN ] Derivative Progress: 1000/2043 symbols completed. KOS took 1.2s. Estimated remaining: 7m 22s. Rate: 141.6 symbols/min [2025-09-25T22:22:32.608302] [DEBUG] [LOCAL ] KRC: Derivative data saved (1807 records). [2025-09-25T22:22:32.612284] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-25T22:22:32.615628] [INFO ] [MAIN ] Derivative Progress: 1001/2043 symbols completed. KRC took 1.2s. Estimated remaining: 7m 21s. Rate: 141.8 symbols/min [2025-09-25T22:22:32.616192] [DEBUG] [MAIN ] KR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:32.617334] [INFO ] [MAIN ] KR: Generated 1807 derivative records from 54072 primary records. [2025-09-25T22:22:32.617701] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:32.612035] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:32.617858] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-25T22:22:32.638234] [DEBUG] [LOCAL ] KR: Derivative data saved (1807 records). [2025-09-25T22:22:32.638463] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-25T22:22:32.641721] [INFO ] [MAIN ] Derivative Progress: 1002/2043 symbols completed. KR took 1.3s. Estimated remaining: 7m 20s. Rate: 141.9 symbols/min [2025-09-25T22:22:32.642120] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:32.694295] [DEBUG] [LOCAL ] KRO: Loaded 26251 existing records from primary storage. [2025-09-25T22:22:32.705479] [INFO ] [MAIN ] KRO: Loaded 26251 primary data records. [2025-09-25T22:22:32.735050] [DEBUG] [LOCAL ] KREF: Loaded 37458 existing records from primary storage. [2025-09-25T22:22:32.793045] [INFO ] [MAIN ] KREF: Loaded 37458 primary data records. [2025-09-25T22:22:32.850568] [DEBUG] [LOCAL ] KRG: Loaded 49543 existing records from primary storage. [2025-09-25T22:22:32.877206] [INFO ] [MAIN ] KRG: Loaded 49543 primary data records. [2025-09-25T22:22:33.779853] [DEBUG] [MAIN ] KRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:33.781105] [INFO ] [MAIN ] KRO: Generated 1807 derivative records from 26251 primary records. [2025-09-25T22:22:33.781440] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-25T22:22:33.819270] [DEBUG] [MAIN ] KRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:33.818950] [DEBUG] [LOCAL ] KRO: Derivative data saved (1807 records). [2025-09-25T22:22:33.821982] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-25T22:22:33.824127] [INFO ] [MAIN ] Derivative Progress: 1003/2043 symbols completed. KRO took 1.2s. Estimated remaining: 7m 21s. Rate: 141.6 symbols/min [2025-09-25T22:22:33.821873] [INFO ] [MAIN ] KRG: Generated 1807 derivative records from 49543 primary records. [2025-09-25T22:22:33.837348] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-25T22:22:33.837743] [DEBUG] [MAIN ] KREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:33.839016] [INFO ] [MAIN ] KREF: Generated 1807 derivative records from 37458 primary records. [2025-09-25T22:22:33.839603] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-25T22:22:33.871518] [DEBUG] [LOCAL ] KRG: Derivative data saved (1807 records). [2025-09-25T22:22:33.872410] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-25T22:22:33.875112] [INFO ] [MAIN ] Derivative Progress: 1004/2043 symbols completed. KRG took 1.3s. Estimated remaining: 7m 20s. Rate: 141.8 symbols/min [2025-09-25T22:22:33.879085] [DEBUG] [LOCAL ] KREF: Derivative data saved (1807 records). [2025-09-25T22:22:33.879159] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-25T22:22:33.882758] [INFO ] [MAIN ] Derivative Progress: 1005/2043 symbols completed. KREF took 1.3s. Estimated remaining: 7m 19s. Rate: 141.9 symbols/min [2025-09-25T22:22:33.883385] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:33.883779] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:33.883726] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:33.927122] [DEBUG] [LOCAL ] KRP: Loaded 37736 existing records from primary storage. [2025-09-25T22:22:33.927335] [INFO ] [MAIN ] KRP: Loaded 37736 primary data records. [2025-09-25T22:22:34.188393] [DEBUG] [LOCAL ] KT: Loaded 46028 existing records from primary storage. [2025-09-25T22:22:34.188743] [INFO ] [MAIN ] KT: Loaded 46028 primary data records. [2025-09-25T22:22:34.188586] [DEBUG] [LOCAL ] KSS: Loaded 53996 existing records from primary storage. [2025-09-25T22:22:34.189068] [INFO ] [MAIN ] KSS: Loaded 53996 primary data records. [2025-09-25T22:22:34.981801] [DEBUG] [MAIN ] KRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:34.983119] [INFO ] [MAIN ] KRP: Generated 1807 derivative records from 37736 primary records. [2025-09-25T22:22:34.985024] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-25T22:22:35.007536] [DEBUG] [LOCAL ] KRP: Derivative data saved (1807 records). [2025-09-25T22:22:35.008226] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-25T22:22:35.010401] [INFO ] [MAIN ] Derivative Progress: 1006/2043 symbols completed. KRP took 1.1s. Estimated remaining: 7m 19s. Rate: 141.7 symbols/min [2025-09-25T22:22:35.010878] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:35.041489] [DEBUG] [MAIN ] KSS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:35.058668] [DEBUG] [MAIN ] KT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:35.058272] [INFO ] [MAIN ] KSS: Generated 1807 derivative records from 53996 primary records. [2025-09-25T22:22:35.059403] [INFO ] [MAIN ] KT: Generated 1807 derivative records from 46028 primary records. [2025-09-25T22:22:35.059619] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-25T22:22:35.059716] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-25T22:22:35.092796] [DEBUG] [LOCAL ] KSS: Derivative data saved (1807 records). [2025-09-25T22:22:35.103457] [DEBUG] [LOCAL ] KT: Derivative data saved (1807 records). [2025-09-25T22:22:35.103352] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-25T22:22:35.106626] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-25T22:22:35.106466] [INFO ] [MAIN ] Derivative Progress: 1007/2043 symbols completed. KSS took 1.2s. Estimated remaining: 7m 18s. Rate: 141.8 symbols/min [2025-09-25T22:22:35.110211] [INFO ] [MAIN ] Derivative Progress: 1008/2043 symbols completed. KT took 1.2s. Estimated remaining: 7m 18s. Rate: 141.9 symbols/min [2025-09-25T22:22:35.110077] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:35.110412] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:35.127040] [DEBUG] [LOCAL ] KTB: Loaded 41408 existing records from primary storage. [2025-09-25T22:22:35.127351] [INFO ] [MAIN ] KTB: Loaded 41408 primary data records. [2025-09-25T22:22:35.228407] [DEBUG] [LOCAL ] KTF: Loaded 13031 existing records from primary storage. [2025-09-25T22:22:35.242106] [INFO ] [MAIN ] KTF: Loaded 13031 primary data records. [2025-09-25T22:22:35.770909] [DEBUG] [LOCAL ] KVUE: Loaded 54057 existing records from primary storage. [2025-09-25T22:22:35.889802] [INFO ] [MAIN ] KVUE: Loaded 54057 primary data records. [2025-09-25T22:22:36.262396] [DEBUG] [MAIN ] KTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:36.264110] [INFO ] [MAIN ] KTB: Generated 1807 derivative records from 41408 primary records. [2025-09-25T22:22:36.265310] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-25T22:22:36.291429] [DEBUG] [MAIN ] KTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:36.297725] [INFO ] [MAIN ] KTF: Generated 1807 derivative records from 13031 primary records. [2025-09-25T22:22:36.300871] [DEBUG] [LOCAL ] KTB: Derivative data saved (1807 records). [2025-09-25T22:22:36.301325] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-25T22:22:36.301242] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-25T22:22:36.303854] [INFO ] [MAIN ] Derivative Progress: 1009/2043 symbols completed. KTB took 1.3s. Estimated remaining: 7m 18s. Rate: 141.7 symbols/min [2025-09-25T22:22:36.305589] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:36.322534] [DEBUG] [LOCAL ] KTF: Derivative data saved (1807 records). [2025-09-25T22:22:36.323016] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-25T22:22:36.325597] [INFO ] [MAIN ] Derivative Progress: 1010/2043 symbols completed. KTF took 1.2s. Estimated remaining: 7m 17s. Rate: 141.8 symbols/min [2025-09-25T22:22:36.326352] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:36.343787] [DEBUG] [MAIN ] KVUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:36.344752] [INFO ] [MAIN ] KVUE: Generated 1807 derivative records from 54057 primary records. [2025-09-25T22:22:36.344895] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-25T22:22:36.363028] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1807 records). [2025-09-25T22:22:36.363174] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-25T22:22:36.368742] [INFO ] [MAIN ] Derivative Progress: 1011/2043 symbols completed. KVUE took 1.3s. Estimated remaining: 7m 16s. Rate: 141.9 symbols/min [2025-09-25T22:22:36.369206] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:36.432198] [DEBUG] [LOCAL ] KW: Loaded 40961 existing records from primary storage. [2025-09-25T22:22:36.433532] [INFO ] [MAIN ] KW: Loaded 40961 primary data records. [2025-09-25T22:22:36.433371] [DEBUG] [LOCAL ] KVYO: Loaded 50306 existing records from primary storage. [2025-09-25T22:22:36.439004] [INFO ] [MAIN ] KVYO: Loaded 50306 primary data records. [2025-09-25T22:22:36.474154] [DEBUG] [LOCAL ] KWR: Loaded 16844 existing records from primary storage. [2025-09-25T22:22:36.491970] [INFO ] [MAIN ] KWR: Loaded 16844 primary data records. [2025-09-25T22:22:37.572114] [DEBUG] [MAIN ] KW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:37.593108] [INFO ] [MAIN ] KW: Generated 1807 derivative records from 40961 primary records. [2025-09-25T22:22:37.593693] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-25T22:22:37.594150] [DEBUG] [MAIN ] KWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:37.596184] [INFO ] [MAIN ] KWR: Generated 1807 derivative records from 16844 primary records. [2025-09-25T22:22:37.609472] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-25T22:22:37.618104] [DEBUG] [MAIN ] KVYO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:37.622231] [INFO ] [MAIN ] KVYO: Generated 1807 derivative records from 50306 primary records. [2025-09-25T22:22:37.632875] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-25T22:22:37.635859] [DEBUG] [LOCAL ] KW: Derivative data saved (1807 records). [2025-09-25T22:22:37.641193] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-25T22:22:37.644192] [INFO ] [MAIN ] Derivative Progress: 1012/2043 symbols completed. KW took 1.3s. Estimated remaining: 7m 17s. Rate: 141.6 symbols/min [2025-09-25T22:22:37.645556] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:37.662091] [DEBUG] [LOCAL ] KWR: Derivative data saved (1807 records). [2025-09-25T22:22:37.663499] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-25T22:22:37.667851] [INFO ] [MAIN ] Derivative Progress: 1013/2043 symbols completed. KWR took 1.3s. Estimated remaining: 7m 16s. Rate: 141.8 symbols/min [2025-09-25T22:22:37.668588] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1807 records). [2025-09-25T22:22:37.669114] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-25T22:22:37.672583] [INFO ] [MAIN ] Derivative Progress: 1014/2043 symbols completed. KVYO took 1.4s. Estimated remaining: 7m 15s. Rate: 141.9 symbols/min [2025-09-25T22:22:37.669174] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:37.673186] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:37.712158] [DEBUG] [LOCAL ] KYN: Loaded 30234 existing records from primary storage. [2025-09-25T22:22:37.712526] [INFO ] [MAIN ] KYN: Loaded 30234 primary data records. [2025-09-25T22:22:37.901088] [DEBUG] [LOCAL ] L: Loaded 41261 existing records from primary storage. [2025-09-25T22:22:37.969150] [INFO ] [MAIN ] L: Loaded 41261 primary data records. [2025-09-25T22:22:38.000295] [DEBUG] [LOCAL ] LAC: Loaded 52701 existing records from primary storage. [2025-09-25T22:22:38.183407] [INFO ] [MAIN ] LAC: Loaded 52701 primary data records. [2025-09-25T22:22:38.933089] [DEBUG] [MAIN ] KYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:38.934446] [INFO ] [MAIN ] KYN: Generated 1807 derivative records from 30234 primary records. [2025-09-25T22:22:38.935928] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-25T22:22:38.966544] [DEBUG] [LOCAL ] KYN: Derivative data saved (1807 records). [2025-09-25T22:22:38.968459] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-25T22:22:38.971943] [INFO ] [MAIN ] Derivative Progress: 1015/2043 symbols completed. KYN took 1.3s. Estimated remaining: 7m 16s. Rate: 141.6 symbols/min [2025-09-25T22:22:38.973980] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:38.997605] [DEBUG] [MAIN ] L: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:38.998924] [INFO ] [MAIN ] L: Generated 1807 derivative records from 41261 primary records. [2025-09-25T22:22:38.999181] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-25T22:22:39.064407] [DEBUG] [MAIN ] LAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:39.063499] [DEBUG] [LOCAL ] LAD: Loaded 23870 existing records from primary storage. [2025-09-25T22:22:39.065413] [INFO ] [MAIN ] LAD: Loaded 23870 primary data records. [2025-09-25T22:22:39.072807] [INFO ] [MAIN ] LAC: Generated 1807 derivative records from 52701 primary records. [2025-09-25T22:22:39.096330] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-25T22:22:39.110843] [DEBUG] [LOCAL ] L: Derivative data saved (1807 records). [2025-09-25T22:22:39.157112] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-25T22:22:39.203229] [INFO ] [MAIN ] Derivative Progress: 1016/2043 symbols completed. L took 1.5s. Estimated remaining: 7m 15s. Rate: 141.7 symbols/min [2025-09-25T22:22:39.219861] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:39.219554] [DEBUG] [LOCAL ] LAC: Derivative data saved (1807 records). [2025-09-25T22:22:39.242543] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-25T22:22:39.259118] [INFO ] [MAIN ] Derivative Progress: 1017/2043 symbols completed. LAC took 1.6s. Estimated remaining: 7m 14s. Rate: 141.8 symbols/min [2025-09-25T22:22:39.271223] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:39.366105] [DEBUG] [LOCAL ] LANV: Loaded 2808 existing records from primary storage. [2025-09-25T22:22:39.493615] [INFO ] [MAIN ] LANV: Loaded 2808 primary data records. [2025-09-25T22:22:39.672795] [DEBUG] [LOCAL ] LADR: Loaded 38917 existing records from primary storage. [2025-09-25T22:22:39.707251] [INFO ] [MAIN ] LADR: Loaded 38917 primary data records. [2025-09-25T22:22:40.141382] [DEBUG] [MAIN ] LAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:40.254669] [INFO ] [MAIN ] LAD: Generated 1807 derivative records from 23870 primary records. [2025-09-25T22:22:40.264118] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-25T22:22:40.286345] [DEBUG] [LOCAL ] LAD: Derivative data saved (1807 records). [2025-09-25T22:22:40.287818] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-25T22:22:40.291025] [INFO ] [MAIN ] Derivative Progress: 1018/2043 symbols completed. LAD took 1.3s. Estimated remaining: 7m 14s. Rate: 141.6 symbols/min [2025-09-25T22:22:40.306574] [DEBUG] [MAIN ] LANV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:22:40.307506] [INFO ] [MAIN ] LANV: Generated 1805 derivative records from 2808 primary records. [2025-09-25T22:22:40.307728] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-25T22:22:40.322697] [DEBUG] [LOCAL ] LANV: Derivative data saved (1805 records). [2025-09-25T22:22:40.323117] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-25T22:22:40.325875] [INFO ] [MAIN ] Derivative Progress: 1019/2043 symbols completed. LANV took 1.1s. Estimated remaining: 7m 13s. Rate: 141.7 symbols/min [2025-09-25T22:22:40.342203] [DEBUG] [MAIN ] LADR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:40.342888] [INFO ] [MAIN ] LADR: Generated 1807 derivative records from 38917 primary records. [2025-09-25T22:22:40.342953] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-25T22:22:40.358794] [DEBUG] [LOCAL ] LADR: Derivative data saved (1807 records). [2025-09-25T22:22:40.358875] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-25T22:22:40.361809] [INFO ] [MAIN ] Derivative Progress: 1020/2043 symbols completed. LADR took 1.1s. Estimated remaining: 7m 13s. Rate: 141.9 symbols/min [2025-09-25T22:22:40.362472] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:40.362723] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:40.362595] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:40.379593] [DEBUG] [LOCAL ] LAW: Loaded 14087 existing records from primary storage. [2025-09-25T22:22:40.379824] [INFO ] [MAIN ] LAW: Loaded 14087 primary data records. [2025-09-25T22:22:40.627434] [DEBUG] [LOCAL ] LB: Loaded 37889 existing records from primary storage. [2025-09-25T22:22:40.748095] [DEBUG] [LOCAL ] LAZ: Loaded 45524 existing records from primary storage. [2025-09-25T22:22:40.748303] [INFO ] [MAIN ] LAZ: Loaded 45524 primary data records. [2025-09-25T22:22:40.756411] [INFO ] [MAIN ] LB: Loaded 37889 primary data records. [2025-09-25T22:22:41.432413] [DEBUG] [MAIN ] LAW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:41.434852] [INFO ] [MAIN ] LAW: Generated 1807 derivative records from 14087 primary records. [2025-09-25T22:22:41.435042] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-25T22:22:41.452873] [DEBUG] [LOCAL ] LAW: Derivative data saved (1807 records). [2025-09-25T22:22:41.453038] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-25T22:22:41.455498] [INFO ] [MAIN ] Derivative Progress: 1021/2043 symbols completed. LAW took 1.1s. Estimated remaining: 7m 13s. Rate: 141.6 symbols/min [2025-09-25T22:22:41.456018] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:41.488924] [DEBUG] [MAIN ] LB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:41.488572] [DEBUG] [MAIN ] LAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:41.490319] [INFO ] [MAIN ] LAZ: Generated 1807 derivative records from 45524 primary records. [2025-09-25T22:22:41.490472] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-25T22:22:41.489737] [INFO ] [MAIN ] LB: Generated 1807 derivative records from 37889 primary records. [2025-09-25T22:22:41.491316] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-25T22:22:41.524742] [DEBUG] [LOCAL ] LB: Derivative data saved (1807 records). [2025-09-25T22:22:41.524627] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1807 records). [2025-09-25T22:22:41.524904] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-25T22:22:41.524996] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-25T22:22:41.527676] [INFO ] [MAIN ] Derivative Progress: 1022/2043 symbols completed. LB took 1.2s. Estimated remaining: 7m 12s. Rate: 141.8 symbols/min [2025-09-25T22:22:41.530531] [INFO ] [MAIN ] Derivative Progress: 1023/2043 symbols completed. LAZ took 1.2s. Estimated remaining: 7m 11s. Rate: 141.9 symbols/min [2025-09-25T22:22:41.530687] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:41.531398] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:41.582028] [DEBUG] [LOCAL ] LBRT: Loaded 53307 existing records from primary storage. [2025-09-25T22:22:41.583826] [INFO ] [MAIN ] LBRT: Loaded 53307 primary data records. [2025-09-25T22:22:41.692455] [DEBUG] [LOCAL ] LCII: Loaded 28760 existing records from primary storage. [2025-09-25T22:22:41.705236] [INFO ] [MAIN ] LCII: Loaded 28760 primary data records. [2025-09-25T22:22:41.864175] [DEBUG] [LOCAL ] LC: Loaded 48267 existing records from primary storage. [2025-09-25T22:22:41.911293] [INFO ] [MAIN ] LC: Loaded 48267 primary data records. [2025-09-25T22:22:42.651856] [DEBUG] [MAIN ] LBRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:42.655953] [INFO ] [MAIN ] LBRT: Generated 1807 derivative records from 53307 primary records. [2025-09-25T22:22:42.656445] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-25T22:22:42.670614] [DEBUG] [MAIN ] LCII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:42.685561] [INFO ] [MAIN ] LCII: Generated 1807 derivative records from 28760 primary records. [2025-09-25T22:22:42.687249] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-25T22:22:42.688368] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1807 records). [2025-09-25T22:22:42.688437] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-25T22:22:42.690895] [INFO ] [MAIN ] Derivative Progress: 1024/2043 symbols completed. LBRT took 1.2s. Estimated remaining: 7m 12s. Rate: 141.6 symbols/min [2025-09-25T22:22:42.702695] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:42.709925] [DEBUG] [LOCAL ] LCII: Derivative data saved (1807 records). [2025-09-25T22:22:42.710316] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-25T22:22:42.713223] [INFO ] [MAIN ] Derivative Progress: 1025/2043 symbols completed. LCII took 1.2s. Estimated remaining: 7m 11s. Rate: 141.8 symbols/min [2025-09-25T22:22:42.713849] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:42.731876] [DEBUG] [MAIN ] LC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:42.733443] [INFO ] [MAIN ] LC: Generated 1807 derivative records from 48267 primary records. [2025-09-25T22:22:42.733698] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-25T22:22:42.761387] [DEBUG] [LOCAL ] LC: Derivative data saved (1807 records). [2025-09-25T22:22:42.761728] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-25T22:22:42.764603] [INFO ] [MAIN ] Derivative Progress: 1026/2043 symbols completed. LC took 1.2s. Estimated remaining: 7m 10s. Rate: 141.9 symbols/min [2025-09-25T22:22:42.765087] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:42.788050] [DEBUG] [LOCAL ] LDI: Loaded 44397 existing records from primary storage. [2025-09-25T22:22:42.788384] [INFO ] [MAIN ] LDI: Loaded 44397 primary data records. [2025-09-25T22:22:42.827091] [DEBUG] [LOCAL ] LDP: Loaded 13041 existing records from primary storage. [2025-09-25T22:22:42.861154] [INFO ] [MAIN ] LDP: Loaded 13041 primary data records. [2025-09-25T22:22:43.118138] [DEBUG] [LOCAL ] LDOS: Loaded 46091 existing records from primary storage. [2025-09-25T22:22:43.231254] [INFO ] [MAIN ] LDOS: Loaded 46091 primary data records. [2025-09-25T22:22:43.817925] [DEBUG] [MAIN ] LDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:43.819091] [INFO ] [MAIN ] LDI: Generated 1807 derivative records from 44397 primary records. [2025-09-25T22:22:43.819463] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-25T22:22:43.854891] [DEBUG] [LOCAL ] LDI: Derivative data saved (1807 records). [2025-09-25T22:22:43.855167] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-25T22:22:43.857832] [INFO ] [MAIN ] Derivative Progress: 1027/2043 symbols completed. LDI took 1.2s. Estimated remaining: 7m 10s. Rate: 141.7 symbols/min [2025-09-25T22:22:43.855510] [DEBUG] [MAIN ] LDP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:43.860191] [INFO ] [MAIN ] LDP: Generated 1807 derivative records from 13041 primary records. [2025-09-25T22:22:43.859122] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:43.860679] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-25T22:22:43.884399] [DEBUG] [LOCAL ] LDP: Derivative data saved (1807 records). [2025-09-25T22:22:43.884927] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-25T22:22:43.888123] [INFO ] [MAIN ] Derivative Progress: 1028/2043 symbols completed. LDP took 1.1s. Estimated remaining: 7m 9s. Rate: 141.8 symbols/min [2025-09-25T22:22:43.906886] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:43.909560] [DEBUG] [MAIN ] LDOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:43.910775] [INFO ] [MAIN ] LDOS: Generated 1807 derivative records from 46091 primary records. [2025-09-25T22:22:43.910862] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-25T22:22:43.934563] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1807 records). [2025-09-25T22:22:43.934788] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-25T22:22:43.942168] [INFO ] [MAIN ] Derivative Progress: 1029/2043 symbols completed. LDOS took 1.2s. Estimated remaining: 7m 9s. Rate: 141.9 symbols/min [2025-09-25T22:22:43.942497] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:43.973917] [DEBUG] [LOCAL ] LEA: Loaded 42166 existing records from primary storage. [2025-09-25T22:22:43.974100] [INFO ] [MAIN ] LEA: Loaded 42166 primary data records. [2025-09-25T22:22:44.171493] [DEBUG] [LOCAL ] LEG: Loaded 50759 existing records from primary storage. [2025-09-25T22:22:44.207279] [INFO ] [MAIN ] LEG: Loaded 50759 primary data records. [2025-09-25T22:22:44.348904] [DEBUG] [LOCAL ] LEN: Loaded 53580 existing records from primary storage. [2025-09-25T22:22:44.514428] [INFO ] [MAIN ] LEN: Loaded 53580 primary data records. [2025-09-25T22:22:45.115105] [DEBUG] [MAIN ] LEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:45.116361] [INFO ] [MAIN ] LEA: Generated 1807 derivative records from 42166 primary records. [2025-09-25T22:22:45.116615] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-25T22:22:45.134764] [DEBUG] [LOCAL ] LEA: Derivative data saved (1807 records). [2025-09-25T22:22:45.135404] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-25T22:22:45.137708] [INFO ] [MAIN ] Derivative Progress: 1030/2043 symbols completed. LEA took 1.3s. Estimated remaining: 7m 9s. Rate: 141.7 symbols/min [2025-09-25T22:22:45.138680] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:45.156878] [DEBUG] [MAIN ] LEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:45.158020] [INFO ] [MAIN ] LEG: Generated 1807 derivative records from 50759 primary records. [2025-09-25T22:22:45.158122] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-25T22:22:45.198462] [DEBUG] [MAIN ] LEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:45.202415] [INFO ] [MAIN ] LEN: Generated 1807 derivative records from 53580 primary records. [2025-09-25T22:22:45.202815] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-25T22:22:45.204728] [DEBUG] [LOCAL ] LEG: Derivative data saved (1807 records). [2025-09-25T22:22:45.205688] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-25T22:22:45.209104] [INFO ] [MAIN ] Derivative Progress: 1031/2043 symbols completed. LEG took 1.3s. Estimated remaining: 7m 8s. Rate: 141.8 symbols/min [2025-09-25T22:22:45.206315] [DEBUG] [LOCAL ] LEO: Loaded 17726 existing records from primary storage. [2025-09-25T22:22:45.217364] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:45.221931] [INFO ] [MAIN ] LEO: Loaded 17726 primary data records. [2025-09-25T22:22:45.327157] [DEBUG] [LOCAL ] LEN: Derivative data saved (1807 records). [2025-09-25T22:22:45.341306] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-25T22:22:45.344760] [INFO ] [MAIN ] Derivative Progress: 1032/2043 symbols completed. LEN took 1.4s. Estimated remaining: 7m 8s. Rate: 141.9 symbols/min [2025-09-25T22:22:45.366438] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:45.610562] [DEBUG] [LOCAL ] LFT: Loaded 18180 existing records from primary storage. [2025-09-25T22:22:45.611365] [INFO ] [MAIN ] LFT: Loaded 18180 primary data records. [2025-09-25T22:22:45.747193] [DEBUG] [LOCAL ] LEVI: Loaded 51936 existing records from primary storage. [2025-09-25T22:22:45.789355] [INFO ] [MAIN ] LEVI: Loaded 51936 primary data records. [2025-09-25T22:22:46.353785] [DEBUG] [MAIN ] LEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:46.354793] [INFO ] [MAIN ] LEO: Generated 1807 derivative records from 17726 primary records. [2025-09-25T22:22:46.355006] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-25T22:22:46.373897] [DEBUG] [LOCAL ] LEO: Derivative data saved (1807 records). [2025-09-25T22:22:46.374207] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-25T22:22:46.376455] [INFO ] [MAIN ] Derivative Progress: 1033/2043 symbols completed. LEO took 1.2s. Estimated remaining: 7m 8s. Rate: 141.7 symbols/min [2025-09-25T22:22:46.394787] [DEBUG] [MAIN ] LFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:46.395559] [INFO ] [MAIN ] LFT: Generated 1807 derivative records from 18180 primary records. [2025-09-25T22:22:46.395747] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-25T22:22:46.412281] [DEBUG] [LOCAL ] LFT: Derivative data saved (1807 records). [2025-09-25T22:22:46.412516] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-25T22:22:46.414964] [INFO ] [MAIN ] Derivative Progress: 1034/2043 symbols completed. LFT took 1.0s. Estimated remaining: 7m 7s. Rate: 141.8 symbols/min [2025-09-25T22:22:46.430982] [DEBUG] [MAIN ] LEVI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:46.431552] [INFO ] [MAIN ] LEVI: Generated 1807 derivative records from 51936 primary records. [2025-09-25T22:22:46.431614] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-25T22:22:46.447497] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1807 records). [2025-09-25T22:22:46.447569] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-25T22:22:46.450317] [INFO ] [MAIN ] Derivative Progress: 1035/2043 symbols completed. LEVI took 1.2s. Estimated remaining: 7m 6s. Rate: 141.9 symbols/min [2025-09-25T22:22:46.450975] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:46.451020] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:46.451174] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:46.464428] [DEBUG] [LOCAL ] LGI: Loaded 10065 existing records from primary storage. [2025-09-25T22:22:46.464571] [INFO ] [MAIN ] LGI: Loaded 10065 primary data records. [2025-09-25T22:22:46.700455] [DEBUG] [LOCAL ] LH: Loaded 38437 existing records from primary storage. [2025-09-25T22:22:46.828786] [INFO ] [MAIN ] LH: Loaded 38437 primary data records. [2025-09-25T22:22:46.923993] [DEBUG] [LOCAL ] LHX: Loaded 49078 existing records from primary storage. [2025-09-25T22:22:46.943292] [INFO ] [MAIN ] LHX: Loaded 49078 primary data records. [2025-09-25T22:22:47.567537] [DEBUG] [MAIN ] LGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:47.568603] [INFO ] [MAIN ] LGI: Generated 1807 derivative records from 10065 primary records. [2025-09-25T22:22:47.569248] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-25T22:22:47.590824] [DEBUG] [LOCAL ] LGI: Derivative data saved (1807 records). [2025-09-25T22:22:47.591695] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-25T22:22:47.594870] [INFO ] [MAIN ] Derivative Progress: 1036/2043 symbols completed. LGI took 1.1s. Estimated remaining: 7m 6s. Rate: 141.7 symbols/min [2025-09-25T22:22:47.596357] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:47.620785] [DEBUG] [MAIN ] LH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:47.623090] [INFO ] [MAIN ] LH: Generated 1807 derivative records from 38437 primary records. [2025-09-25T22:22:47.624112] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-25T22:22:47.659856] [DEBUG] [MAIN ] LHX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:47.661379] [INFO ] [MAIN ] LHX: Generated 1807 derivative records from 49078 primary records. [2025-09-25T22:22:47.662215] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-25T22:22:47.675232] [DEBUG] [LOCAL ] LH: Derivative data saved (1807 records). [2025-09-25T22:22:47.675723] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-25T22:22:47.679134] [DEBUG] [LOCAL ] LII: Loaded 28514 existing records from primary storage. [2025-09-25T22:22:47.678116] [INFO ] [MAIN ] Derivative Progress: 1037/2043 symbols completed. LH took 1.2s. Estimated remaining: 7m 6s. Rate: 141.8 symbols/min [2025-09-25T22:22:47.686965] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:47.688200] [INFO ] [MAIN ] LII: Loaded 28514 primary data records. [2025-09-25T22:22:47.867947] [DEBUG] [LOCAL ] LHX: Derivative data saved (1807 records). [2025-09-25T22:22:47.897711] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-25T22:22:47.969697] [INFO ] [MAIN ] Derivative Progress: 1038/2043 symbols completed. LHX took 1.5s. Estimated remaining: 7m 5s. Rate: 141.9 symbols/min [2025-09-25T22:22:48.020603] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:48.046294] [DEBUG] [LOCAL ] LION: Loaded 43618 existing records from primary storage. [2025-09-25T22:22:48.047783] [INFO ] [MAIN ] LION: Loaded 43618 primary data records. [2025-09-25T22:22:48.073543] [DEBUG] [LOCAL ] LITB: Loaded 4406 existing records from primary storage. [2025-09-25T22:22:48.097787] [INFO ] [MAIN ] LITB: Loaded 4406 primary data records. [2025-09-25T22:22:48.774720] [DEBUG] [MAIN ] LII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:48.776043] [INFO ] [MAIN ] LII: Generated 1807 derivative records from 28514 primary records. [2025-09-25T22:22:48.776223] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-25T22:22:48.795381] [DEBUG] [LOCAL ] LII: Derivative data saved (1807 records). [2025-09-25T22:22:48.795882] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-25T22:22:48.798455] [INFO ] [MAIN ] Derivative Progress: 1039/2043 symbols completed. LII took 1.2s. Estimated remaining: 7m 5s. Rate: 141.7 symbols/min [2025-09-25T22:22:48.798910] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:48.819695] [DEBUG] [MAIN ] LION: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:48.821494] [INFO ] [MAIN ] LION: Generated 1807 derivative records from 43618 primary records. [2025-09-25T22:22:48.821601] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-25T22:22:48.851365] [DEBUG] [LOCAL ] LION: Derivative data saved (1807 records). [2025-09-25T22:22:48.852056] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-25T22:22:48.851865] [DEBUG] [MAIN ] LITB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:48.854479] [INFO ] [MAIN ] Derivative Progress: 1040/2043 symbols completed. LION took 1.2s. Estimated remaining: 7m 4s. Rate: 141.8 symbols/min [2025-09-25T22:22:48.856035] [INFO ] [MAIN ] LITB: Generated 1807 derivative records from 4406 primary records. [2025-09-25T22:22:48.856406] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-25T22:22:48.856339] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:48.880804] [DEBUG] [LOCAL ] LITB: Derivative data saved (1807 records). [2025-09-25T22:22:48.881029] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-25T22:22:48.884241] [INFO ] [MAIN ] Derivative Progress: 1041/2043 symbols completed. LITB took 0.9s. Estimated remaining: 7m 3s. Rate: 142.0 symbols/min [2025-09-25T22:22:48.884805] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:48.944565] [DEBUG] [LOCAL ] LLY: Loaded 53678 existing records from primary storage. [2025-09-25T22:22:48.945494] [INFO ] [MAIN ] LLY: Loaded 53678 primary data records. [2025-09-25T22:22:49.007950] [DEBUG] [LOCAL ] LMND: Loaded 52260 existing records from primary storage. [2025-09-25T22:22:49.036435] [INFO ] [MAIN ] LMND: Loaded 52260 primary data records. [2025-09-25T22:22:49.444992] [DEBUG] [LOCAL ] LMT: Loaded 50266 existing records from primary storage. [2025-09-25T22:22:49.503997] [INFO ] [MAIN ] LMT: Loaded 50266 primary data records. [2025-09-25T22:22:49.993168] [DEBUG] [MAIN ] LLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:49.994970] [INFO ] [MAIN ] LLY: Generated 1807 derivative records from 53678 primary records. [2025-09-25T22:22:49.995366] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-25T22:22:50.011413] [DEBUG] [MAIN ] LMND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:50.025075] [INFO ] [MAIN ] LMND: Generated 1807 derivative records from 52260 primary records. [2025-09-25T22:22:50.026914] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-25T22:22:50.063362] [DEBUG] [MAIN ] LMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:50.064193] [DEBUG] [LOCAL ] LLY: Derivative data saved (1807 records). [2025-09-25T22:22:50.065728] [INFO ] [MAIN ] LMT: Generated 1807 derivative records from 50266 primary records. [2025-09-25T22:22:50.066089] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-25T22:22:50.064860] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-25T22:22:50.070775] [INFO ] [MAIN ] Derivative Progress: 1042/2043 symbols completed. LLY took 1.3s. Estimated remaining: 7m 4s. Rate: 141.7 symbols/min [2025-09-25T22:22:50.073193] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:50.073011] [DEBUG] [LOCAL ] LMND: Derivative data saved (1807 records). [2025-09-25T22:22:50.074543] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-25T22:22:50.085001] [INFO ] [MAIN ] Derivative Progress: 1043/2043 symbols completed. LMND took 1.2s. Estimated remaining: 7m 3s. Rate: 141.9 symbols/min [2025-09-25T22:22:50.092700] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:50.096241] [DEBUG] [LOCAL ] LMT: Derivative data saved (1807 records). [2025-09-25T22:22:50.096398] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-25T22:22:50.099616] [INFO ] [MAIN ] Derivative Progress: 1044/2043 symbols completed. LMT took 1.2s. Estimated remaining: 7m 2s. Rate: 142.0 symbols/min [2025-09-25T22:22:50.100071] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:50.108528] [DEBUG] [LOCAL ] LND: Loaded 4991 existing records from primary storage. [2025-09-25T22:22:50.108844] [INFO ] [MAIN ] LND: Loaded 4991 primary data records. [2025-09-25T22:22:50.508717] [DEBUG] [LOCAL ] LNC: Loaded 51993 existing records from primary storage. [2025-09-25T22:22:50.510220] [INFO ] [MAIN ] LNC: Loaded 51993 primary data records. [2025-09-25T22:22:50.602948] [DEBUG] [LOCAL ] LNG: Loaded 51871 existing records from primary storage. [2025-09-25T22:22:50.610339] [INFO ] [MAIN ] LNG: Loaded 51871 primary data records. [2025-09-25T22:22:51.287829] [DEBUG] [MAIN ] LND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:51.289816] [INFO ] [MAIN ] LND: Generated 1807 derivative records from 4991 primary records. [2025-09-25T22:22:51.290798] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-25T22:22:51.311832] [DEBUG] [LOCAL ] LND: Derivative data saved (1807 records). [2025-09-25T22:22:51.312927] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-25T22:22:51.318954] [INFO ] [MAIN ] Derivative Progress: 1045/2043 symbols completed. LND took 1.2s. Estimated remaining: 7m 2s. Rate: 141.7 symbols/min [2025-09-25T22:22:51.323770] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:51.344343] [DEBUG] [MAIN ] LNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:51.345572] [INFO ] [MAIN ] LNC: Generated 1807 derivative records from 51993 primary records. [2025-09-25T22:22:51.345911] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-25T22:22:51.360000] [DEBUG] [MAIN ] LNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:51.361887] [INFO ] [MAIN ] LNG: Generated 1807 derivative records from 51871 primary records. [2025-09-25T22:22:51.361995] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-25T22:22:51.391279] [DEBUG] [LOCAL ] LNC: Derivative data saved (1807 records). [2025-09-25T22:22:51.403274] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-25T22:22:51.407834] [INFO ] [MAIN ] Derivative Progress: 1046/2043 symbols completed. LNC took 1.3s. Estimated remaining: 7m 2s. Rate: 141.8 symbols/min [2025-09-25T22:22:51.410160] [DEBUG] [LOCAL ] LNG: Derivative data saved (1807 records). [2025-09-25T22:22:51.410605] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:51.408332] [DEBUG] [LOCAL ] LNN: Loaded 11349 existing records from primary storage. [2025-09-25T22:22:51.410950] [INFO ] [MAIN ] LNN: Loaded 11349 primary data records. [2025-09-25T22:22:51.411407] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-25T22:22:51.429883] [INFO ] [MAIN ] Derivative Progress: 1047/2043 symbols completed. LNG took 1.3s. Estimated remaining: 7m 1s. Rate: 142.0 symbols/min [2025-09-25T22:22:51.440637] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:51.807448] [DEBUG] [LOCAL ] LOB: Loaded 27742 existing records from primary storage. [2025-09-25T22:22:51.808506] [DEBUG] [LOCAL ] LOAR: Loaded 41940 existing records from primary storage. [2025-09-25T22:22:51.810274] [INFO ] [MAIN ] LOAR: Loaded 41940 primary data records. [2025-09-25T22:22:51.810579] [INFO ] [MAIN ] LOB: Loaded 27742 primary data records. [2025-09-25T22:22:52.484446] [DEBUG] [MAIN ] LNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:52.487975] [INFO ] [MAIN ] LNN: Generated 1807 derivative records from 11349 primary records. [2025-09-25T22:22:52.490469] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-25T22:22:52.510198] [DEBUG] [LOCAL ] LNN: Derivative data saved (1807 records). [2025-09-25T22:22:52.510498] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-25T22:22:52.517201] [INFO ] [MAIN ] Derivative Progress: 1048/2043 symbols completed. LNN took 1.2s. Estimated remaining: 7m 1s. Rate: 141.8 symbols/min [2025-09-25T22:22:52.542170] [DEBUG] [MAIN ] LOAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:52.543266] [INFO ] [MAIN ] LOAR: Generated 1807 derivative records from 41940 primary records. [2025-09-25T22:22:52.543547] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-25T22:22:52.557708] [DEBUG] [MAIN ] LOB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:52.566020] [INFO ] [MAIN ] LOB: Generated 1807 derivative records from 27742 primary records. [2025-09-25T22:22:52.567531] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-25T22:22:52.575535] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1807 records). [2025-09-25T22:22:52.582948] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-25T22:22:52.587332] [INFO ] [MAIN ] Derivative Progress: 1049/2043 symbols completed. LOAR took 1.2s. Estimated remaining: 7m 0s. Rate: 141.9 symbols/min [2025-09-25T22:22:52.596481] [DEBUG] [LOCAL ] LOB: Derivative data saved (1807 records). [2025-09-25T22:22:52.596713] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-25T22:22:52.599811] [INFO ] [MAIN ] Derivative Progress: 1050/2043 symbols completed. LOB took 1.2s. Estimated remaining: 6m 60s. Rate: 142.0 symbols/min [2025-09-25T22:22:52.601014] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:52.601142] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:52.601319] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:52.612785] [DEBUG] [LOCAL ] LOCL: Loaded 3622 existing records from primary storage. [2025-09-25T22:22:52.613174] [INFO ] [MAIN ] LOCL: Loaded 3622 primary data records. [2025-09-25T22:22:52.930250] [DEBUG] [LOCAL ] LOMA: Loaded 32261 existing records from primary storage. [2025-09-25T22:22:53.012679] [INFO ] [MAIN ] LOMA: Loaded 32261 primary data records. [2025-09-25T22:22:53.128086] [DEBUG] [LOCAL ] LOW: Loaded 53346 existing records from primary storage. [2025-09-25T22:22:53.148922] [INFO ] [MAIN ] LOW: Loaded 53346 primary data records. [2025-09-25T22:22:53.736897] [DEBUG] [MAIN ] LOCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:53.738917] [INFO ] [MAIN ] LOCL: Generated 1807 derivative records from 3622 primary records. [2025-09-25T22:22:53.739032] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-25T22:22:53.758864] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1807 records). [2025-09-25T22:22:53.759288] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-25T22:22:53.762095] [INFO ] [MAIN ] Derivative Progress: 1051/2043 symbols completed. LOCL took 1.2s. Estimated remaining: 6m 60s. Rate: 141.8 symbols/min [2025-09-25T22:22:53.763126] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:53.804031] [DEBUG] [MAIN ] LOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:53.803612] [DEBUG] [MAIN ] LOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:53.805076] [INFO ] [MAIN ] LOMA: Generated 1807 derivative records from 32261 primary records. [2025-09-25T22:22:53.805294] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-25T22:22:53.816289] [INFO ] [MAIN ] LOW: Generated 1807 derivative records from 53346 primary records. [2025-09-25T22:22:53.817091] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-25T22:22:53.849515] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1807 records). [2025-09-25T22:22:53.850751] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-25T22:22:53.853370] [INFO ] [MAIN ] Derivative Progress: 1052/2043 symbols completed. LOMA took 1.3s. Estimated remaining: 6m 59s. Rate: 141.9 symbols/min [2025-09-25T22:22:53.866467] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:53.867167] [DEBUG] [LOCAL ] LOW: Derivative data saved (1807 records). [2025-09-25T22:22:53.868130] [DEBUG] [LOCAL ] LPG: Loaded 40307 existing records from primary storage. [2025-09-25T22:22:53.868343] [INFO ] [MAIN ] LPG: Loaded 40307 primary data records. [2025-09-25T22:22:53.868442] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-25T22:22:53.871555] [INFO ] [MAIN ] Derivative Progress: 1053/2043 symbols completed. LOW took 1.3s. Estimated remaining: 6m 58s. Rate: 142.0 symbols/min [2025-09-25T22:22:53.890428] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:54.038960] [DEBUG] [LOCAL ] LPL: Loaded 26050 existing records from primary storage. [2025-09-25T22:22:54.074470] [INFO ] [MAIN ] LPL: Loaded 26050 primary data records. [2025-09-25T22:22:54.364090] [DEBUG] [LOCAL ] LPX: Loaded 40015 existing records from primary storage. [2025-09-25T22:22:54.375855] [INFO ] [MAIN ] LPX: Loaded 40015 primary data records. [2025-09-25T22:22:55.008225] [DEBUG] [MAIN ] LPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:55.010872] [INFO ] [MAIN ] LPG: Generated 1807 derivative records from 40307 primary records. [2025-09-25T22:22:55.011592] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-25T22:22:55.051805] [DEBUG] [LOCAL ] LPG: Derivative data saved (1807 records). [2025-09-25T22:22:55.052984] [DEBUG] [MAIN ] LPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:55.053830] [INFO ] [MAIN ] LPL: Generated 1807 derivative records from 26050 primary records. [2025-09-25T22:22:55.052631] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-25T22:22:55.054808] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-25T22:22:55.058134] [INFO ] [MAIN ] Derivative Progress: 1054/2043 symbols completed. LPG took 1.3s. Estimated remaining: 6m 59s. Rate: 141.8 symbols/min [2025-09-25T22:22:55.059122] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:55.078692] [DEBUG] [LOCAL ] LPL: Derivative data saved (1807 records). [2025-09-25T22:22:55.079989] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-25T22:22:55.084767] [INFO ] [MAIN ] Derivative Progress: 1055/2043 symbols completed. LPL took 1.2s. Estimated remaining: 6m 58s. Rate: 141.9 symbols/min [2025-09-25T22:22:55.085373] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:55.099709] [DEBUG] [MAIN ] LPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:55.100627] [INFO ] [MAIN ] LPX: Generated 1807 derivative records from 40015 primary records. [2025-09-25T22:22:55.100820] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-25T22:22:55.118069] [DEBUG] [LOCAL ] LPX: Derivative data saved (1807 records). [2025-09-25T22:22:55.118364] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-25T22:22:55.122715] [INFO ] [MAIN ] Derivative Progress: 1056/2043 symbols completed. LPX took 1.2s. Estimated remaining: 6m 57s. Rate: 142.0 symbols/min [2025-09-25T22:22:55.134273] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:55.154090] [DEBUG] [LOCAL ] LRN: Loaded 40224 existing records from primary storage. [2025-09-25T22:22:55.154467] [INFO ] [MAIN ] LRN: Loaded 40224 primary data records. [2025-09-25T22:22:55.322095] [DEBUG] [LOCAL ] LSPD: Loaded 43518 existing records from primary storage. [2025-09-25T22:22:55.333286] [DEBUG] [LOCAL ] LTC: Loaded 30236 existing records from primary storage. [2025-09-25T22:22:55.338882] [INFO ] [MAIN ] LSPD: Loaded 43518 primary data records. [2025-09-25T22:22:55.344297] [INFO ] [MAIN ] LTC: Loaded 30236 primary data records. [2025-09-25T22:22:56.237308] [DEBUG] [MAIN ] LRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:56.238912] [INFO ] [MAIN ] LRN: Generated 1807 derivative records from 40224 primary records. [2025-09-25T22:22:56.239391] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-25T22:22:56.282071] [DEBUG] [MAIN ] LSPD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:56.289061] [INFO ] [MAIN ] LSPD: Generated 1807 derivative records from 43518 primary records. [2025-09-25T22:22:56.289480] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-25T22:22:56.287815] [DEBUG] [MAIN ] LTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:56.292768] [INFO ] [MAIN ] LTC: Generated 1807 derivative records from 30236 primary records. [2025-09-25T22:22:56.300692] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-25T22:22:56.302117] [DEBUG] [LOCAL ] LRN: Derivative data saved (1807 records). [2025-09-25T22:22:56.307220] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-25T22:22:56.310085] [INFO ] [MAIN ] Derivative Progress: 1057/2043 symbols completed. LRN took 1.3s. Estimated remaining: 6m 57s. Rate: 141.8 symbols/min [2025-09-25T22:22:56.323615] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:56.329455] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1807 records). [2025-09-25T22:22:56.330161] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-25T22:22:56.334895] [INFO ] [MAIN ] Derivative Progress: 1058/2043 symbols completed. LSPD took 1.2s. Estimated remaining: 6m 57s. Rate: 141.9 symbols/min [2025-09-25T22:22:56.335458] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:56.337508] [DEBUG] [LOCAL ] LTC: Derivative data saved (1807 records). [2025-09-25T22:22:56.338310] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-25T22:22:56.343245] [INFO ] [MAIN ] Derivative Progress: 1059/2043 symbols completed. LTC took 1.2s. Estimated remaining: 6m 56s. Rate: 142.0 symbols/min [2025-09-25T22:22:56.343582] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:56.420076] [DEBUG] [LOCAL ] LTH: Loaded 52212 existing records from primary storage. [2025-09-25T22:22:56.420390] [INFO ] [MAIN ] LTH: Loaded 52212 primary data records. [2025-09-25T22:22:56.442956] [DEBUG] [LOCAL ] LTM: Loaded 36687 existing records from primary storage. [2025-09-25T22:22:56.459810] [INFO ] [MAIN ] LTM: Loaded 36687 primary data records. [2025-09-25T22:22:56.640252] [DEBUG] [LOCAL ] LU: Loaded 49314 existing records from primary storage. [2025-09-25T22:22:56.698862] [INFO ] [MAIN ] LU: Loaded 49314 primary data records. [2025-09-25T22:22:57.527542] [DEBUG] [MAIN ] LTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:57.531602] [INFO ] [MAIN ] LTH: Generated 1807 derivative records from 52212 primary records. [2025-09-25T22:22:57.532871] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-25T22:22:57.566275] [DEBUG] [LOCAL ] LTH: Derivative data saved (1807 records). [2025-09-25T22:22:57.565001] [DEBUG] [MAIN ] LTM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:57.567375] [INFO ] [MAIN ] LTM: Generated 1807 derivative records from 36687 primary records. [2025-09-25T22:22:57.566433] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-25T22:22:57.569907] [INFO ] [MAIN ] Derivative Progress: 1060/2043 symbols completed. LTH took 1.2s. Estimated remaining: 6m 56s. Rate: 141.8 symbols/min [2025-09-25T22:22:57.572497] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-25T22:22:57.572780] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:57.605078] [DEBUG] [LOCAL ] LTM: Derivative data saved (1807 records). [2025-09-25T22:22:57.605817] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-25T22:22:57.610132] [INFO ] [MAIN ] Derivative Progress: 1061/2043 symbols completed. LTM took 1.3s. Estimated remaining: 6m 55s. Rate: 141.9 symbols/min [2025-09-25T22:22:57.605697] [DEBUG] [MAIN ] LU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:57.611822] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:57.611472] [INFO ] [MAIN ] LU: Generated 1807 derivative records from 49314 primary records. [2025-09-25T22:22:57.611964] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-25T22:22:57.631095] [DEBUG] [LOCAL ] LU: Derivative data saved (1807 records). [2025-09-25T22:22:57.631341] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-25T22:22:57.635157] [INFO ] [MAIN ] Derivative Progress: 1062/2043 symbols completed. LU took 1.3s. Estimated remaining: 6m 54s. Rate: 142.0 symbols/min [2025-09-25T22:22:57.635672] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:57.682028] [DEBUG] [LOCAL ] LUMN: Loaded 54024 existing records from primary storage. [2025-09-25T22:22:57.682256] [INFO ] [MAIN ] LUMN: Loaded 54024 primary data records. [2025-09-25T22:22:57.913826] [DEBUG] [LOCAL ] LUV: Loaded 54079 existing records from primary storage. [2025-09-25T22:22:58.050883] [INFO ] [MAIN ] LUV: Loaded 54079 primary data records. [2025-09-25T22:22:58.085504] [DEBUG] [LOCAL ] LVS: Loaded 53954 existing records from primary storage. [2025-09-25T22:22:58.103599] [INFO ] [MAIN ] LVS: Loaded 53954 primary data records. [2025-09-25T22:22:58.716964] [DEBUG] [MAIN ] LUMN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:58.718399] [INFO ] [MAIN ] LUMN: Generated 1807 derivative records from 54024 primary records. [2025-09-25T22:22:58.719832] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-25T22:22:58.758955] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1807 records). [2025-09-25T22:22:58.759872] [DEBUG] [MAIN ] LUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:58.760256] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-25T22:22:58.761462] [INFO ] [MAIN ] LUV: Generated 1807 derivative records from 54079 primary records. [2025-09-25T22:22:58.761775] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-25T22:22:58.766376] [INFO ] [MAIN ] Derivative Progress: 1063/2043 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 55s. Rate: 141.8 symbols/min [2025-09-25T22:22:58.798869] [DEBUG] [MAIN ] LVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:22:58.801326] [INFO ] [MAIN ] LVS: Generated 1807 derivative records from 53954 primary records. [2025-09-25T22:22:58.801430] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-25T22:22:58.801169] [DEBUG] [LOCAL ] LUV: Derivative data saved (1807 records). [2025-09-25T22:22:58.802179] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-25T22:22:58.805461] [INFO ] [MAIN ] Derivative Progress: 1064/2043 symbols completed. LUV took 1.2s. Estimated remaining: 6m 54s. Rate: 141.9 symbols/min [2025-09-25T22:22:58.822504] [DEBUG] [LOCAL ] LVS: Derivative data saved (1807 records). [2025-09-25T22:22:58.822592] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-25T22:22:58.825695] [INFO ] [MAIN ] Derivative Progress: 1065/2043 symbols completed. LVS took 1.2s. Estimated remaining: 6m 53s. Rate: 142.0 symbols/min [2025-09-25T22:22:58.826754] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:58.826894] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:58.826509] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:22:58.860433] [DEBUG] [LOCAL ] LXFR: Loaded 17187 existing records from primary storage. [2025-09-25T22:22:58.860803] [INFO ] [MAIN ] LXFR: Loaded 17187 primary data records. [2025-09-25T22:22:58.861398] [DEBUG] [LOCAL ] LVWR: Loaded 17624 existing records from primary storage. [2025-09-25T22:22:58.873855] [INFO ] [MAIN ] LVWR: Loaded 17624 primary data records. [2025-09-25T22:22:59.289563] [DEBUG] [LOCAL ] LW: Loaded 51531 existing records from primary storage. [2025-09-25T22:22:59.582898] [INFO ] [MAIN ] LW: Loaded 51531 primary data records. [2025-09-25T22:23:00.000142] [DEBUG] [MAIN ] LVWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:00.006185] [DEBUG] [MAIN ] LXFR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:00.005894] [INFO ] [MAIN ] LVWR: Generated 1807 derivative records from 17624 primary records. [2025-09-25T22:23:00.006963] [INFO ] [MAIN ] LXFR: Generated 1807 derivative records from 17187 primary records. [2025-09-25T22:23:00.007038] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-25T22:23:00.007284] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-25T22:23:00.045294] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1807 records). [2025-09-25T22:23:00.047134] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1807 records). [2025-09-25T22:23:00.047375] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-25T22:23:00.047509] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-25T22:23:00.050056] [INFO ] [MAIN ] Derivative Progress: 1066/2043 symbols completed. LXFR took 1.2s. Estimated remaining: 6m 53s. Rate: 141.8 symbols/min [2025-09-25T22:23:00.054205] [INFO ] [MAIN ] Derivative Progress: 1067/2043 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 53s. Rate: 141.9 symbols/min [2025-09-25T22:23:00.054410] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:00.055211] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:00.074003] [DEBUG] [MAIN ] LW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:00.074940] [INFO ] [MAIN ] LW: Generated 1807 derivative records from 51531 primary records. [2025-09-25T22:23:00.075147] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-25T22:23:00.103334] [DEBUG] [LOCAL ] LW: Derivative data saved (1807 records). [2025-09-25T22:23:00.103498] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-25T22:23:00.109086] [INFO ] [MAIN ] Derivative Progress: 1068/2043 symbols completed. LW took 1.3s. Estimated remaining: 6m 52s. Rate: 142.0 symbols/min [2025-09-25T22:23:00.109562] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:00.137134] [DEBUG] [LOCAL ] LXU: Loaded 32191 existing records from primary storage. [2025-09-25T22:23:00.137477] [INFO ] [MAIN ] LXU: Loaded 32191 primary data records. [2025-09-25T22:23:00.269404] [DEBUG] [LOCAL ] LXP: Loaded 51002 existing records from primary storage. [2025-09-25T22:23:00.280873] [INFO ] [MAIN ] LXP: Loaded 51002 primary data records. [2025-09-25T22:23:00.647946] [DEBUG] [LOCAL ] LYB: Loaded 53989 existing records from primary storage. [2025-09-25T22:23:00.655231] [INFO ] [MAIN ] LYB: Loaded 53989 primary data records. [2025-09-25T22:23:01.205621] [DEBUG] [MAIN ] LXU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:01.210247] [INFO ] [MAIN ] LXU: Generated 1807 derivative records from 32191 primary records. [2025-09-25T22:23:01.210505] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-25T22:23:01.239496] [DEBUG] [MAIN ] LXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:01.243630] [INFO ] [MAIN ] LXP: Generated 1807 derivative records from 51002 primary records. [2025-09-25T22:23:01.244078] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-25T22:23:01.246517] [DEBUG] [LOCAL ] LXU: Derivative data saved (1807 records). [2025-09-25T22:23:01.255271] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-25T22:23:01.263799] [INFO ] [MAIN ] Derivative Progress: 1069/2043 symbols completed. LXU took 1.2s. Estimated remaining: 6m 52s. Rate: 141.8 symbols/min [2025-09-25T22:23:01.264443] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:01.287627] [DEBUG] [MAIN ] LYB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:01.288775] [INFO ] [MAIN ] LYB: Generated 1807 derivative records from 53989 primary records. [2025-09-25T22:23:01.289228] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-25T22:23:01.290870] [DEBUG] [LOCAL ] LXP: Derivative data saved (1807 records). [2025-09-25T22:23:01.290943] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-25T22:23:01.294687] [INFO ] [MAIN ] Derivative Progress: 1070/2043 symbols completed. LXP took 1.2s. Estimated remaining: 6m 51s. Rate: 141.9 symbols/min [2025-09-25T22:23:01.295039] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:01.319858] [DEBUG] [LOCAL ] LYB: Derivative data saved (1807 records). [2025-09-25T22:23:01.320009] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-25T22:23:01.324410] [INFO ] [MAIN ] Derivative Progress: 1071/2043 symbols completed. LYB took 1.2s. Estimated remaining: 6m 51s. Rate: 142.0 symbols/min [2025-09-25T22:23:01.324795] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:01.391774] [DEBUG] [LOCAL ] LYG: Loaded 53243 existing records from primary storage. [2025-09-25T22:23:01.403958] [INFO ] [MAIN ] LYG: Loaded 53243 primary data records. [2025-09-25T22:23:01.538214] [DEBUG] [LOCAL ] LYV: Loaded 51528 existing records from primary storage. [2025-09-25T22:23:01.538492] [INFO ] [MAIN ] LYV: Loaded 51528 primary data records. [2025-09-25T22:23:01.619339] [DEBUG] [LOCAL ] LZB: Loaded 35833 existing records from primary storage. [2025-09-25T22:23:01.648897] [INFO ] [MAIN ] LZB: Loaded 35833 primary data records. [2025-09-25T22:23:02.591310] [DEBUG] [MAIN ] LYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:02.601462] [INFO ] [MAIN ] LYG: Generated 1807 derivative records from 53243 primary records. [2025-09-25T22:23:02.606593] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-25T22:23:02.607403] [DEBUG] [MAIN ] LYV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:02.611364] [INFO ] [MAIN ] LYV: Generated 1807 derivative records from 51528 primary records. [2025-09-25T22:23:02.620823] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-25T22:23:02.639911] [DEBUG] [LOCAL ] LYG: Derivative data saved (1807 records). [2025-09-25T22:23:02.658092] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-25T22:23:02.660188] [INFO ] [MAIN ] Derivative Progress: 1072/2043 symbols completed. LYG took 1.4s. Estimated remaining: 6m 51s. Rate: 141.8 symbols/min [2025-09-25T22:23:02.666145] [DEBUG] [LOCAL ] LYV: Derivative data saved (1807 records). [2025-09-25T22:23:02.666581] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:02.667379] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-25T22:23:02.672835] [INFO ] [MAIN ] Derivative Progress: 1073/2043 symbols completed. LYV took 1.4s. Estimated remaining: 6m 50s. Rate: 141.9 symbols/min [2025-09-25T22:23:02.667770] [DEBUG] [MAIN ] LZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:02.674296] [INFO ] [MAIN ] LZB: Generated 1807 derivative records from 35833 primary records. [2025-09-25T22:23:02.674805] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-25T22:23:02.675136] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:02.699883] [DEBUG] [LOCAL ] LZB: Derivative data saved (1807 records). [2025-09-25T22:23:02.705706] [DEBUG] [LOCAL ] LZM: Loaded 13758 existing records from primary storage. [2025-09-25T22:23:02.706271] [INFO ] [MAIN ] LZM: Loaded 13758 primary data records. [2025-09-25T22:23:02.706137] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-25T22:23:02.733151] [INFO ] [MAIN ] Derivative Progress: 1074/2043 symbols completed. LZB took 1.4s. Estimated remaining: 6m 49s. Rate: 142.0 symbols/min [2025-09-25T22:23:02.759008] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:03.107449] [DEBUG] [LOCAL ] M: Loaded 53925 existing records from primary storage. [2025-09-25T22:23:03.108084] [INFO ] [MAIN ] M: Loaded 53925 primary data records. [2025-09-25T22:23:03.213081] [DEBUG] [LOCAL ] MA: Loaded 52958 existing records from primary storage. [2025-09-25T22:23:03.224832] [INFO ] [MAIN ] MA: Loaded 52958 primary data records. [2025-09-25T22:23:03.420188] [DEBUG] [MAIN ] LZM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:03.445817] [INFO ] [MAIN ] LZM: Generated 1807 derivative records from 13758 primary records. [2025-09-25T22:23:03.512577] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-25T22:23:03.628874] [DEBUG] [LOCAL ] LZM: Derivative data saved (1807 records). [2025-09-25T22:23:03.634838] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-25T22:23:03.680477] [INFO ] [MAIN ] Derivative Progress: 1075/2043 symbols completed. LZM took 1.0s. Estimated remaining: 6m 49s. Rate: 141.8 symbols/min [2025-09-25T22:23:03.709204] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:03.922203] [DEBUG] [MAIN ] M: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:03.933796] [INFO ] [MAIN ] M: Generated 1807 derivative records from 53925 primary records. [2025-09-25T22:23:03.933889] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-25T22:23:03.954898] [DEBUG] [LOCAL ] M: Derivative data saved (1807 records). [2025-09-25T22:23:03.957057] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-25T22:23:03.960550] [INFO ] [MAIN ] Derivative Progress: 1076/2043 symbols completed. M took 1.3s. Estimated remaining: 6m 49s. Rate: 141.9 symbols/min [2025-09-25T22:23:03.975220] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:03.989985] [DEBUG] [LOCAL ] MAA: Loaded 43062 existing records from primary storage. [2025-09-25T22:23:03.990978] [INFO ] [MAIN ] MAA: Loaded 43062 primary data records. [2025-09-25T22:23:03.991338] [DEBUG] [MAIN ] MA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:03.997972] [INFO ] [MAIN ] MA: Generated 1807 derivative records from 52958 primary records. [2025-09-25T22:23:04.034616] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-25T22:23:04.105451] [DEBUG] [LOCAL ] MA: Derivative data saved (1807 records). [2025-09-25T22:23:04.123508] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-25T22:23:04.137780] [INFO ] [MAIN ] Derivative Progress: 1077/2043 symbols completed. MA took 1.4s. Estimated remaining: 6m 48s. Rate: 142.0 symbols/min [2025-09-25T22:23:04.148956] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:04.385312] [DEBUG] [LOCAL ] MAC: Loaded 50079 existing records from primary storage. [2025-09-25T22:23:04.386130] [INFO ] [MAIN ] MAC: Loaded 50079 primary data records. [2025-09-25T22:23:04.400258] [DEBUG] [LOCAL ] MAGN: Loaded 35204 existing records from primary storage. [2025-09-25T22:23:04.418124] [INFO ] [MAIN ] MAGN: Loaded 35204 primary data records. [2025-09-25T22:23:05.105819] [DEBUG] [MAIN ] MAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:05.107822] [INFO ] [MAIN ] MAA: Generated 1807 derivative records from 43062 primary records. [2025-09-25T22:23:05.108206] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-25T22:23:05.131288] [DEBUG] [LOCAL ] MAA: Derivative data saved (1807 records). [2025-09-25T22:23:05.131435] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-25T22:23:05.134850] [INFO ] [MAIN ] Derivative Progress: 1078/2043 symbols completed. MAA took 1.4s. Estimated remaining: 6m 48s. Rate: 141.8 symbols/min [2025-09-25T22:23:05.162572] [DEBUG] [MAIN ] MAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:05.163863] [INFO ] [MAIN ] MAC: Generated 1807 derivative records from 50079 primary records. [2025-09-25T22:23:05.176894] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-25T22:23:05.177263] [DEBUG] [MAIN ] MAGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:05.179467] [INFO ] [MAIN ] MAGN: Generated 1807 derivative records from 35204 primary records. [2025-09-25T22:23:05.186762] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-25T22:23:05.203752] [DEBUG] [LOCAL ] MAC: Derivative data saved (1807 records). [2025-09-25T22:23:05.208865] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-25T22:23:05.212082] [INFO ] [MAIN ] Derivative Progress: 1079/2043 symbols completed. MAC took 1.2s. Estimated remaining: 6m 48s. Rate: 141.9 symbols/min [2025-09-25T22:23:05.214916] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1807 records). [2025-09-25T22:23:05.215017] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-25T22:23:05.218952] [INFO ] [MAIN ] Derivative Progress: 1080/2043 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 47s. Rate: 142.0 symbols/min [2025-09-25T22:23:05.219963] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:05.220098] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:05.219777] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:05.262317] [DEBUG] [LOCAL ] MANU: Loaded 27364 existing records from primary storage. [2025-09-25T22:23:05.274934] [INFO ] [MAIN ] MANU: Loaded 27364 primary data records. [2025-09-25T22:23:05.440275] [DEBUG] [LOCAL ] MAIN: Loaded 41683 existing records from primary storage. [2025-09-25T22:23:05.475013] [INFO ] [MAIN ] MAIN: Loaded 41683 primary data records. [2025-09-25T22:23:05.476029] [DEBUG] [LOCAL ] MAN: Loaded 43878 existing records from primary storage. [2025-09-25T22:23:05.487732] [INFO ] [MAIN ] MAN: Loaded 43878 primary data records. [2025-09-25T22:23:06.396524] [DEBUG] [MAIN ] MANU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:06.398242] [INFO ] [MAIN ] MANU: Generated 1807 derivative records from 27364 primary records. [2025-09-25T22:23:06.398726] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-25T22:23:06.417243] [DEBUG] [LOCAL ] MANU: Derivative data saved (1807 records). [2025-09-25T22:23:06.417598] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-25T22:23:06.419853] [INFO ] [MAIN ] Derivative Progress: 1081/2043 symbols completed. MANU took 1.2s. Estimated remaining: 6m 47s. Rate: 141.8 symbols/min [2025-09-25T22:23:06.423993] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:06.448592] [DEBUG] [MAIN ] MAIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:06.454578] [DEBUG] [MAIN ] MAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:06.454373] [INFO ] [MAIN ] MAIN: Generated 1807 derivative records from 41683 primary records. [2025-09-25T22:23:06.454731] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-25T22:23:06.455454] [INFO ] [MAIN ] MAN: Generated 1807 derivative records from 43878 primary records. [2025-09-25T22:23:06.456623] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-25T22:23:06.483854] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1807 records). [2025-09-25T22:23:06.487538] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-25T22:23:06.492463] [DEBUG] [LOCAL ] MAN: Derivative data saved (1807 records). [2025-09-25T22:23:06.490896] [INFO ] [MAIN ] Derivative Progress: 1082/2043 symbols completed. MAIN took 1.3s. Estimated remaining: 6m 46s. Rate: 141.9 symbols/min [2025-09-25T22:23:06.492808] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-25T22:23:06.497573] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:06.497874] [INFO ] [MAIN ] Derivative Progress: 1083/2043 symbols completed. MAN took 1.3s. Estimated remaining: 6m 46s. Rate: 142.0 symbols/min [2025-09-25T22:23:06.498611] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:06.564467] [DEBUG] [LOCAL ] MAS: Loaded 52722 existing records from primary storage. [2025-09-25T22:23:06.564784] [INFO ] [MAIN ] MAS: Loaded 52722 primary data records. [2025-09-25T22:23:06.666382] [DEBUG] [LOCAL ] MATV: Loaded 37749 existing records from primary storage. [2025-09-25T22:23:06.701009] [INFO ] [MAIN ] MATV: Loaded 37749 primary data records. [2025-09-25T22:23:06.722815] [DEBUG] [LOCAL ] MATX: Loaded 31717 existing records from primary storage. [2025-09-25T22:23:06.742358] [INFO ] [MAIN ] MATX: Loaded 31717 primary data records. [2025-09-25T22:23:07.609312] [DEBUG] [MAIN ] MAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:07.610369] [INFO ] [MAIN ] MAS: Generated 1807 derivative records from 52722 primary records. [2025-09-25T22:23:07.610753] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-25T22:23:07.635765] [DEBUG] [LOCAL ] MAS: Derivative data saved (1807 records). [2025-09-25T22:23:07.649254] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-25T22:23:07.653497] [INFO ] [MAIN ] Derivative Progress: 1084/2043 symbols completed. MAS took 1.2s. Estimated remaining: 6m 46s. Rate: 141.8 symbols/min [2025-09-25T22:23:07.654030] [DEBUG] [MAIN ] MATV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:07.655546] [INFO ] [MAIN ] MATV: Generated 1807 derivative records from 37749 primary records. [2025-09-25T22:23:07.656214] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-25T22:23:07.657675] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:07.689897] [DEBUG] [MAIN ] MATX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:07.691733] [INFO ] [MAIN ] MATX: Generated 1807 derivative records from 31717 primary records. [2025-09-25T22:23:07.692487] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-25T22:23:07.712274] [DEBUG] [LOCAL ] MATV: Derivative data saved (1807 records). [2025-09-25T22:23:07.720967] [DEBUG] [LOCAL ] MATX: Derivative data saved (1807 records). [2025-09-25T22:23:07.721532] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-25T22:23:07.721181] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-25T22:23:07.724279] [INFO ] [MAIN ] Derivative Progress: 1085/2043 symbols completed. MATX took 1.2s. Estimated remaining: 6m 45s. Rate: 141.9 symbols/min [2025-09-25T22:23:07.730200] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:07.730005] [INFO ] [MAIN ] Derivative Progress: 1086/2043 symbols completed. MATV took 1.2s. Estimated remaining: 6m 44s. Rate: 142.0 symbols/min [2025-09-25T22:23:07.731235] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:07.742541] [DEBUG] [LOCAL ] MAX: Loaded 31061 existing records from primary storage. [2025-09-25T22:23:07.742835] [INFO ] [MAIN ] MAX: Loaded 31061 primary data records. [2025-09-25T22:23:08.114691] [DEBUG] [LOCAL ] MBC: Loaded 43426 existing records from primary storage. [2025-09-25T22:23:08.117380] [DEBUG] [LOCAL ] MC: Loaded 44594 existing records from primary storage. [2025-09-25T22:23:08.116304] [INFO ] [MAIN ] MBC: Loaded 43426 primary data records. [2025-09-25T22:23:08.118009] [INFO ] [MAIN ] MC: Loaded 44594 primary data records. [2025-09-25T22:23:08.864136] [DEBUG] [MAIN ] MAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:08.873710] [INFO ] [MAIN ] MAX: Generated 1807 derivative records from 31061 primary records. [2025-09-25T22:23:08.876110] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-25T22:23:08.904412] [DEBUG] [LOCAL ] MAX: Derivative data saved (1807 records). [2025-09-25T22:23:08.904754] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-25T22:23:08.908929] [INFO ] [MAIN ] Derivative Progress: 1087/2043 symbols completed. MAX took 1.3s. Estimated remaining: 6m 45s. Rate: 141.8 symbols/min [2025-09-25T22:23:08.909854] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:08.956288] [DEBUG] [LOCAL ] MCB: Loaded 11768 existing records from primary storage. [2025-09-25T22:23:08.962805] [INFO ] [MAIN ] MCB: Loaded 11768 primary data records. [2025-09-25T22:23:08.963219] [DEBUG] [MAIN ] MBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:08.962462] [DEBUG] [MAIN ] MC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:08.969696] [INFO ] [MAIN ] MBC: Generated 1807 derivative records from 43426 primary records. [2025-09-25T22:23:08.986272] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-25T22:23:08.998410] [INFO ] [MAIN ] MC: Generated 1807 derivative records from 44594 primary records. [2025-09-25T22:23:09.016211] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-25T22:23:09.122300] [DEBUG] [LOCAL ] MBC: Derivative data saved (1807 records). [2025-09-25T22:23:09.125118] [DEBUG] [LOCAL ] MC: Derivative data saved (1807 records). [2025-09-25T22:23:09.125239] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-25T22:23:09.129888] [INFO ] [MAIN ] Derivative Progress: 1088/2043 symbols completed. MBC took 1.4s. Estimated remaining: 6m 44s. Rate: 141.9 symbols/min [2025-09-25T22:23:09.130099] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-25T22:23:09.146068] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:09.148429] [INFO ] [MAIN ] Derivative Progress: 1089/2043 symbols completed. MC took 1.4s. Estimated remaining: 6m 43s. Rate: 142.0 symbols/min [2025-09-25T22:23:09.188796] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:09.345336] [DEBUG] [LOCAL ] MCI: Loaded 6446 existing records from primary storage. [2025-09-25T22:23:09.345516] [INFO ] [MAIN ] MCI: Loaded 6446 primary data records. [2025-09-25T22:23:09.712158] [DEBUG] [LOCAL ] MCK: Loaded 39698 existing records from primary storage. [2025-09-25T22:23:09.714771] [INFO ] [MAIN ] MCK: Loaded 39698 primary data records. [2025-09-25T22:23:09.816525] [DEBUG] [MAIN ] MCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:09.828353] [INFO ] [MAIN ] MCB: Generated 1807 derivative records from 11768 primary records. [2025-09-25T22:23:09.846108] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-25T22:23:09.919296] [DEBUG] [LOCAL ] MCB: Derivative data saved (1807 records). [2025-09-25T22:23:09.955734] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-25T22:23:09.961243] [INFO ] [MAIN ] Derivative Progress: 1090/2043 symbols completed. MCB took 1.1s. Estimated remaining: 6m 43s. Rate: 141.9 symbols/min [2025-09-25T22:23:10.093046] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:10.111134] [DEBUG] [MAIN ] MCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:10.112199] [INFO ] [MAIN ] MCI: Generated 1807 derivative records from 6446 primary records. [2025-09-25T22:23:10.112313] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-25T22:23:10.134389] [DEBUG] [LOCAL ] MCI: Derivative data saved (1807 records). [2025-09-25T22:23:10.138848] [DEBUG] [LOCAL ] MCN: Loaded 8199 existing records from primary storage. [2025-09-25T22:23:10.139407] [INFO ] [MAIN ] MCN: Loaded 8199 primary data records. [2025-09-25T22:23:10.139323] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-25T22:23:10.176974] [INFO ] [MAIN ] Derivative Progress: 1091/2043 symbols completed. MCI took 1.0s. Estimated remaining: 6m 42s. Rate: 141.9 symbols/min [2025-09-25T22:23:10.195789] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:10.564778] [DEBUG] [MAIN ] MCK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:10.567540] [INFO ] [MAIN ] MCK: Generated 1807 derivative records from 39698 primary records. [2025-09-25T22:23:10.567710] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-25T22:23:10.566511] [DEBUG] [LOCAL ] MCO: Loaded 39809 existing records from primary storage. [2025-09-25T22:23:10.568617] [INFO ] [MAIN ] MCO: Loaded 39809 primary data records. [2025-09-25T22:23:10.701157] [DEBUG] [LOCAL ] MCK: Derivative data saved (1807 records). [2025-09-25T22:23:10.702053] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-25T22:23:10.710329] [INFO ] [MAIN ] Derivative Progress: 1092/2043 symbols completed. MCK took 1.5s. Estimated remaining: 6m 42s. Rate: 141.9 symbols/min [2025-09-25T22:23:10.716065] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:10.933367] [DEBUG] [LOCAL ] MCR: Loaded 8814 existing records from primary storage. [2025-09-25T22:23:10.944097] [DEBUG] [MAIN ] MCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:10.946105] [INFO ] [MAIN ] MCR: Loaded 8814 primary data records. [2025-09-25T22:23:10.946000] [INFO ] [MAIN ] MCN: Generated 1807 derivative records from 8199 primary records. [2025-09-25T22:23:10.969729] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-25T22:23:11.280939] [DEBUG] [LOCAL ] MCN: Derivative data saved (1807 records). [2025-09-25T22:23:11.290288] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-25T22:23:11.293638] [INFO ] [MAIN ] Derivative Progress: 1093/2043 symbols completed. MCN took 1.2s. Estimated remaining: 6m 42s. Rate: 141.8 symbols/min [2025-09-25T22:23:11.319588] [DEBUG] [MAIN ] MCO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:23:11.320567] [INFO ] [MAIN ] MCO: Generated 1806 derivative records from 39809 primary records. [2025-09-25T22:23:11.320957] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-25T22:23:11.353729] [DEBUG] [MAIN ] MCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:11.355788] [INFO ] [MAIN ] MCR: Generated 1807 derivative records from 8814 primary records. [2025-09-25T22:23:11.355882] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-25T22:23:11.357177] [DEBUG] [LOCAL ] MCO: Derivative data saved (1806 records). [2025-09-25T22:23:11.357878] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-25T22:23:11.360284] [INFO ] [MAIN ] Derivative Progress: 1094/2043 symbols completed. MCO took 1.2s. Estimated remaining: 6m 41s. Rate: 141.9 symbols/min [2025-09-25T22:23:11.375241] [DEBUG] [LOCAL ] MCR: Derivative data saved (1807 records). [2025-09-25T22:23:11.375317] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-25T22:23:11.379359] [INFO ] [MAIN ] Derivative Progress: 1095/2043 symbols completed. MCR took 0.7s. Estimated remaining: 6m 40s. Rate: 142.1 symbols/min [2025-09-25T22:23:11.380119] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:11.380415] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:11.381286] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:11.411151] [DEBUG] [LOCAL ] MCS: Loaded 21354 existing records from primary storage. [2025-09-25T22:23:11.429675] [INFO ] [MAIN ] MCS: Loaded 21354 primary data records. [2025-09-25T22:23:11.436450] [DEBUG] [LOCAL ] MCY: Loaded 25210 existing records from primary storage. [2025-09-25T22:23:11.449155] [INFO ] [MAIN ] MCY: Loaded 25210 primary data records. [2025-09-25T22:23:11.624175] [DEBUG] [LOCAL ] MD: Loaded 38877 existing records from primary storage. [2025-09-25T22:23:11.645829] [INFO ] [MAIN ] MD: Loaded 38877 primary data records. [2025-09-25T22:23:12.483620] [DEBUG] [MAIN ] MCY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:12.485495] [INFO ] [MAIN ] MCY: Generated 1807 derivative records from 25210 primary records. [2025-09-25T22:23:12.485699] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-25T22:23:12.509015] [DEBUG] [MAIN ] MCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:12.515498] [INFO ] [MAIN ] MCS: Generated 1807 derivative records from 21354 primary records. [2025-09-25T22:23:12.516950] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-25T22:23:12.522695] [DEBUG] [LOCAL ] MCY: Derivative data saved (1807 records). [2025-09-25T22:23:12.523125] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-25T22:23:12.526977] [INFO ] [MAIN ] Derivative Progress: 1096/2043 symbols completed. MCY took 1.1s. Estimated remaining: 6m 41s. Rate: 141.9 symbols/min [2025-09-25T22:23:12.535058] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:12.546480] [DEBUG] [LOCAL ] MCS: Derivative data saved (1807 records). [2025-09-25T22:23:12.547272] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-25T22:23:12.550107] [INFO ] [MAIN ] Derivative Progress: 1097/2043 symbols completed. MCS took 1.2s. Estimated remaining: 6m 40s. Rate: 142.0 symbols/min [2025-09-25T22:23:12.551892] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:12.572373] [DEBUG] [LOCAL ] MDST: Loaded 5600 existing records from primary storage. [2025-09-25T22:23:12.572112] [DEBUG] [MAIN ] MD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:12.572661] [INFO ] [MAIN ] MDST: Loaded 5600 primary data records. [2025-09-25T22:23:12.579355] [INFO ] [MAIN ] MD: Generated 1807 derivative records from 38877 primary records. [2025-09-25T22:23:12.613821] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-25T22:23:12.789391] [DEBUG] [LOCAL ] MD: Derivative data saved (1807 records). [2025-09-25T22:23:12.795125] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-25T22:23:12.820563] [INFO ] [MAIN ] Derivative Progress: 1098/2043 symbols completed. MD took 1.4s. Estimated remaining: 6m 39s. Rate: 142.0 symbols/min [2025-09-25T22:23:12.832743] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:13.019429] [DEBUG] [LOCAL ] MDT: Loaded 54068 existing records from primary storage. [2025-09-25T22:23:13.020358] [INFO ] [MAIN ] MDT: Loaded 54068 primary data records. [2025-09-25T22:23:13.385128] [DEBUG] [LOCAL ] MDU: Loaded 48273 existing records from primary storage. [2025-09-25T22:23:13.385507] [INFO ] [MAIN ] MDU: Loaded 48273 primary data records. [2025-09-25T22:23:13.437516] [DEBUG] [MAIN ] MDST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:13.446170] [INFO ] [MAIN ] MDST: Generated 1807 derivative records from 5600 primary records. [2025-09-25T22:23:13.451796] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-25T22:23:13.565401] [DEBUG] [LOCAL ] MDST: Derivative data saved (1807 records). [2025-09-25T22:23:13.602344] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-25T22:23:13.626219] [INFO ] [MAIN ] Derivative Progress: 1099/2043 symbols completed. MDST took 1.1s. Estimated remaining: 6m 39s. Rate: 141.9 symbols/min [2025-09-25T22:23:13.627400] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:13.782243] [DEBUG] [MAIN ] MDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:13.787388] [DEBUG] [LOCAL ] MDV: Loaded 8699 existing records from primary storage. [2025-09-25T22:23:13.788700] [INFO ] [MAIN ] MDT: Generated 1807 derivative records from 54068 primary records. [2025-09-25T22:23:13.788942] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-25T22:23:13.789152] [INFO ] [MAIN ] MDV: Loaded 8699 primary data records. [2025-09-25T22:23:13.894895] [DEBUG] [LOCAL ] MDT: Derivative data saved (1807 records). [2025-09-25T22:23:13.915477] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-25T22:23:13.918094] [INFO ] [MAIN ] Derivative Progress: 1100/2043 symbols completed. MDT took 1.4s. Estimated remaining: 6m 39s. Rate: 141.9 symbols/min [2025-09-25T22:23:13.923105] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:14.170388] [DEBUG] [LOCAL ] MEC: Loaded 16543 existing records from primary storage. [2025-09-25T22:23:14.169438] [DEBUG] [MAIN ] MDU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:14.172894] [INFO ] [MAIN ] MDU: Generated 1807 derivative records from 48273 primary records. [2025-09-25T22:23:14.171809] [INFO ] [MAIN ] MEC: Loaded 16543 primary data records. [2025-09-25T22:23:14.187980] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-25T22:23:14.392147] [DEBUG] [LOCAL ] MDU: Derivative data saved (1807 records). [2025-09-25T22:23:14.398826] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-25T22:23:14.402249] [INFO ] [MAIN ] Derivative Progress: 1101/2043 symbols completed. MDU took 1.6s. Estimated remaining: 6m 38s. Rate: 141.9 symbols/min [2025-09-25T22:23:14.529404] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:14.553332] [DEBUG] [MAIN ] MDV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:14.562212] [INFO ] [MAIN ] MDV: Generated 1807 derivative records from 8699 primary records. [2025-09-25T22:23:14.562436] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-25T22:23:14.594904] [DEBUG] [LOCAL ] MED: Loaded 21913 existing records from primary storage. [2025-09-25T22:23:14.595969] [DEBUG] [LOCAL ] MDV: Derivative data saved (1807 records). [2025-09-25T22:23:14.596391] [INFO ] [MAIN ] MED: Loaded 21913 primary data records. [2025-09-25T22:23:14.596470] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-25T22:23:14.600792] [INFO ] [MAIN ] Derivative Progress: 1102/2043 symbols completed. MDV took 1.0s. Estimated remaining: 6m 38s. Rate: 142.0 symbols/min [2025-09-25T22:23:14.613666] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:14.790169] [DEBUG] [MAIN ] MEC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:23:14.827482] [INFO ] [MAIN ] MEC: Generated 1806 derivative records from 16543 primary records. [2025-09-25T22:23:14.937692] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-25T22:23:15.025138] [DEBUG] [LOCAL ] MEG: Loaded 32202 existing records from primary storage. [2025-09-25T22:23:15.033357] [INFO ] [MAIN ] MEG: Loaded 32202 primary data records. [2025-09-25T22:23:15.054859] [DEBUG] [LOCAL ] MEC: Derivative data saved (1806 records). [2025-09-25T22:23:15.070779] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-25T22:23:15.073457] [INFO ] [MAIN ] Derivative Progress: 1103/2043 symbols completed. MEC took 1.2s. Estimated remaining: 6m 37s. Rate: 142.0 symbols/min [2025-09-25T22:23:15.085264] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:15.421285] [DEBUG] [LOCAL ] MEGI: Loaded 20538 existing records from primary storage. [2025-09-25T22:23:15.422868] [INFO ] [MAIN ] MEGI: Loaded 20538 primary data records. [2025-09-25T22:23:15.503121] [DEBUG] [MAIN ] MED: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:15.531418] [INFO ] [MAIN ] MED: Generated 1807 derivative records from 21913 primary records. [2025-09-25T22:23:15.542080] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-25T22:23:15.795376] [DEBUG] [LOCAL ] MED: Derivative data saved (1807 records). [2025-09-25T22:23:15.797081] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-25T22:23:15.804799] [INFO ] [MAIN ] Derivative Progress: 1104/2043 symbols completed. MED took 1.3s. Estimated remaining: 6m 37s. Rate: 141.9 symbols/min [2025-09-25T22:23:15.805295] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:15.825336] [DEBUG] [MAIN ] MEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:15.826612] [INFO ] [MAIN ] MEG: Generated 1807 derivative records from 32202 primary records. [2025-09-25T22:23:15.827039] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-25T22:23:15.870195] [DEBUG] [LOCAL ] MEG: Derivative data saved (1807 records). [2025-09-25T22:23:15.870434] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-25T22:23:15.874119] [INFO ] [MAIN ] Derivative Progress: 1105/2043 symbols completed. MEG took 1.3s. Estimated remaining: 6m 36s. Rate: 142.0 symbols/min [2025-09-25T22:23:15.874850] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:15.906289] [DEBUG] [MAIN ] MEGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:15.908837] [INFO ] [MAIN ] MEGI: Generated 1807 derivative records from 20538 primary records. [2025-09-25T22:23:15.907104] [DEBUG] [LOCAL ] MEI: Loaded 32688 existing records from primary storage. [2025-09-25T22:23:15.909190] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-25T22:23:15.909854] [INFO ] [MAIN ] MEI: Loaded 32688 primary data records. [2025-09-25T22:23:15.964703] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1807 records). [2025-09-25T22:23:15.972266] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-25T22:23:15.976449] [INFO ] [MAIN ] Derivative Progress: 1106/2043 symbols completed. MEGI took 0.9s. Estimated remaining: 6m 36s. Rate: 142.1 symbols/min [2025-09-25T22:23:15.987822] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:16.287892] [DEBUG] [LOCAL ] MET: Loaded 53702 existing records from primary storage. [2025-09-25T22:23:16.288327] [INFO ] [MAIN ] MET: Loaded 53702 primary data records. [2025-09-25T22:23:16.496359] [DEBUG] [LOCAL ] MFA: Loaded 45667 existing records from primary storage. [2025-09-25T22:23:16.518125] [INFO ] [MAIN ] MFA: Loaded 45667 primary data records. [2025-09-25T22:23:16.910210] [DEBUG] [MAIN ] MEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:17.070428] [INFO ] [MAIN ] MEI: Generated 1807 derivative records from 32688 primary records. [2025-09-25T22:23:17.071092] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-25T22:23:17.096350] [DEBUG] [LOCAL ] MEI: Derivative data saved (1807 records). [2025-09-25T22:23:17.110626] [DEBUG] [MAIN ] MET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:17.110309] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-25T22:23:17.115094] [INFO ] [MAIN ] Derivative Progress: 1107/2043 symbols completed. MEI took 1.3s. Estimated remaining: 6m 36s. Rate: 141.9 symbols/min [2025-09-25T22:23:17.115425] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:17.111670] [INFO ] [MAIN ] MET: Generated 1807 derivative records from 53702 primary records. [2025-09-25T22:23:17.115629] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-25T22:23:17.137399] [DEBUG] [LOCAL ] MFAN: Loaded 4307 existing records from primary storage. [2025-09-25T22:23:17.138214] [INFO ] [MAIN ] MFAN: Loaded 4307 primary data records. [2025-09-25T22:23:17.245142] [DEBUG] [LOCAL ] MET: Derivative data saved (1807 records). [2025-09-25T22:23:17.248831] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-25T22:23:17.252197] [INFO ] [MAIN ] Derivative Progress: 1108/2043 symbols completed. MET took 1.4s. Estimated remaining: 6m 35s. Rate: 142.0 symbols/min [2025-09-25T22:23:17.479940] [DEBUG] [MAIN ] MFA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:17.481203] [INFO ] [MAIN ] MFA: Generated 1807 derivative records from 45667 primary records. [2025-09-25T22:23:17.482038] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-25T22:23:17.503945] [DEBUG] [LOCAL ] MFA: Derivative data saved (1807 records). [2025-09-25T22:23:17.504249] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-25T22:23:17.508857] [INFO ] [MAIN ] Derivative Progress: 1109/2043 symbols completed. MFA took 1.5s. Estimated remaining: 6m 35s. Rate: 142.0 symbols/min [2025-09-25T22:23:17.527123] [DEBUG] [MAIN ] MFAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:17.527778] [INFO ] [MAIN ] MFAN: Generated 1807 derivative records from 4307 primary records. [2025-09-25T22:23:17.527841] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-25T22:23:17.542149] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1807 records). [2025-09-25T22:23:17.542209] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-25T22:23:17.545720] [INFO ] [MAIN ] Derivative Progress: 1110/2043 symbols completed. MFAN took 0.4s. Estimated remaining: 6m 34s. Rate: 142.1 symbols/min [2025-09-25T22:23:17.546593] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:17.546397] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:17.547233] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:17.559747] [DEBUG] [LOCAL ] MFAO: Loaded 3826 existing records from primary storage. [2025-09-25T22:23:17.560017] [INFO ] [MAIN ] MFAO: Loaded 3826 primary data records. [2025-09-25T22:23:17.941527] [DEBUG] [LOCAL ] MFC: Loaded 51660 existing records from primary storage. [2025-09-25T22:23:17.940736] [DEBUG] [LOCAL ] MFG: Loaded 49399 existing records from primary storage. [2025-09-25T22:23:17.942282] [INFO ] [MAIN ] MFG: Loaded 49399 primary data records. [2025-09-25T22:23:17.942198] [INFO ] [MAIN ] MFC: Loaded 51660 primary data records. [2025-09-25T22:23:18.582283] [DEBUG] [MAIN ] MFAO: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-09-25T22:23:18.584479] [INFO ] [MAIN ] MFAO: Generated 1804 derivative records from 3826 primary records. [2025-09-25T22:23:18.584711] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-25T22:23:18.602419] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1804 records). [2025-09-25T22:23:18.603833] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-25T22:23:18.607820] [INFO ] [MAIN ] Derivative Progress: 1111/2043 symbols completed. MFAO took 1.1s. Estimated remaining: 6m 34s. Rate: 141.9 symbols/min [2025-09-25T22:23:18.608322] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:18.630509] [DEBUG] [LOCAL ] MFM: Loaded 14330 existing records from primary storage. [2025-09-25T22:23:18.631533] [INFO ] [MAIN ] MFM: Loaded 14330 primary data records. [2025-09-25T22:23:18.696285] [DEBUG] [MAIN ] MFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:18.713717] [DEBUG] [MAIN ] MFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:18.714602] [INFO ] [MAIN ] MFG: Generated 1807 derivative records from 49399 primary records. [2025-09-25T22:23:18.715348] [INFO ] [MAIN ] MFC: Generated 1807 derivative records from 51660 primary records. [2025-09-25T22:23:18.715432] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-25T22:23:18.715595] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-25T22:23:18.867075] [DEBUG] [LOCAL ] MFG: Derivative data saved (1807 records). [2025-09-25T22:23:18.870518] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-25T22:23:18.894748] [INFO ] [MAIN ] Derivative Progress: 1112/2043 symbols completed. MFG took 1.3s. Estimated remaining: 6m 33s. Rate: 142.0 symbols/min [2025-09-25T22:23:18.966316] [INFO ] [MAIN ] MFSG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:18.998696] [DEBUG] [LOCAL ] MFC: Derivative data saved (1807 records). [2025-09-25T22:23:18.999330] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-25T22:23:19.002714] [INFO ] [MAIN ] Derivative Progress: 1113/2043 symbols completed. MFC took 1.5s. Estimated remaining: 6m 33s. Rate: 142.1 symbols/min [2025-09-25T22:23:19.003386] [INFO ] [MAIN ] MFSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:19.011834] [DEBUG] [LOCAL ] MFSG: Loaded 5222 existing records from primary storage. [2025-09-25T22:23:19.013372] [INFO ] [MAIN ] MFSG: Loaded 5222 primary data records. [2025-09-25T22:23:19.105912] [DEBUG] [LOCAL ] MFSI: Loaded 11262 existing records from primary storage. [2025-09-25T22:23:19.193995] [INFO ] [MAIN ] MFSI: Loaded 11262 primary data records. [2025-09-25T22:23:19.600190] [DEBUG] [MAIN ] MFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:19.601603] [INFO ] [MAIN ] MFM: Generated 1807 derivative records from 14330 primary records. [2025-09-25T22:23:19.722282] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-25T22:23:19.743043] [DEBUG] [LOCAL ] MFM: Derivative data saved (1807 records). [2025-09-25T22:23:19.744002] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-25T22:23:19.748370] [INFO ] [MAIN ] Derivative Progress: 1114/2043 symbols completed. MFM took 1.1s. Estimated remaining: 6m 33s. Rate: 142.0 symbols/min [2025-09-25T22:23:19.749772] [INFO ] [MAIN ] MFSV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:19.760360] [DEBUG] [LOCAL ] MFSV: Loaded 2484 existing records from primary storage. [2025-09-25T22:23:19.760610] [INFO ] [MAIN ] MFSV: Loaded 2484 primary data records. [2025-09-25T22:23:19.851971] [DEBUG] [MAIN ] MFSG: Filtered 6966 bins outside market hours, 7765 incomplete bins [2025-09-25T22:23:19.864096] [INFO ] [MAIN ] MFSG: Generated 1801 derivative records from 5222 primary records. [2025-09-25T22:23:19.878907] [DEBUG] [LOCAL ] MFSG: Saving derivative data. [2025-09-25T22:23:19.937847] [DEBUG] [LOCAL ] MFSG: Derivative data saved (1801 records). [2025-09-25T22:23:19.938204] [INFO ] [MAIN ] MFSG: Successfully saved derivative data. [2025-09-25T22:23:19.968245] [INFO ] [MAIN ] Derivative Progress: 1115/2043 symbols completed. MFSG took 1.0s. Estimated remaining: 6m 32s. Rate: 142.0 symbols/min [2025-09-25T22:23:20.084421] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:20.163751] [DEBUG] [MAIN ] MFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:20.165495] [INFO ] [MAIN ] MFSI: Generated 1807 derivative records from 11262 primary records. [2025-09-25T22:23:20.165588] [DEBUG] [LOCAL ] MFSI: Saving derivative data. [2025-09-25T22:23:20.196920] [DEBUG] [LOCAL ] MG: Loaded 16756 existing records from primary storage. [2025-09-25T22:23:20.198845] [INFO ] [MAIN ] MG: Loaded 16756 primary data records. [2025-09-25T22:23:20.204464] [DEBUG] [LOCAL ] MFSI: Derivative data saved (1807 records). [2025-09-25T22:23:20.204573] [INFO ] [MAIN ] MFSI: Successfully saved derivative data. [2025-09-25T22:23:20.208695] [INFO ] [MAIN ] Derivative Progress: 1116/2043 symbols completed. MFSI took 1.2s. Estimated remaining: 6m 31s. Rate: 142.1 symbols/min [2025-09-25T22:23:20.237064] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:20.541936] [DEBUG] [MAIN ] MFSV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:23:20.544180] [INFO ] [MAIN ] MFSV: Generated 1806 derivative records from 2484 primary records. [2025-09-25T22:23:20.544392] [DEBUG] [LOCAL ] MFSV: Saving derivative data. [2025-09-25T22:23:20.560594] [DEBUG] [LOCAL ] MFSV: Derivative data saved (1806 records). [2025-09-25T22:23:20.577551] [INFO ] [MAIN ] MFSV: Successfully saved derivative data. [2025-09-25T22:23:20.581291] [INFO ] [MAIN ] Derivative Progress: 1117/2043 symbols completed. MFSV took 0.8s. Estimated remaining: 6m 31s. Rate: 142.1 symbols/min [2025-09-25T22:23:20.582698] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:20.610672] [DEBUG] [LOCAL ] MGF: Loaded 4173 existing records from primary storage. [2025-09-25T22:23:20.612100] [INFO ] [MAIN ] MGF: Loaded 4173 primary data records. [2025-09-25T22:23:20.635158] [DEBUG] [LOCAL ] MGA: Loaded 51028 existing records from primary storage. [2025-09-25T22:23:20.651065] [INFO ] [MAIN ] MGA: Loaded 51028 primary data records. [2025-09-25T22:23:21.085477] [DEBUG] [MAIN ] MG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:21.122973] [INFO ] [MAIN ] MG: Generated 1807 derivative records from 16756 primary records. [2025-09-25T22:23:21.312526] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-25T22:23:21.342223] [DEBUG] [LOCAL ] MG: Derivative data saved (1807 records). [2025-09-25T22:23:21.343253] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-25T22:23:21.347135] [INFO ] [MAIN ] Derivative Progress: 1118/2043 symbols completed. MG took 1.3s. Estimated remaining: 6m 31s. Rate: 142.0 symbols/min [2025-09-25T22:23:21.347995] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:21.377380] [DEBUG] [MAIN ] MGF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:21.378612] [INFO ] [MAIN ] MGF: Generated 1807 derivative records from 4173 primary records. [2025-09-25T22:23:21.378821] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-25T22:23:21.410911] [DEBUG] [MAIN ] MGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:21.413971] [DEBUG] [LOCAL ] MGF: Derivative data saved (1807 records). [2025-09-25T22:23:21.413529] [INFO ] [MAIN ] MGA: Generated 1807 derivative records from 51028 primary records. [2025-09-25T22:23:21.414289] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-25T22:23:21.414109] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-25T22:23:21.418692] [INFO ] [MAIN ] Derivative Progress: 1119/2043 symbols completed. MGF took 0.8s. Estimated remaining: 6m 30s. Rate: 142.1 symbols/min [2025-09-25T22:23:21.419109] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:21.451885] [DEBUG] [LOCAL ] MGA: Derivative data saved (1807 records). [2025-09-25T22:23:21.452191] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-25T22:23:21.456549] [INFO ] [MAIN ] Derivative Progress: 1120/2043 symbols completed. MGA took 1.2s. Estimated remaining: 6m 29s. Rate: 142.2 symbols/min [2025-09-25T22:23:21.457183] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:21.462954] [DEBUG] [LOCAL ] MGR: Loaded 5649 existing records from primary storage. [2025-09-25T22:23:21.463408] [INFO ] [MAIN ] MGR: Loaded 5649 primary data records. [2025-09-25T22:23:21.569108] [DEBUG] [LOCAL ] MGM: Loaded 53998 existing records from primary storage. [2025-09-25T22:23:21.590845] [INFO ] [MAIN ] MGM: Loaded 53998 primary data records. [2025-09-25T22:23:21.599868] [DEBUG] [LOCAL ] MGRB: Loaded 4096 existing records from primary storage. [2025-09-25T22:23:21.600093] [INFO ] [MAIN ] MGRB: Loaded 4096 primary data records. [2025-09-25T22:23:22.536670] [DEBUG] [MAIN ] MGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:22.537871] [INFO ] [MAIN ] MGR: Generated 1807 derivative records from 5649 primary records. [2025-09-25T22:23:22.538072] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-25T22:23:22.568781] [DEBUG] [LOCAL ] MGR: Derivative data saved (1807 records). [2025-09-25T22:23:22.575123] [DEBUG] [MAIN ] MGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:22.576129] [INFO ] [MAIN ] MGM: Generated 1807 derivative records from 53998 primary records. [2025-09-25T22:23:22.575212] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-25T22:23:22.578809] [INFO ] [MAIN ] Derivative Progress: 1121/2043 symbols completed. MGR took 1.2s. Estimated remaining: 6m 30s. Rate: 142.0 symbols/min [2025-09-25T22:23:22.578924] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-25T22:23:22.579293] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:22.594800] [DEBUG] [MAIN ] MGRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:22.611499] [INFO ] [MAIN ] MGRB: Generated 1807 derivative records from 4096 primary records. [2025-09-25T22:23:22.611779] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-25T22:23:22.615525] [DEBUG] [LOCAL ] MGRD: Loaded 2222 existing records from primary storage. [2025-09-25T22:23:22.617686] [INFO ] [MAIN ] MGRD: Loaded 2222 primary data records. [2025-09-25T22:23:22.618104] [DEBUG] [LOCAL ] MGM: Derivative data saved (1807 records). [2025-09-25T22:23:22.624418] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-25T22:23:22.652232] [INFO ] [MAIN ] Derivative Progress: 1122/2043 symbols completed. MGM took 1.3s. Estimated remaining: 6m 29s. Rate: 142.1 symbols/min [2025-09-25T22:23:22.683843] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1807 records). [2025-09-25T22:23:22.684024] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-25T22:23:22.721638] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:22.732179] [INFO ] [MAIN ] Derivative Progress: 1123/2043 symbols completed. MGRB took 1.3s. Estimated remaining: 6m 28s. Rate: 142.2 symbols/min [2025-09-25T22:23:22.850093] [DEBUG] [LOCAL ] MGRE: Loaded 6653 existing records from primary storage. [2025-09-25T22:23:22.977940] [INFO ] [MAIN ] MGRE: Loaded 6653 primary data records. [2025-09-25T22:23:23.391386] [DEBUG] [MAIN ] MGRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:23.392320] [INFO ] [MAIN ] MGRD: Generated 1807 derivative records from 2222 primary records. [2025-09-25T22:23:23.392437] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-25T22:23:23.408562] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1807 records). [2025-09-25T22:23:23.408952] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-25T22:23:23.411444] [INFO ] [MAIN ] Derivative Progress: 1124/2043 symbols completed. MGRD took 0.8s. Estimated remaining: 6m 28s. Rate: 142.1 symbols/min [2025-09-25T22:23:23.427953] [DEBUG] [MAIN ] MGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:23.428683] [INFO ] [MAIN ] MGRE: Generated 1807 derivative records from 6653 primary records. [2025-09-25T22:23:23.428748] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-25T22:23:23.444377] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1807 records). [2025-09-25T22:23:23.444510] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-25T22:23:23.447062] [INFO ] [MAIN ] Derivative Progress: 1125/2043 symbols completed. MGRE took 0.7s. Estimated remaining: 6m 27s. Rate: 142.3 symbols/min [2025-09-25T22:23:23.448081] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:23.448484] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:23.449295] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:23.461366] [DEBUG] [LOCAL ] MHF: Loaded 8678 existing records from primary storage. [2025-09-25T22:23:23.461525] [INFO ] [MAIN ] MHF: Loaded 8678 primary data records. [2025-09-25T22:23:23.532255] [DEBUG] [LOCAL ] MHD: Loaded 12200 existing records from primary storage. [2025-09-25T22:23:23.551136] [INFO ] [MAIN ] MHD: Loaded 12200 primary data records. [2025-09-25T22:23:24.036525] [DEBUG] [LOCAL ] MGY: Loaded 52808 existing records from primary storage. [2025-09-25T22:23:24.046102] [INFO ] [MAIN ] MGY: Loaded 52808 primary data records. [2025-09-25T22:23:24.581309] [DEBUG] [MAIN ] MHF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:24.581703] [DEBUG] [MAIN ] MHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:24.582765] [INFO ] [MAIN ] MHF: Generated 1807 derivative records from 8678 primary records. [2025-09-25T22:23:24.583764] [INFO ] [MAIN ] MHD: Generated 1807 derivative records from 12200 primary records. [2025-09-25T22:23:24.584014] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-25T22:23:24.584100] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-25T22:23:24.626565] [DEBUG] [LOCAL ] MHF: Derivative data saved (1807 records). [2025-09-25T22:23:24.627008] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-25T22:23:24.626186] [DEBUG] [LOCAL ] MHD: Derivative data saved (1807 records). [2025-09-25T22:23:24.631285] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-25T22:23:24.631018] [INFO ] [MAIN ] Derivative Progress: 1126/2043 symbols completed. MHF took 1.2s. Estimated remaining: 6m 27s. Rate: 142.0 symbols/min [2025-09-25T22:23:24.635094] [INFO ] [MAIN ] Derivative Progress: 1127/2043 symbols completed. MHD took 1.2s. Estimated remaining: 6m 27s. Rate: 142.2 symbols/min [2025-09-25T22:23:24.635353] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:24.636747] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:24.658067] [DEBUG] [MAIN ] MGY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:24.659254] [INFO ] [MAIN ] MGY: Generated 1807 derivative records from 52808 primary records. [2025-09-25T22:23:24.663820] [DEBUG] [LOCAL ] MHN: Loaded 7852 existing records from primary storage. [2025-09-25T22:23:24.664075] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-25T22:23:24.664860] [INFO ] [MAIN ] MHN: Loaded 7852 primary data records. [2025-09-25T22:23:24.835986] [DEBUG] [LOCAL ] MGY: Derivative data saved (1807 records). [2025-09-25T22:23:24.836283] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-25T22:23:24.852115] [INFO ] [MAIN ] Derivative Progress: 1128/2043 symbols completed. MGY took 1.4s. Estimated remaining: 6m 26s. Rate: 142.2 symbols/min [2025-09-25T22:23:24.904844] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:24.947480] [DEBUG] [LOCAL ] MHK: Loaded 42816 existing records from primary storage. [2025-09-25T22:23:24.948164] [INFO ] [MAIN ] MHK: Loaded 42816 primary data records. [2025-09-25T22:23:25.309100] [DEBUG] [LOCAL ] MHO: Loaded 24495 existing records from primary storage. [2025-09-25T22:23:25.483143] [INFO ] [MAIN ] MHO: Loaded 24495 primary data records. [2025-09-25T22:23:25.676554] [DEBUG] [MAIN ] MHN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:25.708155] [INFO ] [MAIN ] MHN: Generated 1807 derivative records from 7852 primary records. [2025-09-25T22:23:25.754377] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-25T22:23:25.916398] [DEBUG] [MAIN ] MHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:25.917946] [INFO ] [MAIN ] MHK: Generated 1807 derivative records from 42816 primary records. [2025-09-25T22:23:25.918100] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-25T22:23:25.936433] [DEBUG] [LOCAL ] MHN: Derivative data saved (1807 records). [2025-09-25T22:23:25.937450] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-25T22:23:25.940670] [INFO ] [MAIN ] Derivative Progress: 1129/2043 symbols completed. MHN took 1.3s. Estimated remaining: 6m 26s. Rate: 142.0 symbols/min [2025-09-25T22:23:25.942485] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:25.946280] [DEBUG] [LOCAL ] MHK: Derivative data saved (1807 records). [2025-09-25T22:23:25.946559] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-25T22:23:25.949253] [INFO ] [MAIN ] Derivative Progress: 1130/2043 symbols completed. MHK took 1.3s. Estimated remaining: 6m 25s. Rate: 142.1 symbols/min [2025-09-25T22:23:25.949764] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:25.962674] [DEBUG] [LOCAL ] MIN: Loaded 13198 existing records from primary storage. [2025-09-25T22:23:25.964820] [INFO ] [MAIN ] MIN: Loaded 13198 primary data records. [2025-09-25T22:23:26.037440] [DEBUG] [MAIN ] MHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:26.061967] [INFO ] [MAIN ] MHO: Generated 1807 derivative records from 24495 primary records. [2025-09-25T22:23:26.068882] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-25T22:23:26.184633] [DEBUG] [LOCAL ] MHO: Derivative data saved (1807 records). [2025-09-25T22:23:26.185086] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-25T22:23:26.197351] [INFO ] [MAIN ] Derivative Progress: 1131/2043 symbols completed. MHO took 1.3s. Estimated remaining: 6m 25s. Rate: 142.2 symbols/min [2025-09-25T22:23:26.235337] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:26.385190] [DEBUG] [LOCAL ] MIR: Loaded 51232 existing records from primary storage. [2025-09-25T22:23:26.387198] [INFO ] [MAIN ] MIR: Loaded 51232 primary data records. [2025-09-25T22:23:26.395834] [DEBUG] [LOCAL ] MITP: Loaded 2455 existing records from primary storage. [2025-09-25T22:23:26.419316] [INFO ] [MAIN ] MITP: Loaded 2455 primary data records. [2025-09-25T22:23:27.183262] [DEBUG] [MAIN ] MIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:27.184463] [INFO ] [MAIN ] MIN: Generated 1807 derivative records from 13198 primary records. [2025-09-25T22:23:27.184873] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-25T22:23:27.216440] [DEBUG] [LOCAL ] MIN: Derivative data saved (1807 records). [2025-09-25T22:23:27.218343] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-25T22:23:27.224107] [INFO ] [MAIN ] Derivative Progress: 1132/2043 symbols completed. MIN took 1.3s. Estimated remaining: 6m 25s. Rate: 142.0 symbols/min [2025-09-25T22:23:27.226043] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:27.239997] [DEBUG] [MAIN ] MITP: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:23:27.241334] [INFO ] [MAIN ] MITP: Generated 1805 derivative records from 2455 primary records. [2025-09-25T22:23:27.241540] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-25T22:23:27.272722] [DEBUG] [LOCAL ] MITP: Derivative data saved (1805 records). [2025-09-25T22:23:27.278508] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-25T22:23:27.289757] [INFO ] [MAIN ] Derivative Progress: 1133/2043 symbols completed. MITP took 1.1s. Estimated remaining: 6m 24s. Rate: 142.1 symbols/min [2025-09-25T22:23:27.299396] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:27.299928] [DEBUG] [MAIN ] MIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:27.300928] [DEBUG] [LOCAL ] MITT: Loaded 23213 existing records from primary storage. [2025-09-25T22:23:27.302194] [INFO ] [MAIN ] MITT: Loaded 23213 primary data records. [2025-09-25T22:23:27.302115] [INFO ] [MAIN ] MIR: Generated 1807 derivative records from 51232 primary records. [2025-09-25T22:23:27.302457] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-25T22:23:27.423163] [DEBUG] [LOCAL ] MIY: Loaded 6046 existing records from primary storage. [2025-09-25T22:23:27.445581] [INFO ] [MAIN ] MIY: Loaded 6046 primary data records. [2025-09-25T22:23:27.496307] [DEBUG] [LOCAL ] MIR: Derivative data saved (1807 records). [2025-09-25T22:23:27.506773] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-25T22:23:27.551618] [INFO ] [MAIN ] Derivative Progress: 1134/2043 symbols completed. MIR took 1.6s. Estimated remaining: 6m 24s. Rate: 142.2 symbols/min [2025-09-25T22:23:27.636669] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:28.091173] [DEBUG] [MAIN ] MITT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:28.092338] [INFO ] [MAIN ] MITT: Generated 1807 derivative records from 23213 primary records. [2025-09-25T22:23:28.093430] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-25T22:23:28.139236] [DEBUG] [LOCAL ] MKC: Loaded 52820 existing records from primary storage. [2025-09-25T22:23:28.137739] [DEBUG] [MAIN ] MIY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:28.140638] [INFO ] [MAIN ] MIY: Generated 1807 derivative records from 6046 primary records. [2025-09-25T22:23:28.140771] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-25T22:23:28.141157] [INFO ] [MAIN ] MKC: Loaded 52820 primary data records. [2025-09-25T22:23:28.216001] [DEBUG] [LOCAL ] MITT: Derivative data saved (1807 records). [2025-09-25T22:23:28.225472] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-25T22:23:28.229185] [INFO ] [MAIN ] Derivative Progress: 1135/2043 symbols completed. MITT took 1.0s. Estimated remaining: 6m 23s. Rate: 142.1 symbols/min [2025-09-25T22:23:28.234893] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:28.320419] [DEBUG] [LOCAL ] MIY: Derivative data saved (1807 records). [2025-09-25T22:23:28.358171] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-25T22:23:28.370088] [INFO ] [MAIN ] Derivative Progress: 1136/2043 symbols completed. MIY took 1.1s. Estimated remaining: 6m 23s. Rate: 142.2 symbols/min [2025-09-25T22:23:28.370682] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:28.529119] [DEBUG] [LOCAL ] MKL: Loaded 34303 existing records from primary storage. [2025-09-25T22:23:28.529847] [INFO ] [MAIN ] MKL: Loaded 34303 primary data records. [2025-09-25T22:23:28.770953] [DEBUG] [LOCAL ] MLI: Loaded 44135 existing records from primary storage. [2025-09-25T22:23:28.771638] [INFO ] [MAIN ] MLI: Loaded 44135 primary data records. [2025-09-25T22:23:28.771423] [DEBUG] [MAIN ] MKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:28.772594] [INFO ] [MAIN ] MKC: Generated 1807 derivative records from 52820 primary records. [2025-09-25T22:23:28.772902] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-25T22:23:28.977170] [DEBUG] [LOCAL ] MKC: Derivative data saved (1807 records). [2025-09-25T22:23:28.996328] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-25T22:23:29.005364] [INFO ] [MAIN ] Derivative Progress: 1137/2043 symbols completed. MKC took 1.4s. Estimated remaining: 6m 23s. Rate: 142.1 symbols/min [2025-09-25T22:23:29.030610] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:29.275730] [DEBUG] [MAIN ] MKL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:29.277130] [INFO ] [MAIN ] MKL: Generated 1807 derivative records from 34303 primary records. [2025-09-25T22:23:29.277556] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-25T22:23:29.301411] [DEBUG] [LOCAL ] MLM: Loaded 30863 existing records from primary storage. [2025-09-25T22:23:29.302221] [INFO ] [MAIN ] MLM: Loaded 30863 primary data records. [2025-09-25T22:23:29.407916] [DEBUG] [LOCAL ] MKL: Derivative data saved (1807 records). [2025-09-25T22:23:29.427897] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-25T22:23:29.431553] [INFO ] [MAIN ] Derivative Progress: 1138/2043 symbols completed. MKL took 1.2s. Estimated remaining: 6m 22s. Rate: 142.1 symbols/min [2025-09-25T22:23:29.656777] [DEBUG] [MAIN ] MLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:29.658389] [INFO ] [MAIN ] MLI: Generated 1807 derivative records from 44135 primary records. [2025-09-25T22:23:29.658508] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-25T22:23:29.679124] [DEBUG] [LOCAL ] MLI: Derivative data saved (1807 records). [2025-09-25T22:23:29.679707] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-25T22:23:29.682950] [INFO ] [MAIN ] Derivative Progress: 1139/2043 symbols completed. MLI took 1.3s. Estimated remaining: 6m 22s. Rate: 142.2 symbols/min [2025-09-25T22:23:29.703367] [DEBUG] [MAIN ] MLM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:29.704103] [INFO ] [MAIN ] MLM: Generated 1807 derivative records from 30863 primary records. [2025-09-25T22:23:29.704173] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-25T22:23:29.719898] [DEBUG] [LOCAL ] MLM: Derivative data saved (1807 records). [2025-09-25T22:23:29.719990] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-25T22:23:29.722608] [INFO ] [MAIN ] Derivative Progress: 1140/2043 symbols completed. MLM took 0.7s. Estimated remaining: 6m 21s. Rate: 142.3 symbols/min [2025-09-25T22:23:29.723931] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:29.723852] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:29.723724] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:29.731992] [DEBUG] [LOCAL ] MLP: Loaded 3117 existing records from primary storage. [2025-09-25T22:23:29.732127] [INFO ] [MAIN ] MLP: Loaded 3117 primary data records. [2025-09-25T22:23:29.869223] [DEBUG] [LOCAL ] MLR: Loaded 12887 existing records from primary storage. [2025-09-25T22:23:29.875985] [INFO ] [MAIN ] MLR: Loaded 12887 primary data records. [2025-09-25T22:23:29.955223] [DEBUG] [LOCAL ] MLNK: Loaded 25735 existing records from primary storage. [2025-09-25T22:23:29.995171] [INFO ] [MAIN ] MLNK: Loaded 25735 primary data records. [2025-09-25T22:23:30.869502] [DEBUG] [MAIN ] MLP: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-09-25T22:23:30.870766] [INFO ] [MAIN ] MLP: Generated 1804 derivative records from 3117 primary records. [2025-09-25T22:23:30.870950] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-25T22:23:30.891003] [DEBUG] [LOCAL ] MLP: Derivative data saved (1804 records). [2025-09-25T22:23:30.892875] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-25T22:23:30.896217] [INFO ] [MAIN ] Derivative Progress: 1141/2043 symbols completed. MLP took 1.2s. Estimated remaining: 6m 21s. Rate: 142.0 symbols/min [2025-09-25T22:23:30.905129] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:30.925323] [DEBUG] [MAIN ] MLNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:30.927134] [INFO ] [MAIN ] MLNK: Generated 1807 derivative records from 25735 primary records. [2025-09-25T22:23:30.927388] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-25T22:23:30.927697] [DEBUG] [MAIN ] MLR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:30.929691] [INFO ] [MAIN ] MLR: Generated 1807 derivative records from 12887 primary records. [2025-09-25T22:23:30.929840] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-25T22:23:30.962691] [DEBUG] [LOCAL ] MLR: Derivative data saved (1807 records). [2025-09-25T22:23:30.963683] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-25T22:23:30.966814] [INFO ] [MAIN ] Derivative Progress: 1142/2043 symbols completed. MLR took 1.2s. Estimated remaining: 6m 20s. Rate: 142.2 symbols/min [2025-09-25T22:23:30.967797] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:30.968553] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1807 records). [2025-09-25T22:23:30.969442] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-25T22:23:30.972444] [INFO ] [MAIN ] Derivative Progress: 1143/2043 symbols completed. MLNK took 1.2s. Estimated remaining: 6m 20s. Rate: 142.3 symbols/min [2025-09-25T22:23:30.973151] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:31.001981] [DEBUG] [LOCAL ] MMD: Loaded 11356 existing records from primary storage. [2025-09-25T22:23:31.006725] [INFO ] [MAIN ] MMD: Loaded 11356 primary data records. [2025-09-25T22:23:31.091141] [DEBUG] [LOCAL ] MMI: Loaded 15372 existing records from primary storage. [2025-09-25T22:23:31.133278] [INFO ] [MAIN ] MMI: Loaded 15372 primary data records. [2025-09-25T22:23:31.154276] [DEBUG] [LOCAL ] MMC: Loaded 52193 existing records from primary storage. [2025-09-25T22:23:31.187238] [INFO ] [MAIN ] MMC: Loaded 52193 primary data records. [2025-09-25T22:23:32.336989] [DEBUG] [MAIN ] MMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:32.338741] [INFO ] [MAIN ] MMD: Generated 1807 derivative records from 11356 primary records. [2025-09-25T22:23:32.339334] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-25T22:23:32.380852] [DEBUG] [MAIN ] MMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:32.382610] [INFO ] [MAIN ] MMI: Generated 1807 derivative records from 15372 primary records. [2025-09-25T22:23:32.383152] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-25T22:23:32.385155] [DEBUG] [LOCAL ] MMD: Derivative data saved (1807 records). [2025-09-25T22:23:32.400853] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-25T22:23:32.414884] [DEBUG] [MAIN ] MMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:32.414244] [INFO ] [MAIN ] Derivative Progress: 1144/2043 symbols completed. MMD took 1.4s. Estimated remaining: 6m 20s. Rate: 142.0 symbols/min [2025-09-25T22:23:32.420837] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:32.423540] [DEBUG] [LOCAL ] MMI: Derivative data saved (1807 records). [2025-09-25T22:23:32.424047] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-25T22:23:32.423368] [INFO ] [MAIN ] MMC: Generated 1807 derivative records from 52193 primary records. [2025-09-25T22:23:32.428483] [INFO ] [MAIN ] Derivative Progress: 1145/2043 symbols completed. MMI took 1.5s. Estimated remaining: 6m 19s. Rate: 142.1 symbols/min [2025-09-25T22:23:32.428940] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-25T22:23:32.430294] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:32.454429] [DEBUG] [LOCAL ] MMC: Derivative data saved (1807 records). [2025-09-25T22:23:32.454622] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-25T22:23:32.458394] [INFO ] [MAIN ] Derivative Progress: 1146/2043 symbols completed. MMC took 1.6s. Estimated remaining: 6m 18s. Rate: 142.2 symbols/min [2025-09-25T22:23:32.458941] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:32.500476] [DEBUG] [LOCAL ] MMT: Loaded 10959 existing records from primary storage. [2025-09-25T22:23:32.510693] [INFO ] [MAIN ] MMT: Loaded 10959 primary data records. [2025-09-25T22:23:32.534690] [DEBUG] [LOCAL ] MMS: Loaded 34138 existing records from primary storage. [2025-09-25T22:23:32.569225] [INFO ] [MAIN ] MMS: Loaded 34138 primary data records. [2025-09-25T22:23:32.590870] [DEBUG] [LOCAL ] MMM: Loaded 53617 existing records from primary storage. [2025-09-25T22:23:32.637854] [INFO ] [MAIN ] MMM: Loaded 53617 primary data records. [2025-09-25T22:23:33.686365] [DEBUG] [MAIN ] MMS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:33.687492] [INFO ] [MAIN ] MMS: Generated 1807 derivative records from 34138 primary records. [2025-09-25T22:23:33.688519] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-25T22:23:33.721603] [DEBUG] [LOCAL ] MMS: Derivative data saved (1807 records). [2025-09-25T22:23:33.722812] [DEBUG] [MAIN ] MMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:33.722934] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-25T22:23:33.727252] [INFO ] [MAIN ] MMM: Generated 1807 derivative records from 53617 primary records. [2025-09-25T22:23:33.727447] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-25T22:23:33.726216] [INFO ] [MAIN ] Derivative Progress: 1147/2043 symbols completed. MMS took 1.3s. Estimated remaining: 6m 19s. Rate: 142.0 symbols/min [2025-09-25T22:23:33.728724] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:33.755973] [DEBUG] [MAIN ] MMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:33.758098] [INFO ] [MAIN ] MMT: Generated 1807 derivative records from 10959 primary records. [2025-09-25T22:23:33.764245] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-25T22:23:33.773772] [DEBUG] [LOCAL ] MMM: Derivative data saved (1807 records). [2025-09-25T22:23:33.784317] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-25T22:23:33.787955] [DEBUG] [LOCAL ] MMU: Loaded 17066 existing records from primary storage. [2025-09-25T22:23:33.787221] [INFO ] [MAIN ] Derivative Progress: 1148/2043 symbols completed. MMM took 1.4s. Estimated remaining: 6m 18s. Rate: 142.1 symbols/min [2025-09-25T22:23:33.791358] [INFO ] [MAIN ] MMU: Loaded 17066 primary data records. [2025-09-25T22:23:33.792127] [DEBUG] [LOCAL ] MMT: Derivative data saved (1807 records). [2025-09-25T22:23:33.792633] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-25T22:23:33.800573] [INFO ] [MAIN ] Derivative Progress: 1149/2043 symbols completed. MMT took 1.3s. Estimated remaining: 6m 17s. Rate: 142.2 symbols/min [2025-09-25T22:23:33.792255] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:33.833876] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:34.125126] [DEBUG] [LOCAL ] MNR: Loaded 24782 existing records from primary storage. [2025-09-25T22:23:34.125477] [INFO ] [MAIN ] MNR: Loaded 24782 primary data records. [2025-09-25T22:23:34.301183] [DEBUG] [LOCAL ] MNSO: Loaded 44692 existing records from primary storage. [2025-09-25T22:23:34.320701] [INFO ] [MAIN ] MNSO: Loaded 44692 primary data records. [2025-09-25T22:23:34.912526] [DEBUG] [MAIN ] MMU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:34.913874] [INFO ] [MAIN ] MMU: Generated 1807 derivative records from 17066 primary records. [2025-09-25T22:23:34.914161] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-25T22:23:34.937054] [DEBUG] [LOCAL ] MMU: Derivative data saved (1807 records). [2025-09-25T22:23:34.938930] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-25T22:23:34.941602] [INFO ] [MAIN ] Derivative Progress: 1150/2043 symbols completed. MMU took 1.2s. Estimated remaining: 6m 17s. Rate: 142.0 symbols/min [2025-09-25T22:23:34.942084] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:34.958981] [DEBUG] [MAIN ] MNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:34.960306] [INFO ] [MAIN ] MNR: Generated 1807 derivative records from 24782 primary records. [2025-09-25T22:23:34.960948] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-25T22:23:34.980519] [DEBUG] [LOCAL ] MNR: Derivative data saved (1807 records). [2025-09-25T22:23:34.981043] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-25T22:23:34.983857] [INFO ] [MAIN ] Derivative Progress: 1151/2043 symbols completed. MNR took 1.2s. Estimated remaining: 6m 17s. Rate: 142.1 symbols/min [2025-09-25T22:23:34.985378] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:35.010331] [DEBUG] [MAIN ] MNSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:35.011293] [INFO ] [MAIN ] MNSO: Generated 1807 derivative records from 44692 primary records. [2025-09-25T22:23:35.011454] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-25T22:23:35.041895] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1807 records). [2025-09-25T22:23:35.042064] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-25T22:23:35.044922] [INFO ] [MAIN ] Derivative Progress: 1152/2043 symbols completed. MNSO took 1.2s. Estimated remaining: 6m 16s. Rate: 142.2 symbols/min [2025-09-25T22:23:35.046106] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:35.061680] [DEBUG] [LOCAL ] MOD: Loaded 45879 existing records from primary storage. [2025-09-25T22:23:35.075380] [INFO ] [MAIN ] MOD: Loaded 45879 primary data records. [2025-09-25T22:23:35.212485] [DEBUG] [LOCAL ] MODG: Loaded 51979 existing records from primary storage. [2025-09-25T22:23:35.218950] [INFO ] [MAIN ] MODG: Loaded 51979 primary data records. [2025-09-25T22:23:35.557869] [DEBUG] [LOCAL ] MOH: Loaded 42116 existing records from primary storage. [2025-09-25T22:23:35.566470] [INFO ] [MAIN ] MOH: Loaded 42116 primary data records. [2025-09-25T22:23:36.132128] [DEBUG] [MAIN ] MOD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:23:36.134363] [INFO ] [MAIN ] MOD: Generated 1806 derivative records from 45879 primary records. [2025-09-25T22:23:36.134752] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-25T22:23:36.154807] [DEBUG] [LOCAL ] MOD: Derivative data saved (1806 records). [2025-09-25T22:23:36.155060] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-25T22:23:36.157627] [INFO ] [MAIN ] Derivative Progress: 1153/2043 symbols completed. MOD took 1.2s. Estimated remaining: 6m 16s. Rate: 142.0 symbols/min [2025-09-25T22:23:36.171922] [DEBUG] [MAIN ] MODG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:36.172746] [INFO ] [MAIN ] MODG: Generated 1807 derivative records from 51979 primary records. [2025-09-25T22:23:36.172967] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-25T22:23:36.204601] [DEBUG] [LOCAL ] MODG: Derivative data saved (1807 records). [2025-09-25T22:23:36.204929] [DEBUG] [MAIN ] MOH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:36.205172] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-25T22:23:36.206006] [INFO ] [MAIN ] MOH: Generated 1807 derivative records from 42116 primary records. [2025-09-25T22:23:36.208542] [INFO ] [MAIN ] Derivative Progress: 1154/2043 symbols completed. MODG took 1.2s. Estimated remaining: 6m 15s. Rate: 142.1 symbols/min [2025-09-25T22:23:36.208702] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-25T22:23:36.225788] [DEBUG] [LOCAL ] MOH: Derivative data saved (1807 records). [2025-09-25T22:23:36.225946] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-25T22:23:36.228683] [INFO ] [MAIN ] Derivative Progress: 1155/2043 symbols completed. MOH took 1.2s. Estimated remaining: 6m 15s. Rate: 142.2 symbols/min [2025-09-25T22:23:36.229282] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:36.229618] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:36.230184] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:36.256347] [DEBUG] [LOCAL ] MOV: Loaded 22325 existing records from primary storage. [2025-09-25T22:23:36.256521] [INFO ] [MAIN ] MOV: Loaded 22325 primary data records. [2025-09-25T22:23:36.519962] [DEBUG] [LOCAL ] MOS: Loaded 53896 existing records from primary storage. [2025-09-25T22:23:36.520247] [INFO ] [MAIN ] MOS: Loaded 53896 primary data records. [2025-09-25T22:23:36.659830] [DEBUG] [LOCAL ] MP: Loaded 54054 existing records from primary storage. [2025-09-25T22:23:36.671456] [INFO ] [MAIN ] MP: Loaded 54054 primary data records. [2025-09-25T22:23:37.402758] [DEBUG] [MAIN ] MOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:37.404326] [INFO ] [MAIN ] MOV: Generated 1807 derivative records from 22325 primary records. [2025-09-25T22:23:37.404615] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-25T22:23:37.431230] [DEBUG] [LOCAL ] MOV: Derivative data saved (1807 records). [2025-09-25T22:23:37.445327] [DEBUG] [MAIN ] MOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:37.445812] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-25T22:23:37.450238] [INFO ] [MAIN ] MOS: Generated 1807 derivative records from 53896 primary records. [2025-09-25T22:23:37.449070] [INFO ] [MAIN ] Derivative Progress: 1156/2043 symbols completed. MOV took 1.2s. Estimated remaining: 6m 15s. Rate: 142.0 symbols/min [2025-09-25T22:23:37.450509] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-25T22:23:37.452067] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:37.487590] [DEBUG] [MAIN ] MP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:37.492528] [DEBUG] [LOCAL ] MPA: Loaded 5231 existing records from primary storage. [2025-09-25T22:23:37.493809] [INFO ] [MAIN ] MP: Generated 1807 derivative records from 54054 primary records. [2025-09-25T22:23:37.494220] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-25T22:23:37.494703] [INFO ] [MAIN ] MPA: Loaded 5231 primary data records. [2025-09-25T22:23:37.499984] [DEBUG] [LOCAL ] MOS: Derivative data saved (1807 records). [2025-09-25T22:23:37.507630] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-25T22:23:37.520612] [INFO ] [MAIN ] Derivative Progress: 1157/2043 symbols completed. MOS took 1.3s. Estimated remaining: 6m 14s. Rate: 142.1 symbols/min [2025-09-25T22:23:37.592548] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:37.840740] [DEBUG] [LOCAL ] MP: Derivative data saved (1807 records). [2025-09-25T22:23:37.840896] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-25T22:23:37.843855] [INFO ] [MAIN ] Derivative Progress: 1158/2043 symbols completed. MP took 1.6s. Estimated remaining: 6m 14s. Rate: 142.1 symbols/min [2025-09-25T22:23:37.844251] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:37.890577] [DEBUG] [MAIN ] MPA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:37.891445] [INFO ] [MAIN ] MPA: Generated 1807 derivative records from 5231 primary records. [2025-09-25T22:23:37.891515] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-25T22:23:37.908696] [DEBUG] [LOCAL ] MPA: Derivative data saved (1807 records). [2025-09-25T22:23:37.908903] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-25T22:23:37.911277] [INFO ] [MAIN ] Derivative Progress: 1159/2043 symbols completed. MPA took 0.5s. Estimated remaining: 6m 13s. Rate: 142.2 symbols/min [2025-09-25T22:23:37.926876] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:37.941699] [DEBUG] [LOCAL ] MPC: Loaded 52505 existing records from primary storage. [2025-09-25T22:23:37.942085] [INFO ] [MAIN ] MPC: Loaded 52505 primary data records. [2025-09-25T22:23:38.075795] [DEBUG] [LOCAL ] MPV: Loaded 5079 existing records from primary storage. [2025-09-25T22:23:38.075523] [DEBUG] [LOCAL ] MPLX: Loaded 51120 existing records from primary storage. [2025-09-25T22:23:38.081781] [INFO ] [MAIN ] MPV: Loaded 5079 primary data records. [2025-09-25T22:23:38.102547] [INFO ] [MAIN ] MPLX: Loaded 51120 primary data records. [2025-09-25T22:23:39.035208] [DEBUG] [MAIN ] MPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:39.036186] [INFO ] [MAIN ] MPC: Generated 1807 derivative records from 52505 primary records. [2025-09-25T22:23:39.036702] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-25T22:23:39.075579] [DEBUG] [LOCAL ] MPC: Derivative data saved (1807 records). [2025-09-25T22:23:39.075802] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-25T22:23:39.078807] [INFO ] [MAIN ] Derivative Progress: 1160/2043 symbols completed. MPC took 1.5s. Estimated remaining: 6m 13s. Rate: 142.0 symbols/min [2025-09-25T22:23:39.075493] [DEBUG] [MAIN ] MPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:39.079975] [INFO ] [MAIN ] MPV: Generated 1807 derivative records from 5079 primary records. [2025-09-25T22:23:39.093222] [DEBUG] [MAIN ] MPLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:39.092361] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:39.094030] [INFO ] [MAIN ] MPLX: Generated 1807 derivative records from 51120 primary records. [2025-09-25T22:23:39.092944] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-25T22:23:39.094151] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-25T22:23:39.126178] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1807 records). [2025-09-25T22:23:39.129104] [DEBUG] [LOCAL ] MPV: Derivative data saved (1807 records). [2025-09-25T22:23:39.129388] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-25T22:23:39.132140] [INFO ] [MAIN ] Derivative Progress: 1161/2043 symbols completed. MPLX took 1.3s. Estimated remaining: 6m 12s. Rate: 142.1 symbols/min [2025-09-25T22:23:39.129318] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-25T22:23:39.135574] [INFO ] [MAIN ] Derivative Progress: 1162/2043 symbols completed. MPV took 1.2s. Estimated remaining: 6m 12s. Rate: 142.2 symbols/min [2025-09-25T22:23:39.135487] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:39.136008] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:39.151022] [DEBUG] [LOCAL ] MQT: Loaded 8472 existing records from primary storage. [2025-09-25T22:23:39.151385] [INFO ] [MAIN ] MQT: Loaded 8472 primary data records. [2025-09-25T22:23:39.171925] [DEBUG] [LOCAL ] MPX: Loaded 4198 existing records from primary storage. [2025-09-25T22:23:39.194310] [INFO ] [MAIN ] MPX: Loaded 4198 primary data records. [2025-09-25T22:23:39.504984] [DEBUG] [LOCAL ] MPW: Loaded 53889 existing records from primary storage. [2025-09-25T22:23:39.512948] [INFO ] [MAIN ] MPW: Loaded 53889 primary data records. [2025-09-25T22:23:40.212161] [DEBUG] [MAIN ] MQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:40.213041] [INFO ] [MAIN ] MQT: Generated 1807 derivative records from 8472 primary records. [2025-09-25T22:23:40.213244] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-25T22:23:40.244800] [DEBUG] [MAIN ] MPX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:40.247067] [INFO ] [MAIN ] MPX: Generated 1807 derivative records from 4198 primary records. [2025-09-25T22:23:40.247292] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-25T22:23:40.260010] [DEBUG] [LOCAL ] MQT: Derivative data saved (1807 records). [2025-09-25T22:23:40.263947] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-25T22:23:40.264355] [DEBUG] [LOCAL ] MPX: Derivative data saved (1807 records). [2025-09-25T22:23:40.266918] [INFO ] [MAIN ] Derivative Progress: 1163/2043 symbols completed. MQT took 1.1s. Estimated remaining: 6m 12s. Rate: 142.0 symbols/min [2025-09-25T22:23:40.268531] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-25T22:23:40.267278] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:40.272879] [INFO ] [MAIN ] Derivative Progress: 1164/2043 symbols completed. MPX took 1.1s. Estimated remaining: 6m 11s. Rate: 142.1 symbols/min [2025-09-25T22:23:40.273790] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:40.288203] [DEBUG] [MAIN ] MPW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:40.289060] [INFO ] [MAIN ] MPW: Generated 1807 derivative records from 53889 primary records. [2025-09-25T22:23:40.289179] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-25T22:23:40.310469] [DEBUG] [LOCAL ] MPW: Derivative data saved (1807 records). [2025-09-25T22:23:40.310689] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-25T22:23:40.313778] [INFO ] [MAIN ] Derivative Progress: 1165/2043 symbols completed. MPW took 1.2s. Estimated remaining: 6m 10s. Rate: 142.3 symbols/min [2025-09-25T22:23:40.314228] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:40.323003] [DEBUG] [LOCAL ] MQY: Loaded 16881 existing records from primary storage. [2025-09-25T22:23:40.323282] [INFO ] [MAIN ] MQY: Loaded 16881 primary data records. [2025-09-25T22:23:40.462087] [DEBUG] [LOCAL ] MRC: Loaded 37865 existing records from primary storage. [2025-09-25T22:23:40.478893] [INFO ] [MAIN ] MRC: Loaded 37865 primary data records. [2025-09-25T22:23:40.866397] [DEBUG] [LOCAL ] MRK: Loaded 54179 existing records from primary storage. [2025-09-25T22:23:41.065018] [INFO ] [MAIN ] MRK: Loaded 54179 primary data records. [2025-09-25T22:23:41.455969] [DEBUG] [MAIN ] MQY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:41.457261] [INFO ] [MAIN ] MQY: Generated 1807 derivative records from 16881 primary records. [2025-09-25T22:23:41.457555] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-25T22:23:41.493723] [DEBUG] [MAIN ] MRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:41.495450] [INFO ] [MAIN ] MRC: Generated 1807 derivative records from 37865 primary records. [2025-09-25T22:23:41.496684] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-25T22:23:41.506855] [DEBUG] [LOCAL ] MQY: Derivative data saved (1807 records). [2025-09-25T22:23:41.510804] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-25T22:23:41.513437] [INFO ] [MAIN ] Derivative Progress: 1166/2043 symbols completed. MQY took 1.2s. Estimated remaining: 6m 10s. Rate: 142.0 symbols/min [2025-09-25T22:23:41.518196] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:41.519431] [DEBUG] [LOCAL ] MRC: Derivative data saved (1807 records). [2025-09-25T22:23:41.519677] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-25T22:23:41.522139] [INFO ] [MAIN ] Derivative Progress: 1167/2043 symbols completed. MRC took 1.2s. Estimated remaining: 6m 10s. Rate: 142.1 symbols/min [2025-09-25T22:23:41.522489] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:41.544496] [DEBUG] [MAIN ] MRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:41.550415] [INFO ] [MAIN ] MRK: Generated 1807 derivative records from 54179 primary records. [2025-09-25T22:23:41.550664] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-25T22:23:41.572463] [DEBUG] [LOCAL ] MSA: Loaded 18891 existing records from primary storage. [2025-09-25T22:23:41.573555] [INFO ] [MAIN ] MSA: Loaded 18891 primary data records. [2025-09-25T22:23:41.705529] [DEBUG] [LOCAL ] MRK: Derivative data saved (1807 records). [2025-09-25T22:23:41.722538] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-25T22:23:41.751005] [INFO ] [MAIN ] Derivative Progress: 1168/2043 symbols completed. MRK took 1.4s. Estimated remaining: 6m 9s. Rate: 142.2 symbols/min [2025-09-25T22:23:41.914918] [DEBUG] [LOCAL ] MS: Loaded 54082 existing records from primary storage. [2025-09-25T22:23:41.929770] [INFO ] [MAIN ] MS: Loaded 54082 primary data records. [2025-09-25T22:23:42.291495] [DEBUG] [MAIN ] MSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:42.292723] [INFO ] [MAIN ] MSA: Generated 1807 derivative records from 18891 primary records. [2025-09-25T22:23:42.293190] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-25T22:23:42.315235] [DEBUG] [LOCAL ] MSA: Derivative data saved (1807 records). [2025-09-25T22:23:42.315552] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-25T22:23:42.318450] [INFO ] [MAIN ] Derivative Progress: 1169/2043 symbols completed. MSA took 0.8s. Estimated remaining: 6m 9s. Rate: 142.2 symbols/min [2025-09-25T22:23:42.335259] [DEBUG] [MAIN ] MS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:42.336018] [INFO ] [MAIN ] MS: Generated 1807 derivative records from 54082 primary records. [2025-09-25T22:23:42.336083] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-25T22:23:42.352779] [DEBUG] [LOCAL ] MS: Derivative data saved (1807 records). [2025-09-25T22:23:42.352853] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-25T22:23:42.355281] [INFO ] [MAIN ] Derivative Progress: 1170/2043 symbols completed. MS took 0.8s. Estimated remaining: 6m 8s. Rate: 142.3 symbols/min [2025-09-25T22:23:42.356064] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:42.356256] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:42.356746] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:42.379890] [DEBUG] [LOCAL ] MSB: Loaded 7865 existing records from primary storage. [2025-09-25T22:23:42.385707] [DEBUG] [LOCAL ] MSD: Loaded 15655 existing records from primary storage. [2025-09-25T22:23:42.385330] [INFO ] [MAIN ] MSB: Loaded 7865 primary data records. [2025-09-25T22:23:42.385950] [INFO ] [MAIN ] MSD: Loaded 15655 primary data records. [2025-09-25T22:23:42.643693] [DEBUG] [LOCAL ] MSCI: Loaded 35077 existing records from primary storage. [2025-09-25T22:23:42.674754] [INFO ] [MAIN ] MSCI: Loaded 35077 primary data records. [2025-09-25T22:23:43.603845] [DEBUG] [MAIN ] MSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:43.605550] [INFO ] [MAIN ] MSD: Generated 1807 derivative records from 15655 primary records. [2025-09-25T22:23:43.622987] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-25T22:23:43.626404] [DEBUG] [MAIN ] MSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:43.647043] [INFO ] [MAIN ] MSB: Generated 1807 derivative records from 7865 primary records. [2025-09-25T22:23:43.645743] [DEBUG] [LOCAL ] MSD: Derivative data saved (1807 records). [2025-09-25T22:23:43.647275] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-25T22:23:43.647421] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-25T22:23:43.653377] [INFO ] [MAIN ] Derivative Progress: 1171/2043 symbols completed. MSD took 1.3s. Estimated remaining: 6m 8s. Rate: 142.0 symbols/min [2025-09-25T22:23:43.654184] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:43.688055] [DEBUG] [MAIN ] MSCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:43.688305] [DEBUG] [LOCAL ] MSB: Derivative data saved (1807 records). [2025-09-25T22:23:43.689489] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-25T22:23:43.689247] [INFO ] [MAIN ] MSCI: Generated 1807 derivative records from 35077 primary records. [2025-09-25T22:23:43.692143] [INFO ] [MAIN ] Derivative Progress: 1172/2043 symbols completed. MSB took 1.3s. Estimated remaining: 6m 8s. Rate: 142.1 symbols/min [2025-09-25T22:23:43.692495] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-25T22:23:43.693309] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:43.711903] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1807 records). [2025-09-25T22:23:43.712110] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-25T22:23:43.724533] [INFO ] [MAIN ] Derivative Progress: 1173/2043 symbols completed. MSCI took 1.4s. Estimated remaining: 6m 7s. Rate: 142.2 symbols/min [2025-09-25T22:23:43.725152] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:43.763367] [DEBUG] [LOCAL ] MSDL: Loaded 38380 existing records from primary storage. [2025-09-25T22:23:43.763718] [INFO ] [MAIN ] MSDL: Loaded 38380 primary data records. [2025-09-25T22:23:43.764237] [DEBUG] [LOCAL ] MSGE: Loaded 27270 existing records from primary storage. [2025-09-25T22:23:43.795573] [INFO ] [MAIN ] MSGE: Loaded 27270 primary data records. [2025-09-25T22:23:43.807049] [DEBUG] [LOCAL ] MSGS: Loaded 17083 existing records from primary storage. [2025-09-25T22:23:43.830510] [INFO ] [MAIN ] MSGS: Loaded 17083 primary data records. [2025-09-25T22:23:44.812375] [DEBUG] [MAIN ] MSDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:44.813851] [INFO ] [MAIN ] MSDL: Generated 1807 derivative records from 38380 primary records. [2025-09-25T22:23:44.831292] [DEBUG] [MAIN ] MSGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:44.831421] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-25T22:23:44.841964] [INFO ] [MAIN ] MSGS: Generated 1807 derivative records from 17083 primary records. [2025-09-25T22:23:44.847755] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-25T22:23:44.848080] [DEBUG] [MAIN ] MSGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:44.859362] [INFO ] [MAIN ] MSGE: Generated 1807 derivative records from 27270 primary records. [2025-09-25T22:23:44.871324] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-25T22:23:44.883009] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1807 records). [2025-09-25T22:23:44.885106] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-25T22:23:44.884970] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1807 records). [2025-09-25T22:23:44.885328] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-25T22:23:44.888121] [INFO ] [MAIN ] Derivative Progress: 1174/2043 symbols completed. MSGS took 1.2s. Estimated remaining: 6m 7s. Rate: 142.0 symbols/min [2025-09-25T22:23:44.899382] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:44.891166] [INFO ] [MAIN ] Derivative Progress: 1175/2043 symbols completed. MSDL took 1.2s. Estimated remaining: 6m 6s. Rate: 142.2 symbols/min [2025-09-25T22:23:44.905071] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:44.911455] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1807 records). [2025-09-25T22:23:44.911806] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-25T22:23:44.914579] [INFO ] [MAIN ] Derivative Progress: 1176/2043 symbols completed. MSGE took 1.2s. Estimated remaining: 6m 6s. Rate: 142.3 symbols/min [2025-09-25T22:23:44.915020] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:44.962345] [DEBUG] [LOCAL ] MSM: Loaded 35693 existing records from primary storage. [2025-09-25T22:23:44.962609] [INFO ] [MAIN ] MSM: Loaded 35693 primary data records. [2025-09-25T22:23:45.064412] [DEBUG] [LOCAL ] MSI: Loaded 40895 existing records from primary storage. [2025-09-25T22:23:45.106628] [INFO ] [MAIN ] MSI: Loaded 40895 primary data records. [2025-09-25T22:23:45.228900] [DEBUG] [LOCAL ] MT: Loaded 51034 existing records from primary storage. [2025-09-25T22:23:45.270790] [INFO ] [MAIN ] MT: Loaded 51034 primary data records. [2025-09-25T22:23:46.096781] [DEBUG] [MAIN ] MSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:46.098819] [INFO ] [MAIN ] MSM: Generated 1807 derivative records from 35693 primary records. [2025-09-25T22:23:46.099398] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-25T22:23:46.124794] [DEBUG] [MAIN ] MSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:46.129729] [INFO ] [MAIN ] MSI: Generated 1807 derivative records from 40895 primary records. [2025-09-25T22:23:46.132710] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-25T22:23:46.148341] [DEBUG] [LOCAL ] MSM: Derivative data saved (1807 records). [2025-09-25T22:23:46.148896] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-25T22:23:46.151236] [INFO ] [MAIN ] Derivative Progress: 1177/2043 symbols completed. MSM took 1.2s. Estimated remaining: 6m 6s. Rate: 142.0 symbols/min [2025-09-25T22:23:46.148793] [DEBUG] [MAIN ] MT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:46.160406] [INFO ] [MAIN ] MT: Generated 1807 derivative records from 51034 primary records. [2025-09-25T22:23:46.160616] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-25T22:23:46.160733] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:46.182633] [DEBUG] [LOCAL ] MSI: Derivative data saved (1807 records). [2025-09-25T22:23:46.184839] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-25T22:23:46.188466] [INFO ] [MAIN ] Derivative Progress: 1178/2043 symbols completed. MSI took 1.3s. Estimated remaining: 6m 5s. Rate: 142.1 symbols/min [2025-09-25T22:23:46.190858] [DEBUG] [LOCAL ] MT: Derivative data saved (1807 records). [2025-09-25T22:23:46.191239] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-25T22:23:46.191112] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:46.194589] [INFO ] [MAIN ] Derivative Progress: 1179/2043 symbols completed. MT took 1.3s. Estimated remaining: 6m 4s. Rate: 142.3 symbols/min [2025-09-25T22:23:46.195064] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:46.223962] [DEBUG] [LOCAL ] MTD: Loaded 15274 existing records from primary storage. [2025-09-25T22:23:46.224169] [INFO ] [MAIN ] MTD: Loaded 15274 primary data records. [2025-09-25T22:23:46.336787] [DEBUG] [LOCAL ] MTAL: Loaded 36633 existing records from primary storage. [2025-09-25T22:23:46.358170] [INFO ] [MAIN ] MTAL: Loaded 36633 primary data records. [2025-09-25T22:23:46.588047] [DEBUG] [LOCAL ] MTB: Loaded 47284 existing records from primary storage. [2025-09-25T22:23:46.621294] [INFO ] [MAIN ] MTB: Loaded 47284 primary data records. [2025-09-25T22:23:47.326956] [DEBUG] [MAIN ] MTD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:47.329235] [INFO ] [MAIN ] MTD: Generated 1807 derivative records from 15274 primary records. [2025-09-25T22:23:47.329609] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-25T22:23:47.361976] [DEBUG] [LOCAL ] MTD: Derivative data saved (1807 records). [2025-09-25T22:23:47.362129] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-25T22:23:47.360180] [DEBUG] [MAIN ] MTAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:47.364604] [INFO ] [MAIN ] Derivative Progress: 1180/2043 symbols completed. MTD took 1.2s. Estimated remaining: 6m 5s. Rate: 142.0 symbols/min [2025-09-25T22:23:47.365039] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:47.366076] [INFO ] [MAIN ] MTAL: Generated 1807 derivative records from 36633 primary records. [2025-09-25T22:23:47.366507] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-25T22:23:47.384930] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1807 records). [2025-09-25T22:23:47.385316] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-25T22:23:47.388230] [INFO ] [MAIN ] Derivative Progress: 1181/2043 symbols completed. MTAL took 1.2s. Estimated remaining: 6m 4s. Rate: 142.2 symbols/min [2025-09-25T22:23:47.392028] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:47.406732] [DEBUG] [MAIN ] MTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:47.407762] [INFO ] [MAIN ] MTB: Generated 1807 derivative records from 47284 primary records. [2025-09-25T22:23:47.407903] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-25T22:23:47.427102] [DEBUG] [LOCAL ] MTB: Derivative data saved (1807 records). [2025-09-25T22:23:47.427329] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-25T22:23:47.430006] [INFO ] [MAIN ] Derivative Progress: 1182/2043 symbols completed. MTB took 1.2s. Estimated remaining: 6m 3s. Rate: 142.3 symbols/min [2025-09-25T22:23:47.430552] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:47.486700] [DEBUG] [LOCAL ] MTDR: Loaded 51936 existing records from primary storage. [2025-09-25T22:23:47.486989] [INFO ] [MAIN ] MTDR: Loaded 51936 primary data records. [2025-09-25T22:23:47.614384] [DEBUG] [LOCAL ] MTG: Loaded 51745 existing records from primary storage. [2025-09-25T22:23:47.622288] [INFO ] [MAIN ] MTG: Loaded 51745 primary data records. [2025-09-25T22:23:47.748417] [DEBUG] [LOCAL ] MTH: Loaded 44201 existing records from primary storage. [2025-09-25T22:23:47.788166] [INFO ] [MAIN ] MTH: Loaded 44201 primary data records. [2025-09-25T22:23:48.604836] [DEBUG] [MAIN ] MTDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:48.605970] [INFO ] [MAIN ] MTDR: Generated 1807 derivative records from 51936 primary records. [2025-09-25T22:23:48.606261] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-25T22:23:48.627292] [DEBUG] [MAIN ] MTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:48.628163] [INFO ] [MAIN ] MTG: Generated 1807 derivative records from 51745 primary records. [2025-09-25T22:23:48.628377] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-25T22:23:48.653936] [DEBUG] [LOCAL ] MTG: Derivative data saved (1807 records). [2025-09-25T22:23:48.655048] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-25T22:23:48.658006] [INFO ] [MAIN ] Derivative Progress: 1183/2043 symbols completed. MTG took 1.3s. Estimated remaining: 6m 3s. Rate: 142.0 symbols/min [2025-09-25T22:23:48.659233] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1807 records). [2025-09-25T22:23:48.671591] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-25T22:23:48.674217] [INFO ] [MAIN ] Derivative Progress: 1184/2043 symbols completed. MTDR took 1.3s. Estimated remaining: 6m 3s. Rate: 142.2 symbols/min [2025-09-25T22:23:48.674843] [DEBUG] [MAIN ] MTH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:48.675444] [INFO ] [MAIN ] MTH: Generated 1807 derivative records from 44201 primary records. [2025-09-25T22:23:48.675503] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-25T22:23:48.691002] [DEBUG] [LOCAL ] MTH: Derivative data saved (1807 records). [2025-09-25T22:23:48.691066] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-25T22:23:48.693523] [INFO ] [MAIN ] Derivative Progress: 1185/2043 symbols completed. MTH took 1.3s. Estimated remaining: 6m 2s. Rate: 142.3 symbols/min [2025-09-25T22:23:48.694149] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:48.694082] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:48.694858] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:48.723503] [DEBUG] [LOCAL ] MTRN: Loaded 18210 existing records from primary storage. [2025-09-25T22:23:48.723674] [INFO ] [MAIN ] MTRN: Loaded 18210 primary data records. [2025-09-25T22:23:48.821896] [DEBUG] [LOCAL ] MTUS: Loaded 28828 existing records from primary storage. [2025-09-25T22:23:48.838866] [INFO ] [MAIN ] MTUS: Loaded 28828 primary data records. [2025-09-25T22:23:48.959014] [DEBUG] [LOCAL ] MTN: Loaded 39319 existing records from primary storage. [2025-09-25T22:23:49.025230] [INFO ] [MAIN ] MTN: Loaded 39319 primary data records. [2025-09-25T22:23:49.838312] [DEBUG] [MAIN ] MTRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:49.839884] [INFO ] [MAIN ] MTRN: Generated 1807 derivative records from 18210 primary records. [2025-09-25T22:23:49.840101] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-25T22:23:49.863501] [DEBUG] [MAIN ] MTUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:49.869160] [INFO ] [MAIN ] MTUS: Generated 1807 derivative records from 28828 primary records. [2025-09-25T22:23:49.869670] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-25T22:23:49.878417] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1807 records). [2025-09-25T22:23:49.878589] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-25T22:23:49.881164] [INFO ] [MAIN ] Derivative Progress: 1186/2043 symbols completed. MTRN took 1.2s. Estimated remaining: 6m 2s. Rate: 142.1 symbols/min [2025-09-25T22:23:49.889005] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:49.906442] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1807 records). [2025-09-25T22:23:49.911594] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-25T22:23:49.915053] [INFO ] [MAIN ] Derivative Progress: 1187/2043 symbols completed. MTUS took 1.2s. Estimated remaining: 6m 1s. Rate: 142.2 symbols/min [2025-09-25T22:23:49.915576] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:49.916894] [DEBUG] [MAIN ] MTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:49.919853] [INFO ] [MAIN ] MTN: Generated 1807 derivative records from 39319 primary records. [2025-09-25T22:23:49.920272] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-25T22:23:49.939686] [DEBUG] [LOCAL ] MTN: Derivative data saved (1807 records). [2025-09-25T22:23:49.940176] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-25T22:23:49.952499] [INFO ] [MAIN ] Derivative Progress: 1188/2043 symbols completed. MTN took 1.3s. Estimated remaining: 6m 1s. Rate: 142.3 symbols/min [2025-09-25T22:23:49.953106] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:49.977526] [DEBUG] [LOCAL ] MTW: Loaded 26735 existing records from primary storage. [2025-09-25T22:23:49.978754] [INFO ] [MAIN ] MTW: Loaded 26735 primary data records. [2025-09-25T22:23:50.001818] [DEBUG] [LOCAL ] MTX: Loaded 22995 existing records from primary storage. [2025-09-25T22:23:50.037834] [INFO ] [MAIN ] MTX: Loaded 22995 primary data records. [2025-09-25T22:23:50.674246] [DEBUG] [LOCAL ] MTZ: Loaded 43650 existing records from primary storage. [2025-09-25T22:23:50.684873] [INFO ] [MAIN ] MTZ: Loaded 43650 primary data records. [2025-09-25T22:23:51.026795] [DEBUG] [MAIN ] MTW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:51.029249] [INFO ] [MAIN ] MTW: Generated 1807 derivative records from 26735 primary records. [2025-09-25T22:23:51.030150] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-25T22:23:51.050054] [DEBUG] [LOCAL ] MTW: Derivative data saved (1807 records). [2025-09-25T22:23:51.051347] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-25T22:23:51.054255] [INFO ] [MAIN ] Derivative Progress: 1189/2043 symbols completed. MTW took 1.2s. Estimated remaining: 6m 1s. Rate: 142.1 symbols/min [2025-09-25T22:23:51.056085] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:51.082151] [DEBUG] [MAIN ] MTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:51.083627] [INFO ] [MAIN ] MTX: Generated 1807 derivative records from 22995 primary records. [2025-09-25T22:23:51.083946] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-25T22:23:51.109507] [DEBUG] [LOCAL ] MTX: Derivative data saved (1807 records). [2025-09-25T22:23:51.115804] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-25T22:23:51.115529] [DEBUG] [LOCAL ] MUA: Loaded 12338 existing records from primary storage. [2025-09-25T22:23:51.119451] [INFO ] [MAIN ] Derivative Progress: 1190/2043 symbols completed. MTX took 1.2s. Estimated remaining: 5m 60s. Rate: 142.2 symbols/min [2025-09-25T22:23:51.131861] [INFO ] [MAIN ] MUA: Loaded 12338 primary data records. [2025-09-25T22:23:51.133074] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:51.133479] [DEBUG] [MAIN ] MTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:51.168318] [INFO ] [MAIN ] MTZ: Generated 1807 derivative records from 43650 primary records. [2025-09-25T22:23:51.182628] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-25T22:23:51.378272] [DEBUG] [LOCAL ] MUC: Loaded 20556 existing records from primary storage. [2025-09-25T22:23:51.510356] [INFO ] [MAIN ] MUC: Loaded 20556 primary data records. [2025-09-25T22:23:51.511621] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1807 records). [2025-09-25T22:23:51.518440] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-25T22:23:51.552009] [INFO ] [MAIN ] Derivative Progress: 1191/2043 symbols completed. MTZ took 1.6s. Estimated remaining: 5m 60s. Rate: 142.2 symbols/min [2025-09-25T22:23:51.596325] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:51.744436] [DEBUG] [LOCAL ] MUE: Loaded 12072 existing records from primary storage. [2025-09-25T22:23:51.858852] [INFO ] [MAIN ] MUE: Loaded 12072 primary data records. [2025-09-25T22:23:52.169431] [DEBUG] [MAIN ] MUA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:52.270051] [INFO ] [MAIN ] MUA: Generated 1807 derivative records from 12338 primary records. [2025-09-25T22:23:52.270559] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-25T22:23:52.291878] [DEBUG] [LOCAL ] MUA: Derivative data saved (1807 records). [2025-09-25T22:23:52.294924] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-25T22:23:52.298913] [INFO ] [MAIN ] Derivative Progress: 1192/2043 symbols completed. MUA took 1.2s. Estimated remaining: 5m 59s. Rate: 142.1 symbols/min [2025-09-25T22:23:52.312209] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:52.314456] [DEBUG] [MAIN ] MUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:52.316047] [INFO ] [MAIN ] MUC: Generated 1807 derivative records from 20556 primary records. [2025-09-25T22:23:52.316245] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-25T22:23:52.334497] [DEBUG] [LOCAL ] MUC: Derivative data saved (1807 records). [2025-09-25T22:23:52.334836] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-25T22:23:52.337680] [INFO ] [MAIN ] Derivative Progress: 1193/2043 symbols completed. MUC took 1.2s. Estimated remaining: 5m 59s. Rate: 142.2 symbols/min [2025-09-25T22:23:52.338803] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:52.366841] [DEBUG] [MAIN ] MUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:52.367944] [INFO ] [MAIN ] MUE: Generated 1807 derivative records from 12072 primary records. [2025-09-25T22:23:52.368232] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-25T22:23:52.374751] [DEBUG] [LOCAL ] MUJ: Loaded 13414 existing records from primary storage. [2025-09-25T22:23:52.382958] [INFO ] [MAIN ] MUJ: Loaded 13414 primary data records. [2025-09-25T22:23:52.537745] [DEBUG] [LOCAL ] MUE: Derivative data saved (1807 records). [2025-09-25T22:23:52.537990] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-25T22:23:52.545066] [DEBUG] [LOCAL ] MUFG: Loaded 52971 existing records from primary storage. [2025-09-25T22:23:52.550333] [INFO ] [MAIN ] MUFG: Loaded 52971 primary data records. [2025-09-25T22:23:52.635422] [INFO ] [MAIN ] Derivative Progress: 1194/2043 symbols completed. MUE took 1.1s. Estimated remaining: 5m 58s. Rate: 142.2 symbols/min [2025-09-25T22:23:52.727831] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:53.148476] [DEBUG] [MAIN ] MUJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:53.150149] [INFO ] [MAIN ] MUJ: Generated 1807 derivative records from 13414 primary records. [2025-09-25T22:23:53.150371] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-25T22:23:53.152343] [DEBUG] [LOCAL ] MUR: Loaded 53315 existing records from primary storage. [2025-09-25T22:23:53.152911] [INFO ] [MAIN ] MUR: Loaded 53315 primary data records. [2025-09-25T22:23:53.180938] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1807 records). [2025-09-25T22:23:53.202289] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-25T22:23:53.232943] [INFO ] [MAIN ] Derivative Progress: 1195/2043 symbols completed. MUJ took 0.9s. Estimated remaining: 5m 58s. Rate: 142.2 symbols/min [2025-09-25T22:23:53.290494] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:53.319985] [DEBUG] [MAIN ] MUFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:53.336938] [INFO ] [MAIN ] MUFG: Generated 1807 derivative records from 52971 primary records. [2025-09-25T22:23:53.337062] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-25T22:23:53.423542] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1807 records). [2025-09-25T22:23:53.550268] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-25T22:23:53.553838] [INFO ] [MAIN ] Derivative Progress: 1196/2043 symbols completed. MUFG took 1.2s. Estimated remaining: 5m 57s. Rate: 142.2 symbols/min [2025-09-25T22:23:53.554608] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:53.566110] [DEBUG] [LOCAL ] MUSA: Loaded 25043 existing records from primary storage. [2025-09-25T22:23:53.566472] [INFO ] [MAIN ] MUSA: Loaded 25043 primary data records. [2025-09-25T22:23:53.943489] [DEBUG] [LOCAL ] MUX: Loaded 42890 existing records from primary storage. [2025-09-25T22:23:53.944865] [INFO ] [MAIN ] MUX: Loaded 42890 primary data records. [2025-09-25T22:23:54.096049] [DEBUG] [MAIN ] MUR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:54.113268] [INFO ] [MAIN ] MUR: Generated 1807 derivative records from 53315 primary records. [2025-09-25T22:23:54.124078] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-25T22:23:54.379088] [DEBUG] [LOCAL ] MUR: Derivative data saved (1807 records). [2025-09-25T22:23:54.380989] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-25T22:23:54.384074] [INFO ] [MAIN ] Derivative Progress: 1197/2043 symbols completed. MUR took 1.7s. Estimated remaining: 5m 57s. Rate: 142.1 symbols/min [2025-09-25T22:23:54.384520] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:54.400461] [DEBUG] [MAIN ] MUSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:54.401494] [INFO ] [MAIN ] MUSA: Generated 1807 derivative records from 25043 primary records. [2025-09-25T22:23:54.401765] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-25T22:23:54.430355] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1807 records). [2025-09-25T22:23:54.431219] [DEBUG] [LOCAL ] MVF: Loaded 12867 existing records from primary storage. [2025-09-25T22:23:54.431537] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-25T22:23:54.434361] [INFO ] [MAIN ] Derivative Progress: 1198/2043 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 57s. Rate: 142.2 symbols/min [2025-09-25T22:23:54.434810] [INFO ] [MAIN ] MVF: Loaded 12867 primary data records. [2025-09-25T22:23:54.657239] [DEBUG] [MAIN ] MUX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:54.786925] [INFO ] [MAIN ] MUX: Generated 1807 derivative records from 42890 primary records. [2025-09-25T22:23:54.787173] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-25T22:23:54.811210] [DEBUG] [LOCAL ] MUX: Derivative data saved (1807 records). [2025-09-25T22:23:54.811740] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-25T22:23:54.815723] [INFO ] [MAIN ] Derivative Progress: 1199/2043 symbols completed. MUX took 1.3s. Estimated remaining: 5m 56s. Rate: 142.2 symbols/min [2025-09-25T22:23:54.839184] [DEBUG] [MAIN ] MVF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:54.840046] [INFO ] [MAIN ] MVF: Generated 1807 derivative records from 12867 primary records. [2025-09-25T22:23:54.840116] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-25T22:23:54.856460] [DEBUG] [LOCAL ] MVF: Derivative data saved (1807 records). [2025-09-25T22:23:54.856602] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-25T22:23:54.859279] [INFO ] [MAIN ] Derivative Progress: 1200/2043 symbols completed. MVF took 0.5s. Estimated remaining: 5m 55s. Rate: 142.3 symbols/min [2025-09-25T22:23:54.860400] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:54.860171] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:54.860915] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:54.877960] [DEBUG] [LOCAL ] MVO: Loaded 9106 existing records from primary storage. [2025-09-25T22:23:54.878194] [INFO ] [MAIN ] MVO: Loaded 9106 primary data records. [2025-09-25T22:23:54.928831] [DEBUG] [LOCAL ] MVT: Loaded 10252 existing records from primary storage. [2025-09-25T22:23:54.934785] [INFO ] [MAIN ] MVT: Loaded 10252 primary data records. [2025-09-25T22:23:55.229075] [DEBUG] [LOCAL ] MWA: Loaded 47339 existing records from primary storage. [2025-09-25T22:23:55.280078] [INFO ] [MAIN ] MWA: Loaded 47339 primary data records. [2025-09-25T22:23:55.958952] [DEBUG] [MAIN ] MVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:55.960224] [INFO ] [MAIN ] MVO: Generated 1807 derivative records from 9106 primary records. [2025-09-25T22:23:55.969851] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-25T22:23:55.976140] [DEBUG] [MAIN ] MVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:55.978798] [INFO ] [MAIN ] MVT: Generated 1807 derivative records from 10252 primary records. [2025-09-25T22:23:55.989969] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-25T22:23:56.009498] [DEBUG] [LOCAL ] MVT: Derivative data saved (1807 records). [2025-09-25T22:23:56.010092] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-25T22:23:56.014262] [INFO ] [MAIN ] Derivative Progress: 1201/2043 symbols completed. MVT took 1.2s. Estimated remaining: 5m 55s. Rate: 142.1 symbols/min [2025-09-25T22:23:56.015584] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:56.021392] [DEBUG] [LOCAL ] MVO: Derivative data saved (1807 records). [2025-09-25T22:23:56.021780] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-25T22:23:56.032633] [INFO ] [MAIN ] Derivative Progress: 1202/2043 symbols completed. MVO took 1.2s. Estimated remaining: 5m 55s. Rate: 142.2 symbols/min [2025-09-25T22:23:56.038562] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:56.038803] [DEBUG] [MAIN ] MWA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:56.040230] [INFO ] [MAIN ] MWA: Generated 1807 derivative records from 47339 primary records. [2025-09-25T22:23:56.040418] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-25T22:23:56.067071] [DEBUG] [LOCAL ] MWA: Derivative data saved (1807 records). [2025-09-25T22:23:56.074356] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-25T22:23:56.077270] [INFO ] [MAIN ] Derivative Progress: 1203/2043 symbols completed. MWA took 1.2s. Estimated remaining: 5m 54s. Rate: 142.3 symbols/min [2025-09-25T22:23:56.079352] [DEBUG] [LOCAL ] MX: Loaded 23261 existing records from primary storage. [2025-09-25T22:23:56.079699] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:56.080098] [INFO ] [MAIN ] MX: Loaded 23261 primary data records. [2025-09-25T22:23:56.084006] [DEBUG] [LOCAL ] MXF: Loaded 5972 existing records from primary storage. [2025-09-25T22:23:56.097223] [INFO ] [MAIN ] MXF: Loaded 5972 primary data records. [2025-09-25T22:23:56.321365] [DEBUG] [LOCAL ] MYD: Loaded 13867 existing records from primary storage. [2025-09-25T22:23:56.336887] [INFO ] [MAIN ] MYD: Loaded 13867 primary data records. [2025-09-25T22:23:57.179267] [DEBUG] [MAIN ] MX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:57.182311] [INFO ] [MAIN ] MX: Generated 1807 derivative records from 23261 primary records. [2025-09-25T22:23:57.182678] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-25T22:23:57.213143] [DEBUG] [MAIN ] MXF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:57.217174] [DEBUG] [LOCAL ] MX: Derivative data saved (1807 records). [2025-09-25T22:23:57.217629] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-25T22:23:57.233566] [DEBUG] [MAIN ] MYD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:57.227802] [INFO ] [MAIN ] Derivative Progress: 1204/2043 symbols completed. MX took 1.2s. Estimated remaining: 5m 54s. Rate: 142.1 symbols/min [2025-09-25T22:23:57.234827] [INFO ] [MAIN ] MXF: Generated 1807 derivative records from 5972 primary records. [2025-09-25T22:23:57.235783] [INFO ] [MAIN ] MYD: Generated 1807 derivative records from 13867 primary records. [2025-09-25T22:23:57.236337] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:57.236099] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-25T22:23:57.236702] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-25T22:23:57.267883] [DEBUG] [LOCAL ] MYD: Derivative data saved (1807 records). [2025-09-25T22:23:57.268669] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-25T22:23:57.272207] [INFO ] [MAIN ] Derivative Progress: 1205/2043 symbols completed. MYD took 1.2s. Estimated remaining: 5m 54s. Rate: 142.2 symbols/min [2025-09-25T22:23:57.272985] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:57.277186] [DEBUG] [LOCAL ] MXF: Derivative data saved (1807 records). [2025-09-25T22:23:57.277467] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-25T22:23:57.280042] [INFO ] [MAIN ] Derivative Progress: 1206/2043 symbols completed. MXF took 1.2s. Estimated remaining: 5m 53s. Rate: 142.3 symbols/min [2025-09-25T22:23:57.287233] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:57.313273] [DEBUG] [LOCAL ] MYN: Loaded 10294 existing records from primary storage. [2025-09-25T22:23:57.313485] [INFO ] [MAIN ] MYN: Loaded 10294 primary data records. [2025-09-25T22:23:57.327171] [DEBUG] [LOCAL ] MYE: Loaded 25165 existing records from primary storage. [2025-09-25T22:23:57.413205] [DEBUG] [LOCAL ] MYI: Loaded 19516 existing records from primary storage. [2025-09-25T22:23:57.418485] [INFO ] [MAIN ] MYE: Loaded 25165 primary data records. [2025-09-25T22:23:57.458701] [INFO ] [MAIN ] MYI: Loaded 19516 primary data records. [2025-09-25T22:23:58.346437] [DEBUG] [MAIN ] MYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:58.348461] [INFO ] [MAIN ] MYN: Generated 1807 derivative records from 10294 primary records. [2025-09-25T22:23:58.349203] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-25T22:23:58.394996] [DEBUG] [MAIN ] MYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:58.396943] [INFO ] [MAIN ] MYI: Generated 1807 derivative records from 19516 primary records. [2025-09-25T22:23:58.397054] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-25T22:23:58.395910] [DEBUG] [MAIN ] MYE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:58.398139] [INFO ] [MAIN ] MYE: Generated 1807 derivative records from 25165 primary records. [2025-09-25T22:23:58.398695] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-25T22:23:58.427598] [DEBUG] [LOCAL ] MYN: Derivative data saved (1807 records). [2025-09-25T22:23:58.432092] [DEBUG] [LOCAL ] MYI: Derivative data saved (1807 records). [2025-09-25T22:23:58.432296] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-25T22:23:58.435149] [INFO ] [MAIN ] Derivative Progress: 1207/2043 symbols completed. MYN took 1.2s. Estimated remaining: 5m 53s. Rate: 142.1 symbols/min [2025-09-25T22:23:58.432225] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-25T22:23:58.439196] [INFO ] [MAIN ] Derivative Progress: 1208/2043 symbols completed. MYI took 1.2s. Estimated remaining: 5m 52s. Rate: 142.3 symbols/min [2025-09-25T22:23:58.444251] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:58.443968] [DEBUG] [LOCAL ] MYE: Derivative data saved (1807 records). [2025-09-25T22:23:58.444616] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:58.444849] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-25T22:23:58.448381] [INFO ] [MAIN ] Derivative Progress: 1209/2043 symbols completed. MYE took 1.2s. Estimated remaining: 5m 51s. Rate: 142.4 symbols/min [2025-09-25T22:23:58.449157] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:58.478575] [DEBUG] [LOCAL ] NAC: Loaded 24882 existing records from primary storage. [2025-09-25T22:23:58.488593] [INFO ] [MAIN ] NAC: Loaded 24882 primary data records. [2025-09-25T22:23:58.629284] [DEBUG] [LOCAL ] NAD: Loaded 34139 existing records from primary storage. [2025-09-25T22:23:58.646978] [INFO ] [MAIN ] NAD: Loaded 34139 primary data records. [2025-09-25T22:23:58.636429] [DEBUG] [LOCAL ] NABL: Loaded 40059 existing records from primary storage. [2025-09-25T22:23:58.657565] [INFO ] [MAIN ] NABL: Loaded 40059 primary data records. [2025-09-25T22:23:59.549922] [DEBUG] [MAIN ] NAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:59.551596] [INFO ] [MAIN ] NAC: Generated 1807 derivative records from 24882 primary records. [2025-09-25T22:23:59.551876] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-25T22:23:59.589820] [DEBUG] [LOCAL ] NAC: Derivative data saved (1807 records). [2025-09-25T22:23:59.589970] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-25T22:23:59.585193] [DEBUG] [MAIN ] NAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:59.592773] [INFO ] [MAIN ] Derivative Progress: 1210/2043 symbols completed. NAC took 1.1s. Estimated remaining: 5m 52s. Rate: 142.2 symbols/min [2025-09-25T22:23:59.594300] [INFO ] [MAIN ] NAD: Generated 1807 derivative records from 34139 primary records. [2025-09-25T22:23:59.594773] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-25T22:23:59.594569] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:59.609602] [DEBUG] [MAIN ] NABL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:23:59.620223] [INFO ] [MAIN ] NABL: Generated 1807 derivative records from 40059 primary records. [2025-09-25T22:23:59.626406] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-25T22:23:59.628877] [DEBUG] [LOCAL ] NAD: Derivative data saved (1807 records). [2025-09-25T22:23:59.631233] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-25T22:23:59.635112] [INFO ] [MAIN ] Derivative Progress: 1211/2043 symbols completed. NAD took 1.2s. Estimated remaining: 5m 51s. Rate: 142.3 symbols/min [2025-09-25T22:23:59.636384] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:23:59.655375] [DEBUG] [LOCAL ] NAN: Loaded 9060 existing records from primary storage. [2025-09-25T22:23:59.656275] [INFO ] [MAIN ] NAN: Loaded 9060 primary data records. [2025-09-25T22:23:59.728087] [DEBUG] [LOCAL ] NABL: Derivative data saved (1807 records). [2025-09-25T22:23:59.741572] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-25T22:23:59.755017] [INFO ] [MAIN ] Derivative Progress: 1212/2043 symbols completed. NABL took 1.3s. Estimated remaining: 5m 50s. Rate: 142.4 symbols/min [2025-09-25T22:23:59.755444] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:00.030710] [DEBUG] [LOCAL ] NAT: Loaded 49478 existing records from primary storage. [2025-09-25T22:24:00.031960] [INFO ] [MAIN ] NAT: Loaded 49478 primary data records. [2025-09-25T22:24:00.094776] [DEBUG] [LOCAL ] NATL: Loaded 33145 existing records from primary storage. [2025-09-25T22:24:00.103057] [INFO ] [MAIN ] NATL: Loaded 33145 primary data records. [2025-09-25T22:24:00.750681] [DEBUG] [MAIN ] NAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:00.752811] [INFO ] [MAIN ] NAN: Generated 1807 derivative records from 9060 primary records. [2025-09-25T22:24:00.762138] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-25T22:24:00.783545] [DEBUG] [LOCAL ] NAN: Derivative data saved (1807 records). [2025-09-25T22:24:00.785713] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-25T22:24:00.789419] [INFO ] [MAIN ] Derivative Progress: 1213/2043 symbols completed. NAN took 1.2s. Estimated remaining: 5m 50s. Rate: 142.2 symbols/min [2025-09-25T22:24:00.814575] [DEBUG] [MAIN ] NAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:00.815627] [INFO ] [MAIN ] NAT: Generated 1807 derivative records from 49478 primary records. [2025-09-25T22:24:00.815748] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-25T22:24:00.838216] [DEBUG] [LOCAL ] NAT: Derivative data saved (1807 records). [2025-09-25T22:24:00.852243] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-25T22:24:00.854685] [INFO ] [MAIN ] Derivative Progress: 1214/2043 symbols completed. NAT took 1.2s. Estimated remaining: 5m 50s. Rate: 142.3 symbols/min [2025-09-25T22:24:00.852140] [DEBUG] [MAIN ] NATL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:00.856146] [INFO ] [MAIN ] NATL: Generated 1807 derivative records from 33145 primary records. [2025-09-25T22:24:00.856245] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-25T22:24:00.874082] [DEBUG] [LOCAL ] NATL: Derivative data saved (1807 records). [2025-09-25T22:24:00.874307] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-25T22:24:00.877353] [INFO ] [MAIN ] Derivative Progress: 1215/2043 symbols completed. NATL took 1.1s. Estimated remaining: 5m 49s. Rate: 142.4 symbols/min [2025-09-25T22:24:00.878161] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:00.878940] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:00.878781] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:00.886270] [DEBUG] [LOCAL ] NAZ: Loaded 2685 existing records from primary storage. [2025-09-25T22:24:00.889344] [INFO ] [MAIN ] NAZ: Loaded 2685 primary data records. [2025-09-25T22:24:00.963765] [DEBUG] [LOCAL ] NBB: Loaded 8917 existing records from primary storage. [2025-09-25T22:24:00.980776] [INFO ] [MAIN ] NBB: Loaded 8917 primary data records. [2025-09-25T22:24:01.157245] [DEBUG] [LOCAL ] NBHC: Loaded 23359 existing records from primary storage. [2025-09-25T22:24:01.202512] [INFO ] [MAIN ] NBHC: Loaded 23359 primary data records. [2025-09-25T22:24:01.937054] [DEBUG] [MAIN ] NAZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:01.940134] [INFO ] [MAIN ] NAZ: Generated 1807 derivative records from 2685 primary records. [2025-09-25T22:24:01.943414] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-25T22:24:01.973713] [DEBUG] [MAIN ] NBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:01.975461] [INFO ] [MAIN ] NBB: Generated 1807 derivative records from 8917 primary records. [2025-09-25T22:24:01.976268] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1807 records). [2025-09-25T22:24:01.975754] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-25T22:24:01.976618] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-25T22:24:01.979745] [INFO ] [MAIN ] Derivative Progress: 1216/2043 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 49s. Rate: 142.2 symbols/min [2025-09-25T22:24:01.981289] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:02.013854] [DEBUG] [MAIN ] NBHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:02.017050] [INFO ] [MAIN ] NBHC: Generated 1807 derivative records from 23359 primary records. [2025-09-25T22:24:02.018753] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-25T22:24:02.020175] [DEBUG] [LOCAL ] NBB: Derivative data saved (1807 records). [2025-09-25T22:24:02.021368] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-25T22:24:02.024128] [INFO ] [MAIN ] Derivative Progress: 1217/2043 symbols completed. NBB took 1.1s. Estimated remaining: 5m 48s. Rate: 142.3 symbols/min [2025-09-25T22:24:02.045028] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:02.062933] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1807 records). [2025-09-25T22:24:02.063935] [DEBUG] [LOCAL ] NBR: Loaded 35065 existing records from primary storage. [2025-09-25T22:24:02.064184] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-25T22:24:02.073424] [INFO ] [MAIN ] NBR: Loaded 35065 primary data records. [2025-09-25T22:24:02.068549] [INFO ] [MAIN ] Derivative Progress: 1218/2043 symbols completed. NBHC took 1.2s. Estimated remaining: 5m 48s. Rate: 142.4 symbols/min [2025-09-25T22:24:02.074032] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:02.182337] [DEBUG] [LOCAL ] NC: Loaded 1925 existing records from primary storage. [2025-09-25T22:24:02.190563] [INFO ] [MAIN ] NC: Loaded 1925 primary data records. [2025-09-25T22:24:02.190474] [DEBUG] [LOCAL ] NBXG: Loaded 22677 existing records from primary storage. [2025-09-25T22:24:02.204720] [INFO ] [MAIN ] NBXG: Loaded 22677 primary data records. [2025-09-25T22:24:03.197767] [DEBUG] [MAIN ] NBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:03.199272] [INFO ] [MAIN ] NBR: Generated 1807 derivative records from 35065 primary records. [2025-09-25T22:24:03.192307] [DEBUG] [MAIN ] NC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:03.200104] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-25T22:24:03.200041] [INFO ] [MAIN ] NC: Generated 1807 derivative records from 1925 primary records. [2025-09-25T22:24:03.198140] [DEBUG] [MAIN ] NBXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:03.201128] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-25T22:24:03.202125] [INFO ] [MAIN ] NBXG: Generated 1807 derivative records from 22677 primary records. [2025-09-25T22:24:03.202805] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-25T22:24:03.239897] [DEBUG] [LOCAL ] NBR: Derivative data saved (1807 records). [2025-09-25T22:24:03.240595] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-25T22:24:03.247194] [INFO ] [MAIN ] Derivative Progress: 1219/2043 symbols completed. NBR took 1.3s. Estimated remaining: 5m 48s. Rate: 142.2 symbols/min [2025-09-25T22:24:03.250473] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:03.253713] [DEBUG] [LOCAL ] NC: Derivative data saved (1807 records). [2025-09-25T22:24:03.253969] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-25T22:24:03.257360] [INFO ] [MAIN ] Derivative Progress: 1220/2043 symbols completed. NC took 1.2s. Estimated remaining: 5m 47s. Rate: 142.3 symbols/min [2025-09-25T22:24:03.260786] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1807 records). [2025-09-25T22:24:03.261183] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-25T22:24:03.261281] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:03.265438] [INFO ] [MAIN ] Derivative Progress: 1221/2043 symbols completed. NBXG took 1.2s. Estimated remaining: 5m 46s. Rate: 142.4 symbols/min [2025-09-25T22:24:03.265838] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:03.276732] [DEBUG] [LOCAL ] NCA: Loaded 10134 existing records from primary storage. [2025-09-25T22:24:03.277083] [INFO ] [MAIN ] NCA: Loaded 10134 primary data records. [2025-09-25T22:24:03.439720] [DEBUG] [LOCAL ] NCDL: Loaded 21698 existing records from primary storage. [2025-09-25T22:24:03.455735] [INFO ] [MAIN ] NCDL: Loaded 21698 primary data records. [2025-09-25T22:24:03.995009] [DEBUG] [LOCAL ] NCLH: Loaded 54143 existing records from primary storage. [2025-09-25T22:24:04.006370] [INFO ] [MAIN ] NCLH: Loaded 54143 primary data records. [2025-09-25T22:24:04.373062] [DEBUG] [MAIN ] NCA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:04.374011] [INFO ] [MAIN ] NCA: Generated 1807 derivative records from 10134 primary records. [2025-09-25T22:24:04.374207] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-25T22:24:04.392608] [DEBUG] [LOCAL ] NCA: Derivative data saved (1807 records). [2025-09-25T22:24:04.393111] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-25T22:24:04.396252] [INFO ] [MAIN ] Derivative Progress: 1222/2043 symbols completed. NCA took 1.1s. Estimated remaining: 5m 46s. Rate: 142.2 symbols/min [2025-09-25T22:24:04.399869] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:04.417976] [DEBUG] [MAIN ] NCDL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:04.420302] [INFO ] [MAIN ] NCDL: Generated 1807 derivative records from 21698 primary records. [2025-09-25T22:24:04.420772] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-25T22:24:04.447982] [DEBUG] [LOCAL ] NCV: Loaded 13501 existing records from primary storage. [2025-09-25T22:24:04.449123] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1807 records). [2025-09-25T22:24:04.449358] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-25T22:24:04.449743] [INFO ] [MAIN ] NCV: Loaded 13501 primary data records. [2025-09-25T22:24:04.452389] [INFO ] [MAIN ] Derivative Progress: 1223/2043 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 46s. Rate: 142.3 symbols/min [2025-09-25T22:24:04.453036] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:04.571123] [DEBUG] [LOCAL ] NCZ: Loaded 11900 existing records from primary storage. [2025-09-25T22:24:04.581927] [INFO ] [MAIN ] NCZ: Loaded 11900 primary data records. [2025-09-25T22:24:04.694339] [DEBUG] [MAIN ] NCLH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:04.953680] [INFO ] [MAIN ] NCLH: Generated 1807 derivative records from 54143 primary records. [2025-09-25T22:24:04.970331] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-25T22:24:05.099987] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1807 records). [2025-09-25T22:24:05.108077] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-25T22:24:05.114900] [INFO ] [MAIN ] Derivative Progress: 1224/2043 symbols completed. NCLH took 1.8s. Estimated remaining: 5m 45s. Rate: 142.3 symbols/min [2025-09-25T22:24:05.229048] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:05.268294] [DEBUG] [LOCAL ] NDMO: Loaded 16814 existing records from primary storage. [2025-09-25T22:24:05.268632] [INFO ] [MAIN ] NDMO: Loaded 16814 primary data records. [2025-09-25T22:24:05.370091] [DEBUG] [MAIN ] NCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:05.393923] [INFO ] [MAIN ] NCV: Generated 1807 derivative records from 13501 primary records. [2025-09-25T22:24:05.405696] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-25T22:24:05.641967] [DEBUG] [MAIN ] NCZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:05.648788] [INFO ] [MAIN ] NCZ: Generated 1807 derivative records from 11900 primary records. [2025-09-25T22:24:05.651518] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-25T22:24:05.650993] [DEBUG] [LOCAL ] NCV: Derivative data saved (1807 records). [2025-09-25T22:24:05.652021] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-25T22:24:05.655227] [INFO ] [MAIN ] Derivative Progress: 1225/2043 symbols completed. NCV took 1.3s. Estimated remaining: 5m 45s. Rate: 142.2 symbols/min [2025-09-25T22:24:05.655752] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:05.677808] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1807 records). [2025-09-25T22:24:05.678182] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-25T22:24:05.680715] [INFO ] [MAIN ] Derivative Progress: 1226/2043 symbols completed. NCZ took 1.2s. Estimated remaining: 5m 44s. Rate: 142.4 symbols/min [2025-09-25T22:24:05.681226] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:05.701749] [DEBUG] [MAIN ] NDMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:05.702473] [INFO ] [MAIN ] NDMO: Generated 1807 derivative records from 16814 primary records. [2025-09-25T22:24:05.702537] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-25T22:24:05.720998] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1807 records). [2025-09-25T22:24:05.721275] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-25T22:24:05.724121] [INFO ] [MAIN ] Derivative Progress: 1227/2043 symbols completed. NDMO took 0.5s. Estimated remaining: 5m 44s. Rate: 142.5 symbols/min [2025-09-25T22:24:05.724506] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:05.795342] [DEBUG] [LOCAL ] NE: Loaded 52771 existing records from primary storage. [2025-09-25T22:24:05.795601] [INFO ] [MAIN ] NE: Loaded 52771 primary data records. [2025-09-25T22:24:05.796189] [DEBUG] [LOCAL ] NEA: Loaded 35520 existing records from primary storage. [2025-09-25T22:24:05.807155] [INFO ] [MAIN ] NEA: Loaded 35520 primary data records. [2025-09-25T22:24:06.484702] [DEBUG] [LOCAL ] NEE: Loaded 54097 existing records from primary storage. [2025-09-25T22:24:06.485802] [INFO ] [MAIN ] NEE: Loaded 54097 primary data records. [2025-09-25T22:24:06.875255] [DEBUG] [MAIN ] NE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:06.874954] [DEBUG] [MAIN ] NEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:06.877999] [INFO ] [MAIN ] NEA: Generated 1807 derivative records from 35520 primary records. [2025-09-25T22:24:06.878279] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-25T22:24:06.879364] [INFO ] [MAIN ] NE: Generated 1807 derivative records from 52771 primary records. [2025-09-25T22:24:06.881310] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-25T22:24:06.899179] [DEBUG] [LOCAL ] NEA: Derivative data saved (1807 records). [2025-09-25T22:24:06.899588] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-25T22:24:06.902584] [INFO ] [MAIN ] Derivative Progress: 1228/2043 symbols completed. NEA took 1.2s. Estimated remaining: 5m 44s. Rate: 142.3 symbols/min [2025-09-25T22:24:06.922994] [DEBUG] [LOCAL ] NE: Derivative data saved (1807 records). [2025-09-25T22:24:06.923248] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-25T22:24:06.926150] [INFO ] [MAIN ] Derivative Progress: 1229/2043 symbols completed. NE took 1.3s. Estimated remaining: 5m 43s. Rate: 142.4 symbols/min [2025-09-25T22:24:06.939542] [DEBUG] [MAIN ] NEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:06.940422] [INFO ] [MAIN ] NEE: Generated 1807 derivative records from 54097 primary records. [2025-09-25T22:24:06.940487] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-25T22:24:06.956749] [DEBUG] [LOCAL ] NEE: Derivative data saved (1807 records). [2025-09-25T22:24:06.956814] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-25T22:24:06.959561] [INFO ] [MAIN ] Derivative Progress: 1230/2043 symbols completed. NEE took 1.2s. Estimated remaining: 5m 42s. Rate: 142.5 symbols/min [2025-09-25T22:24:06.960407] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:06.960512] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:06.960629] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:06.972897] [DEBUG] [LOCAL ] NEU: Loaded 8200 existing records from primary storage. [2025-09-25T22:24:06.973120] [INFO ] [MAIN ] NEU: Loaded 8200 primary data records. [2025-09-25T22:24:07.436528] [DEBUG] [LOCAL ] NEM: Loaded 54098 existing records from primary storage. [2025-09-25T22:24:07.440967] [DEBUG] [LOCAL ] NET: Loaded 53435 existing records from primary storage. [2025-09-25T22:24:07.441117] [INFO ] [MAIN ] NEM: Loaded 54098 primary data records. [2025-09-25T22:24:07.441214] [INFO ] [MAIN ] NET: Loaded 53435 primary data records. [2025-09-25T22:24:08.112632] [DEBUG] [MAIN ] NEU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:08.114082] [INFO ] [MAIN ] NEU: Generated 1807 derivative records from 8200 primary records. [2025-09-25T22:24:08.115240] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-25T22:24:08.144332] [DEBUG] [LOCAL ] NEU: Derivative data saved (1807 records). [2025-09-25T22:24:08.145101] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-25T22:24:08.149189] [INFO ] [MAIN ] Derivative Progress: 1231/2043 symbols completed. NEU took 1.2s. Estimated remaining: 5m 42s. Rate: 142.3 symbols/min [2025-09-25T22:24:08.150344] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:08.175006] [DEBUG] [LOCAL ] NEUE: Loaded 2255 existing records from primary storage. [2025-09-25T22:24:08.175870] [INFO ] [MAIN ] NEUE: Loaded 2255 primary data records. [2025-09-25T22:24:08.176256] [DEBUG] [MAIN ] NEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:08.177127] [INFO ] [MAIN ] NEM: Generated 1807 derivative records from 54098 primary records. [2025-09-25T22:24:08.188533] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-25T22:24:08.249928] [DEBUG] [MAIN ] NET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:08.285896] [INFO ] [MAIN ] NET: Generated 1807 derivative records from 53435 primary records. [2025-09-25T22:24:08.314271] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-25T22:24:08.419731] [DEBUG] [LOCAL ] NEM: Derivative data saved (1807 records). [2025-09-25T22:24:08.420870] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-25T22:24:08.424568] [INFO ] [MAIN ] Derivative Progress: 1232/2043 symbols completed. NEM took 1.5s. Estimated remaining: 5m 42s. Rate: 142.3 symbols/min [2025-09-25T22:24:08.543891] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:08.546336] [DEBUG] [LOCAL ] NET: Derivative data saved (1807 records). [2025-09-25T22:24:08.547874] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-25T22:24:08.551237] [INFO ] [MAIN ] Derivative Progress: 1233/2043 symbols completed. NET took 1.6s. Estimated remaining: 5m 41s. Rate: 142.4 symbols/min [2025-09-25T22:24:08.554394] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:08.562635] [DEBUG] [LOCAL ] NEXA: Loaded 4210 existing records from primary storage. [2025-09-25T22:24:08.563158] [INFO ] [MAIN ] NEXA: Loaded 4210 primary data records. [2025-09-25T22:24:08.955618] [DEBUG] [MAIN ] NEUE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:08.957159] [INFO ] [MAIN ] NEUE: Generated 1807 derivative records from 2255 primary records. [2025-09-25T22:24:08.957844] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-25T22:24:08.959114] [DEBUG] [LOCAL ] NFG: Loaded 38809 existing records from primary storage. [2025-09-25T22:24:08.961581] [INFO ] [MAIN ] NFG: Loaded 38809 primary data records. [2025-09-25T22:24:09.025624] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1807 records). [2025-09-25T22:24:09.052237] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-25T22:24:09.062484] [INFO ] [MAIN ] Derivative Progress: 1234/2043 symbols completed. NEUE took 0.9s. Estimated remaining: 5m 41s. Rate: 142.4 symbols/min [2025-09-25T22:24:09.081858] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:09.413503] [DEBUG] [LOCAL ] NFJ: Loaded 20362 existing records from primary storage. [2025-09-25T22:24:09.433061] [DEBUG] [MAIN ] NEXA: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:24:09.432699] [INFO ] [MAIN ] NFJ: Loaded 20362 primary data records. [2025-09-25T22:24:09.434984] [INFO ] [MAIN ] NEXA: Generated 1806 derivative records from 4210 primary records. [2025-09-25T22:24:09.435223] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-25T22:24:09.552353] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1806 records). [2025-09-25T22:24:09.564698] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-25T22:24:09.578328] [INFO ] [MAIN ] Derivative Progress: 1235/2043 symbols completed. NEXA took 1.0s. Estimated remaining: 5m 41s. Rate: 142.3 symbols/min [2025-09-25T22:24:09.610432] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:09.825981] [DEBUG] [MAIN ] NFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:09.827380] [INFO ] [MAIN ] NFG: Generated 1807 derivative records from 38809 primary records. [2025-09-25T22:24:09.827784] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-25T22:24:09.893195] [DEBUG] [LOCAL ] NFG: Derivative data saved (1807 records). [2025-09-25T22:24:09.894016] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-25T22:24:09.897781] [INFO ] [MAIN ] Derivative Progress: 1236/2043 symbols completed. NFG took 1.3s. Estimated remaining: 5m 40s. Rate: 142.4 symbols/min [2025-09-25T22:24:09.898422] [DEBUG] [MAIN ] NFJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:09.899155] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:09.900470] [INFO ] [MAIN ] NFJ: Generated 1807 derivative records from 20362 primary records. [2025-09-25T22:24:09.902918] [DEBUG] [LOCAL ] NGG: Loaded 46497 existing records from primary storage. [2025-09-25T22:24:09.903337] [INFO ] [MAIN ] NGG: Loaded 46497 primary data records. [2025-09-25T22:24:09.903585] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-25T22:24:10.057324] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1807 records). [2025-09-25T22:24:10.068501] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-25T22:24:10.083598] [INFO ] [MAIN ] Derivative Progress: 1237/2043 symbols completed. NFJ took 1.0s. Estimated remaining: 5m 40s. Rate: 142.4 symbols/min [2025-09-25T22:24:10.134068] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:10.159216] [DEBUG] [LOCAL ] NGL: Loaded 30631 existing records from primary storage. [2025-09-25T22:24:10.159957] [INFO ] [MAIN ] NGL: Loaded 30631 primary data records. [2025-09-25T22:24:10.415399] [DEBUG] [LOCAL ] NGS: Loaded 11597 existing records from primary storage. [2025-09-25T22:24:10.421869] [INFO ] [MAIN ] NGS: Loaded 11597 primary data records. [2025-09-25T22:24:10.993995] [DEBUG] [MAIN ] NGG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:10.995901] [INFO ] [MAIN ] NGG: Generated 1807 derivative records from 46497 primary records. [2025-09-25T22:24:10.996151] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-25T22:24:11.039873] [DEBUG] [LOCAL ] NGG: Derivative data saved (1807 records). [2025-09-25T22:24:11.040461] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-25T22:24:11.040401] [DEBUG] [MAIN ] NGL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:11.045903] [INFO ] [MAIN ] NGL: Generated 1807 derivative records from 30631 primary records. [2025-09-25T22:24:11.046160] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-25T22:24:11.044479] [INFO ] [MAIN ] Derivative Progress: 1238/2043 symbols completed. NGG took 1.4s. Estimated remaining: 5m 39s. Rate: 142.3 symbols/min [2025-09-25T22:24:11.047723] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:11.066634] [DEBUG] [LOCAL ] NGL: Derivative data saved (1807 records). [2025-09-25T22:24:11.067740] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-25T22:24:11.071499] [INFO ] [MAIN ] Derivative Progress: 1239/2043 symbols completed. NGL took 1.2s. Estimated remaining: 5m 39s. Rate: 142.4 symbols/min [2025-09-25T22:24:11.072207] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:11.085805] [DEBUG] [MAIN ] NGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:11.086941] [INFO ] [MAIN ] NGS: Generated 1807 derivative records from 11597 primary records. [2025-09-25T22:24:11.087131] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-25T22:24:11.110782] [DEBUG] [LOCAL ] NGS: Derivative data saved (1807 records). [2025-09-25T22:24:11.110998] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-25T22:24:11.114862] [INFO ] [MAIN ] Derivative Progress: 1240/2043 symbols completed. NGS took 1.0s. Estimated remaining: 5m 38s. Rate: 142.5 symbols/min [2025-09-25T22:24:11.120469] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:11.130177] [DEBUG] [LOCAL ] NGVC: Loaded 22506 existing records from primary storage. [2025-09-25T22:24:11.130439] [INFO ] [MAIN ] NGVC: Loaded 22506 primary data records. [2025-09-25T22:24:11.256779] [DEBUG] [LOCAL ] NGVT: Loaded 24491 existing records from primary storage. [2025-09-25T22:24:11.258195] [INFO ] [MAIN ] NGVT: Loaded 24491 primary data records. [2025-09-25T22:24:11.398339] [DEBUG] [LOCAL ] NHI: Loaded 22129 existing records from primary storage. [2025-09-25T22:24:11.410845] [INFO ] [MAIN ] NHI: Loaded 22129 primary data records. [2025-09-25T22:24:12.262681] [DEBUG] [MAIN ] NGVC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:12.263808] [INFO ] [MAIN ] NGVC: Generated 1807 derivative records from 22506 primary records. [2025-09-25T22:24:12.264956] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-25T22:24:12.303749] [DEBUG] [MAIN ] NGVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:12.305225] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1807 records). [2025-09-25T22:24:12.306011] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-25T22:24:12.309513] [INFO ] [MAIN ] Derivative Progress: 1241/2043 symbols completed. NGVC took 1.3s. Estimated remaining: 5m 38s. Rate: 142.3 symbols/min [2025-09-25T22:24:12.310493] [INFO ] [MAIN ] NGVT: Generated 1807 derivative records from 24491 primary records. [2025-09-25T22:24:12.311637] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-25T22:24:12.311255] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:12.343668] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1807 records). [2025-09-25T22:24:12.344018] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-25T22:24:12.368613] [DEBUG] [LOCAL ] NIC: Loaded 8966 existing records from primary storage. [2025-09-25T22:24:12.362542] [INFO ] [MAIN ] Derivative Progress: 1242/2043 symbols completed. NGVT took 1.3s. Estimated remaining: 5m 38s. Rate: 142.4 symbols/min [2025-09-25T22:24:12.368158] [DEBUG] [MAIN ] NHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:12.370279] [INFO ] [MAIN ] NHI: Generated 1807 derivative records from 22129 primary records. [2025-09-25T22:24:12.370496] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:12.370734] [INFO ] [MAIN ] NIC: Loaded 8966 primary data records. [2025-09-25T22:24:12.384097] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-25T22:24:12.524687] [DEBUG] [LOCAL ] NHI: Derivative data saved (1807 records). [2025-09-25T22:24:12.523634] [DEBUG] [LOCAL ] NIE: Loaded 11696 existing records from primary storage. [2025-09-25T22:24:12.530123] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-25T22:24:12.545531] [INFO ] [MAIN ] NIE: Loaded 11696 primary data records. [2025-09-25T22:24:12.540070] [INFO ] [MAIN ] Derivative Progress: 1243/2043 symbols completed. NHI took 1.4s. Estimated remaining: 5m 37s. Rate: 142.4 symbols/min [2025-09-25T22:24:13.165505] [DEBUG] [MAIN ] NIC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:13.166911] [INFO ] [MAIN ] NIC: Generated 1807 derivative records from 8966 primary records. [2025-09-25T22:24:13.167130] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-25T22:24:13.200373] [DEBUG] [MAIN ] NIE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:13.202844] [INFO ] [MAIN ] NIE: Generated 1807 derivative records from 11696 primary records. [2025-09-25T22:24:13.202949] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-25T22:24:13.201923] [DEBUG] [LOCAL ] NIC: Derivative data saved (1807 records). [2025-09-25T22:24:13.203566] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-25T22:24:13.206723] [INFO ] [MAIN ] Derivative Progress: 1244/2043 symbols completed. NIC took 0.9s. Estimated remaining: 5m 37s. Rate: 142.4 symbols/min [2025-09-25T22:24:13.222958] [DEBUG] [LOCAL ] NIE: Derivative data saved (1807 records). [2025-09-25T22:24:13.223040] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-25T22:24:13.226672] [INFO ] [MAIN ] Derivative Progress: 1245/2043 symbols completed. NIE took 0.9s. Estimated remaining: 5m 36s. Rate: 142.5 symbols/min [2025-09-25T22:24:13.227440] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:13.228089] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:13.228776] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:13.236848] [DEBUG] [LOCAL ] NIM: Loaded 4117 existing records from primary storage. [2025-09-25T22:24:13.237093] [INFO ] [MAIN ] NIM: Loaded 4117 primary data records. [2025-09-25T22:24:13.467570] [DEBUG] [LOCAL ] NINE: Loaded 28502 existing records from primary storage. [2025-09-25T22:24:13.496172] [INFO ] [MAIN ] NINE: Loaded 28502 primary data records. [2025-09-25T22:24:13.752282] [DEBUG] [LOCAL ] NIO: Loaded 54192 existing records from primary storage. [2025-09-25T22:24:13.769902] [INFO ] [MAIN ] NIO: Loaded 54192 primary data records. [2025-09-25T22:24:14.385990] [DEBUG] [MAIN ] NIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:14.387300] [INFO ] [MAIN ] NIM: Generated 1807 derivative records from 4117 primary records. [2025-09-25T22:24:14.387712] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-25T22:24:14.416265] [DEBUG] [LOCAL ] NIM: Derivative data saved (1807 records). [2025-09-25T22:24:14.416519] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-25T22:24:14.422265] [INFO ] [MAIN ] Derivative Progress: 1246/2043 symbols completed. NIM took 1.2s. Estimated remaining: 5m 36s. Rate: 142.3 symbols/min [2025-09-25T22:24:14.423943] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:14.441612] [DEBUG] [MAIN ] NINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:14.442586] [INFO ] [MAIN ] NINE: Generated 1807 derivative records from 28502 primary records. [2025-09-25T22:24:14.442809] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-25T22:24:14.475390] [DEBUG] [LOCAL ] NINE: Derivative data saved (1807 records). [2025-09-25T22:24:14.475814] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-25T22:24:14.479282] [INFO ] [MAIN ] Derivative Progress: 1247/2043 symbols completed. NINE took 1.3s. Estimated remaining: 5m 35s. Rate: 142.4 symbols/min [2025-09-25T22:24:14.492693] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:14.493275] [DEBUG] [MAIN ] NIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:14.505912] [INFO ] [MAIN ] NIO: Generated 1807 derivative records from 54192 primary records. [2025-09-25T22:24:14.506013] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-25T22:24:14.540024] [DEBUG] [LOCAL ] NJR: Loaded 38433 existing records from primary storage. [2025-09-25T22:24:14.548621] [DEBUG] [LOCAL ] NIO: Derivative data saved (1807 records). [2025-09-25T22:24:14.548803] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-25T22:24:14.548948] [INFO ] [MAIN ] NJR: Loaded 38433 primary data records. [2025-09-25T22:24:14.551914] [INFO ] [MAIN ] Derivative Progress: 1248/2043 symbols completed. NIO took 1.3s. Estimated remaining: 5m 35s. Rate: 142.5 symbols/min [2025-09-25T22:24:14.552410] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:14.553404] [DEBUG] [LOCAL ] NKX: Loaded 13747 existing records from primary storage. [2025-09-25T22:24:14.553548] [INFO ] [MAIN ] NKX: Loaded 13747 primary data records. [2025-09-25T22:24:14.781418] [DEBUG] [LOCAL ] NLOP: Loaded 11904 existing records from primary storage. [2025-09-25T22:24:14.798087] [INFO ] [MAIN ] NLOP: Loaded 11904 primary data records. [2025-09-25T22:24:15.602905] [DEBUG] [MAIN ] NJR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:15.608630] [INFO ] [MAIN ] NJR: Generated 1807 derivative records from 38433 primary records. [2025-09-25T22:24:15.609465] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-25T22:24:15.650369] [DEBUG] [MAIN ] NKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:15.654603] [DEBUG] [MAIN ] NLOP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:15.656624] [DEBUG] [LOCAL ] NJR: Derivative data saved (1807 records). [2025-09-25T22:24:15.657980] [INFO ] [MAIN ] NLOP: Generated 1807 derivative records from 11904 primary records. [2025-09-25T22:24:15.659132] [INFO ] [MAIN ] NKX: Generated 1807 derivative records from 13747 primary records. [2025-09-25T22:24:15.658122] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-25T22:24:15.659269] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-25T22:24:15.659341] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-25T22:24:15.663226] [INFO ] [MAIN ] Derivative Progress: 1249/2043 symbols completed. NJR took 1.2s. Estimated remaining: 5m 35s. Rate: 142.3 symbols/min [2025-09-25T22:24:15.666245] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:15.691818] [DEBUG] [LOCAL ] NKX: Derivative data saved (1807 records). [2025-09-25T22:24:15.692084] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-25T22:24:15.697953] [INFO ] [MAIN ] Derivative Progress: 1250/2043 symbols completed. NKX took 1.2s. Estimated remaining: 5m 34s. Rate: 142.4 symbols/min [2025-09-25T22:24:15.699803] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:15.705382] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1807 records). [2025-09-25T22:24:15.705556] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-25T22:24:15.708989] [INFO ] [MAIN ] Derivative Progress: 1251/2043 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 33s. Rate: 142.5 symbols/min [2025-09-25T22:24:15.709566] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:15.722425] [DEBUG] [LOCAL ] NMAI: Loaded 13127 existing records from primary storage. [2025-09-25T22:24:15.722623] [INFO ] [MAIN ] NMAI: Loaded 13127 primary data records. [2025-09-25T22:24:15.868696] [DEBUG] [LOCAL ] NMCO: Loaded 16751 existing records from primary storage. [2025-09-25T22:24:15.869295] [INFO ] [MAIN ] NMCO: Loaded 16751 primary data records. [2025-09-25T22:24:16.145193] [DEBUG] [LOCAL ] NLY: Loaded 53967 existing records from primary storage. [2025-09-25T22:24:16.264980] [INFO ] [MAIN ] NLY: Loaded 53967 primary data records. [2025-09-25T22:24:16.862291] [DEBUG] [MAIN ] NMAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:16.863793] [INFO ] [MAIN ] NMAI: Generated 1807 derivative records from 13127 primary records. [2025-09-25T22:24:16.864252] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-25T22:24:16.888805] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1807 records). [2025-09-25T22:24:16.888934] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-25T22:24:16.893503] [INFO ] [MAIN ] Derivative Progress: 1252/2043 symbols completed. NMAI took 1.2s. Estimated remaining: 5m 34s. Rate: 142.3 symbols/min [2025-09-25T22:24:16.903631] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:16.910810] [DEBUG] [MAIN ] NMCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:16.912981] [INFO ] [MAIN ] NMCO: Generated 1807 derivative records from 16751 primary records. [2025-09-25T22:24:16.913071] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-25T22:24:16.937846] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1807 records). [2025-09-25T22:24:16.955078] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-25T22:24:16.958926] [INFO ] [MAIN ] Derivative Progress: 1253/2043 symbols completed. NMCO took 1.2s. Estimated remaining: 5m 33s. Rate: 142.4 symbols/min [2025-09-25T22:24:16.949940] [DEBUG] [LOCAL ] NMG: Loaded 7841 existing records from primary storage. [2025-09-25T22:24:16.959635] [DEBUG] [MAIN ] NLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:16.959966] [INFO ] [MAIN ] NMG: Loaded 7841 primary data records. [2025-09-25T22:24:16.974299] [INFO ] [MAIN ] NLY: Generated 1807 derivative records from 53967 primary records. [2025-09-25T22:24:16.984858] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-25T22:24:16.973234] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:17.064837] [DEBUG] [LOCAL ] NLY: Derivative data saved (1807 records). [2025-09-25T22:24:17.082182] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-25T22:24:17.105776] [INFO ] [MAIN ] Derivative Progress: 1254/2043 symbols completed. NLY took 1.4s. Estimated remaining: 5m 32s. Rate: 142.5 symbols/min [2025-09-25T22:24:17.110290] [DEBUG] [LOCAL ] NMI: Loaded 4078 existing records from primary storage. [2025-09-25T22:24:17.115926] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:17.121249] [INFO ] [MAIN ] NMI: Loaded 4078 primary data records. [2025-09-25T22:24:17.460715] [DEBUG] [LOCAL ] NMM: Loaded 14402 existing records from primary storage. [2025-09-25T22:24:17.462464] [INFO ] [MAIN ] NMM: Loaded 14402 primary data records. [2025-09-25T22:24:18.127779] [DEBUG] [MAIN ] NMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:18.129181] [INFO ] [MAIN ] NMG: Generated 1807 derivative records from 7841 primary records. [2025-09-25T22:24:18.129451] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-25T22:24:18.148667] [DEBUG] [LOCAL ] NMG: Derivative data saved (1807 records). [2025-09-25T22:24:18.148909] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-25T22:24:18.152711] [INFO ] [MAIN ] Derivative Progress: 1255/2043 symbols completed. NMG took 1.3s. Estimated remaining: 5m 32s. Rate: 142.3 symbols/min [2025-09-25T22:24:18.155521] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:18.172009] [DEBUG] [MAIN ] NMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:18.173125] [INFO ] [MAIN ] NMI: Generated 1807 derivative records from 4078 primary records. [2025-09-25T22:24:18.173348] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-25T22:24:18.193060] [DEBUG] [LOCAL ] NMI: Derivative data saved (1807 records). [2025-09-25T22:24:18.195329] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-25T22:24:18.199843] [INFO ] [MAIN ] Derivative Progress: 1256/2043 symbols completed. NMI took 1.2s. Estimated remaining: 5m 32s. Rate: 142.4 symbols/min [2025-09-25T22:24:18.214955] [DEBUG] [MAIN ] NMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:18.215059] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:18.228931] [INFO ] [MAIN ] NMM: Generated 1807 derivative records from 14402 primary records. [2025-09-25T22:24:18.229318] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-25T22:24:18.250599] [DEBUG] [LOCAL ] NMS: Loaded 2889 existing records from primary storage. [2025-09-25T22:24:18.269452] [INFO ] [MAIN ] NMS: Loaded 2889 primary data records. [2025-09-25T22:24:18.269597] [DEBUG] [LOCAL ] NMM: Derivative data saved (1807 records). [2025-09-25T22:24:18.277228] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-25T22:24:18.277066] [DEBUG] [LOCAL ] NMR: Loaded 35332 existing records from primary storage. [2025-09-25T22:24:18.280661] [INFO ] [MAIN ] Derivative Progress: 1257/2043 symbols completed. NMM took 1.2s. Estimated remaining: 5m 31s. Rate: 142.5 symbols/min [2025-09-25T22:24:18.327389] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:18.327051] [INFO ] [MAIN ] NMR: Loaded 35332 primary data records. [2025-09-25T22:24:18.495516] [DEBUG] [LOCAL ] NMT: Loaded 2867 existing records from primary storage. [2025-09-25T22:24:18.524398] [INFO ] [MAIN ] NMT: Loaded 2867 primary data records. [2025-09-25T22:24:19.351031] [DEBUG] [MAIN ] NMS: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:24:19.352869] [INFO ] [MAIN ] NMS: Generated 1805 derivative records from 2889 primary records. [2025-09-25T22:24:19.353353] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-25T22:24:19.370920] [DEBUG] [MAIN ] NMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:19.373593] [INFO ] [MAIN ] NMR: Generated 1807 derivative records from 35332 primary records. [2025-09-25T22:24:19.379824] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-25T22:24:19.401308] [DEBUG] [LOCAL ] NMS: Derivative data saved (1805 records). [2025-09-25T22:24:19.406932] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-25T22:24:19.424712] [DEBUG] [MAIN ] NMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:19.423892] [INFO ] [MAIN ] Derivative Progress: 1258/2043 symbols completed. NMS took 1.2s. Estimated remaining: 5m 31s. Rate: 142.3 symbols/min [2025-09-25T22:24:19.428046] [INFO ] [MAIN ] NMT: Generated 1807 derivative records from 2867 primary records. [2025-09-25T22:24:19.430850] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-25T22:24:19.430947] [DEBUG] [LOCAL ] NMR: Derivative data saved (1807 records). [2025-09-25T22:24:19.432330] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-25T22:24:19.438868] [INFO ] [MAIN ] Derivative Progress: 1259/2043 symbols completed. NMR took 1.3s. Estimated remaining: 5m 30s. Rate: 142.4 symbols/min [2025-09-25T22:24:19.454470] [DEBUG] [LOCAL ] NMT: Derivative data saved (1807 records). [2025-09-25T22:24:19.454672] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-25T22:24:19.457613] [INFO ] [MAIN ] Derivative Progress: 1260/2043 symbols completed. NMT took 1.1s. Estimated remaining: 5m 30s. Rate: 142.5 symbols/min [2025-09-25T22:24:19.458692] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:19.458806] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:19.458960] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:19.474738] [DEBUG] [LOCAL ] NNI: Loaded 10071 existing records from primary storage. [2025-09-25T22:24:19.475115] [INFO ] [MAIN ] NNI: Loaded 10071 primary data records. [2025-09-25T22:24:19.579832] [DEBUG] [LOCAL ] NMZ: Loaded 21768 existing records from primary storage. [2025-09-25T22:24:19.608998] [INFO ] [MAIN ] NMZ: Loaded 21768 primary data records. [2025-09-25T22:24:19.988948] [DEBUG] [LOCAL ] NNN: Loaded 48783 existing records from primary storage. [2025-09-25T22:24:20.041365] [INFO ] [MAIN ] NNN: Loaded 48783 primary data records. [2025-09-25T22:24:20.610537] [DEBUG] [MAIN ] NNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:20.617364] [INFO ] [MAIN ] NNI: Generated 1807 derivative records from 10071 primary records. [2025-09-25T22:24:20.618075] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-25T22:24:20.618456] [DEBUG] [MAIN ] NMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:20.620600] [INFO ] [MAIN ] NMZ: Generated 1807 derivative records from 21768 primary records. [2025-09-25T22:24:20.620815] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-25T22:24:20.651488] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1807 records). [2025-09-25T22:24:20.652669] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-25T22:24:20.656239] [INFO ] [MAIN ] Derivative Progress: 1261/2043 symbols completed. NMZ took 1.2s. Estimated remaining: 5m 30s. Rate: 142.3 symbols/min [2025-09-25T22:24:20.657059] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:20.659511] [DEBUG] [LOCAL ] NNI: Derivative data saved (1807 records). [2025-09-25T22:24:20.659897] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-25T22:24:20.663630] [INFO ] [MAIN ] Derivative Progress: 1262/2043 symbols completed. NNI took 1.2s. Estimated remaining: 5m 29s. Rate: 142.4 symbols/min [2025-09-25T22:24:20.664819] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:20.686930] [DEBUG] [MAIN ] NNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:20.686527] [DEBUG] [LOCAL ] NNY: Loaded 5728 existing records from primary storage. [2025-09-25T22:24:20.688051] [INFO ] [MAIN ] NNN: Generated 1807 derivative records from 48783 primary records. [2025-09-25T22:24:20.688262] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-25T22:24:20.688195] [INFO ] [MAIN ] NNY: Loaded 5728 primary data records. [2025-09-25T22:24:20.801086] [DEBUG] [LOCAL ] NOA: Loaded 16401 existing records from primary storage. [2025-09-25T22:24:20.807172] [INFO ] [MAIN ] NOA: Loaded 16401 primary data records. [2025-09-25T22:24:20.919272] [DEBUG] [LOCAL ] NNN: Derivative data saved (1807 records). [2025-09-25T22:24:21.021041] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-25T22:24:21.080624] [INFO ] [MAIN ] Derivative Progress: 1263/2043 symbols completed. NNN took 1.6s. Estimated remaining: 5m 29s. Rate: 142.4 symbols/min [2025-09-25T22:24:21.202429] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:21.403973] [DEBUG] [LOCAL ] NOAH: Loaded 20272 existing records from primary storage. [2025-09-25T22:24:21.404344] [INFO ] [MAIN ] NOAH: Loaded 20272 primary data records. [2025-09-25T22:24:21.515905] [DEBUG] [MAIN ] NNY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:21.539802] [INFO ] [MAIN ] NNY: Generated 1807 derivative records from 5728 primary records. [2025-09-25T22:24:21.541524] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-25T22:24:21.587745] [DEBUG] [MAIN ] NOA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:21.610050] [INFO ] [MAIN ] NOA: Generated 1807 derivative records from 16401 primary records. [2025-09-25T22:24:21.639706] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-25T22:24:21.782709] [DEBUG] [LOCAL ] NNY: Derivative data saved (1807 records). [2025-09-25T22:24:21.782898] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-25T22:24:21.785477] [INFO ] [MAIN ] Derivative Progress: 1264/2043 symbols completed. NNY took 1.1s. Estimated remaining: 5m 28s. Rate: 142.3 symbols/min [2025-09-25T22:24:21.785780] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:21.803372] [DEBUG] [LOCAL ] NOA: Derivative data saved (1807 records). [2025-09-25T22:24:21.805023] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-25T22:24:21.808250] [INFO ] [MAIN ] Derivative Progress: 1265/2043 symbols completed. NOA took 1.1s. Estimated remaining: 5m 28s. Rate: 142.4 symbols/min [2025-09-25T22:24:21.808941] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:21.841354] [DEBUG] [MAIN ] NOAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:21.842400] [INFO ] [MAIN ] NOAH: Generated 1807 derivative records from 20272 primary records. [2025-09-25T22:24:21.842588] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-25T22:24:21.869821] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1807 records). [2025-09-25T22:24:21.870008] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-25T22:24:21.873141] [INFO ] [MAIN ] Derivative Progress: 1266/2043 symbols completed. NOAH took 0.7s. Estimated remaining: 5m 27s. Rate: 142.5 symbols/min [2025-09-25T22:24:21.873723] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:21.904421] [DEBUG] [LOCAL ] NOC: Loaded 42916 existing records from primary storage. [2025-09-25T22:24:21.904812] [INFO ] [MAIN ] NOC: Loaded 42916 primary data records. [2025-09-25T22:24:22.035938] [DEBUG] [LOCAL ] NOG: Loaded 51547 existing records from primary storage. [2025-09-25T22:24:22.063520] [INFO ] [MAIN ] NOG: Loaded 51547 primary data records. [2025-09-25T22:24:22.474726] [DEBUG] [LOCAL ] NOK: Loaded 54011 existing records from primary storage. [2025-09-25T22:24:22.475046] [INFO ] [MAIN ] NOK: Loaded 54011 primary data records. [2025-09-25T22:24:22.999538] [DEBUG] [MAIN ] NOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:23.001477] [INFO ] [MAIN ] NOC: Generated 1807 derivative records from 42916 primary records. [2025-09-25T22:24:23.001810] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-25T22:24:23.020634] [DEBUG] [LOCAL ] NOC: Derivative data saved (1807 records). [2025-09-25T22:24:23.020909] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-25T22:24:23.023475] [INFO ] [MAIN ] Derivative Progress: 1267/2043 symbols completed. NOC took 1.2s. Estimated remaining: 5m 27s. Rate: 142.3 symbols/min [2025-09-25T22:24:23.026173] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:23.042738] [DEBUG] [MAIN ] NOG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:23.043556] [INFO ] [MAIN ] NOG: Generated 1807 derivative records from 51547 primary records. [2025-09-25T22:24:23.043674] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-25T22:24:23.061913] [DEBUG] [LOCAL ] NOG: Derivative data saved (1807 records). [2025-09-25T22:24:23.063068] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-25T22:24:23.066802] [INFO ] [MAIN ] Derivative Progress: 1268/2043 symbols completed. NOG took 1.3s. Estimated remaining: 5m 26s. Rate: 142.4 symbols/min [2025-09-25T22:24:23.068026] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:23.082964] [DEBUG] [MAIN ] NOK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:23.083783] [INFO ] [MAIN ] NOK: Generated 1807 derivative records from 54011 primary records. [2025-09-25T22:24:23.083911] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-25T22:24:23.109634] [DEBUG] [LOCAL ] NOK: Derivative data saved (1807 records). [2025-09-25T22:24:23.109914] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-25T22:24:23.113470] [INFO ] [MAIN ] Derivative Progress: 1269/2043 symbols completed. NOK took 1.2s. Estimated remaining: 5m 26s. Rate: 142.5 symbols/min [2025-09-25T22:24:23.113895] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:23.130050] [DEBUG] [LOCAL ] NOMD: Loaded 41665 existing records from primary storage. [2025-09-25T22:24:23.130325] [INFO ] [MAIN ] NOMD: Loaded 41665 primary data records. [2025-09-25T22:24:23.290261] [DEBUG] [LOCAL ] NOTE: Loaded 43022 existing records from primary storage. [2025-09-25T22:24:23.328900] [INFO ] [MAIN ] NOTE: Loaded 43022 primary data records. [2025-09-25T22:24:23.647692] [DEBUG] [LOCAL ] NOV: Loaded 53572 existing records from primary storage. [2025-09-25T22:24:23.648380] [INFO ] [MAIN ] NOV: Loaded 53572 primary data records. [2025-09-25T22:24:24.240132] [DEBUG] [MAIN ] NOMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:24.241872] [INFO ] [MAIN ] NOMD: Generated 1807 derivative records from 41665 primary records. [2025-09-25T22:24:24.242486] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-25T22:24:24.298832] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1807 records). [2025-09-25T22:24:24.299907] [DEBUG] [MAIN ] NOTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:24.299573] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-25T22:24:24.300889] [INFO ] [MAIN ] NOTE: Generated 1807 derivative records from 43022 primary records. [2025-09-25T22:24:24.304146] [INFO ] [MAIN ] Derivative Progress: 1270/2043 symbols completed. NOMD took 1.3s. Estimated remaining: 5m 26s. Rate: 142.3 symbols/min [2025-09-25T22:24:24.304475] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-25T22:24:24.306516] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:24.328202] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1807 records). [2025-09-25T22:24:24.331159] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-25T22:24:24.337403] [INFO ] [MAIN ] Derivative Progress: 1271/2043 symbols completed. NOTE took 1.3s. Estimated remaining: 5m 25s. Rate: 142.4 symbols/min [2025-09-25T22:24:24.338264] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:24.352475] [DEBUG] [MAIN ] NOV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:24.353371] [INFO ] [MAIN ] NOV: Generated 1807 derivative records from 53572 primary records. [2025-09-25T22:24:24.353628] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-25T22:24:24.376053] [DEBUG] [LOCAL ] NOV: Derivative data saved (1807 records). [2025-09-25T22:24:24.386696] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-25T22:24:24.386509] [DEBUG] [LOCAL ] NPCT: Loaded 16872 existing records from primary storage. [2025-09-25T22:24:24.391001] [INFO ] [MAIN ] Derivative Progress: 1272/2043 symbols completed. NOV took 1.3s. Estimated remaining: 5m 25s. Rate: 142.5 symbols/min [2025-09-25T22:24:24.391414] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:24.386860] [INFO ] [MAIN ] NPCT: Loaded 16872 primary data records. [2025-09-25T22:24:24.433981] [DEBUG] [LOCAL ] NPFD: Loaded 9713 existing records from primary storage. [2025-09-25T22:24:24.478300] [INFO ] [MAIN ] NPFD: Loaded 9713 primary data records. [2025-09-25T22:24:24.587338] [DEBUG] [LOCAL ] NPK: Loaded 8072 existing records from primary storage. [2025-09-25T22:24:24.640756] [INFO ] [MAIN ] NPK: Loaded 8072 primary data records. [2025-09-25T22:24:25.792373] [DEBUG] [MAIN ] NPFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:25.795496] [INFO ] [MAIN ] NPFD: Generated 1807 derivative records from 9713 primary records. [2025-09-25T22:24:25.794573] [DEBUG] [MAIN ] NPCT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:25.795848] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-25T22:24:25.799016] [INFO ] [MAIN ] NPCT: Generated 1807 derivative records from 16872 primary records. [2025-09-25T22:24:25.800246] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-25T22:24:25.844113] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1807 records). [2025-09-25T22:24:25.827519] [DEBUG] [MAIN ] NPK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:25.844349] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-25T22:24:25.850531] [INFO ] [MAIN ] NPK: Generated 1807 derivative records from 8072 primary records. [2025-09-25T22:24:25.853558] [INFO ] [MAIN ] Derivative Progress: 1273/2043 symbols completed. NPFD took 1.5s. Estimated remaining: 5m 25s. Rate: 142.3 symbols/min [2025-09-25T22:24:25.855108] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-25T22:24:25.867745] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1807 records). [2025-09-25T22:24:25.872424] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-25T22:24:25.876244] [INFO ] [MAIN ] Derivative Progress: 1274/2043 symbols completed. NPCT took 1.6s. Estimated remaining: 5m 24s. Rate: 142.4 symbols/min [2025-09-25T22:24:25.879871] [DEBUG] [LOCAL ] NPK: Derivative data saved (1807 records). [2025-09-25T22:24:25.879950] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-25T22:24:25.882864] [INFO ] [MAIN ] Derivative Progress: 1275/2043 symbols completed. NPK took 1.5s. Estimated remaining: 5m 23s. Rate: 142.5 symbols/min [2025-09-25T22:24:25.883676] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:25.883596] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:25.883878] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:25.892757] [DEBUG] [LOCAL ] NPV: Loaded 5042 existing records from primary storage. [2025-09-25T22:24:25.892906] [INFO ] [MAIN ] NPV: Loaded 5042 primary data records. [2025-09-25T22:24:26.005826] [DEBUG] [LOCAL ] NPO: Loaded 12914 existing records from primary storage. [2025-09-25T22:24:26.022269] [INFO ] [MAIN ] NPO: Loaded 12914 primary data records. [2025-09-25T22:24:26.411390] [DEBUG] [LOCAL ] NPWR: Loaded 43581 existing records from primary storage. [2025-09-25T22:24:26.420451] [INFO ] [MAIN ] NPWR: Loaded 43581 primary data records. [2025-09-25T22:24:27.079000] [DEBUG] [MAIN ] NPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:27.080198] [INFO ] [MAIN ] NPV: Generated 1807 derivative records from 5042 primary records. [2025-09-25T22:24:27.080455] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-25T22:24:27.099580] [DEBUG] [LOCAL ] NPV: Derivative data saved (1807 records). [2025-09-25T22:24:27.099853] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-25T22:24:27.103600] [INFO ] [MAIN ] Derivative Progress: 1276/2043 symbols completed. NPV took 1.2s. Estimated remaining: 5m 23s. Rate: 142.3 symbols/min [2025-09-25T22:24:27.105213] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:27.120780] [DEBUG] [MAIN ] NPO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:27.121821] [INFO ] [MAIN ] NPO: Generated 1807 derivative records from 12914 primary records. [2025-09-25T22:24:27.122001] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-25T22:24:27.149431] [DEBUG] [LOCAL ] NPO: Derivative data saved (1807 records). [2025-09-25T22:24:27.150345] [DEBUG] [LOCAL ] NQP: Loaded 9373 existing records from primary storage. [2025-09-25T22:24:27.158670] [INFO ] [MAIN ] NQP: Loaded 9373 primary data records. [2025-09-25T22:24:27.150948] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-25T22:24:27.166717] [INFO ] [MAIN ] Derivative Progress: 1277/2043 symbols completed. NPO took 1.3s. Estimated remaining: 5m 23s. Rate: 142.4 symbols/min [2025-09-25T22:24:27.172587] [DEBUG] [MAIN ] NPWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:27.202963] [INFO ] [MAIN ] NPWR: Generated 1807 derivative records from 43581 primary records. [2025-09-25T22:24:27.203097] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-25T22:24:27.204218] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:27.379070] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1807 records). [2025-09-25T22:24:27.403393] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-25T22:24:27.417542] [INFO ] [MAIN ] Derivative Progress: 1278/2043 symbols completed. NPWR took 1.5s. Estimated remaining: 5m 22s. Rate: 142.4 symbols/min [2025-09-25T22:24:27.537668] [DEBUG] [LOCAL ] NRDY: Loaded 33222 existing records from primary storage. [2025-09-25T22:24:27.531275] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:27.538049] [INFO ] [MAIN ] NRDY: Loaded 33222 primary data records. [2025-09-25T22:24:27.643019] [DEBUG] [LOCAL ] NREF: Loaded 7893 existing records from primary storage. [2025-09-25T22:24:27.671821] [INFO ] [MAIN ] NREF: Loaded 7893 primary data records. [2025-09-25T22:24:28.239038] [DEBUG] [MAIN ] NQP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:28.240461] [INFO ] [MAIN ] NQP: Generated 1807 derivative records from 9373 primary records. [2025-09-25T22:24:28.240574] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-25T22:24:28.258925] [DEBUG] [LOCAL ] NQP: Derivative data saved (1807 records). [2025-09-25T22:24:28.259334] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-25T22:24:28.262186] [INFO ] [MAIN ] Derivative Progress: 1279/2043 symbols completed. NQP took 1.2s. Estimated remaining: 5m 22s. Rate: 142.3 symbols/min [2025-09-25T22:24:28.262636] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:28.281889] [DEBUG] [MAIN ] NRDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:28.282958] [INFO ] [MAIN ] NRDY: Generated 1807 derivative records from 33222 primary records. [2025-09-25T22:24:28.286250] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-25T22:24:28.312083] [DEBUG] [MAIN ] NREF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:28.313452] [INFO ] [MAIN ] NREF: Generated 1807 derivative records from 7893 primary records. [2025-09-25T22:24:28.313871] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-25T22:24:28.332341] [DEBUG] [LOCAL ] NREF: Derivative data saved (1807 records). [2025-09-25T22:24:28.333798] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-25T22:24:28.346142] [INFO ] [MAIN ] Derivative Progress: 1280/2043 symbols completed. NREF took 0.8s. Estimated remaining: 5m 22s. Rate: 142.4 symbols/min [2025-09-25T22:24:28.346970] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1807 records). [2025-09-25T22:24:28.347254] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:28.347400] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-25T22:24:28.350077] [INFO ] [MAIN ] Derivative Progress: 1281/2043 symbols completed. NRDY took 1.1s. Estimated remaining: 5m 21s. Rate: 142.5 symbols/min [2025-09-25T22:24:28.350728] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:28.370300] [DEBUG] [LOCAL ] NRP: Loaded 4098 existing records from primary storage. [2025-09-25T22:24:28.370463] [INFO ] [MAIN ] NRP: Loaded 4098 primary data records. [2025-09-25T22:24:28.393394] [DEBUG] [LOCAL ] NRGV: Loaded 43355 existing records from primary storage. [2025-09-25T22:24:28.409069] [INFO ] [MAIN ] NRGV: Loaded 43355 primary data records. [2025-09-25T22:24:28.550446] [DEBUG] [LOCAL ] NRK: Loaded 19862 existing records from primary storage. [2025-09-25T22:24:28.606851] [INFO ] [MAIN ] NRK: Loaded 19862 primary data records. [2025-09-25T22:24:29.497399] [DEBUG] [MAIN ] NRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:29.500139] [INFO ] [MAIN ] NRP: Generated 1807 derivative records from 4098 primary records. [2025-09-25T22:24:29.500411] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-25T22:24:29.525924] [DEBUG] [MAIN ] NRGV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:29.532269] [INFO ] [MAIN ] NRGV: Generated 1807 derivative records from 43355 primary records. [2025-09-25T22:24:29.540899] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-25T22:24:29.546958] [DEBUG] [MAIN ] NRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:29.549927] [INFO ] [MAIN ] NRK: Generated 1807 derivative records from 19862 primary records. [2025-09-25T22:24:29.557102] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-25T22:24:29.575287] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1807 records). [2025-09-25T22:24:29.575843] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-25T22:24:29.585026] [INFO ] [MAIN ] Derivative Progress: 1282/2043 symbols completed. NRGV took 1.3s. Estimated remaining: 5m 21s. Rate: 142.3 symbols/min [2025-09-25T22:24:29.588245] [DEBUG] [LOCAL ] NRP: Derivative data saved (1807 records). [2025-09-25T22:24:29.588444] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:29.592352] [DEBUG] [LOCAL ] NRK: Derivative data saved (1807 records). [2025-09-25T22:24:29.588683] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-25T22:24:29.595830] [INFO ] [MAIN ] Derivative Progress: 1283/2043 symbols completed. NRP took 1.2s. Estimated remaining: 5m 20s. Rate: 142.4 symbols/min [2025-09-25T22:24:29.596354] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:29.596599] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-25T22:24:29.601027] [INFO ] [MAIN ] Derivative Progress: 1284/2043 symbols completed. NRK took 1.3s. Estimated remaining: 5m 20s. Rate: 142.5 symbols/min [2025-09-25T22:24:29.601818] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:29.617106] [DEBUG] [LOCAL ] NRUC: Loaded 3116 existing records from primary storage. [2025-09-25T22:24:29.617416] [DEBUG] [LOCAL ] NRT: Loaded 4906 existing records from primary storage. [2025-09-25T22:24:29.617715] [INFO ] [MAIN ] NRUC: Loaded 3116 primary data records. [2025-09-25T22:24:29.652318] [INFO ] [MAIN ] NRT: Loaded 4906 primary data records. [2025-09-25T22:24:30.020168] [DEBUG] [LOCAL ] NSA: Loaded 45202 existing records from primary storage. [2025-09-25T22:24:30.161770] [INFO ] [MAIN ] NSA: Loaded 45202 primary data records. [2025-09-25T22:24:30.729987] [DEBUG] [MAIN ] NRUC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:30.747045] [INFO ] [MAIN ] NRUC: Generated 1807 derivative records from 3116 primary records. [2025-09-25T22:24:30.747418] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-25T22:24:30.747948] [DEBUG] [MAIN ] NRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:30.768693] [INFO ] [MAIN ] NRT: Generated 1807 derivative records from 4906 primary records. [2025-09-25T22:24:30.769991] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-25T22:24:30.775425] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1807 records). [2025-09-25T22:24:30.775705] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-25T22:24:30.785039] [INFO ] [MAIN ] Derivative Progress: 1285/2043 symbols completed. NRUC took 1.2s. Estimated remaining: 5m 20s. Rate: 142.3 symbols/min [2025-09-25T22:24:30.791244] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:30.801253] [DEBUG] [LOCAL ] NRT: Derivative data saved (1807 records). [2025-09-25T22:24:30.809621] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-25T22:24:30.819287] [INFO ] [MAIN ] Derivative Progress: 1286/2043 symbols completed. NRT took 1.2s. Estimated remaining: 5m 19s. Rate: 142.4 symbols/min [2025-09-25T22:24:30.819824] [DEBUG] [MAIN ] NSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:30.820493] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:30.821974] [INFO ] [MAIN ] NSA: Generated 1807 derivative records from 45202 primary records. [2025-09-25T22:24:30.822330] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-25T22:24:30.854742] [DEBUG] [LOCAL ] NSA: Derivative data saved (1807 records). [2025-09-25T22:24:30.854841] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-25T22:24:30.858062] [INFO ] [MAIN ] Derivative Progress: 1287/2043 symbols completed. NSA took 1.3s. Estimated remaining: 5m 18s. Rate: 142.5 symbols/min [2025-09-25T22:24:30.859270] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:30.879796] [DEBUG] [LOCAL ] NSP: Loaded 35210 existing records from primary storage. [2025-09-25T22:24:30.878893] [DEBUG] [LOCAL ] NTB: Loaded 20819 existing records from primary storage. [2025-09-25T22:24:30.880281] [INFO ] [MAIN ] NSP: Loaded 35210 primary data records. [2025-09-25T22:24:30.880405] [INFO ] [MAIN ] NTB: Loaded 20819 primary data records. [2025-09-25T22:24:31.659204] [DEBUG] [LOCAL ] NTR: Loaded 52969 existing records from primary storage. [2025-09-25T22:24:31.661012] [INFO ] [MAIN ] NTR: Loaded 52969 primary data records. [2025-09-25T22:24:32.012532] [DEBUG] [MAIN ] NSP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:32.013709] [INFO ] [MAIN ] NSP: Generated 1807 derivative records from 35210 primary records. [2025-09-25T22:24:32.014320] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-25T22:24:32.049304] [DEBUG] [MAIN ] NTB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:32.051190] [INFO ] [MAIN ] NTB: Generated 1807 derivative records from 20819 primary records. [2025-09-25T22:24:32.051826] [DEBUG] [LOCAL ] NSP: Derivative data saved (1807 records). [2025-09-25T22:24:32.052020] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-25T22:24:32.052141] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-25T22:24:32.055463] [INFO ] [MAIN ] Derivative Progress: 1288/2043 symbols completed. NSP took 1.3s. Estimated remaining: 5m 18s. Rate: 142.3 symbols/min [2025-09-25T22:24:32.073569] [DEBUG] [LOCAL ] NTB: Derivative data saved (1807 records). [2025-09-25T22:24:32.074617] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-25T22:24:32.078376] [INFO ] [MAIN ] Derivative Progress: 1289/2043 symbols completed. NTB took 1.3s. Estimated remaining: 5m 18s. Rate: 142.4 symbols/min [2025-09-25T22:24:32.092099] [DEBUG] [MAIN ] NTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:32.092815] [INFO ] [MAIN ] NTR: Generated 1807 derivative records from 52969 primary records. [2025-09-25T22:24:32.092880] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-25T22:24:32.109335] [DEBUG] [LOCAL ] NTR: Derivative data saved (1807 records). [2025-09-25T22:24:32.109433] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-25T22:24:32.112273] [INFO ] [MAIN ] Derivative Progress: 1290/2043 symbols completed. NTR took 1.3s. Estimated remaining: 5m 17s. Rate: 142.5 symbols/min [2025-09-25T22:24:32.113201] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:32.113145] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:32.113455] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:32.162067] [DEBUG] [LOCAL ] NUS: Loaded 36728 existing records from primary storage. [2025-09-25T22:24:32.175862] [INFO ] [MAIN ] NUS: Loaded 36728 primary data records. [2025-09-25T22:24:32.307762] [DEBUG] [LOCAL ] NTST: Loaded 43910 existing records from primary storage. [2025-09-25T22:24:32.324706] [INFO ] [MAIN ] NTST: Loaded 43910 primary data records. [2025-09-25T22:24:32.331931] [DEBUG] [LOCAL ] NU: Loaded 54136 existing records from primary storage. [2025-09-25T22:24:32.371169] [INFO ] [MAIN ] NU: Loaded 54136 primary data records. [2025-09-25T22:24:33.301271] [DEBUG] [MAIN ] NUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:33.305604] [INFO ] [MAIN ] NUS: Generated 1807 derivative records from 36728 primary records. [2025-09-25T22:24:33.306018] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-25T22:24:33.343300] [DEBUG] [MAIN ] NTST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:33.345269] [INFO ] [MAIN ] NTST: Generated 1807 derivative records from 43910 primary records. [2025-09-25T22:24:33.345447] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-25T22:24:33.361990] [DEBUG] [MAIN ] NU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:33.364084] [INFO ] [MAIN ] NU: Generated 1807 derivative records from 54136 primary records. [2025-09-25T22:24:33.364204] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-25T22:24:33.366068] [DEBUG] [LOCAL ] NUS: Derivative data saved (1807 records). [2025-09-25T22:24:33.376559] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-25T22:24:33.395547] [INFO ] [MAIN ] Derivative Progress: 1291/2043 symbols completed. NUS took 1.3s. Estimated remaining: 5m 17s. Rate: 142.3 symbols/min [2025-09-25T22:24:33.400306] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:33.407918] [DEBUG] [LOCAL ] NTST: Derivative data saved (1807 records). [2025-09-25T22:24:33.408189] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-25T22:24:33.404598] [DEBUG] [LOCAL ] NU: Derivative data saved (1807 records). [2025-09-25T22:24:33.413203] [INFO ] [MAIN ] Derivative Progress: 1292/2043 symbols completed. NTST took 1.3s. Estimated remaining: 5m 16s. Rate: 142.4 symbols/min [2025-09-25T22:24:33.408984] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-25T22:24:33.418991] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:33.419095] [INFO ] [MAIN ] Derivative Progress: 1293/2043 symbols completed. NU took 1.3s. Estimated remaining: 5m 16s. Rate: 142.5 symbols/min [2025-09-25T22:24:33.421334] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:33.441716] [DEBUG] [LOCAL ] NUW: Loaded 7466 existing records from primary storage. [2025-09-25T22:24:33.442748] [INFO ] [MAIN ] NUW: Loaded 7466 primary data records. [2025-09-25T22:24:33.569980] [DEBUG] [LOCAL ] NUV: Loaded 23442 existing records from primary storage. [2025-09-25T22:24:33.584598] [INFO ] [MAIN ] NUV: Loaded 23442 primary data records. [2025-09-25T22:24:33.934390] [DEBUG] [LOCAL ] NUVB: Loaded 51622 existing records from primary storage. [2025-09-25T22:24:34.002798] [INFO ] [MAIN ] NUVB: Loaded 51622 primary data records. [2025-09-25T22:24:34.628158] [DEBUG] [MAIN ] NUW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:34.630553] [INFO ] [MAIN ] NUW: Generated 1807 derivative records from 7466 primary records. [2025-09-25T22:24:34.630951] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-25T22:24:34.654893] [DEBUG] [LOCAL ] NUW: Derivative data saved (1807 records). [2025-09-25T22:24:34.655976] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-25T22:24:34.659691] [INFO ] [MAIN ] Derivative Progress: 1294/2043 symbols completed. NUW took 1.2s. Estimated remaining: 5m 16s. Rate: 142.3 symbols/min [2025-09-25T22:24:34.660496] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:34.674972] [DEBUG] [MAIN ] NUV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:34.676509] [INFO ] [MAIN ] NUV: Generated 1807 derivative records from 23442 primary records. [2025-09-25T22:24:34.676890] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-25T22:24:34.696090] [DEBUG] [LOCAL ] NUV: Derivative data saved (1807 records). [2025-09-25T22:24:34.696444] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-25T22:24:34.699618] [INFO ] [MAIN ] Derivative Progress: 1295/2043 symbols completed. NUV took 1.3s. Estimated remaining: 5m 15s. Rate: 142.4 symbols/min [2025-09-25T22:24:34.701603] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:34.735967] [DEBUG] [MAIN ] NUVB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:34.737329] [INFO ] [MAIN ] NUVB: Generated 1807 derivative records from 51622 primary records. [2025-09-25T22:24:34.737567] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-25T22:24:34.770945] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1807 records). [2025-09-25T22:24:34.771864] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-25T22:24:34.771746] [DEBUG] [LOCAL ] NVG: Loaded 27503 existing records from primary storage. [2025-09-25T22:24:34.775094] [INFO ] [MAIN ] Derivative Progress: 1296/2043 symbols completed. NUVB took 1.4s. Estimated remaining: 5m 15s. Rate: 142.5 symbols/min [2025-09-25T22:24:34.775672] [INFO ] [MAIN ] NVG: Loaded 27503 primary data records. [2025-09-25T22:24:34.775831] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:34.914704] [DEBUG] [LOCAL ] NVGS: Loaded 31272 existing records from primary storage. [2025-09-25T22:24:34.915108] [INFO ] [MAIN ] NVGS: Loaded 31272 primary data records. [2025-09-25T22:24:35.498632] [DEBUG] [LOCAL ] NVO: Loaded 54174 existing records from primary storage. [2025-09-25T22:24:35.509014] [INFO ] [MAIN ] NVO: Loaded 54174 primary data records. [2025-09-25T22:24:35.939396] [DEBUG] [MAIN ] NVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:35.940608] [INFO ] [MAIN ] NVG: Generated 1807 derivative records from 27503 primary records. [2025-09-25T22:24:35.941275] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-25T22:24:35.976406] [DEBUG] [MAIN ] NVGS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:24:35.979364] [DEBUG] [LOCAL ] NVG: Derivative data saved (1807 records). [2025-09-25T22:24:35.980417] [INFO ] [MAIN ] NVGS: Generated 1806 derivative records from 31272 primary records. [2025-09-25T22:24:35.979513] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-25T22:24:35.983879] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-25T22:24:35.983755] [INFO ] [MAIN ] Derivative Progress: 1297/2043 symbols completed. NVG took 1.3s. Estimated remaining: 5m 15s. Rate: 142.3 symbols/min [2025-09-25T22:24:35.985238] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:36.004452] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1806 records). [2025-09-25T22:24:36.004728] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-25T22:24:36.007948] [INFO ] [MAIN ] Derivative Progress: 1298/2043 symbols completed. NVGS took 1.3s. Estimated remaining: 5m 14s. Rate: 142.4 symbols/min [2025-09-25T22:24:36.008521] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:36.046291] [DEBUG] [MAIN ] NVO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:36.048344] [INFO ] [MAIN ] NVO: Generated 1807 derivative records from 54174 primary records. [2025-09-25T22:24:36.048460] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-25T22:24:36.047236] [DEBUG] [LOCAL ] NVR: Loaded 19212 existing records from primary storage. [2025-09-25T22:24:36.048726] [INFO ] [MAIN ] NVR: Loaded 19212 primary data records. [2025-09-25T22:24:36.130719] [DEBUG] [LOCAL ] NVO: Derivative data saved (1807 records). [2025-09-25T22:24:36.130884] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-25T22:24:36.154410] [INFO ] [MAIN ] Derivative Progress: 1299/2043 symbols completed. NVO took 1.4s. Estimated remaining: 5m 13s. Rate: 142.4 symbols/min [2025-09-25T22:24:36.173003] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:36.230314] [DEBUG] [LOCAL ] NVRI: Loaded 39056 existing records from primary storage. [2025-09-25T22:24:36.241065] [INFO ] [MAIN ] NVRI: Loaded 39056 primary data records. [2025-09-25T22:24:36.825367] [DEBUG] [LOCAL ] NVS: Loaded 51965 existing records from primary storage. [2025-09-25T22:24:36.826731] [INFO ] [MAIN ] NVS: Loaded 51965 primary data records. [2025-09-25T22:24:37.014568] [DEBUG] [MAIN ] NVR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:24:37.025182] [INFO ] [MAIN ] NVR: Generated 1806 derivative records from 19212 primary records. [2025-09-25T22:24:37.044601] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-25T22:24:37.197336] [DEBUG] [MAIN ] NVRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:37.204613] [INFO ] [MAIN ] NVRI: Generated 1807 derivative records from 39056 primary records. [2025-09-25T22:24:37.207972] [DEBUG] [LOCAL ] NVR: Derivative data saved (1806 records). [2025-09-25T22:24:37.208678] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-25T22:24:37.211692] [INFO ] [MAIN ] Derivative Progress: 1300/2043 symbols completed. NVR took 1.2s. Estimated remaining: 5m 13s. Rate: 142.3 symbols/min [2025-09-25T22:24:37.212115] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-25T22:24:37.213464] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:37.231424] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1807 records). [2025-09-25T22:24:37.231584] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-25T22:24:37.234797] [INFO ] [MAIN ] Derivative Progress: 1301/2043 symbols completed. NVRI took 1.2s. Estimated remaining: 5m 13s. Rate: 142.4 symbols/min [2025-09-25T22:24:37.235371] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:37.267131] [DEBUG] [MAIN ] NVS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:37.267972] [INFO ] [MAIN ] NVS: Generated 1807 derivative records from 51965 primary records. [2025-09-25T22:24:37.268132] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-25T22:24:37.286527] [DEBUG] [LOCAL ] NVS: Derivative data saved (1807 records). [2025-09-25T22:24:37.286790] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-25T22:24:37.289406] [INFO ] [MAIN ] Derivative Progress: 1302/2043 symbols completed. NVS took 1.1s. Estimated remaining: 5m 12s. Rate: 142.5 symbols/min [2025-09-25T22:24:37.289877] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:37.361739] [DEBUG] [LOCAL ] NVT: Loaded 51970 existing records from primary storage. [2025-09-25T22:24:37.363401] [DEBUG] [LOCAL ] NVST: Loaded 51987 existing records from primary storage. [2025-09-25T22:24:37.363857] [INFO ] [MAIN ] NVT: Loaded 51970 primary data records. [2025-09-25T22:24:37.363996] [INFO ] [MAIN ] NVST: Loaded 51987 primary data records. [2025-09-25T22:24:37.802730] [DEBUG] [LOCAL ] NWG: Loaded 51950 existing records from primary storage. [2025-09-25T22:24:37.920487] [INFO ] [MAIN ] NWG: Loaded 51950 primary data records. [2025-09-25T22:24:38.448665] [DEBUG] [MAIN ] NVST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:38.451244] [INFO ] [MAIN ] NVST: Generated 1807 derivative records from 51987 primary records. [2025-09-25T22:24:38.451457] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-25T22:24:38.485056] [DEBUG] [MAIN ] NVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:38.486086] [INFO ] [MAIN ] NVT: Generated 1807 derivative records from 51970 primary records. [2025-09-25T22:24:38.486228] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-25T22:24:38.484822] [DEBUG] [LOCAL ] NVST: Derivative data saved (1807 records). [2025-09-25T22:24:38.487444] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-25T22:24:38.490225] [INFO ] [MAIN ] Derivative Progress: 1303/2043 symbols completed. NVST took 1.3s. Estimated remaining: 5m 12s. Rate: 142.3 symbols/min [2025-09-25T22:24:38.507480] [DEBUG] [LOCAL ] NVT: Derivative data saved (1807 records). [2025-09-25T22:24:38.507739] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-25T22:24:38.510727] [INFO ] [MAIN ] Derivative Progress: 1304/2043 symbols completed. NVT took 1.3s. Estimated remaining: 5m 11s. Rate: 142.4 symbols/min [2025-09-25T22:24:38.527972] [DEBUG] [MAIN ] NWG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:38.528795] [INFO ] [MAIN ] NWG: Generated 1807 derivative records from 51950 primary records. [2025-09-25T22:24:38.528861] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-25T22:24:38.545149] [DEBUG] [LOCAL ] NWG: Derivative data saved (1807 records). [2025-09-25T22:24:38.545258] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-25T22:24:38.549023] [INFO ] [MAIN ] Derivative Progress: 1305/2043 symbols completed. NWG took 1.3s. Estimated remaining: 5m 11s. Rate: 142.5 symbols/min [2025-09-25T22:24:38.550156] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:38.550235] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:38.550283] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:38.560341] [DEBUG] [LOCAL ] NXC: Loaded 4285 existing records from primary storage. [2025-09-25T22:24:38.560593] [INFO ] [MAIN ] NXC: Loaded 4285 primary data records. [2025-09-25T22:24:38.929681] [DEBUG] [LOCAL ] NX: Loaded 33642 existing records from primary storage. [2025-09-25T22:24:38.945593] [INFO ] [MAIN ] NX: Loaded 33642 primary data records. [2025-09-25T22:24:38.946302] [DEBUG] [LOCAL ] NWN: Loaded 27059 existing records from primary storage. [2025-09-25T22:24:38.958546] [INFO ] [MAIN ] NWN: Loaded 27059 primary data records. [2025-09-25T22:24:39.623367] [DEBUG] [MAIN ] NXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:39.624602] [INFO ] [MAIN ] NXC: Generated 1807 derivative records from 4285 primary records. [2025-09-25T22:24:39.624843] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-25T22:24:39.645133] [DEBUG] [LOCAL ] NXC: Derivative data saved (1807 records). [2025-09-25T22:24:39.657741] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-25T22:24:39.662267] [DEBUG] [MAIN ] NX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:39.661802] [INFO ] [MAIN ] Derivative Progress: 1306/2043 symbols completed. NXC took 1.1s. Estimated remaining: 5m 11s. Rate: 142.3 symbols/min [2025-09-25T22:24:39.663337] [INFO ] [MAIN ] NX: Generated 1807 derivative records from 33642 primary records. [2025-09-25T22:24:39.664143] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-25T22:24:39.663973] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:39.685617] [DEBUG] [LOCAL ] NX: Derivative data saved (1807 records). [2025-09-25T22:24:39.685906] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-25T22:24:39.688603] [INFO ] [MAIN ] Derivative Progress: 1307/2043 symbols completed. NX took 1.1s. Estimated remaining: 5m 10s. Rate: 142.4 symbols/min [2025-09-25T22:24:39.695013] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:39.711809] [DEBUG] [MAIN ] NWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:39.713209] [INFO ] [MAIN ] NWN: Generated 1807 derivative records from 27059 primary records. [2025-09-25T22:24:39.713314] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-25T22:24:39.738480] [DEBUG] [LOCAL ] NXDT: Loaded 16464 existing records from primary storage. [2025-09-25T22:24:39.741259] [DEBUG] [LOCAL ] NWN: Derivative data saved (1807 records). [2025-09-25T22:24:39.741457] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-25T22:24:39.741566] [INFO ] [MAIN ] NXDT: Loaded 16464 primary data records. [2025-09-25T22:24:39.750069] [INFO ] [MAIN ] Derivative Progress: 1308/2043 symbols completed. NWN took 1.2s. Estimated remaining: 5m 10s. Rate: 142.5 symbols/min [2025-09-25T22:24:39.770163] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:39.980450] [DEBUG] [LOCAL ] NXG: Loaded 10539 existing records from primary storage. [2025-09-25T22:24:40.109598] [INFO ] [MAIN ] NXG: Loaded 10539 primary data records. [2025-09-25T22:24:40.178999] [DEBUG] [LOCAL ] NXE: Loaded 53375 existing records from primary storage. [2025-09-25T22:24:40.223044] [INFO ] [MAIN ] NXE: Loaded 53375 primary data records. [2025-09-25T22:24:40.886843] [DEBUG] [MAIN ] NXDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:40.888933] [INFO ] [MAIN ] NXDT: Generated 1807 derivative records from 16464 primary records. [2025-09-25T22:24:40.890956] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-25T22:24:40.911262] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1807 records). [2025-09-25T22:24:40.911550] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-25T22:24:40.915109] [INFO ] [MAIN ] Derivative Progress: 1309/2043 symbols completed. NXDT took 1.3s. Estimated remaining: 5m 10s. Rate: 142.3 symbols/min [2025-09-25T22:24:40.917078] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:40.936513] [DEBUG] [MAIN ] NXG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:40.937493] [INFO ] [MAIN ] NXG: Generated 1807 derivative records from 10539 primary records. [2025-09-25T22:24:40.937803] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-25T22:24:40.983611] [DEBUG] [LOCAL ] NXJ: Loaded 15011 existing records from primary storage. [2025-09-25T22:24:40.985245] [DEBUG] [LOCAL ] NXG: Derivative data saved (1807 records). [2025-09-25T22:24:40.985973] [DEBUG] [MAIN ] NXE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:40.985585] [INFO ] [MAIN ] NXJ: Loaded 15011 primary data records. [2025-09-25T22:24:40.987078] [INFO ] [MAIN ] NXE: Generated 1807 derivative records from 53375 primary records. [2025-09-25T22:24:40.986093] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-25T22:24:41.008921] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-25T22:24:41.008764] [INFO ] [MAIN ] Derivative Progress: 1310/2043 symbols completed. NXG took 1.2s. Estimated remaining: 5m 9s. Rate: 142.4 symbols/min [2025-09-25T22:24:41.034956] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:41.147947] [DEBUG] [LOCAL ] NXN: Loaded 2368 existing records from primary storage. [2025-09-25T22:24:41.149208] [INFO ] [MAIN ] NXN: Loaded 2368 primary data records. [2025-09-25T22:24:41.469229] [DEBUG] [LOCAL ] NXE: Derivative data saved (1807 records). [2025-09-25T22:24:41.484171] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-25T22:24:41.498423] [INFO ] [MAIN ] Derivative Progress: 1311/2043 symbols completed. NXE took 1.8s. Estimated remaining: 5m 9s. Rate: 142.4 symbols/min [2025-09-25T22:24:41.510301] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:41.720247] [DEBUG] [LOCAL ] NXP: Loaded 12391 existing records from primary storage. [2025-09-25T22:24:41.721224] [INFO ] [MAIN ] NXP: Loaded 12391 primary data records. [2025-09-25T22:24:41.907124] [DEBUG] [MAIN ] NXJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:41.942964] [INFO ] [MAIN ] NXJ: Generated 1807 derivative records from 15011 primary records. [2025-09-25T22:24:41.943426] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-25T22:24:42.104457] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1807 records). [2025-09-25T22:24:42.103405] [DEBUG] [MAIN ] NXN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:42.105982] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-25T22:24:42.109922] [INFO ] [MAIN ] Derivative Progress: 1312/2043 symbols completed. NXJ took 1.2s. Estimated remaining: 5m 8s. Rate: 142.3 symbols/min [2025-09-25T22:24:42.107330] [INFO ] [MAIN ] NXN: Generated 1807 derivative records from 2368 primary records. [2025-09-25T22:24:42.110578] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-25T22:24:42.110905] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:42.128970] [DEBUG] [LOCAL ] NXN: Derivative data saved (1807 records). [2025-09-25T22:24:42.129463] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-25T22:24:42.132099] [INFO ] [MAIN ] Derivative Progress: 1313/2043 symbols completed. NXN took 1.1s. Estimated remaining: 5m 8s. Rate: 142.4 symbols/min [2025-09-25T22:24:42.132631] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:42.157184] [DEBUG] [MAIN ] NXP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:42.164923] [INFO ] [MAIN ] NXP: Generated 1807 derivative records from 12391 primary records. [2025-09-25T22:24:42.165623] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-25T22:24:42.165460] [DEBUG] [LOCAL ] NXRT: Loaded 19162 existing records from primary storage. [2025-09-25T22:24:42.166669] [INFO ] [MAIN ] NXRT: Loaded 19162 primary data records. [2025-09-25T22:24:42.335147] [DEBUG] [LOCAL ] NXP: Derivative data saved (1807 records). [2025-09-25T22:24:42.370712] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-25T22:24:42.399269] [INFO ] [MAIN ] Derivative Progress: 1314/2043 symbols completed. NXP took 0.9s. Estimated remaining: 5m 7s. Rate: 142.5 symbols/min [2025-09-25T22:24:42.400521] [DEBUG] [LOCAL ] NYT: Loaded 50259 existing records from primary storage. [2025-09-25T22:24:42.406925] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:42.406807] [INFO ] [MAIN ] NYT: Loaded 50259 primary data records. [2025-09-25T22:24:42.903557] [DEBUG] [LOCAL ] NZF: Loaded 29224 existing records from primary storage. [2025-09-25T22:24:42.904069] [INFO ] [MAIN ] NZF: Loaded 29224 primary data records. [2025-09-25T22:24:43.128940] [DEBUG] [MAIN ] NXRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:43.252391] [INFO ] [MAIN ] NXRT: Generated 1807 derivative records from 19162 primary records. [2025-09-25T22:24:43.267256] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-25T22:24:43.285521] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1807 records). [2025-09-25T22:24:43.286843] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-25T22:24:43.289382] [INFO ] [MAIN ] Derivative Progress: 1315/2043 symbols completed. NXRT took 1.2s. Estimated remaining: 5m 7s. Rate: 142.3 symbols/min [2025-09-25T22:24:43.290567] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:43.309008] [DEBUG] [MAIN ] NYT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:43.309871] [INFO ] [MAIN ] NYT: Generated 1807 derivative records from 50259 primary records. [2025-09-25T22:24:43.310065] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-25T22:24:43.330611] [DEBUG] [LOCAL ] NYT: Derivative data saved (1807 records). [2025-09-25T22:24:43.331433] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-25T22:24:43.334406] [INFO ] [MAIN ] Derivative Progress: 1316/2043 symbols completed. NYT took 1.2s. Estimated remaining: 5m 6s. Rate: 142.4 symbols/min [2025-09-25T22:24:43.335018] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:43.348396] [DEBUG] [MAIN ] NZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:43.349147] [INFO ] [MAIN ] NZF: Generated 1807 derivative records from 29224 primary records. [2025-09-25T22:24:43.349321] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-25T22:24:43.379804] [DEBUG] [LOCAL ] NZF: Derivative data saved (1807 records). [2025-09-25T22:24:43.379949] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-25T22:24:43.382966] [INFO ] [MAIN ] Derivative Progress: 1317/2043 symbols completed. NZF took 1.0s. Estimated remaining: 5m 6s. Rate: 142.5 symbols/min [2025-09-25T22:24:43.383492] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:43.395987] [DEBUG] [LOCAL ] OBK: Loaded 16432 existing records from primary storage. [2025-09-25T22:24:43.396124] [INFO ] [MAIN ] OBK: Loaded 16432 primary data records. [2025-09-25T22:24:43.520531] [DEBUG] [LOCAL ] OBDC: Loaded 52042 existing records from primary storage. [2025-09-25T22:24:43.524846] [INFO ] [MAIN ] OBDC: Loaded 52042 primary data records. [2025-09-25T22:24:43.982840] [DEBUG] [LOCAL ] OC: Loaded 45024 existing records from primary storage. [2025-09-25T22:24:44.099366] [INFO ] [MAIN ] OC: Loaded 45024 primary data records. [2025-09-25T22:24:44.461048] [DEBUG] [MAIN ] OBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:44.462068] [INFO ] [MAIN ] OBK: Generated 1807 derivative records from 16432 primary records. [2025-09-25T22:24:44.462242] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-25T22:24:44.483970] [DEBUG] [LOCAL ] OBK: Derivative data saved (1807 records). [2025-09-25T22:24:44.497853] [DEBUG] [MAIN ] OBDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:44.497486] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-25T22:24:44.498756] [INFO ] [MAIN ] OBDC: Generated 1807 derivative records from 52042 primary records. [2025-09-25T22:24:44.501392] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-25T22:24:44.501260] [INFO ] [MAIN ] Derivative Progress: 1318/2043 symbols completed. OBK took 1.2s. Estimated remaining: 5m 6s. Rate: 142.3 symbols/min [2025-09-25T22:24:44.519853] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1807 records). [2025-09-25T22:24:44.520079] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-25T22:24:44.522753] [INFO ] [MAIN ] Derivative Progress: 1319/2043 symbols completed. OBDC took 1.2s. Estimated remaining: 5m 5s. Rate: 142.4 symbols/min [2025-09-25T22:24:44.539241] [DEBUG] [MAIN ] OC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:44.540024] [INFO ] [MAIN ] OC: Generated 1807 derivative records from 45024 primary records. [2025-09-25T22:24:44.540088] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-25T22:24:44.555964] [DEBUG] [LOCAL ] OC: Derivative data saved (1807 records). [2025-09-25T22:24:44.556066] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-25T22:24:44.560389] [INFO ] [MAIN ] Derivative Progress: 1320/2043 symbols completed. OC took 1.2s. Estimated remaining: 5m 4s. Rate: 142.5 symbols/min [2025-09-25T22:24:44.560944] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:44.561114] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:44.561249] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:44.577861] [DEBUG] [LOCAL ] OCFT: Loaded 8902 existing records from primary storage. [2025-09-25T22:24:44.578343] [DEBUG] [LOCAL ] ODC: Loaded 8582 existing records from primary storage. [2025-09-25T22:24:44.578457] [INFO ] [MAIN ] OCFT: Loaded 8902 primary data records. [2025-09-25T22:24:44.589820] [INFO ] [MAIN ] ODC: Loaded 8582 primary data records. [2025-09-25T22:24:44.853292] [DEBUG] [LOCAL ] ODV: Loaded 25988 existing records from primary storage. [2025-09-25T22:24:44.939742] [INFO ] [MAIN ] ODV: Loaded 25988 primary data records. [2025-09-25T22:24:45.654956] [DEBUG] [MAIN ] OCFT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:45.655999] [INFO ] [MAIN ] OCFT: Generated 1807 derivative records from 8902 primary records. [2025-09-25T22:24:45.656572] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-25T22:24:45.673057] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1807 records). [2025-09-25T22:24:45.674356] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-25T22:24:45.677884] [INFO ] [MAIN ] Derivative Progress: 1321/2043 symbols completed. OCFT took 1.1s. Estimated remaining: 5m 4s. Rate: 142.4 symbols/min [2025-09-25T22:24:45.679775] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:45.694256] [DEBUG] [MAIN ] ODC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:45.695148] [INFO ] [MAIN ] ODC: Generated 1807 derivative records from 8582 primary records. [2025-09-25T22:24:45.695293] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-25T22:24:45.714739] [DEBUG] [LOCAL ] ODC: Derivative data saved (1807 records). [2025-09-25T22:24:45.728149] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-25T22:24:45.728461] [DEBUG] [MAIN ] ODV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:45.732588] [INFO ] [MAIN ] Derivative Progress: 1322/2043 symbols completed. ODC took 1.2s. Estimated remaining: 5m 4s. Rate: 142.5 symbols/min [2025-09-25T22:24:45.733916] [INFO ] [MAIN ] ODV: Generated 1807 derivative records from 25988 primary records. [2025-09-25T22:24:45.734276] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-25T22:24:45.734326] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:45.761491] [DEBUG] [LOCAL ] ODV: Derivative data saved (1807 records). [2025-09-25T22:24:45.761861] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-25T22:24:45.764875] [INFO ] [MAIN ] Derivative Progress: 1323/2043 symbols completed. ODV took 1.2s. Estimated remaining: 5m 3s. Rate: 142.6 symbols/min [2025-09-25T22:24:45.765349] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:45.781520] [DEBUG] [LOCAL ] OEC: Loaded 37431 existing records from primary storage. [2025-09-25T22:24:45.781817] [INFO ] [MAIN ] OEC: Loaded 37431 primary data records. [2025-09-25T22:24:45.892969] [DEBUG] [LOCAL ] OFG: Loaded 22255 existing records from primary storage. [2025-09-25T22:24:45.899380] [INFO ] [MAIN ] OFG: Loaded 22255 primary data records. [2025-09-25T22:24:46.292483] [DEBUG] [LOCAL ] OGE: Loaded 46726 existing records from primary storage. [2025-09-25T22:24:46.312885] [INFO ] [MAIN ] OGE: Loaded 46726 primary data records. [2025-09-25T22:24:46.960081] [DEBUG] [MAIN ] OEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:46.961935] [INFO ] [MAIN ] OEC: Generated 1807 derivative records from 37431 primary records. [2025-09-25T22:24:46.962424] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-25T22:24:46.997207] [DEBUG] [LOCAL ] OEC: Derivative data saved (1807 records). [2025-09-25T22:24:46.997583] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-25T22:24:47.000399] [INFO ] [MAIN ] Derivative Progress: 1324/2043 symbols completed. OEC took 1.3s. Estimated remaining: 5m 3s. Rate: 142.4 symbols/min [2025-09-25T22:24:47.001045] [DEBUG] [MAIN ] OFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:47.002230] [INFO ] [MAIN ] OFG: Generated 1807 derivative records from 22255 primary records. [2025-09-25T22:24:47.002462] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:47.002704] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-25T22:24:47.022897] [DEBUG] [LOCAL ] OFG: Derivative data saved (1807 records). [2025-09-25T22:24:47.025184] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-25T22:24:47.028217] [INFO ] [MAIN ] Derivative Progress: 1325/2043 symbols completed. OFG took 1.3s. Estimated remaining: 5m 2s. Rate: 142.5 symbols/min [2025-09-25T22:24:47.036703] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:47.042862] [DEBUG] [MAIN ] OGE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:47.043819] [INFO ] [MAIN ] OGE: Generated 1807 derivative records from 46726 primary records. [2025-09-25T22:24:47.044039] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-25T22:24:47.064256] [DEBUG] [LOCAL ] OGE: Derivative data saved (1807 records). [2025-09-25T22:24:47.064530] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-25T22:24:47.068175] [INFO ] [MAIN ] Derivative Progress: 1326/2043 symbols completed. OGE took 1.3s. Estimated remaining: 5m 2s. Rate: 142.5 symbols/min [2025-09-25T22:24:47.068690] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:47.133030] [DEBUG] [LOCAL ] OGN: Loaded 53493 existing records from primary storage. [2025-09-25T22:24:47.133325] [INFO ] [MAIN ] OGN: Loaded 53493 primary data records. [2025-09-25T22:24:47.134214] [DEBUG] [LOCAL ] OGS: Loaded 34239 existing records from primary storage. [2025-09-25T22:24:47.156444] [INFO ] [MAIN ] OGS: Loaded 34239 primary data records. [2025-09-25T22:24:47.570916] [DEBUG] [LOCAL ] OHI: Loaded 52459 existing records from primary storage. [2025-09-25T22:24:47.822541] [INFO ] [MAIN ] OHI: Loaded 52459 primary data records. [2025-09-25T22:24:48.196637] [DEBUG] [MAIN ] OGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:48.197693] [INFO ] [MAIN ] OGS: Generated 1807 derivative records from 34239 primary records. [2025-09-25T22:24:48.197792] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-25T22:24:48.211807] [DEBUG] [MAIN ] OGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:48.213212] [INFO ] [MAIN ] OGN: Generated 1807 derivative records from 53493 primary records. [2025-09-25T22:24:48.213474] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-25T22:24:48.244603] [DEBUG] [LOCAL ] OGS: Derivative data saved (1807 records). [2025-09-25T22:24:48.245187] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-25T22:24:48.248019] [INFO ] [MAIN ] Derivative Progress: 1327/2043 symbols completed. OGS took 1.2s. Estimated remaining: 5m 2s. Rate: 142.4 symbols/min [2025-09-25T22:24:48.249732] [DEBUG] [LOCAL ] OGN: Derivative data saved (1807 records). [2025-09-25T22:24:48.250137] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-25T22:24:48.252719] [INFO ] [MAIN ] Derivative Progress: 1328/2043 symbols completed. OGN took 1.3s. Estimated remaining: 5m 1s. Rate: 142.5 symbols/min [2025-09-25T22:24:48.249815] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:48.253486] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:48.272196] [DEBUG] [MAIN ] OHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:48.273074] [INFO ] [MAIN ] OHI: Generated 1807 derivative records from 52459 primary records. [2025-09-25T22:24:48.277017] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-25T22:24:48.297290] [DEBUG] [LOCAL ] OIA: Loaded 14159 existing records from primary storage. [2025-09-25T22:24:48.300526] [DEBUG] [LOCAL ] OHI: Derivative data saved (1807 records). [2025-09-25T22:24:48.300845] [INFO ] [MAIN ] OIA: Loaded 14159 primary data records. [2025-09-25T22:24:48.312948] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-25T22:24:48.342991] [INFO ] [MAIN ] Derivative Progress: 1329/2043 symbols completed. OHI took 1.3s. Estimated remaining: 5m 1s. Rate: 142.5 symbols/min [2025-09-25T22:24:48.365145] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:48.660633] [DEBUG] [LOCAL ] OI: Loaded 47657 existing records from primary storage. [2025-09-25T22:24:48.672056] [INFO ] [MAIN ] OI: Loaded 47657 primary data records. [2025-09-25T22:24:48.823029] [DEBUG] [LOCAL ] OII: Loaded 43123 existing records from primary storage. [2025-09-25T22:24:48.839348] [INFO ] [MAIN ] OII: Loaded 43123 primary data records. [2025-09-25T22:24:49.286426] [DEBUG] [MAIN ] OIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:49.293447] [INFO ] [MAIN ] OIA: Generated 1807 derivative records from 14159 primary records. [2025-09-25T22:24:49.345061] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-25T22:24:49.512769] [DEBUG] [LOCAL ] OIA: Derivative data saved (1807 records). [2025-09-25T22:24:49.513224] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-25T22:24:49.516528] [INFO ] [MAIN ] Derivative Progress: 1330/2043 symbols completed. OIA took 1.3s. Estimated remaining: 5m 1s. Rate: 142.4 symbols/min [2025-09-25T22:24:49.518119] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:49.543707] [DEBUG] [MAIN ] OI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:49.545032] [INFO ] [MAIN ] OI: Generated 1807 derivative records from 47657 primary records. [2025-09-25T22:24:49.545239] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-25T22:24:49.605921] [DEBUG] [LOCAL ] OIS: Loaded 40891 existing records from primary storage. [2025-09-25T22:24:49.606320] [DEBUG] [LOCAL ] OI: Derivative data saved (1807 records). [2025-09-25T22:24:49.606546] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-25T22:24:49.606428] [INFO ] [MAIN ] OIS: Loaded 40891 primary data records. [2025-09-25T22:24:49.610101] [INFO ] [MAIN ] Derivative Progress: 1331/2043 symbols completed. OI took 1.4s. Estimated remaining: 4m 60s. Rate: 142.4 symbols/min [2025-09-25T22:24:49.610792] [DEBUG] [MAIN ] OII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:49.635957] [INFO ] [MAIN ] OII: Generated 1807 derivative records from 43123 primary records. [2025-09-25T22:24:49.665809] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:49.665955] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-25T22:24:49.955865] [DEBUG] [LOCAL ] OII: Derivative data saved (1807 records). [2025-09-25T22:24:49.956227] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-25T22:24:49.959245] [INFO ] [MAIN ] Derivative Progress: 1332/2043 symbols completed. OII took 1.6s. Estimated remaining: 4m 59s. Rate: 142.5 symbols/min [2025-09-25T22:24:49.959764] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:50.028343] [DEBUG] [LOCAL ] OKE: Loaded 53926 existing records from primary storage. [2025-09-25T22:24:50.029199] [INFO ] [MAIN ] OKE: Loaded 53926 primary data records. [2025-09-25T22:24:50.029133] [DEBUG] [MAIN ] OIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:50.030224] [INFO ] [MAIN ] OIS: Generated 1807 derivative records from 40891 primary records. [2025-09-25T22:24:50.053326] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-25T22:24:50.226702] [DEBUG] [LOCAL ] OIS: Derivative data saved (1807 records). [2025-09-25T22:24:50.257561] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-25T22:24:50.257402] [DEBUG] [LOCAL ] OLN: Loaded 52126 existing records from primary storage. [2025-09-25T22:24:50.257785] [INFO ] [MAIN ] OLN: Loaded 52126 primary data records. [2025-09-25T22:24:50.262582] [INFO ] [MAIN ] Derivative Progress: 1333/2043 symbols completed. OIS took 0.7s. Estimated remaining: 4m 59s. Rate: 142.5 symbols/min [2025-09-25T22:24:50.781233] [DEBUG] [MAIN ] OKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:50.782624] [INFO ] [MAIN ] OKE: Generated 1807 derivative records from 53926 primary records. [2025-09-25T22:24:50.782853] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-25T22:24:50.801379] [DEBUG] [LOCAL ] OKE: Derivative data saved (1807 records). [2025-09-25T22:24:50.801612] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-25T22:24:50.804213] [INFO ] [MAIN ] Derivative Progress: 1334/2043 symbols completed. OKE took 1.2s. Estimated remaining: 4m 59s. Rate: 142.5 symbols/min [2025-09-25T22:24:50.821180] [DEBUG] [MAIN ] OLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:50.822260] [INFO ] [MAIN ] OLN: Generated 1807 derivative records from 52126 primary records. [2025-09-25T22:24:50.822338] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-25T22:24:50.839380] [DEBUG] [LOCAL ] OLN: Derivative data saved (1807 records). [2025-09-25T22:24:50.839551] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-25T22:24:50.843782] [INFO ] [MAIN ] Derivative Progress: 1335/2043 symbols completed. OLN took 0.9s. Estimated remaining: 4m 58s. Rate: 142.6 symbols/min [2025-09-25T22:24:50.844758] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:50.844880] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:50.845259] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:50.859678] [DEBUG] [LOCAL ] OLP: Loaded 9853 existing records from primary storage. [2025-09-25T22:24:50.859851] [INFO ] [MAIN ] OLP: Loaded 9853 primary data records. [2025-09-25T22:24:51.282686] [DEBUG] [LOCAL ] OMF: Loaded 46577 existing records from primary storage. [2025-09-25T22:24:51.285256] [DEBUG] [LOCAL ] OMC: Loaded 53680 existing records from primary storage. [2025-09-25T22:24:51.285852] [INFO ] [MAIN ] OMC: Loaded 53680 primary data records. [2025-09-25T22:24:51.285609] [INFO ] [MAIN ] OMF: Loaded 46577 primary data records. [2025-09-25T22:24:51.984633] [DEBUG] [MAIN ] OLP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:51.986251] [INFO ] [MAIN ] OLP: Generated 1807 derivative records from 9853 primary records. [2025-09-25T22:24:51.986925] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-25T22:24:52.013789] [DEBUG] [LOCAL ] OLP: Derivative data saved (1807 records). [2025-09-25T22:24:52.014888] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-25T22:24:52.019458] [INFO ] [MAIN ] Derivative Progress: 1336/2043 symbols completed. OLP took 1.2s. Estimated remaining: 4m 58s. Rate: 142.4 symbols/min [2025-09-25T22:24:52.033275] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:52.035724] [DEBUG] [MAIN ] OMF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:52.037178] [INFO ] [MAIN ] OMF: Generated 1807 derivative records from 46577 primary records. [2025-09-25T22:24:52.038120] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-25T22:24:52.059303] [DEBUG] [LOCAL ] OMF: Derivative data saved (1807 records). [2025-09-25T22:24:52.072561] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-25T22:24:52.075225] [INFO ] [MAIN ] Derivative Progress: 1337/2043 symbols completed. OMF took 1.2s. Estimated remaining: 4m 57s. Rate: 142.5 symbols/min [2025-09-25T22:24:52.075907] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:52.076239] [DEBUG] [MAIN ] OMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:52.077398] [INFO ] [MAIN ] OMC: Generated 1807 derivative records from 53680 primary records. [2025-09-25T22:24:52.077714] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-25T22:24:52.111588] [DEBUG] [LOCAL ] ONIT: Loaded 7831 existing records from primary storage. [2025-09-25T22:24:52.112858] [INFO ] [MAIN ] ONIT: Loaded 7831 primary data records. [2025-09-25T22:24:52.245194] [DEBUG] [LOCAL ] OMC: Derivative data saved (1807 records). [2025-09-25T22:24:52.244993] [DEBUG] [LOCAL ] OMI: Loaded 46205 existing records from primary storage. [2025-09-25T22:24:52.249579] [INFO ] [MAIN ] OMI: Loaded 46205 primary data records. [2025-09-25T22:24:52.265997] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-25T22:24:52.299221] [INFO ] [MAIN ] Derivative Progress: 1338/2043 symbols completed. OMC took 1.5s. Estimated remaining: 4m 57s. Rate: 142.5 symbols/min [2025-09-25T22:24:52.359330] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:52.822877] [DEBUG] [LOCAL ] ONL: Loaded 31704 existing records from primary storage. [2025-09-25T22:24:52.823090] [INFO ] [MAIN ] ONL: Loaded 31704 primary data records. [2025-09-25T22:24:53.178622] [DEBUG] [MAIN ] ONIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:53.182397] [INFO ] [MAIN ] ONIT: Generated 1807 derivative records from 7831 primary records. [2025-09-25T22:24:53.183269] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-25T22:24:53.214130] [DEBUG] [MAIN ] OMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:53.217528] [INFO ] [MAIN ] OMI: Generated 1807 derivative records from 46205 primary records. [2025-09-25T22:24:53.217636] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-25T22:24:53.218938] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1807 records). [2025-09-25T22:24:53.221064] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-25T22:24:53.231082] [INFO ] [MAIN ] Derivative Progress: 1339/2043 symbols completed. ONIT took 1.2s. Estimated remaining: 4m 57s. Rate: 142.4 symbols/min [2025-09-25T22:24:53.236472] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:53.243218] [DEBUG] [LOCAL ] OMI: Derivative data saved (1807 records). [2025-09-25T22:24:53.243504] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-25T22:24:53.246745] [INFO ] [MAIN ] Derivative Progress: 1340/2043 symbols completed. OMI took 1.2s. Estimated remaining: 4m 56s. Rate: 142.5 symbols/min [2025-09-25T22:24:53.247238] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:53.264972] [DEBUG] [MAIN ] ONL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:53.265892] [INFO ] [MAIN ] ONL: Generated 1807 derivative records from 31704 primary records. [2025-09-25T22:24:53.266027] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-25T22:24:53.315278] [DEBUG] [LOCAL ] ONL: Derivative data saved (1807 records). [2025-09-25T22:24:53.316135] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-25T22:24:53.316028] [DEBUG] [LOCAL ] ONTF: Loaded 23075 existing records from primary storage. [2025-09-25T22:24:53.319110] [INFO ] [MAIN ] Derivative Progress: 1341/2043 symbols completed. ONL took 1.0s. Estimated remaining: 4m 55s. Rate: 142.6 symbols/min [2025-09-25T22:24:53.319764] [INFO ] [MAIN ] ONTF: Loaded 23075 primary data records. [2025-09-25T22:24:53.319524] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:53.438401] [DEBUG] [LOCAL ] ONON: Loaded 54002 existing records from primary storage. [2025-09-25T22:24:53.450556] [INFO ] [MAIN ] ONON: Loaded 54002 primary data records. [2025-09-25T22:24:53.921889] [DEBUG] [LOCAL ] ONTO: Loaded 46992 existing records from primary storage. [2025-09-25T22:24:53.940094] [INFO ] [MAIN ] ONTO: Loaded 46992 primary data records. [2025-09-25T22:24:54.480894] [DEBUG] [MAIN ] ONTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:54.482824] [INFO ] [MAIN ] ONTF: Generated 1807 derivative records from 23075 primary records. [2025-09-25T22:24:54.485327] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-25T22:24:54.505753] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1807 records). [2025-09-25T22:24:54.506841] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-25T22:24:54.509545] [INFO ] [MAIN ] Derivative Progress: 1342/2043 symbols completed. ONTF took 1.3s. Estimated remaining: 4m 55s. Rate: 142.4 symbols/min [2025-09-25T22:24:54.510182] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:54.524728] [DEBUG] [MAIN ] ONON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:54.526110] [INFO ] [MAIN ] ONON: Generated 1807 derivative records from 54002 primary records. [2025-09-25T22:24:54.526325] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-25T22:24:54.560090] [DEBUG] [LOCAL ] ONON: Derivative data saved (1807 records). [2025-09-25T22:24:54.565758] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-25T22:24:54.568766] [INFO ] [MAIN ] Derivative Progress: 1343/2043 symbols completed. ONON took 1.3s. Estimated remaining: 4m 55s. Rate: 142.5 symbols/min [2025-09-25T22:24:54.565615] [DEBUG] [MAIN ] ONTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:54.569235] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:54.570211] [INFO ] [MAIN ] ONTO: Generated 1807 derivative records from 46992 primary records. [2025-09-25T22:24:54.570887] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-25T22:24:54.587104] [DEBUG] [LOCAL ] OOMA: Loaded 19157 existing records from primary storage. [2025-09-25T22:24:54.591025] [INFO ] [MAIN ] OOMA: Loaded 19157 primary data records. [2025-09-25T22:24:54.703572] [DEBUG] [LOCAL ] OPAD: Loaded 20422 existing records from primary storage. [2025-09-25T22:24:54.720027] [INFO ] [MAIN ] OPAD: Loaded 20422 primary data records. [2025-09-25T22:24:54.724868] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1807 records). [2025-09-25T22:24:54.740922] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-25T22:24:54.789885] [INFO ] [MAIN ] Derivative Progress: 1344/2043 symbols completed. ONTO took 1.5s. Estimated remaining: 4m 54s. Rate: 142.5 symbols/min [2025-09-25T22:24:55.022482] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:55.305670] [DEBUG] [MAIN ] OOMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:55.306606] [INFO ] [MAIN ] OOMA: Generated 1807 derivative records from 19157 primary records. [2025-09-25T22:24:55.307100] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-25T22:24:55.359380] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1807 records). [2025-09-25T22:24:55.359962] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-25T22:24:55.359777] [DEBUG] [MAIN ] OPAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:55.361007] [INFO ] [MAIN ] OPAD: Generated 1807 derivative records from 20422 primary records. [2025-09-25T22:24:55.363560] [INFO ] [MAIN ] Derivative Progress: 1345/2043 symbols completed. OOMA took 0.9s. Estimated remaining: 4m 54s. Rate: 142.5 symbols/min [2025-09-25T22:24:55.358541] [DEBUG] [LOCAL ] OPFI: Loaded 46918 existing records from primary storage. [2025-09-25T22:24:55.364168] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-25T22:24:55.363887] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:55.365472] [INFO ] [MAIN ] OPFI: Loaded 46918 primary data records. [2025-09-25T22:24:55.420778] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1807 records). [2025-09-25T22:24:55.428280] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-25T22:24:55.431184] [INFO ] [MAIN ] Derivative Progress: 1346/2043 symbols completed. OPAD took 0.9s. Estimated remaining: 4m 53s. Rate: 142.6 symbols/min [2025-09-25T22:24:55.443755] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:55.535116] [DEBUG] [LOCAL ] OPP: Loaded 11630 existing records from primary storage. [2025-09-25T22:24:55.588799] [INFO ] [MAIN ] OPP: Loaded 11630 primary data records. [2025-09-25T22:24:55.943344] [DEBUG] [LOCAL ] OR: Loaded 46423 existing records from primary storage. [2025-09-25T22:24:55.963266] [INFO ] [MAIN ] OR: Loaded 46423 primary data records. [2025-09-25T22:24:56.465060] [DEBUG] [MAIN ] OPFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:56.466360] [INFO ] [MAIN ] OPFI: Generated 1807 derivative records from 46918 primary records. [2025-09-25T22:24:56.466981] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-25T22:24:56.487764] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1807 records). [2025-09-25T22:24:56.488056] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-25T22:24:56.493346] [INFO ] [MAIN ] Derivative Progress: 1347/2043 symbols completed. OPFI took 1.6s. Estimated remaining: 4m 53s. Rate: 142.4 symbols/min [2025-09-25T22:24:56.494808] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:56.508981] [DEBUG] [MAIN ] OPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:56.512236] [INFO ] [MAIN ] OPP: Generated 1807 derivative records from 11630 primary records. [2025-09-25T22:24:56.512772] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-25T22:24:56.530845] [DEBUG] [LOCAL ] OPP: Derivative data saved (1807 records). [2025-09-25T22:24:56.531155] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-25T22:24:56.533788] [INFO ] [MAIN ] Derivative Progress: 1348/2043 symbols completed. OPP took 1.2s. Estimated remaining: 4m 53s. Rate: 142.5 symbols/min [2025-09-25T22:24:56.554191] [DEBUG] [MAIN ] OR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:56.555534] [INFO ] [MAIN ] OR: Generated 1807 derivative records from 46423 primary records. [2025-09-25T22:24:56.555671] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-25T22:24:56.582892] [DEBUG] [LOCAL ] OR: Derivative data saved (1807 records). [2025-09-25T22:24:56.591996] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-25T22:24:56.596221] [INFO ] [MAIN ] Derivative Progress: 1349/2043 symbols completed. OR took 1.2s. Estimated remaining: 4m 52s. Rate: 142.6 symbols/min [2025-09-25T22:24:56.597374] [DEBUG] [LOCAL ] ORA: Loaded 32800 existing records from primary storage. [2025-09-25T22:24:56.597559] [INFO ] [MAIN ] ORA: Loaded 32800 primary data records. [2025-09-25T22:24:56.927856] [DEBUG] [MAIN ] ORA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:56.928613] [INFO ] [MAIN ] ORA: Generated 1807 derivative records from 32800 primary records. [2025-09-25T22:24:56.928706] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-25T22:24:56.944248] [DEBUG] [LOCAL ] ORA: Derivative data saved (1807 records). [2025-09-25T22:24:56.944333] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-25T22:24:56.946671] [INFO ] [MAIN ] Derivative Progress: 1350/2043 symbols completed. ORA took 0.5s. Estimated remaining: 4m 52s. Rate: 142.6 symbols/min [2025-09-25T22:24:56.947635] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:56.947865] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:56.948089] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:57.021259] [DEBUG] [LOCAL ] ORN: Loaded 31831 existing records from primary storage. [2025-09-25T22:24:57.021503] [INFO ] [MAIN ] ORN: Loaded 31831 primary data records. [2025-09-25T22:24:57.035402] [DEBUG] [LOCAL ] ORC: Loaded 52702 existing records from primary storage. [2025-09-25T22:24:57.046496] [INFO ] [MAIN ] ORC: Loaded 52702 primary data records. [2025-09-25T22:24:57.311220] [DEBUG] [LOCAL ] OSCR: Loaded 54112 existing records from primary storage. [2025-09-25T22:24:57.346594] [INFO ] [MAIN ] OSCR: Loaded 54112 primary data records. [2025-09-25T22:24:58.143041] [DEBUG] [MAIN ] ORN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:58.145044] [INFO ] [MAIN ] ORN: Generated 1807 derivative records from 31831 primary records. [2025-09-25T22:24:58.145597] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-25T22:24:58.167879] [DEBUG] [MAIN ] ORC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:58.174137] [INFO ] [MAIN ] ORC: Generated 1807 derivative records from 52702 primary records. [2025-09-25T22:24:58.176040] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-25T22:24:58.205871] [DEBUG] [LOCAL ] ORN: Derivative data saved (1807 records). [2025-09-25T22:24:58.205790] [DEBUG] [MAIN ] OSCR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:58.207775] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-25T22:24:58.211782] [INFO ] [MAIN ] Derivative Progress: 1351/2043 symbols completed. ORN took 1.3s. Estimated remaining: 4m 52s. Rate: 142.4 symbols/min [2025-09-25T22:24:58.208613] [INFO ] [MAIN ] OSCR: Generated 1807 derivative records from 54112 primary records. [2025-09-25T22:24:58.211951] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-25T22:24:58.212209] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:58.214086] [DEBUG] [LOCAL ] ORC: Derivative data saved (1807 records). [2025-09-25T22:24:58.214471] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-25T22:24:58.217692] [INFO ] [MAIN ] Derivative Progress: 1352/2043 symbols completed. ORC took 1.3s. Estimated remaining: 4m 51s. Rate: 142.5 symbols/min [2025-09-25T22:24:58.225750] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:58.234862] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1807 records). [2025-09-25T22:24:58.235113] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-25T22:24:58.238022] [INFO ] [MAIN ] Derivative Progress: 1353/2043 symbols completed. OSCR took 1.3s. Estimated remaining: 4m 50s. Rate: 142.6 symbols/min [2025-09-25T22:24:58.238739] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:58.340628] [DEBUG] [LOCAL ] OTIS: Loaded 53093 existing records from primary storage. [2025-09-25T22:24:58.340960] [INFO ] [MAIN ] OTIS: Loaded 53093 primary data records. [2025-09-25T22:24:58.341873] [DEBUG] [LOCAL ] OVV: Loaded 53905 existing records from primary storage. [2025-09-25T22:24:58.342024] [INFO ] [MAIN ] OVV: Loaded 53905 primary data records. [2025-09-25T22:24:58.505307] [DEBUG] [LOCAL ] OUT: Loaded 48342 existing records from primary storage. [2025-09-25T22:24:58.518105] [INFO ] [MAIN ] OUT: Loaded 48342 primary data records. [2025-09-25T22:24:59.410075] [DEBUG] [MAIN ] OVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:59.412098] [DEBUG] [MAIN ] OTIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:59.413254] [INFO ] [MAIN ] OVV: Generated 1807 derivative records from 53905 primary records. [2025-09-25T22:24:59.414239] [INFO ] [MAIN ] OTIS: Generated 1807 derivative records from 53093 primary records. [2025-09-25T22:24:59.414394] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-25T22:24:59.414546] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-25T22:24:59.446515] [DEBUG] [MAIN ] OUT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:24:59.451931] [INFO ] [MAIN ] OUT: Generated 1807 derivative records from 48342 primary records. [2025-09-25T22:24:59.452679] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-25T22:24:59.471245] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1807 records). [2025-09-25T22:24:59.472136] [DEBUG] [LOCAL ] OVV: Derivative data saved (1807 records). [2025-09-25T22:24:59.472238] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-25T22:24:59.475812] [INFO ] [MAIN ] Derivative Progress: 1354/2043 symbols completed. OTIS took 1.3s. Estimated remaining: 4m 50s. Rate: 142.4 symbols/min [2025-09-25T22:24:59.473802] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-25T22:24:59.482273] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:59.482069] [INFO ] [MAIN ] Derivative Progress: 1355/2043 symbols completed. OVV took 1.2s. Estimated remaining: 4m 50s. Rate: 142.5 symbols/min [2025-09-25T22:24:59.487762] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:59.489145] [DEBUG] [LOCAL ] OUT: Derivative data saved (1807 records). [2025-09-25T22:24:59.490154] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-25T22:24:59.493028] [INFO ] [MAIN ] Derivative Progress: 1356/2043 symbols completed. OUT took 1.3s. Estimated remaining: 4m 49s. Rate: 142.6 symbols/min [2025-09-25T22:24:59.493550] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:24:59.505710] [DEBUG] [LOCAL ] OWLT: Loaded 9023 existing records from primary storage. [2025-09-25T22:24:59.505882] [INFO ] [MAIN ] OWLT: Loaded 9023 primary data records. [2025-09-25T22:24:59.869868] [DEBUG] [LOCAL ] OWL: Loaded 53945 existing records from primary storage. [2025-09-25T22:24:59.870850] [INFO ] [MAIN ] OWL: Loaded 53945 primary data records. [2025-09-25T22:24:59.962046] [DEBUG] [LOCAL ] PAAS: Loaded 53993 existing records from primary storage. [2025-09-25T22:24:59.989277] [INFO ] [MAIN ] PAAS: Loaded 53993 primary data records. [2025-09-25T22:25:00.636937] [DEBUG] [MAIN ] OWLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:00.638532] [INFO ] [MAIN ] OWLT: Generated 1807 derivative records from 9023 primary records. [2025-09-25T22:25:00.638618] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-25T22:25:00.660807] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1807 records). [2025-09-25T22:25:00.661200] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-25T22:25:00.663667] [INFO ] [MAIN ] Derivative Progress: 1357/2043 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 49s. Rate: 142.4 symbols/min [2025-09-25T22:25:00.665183] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:00.690618] [DEBUG] [MAIN ] OWL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:00.691988] [INFO ] [MAIN ] OWL: Generated 1807 derivative records from 53945 primary records. [2025-09-25T22:25:00.696967] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-25T22:25:00.697244] [DEBUG] [LOCAL ] PAC: Loaded 11651 existing records from primary storage. [2025-09-25T22:25:00.698585] [INFO ] [MAIN ] PAC: Loaded 11651 primary data records. [2025-09-25T22:25:00.794386] [DEBUG] [LOCAL ] OWL: Derivative data saved (1807 records). [2025-09-25T22:25:00.801776] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-25T22:25:00.814982] [INFO ] [MAIN ] Derivative Progress: 1358/2043 symbols completed. OWL took 1.3s. Estimated remaining: 4m 48s. Rate: 142.5 symbols/min [2025-09-25T22:25:00.851198] [DEBUG] [MAIN ] PAAS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:00.850842] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:00.852527] [INFO ] [MAIN ] PAAS: Generated 1807 derivative records from 53993 primary records. [2025-09-25T22:25:00.857936] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-25T22:25:01.021775] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1807 records). [2025-09-25T22:25:01.051743] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-25T22:25:01.086242] [INFO ] [MAIN ] Derivative Progress: 1359/2043 symbols completed. PAAS took 1.6s. Estimated remaining: 4m 48s. Rate: 142.5 symbols/min [2025-09-25T22:25:01.087073] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:01.116752] [DEBUG] [LOCAL ] PACK: Loaded 32207 existing records from primary storage. [2025-09-25T22:25:01.117385] [INFO ] [MAIN ] PACK: Loaded 32207 primary data records. [2025-09-25T22:25:01.269485] [DEBUG] [LOCAL ] PACS: Loaded 34425 existing records from primary storage. [2025-09-25T22:25:01.270252] [INFO ] [MAIN ] PACS: Loaded 34425 primary data records. [2025-09-25T22:25:01.307012] [DEBUG] [MAIN ] PAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:01.379582] [INFO ] [MAIN ] PAC: Generated 1807 derivative records from 11651 primary records. [2025-09-25T22:25:01.599749] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-25T22:25:01.848752] [DEBUG] [LOCAL ] PAC: Derivative data saved (1807 records). [2025-09-25T22:25:01.849082] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-25T22:25:01.851595] [INFO ] [MAIN ] Derivative Progress: 1360/2043 symbols completed. PAC took 1.2s. Estimated remaining: 4m 48s. Rate: 142.4 symbols/min [2025-09-25T22:25:01.853128] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:01.886111] [DEBUG] [MAIN ] PACK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:01.887979] [INFO ] [MAIN ] PACK: Generated 1807 derivative records from 32207 primary records. [2025-09-25T22:25:01.888403] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-25T22:25:01.898393] [DEBUG] [LOCAL ] PAG: Loaded 22087 existing records from primary storage. [2025-09-25T22:25:01.911550] [INFO ] [MAIN ] PAG: Loaded 22087 primary data records. [2025-09-25T22:25:01.916799] [DEBUG] [LOCAL ] PACK: Derivative data saved (1807 records). [2025-09-25T22:25:01.929117] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-25T22:25:01.972896] [INFO ] [MAIN ] Derivative Progress: 1361/2043 symbols completed. PACK took 1.1s. Estimated remaining: 4m 47s. Rate: 142.5 symbols/min [2025-09-25T22:25:02.029871] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:02.024397] [DEBUG] [MAIN ] PACS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:02.051732] [INFO ] [MAIN ] PACS: Generated 1807 derivative records from 34425 primary records. [2025-09-25T22:25:02.051959] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-25T22:25:02.157984] [DEBUG] [LOCAL ] PACS: Derivative data saved (1807 records). [2025-09-25T22:25:02.326951] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-25T22:25:02.345948] [INFO ] [MAIN ] Derivative Progress: 1362/2043 symbols completed. PACS took 1.3s. Estimated remaining: 4m 47s. Rate: 142.5 symbols/min [2025-09-25T22:25:02.346699] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:02.355106] [DEBUG] [LOCAL ] PAI: Loaded 2741 existing records from primary storage. [2025-09-25T22:25:02.355566] [INFO ] [MAIN ] PAI: Loaded 2741 primary data records. [2025-09-25T22:25:02.546688] [DEBUG] [LOCAL ] PAGS: Loaded 53058 existing records from primary storage. [2025-09-25T22:25:02.567967] [INFO ] [MAIN ] PAGS: Loaded 53058 primary data records. [2025-09-25T22:25:02.976012] [DEBUG] [MAIN ] PAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:02.977480] [INFO ] [MAIN ] PAG: Generated 1807 derivative records from 22087 primary records. [2025-09-25T22:25:02.977738] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-25T22:25:03.122618] [DEBUG] [LOCAL ] PAG: Derivative data saved (1807 records). [2025-09-25T22:25:03.123273] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-25T22:25:03.126797] [INFO ] [MAIN ] Derivative Progress: 1363/2043 symbols completed. PAG took 1.3s. Estimated remaining: 4m 46s. Rate: 142.4 symbols/min [2025-09-25T22:25:03.145900] [DEBUG] [MAIN ] PAI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:03.147549] [INFO ] [MAIN ] PAI: Generated 1807 derivative records from 2741 primary records. [2025-09-25T22:25:03.148035] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-25T22:25:03.164385] [DEBUG] [LOCAL ] PAI: Derivative data saved (1807 records). [2025-09-25T22:25:03.164516] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-25T22:25:03.167003] [INFO ] [MAIN ] Derivative Progress: 1364/2043 symbols completed. PAI took 0.8s. Estimated remaining: 4m 46s. Rate: 142.5 symbols/min [2025-09-25T22:25:03.185780] [DEBUG] [MAIN ] PAGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:03.186612] [INFO ] [MAIN ] PAGS: Generated 1807 derivative records from 53058 primary records. [2025-09-25T22:25:03.186702] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-25T22:25:03.202575] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1807 records). [2025-09-25T22:25:03.202725] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-25T22:25:03.205315] [INFO ] [MAIN ] Derivative Progress: 1365/2043 symbols completed. PAGS took 1.2s. Estimated remaining: 4m 45s. Rate: 142.6 symbols/min [2025-09-25T22:25:03.206364] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:03.206746] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:03.206506] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:03.248628] [DEBUG] [LOCAL ] PAM: Loaded 28151 existing records from primary storage. [2025-09-25T22:25:03.249825] [INFO ] [MAIN ] PAM: Loaded 28151 primary data records. [2025-09-25T22:25:03.332686] [DEBUG] [LOCAL ] PAR: Loaded 32920 existing records from primary storage. [2025-09-25T22:25:03.347494] [INFO ] [MAIN ] PAR: Loaded 32920 primary data records. [2025-09-25T22:25:03.441726] [DEBUG] [LOCAL ] PARR: Loaded 48708 existing records from primary storage. [2025-09-25T22:25:03.470405] [INFO ] [MAIN ] PARR: Loaded 48708 primary data records. [2025-09-25T22:25:04.428183] [DEBUG] [MAIN ] PAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:04.429931] [INFO ] [MAIN ] PAR: Generated 1807 derivative records from 32920 primary records. [2025-09-25T22:25:04.427898] [DEBUG] [MAIN ] PAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:04.430627] [INFO ] [MAIN ] PAM: Generated 1807 derivative records from 28151 primary records. [2025-09-25T22:25:04.431516] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-25T22:25:04.433067] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-25T22:25:04.474495] [DEBUG] [LOCAL ] PAM: Derivative data saved (1807 records). [2025-09-25T22:25:04.473507] [DEBUG] [MAIN ] PARR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:04.474872] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-25T22:25:04.477694] [INFO ] [MAIN ] Derivative Progress: 1366/2043 symbols completed. PAM took 1.3s. Estimated remaining: 4m 45s. Rate: 142.4 symbols/min [2025-09-25T22:25:04.478937] [INFO ] [MAIN ] PARR: Generated 1807 derivative records from 48708 primary records. [2025-09-25T22:25:04.479043] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-25T22:25:04.479297] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:04.499129] [DEBUG] [LOCAL ] PARR: Derivative data saved (1807 records). [2025-09-25T22:25:04.500019] [DEBUG] [LOCAL ] PAR: Derivative data saved (1807 records). [2025-09-25T22:25:04.500113] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-25T22:25:04.500206] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-25T22:25:04.503428] [INFO ] [MAIN ] Derivative Progress: 1367/2043 symbols completed. PARR took 1.3s. Estimated remaining: 4m 45s. Rate: 142.5 symbols/min [2025-09-25T22:25:04.506739] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:04.506822] [INFO ] [MAIN ] Derivative Progress: 1368/2043 symbols completed. PAR took 1.3s. Estimated remaining: 4m 44s. Rate: 142.6 symbols/min [2025-09-25T22:25:04.507203] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:04.533857] [DEBUG] [LOCAL ] PAXS: Loaded 21098 existing records from primary storage. [2025-09-25T22:25:04.547426] [INFO ] [MAIN ] PAXS: Loaded 21098 primary data records. [2025-09-25T22:25:04.691261] [DEBUG] [LOCAL ] PATH: Loaded 54067 existing records from primary storage. [2025-09-25T22:25:04.754150] [INFO ] [MAIN ] PATH: Loaded 54067 primary data records. [2025-09-25T22:25:04.745023] [DEBUG] [LOCAL ] PAY: Loaded 38647 existing records from primary storage. [2025-09-25T22:25:04.786925] [INFO ] [MAIN ] PAY: Loaded 38647 primary data records. [2025-09-25T22:25:05.611497] [DEBUG] [MAIN ] PAXS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:05.612744] [INFO ] [MAIN ] PAXS: Generated 1807 derivative records from 21098 primary records. [2025-09-25T22:25:05.612990] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-25T22:25:05.633768] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1807 records). [2025-09-25T22:25:05.635277] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-25T22:25:05.639257] [INFO ] [MAIN ] Derivative Progress: 1369/2043 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 44s. Rate: 142.4 symbols/min [2025-09-25T22:25:05.640207] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:05.656245] [DEBUG] [MAIN ] PATH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:05.657482] [INFO ] [MAIN ] PATH: Generated 1807 derivative records from 54067 primary records. [2025-09-25T22:25:05.657777] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-25T22:25:05.692569] [DEBUG] [MAIN ] PAY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:05.694872] [INFO ] [MAIN ] PAY: Generated 1807 derivative records from 38647 primary records. [2025-09-25T22:25:05.695798] [DEBUG] [LOCAL ] PATH: Derivative data saved (1807 records). [2025-09-25T22:25:05.695859] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-25T22:25:05.696619] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-25T22:25:05.699849] [INFO ] [MAIN ] Derivative Progress: 1370/2043 symbols completed. PATH took 1.2s. Estimated remaining: 4m 43s. Rate: 142.5 symbols/min [2025-09-25T22:25:05.700603] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:05.726422] [DEBUG] [LOCAL ] PAY: Derivative data saved (1807 records). [2025-09-25T22:25:05.726697] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-25T22:25:05.729508] [INFO ] [MAIN ] Derivative Progress: 1371/2043 symbols completed. PAY took 1.2s. Estimated remaining: 4m 43s. Rate: 142.6 symbols/min [2025-09-25T22:25:05.729981] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:05.744699] [DEBUG] [LOCAL ] PAYC: Loaded 36598 existing records from primary storage. [2025-09-25T22:25:05.744916] [INFO ] [MAIN ] PAYC: Loaded 36598 primary data records. [2025-09-25T22:25:06.121054] [DEBUG] [LOCAL ] PB: Loaded 41683 existing records from primary storage. [2025-09-25T22:25:06.131869] [INFO ] [MAIN ] PB: Loaded 41683 primary data records. [2025-09-25T22:25:06.185077] [DEBUG] [LOCAL ] PBA: Loaded 49297 existing records from primary storage. [2025-09-25T22:25:06.211983] [INFO ] [MAIN ] PBA: Loaded 49297 primary data records. [2025-09-25T22:25:06.877830] [DEBUG] [MAIN ] PAYC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:06.880446] [INFO ] [MAIN ] PAYC: Generated 1807 derivative records from 36598 primary records. [2025-09-25T22:25:06.881452] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-25T22:25:06.901013] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1807 records). [2025-09-25T22:25:06.901506] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-25T22:25:06.904676] [INFO ] [MAIN ] Derivative Progress: 1372/2043 symbols completed. PAYC took 1.3s. Estimated remaining: 4m 43s. Rate: 142.4 symbols/min [2025-09-25T22:25:06.905179] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:06.924226] [DEBUG] [MAIN ] PB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:06.925082] [INFO ] [MAIN ] PB: Generated 1807 derivative records from 41683 primary records. [2025-09-25T22:25:06.925212] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-25T22:25:06.958588] [DEBUG] [LOCAL ] PB: Derivative data saved (1807 records). [2025-09-25T22:25:06.959186] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-25T22:25:06.958919] [DEBUG] [MAIN ] PBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:06.962802] [INFO ] [MAIN ] PBA: Generated 1807 derivative records from 49297 primary records. [2025-09-25T22:25:06.963002] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-25T22:25:06.961591] [INFO ] [MAIN ] Derivative Progress: 1373/2043 symbols completed. PB took 1.3s. Estimated remaining: 4m 42s. Rate: 142.5 symbols/min [2025-09-25T22:25:06.964315] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:06.983962] [DEBUG] [LOCAL ] PBA: Derivative data saved (1807 records). [2025-09-25T22:25:06.984256] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-25T22:25:06.987230] [INFO ] [MAIN ] Derivative Progress: 1374/2043 symbols completed. PBA took 1.3s. Estimated remaining: 4m 41s. Rate: 142.6 symbols/min [2025-09-25T22:25:06.987863] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:07.045356] [DEBUG] [LOCAL ] PBH: Loaded 31888 existing records from primary storage. [2025-09-25T22:25:07.045631] [INFO ] [MAIN ] PBH: Loaded 31888 primary data records. [2025-09-25T22:25:07.058695] [DEBUG] [LOCAL ] PBF: Loaded 53478 existing records from primary storage. [2025-09-25T22:25:07.084432] [INFO ] [MAIN ] PBF: Loaded 53478 primary data records. [2025-09-25T22:25:07.734988] [DEBUG] [LOCAL ] PBI: Loaded 50410 existing records from primary storage. [2025-09-25T22:25:07.735332] [INFO ] [MAIN ] PBI: Loaded 50410 primary data records. [2025-09-25T22:25:08.089928] [DEBUG] [MAIN ] PBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:08.091158] [INFO ] [MAIN ] PBH: Generated 1807 derivative records from 31888 primary records. [2025-09-25T22:25:08.091262] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-25T22:25:08.112051] [DEBUG] [LOCAL ] PBH: Derivative data saved (1807 records). [2025-09-25T22:25:08.126322] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-25T22:25:08.129492] [DEBUG] [MAIN ] PBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:08.129052] [INFO ] [MAIN ] Derivative Progress: 1375/2043 symbols completed. PBH took 1.2s. Estimated remaining: 4m 41s. Rate: 142.4 symbols/min [2025-09-25T22:25:08.129844] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:08.130974] [INFO ] [MAIN ] PBF: Generated 1807 derivative records from 53478 primary records. [2025-09-25T22:25:08.131225] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-25T22:25:08.150587] [DEBUG] [LOCAL ] PBF: Derivative data saved (1807 records). [2025-09-25T22:25:08.150848] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-25T22:25:08.154446] [INFO ] [MAIN ] Derivative Progress: 1376/2043 symbols completed. PBF took 1.2s. Estimated remaining: 4m 41s. Rate: 142.5 symbols/min [2025-09-25T22:25:08.155631] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:08.175160] [DEBUG] [MAIN ] PBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:08.176313] [INFO ] [MAIN ] PBI: Generated 1807 derivative records from 50410 primary records. [2025-09-25T22:25:08.176440] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-25T22:25:08.205010] [DEBUG] [LOCAL ] PBT: Loaded 17462 existing records from primary storage. [2025-09-25T22:25:08.206023] [INFO ] [MAIN ] PBT: Loaded 17462 primary data records. [2025-09-25T22:25:08.306670] [DEBUG] [LOCAL ] PBI: Derivative data saved (1807 records). [2025-09-25T22:25:08.333466] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-25T22:25:08.354891] [INFO ] [MAIN ] Derivative Progress: 1377/2043 symbols completed. PBI took 1.4s. Estimated remaining: 4m 40s. Rate: 142.6 symbols/min [2025-09-25T22:25:08.373793] [DEBUG] [LOCAL ] PBR: Loaded 54103 existing records from primary storage. [2025-09-25T22:25:08.384451] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:08.399206] [INFO ] [MAIN ] PBR: Loaded 54103 primary data records. [2025-09-25T22:25:08.695175] [DEBUG] [LOCAL ] PCF: Loaded 8669 existing records from primary storage. [2025-09-25T22:25:08.731917] [INFO ] [MAIN ] PCF: Loaded 8669 primary data records. [2025-09-25T22:25:09.328969] [DEBUG] [MAIN ] PBT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:09.331398] [INFO ] [MAIN ] PBT: Generated 1807 derivative records from 17462 primary records. [2025-09-25T22:25:09.332614] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-25T22:25:09.360754] [DEBUG] [MAIN ] PBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:09.367056] [DEBUG] [LOCAL ] PBT: Derivative data saved (1807 records). [2025-09-25T22:25:09.367967] [INFO ] [MAIN ] PBR: Generated 1807 derivative records from 54103 primary records. [2025-09-25T22:25:09.368405] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-25T22:25:09.368683] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-25T22:25:09.371017] [INFO ] [MAIN ] Derivative Progress: 1378/2043 symbols completed. PBT took 1.2s. Estimated remaining: 4m 40s. Rate: 142.4 symbols/min [2025-09-25T22:25:09.407735] [DEBUG] [LOCAL ] PBR: Derivative data saved (1807 records). [2025-09-25T22:25:09.408120] [DEBUG] [MAIN ] PCF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:09.408376] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-25T22:25:09.409244] [INFO ] [MAIN ] PCF: Generated 1807 derivative records from 8669 primary records. [2025-09-25T22:25:09.412692] [INFO ] [MAIN ] Derivative Progress: 1379/2043 symbols completed. PBR took 1.3s. Estimated remaining: 4m 40s. Rate: 142.5 symbols/min [2025-09-25T22:25:09.412934] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-25T22:25:09.428662] [DEBUG] [LOCAL ] PCF: Derivative data saved (1807 records). [2025-09-25T22:25:09.428823] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-25T22:25:09.431782] [INFO ] [MAIN ] Derivative Progress: 1380/2043 symbols completed. PCF took 1.0s. Estimated remaining: 4m 39s. Rate: 142.6 symbols/min [2025-09-25T22:25:09.432696] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:09.433233] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:09.433112] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:09.444804] [DEBUG] [LOCAL ] PCM: Loaded 6827 existing records from primary storage. [2025-09-25T22:25:09.444956] [INFO ] [MAIN ] PCM: Loaded 6827 primary data records. [2025-09-25T22:25:09.607143] [DEBUG] [LOCAL ] PCN: Loaded 24500 existing records from primary storage. [2025-09-25T22:25:09.612663] [INFO ] [MAIN ] PCN: Loaded 24500 primary data records. [2025-09-25T22:25:09.918154] [DEBUG] [LOCAL ] PCOR: Loaded 48522 existing records from primary storage. [2025-09-25T22:25:09.929672] [INFO ] [MAIN ] PCOR: Loaded 48522 primary data records. [2025-09-25T22:25:10.546738] [DEBUG] [MAIN ] PCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:10.548696] [INFO ] [MAIN ] PCM: Generated 1807 derivative records from 6827 primary records. [2025-09-25T22:25:10.549502] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-25T22:25:10.570361] [DEBUG] [LOCAL ] PCM: Derivative data saved (1807 records). [2025-09-25T22:25:10.570916] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-25T22:25:10.573620] [INFO ] [MAIN ] Derivative Progress: 1381/2043 symbols completed. PCM took 1.1s. Estimated remaining: 4m 39s. Rate: 142.5 symbols/min [2025-09-25T22:25:10.574777] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:10.598318] [DEBUG] [MAIN ] PCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:10.599608] [INFO ] [MAIN ] PCN: Generated 1807 derivative records from 24500 primary records. [2025-09-25T22:25:10.607842] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-25T22:25:10.607724] [DEBUG] [LOCAL ] PCQ: Loaded 12229 existing records from primary storage. [2025-09-25T22:25:10.608050] [INFO ] [MAIN ] PCQ: Loaded 12229 primary data records. [2025-09-25T22:25:10.684406] [DEBUG] [MAIN ] PCOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:10.708348] [INFO ] [MAIN ] PCOR: Generated 1807 derivative records from 48522 primary records. [2025-09-25T22:25:10.738134] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-25T22:25:10.722596] [DEBUG] [LOCAL ] PCN: Derivative data saved (1807 records). [2025-09-25T22:25:10.757588] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-25T22:25:10.782093] [INFO ] [MAIN ] Derivative Progress: 1382/2043 symbols completed. PCN took 1.3s. Estimated remaining: 4m 38s. Rate: 142.5 symbols/min [2025-09-25T22:25:10.791304] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:10.802599] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1807 records). [2025-09-25T22:25:10.860708] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-25T22:25:10.958495] [INFO ] [MAIN ] Derivative Progress: 1383/2043 symbols completed. PCOR took 1.5s. Estimated remaining: 4m 38s. Rate: 142.6 symbols/min [2025-09-25T22:25:11.034452] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:11.097158] [DEBUG] [MAIN ] PCQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:11.096797] [DEBUG] [LOCAL ] PD: Loaded 48235 existing records from primary storage. [2025-09-25T22:25:11.097357] [INFO ] [MAIN ] PD: Loaded 48235 primary data records. [2025-09-25T22:25:11.098396] [INFO ] [MAIN ] PCQ: Generated 1807 derivative records from 12229 primary records. [2025-09-25T22:25:11.103836] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-25T22:25:11.286688] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1807 records). [2025-09-25T22:25:11.286959] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-25T22:25:11.288416] [DEBUG] [LOCAL ] PDI: Loaded 50558 existing records from primary storage. [2025-09-25T22:25:11.299407] [INFO ] [MAIN ] Derivative Progress: 1384/2043 symbols completed. PCQ took 0.7s. Estimated remaining: 4m 37s. Rate: 142.6 symbols/min [2025-09-25T22:25:11.299567] [INFO ] [MAIN ] PDI: Loaded 50558 primary data records. [2025-09-25T22:25:11.335144] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:11.844927] [DEBUG] [LOCAL ] PDM: Loaded 40139 existing records from primary storage. [2025-09-25T22:25:11.845320] [INFO ] [MAIN ] PDM: Loaded 40139 primary data records. [2025-09-25T22:25:12.065694] [DEBUG] [MAIN ] PD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:12.190833] [INFO ] [MAIN ] PD: Generated 1807 derivative records from 48235 primary records. [2025-09-25T22:25:12.192799] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-25T22:25:12.218675] [DEBUG] [MAIN ] PDI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:12.223605] [INFO ] [MAIN ] PDI: Generated 1807 derivative records from 50558 primary records. [2025-09-25T22:25:12.225788] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-25T22:25:12.228424] [DEBUG] [LOCAL ] PD: Derivative data saved (1807 records). [2025-09-25T22:25:12.228820] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-25T22:25:12.231803] [INFO ] [MAIN ] Derivative Progress: 1385/2043 symbols completed. PD took 1.4s. Estimated remaining: 4m 37s. Rate: 142.5 symbols/min [2025-09-25T22:25:12.241256] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:12.250347] [DEBUG] [LOCAL ] PDI: Derivative data saved (1807 records). [2025-09-25T22:25:12.251599] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-25T22:25:12.254618] [INFO ] [MAIN ] Derivative Progress: 1386/2043 symbols completed. PDI took 1.2s. Estimated remaining: 4m 37s. Rate: 142.6 symbols/min [2025-09-25T22:25:12.255161] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:12.284442] [DEBUG] [MAIN ] PDM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:12.300057] [INFO ] [MAIN ] PDM: Generated 1807 derivative records from 40139 primary records. [2025-09-25T22:25:12.299063] [DEBUG] [LOCAL ] PDS: Loaded 18211 existing records from primary storage. [2025-09-25T22:25:12.300290] [INFO ] [MAIN ] PDS: Loaded 18211 primary data records. [2025-09-25T22:25:12.305670] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-25T22:25:12.452735] [DEBUG] [LOCAL ] PDO: Loaded 31936 existing records from primary storage. [2025-09-25T22:25:12.494006] [INFO ] [MAIN ] PDO: Loaded 31936 primary data records. [2025-09-25T22:25:12.494104] [DEBUG] [LOCAL ] PDM: Derivative data saved (1807 records). [2025-09-25T22:25:12.540371] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-25T22:25:12.717578] [INFO ] [MAIN ] Derivative Progress: 1387/2043 symbols completed. PDM took 1.4s. Estimated remaining: 4m 36s. Rate: 142.6 symbols/min [2025-09-25T22:25:12.749087] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:13.058395] [DEBUG] [LOCAL ] PDT: Loaded 17362 existing records from primary storage. [2025-09-25T22:25:13.068428] [INFO ] [MAIN ] PDT: Loaded 17362 primary data records. [2025-09-25T22:25:13.412457] [DEBUG] [MAIN ] PDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:13.414488] [INFO ] [MAIN ] PDS: Generated 1807 derivative records from 18211 primary records. [2025-09-25T22:25:13.414894] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-25T22:25:13.440346] [DEBUG] [LOCAL ] PDS: Derivative data saved (1807 records). [2025-09-25T22:25:13.441053] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-25T22:25:13.443592] [INFO ] [MAIN ] Derivative Progress: 1388/2043 symbols completed. PDS took 1.2s. Estimated remaining: 4m 36s. Rate: 142.5 symbols/min [2025-09-25T22:25:13.458958] [DEBUG] [MAIN ] PDO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:13.460049] [INFO ] [MAIN ] PDO: Generated 1807 derivative records from 31936 primary records. [2025-09-25T22:25:13.460189] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-25T22:25:13.457850] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:13.480031] [DEBUG] [LOCAL ] PDO: Derivative data saved (1807 records). [2025-09-25T22:25:13.480477] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-25T22:25:13.483268] [INFO ] [MAIN ] Derivative Progress: 1389/2043 symbols completed. PDO took 1.2s. Estimated remaining: 4m 35s. Rate: 142.6 symbols/min [2025-09-25T22:25:13.484306] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:13.508306] [DEBUG] [MAIN ] PDT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:13.515016] [INFO ] [MAIN ] PDT: Generated 1807 derivative records from 17362 primary records. [2025-09-25T22:25:13.515200] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-25T22:25:13.514278] [DEBUG] [LOCAL ] PDX: Loaded 14398 existing records from primary storage. [2025-09-25T22:25:13.515805] [INFO ] [MAIN ] PDX: Loaded 14398 primary data records. [2025-09-25T22:25:13.625059] [DEBUG] [LOCAL ] PDT: Derivative data saved (1807 records). [2025-09-25T22:25:13.630765] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-25T22:25:13.641143] [INFO ] [MAIN ] Derivative Progress: 1390/2043 symbols completed. PDT took 0.9s. Estimated remaining: 4m 35s. Rate: 142.6 symbols/min [2025-09-25T22:25:13.669531] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:13.897684] [DEBUG] [LOCAL ] PEB: Loaded 51087 existing records from primary storage. [2025-09-25T22:25:13.897969] [INFO ] [MAIN ] PEB: Loaded 51087 primary data records. [2025-09-25T22:25:14.037129] [DEBUG] [LOCAL ] PEN: Loaded 30702 existing records from primary storage. [2025-09-25T22:25:14.043486] [INFO ] [MAIN ] PEN: Loaded 30702 primary data records. [2025-09-25T22:25:14.519083] [DEBUG] [MAIN ] PDX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:14.630060] [INFO ] [MAIN ] PDX: Generated 1807 derivative records from 14398 primary records. [2025-09-25T22:25:14.630709] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-25T22:25:14.655878] [DEBUG] [LOCAL ] PDX: Derivative data saved (1807 records). [2025-09-25T22:25:14.656691] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-25T22:25:14.672186] [INFO ] [MAIN ] Derivative Progress: 1391/2043 symbols completed. PDX took 1.2s. Estimated remaining: 4m 35s. Rate: 142.5 symbols/min [2025-09-25T22:25:14.674107] [DEBUG] [MAIN ] PEB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:14.674285] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:14.675384] [INFO ] [MAIN ] PEB: Generated 1807 derivative records from 51087 primary records. [2025-09-25T22:25:14.675729] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-25T22:25:14.706539] [DEBUG] [LOCAL ] PEB: Derivative data saved (1807 records). [2025-09-25T22:25:14.706766] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-25T22:25:14.710910] [INFO ] [MAIN ] Derivative Progress: 1392/2043 symbols completed. PEB took 1.2s. Estimated remaining: 4m 34s. Rate: 142.6 symbols/min [2025-09-25T22:25:14.711905] [DEBUG] [LOCAL ] PEO: Loaded 10897 existing records from primary storage. [2025-09-25T22:25:14.712004] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:14.713829] [INFO ] [MAIN ] PEO: Loaded 10897 primary data records. [2025-09-25T22:25:14.816128] [DEBUG] [MAIN ] PEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:14.828038] [INFO ] [MAIN ] PEN: Generated 1807 derivative records from 30702 primary records. [2025-09-25T22:25:14.847045] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-25T22:25:14.853314] [DEBUG] [LOCAL ] PERF: Loaded 14123 existing records from primary storage. [2025-09-25T22:25:14.854376] [INFO ] [MAIN ] PERF: Loaded 14123 primary data records. [2025-09-25T22:25:14.970305] [DEBUG] [LOCAL ] PEN: Derivative data saved (1807 records). [2025-09-25T22:25:15.054694] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-25T22:25:15.071903] [INFO ] [MAIN ] Derivative Progress: 1393/2043 symbols completed. PEN took 1.4s. Estimated remaining: 4m 33s. Rate: 142.6 symbols/min [2025-09-25T22:25:15.514929] [DEBUG] [MAIN ] PEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:15.517696] [INFO ] [MAIN ] PEO: Generated 1807 derivative records from 10897 primary records. [2025-09-25T22:25:15.517808] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-25T22:25:15.536943] [DEBUG] [LOCAL ] PEO: Derivative data saved (1807 records). [2025-09-25T22:25:15.537567] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-25T22:25:15.540424] [INFO ] [MAIN ] Derivative Progress: 1394/2043 symbols completed. PEO took 0.9s. Estimated remaining: 4m 33s. Rate: 142.6 symbols/min [2025-09-25T22:25:15.562247] [DEBUG] [MAIN ] PERF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:15.563504] [INFO ] [MAIN ] PERF: Generated 1807 derivative records from 14123 primary records. [2025-09-25T22:25:15.563628] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-25T22:25:15.580953] [DEBUG] [LOCAL ] PERF: Derivative data saved (1807 records). [2025-09-25T22:25:15.581113] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-25T22:25:15.583937] [INFO ] [MAIN ] Derivative Progress: 1395/2043 symbols completed. PERF took 0.9s. Estimated remaining: 4m 33s. Rate: 142.7 symbols/min [2025-09-25T22:25:15.585224] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:15.585060] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:15.584875] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:15.599114] [DEBUG] [LOCAL ] PFD: Loaded 5163 existing records from primary storage. [2025-09-25T22:25:15.603242] [DEBUG] [LOCAL ] PFH: Loaded 6888 existing records from primary storage. [2025-09-25T22:25:15.603882] [INFO ] [MAIN ] PFH: Loaded 6888 primary data records. [2025-09-25T22:25:15.603759] [INFO ] [MAIN ] PFD: Loaded 5163 primary data records. [2025-09-25T22:25:16.179724] [DEBUG] [LOCAL ] PFGC: Loaded 47328 existing records from primary storage. [2025-09-25T22:25:16.323479] [INFO ] [MAIN ] PFGC: Loaded 47328 primary data records. [2025-09-25T22:25:16.724081] [DEBUG] [MAIN ] PFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:16.723903] [DEBUG] [MAIN ] PFH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:16.725028] [INFO ] [MAIN ] PFH: Generated 1807 derivative records from 6888 primary records. [2025-09-25T22:25:16.725196] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-25T22:25:16.727106] [INFO ] [MAIN ] PFD: Generated 1807 derivative records from 5163 primary records. [2025-09-25T22:25:16.739789] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-25T22:25:16.757755] [DEBUG] [LOCAL ] PFH: Derivative data saved (1807 records). [2025-09-25T22:25:16.759070] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-25T22:25:16.762795] [INFO ] [MAIN ] Derivative Progress: 1396/2043 symbols completed. PFH took 1.2s. Estimated remaining: 4m 32s. Rate: 142.5 symbols/min [2025-09-25T22:25:16.763924] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:16.766128] [DEBUG] [LOCAL ] PFD: Derivative data saved (1807 records). [2025-09-25T22:25:16.766716] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-25T22:25:16.770544] [INFO ] [MAIN ] Derivative Progress: 1397/2043 symbols completed. PFD took 1.2s. Estimated remaining: 4m 32s. Rate: 142.6 symbols/min [2025-09-25T22:25:16.771776] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:16.794925] [DEBUG] [MAIN ] PFGC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:16.795887] [INFO ] [MAIN ] PFGC: Generated 1807 derivative records from 47328 primary records. [2025-09-25T22:25:16.796022] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-25T22:25:16.802425] [DEBUG] [LOCAL ] PFL: Loaded 13885 existing records from primary storage. [2025-09-25T22:25:16.802836] [INFO ] [MAIN ] PFL: Loaded 13885 primary data records. [2025-09-25T22:25:16.977413] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1807 records). [2025-09-25T22:25:17.003779] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-25T22:25:17.008262] [INFO ] [MAIN ] Derivative Progress: 1398/2043 symbols completed. PFGC took 1.4s. Estimated remaining: 4m 31s. Rate: 142.6 symbols/min [2025-09-25T22:25:17.049633] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:17.195703] [DEBUG] [LOCAL ] PFLT: Loaded 43976 existing records from primary storage. [2025-09-25T22:25:17.195998] [INFO ] [MAIN ] PFLT: Loaded 43976 primary data records. [2025-09-25T22:25:17.376944] [DEBUG] [LOCAL ] PFN: Loaded 21856 existing records from primary storage. [2025-09-25T22:25:17.420734] [INFO ] [MAIN ] PFN: Loaded 21856 primary data records. [2025-09-25T22:25:17.976437] [DEBUG] [MAIN ] PFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:17.978921] [INFO ] [MAIN ] PFL: Generated 1807 derivative records from 13885 primary records. [2025-09-25T22:25:17.979216] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-25T22:25:18.003717] [DEBUG] [LOCAL ] PFL: Derivative data saved (1807 records). [2025-09-25T22:25:18.004257] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-25T22:25:18.010060] [INFO ] [MAIN ] Derivative Progress: 1399/2043 symbols completed. PFL took 1.2s. Estimated remaining: 4m 31s. Rate: 142.5 symbols/min [2025-09-25T22:25:18.011596] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:18.023064] [DEBUG] [LOCAL ] PFO: Loaded 5922 existing records from primary storage. [2025-09-25T22:25:18.023273] [INFO ] [MAIN ] PFO: Loaded 5922 primary data records. [2025-09-25T22:25:18.142330] [DEBUG] [MAIN ] PFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:18.158893] [INFO ] [MAIN ] PFLT: Generated 1807 derivative records from 43976 primary records. [2025-09-25T22:25:18.193216] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-25T22:25:18.234274] [DEBUG] [MAIN ] PFN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:18.272921] [INFO ] [MAIN ] PFN: Generated 1807 derivative records from 21856 primary records. [2025-09-25T22:25:18.398195] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1807 records). [2025-09-25T22:25:18.398376] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-25T22:25:18.394378] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-25T22:25:18.405352] [INFO ] [MAIN ] Derivative Progress: 1400/2043 symbols completed. PFLT took 1.6s. Estimated remaining: 4m 31s. Rate: 142.5 symbols/min [2025-09-25T22:25:18.407623] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:18.427798] [DEBUG] [LOCAL ] PFN: Derivative data saved (1807 records). [2025-09-25T22:25:18.428422] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-25T22:25:18.431464] [INFO ] [MAIN ] Derivative Progress: 1401/2043 symbols completed. PFN took 1.4s. Estimated remaining: 4m 30s. Rate: 142.6 symbols/min [2025-09-25T22:25:18.431954] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:18.454584] [DEBUG] [MAIN ] PFO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:18.455525] [INFO ] [MAIN ] PFO: Generated 1807 derivative records from 5922 primary records. [2025-09-25T22:25:18.455742] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-25T22:25:18.489511] [DEBUG] [LOCAL ] PFO: Derivative data saved (1807 records). [2025-09-25T22:25:18.489830] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-25T22:25:18.493348] [INFO ] [MAIN ] Derivative Progress: 1402/2043 symbols completed. PFO took 0.5s. Estimated remaining: 4m 30s. Rate: 142.7 symbols/min [2025-09-25T22:25:18.493904] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:18.522218] [DEBUG] [LOCAL ] PFSI: Loaded 29071 existing records from primary storage. [2025-09-25T22:25:18.524904] [DEBUG] [LOCAL ] PFS: Loaded 35929 existing records from primary storage. [2025-09-25T22:25:18.525107] [INFO ] [MAIN ] PFSI: Loaded 29071 primary data records. [2025-09-25T22:25:18.525301] [INFO ] [MAIN ] PFS: Loaded 35929 primary data records. [2025-09-25T22:25:18.529415] [DEBUG] [LOCAL ] PGP: Loaded 5491 existing records from primary storage. [2025-09-25T22:25:18.556918] [INFO ] [MAIN ] PGP: Loaded 5491 primary data records. [2025-09-25T22:25:19.711854] [DEBUG] [MAIN ] PGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:19.721845] [INFO ] [MAIN ] PGP: Generated 1807 derivative records from 5491 primary records. [2025-09-25T22:25:19.726964] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-25T22:25:19.730300] [DEBUG] [MAIN ] PFS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:19.748577] [INFO ] [MAIN ] PFS: Generated 1807 derivative records from 35929 primary records. [2025-09-25T22:25:19.749766] [DEBUG] [LOCAL ] PGP: Derivative data saved (1807 records). [2025-09-25T22:25:19.750425] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-25T22:25:19.753570] [INFO ] [MAIN ] Derivative Progress: 1403/2043 symbols completed. PGP took 1.3s. Estimated remaining: 4m 30s. Rate: 142.5 symbols/min [2025-09-25T22:25:19.750010] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-25T22:25:19.762093] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:19.769945] [DEBUG] [MAIN ] PFSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:19.771696] [INFO ] [MAIN ] PFSI: Generated 1807 derivative records from 29071 primary records. [2025-09-25T22:25:19.781859] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-25T22:25:19.790861] [DEBUG] [LOCAL ] PFS: Derivative data saved (1807 records). [2025-09-25T22:25:19.798548] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-25T22:25:19.805814] [INFO ] [MAIN ] Derivative Progress: 1404/2043 symbols completed. PFS took 1.4s. Estimated remaining: 4m 29s. Rate: 142.6 symbols/min [2025-09-25T22:25:19.806168] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:19.811402] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1807 records). [2025-09-25T22:25:19.811761] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-25T22:25:19.815903] [INFO ] [MAIN ] Derivative Progress: 1405/2043 symbols completed. PFSI took 1.4s. Estimated remaining: 4m 28s. Rate: 142.7 symbols/min [2025-09-25T22:25:19.816471] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:19.830957] [DEBUG] [LOCAL ] PGZ: Loaded 5409 existing records from primary storage. [2025-09-25T22:25:19.831383] [INFO ] [MAIN ] PGZ: Loaded 5409 primary data records. [2025-09-25T22:25:20.040170] [DEBUG] [LOCAL ] PGRE: Loaded 46830 existing records from primary storage. [2025-09-25T22:25:20.073171] [INFO ] [MAIN ] PGRE: Loaded 46830 primary data records. [2025-09-25T22:25:20.345480] [DEBUG] [LOCAL ] PH: Loaded 39003 existing records from primary storage. [2025-09-25T22:25:20.352460] [INFO ] [MAIN ] PH: Loaded 39003 primary data records. [2025-09-25T22:25:20.910745] [DEBUG] [MAIN ] PGZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:20.912899] [INFO ] [MAIN ] PGZ: Generated 1807 derivative records from 5409 primary records. [2025-09-25T22:25:20.913607] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-25T22:25:20.933895] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1807 records). [2025-09-25T22:25:20.934571] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-25T22:25:20.937340] [INFO ] [MAIN ] Derivative Progress: 1406/2043 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 28s. Rate: 142.5 symbols/min [2025-09-25T22:25:20.937987] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:20.959577] [DEBUG] [MAIN ] PGRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:20.960825] [INFO ] [MAIN ] PGRE: Generated 1807 derivative records from 46830 primary records. [2025-09-25T22:25:20.960981] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-25T22:25:20.969863] [DEBUG] [LOCAL ] PHD: Loaded 9913 existing records from primary storage. [2025-09-25T22:25:20.970547] [INFO ] [MAIN ] PHD: Loaded 9913 primary data records. [2025-09-25T22:25:21.059310] [DEBUG] [MAIN ] PH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:21.074543] [INFO ] [MAIN ] PH: Generated 1807 derivative records from 39003 primary records. [2025-09-25T22:25:21.058902] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1807 records). [2025-09-25T22:25:21.074674] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-25T22:25:21.092412] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-25T22:25:21.096104] [INFO ] [MAIN ] Derivative Progress: 1407/2043 symbols completed. PGRE took 1.3s. Estimated remaining: 4m 28s. Rate: 142.6 symbols/min [2025-09-25T22:25:21.122588] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:21.324060] [DEBUG] [LOCAL ] PH: Derivative data saved (1807 records). [2025-09-25T22:25:21.334040] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-25T22:25:21.338425] [INFO ] [MAIN ] Derivative Progress: 1408/2043 symbols completed. PH took 1.5s. Estimated remaining: 4m 27s. Rate: 142.6 symbols/min [2025-09-25T22:25:21.379807] [DEBUG] [MAIN ] PHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:21.380601] [INFO ] [MAIN ] PHD: Generated 1807 derivative records from 9913 primary records. [2025-09-25T22:25:21.380772] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-25T22:25:21.397093] [DEBUG] [LOCAL ] PHD: Derivative data saved (1807 records). [2025-09-25T22:25:21.410716] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-25T22:25:21.413504] [INFO ] [MAIN ] Derivative Progress: 1409/2043 symbols completed. PHD took 0.5s. Estimated remaining: 4m 27s. Rate: 142.7 symbols/min [2025-09-25T22:25:21.416928] [DEBUG] [LOCAL ] PHG: Loaded 46531 existing records from primary storage. [2025-09-25T22:25:21.417113] [INFO ] [MAIN ] PHG: Loaded 46531 primary data records. [2025-09-25T22:25:21.807542] [DEBUG] [MAIN ] PHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:21.808296] [INFO ] [MAIN ] PHG: Generated 1807 derivative records from 46531 primary records. [2025-09-25T22:25:21.808363] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-25T22:25:21.824390] [DEBUG] [LOCAL ] PHG: Derivative data saved (1807 records). [2025-09-25T22:25:21.824489] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-25T22:25:21.827312] [INFO ] [MAIN ] Derivative Progress: 1410/2043 symbols completed. PHG took 0.7s. Estimated remaining: 4m 26s. Rate: 142.7 symbols/min [2025-09-25T22:25:21.828460] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:21.828368] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:21.829382] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:21.876054] [DEBUG] [LOCAL ] PHI: Loaded 15126 existing records from primary storage. [2025-09-25T22:25:21.877284] [INFO ] [MAIN ] PHI: Loaded 15126 primary data records. [2025-09-25T22:25:21.876992] [DEBUG] [LOCAL ] PHK: Loaded 26530 existing records from primary storage. [2025-09-25T22:25:21.900741] [INFO ] [MAIN ] PHK: Loaded 26530 primary data records. [2025-09-25T22:25:22.010696] [DEBUG] [LOCAL ] PHIN: Loaded 33373 existing records from primary storage. [2025-09-25T22:25:22.080804] [INFO ] [MAIN ] PHIN: Loaded 33373 primary data records. [2025-09-25T22:25:22.931709] [DEBUG] [MAIN ] PHK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:22.932885] [INFO ] [MAIN ] PHK: Generated 1807 derivative records from 26530 primary records. [2025-09-25T22:25:22.931292] [DEBUG] [MAIN ] PHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:22.933560] [INFO ] [MAIN ] PHI: Generated 1807 derivative records from 15126 primary records. [2025-09-25T22:25:22.933833] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-25T22:25:22.933693] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-25T22:25:22.964881] [DEBUG] [LOCAL ] PHI: Derivative data saved (1807 records). [2025-09-25T22:25:22.966134] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-25T22:25:22.979326] [DEBUG] [LOCAL ] PHK: Derivative data saved (1807 records). [2025-09-25T22:25:22.969140] [INFO ] [MAIN ] Derivative Progress: 1411/2043 symbols completed. PHI took 1.1s. Estimated remaining: 4m 26s. Rate: 142.5 symbols/min [2025-09-25T22:25:22.985274] [DEBUG] [MAIN ] PHIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:22.985369] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:22.985532] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-25T22:25:22.986840] [INFO ] [MAIN ] PHIN: Generated 1807 derivative records from 33373 primary records. [2025-09-25T22:25:22.987113] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-25T22:25:22.990450] [INFO ] [MAIN ] Derivative Progress: 1412/2043 symbols completed. PHK took 1.2s. Estimated remaining: 4m 25s. Rate: 142.6 symbols/min [2025-09-25T22:25:22.992066] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:23.011450] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1807 records). [2025-09-25T22:25:23.011722] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-25T22:25:23.014787] [INFO ] [MAIN ] Derivative Progress: 1413/2043 symbols completed. PHIN took 1.2s. Estimated remaining: 4m 25s. Rate: 142.7 symbols/min [2025-09-25T22:25:23.015474] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:23.044468] [DEBUG] [LOCAL ] PHT: Loaded 15751 existing records from primary storage. [2025-09-25T22:25:23.053287] [INFO ] [MAIN ] PHT: Loaded 15751 primary data records. [2025-09-25T22:25:23.193881] [DEBUG] [LOCAL ] PHR: Loaded 37787 existing records from primary storage. [2025-09-25T22:25:23.216426] [INFO ] [MAIN ] PHR: Loaded 37787 primary data records. [2025-09-25T22:25:23.299839] [DEBUG] [LOCAL ] PII: Loaded 49499 existing records from primary storage. [2025-09-25T22:25:23.334134] [INFO ] [MAIN ] PII: Loaded 49499 primary data records. [2025-09-25T22:25:24.171829] [DEBUG] [MAIN ] PHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:24.172784] [INFO ] [MAIN ] PHT: Generated 1807 derivative records from 15751 primary records. [2025-09-25T22:25:24.173021] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-25T22:25:24.193152] [DEBUG] [LOCAL ] PHT: Derivative data saved (1807 records). [2025-09-25T22:25:24.207110] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-25T22:25:24.210491] [INFO ] [MAIN ] Derivative Progress: 1414/2043 symbols completed. PHT took 1.2s. Estimated remaining: 4m 25s. Rate: 142.5 symbols/min [2025-09-25T22:25:24.207585] [DEBUG] [MAIN ] PHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:24.211099] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:24.212040] [INFO ] [MAIN ] PHR: Generated 1807 derivative records from 37787 primary records. [2025-09-25T22:25:24.213088] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-25T22:25:24.235146] [DEBUG] [LOCAL ] PHR: Derivative data saved (1807 records). [2025-09-25T22:25:24.235508] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-25T22:25:24.238908] [INFO ] [MAIN ] Derivative Progress: 1415/2043 symbols completed. PHR took 1.3s. Estimated remaining: 4m 24s. Rate: 142.6 symbols/min [2025-09-25T22:25:24.243543] [DEBUG] [LOCAL ] PIM: Loaded 4785 existing records from primary storage. [2025-09-25T22:25:24.251546] [INFO ] [MAIN ] PIM: Loaded 4785 primary data records. [2025-09-25T22:25:24.240124] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:24.281154] [DEBUG] [MAIN ] PII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:24.300442] [INFO ] [MAIN ] PII: Generated 1807 derivative records from 49499 primary records. [2025-09-25T22:25:24.300711] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-25T22:25:24.431750] [DEBUG] [LOCAL ] PII: Derivative data saved (1807 records). [2025-09-25T22:25:24.442241] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-25T22:25:24.447025] [DEBUG] [LOCAL ] PINE: Loaded 14283 existing records from primary storage. [2025-09-25T22:25:24.445871] [INFO ] [MAIN ] Derivative Progress: 1416/2043 symbols completed. PII took 1.4s. Estimated remaining: 4m 24s. Rate: 142.7 symbols/min [2025-09-25T22:25:24.447432] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:24.473569] [INFO ] [MAIN ] PINE: Loaded 14283 primary data records. [2025-09-25T22:25:25.007602] [DEBUG] [LOCAL ] PINS: Loaded 54083 existing records from primary storage. [2025-09-25T22:25:25.009879] [INFO ] [MAIN ] PINS: Loaded 54083 primary data records. [2025-09-25T22:25:25.358202] [DEBUG] [MAIN ] PIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:25.360456] [INFO ] [MAIN ] PIM: Generated 1807 derivative records from 4785 primary records. [2025-09-25T22:25:25.360626] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-25T22:25:25.399543] [DEBUG] [MAIN ] PINE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:25.401482] [DEBUG] [LOCAL ] PIM: Derivative data saved (1807 records). [2025-09-25T22:25:25.402364] [INFO ] [MAIN ] PINE: Generated 1807 derivative records from 14283 primary records. [2025-09-25T22:25:25.402477] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-25T22:25:25.402552] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-25T22:25:25.404997] [INFO ] [MAIN ] Derivative Progress: 1417/2043 symbols completed. PIM took 1.2s. Estimated remaining: 4m 24s. Rate: 142.5 symbols/min [2025-09-25T22:25:25.406360] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:25.427235] [DEBUG] [LOCAL ] PINE: Derivative data saved (1807 records). [2025-09-25T22:25:25.427794] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-25T22:25:25.435557] [INFO ] [MAIN ] Derivative Progress: 1418/2043 symbols completed. PINE took 1.2s. Estimated remaining: 4m 23s. Rate: 142.6 symbols/min [2025-09-25T22:25:25.436469] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:25.447840] [DEBUG] [LOCAL ] PIPR: Loaded 15270 existing records from primary storage. [2025-09-25T22:25:25.448145] [INFO ] [MAIN ] PIPR: Loaded 15270 primary data records. [2025-09-25T22:25:25.578100] [DEBUG] [MAIN ] PINS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:25.579318] [INFO ] [MAIN ] PINS: Generated 1807 derivative records from 54083 primary records. [2025-09-25T22:25:25.579488] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-25T22:25:25.608133] [DEBUG] [LOCAL ] PJT: Loaded 22488 existing records from primary storage. [2025-09-25T22:25:25.614906] [INFO ] [MAIN ] PJT: Loaded 22488 primary data records. [2025-09-25T22:25:25.642909] [DEBUG] [LOCAL ] PINS: Derivative data saved (1807 records). [2025-09-25T22:25:25.698930] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-25T22:25:25.738017] [INFO ] [MAIN ] Derivative Progress: 1419/2043 symbols completed. PINS took 1.3s. Estimated remaining: 4m 22s. Rate: 142.7 symbols/min [2025-09-25T22:25:25.913184] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:26.307788] [DEBUG] [MAIN ] PIPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:26.308980] [INFO ] [MAIN ] PIPR: Generated 1807 derivative records from 15270 primary records. [2025-09-25T22:25:26.309268] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-25T22:25:26.344932] [DEBUG] [LOCAL ] PK: Loaded 53243 existing records from primary storage. [2025-09-25T22:25:26.345451] [INFO ] [MAIN ] PK: Loaded 53243 primary data records. [2025-09-25T22:25:26.378511] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1807 records). [2025-09-25T22:25:26.421325] [DEBUG] [MAIN ] PJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:26.420972] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-25T22:25:26.446893] [INFO ] [MAIN ] Derivative Progress: 1420/2043 symbols completed. PIPR took 1.0s. Estimated remaining: 4m 22s. Rate: 142.6 symbols/min [2025-09-25T22:25:26.478114] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:26.473060] [INFO ] [MAIN ] PJT: Generated 1807 derivative records from 22488 primary records. [2025-09-25T22:25:26.478802] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-25T22:25:26.587595] [DEBUG] [LOCAL ] PJT: Derivative data saved (1807 records). [2025-09-25T22:25:26.707979] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-25T22:25:26.713529] [DEBUG] [LOCAL ] PKE: Loaded 12677 existing records from primary storage. [2025-09-25T22:25:26.716729] [INFO ] [MAIN ] PKE: Loaded 12677 primary data records. [2025-09-25T22:25:26.716558] [INFO ] [MAIN ] Derivative Progress: 1421/2043 symbols completed. PJT took 1.3s. Estimated remaining: 4m 22s. Rate: 142.6 symbols/min [2025-09-25T22:25:26.739809] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:27.085303] [DEBUG] [LOCAL ] PKG: Loaded 39494 existing records from primary storage. [2025-09-25T22:25:27.085559] [INFO ] [MAIN ] PKG: Loaded 39494 primary data records. [2025-09-25T22:25:27.084192] [DEBUG] [MAIN ] PK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:27.092206] [INFO ] [MAIN ] PK: Generated 1807 derivative records from 53243 primary records. [2025-09-25T22:25:27.120606] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-25T22:25:27.241267] [DEBUG] [LOCAL ] PK: Derivative data saved (1807 records). [2025-09-25T22:25:27.272499] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-25T22:25:27.300137] [INFO ] [MAIN ] Derivative Progress: 1422/2043 symbols completed. PK took 1.5s. Estimated remaining: 4m 21s. Rate: 142.6 symbols/min [2025-09-25T22:25:27.310832] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:27.439393] [DEBUG] [MAIN ] PKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:27.441915] [INFO ] [MAIN ] PKE: Generated 1807 derivative records from 12677 primary records. [2025-09-25T22:25:27.442126] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-25T22:25:27.460483] [DEBUG] [LOCAL ] PKE: Derivative data saved (1807 records). [2025-09-25T22:25:27.466135] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-25T22:25:27.471142] [INFO ] [MAIN ] Derivative Progress: 1423/2043 symbols completed. PKE took 1.0s. Estimated remaining: 4m 21s. Rate: 142.7 symbols/min [2025-09-25T22:25:27.483622] [DEBUG] [LOCAL ] PKST: Loaded 19342 existing records from primary storage. [2025-09-25T22:25:27.484103] [INFO ] [MAIN ] PKST: Loaded 19342 primary data records. [2025-09-25T22:25:27.584628] [DEBUG] [MAIN ] PKG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:27.605494] [INFO ] [MAIN ] PKG: Generated 1807 derivative records from 39494 primary records. [2025-09-25T22:25:27.630954] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-25T22:25:27.730516] [DEBUG] [LOCAL ] PKG: Derivative data saved (1807 records). [2025-09-25T22:25:27.733630] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-25T22:25:27.740250] [INFO ] [MAIN ] Derivative Progress: 1424/2043 symbols completed. PKG took 1.0s. Estimated remaining: 4m 20s. Rate: 142.7 symbols/min [2025-09-25T22:25:27.878713] [DEBUG] [MAIN ] PKST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:27.879476] [INFO ] [MAIN ] PKST: Generated 1807 derivative records from 19342 primary records. [2025-09-25T22:25:27.879541] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-25T22:25:27.896082] [DEBUG] [LOCAL ] PKST: Derivative data saved (1807 records). [2025-09-25T22:25:27.896164] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-25T22:25:27.899111] [INFO ] [MAIN ] Derivative Progress: 1425/2043 symbols completed. PKST took 0.6s. Estimated remaining: 4m 20s. Rate: 142.7 symbols/min [2025-09-25T22:25:27.900099] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:27.900317] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:27.900375] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:27.937354] [DEBUG] [LOCAL ] PKX: Loaded 25041 existing records from primary storage. [2025-09-25T22:25:27.937753] [INFO ] [MAIN ] PKX: Loaded 25041 primary data records. [2025-09-25T22:25:28.151190] [DEBUG] [LOCAL ] PL: Loaded 53504 existing records from primary storage. [2025-09-25T22:25:28.202316] [DEBUG] [LOCAL ] PLD: Loaded 53850 existing records from primary storage. [2025-09-25T22:25:28.330145] [INFO ] [MAIN ] PL: Loaded 53504 primary data records. [2025-09-25T22:25:28.362959] [INFO ] [MAIN ] PLD: Loaded 53850 primary data records. [2025-09-25T22:25:29.069492] [DEBUG] [MAIN ] PKX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:29.071339] [INFO ] [MAIN ] PKX: Generated 1807 derivative records from 25041 primary records. [2025-09-25T22:25:29.071700] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-25T22:25:29.096625] [DEBUG] [LOCAL ] PKX: Derivative data saved (1807 records). [2025-09-25T22:25:29.096892] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-25T22:25:29.100271] [INFO ] [MAIN ] Derivative Progress: 1426/2043 symbols completed. PKX took 1.2s. Estimated remaining: 4m 20s. Rate: 142.6 symbols/min [2025-09-25T22:25:29.109024] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:29.115393] [DEBUG] [MAIN ] PLD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:29.117065] [INFO ] [MAIN ] PLD: Generated 1807 derivative records from 53850 primary records. [2025-09-25T22:25:29.117586] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-25T22:25:29.151211] [DEBUG] [MAIN ] PL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:29.152472] [DEBUG] [LOCAL ] PLD: Derivative data saved (1807 records). [2025-09-25T22:25:29.153828] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-25T22:25:29.153713] [INFO ] [MAIN ] PL: Generated 1807 derivative records from 53504 primary records. [2025-09-25T22:25:29.158402] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-25T22:25:29.158246] [INFO ] [MAIN ] Derivative Progress: 1427/2043 symbols completed. PLD took 1.3s. Estimated remaining: 4m 19s. Rate: 142.6 symbols/min [2025-09-25T22:25:29.159997] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:29.177635] [DEBUG] [LOCAL ] PL: Derivative data saved (1807 records). [2025-09-25T22:25:29.177828] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-25T22:25:29.181679] [INFO ] [MAIN ] Derivative Progress: 1428/2043 symbols completed. PL took 1.3s. Estimated remaining: 4m 19s. Rate: 142.7 symbols/min [2025-09-25T22:25:29.182169] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:29.213528] [DEBUG] [LOCAL ] PLOW: Loaded 20661 existing records from primary storage. [2025-09-25T22:25:29.213872] [INFO ] [MAIN ] PLOW: Loaded 20661 primary data records. [2025-09-25T22:25:29.301504] [DEBUG] [LOCAL ] PLNT: Loaded 48791 existing records from primary storage. [2025-09-25T22:25:29.328845] [INFO ] [MAIN ] PLNT: Loaded 48791 primary data records. [2025-09-25T22:25:29.541576] [DEBUG] [LOCAL ] PLYM: Loaded 33657 existing records from primary storage. [2025-09-25T22:25:29.623064] [INFO ] [MAIN ] PLYM: Loaded 33657 primary data records. [2025-09-25T22:25:30.258244] [DEBUG] [MAIN ] PLOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:30.267164] [INFO ] [MAIN ] PLOW: Generated 1807 derivative records from 20661 primary records. [2025-09-25T22:25:30.273186] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-25T22:25:30.273099] [DEBUG] [MAIN ] PLNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:30.275359] [INFO ] [MAIN ] PLNT: Generated 1807 derivative records from 48791 primary records. [2025-09-25T22:25:30.275595] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-25T22:25:30.310081] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1807 records). [2025-09-25T22:25:30.310398] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1807 records). [2025-09-25T22:25:30.310578] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-25T22:25:30.310733] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-25T22:25:30.314782] [INFO ] [MAIN ] Derivative Progress: 1429/2043 symbols completed. PLNT took 1.2s. Estimated remaining: 4m 18s. Rate: 142.6 symbols/min [2025-09-25T22:25:30.318364] [INFO ] [MAIN ] Derivative Progress: 1430/2043 symbols completed. PLOW took 1.2s. Estimated remaining: 4m 18s. Rate: 142.7 symbols/min [2025-09-25T22:25:30.318876] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:30.318528] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:30.343172] [DEBUG] [MAIN ] PLYM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:30.344079] [INFO ] [MAIN ] PLYM: Generated 1807 derivative records from 33657 primary records. [2025-09-25T22:25:30.344550] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-25T22:25:30.363692] [DEBUG] [LOCAL ] PMM: Loaded 10692 existing records from primary storage. [2025-09-25T22:25:30.368339] [INFO ] [MAIN ] PMM: Loaded 10692 primary data records. [2025-09-25T22:25:30.377832] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1807 records). [2025-09-25T22:25:30.401230] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-25T22:25:30.450980] [INFO ] [MAIN ] Derivative Progress: 1431/2043 symbols completed. PLYM took 1.3s. Estimated remaining: 4m 17s. Rate: 142.7 symbols/min [2025-09-25T22:25:30.469193] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:30.490423] [DEBUG] [LOCAL ] PML: Loaded 20794 existing records from primary storage. [2025-09-25T22:25:30.494419] [INFO ] [MAIN ] PML: Loaded 20794 primary data records. [2025-09-25T22:25:30.750294] [DEBUG] [LOCAL ] PMO: Loaded 10470 existing records from primary storage. [2025-09-25T22:25:30.876012] [INFO ] [MAIN ] PMO: Loaded 10470 primary data records. [2025-09-25T22:25:31.449957] [DEBUG] [MAIN ] PMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:31.453475] [INFO ] [MAIN ] PMM: Generated 1807 derivative records from 10692 primary records. [2025-09-25T22:25:31.453998] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-25T22:25:31.470059] [DEBUG] [MAIN ] PML: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:31.479764] [INFO ] [MAIN ] PML: Generated 1807 derivative records from 20794 primary records. [2025-09-25T22:25:31.487144] [DEBUG] [LOCAL ] PMM: Derivative data saved (1807 records). [2025-09-25T22:25:31.489022] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-25T22:25:31.488781] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-25T22:25:31.494523] [INFO ] [MAIN ] Derivative Progress: 1432/2043 symbols completed. PMM took 1.2s. Estimated remaining: 4m 17s. Rate: 142.6 symbols/min [2025-09-25T22:25:31.495567] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:31.525292] [DEBUG] [LOCAL ] PML: Derivative data saved (1807 records). [2025-09-25T22:25:31.526551] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-25T22:25:31.526375] [DEBUG] [MAIN ] PMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:31.527452] [INFO ] [MAIN ] PMO: Generated 1807 derivative records from 10470 primary records. [2025-09-25T22:25:31.531448] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-25T22:25:31.531198] [INFO ] [MAIN ] Derivative Progress: 1433/2043 symbols completed. PML took 1.2s. Estimated remaining: 4m 17s. Rate: 142.7 symbols/min [2025-09-25T22:25:31.532048] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:31.557238] [DEBUG] [LOCAL ] PNI: Loaded 6775 existing records from primary storage. [2025-09-25T22:25:31.558076] [INFO ] [MAIN ] PNI: Loaded 6775 primary data records. [2025-09-25T22:25:31.581915] [DEBUG] [LOCAL ] PMO: Derivative data saved (1807 records). [2025-09-25T22:25:31.631558] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-25T22:25:31.684603] [INFO ] [MAIN ] Derivative Progress: 1434/2043 symbols completed. PMO took 1.2s. Estimated remaining: 4m 16s. Rate: 142.7 symbols/min [2025-09-25T22:25:31.710194] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:31.727906] [DEBUG] [LOCAL ] PMT: Loaded 40570 existing records from primary storage. [2025-09-25T22:25:31.740022] [INFO ] [MAIN ] PMT: Loaded 40570 primary data records. [2025-09-25T22:25:32.131905] [DEBUG] [LOCAL ] PNNT: Loaded 33086 existing records from primary storage. [2025-09-25T22:25:32.160188] [INFO ] [MAIN ] PNNT: Loaded 33086 primary data records. [2025-09-25T22:25:32.774869] [DEBUG] [MAIN ] PNI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:32.776925] [INFO ] [MAIN ] PNI: Generated 1807 derivative records from 6775 primary records. [2025-09-25T22:25:32.777787] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-25T22:25:32.803357] [DEBUG] [LOCAL ] PNI: Derivative data saved (1807 records). [2025-09-25T22:25:32.803893] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-25T22:25:32.811898] [INFO ] [MAIN ] Derivative Progress: 1435/2043 symbols completed. PNI took 1.3s. Estimated remaining: 4m 16s. Rate: 142.6 symbols/min [2025-09-25T22:25:32.812949] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:32.828619] [DEBUG] [MAIN ] PMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:32.830322] [INFO ] [MAIN ] PMT: Generated 1807 derivative records from 40570 primary records. [2025-09-25T22:25:32.830799] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-25T22:25:32.851430] [DEBUG] [LOCAL ] PMT: Derivative data saved (1807 records). [2025-09-25T22:25:32.854278] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-25T22:25:32.858153] [INFO ] [MAIN ] Derivative Progress: 1436/2043 symbols completed. PMT took 1.4s. Estimated remaining: 4m 15s. Rate: 142.7 symbols/min [2025-09-25T22:25:32.859083] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:32.872763] [DEBUG] [MAIN ] PNNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:32.881632] [INFO ] [MAIN ] PNNT: Generated 1807 derivative records from 33086 primary records. [2025-09-25T22:25:32.881741] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-25T22:25:32.900753] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1807 records). [2025-09-25T22:25:32.914552] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-25T22:25:32.917783] [INFO ] [MAIN ] Derivative Progress: 1437/2043 symbols completed. PNNT took 1.2s. Estimated remaining: 4m 15s. Rate: 142.8 symbols/min [2025-09-25T22:25:32.918219] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:32.941586] [DEBUG] [LOCAL ] PNW: Loaded 46164 existing records from primary storage. [2025-09-25T22:25:32.941937] [INFO ] [MAIN ] PNW: Loaded 46164 primary data records. [2025-09-25T22:25:33.317475] [DEBUG] [LOCAL ] POST: Loaded 39228 existing records from primary storage. [2025-09-25T22:25:33.319839] [DEBUG] [LOCAL ] POR: Loaded 47392 existing records from primary storage. [2025-09-25T22:25:33.320251] [INFO ] [MAIN ] POR: Loaded 47392 primary data records. [2025-09-25T22:25:33.320378] [INFO ] [MAIN ] POST: Loaded 39228 primary data records. [2025-09-25T22:25:34.031990] [DEBUG] [MAIN ] PNW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:34.033881] [INFO ] [MAIN ] PNW: Generated 1807 derivative records from 46164 primary records. [2025-09-25T22:25:34.034385] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-25T22:25:34.054632] [DEBUG] [LOCAL ] PNW: Derivative data saved (1807 records). [2025-09-25T22:25:34.055037] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-25T22:25:34.058259] [INFO ] [MAIN ] Derivative Progress: 1438/2043 symbols completed. PNW took 1.2s. Estimated remaining: 4m 15s. Rate: 142.6 symbols/min [2025-09-25T22:25:34.090111] [DEBUG] [MAIN ] POR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:34.091949] [INFO ] [MAIN ] POR: Generated 1807 derivative records from 47392 primary records. [2025-09-25T22:25:34.091058] [DEBUG] [MAIN ] POST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:34.092049] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-25T22:25:34.093258] [INFO ] [MAIN ] POST: Generated 1807 derivative records from 39228 primary records. [2025-09-25T22:25:34.093836] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-25T22:25:34.126764] [DEBUG] [LOCAL ] POR: Derivative data saved (1807 records). [2025-09-25T22:25:34.127066] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-25T22:25:34.126880] [DEBUG] [LOCAL ] POST: Derivative data saved (1807 records). [2025-09-25T22:25:34.129773] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-25T22:25:34.129598] [INFO ] [MAIN ] Derivative Progress: 1439/2043 symbols completed. POR took 1.3s. Estimated remaining: 4m 14s. Rate: 142.7 symbols/min [2025-09-25T22:25:34.133742] [INFO ] [MAIN ] Derivative Progress: 1440/2043 symbols completed. POST took 1.2s. Estimated remaining: 4m 13s. Rate: 142.8 symbols/min [2025-09-25T22:25:34.134583] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:34.134745] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:34.135234] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:34.163720] [DEBUG] [LOCAL ] PPT: Loaded 20177 existing records from primary storage. [2025-09-25T22:25:34.163910] [INFO ] [MAIN ] PPT: Loaded 20177 primary data records. [2025-09-25T22:25:34.538075] [DEBUG] [LOCAL ] PPG: Loaded 51078 existing records from primary storage. [2025-09-25T22:25:34.554319] [INFO ] [MAIN ] PPG: Loaded 51078 primary data records. [2025-09-25T22:25:34.577826] [DEBUG] [LOCAL ] PR: Loaded 53999 existing records from primary storage. [2025-09-25T22:25:34.604118] [INFO ] [MAIN ] PR: Loaded 53999 primary data records. [2025-09-25T22:25:35.330394] [DEBUG] [MAIN ] PPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:35.332785] [INFO ] [MAIN ] PPT: Generated 1807 derivative records from 20177 primary records. [2025-09-25T22:25:35.332983] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-25T22:25:35.353565] [DEBUG] [LOCAL ] PPT: Derivative data saved (1807 records). [2025-09-25T22:25:35.354099] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-25T22:25:35.357031] [INFO ] [MAIN ] Derivative Progress: 1441/2043 symbols completed. PPT took 1.2s. Estimated remaining: 4m 13s. Rate: 142.6 symbols/min [2025-09-25T22:25:35.357868] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:35.383118] [DEBUG] [MAIN ] PR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:35.386050] [INFO ] [MAIN ] PR: Generated 1807 derivative records from 53999 primary records. [2025-09-25T22:25:35.387970] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-25T22:25:35.432866] [DEBUG] [MAIN ] PPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:35.437350] [DEBUG] [LOCAL ] PR: Derivative data saved (1807 records). [2025-09-25T22:25:35.438498] [INFO ] [MAIN ] PPG: Generated 1807 derivative records from 51078 primary records. [2025-09-25T22:25:35.438794] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-25T22:25:35.438862] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-25T22:25:35.441787] [INFO ] [MAIN ] Derivative Progress: 1442/2043 symbols completed. PR took 1.3s. Estimated remaining: 4m 13s. Rate: 142.7 symbols/min [2025-09-25T22:25:35.444173] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:35.481005] [DEBUG] [LOCAL ] PRA: Loaded 35061 existing records from primary storage. [2025-09-25T22:25:35.481888] [INFO ] [MAIN ] PRA: Loaded 35061 primary data records. [2025-09-25T22:25:35.535438] [DEBUG] [LOCAL ] PPG: Derivative data saved (1807 records). [2025-09-25T22:25:35.570458] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-25T22:25:35.612105] [INFO ] [MAIN ] Derivative Progress: 1443/2043 symbols completed. PPG took 1.5s. Estimated remaining: 4m 12s. Rate: 142.7 symbols/min [2025-09-25T22:25:35.641000] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:35.714915] [DEBUG] [LOCAL ] PRG: Loaded 30222 existing records from primary storage. [2025-09-25T22:25:35.727596] [INFO ] [MAIN ] PRG: Loaded 30222 primary data records. [2025-09-25T22:25:36.300063] [DEBUG] [LOCAL ] PRGO: Loaded 47266 existing records from primary storage. [2025-09-25T22:25:36.439417] [INFO ] [MAIN ] PRGO: Loaded 47266 primary data records. [2025-09-25T22:25:36.794809] [DEBUG] [MAIN ] PRA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:36.796744] [INFO ] [MAIN ] PRA: Generated 1807 derivative records from 35061 primary records. [2025-09-25T22:25:36.797053] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-25T22:25:36.833234] [DEBUG] [MAIN ] PRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:36.834401] [DEBUG] [LOCAL ] PRA: Derivative data saved (1807 records). [2025-09-25T22:25:36.835229] [INFO ] [MAIN ] PRG: Generated 1807 derivative records from 30222 primary records. [2025-09-25T22:25:36.835337] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-25T22:25:36.835433] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-25T22:25:36.838488] [INFO ] [MAIN ] Derivative Progress: 1444/2043 symbols completed. PRA took 1.5s. Estimated remaining: 4m 12s. Rate: 142.5 symbols/min [2025-09-25T22:25:36.851451] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:36.859914] [DEBUG] [LOCAL ] PRG: Derivative data saved (1807 records). [2025-09-25T22:25:36.860143] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-25T22:25:36.862919] [INFO ] [MAIN ] Derivative Progress: 1445/2043 symbols completed. PRG took 1.4s. Estimated remaining: 4m 12s. Rate: 142.6 symbols/min [2025-09-25T22:25:36.866455] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:36.866814] [DEBUG] [LOCAL ] PRH: Loaded 4885 existing records from primary storage. [2025-09-25T22:25:36.867518] [INFO ] [MAIN ] PRH: Loaded 4885 primary data records. [2025-09-25T22:25:37.037194] [DEBUG] [MAIN ] PRGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:37.052878] [DEBUG] [LOCAL ] PRI: Loaded 18543 existing records from primary storage. [2025-09-25T22:25:37.071538] [INFO ] [MAIN ] PRI: Loaded 18543 primary data records. [2025-09-25T22:25:37.071206] [INFO ] [MAIN ] PRGO: Generated 1807 derivative records from 47266 primary records. [2025-09-25T22:25:37.089670] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-25T22:25:37.392125] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1807 records). [2025-09-25T22:25:37.412572] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-25T22:25:37.421258] [INFO ] [MAIN ] Derivative Progress: 1446/2043 symbols completed. PRGO took 1.8s. Estimated remaining: 4m 11s. Rate: 142.6 symbols/min [2025-09-25T22:25:37.427141] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:37.648615] [DEBUG] [MAIN ] PRH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:37.649804] [INFO ] [MAIN ] PRH: Generated 1807 derivative records from 4885 primary records. [2025-09-25T22:25:37.650006] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-25T22:25:37.681252] [DEBUG] [LOCAL ] PRH: Derivative data saved (1807 records). [2025-09-25T22:25:37.682264] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-25T22:25:37.685019] [INFO ] [MAIN ] Derivative Progress: 1447/2043 symbols completed. PRH took 0.8s. Estimated remaining: 4m 11s. Rate: 142.6 symbols/min [2025-09-25T22:25:37.700463] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:37.711492] [DEBUG] [LOCAL ] PRIM: Loaded 44756 existing records from primary storage. [2025-09-25T22:25:37.717009] [INFO ] [MAIN ] PRIM: Loaded 44756 primary data records. [2025-09-25T22:25:37.717332] [DEBUG] [MAIN ] PRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:37.718435] [INFO ] [MAIN ] PRI: Generated 1807 derivative records from 18543 primary records. [2025-09-25T22:25:37.752157] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-25T22:25:38.071080] [DEBUG] [LOCAL ] PRI: Derivative data saved (1807 records). [2025-09-25T22:25:38.071552] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-25T22:25:38.087315] [INFO ] [MAIN ] Derivative Progress: 1448/2043 symbols completed. PRI took 1.2s. Estimated remaining: 4m 10s. Rate: 142.6 symbols/min [2025-09-25T22:25:38.089333] [DEBUG] [LOCAL ] PRKS: Loaded 42999 existing records from primary storage. [2025-09-25T22:25:38.088164] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:38.090286] [INFO ] [MAIN ] PRKS: Loaded 42999 primary data records. [2025-09-25T22:25:38.316850] [DEBUG] [LOCAL ] PRLB: Loaded 20788 existing records from primary storage. [2025-09-25T22:25:38.432414] [INFO ] [MAIN ] PRLB: Loaded 20788 primary data records. [2025-09-25T22:25:38.794465] [DEBUG] [MAIN ] PRIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:38.795481] [INFO ] [MAIN ] PRIM: Generated 1807 derivative records from 44756 primary records. [2025-09-25T22:25:38.795997] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-25T22:25:38.818122] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1807 records). [2025-09-25T22:25:38.833276] [DEBUG] [MAIN ] PRKS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:38.832568] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-25T22:25:38.834230] [INFO ] [MAIN ] PRKS: Generated 1807 derivative records from 42999 primary records. [2025-09-25T22:25:38.834334] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-25T22:25:38.836783] [INFO ] [MAIN ] Derivative Progress: 1449/2043 symbols completed. PRIM took 1.4s. Estimated remaining: 4m 10s. Rate: 142.5 symbols/min [2025-09-25T22:25:38.838672] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:38.860980] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1807 records). [2025-09-25T22:25:38.861429] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-25T22:25:38.863875] [INFO ] [MAIN ] Derivative Progress: 1450/2043 symbols completed. PRKS took 1.2s. Estimated remaining: 4m 9s. Rate: 142.6 symbols/min [2025-09-25T22:25:38.864535] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:38.886244] [DEBUG] [MAIN ] PRLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:38.887242] [INFO ] [MAIN ] PRLB: Generated 1807 derivative records from 20788 primary records. [2025-09-25T22:25:38.887459] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-25T22:25:38.905311] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1807 records). [2025-09-25T22:25:38.916719] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-25T22:25:38.919560] [INFO ] [MAIN ] Derivative Progress: 1451/2043 symbols completed. PRLB took 0.8s. Estimated remaining: 4m 9s. Rate: 142.7 symbols/min [2025-09-25T22:25:38.920040] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:38.953792] [DEBUG] [LOCAL ] PRM: Loaded 44963 existing records from primary storage. [2025-09-25T22:25:38.954152] [INFO ] [MAIN ] PRM: Loaded 44963 primary data records. [2025-09-25T22:25:39.089534] [DEBUG] [LOCAL ] PRMB: Loaded 53544 existing records from primary storage. [2025-09-25T22:25:39.113323] [INFO ] [MAIN ] PRMB: Loaded 53544 primary data records. [2025-09-25T22:25:39.460603] [DEBUG] [LOCAL ] PRO: Loaded 38081 existing records from primary storage. [2025-09-25T22:25:39.472178] [INFO ] [MAIN ] PRO: Loaded 38081 primary data records. [2025-09-25T22:25:40.086265] [DEBUG] [MAIN ] PRM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:40.087923] [INFO ] [MAIN ] PRM: Generated 1807 derivative records from 44963 primary records. [2025-09-25T22:25:40.088607] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-25T22:25:40.122229] [DEBUG] [MAIN ] PRMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:40.124311] [INFO ] [MAIN ] PRMB: Generated 1807 derivative records from 53544 primary records. [2025-09-25T22:25:40.125017] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-25T22:25:40.125216] [DEBUG] [LOCAL ] PRM: Derivative data saved (1807 records). [2025-09-25T22:25:40.126407] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-25T22:25:40.129674] [INFO ] [MAIN ] Derivative Progress: 1452/2043 symbols completed. PRM took 1.3s. Estimated remaining: 4m 9s. Rate: 142.5 symbols/min [2025-09-25T22:25:40.139184] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:40.147289] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1807 records). [2025-09-25T22:25:40.147933] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-25T22:25:40.151256] [INFO ] [MAIN ] Derivative Progress: 1453/2043 symbols completed. PRMB took 1.3s. Estimated remaining: 4m 8s. Rate: 142.6 symbols/min [2025-09-25T22:25:40.167803] [DEBUG] [MAIN ] PRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:40.168565] [INFO ] [MAIN ] PRO: Generated 1807 derivative records from 38081 primary records. [2025-09-25T22:25:40.168734] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-25T22:25:40.186370] [DEBUG] [LOCAL ] PRT: Loaded 5372 existing records from primary storage. [2025-09-25T22:25:40.190809] [DEBUG] [LOCAL ] PRO: Derivative data saved (1807 records). [2025-09-25T22:25:40.191030] [INFO ] [MAIN ] PRT: Loaded 5372 primary data records. [2025-09-25T22:25:40.191125] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-25T22:25:40.193850] [INFO ] [MAIN ] Derivative Progress: 1454/2043 symbols completed. PRO took 1.3s. Estimated remaining: 4m 8s. Rate: 142.7 symbols/min [2025-09-25T22:25:40.528710] [DEBUG] [MAIN ] PRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:40.529424] [INFO ] [MAIN ] PRT: Generated 1807 derivative records from 5372 primary records. [2025-09-25T22:25:40.529488] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-25T22:25:40.544045] [DEBUG] [LOCAL ] PRT: Derivative data saved (1807 records). [2025-09-25T22:25:40.544125] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-25T22:25:40.546396] [INFO ] [MAIN ] Derivative Progress: 1455/2043 symbols completed. PRT took 0.4s. Estimated remaining: 4m 7s. Rate: 142.7 symbols/min [2025-09-25T22:25:40.547301] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:40.547471] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:40.548286] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:40.559585] [DEBUG] [LOCAL ] PSBD: Loaded 7064 existing records from primary storage. [2025-09-25T22:25:40.559785] [INFO ] [MAIN ] PSBD: Loaded 7064 primary data records. [2025-09-25T22:25:40.899622] [DEBUG] [LOCAL ] PSA: Loaded 42130 existing records from primary storage. [2025-09-25T22:25:40.909628] [INFO ] [MAIN ] PSA: Loaded 42130 primary data records. [2025-09-25T22:25:41.017569] [DEBUG] [LOCAL ] PRU: Loaded 51835 existing records from primary storage. [2025-09-25T22:25:41.023222] [INFO ] [MAIN ] PRU: Loaded 51835 primary data records. [2025-09-25T22:25:41.667422] [DEBUG] [MAIN ] PSBD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:25:41.668965] [INFO ] [MAIN ] PSBD: Generated 1806 derivative records from 7064 primary records. [2025-09-25T22:25:41.669352] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-25T22:25:41.691725] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1806 records). [2025-09-25T22:25:41.705665] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-25T22:25:41.705998] [DEBUG] [MAIN ] PSA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:41.709956] [INFO ] [MAIN ] PSA: Generated 1807 derivative records from 42130 primary records. [2025-09-25T22:25:41.709004] [INFO ] [MAIN ] Derivative Progress: 1456/2043 symbols completed. PSBD took 1.2s. Estimated remaining: 4m 7s. Rate: 142.6 symbols/min [2025-09-25T22:25:41.710078] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-25T22:25:41.710435] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:41.734251] [DEBUG] [LOCAL ] PSA: Derivative data saved (1807 records). [2025-09-25T22:25:41.735828] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-25T22:25:41.738269] [INFO ] [MAIN ] Derivative Progress: 1457/2043 symbols completed. PSA took 1.2s. Estimated remaining: 4m 6s. Rate: 142.7 symbols/min [2025-09-25T22:25:41.756698] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:41.757052] [DEBUG] [LOCAL ] PSF: Loaded 6828 existing records from primary storage. [2025-09-25T22:25:41.757826] [INFO ] [MAIN ] PSF: Loaded 6828 primary data records. [2025-09-25T22:25:41.757627] [DEBUG] [MAIN ] PRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:41.758731] [INFO ] [MAIN ] PRU: Generated 1807 derivative records from 51835 primary records. [2025-09-25T22:25:41.793573] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-25T22:25:41.925013] [DEBUG] [LOCAL ] PRU: Derivative data saved (1807 records). [2025-09-25T22:25:41.951918] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-25T22:25:41.999474] [INFO ] [MAIN ] Derivative Progress: 1458/2043 symbols completed. PRU took 1.5s. Estimated remaining: 4m 6s. Rate: 142.7 symbols/min [2025-09-25T22:25:42.000037] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:42.132841] [DEBUG] [LOCAL ] PSFE: Loaded 30563 existing records from primary storage. [2025-09-25T22:25:42.133101] [INFO ] [MAIN ] PSFE: Loaded 30563 primary data records. [2025-09-25T22:25:42.510479] [DEBUG] [LOCAL ] PSN: Loaded 46526 existing records from primary storage. [2025-09-25T22:25:42.512203] [INFO ] [MAIN ] PSN: Loaded 46526 primary data records. [2025-09-25T22:25:42.646343] [DEBUG] [MAIN ] PSF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:42.650330] [INFO ] [MAIN ] PSF: Generated 1807 derivative records from 6828 primary records. [2025-09-25T22:25:42.651300] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-25T22:25:42.875749] [DEBUG] [LOCAL ] PSF: Derivative data saved (1807 records). [2025-09-25T22:25:42.876418] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-25T22:25:42.878948] [INFO ] [MAIN ] Derivative Progress: 1459/2043 symbols completed. PSF took 1.2s. Estimated remaining: 4m 6s. Rate: 142.6 symbols/min [2025-09-25T22:25:42.880515] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:42.900398] [DEBUG] [MAIN ] PSFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:42.901455] [INFO ] [MAIN ] PSFE: Generated 1807 derivative records from 30563 primary records. [2025-09-25T22:25:42.902127] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-25T22:25:42.930743] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1807 records). [2025-09-25T22:25:42.930890] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-25T22:25:42.933449] [INFO ] [MAIN ] Derivative Progress: 1460/2043 symbols completed. PSFE took 1.2s. Estimated remaining: 4m 5s. Rate: 142.7 symbols/min [2025-09-25T22:25:42.933881] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:42.963796] [DEBUG] [LOCAL ] PSO: Loaded 37577 existing records from primary storage. [2025-09-25T22:25:42.964399] [DEBUG] [MAIN ] PSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:42.965313] [INFO ] [MAIN ] PSN: Generated 1807 derivative records from 46526 primary records. [2025-09-25T22:25:42.964581] [INFO ] [MAIN ] PSO: Loaded 37577 primary data records. [2025-09-25T22:25:42.965423] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-25T22:25:43.088003] [DEBUG] [LOCAL ] PSN: Derivative data saved (1807 records). [2025-09-25T22:25:43.099529] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-25T22:25:43.109952] [INFO ] [MAIN ] Derivative Progress: 1461/2043 symbols completed. PSN took 1.1s. Estimated remaining: 4m 5s. Rate: 142.7 symbols/min [2025-09-25T22:25:43.202851] [DEBUG] [LOCAL ] PSQH: Loaded 35131 existing records from primary storage. [2025-09-25T22:25:43.203044] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:43.325247] [INFO ] [MAIN ] PSQH: Loaded 35131 primary data records. [2025-09-25T22:25:43.728928] [DEBUG] [MAIN ] PSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:43.730251] [INFO ] [MAIN ] PSO: Generated 1807 derivative records from 37577 primary records. [2025-09-25T22:25:43.746122] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-25T22:25:43.749130] [DEBUG] [LOCAL ] PSTG: Loaded 53237 existing records from primary storage. [2025-09-25T22:25:43.756569] [INFO ] [MAIN ] PSTG: Loaded 53237 primary data records. [2025-09-25T22:25:43.866374] [DEBUG] [LOCAL ] PSO: Derivative data saved (1807 records). [2025-09-25T22:25:43.878178] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-25T22:25:43.880942] [INFO ] [MAIN ] Derivative Progress: 1462/2043 symbols completed. PSO took 1.0s. Estimated remaining: 4m 4s. Rate: 142.6 symbols/min [2025-09-25T22:25:43.897062] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:44.117742] [DEBUG] [MAIN ] PSQH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:44.118988] [INFO ] [MAIN ] PSQH: Generated 1807 derivative records from 35131 primary records. [2025-09-25T22:25:44.119326] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-25T22:25:44.138044] [DEBUG] [LOCAL ] PSTL: Loaded 20493 existing records from primary storage. [2025-09-25T22:25:44.140805] [INFO ] [MAIN ] PSTL: Loaded 20493 primary data records. [2025-09-25T22:25:44.244540] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1807 records). [2025-09-25T22:25:44.260473] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-25T22:25:44.267146] [INFO ] [MAIN ] Derivative Progress: 1463/2043 symbols completed. PSQH took 1.3s. Estimated remaining: 4m 4s. Rate: 142.7 symbols/min [2025-09-25T22:25:44.278687] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:44.510586] [DEBUG] [MAIN ] PSTG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:44.511609] [INFO ] [MAIN ] PSTG: Generated 1807 derivative records from 53237 primary records. [2025-09-25T22:25:44.512269] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-25T22:25:44.535680] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1807 records). [2025-09-25T22:25:44.535862] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-25T22:25:44.538593] [INFO ] [MAIN ] Derivative Progress: 1464/2043 symbols completed. PSTG took 1.4s. Estimated remaining: 4m 3s. Rate: 142.7 symbols/min [2025-09-25T22:25:44.540632] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:44.579804] [DEBUG] [MAIN ] PSTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:44.580785] [INFO ] [MAIN ] PSTL: Generated 1807 derivative records from 20493 primary records. [2025-09-25T22:25:44.580936] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-25T22:25:44.604036] [DEBUG] [LOCAL ] PTA: Loaded 15182 existing records from primary storage. [2025-09-25T22:25:44.605612] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1807 records). [2025-09-25T22:25:44.605901] [INFO ] [MAIN ] PTA: Loaded 15182 primary data records. [2025-09-25T22:25:44.605791] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-25T22:25:44.608492] [INFO ] [MAIN ] Derivative Progress: 1465/2043 symbols completed. PSTL took 0.7s. Estimated remaining: 4m 3s. Rate: 142.8 symbols/min [2025-09-25T22:25:44.614243] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:44.707203] [DEBUG] [LOCAL ] PSX: Loaded 53522 existing records from primary storage. [2025-09-25T22:25:44.720295] [INFO ] [MAIN ] PSX: Loaded 53522 primary data records. [2025-09-25T22:25:45.322843] [DEBUG] [LOCAL ] PTY: Loaded 37653 existing records from primary storage. [2025-09-25T22:25:45.323146] [INFO ] [MAIN ] PTY: Loaded 37653 primary data records. [2025-09-25T22:25:45.734367] [DEBUG] [MAIN ] PTA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:45.736238] [INFO ] [MAIN ] PTA: Generated 1807 derivative records from 15182 primary records. [2025-09-25T22:25:45.736829] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-25T22:25:45.771831] [DEBUG] [MAIN ] PSX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:45.774353] [INFO ] [MAIN ] PSX: Generated 1807 derivative records from 53522 primary records. [2025-09-25T22:25:45.776322] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-25T22:25:45.775945] [DEBUG] [LOCAL ] PTA: Derivative data saved (1807 records). [2025-09-25T22:25:45.776750] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-25T22:25:45.788721] [INFO ] [MAIN ] Derivative Progress: 1466/2043 symbols completed. PTA took 1.2s. Estimated remaining: 4m 3s. Rate: 142.6 symbols/min [2025-09-25T22:25:45.795164] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:45.800181] [DEBUG] [LOCAL ] PSX: Derivative data saved (1807 records). [2025-09-25T22:25:45.800522] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-25T22:25:45.815987] [INFO ] [MAIN ] Derivative Progress: 1467/2043 symbols completed. PSX took 1.5s. Estimated remaining: 4m 2s. Rate: 142.7 symbols/min [2025-09-25T22:25:45.816518] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:45.816980] [DEBUG] [MAIN ] PTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:45.818423] [INFO ] [MAIN ] PTY: Generated 1807 derivative records from 37653 primary records. [2025-09-25T22:25:45.818618] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-25T22:25:45.836112] [DEBUG] [LOCAL ] PTY: Derivative data saved (1807 records). [2025-09-25T22:25:45.841682] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-25T22:25:45.844432] [INFO ] [MAIN ] Derivative Progress: 1468/2043 symbols completed. PTY took 1.2s. Estimated remaining: 4m 2s. Rate: 142.8 symbols/min [2025-09-25T22:25:45.904614] [DEBUG] [LOCAL ] PUK: Loaded 45251 existing records from primary storage. [2025-09-25T22:25:45.904902] [INFO ] [MAIN ] PUK: Loaded 45251 primary data records. [2025-09-25T22:25:45.939596] [DEBUG] [LOCAL ] PUMP: Loaded 49796 existing records from primary storage. [2025-09-25T22:25:45.973876] [INFO ] [MAIN ] PUMP: Loaded 49796 primary data records. [2025-09-25T22:25:46.583020] [DEBUG] [MAIN ] PUK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:46.584059] [INFO ] [MAIN ] PUK: Generated 1807 derivative records from 45251 primary records. [2025-09-25T22:25:46.584164] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-25T22:25:46.602749] [DEBUG] [LOCAL ] PUK: Derivative data saved (1807 records). [2025-09-25T22:25:46.602858] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-25T22:25:46.606838] [INFO ] [MAIN ] Derivative Progress: 1469/2043 symbols completed. PUK took 0.8s. Estimated remaining: 4m 1s. Rate: 142.7 symbols/min [2025-09-25T22:25:46.621931] [DEBUG] [MAIN ] PUMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:46.622993] [INFO ] [MAIN ] PUMP: Generated 1807 derivative records from 49796 primary records. [2025-09-25T22:25:46.623062] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-25T22:25:46.641823] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1807 records). [2025-09-25T22:25:46.641942] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-25T22:25:46.644689] [INFO ] [MAIN ] Derivative Progress: 1470/2043 symbols completed. PUMP took 0.8s. Estimated remaining: 4m 1s. Rate: 142.8 symbols/min [2025-09-25T22:25:46.645472] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:46.645950] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:46.645633] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:46.656213] [DEBUG] [LOCAL ] PVL: Loaded 4785 existing records from primary storage. [2025-09-25T22:25:46.656511] [INFO ] [MAIN ] PVL: Loaded 4785 primary data records. [2025-09-25T22:25:47.091539] [DEBUG] [LOCAL ] PVH: Loaded 50819 existing records from primary storage. [2025-09-25T22:25:47.091795] [DEBUG] [LOCAL ] PWR: Loaded 47713 existing records from primary storage. [2025-09-25T22:25:47.092269] [INFO ] [MAIN ] PVH: Loaded 50819 primary data records. [2025-09-25T22:25:47.092420] [INFO ] [MAIN ] PWR: Loaded 47713 primary data records. [2025-09-25T22:25:47.832201] [DEBUG] [MAIN ] PVL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:47.833711] [INFO ] [MAIN ] PVL: Generated 1807 derivative records from 4785 primary records. [2025-09-25T22:25:47.833909] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-25T22:25:47.852993] [DEBUG] [LOCAL ] PVL: Derivative data saved (1807 records). [2025-09-25T22:25:47.853274] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-25T22:25:47.856043] [INFO ] [MAIN ] Derivative Progress: 1471/2043 symbols completed. PVL took 1.2s. Estimated remaining: 4m 1s. Rate: 142.6 symbols/min [2025-09-25T22:25:47.856739] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:47.882437] [DEBUG] [MAIN ] PWR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:47.883630] [INFO ] [MAIN ] PWR: Generated 1807 derivative records from 47713 primary records. [2025-09-25T22:25:47.884036] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-25T22:25:47.908995] [DEBUG] [MAIN ] PVH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:47.917583] [INFO ] [MAIN ] PVH: Generated 1807 derivative records from 50819 primary records. [2025-09-25T22:25:47.916578] [DEBUG] [LOCAL ] PWR: Derivative data saved (1807 records). [2025-09-25T22:25:47.926172] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-25T22:25:47.926062] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-25T22:25:47.928959] [INFO ] [MAIN ] Derivative Progress: 1472/2043 symbols completed. PWR took 1.3s. Estimated remaining: 4m 0s. Rate: 142.7 symbols/min [2025-09-25T22:25:47.929577] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:47.966627] [DEBUG] [LOCAL ] PVH: Derivative data saved (1807 records). [2025-09-25T22:25:47.968035] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-25T22:25:47.967853] [DEBUG] [LOCAL ] PX: Loaded 34911 existing records from primary storage. [2025-09-25T22:25:47.972105] [INFO ] [MAIN ] Derivative Progress: 1473/2043 symbols completed. PVH took 1.3s. Estimated remaining: 3m 60s. Rate: 142.8 symbols/min [2025-09-25T22:25:47.972566] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:47.973447] [INFO ] [MAIN ] PX: Loaded 34911 primary data records. [2025-09-25T22:25:48.106379] [DEBUG] [LOCAL ] QD: Loaded 28263 existing records from primary storage. [2025-09-25T22:25:48.112477] [INFO ] [MAIN ] QD: Loaded 28263 primary data records. [2025-09-25T22:25:48.593670] [DEBUG] [LOCAL ] QGEN: Loaded 49526 existing records from primary storage. [2025-09-25T22:25:48.594323] [INFO ] [MAIN ] QGEN: Loaded 49526 primary data records. [2025-09-25T22:25:49.105907] [DEBUG] [MAIN ] PX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:49.107190] [INFO ] [MAIN ] PX: Generated 1807 derivative records from 34911 primary records. [2025-09-25T22:25:49.108965] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-25T22:25:49.141498] [DEBUG] [MAIN ] QD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:49.142975] [INFO ] [MAIN ] QD: Generated 1807 derivative records from 28263 primary records. [2025-09-25T22:25:49.143319] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-25T22:25:49.146600] [DEBUG] [LOCAL ] PX: Derivative data saved (1807 records). [2025-09-25T22:25:49.146728] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-25T22:25:49.150192] [INFO ] [MAIN ] Derivative Progress: 1474/2043 symbols completed. PX took 1.3s. Estimated remaining: 3m 59s. Rate: 142.6 symbols/min [2025-09-25T22:25:49.150987] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:49.168554] [DEBUG] [LOCAL ] QD: Derivative data saved (1807 records). [2025-09-25T22:25:49.168908] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-25T22:25:49.172770] [INFO ] [MAIN ] Derivative Progress: 1475/2043 symbols completed. QD took 1.2s. Estimated remaining: 3m 59s. Rate: 142.7 symbols/min [2025-09-25T22:25:49.173130] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:49.190232] [DEBUG] [MAIN ] QGEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:49.191264] [INFO ] [MAIN ] QGEN: Generated 1807 derivative records from 49526 primary records. [2025-09-25T22:25:49.191405] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-25T22:25:49.210412] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1807 records). [2025-09-25T22:25:49.210761] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-25T22:25:49.213442] [INFO ] [MAIN ] Derivative Progress: 1476/2043 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 58s. Rate: 142.8 symbols/min [2025-09-25T22:25:49.213937] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:49.292318] [DEBUG] [LOCAL ] QS: Loaded 54132 existing records from primary storage. [2025-09-25T22:25:49.293551] [INFO ] [MAIN ] QS: Loaded 54132 primary data records. [2025-09-25T22:25:49.293324] [DEBUG] [LOCAL ] QSR: Loaded 52792 existing records from primary storage. [2025-09-25T22:25:49.307193] [INFO ] [MAIN ] QSR: Loaded 52792 primary data records. [2025-09-25T22:25:49.538010] [DEBUG] [LOCAL ] QTWO: Loaded 39406 existing records from primary storage. [2025-09-25T22:25:49.596865] [INFO ] [MAIN ] QTWO: Loaded 39406 primary data records. [2025-09-25T22:25:50.444203] [DEBUG] [MAIN ] QS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:50.447350] [INFO ] [MAIN ] QS: Generated 1807 derivative records from 54132 primary records. [2025-09-25T22:25:50.447705] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-25T22:25:50.481128] [DEBUG] [MAIN ] QSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:50.483786] [DEBUG] [LOCAL ] QS: Derivative data saved (1807 records). [2025-09-25T22:25:50.485184] [INFO ] [MAIN ] QSR: Generated 1807 derivative records from 52792 primary records. [2025-09-25T22:25:50.485700] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-25T22:25:50.486046] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-25T22:25:50.489436] [INFO ] [MAIN ] Derivative Progress: 1477/2043 symbols completed. QS took 1.3s. Estimated remaining: 3m 58s. Rate: 142.6 symbols/min [2025-09-25T22:25:50.503425] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:50.529232] [DEBUG] [MAIN ] QTWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:50.528946] [DEBUG] [LOCAL ] QSR: Derivative data saved (1807 records). [2025-09-25T22:25:50.529500] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-25T22:25:50.533673] [INFO ] [MAIN ] Derivative Progress: 1478/2043 symbols completed. QSR took 1.4s. Estimated remaining: 3m 58s. Rate: 142.7 symbols/min [2025-09-25T22:25:50.534831] [INFO ] [MAIN ] QTWO: Generated 1807 derivative records from 39406 primary records. [2025-09-25T22:25:50.535312] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:50.535494] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-25T22:25:50.560298] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1807 records). [2025-09-25T22:25:50.563190] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-25T22:25:50.565936] [INFO ] [MAIN ] Derivative Progress: 1479/2043 symbols completed. QTWO took 1.4s. Estimated remaining: 3m 57s. Rate: 142.8 symbols/min [2025-09-25T22:25:50.566451] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:50.572050] [DEBUG] [LOCAL ] QVCC: Loaded 8949 existing records from primary storage. [2025-09-25T22:25:50.572226] [INFO ] [MAIN ] QVCC: Loaded 8949 primary data records. [2025-09-25T22:25:50.655234] [DEBUG] [LOCAL ] QUAD: Loaded 23833 existing records from primary storage. [2025-09-25T22:25:50.654475] [DEBUG] [LOCAL ] QVCD: Loaded 4519 existing records from primary storage. [2025-09-25T22:25:50.664586] [INFO ] [MAIN ] QVCD: Loaded 4519 primary data records. [2025-09-25T22:25:50.676633] [INFO ] [MAIN ] QUAD: Loaded 23833 primary data records. [2025-09-25T22:25:51.692813] [DEBUG] [MAIN ] QVCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:51.694049] [INFO ] [MAIN ] QVCC: Generated 1807 derivative records from 8949 primary records. [2025-09-25T22:25:51.694178] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-25T22:25:51.715913] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1807 records). [2025-09-25T22:25:51.717908] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-25T22:25:51.721763] [INFO ] [MAIN ] Derivative Progress: 1480/2043 symbols completed. QVCC took 1.2s. Estimated remaining: 3m 57s. Rate: 142.6 symbols/min [2025-09-25T22:25:51.722568] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:51.740499] [DEBUG] [MAIN ] QUAD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:51.755302] [INFO ] [MAIN ] QUAD: Generated 1807 derivative records from 23833 primary records. [2025-09-25T22:25:51.755395] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-25T22:25:51.754306] [DEBUG] [MAIN ] QVCD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:25:51.756886] [INFO ] [MAIN ] QVCD: Generated 1806 derivative records from 4519 primary records. [2025-09-25T22:25:51.764292] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-25T22:25:51.793098] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1807 records). [2025-09-25T22:25:51.795897] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-25T22:25:51.800870] [INFO ] [MAIN ] Derivative Progress: 1481/2043 symbols completed. QUAD took 1.3s. Estimated remaining: 3m 56s. Rate: 142.7 symbols/min [2025-09-25T22:25:51.796361] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1806 records). [2025-09-25T22:25:51.801230] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:51.801525] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-25T22:25:51.805718] [INFO ] [MAIN ] Derivative Progress: 1482/2043 symbols completed. QVCD took 1.2s. Estimated remaining: 3m 56s. Rate: 142.8 symbols/min [2025-09-25T22:25:51.806262] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:51.852442] [DEBUG] [LOCAL ] QXO: Loaded 53574 existing records from primary storage. [2025-09-25T22:25:51.852850] [INFO ] [MAIN ] QXO: Loaded 53574 primary data records. [2025-09-25T22:25:51.930589] [DEBUG] [LOCAL ] RA: Loaded 21803 existing records from primary storage. [2025-09-25T22:25:51.953302] [INFO ] [MAIN ] RA: Loaded 21803 primary data records. [2025-09-25T22:25:52.097637] [DEBUG] [LOCAL ] R: Loaded 29533 existing records from primary storage. [2025-09-25T22:25:52.207740] [INFO ] [MAIN ] R: Loaded 29533 primary data records. [2025-09-25T22:25:53.008491] [DEBUG] [MAIN ] QXO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:25:53.010842] [INFO ] [MAIN ] QXO: Generated 1806 derivative records from 53574 primary records. [2025-09-25T22:25:53.010973] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-25T22:25:53.036791] [DEBUG] [LOCAL ] QXO: Derivative data saved (1806 records). [2025-09-25T22:25:53.037547] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-25T22:25:53.053836] [INFO ] [MAIN ] Derivative Progress: 1483/2043 symbols completed. QXO took 1.3s. Estimated remaining: 3m 56s. Rate: 142.6 symbols/min [2025-09-25T22:25:53.054810] [DEBUG] [MAIN ] RA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:53.056450] [INFO ] [MAIN ] RA: Generated 1807 derivative records from 21803 primary records. [2025-09-25T22:25:53.056575] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-25T22:25:53.087998] [DEBUG] [MAIN ] R: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:53.089701] [INFO ] [MAIN ] R: Generated 1807 derivative records from 29533 primary records. [2025-09-25T22:25:53.090025] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-25T22:25:53.092325] [DEBUG] [LOCAL ] RA: Derivative data saved (1807 records). [2025-09-25T22:25:53.092517] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-25T22:25:53.096536] [INFO ] [MAIN ] Derivative Progress: 1484/2043 symbols completed. RA took 1.3s. Estimated remaining: 3m 55s. Rate: 142.7 symbols/min [2025-09-25T22:25:53.112381] [DEBUG] [LOCAL ] R: Derivative data saved (1807 records). [2025-09-25T22:25:53.112509] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-25T22:25:53.115200] [INFO ] [MAIN ] Derivative Progress: 1485/2043 symbols completed. R took 1.3s. Estimated remaining: 3m 55s. Rate: 142.7 symbols/min [2025-09-25T22:25:53.116016] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:53.116341] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:53.116513] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:53.173548] [DEBUG] [LOCAL ] RACE: Loaded 33135 existing records from primary storage. [2025-09-25T22:25:53.196711] [INFO ] [MAIN ] RACE: Loaded 33135 primary data records. [2025-09-25T22:25:53.235983] [DEBUG] [LOCAL ] RAMP: Loaded 37942 existing records from primary storage. [2025-09-25T22:25:53.265930] [INFO ] [MAIN ] RAMP: Loaded 37942 primary data records. [2025-09-25T22:25:53.407418] [DEBUG] [LOCAL ] RBA: Loaded 46238 existing records from primary storage. [2025-09-25T22:25:53.428806] [INFO ] [MAIN ] RBA: Loaded 46238 primary data records. [2025-09-25T22:25:54.273797] [DEBUG] [MAIN ] RACE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:54.275249] [INFO ] [MAIN ] RACE: Generated 1807 derivative records from 33135 primary records. [2025-09-25T22:25:54.278324] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-25T22:25:54.297769] [DEBUG] [LOCAL ] RACE: Derivative data saved (1807 records). [2025-09-25T22:25:54.298099] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-25T22:25:54.300688] [INFO ] [MAIN ] Derivative Progress: 1486/2043 symbols completed. RACE took 1.2s. Estimated remaining: 3m 54s. Rate: 142.6 symbols/min [2025-09-25T22:25:54.301247] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:54.331424] [DEBUG] [MAIN ] RBA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:54.345960] [INFO ] [MAIN ] RBA: Generated 1807 derivative records from 46238 primary records. [2025-09-25T22:25:54.358718] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-25T22:25:54.362027] [DEBUG] [LOCAL ] RBC: Loaded 15246 existing records from primary storage. [2025-09-25T22:25:54.369987] [INFO ] [MAIN ] RBC: Loaded 15246 primary data records. [2025-09-25T22:25:54.370497] [DEBUG] [MAIN ] RAMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:54.400233] [INFO ] [MAIN ] RAMP: Generated 1807 derivative records from 37942 primary records. [2025-09-25T22:25:54.417148] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-25T22:25:54.437154] [DEBUG] [LOCAL ] RBA: Derivative data saved (1807 records). [2025-09-25T22:25:54.446274] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-25T22:25:54.457491] [INFO ] [MAIN ] Derivative Progress: 1487/2043 symbols completed. RBA took 1.3s. Estimated remaining: 3m 54s. Rate: 142.6 symbols/min [2025-09-25T22:25:54.491247] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1807 records). [2025-09-25T22:25:54.518674] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-25T22:25:54.502236] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:54.526211] [INFO ] [MAIN ] Derivative Progress: 1488/2043 symbols completed. RAMP took 1.4s. Estimated remaining: 3m 53s. Rate: 142.7 symbols/min [2025-09-25T22:25:54.527198] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:54.620396] [DEBUG] [LOCAL ] RBOT: Loaded 5178 existing records from primary storage. [2025-09-25T22:25:54.745807] [INFO ] [MAIN ] RBOT: Loaded 5178 primary data records. [2025-09-25T22:25:55.150120] [DEBUG] [LOCAL ] RBLX: Loaded 54107 existing records from primary storage. [2025-09-25T22:25:55.160387] [INFO ] [MAIN ] RBLX: Loaded 54107 primary data records. [2025-09-25T22:25:55.279313] [DEBUG] [MAIN ] RBC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:55.292122] [INFO ] [MAIN ] RBC: Generated 1807 derivative records from 15246 primary records. [2025-09-25T22:25:55.304526] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-25T22:25:55.413820] [DEBUG] [LOCAL ] RBC: Derivative data saved (1807 records). [2025-09-25T22:25:55.414377] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-25T22:25:55.533120] [INFO ] [MAIN ] Derivative Progress: 1489/2043 symbols completed. RBC took 1.2s. Estimated remaining: 3m 53s. Rate: 142.6 symbols/min [2025-09-25T22:25:55.551086] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:55.580373] [DEBUG] [MAIN ] RBOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:55.584185] [INFO ] [MAIN ] RBOT: Generated 1807 derivative records from 5178 primary records. [2025-09-25T22:25:55.585681] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-25T22:25:55.603095] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1807 records). [2025-09-25T22:25:55.603392] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-25T22:25:55.606590] [INFO ] [MAIN ] Derivative Progress: 1490/2043 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 53s. Rate: 142.7 symbols/min [2025-09-25T22:25:55.607413] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:55.643375] [DEBUG] [MAIN ] RBLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:55.644479] [INFO ] [MAIN ] RBLX: Generated 1807 derivative records from 54107 primary records. [2025-09-25T22:25:55.644715] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-25T22:25:55.663870] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1807 records). [2025-09-25T22:25:55.664128] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-25T22:25:55.682891] [INFO ] [MAIN ] Derivative Progress: 1491/2043 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 52s. Rate: 142.7 symbols/min [2025-09-25T22:25:55.683567] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:55.685798] [DEBUG] [LOCAL ] RBRK: Loaded 53507 existing records from primary storage. [2025-09-25T22:25:55.686004] [INFO ] [MAIN ] RBRK: Loaded 53507 primary data records. [2025-09-25T22:25:55.962957] [DEBUG] [LOCAL ] RC: Loaded 49317 existing records from primary storage. [2025-09-25T22:25:56.038127] [INFO ] [MAIN ] RC: Loaded 49317 primary data records. [2025-09-25T22:25:56.190397] [DEBUG] [LOCAL ] RCI: Loaded 49060 existing records from primary storage. [2025-09-25T22:25:56.237800] [INFO ] [MAIN ] RCI: Loaded 49060 primary data records. [2025-09-25T22:25:56.753362] [DEBUG] [MAIN ] RBRK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:56.766105] [INFO ] [MAIN ] RBRK: Generated 1807 derivative records from 53507 primary records. [2025-09-25T22:25:56.766461] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-25T22:25:56.787014] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1807 records). [2025-09-25T22:25:56.787127] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-25T22:25:56.790894] [INFO ] [MAIN ] Derivative Progress: 1492/2043 symbols completed. RBRK took 1.3s. Estimated remaining: 3m 52s. Rate: 142.6 symbols/min [2025-09-25T22:25:56.792603] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:56.823886] [DEBUG] [MAIN ] RC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:56.824183] [DEBUG] [LOCAL ] RCS: Loaded 11526 existing records from primary storage. [2025-09-25T22:25:56.825271] [INFO ] [MAIN ] RC: Generated 1807 derivative records from 49317 primary records. [2025-09-25T22:25:56.825550] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-25T22:25:56.825682] [INFO ] [MAIN ] RCS: Loaded 11526 primary data records. [2025-09-25T22:25:56.891284] [DEBUG] [LOCAL ] RC: Derivative data saved (1807 records). [2025-09-25T22:25:56.925884] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-25T22:25:56.949146] [INFO ] [MAIN ] Derivative Progress: 1493/2043 symbols completed. RC took 1.3s. Estimated remaining: 3m 51s. Rate: 142.6 symbols/min [2025-09-25T22:25:56.953610] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:57.061311] [DEBUG] [MAIN ] RCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:57.239762] [INFO ] [MAIN ] RCI: Generated 1807 derivative records from 49060 primary records. [2025-09-25T22:25:57.245314] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-25T22:25:57.286338] [DEBUG] [LOCAL ] RCI: Derivative data saved (1807 records). [2025-09-25T22:25:57.287050] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-25T22:25:57.290923] [INFO ] [MAIN ] Derivative Progress: 1494/2043 symbols completed. RCI took 1.6s. Estimated remaining: 3m 51s. Rate: 142.7 symbols/min [2025-09-25T22:25:57.292147] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:57.308984] [DEBUG] [LOCAL ] RCUS: Loaded 42949 existing records from primary storage. [2025-09-25T22:25:57.309561] [INFO ] [MAIN ] RCUS: Loaded 42949 primary data records. [2025-09-25T22:25:57.652425] [DEBUG] [MAIN ] RCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:57.653699] [INFO ] [MAIN ] RCS: Generated 1807 derivative records from 11526 primary records. [2025-09-25T22:25:57.654682] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-25T22:25:57.674020] [DEBUG] [LOCAL ] RDN: Loaded 45605 existing records from primary storage. [2025-09-25T22:25:57.686414] [INFO ] [MAIN ] RDN: Loaded 45605 primary data records. [2025-09-25T22:25:57.692118] [DEBUG] [LOCAL ] RCS: Derivative data saved (1807 records). [2025-09-25T22:25:57.705612] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-25T22:25:57.718391] [INFO ] [MAIN ] Derivative Progress: 1495/2043 symbols completed. RCS took 0.9s. Estimated remaining: 3m 50s. Rate: 142.7 symbols/min [2025-09-25T22:25:57.729566] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:58.042337] [DEBUG] [MAIN ] RCUS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:58.043901] [INFO ] [MAIN ] RCUS: Generated 1807 derivative records from 42949 primary records. [2025-09-25T22:25:58.044167] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-25T22:25:58.079966] [DEBUG] [LOCAL ] RDW: Loaded 52404 existing records from primary storage. [2025-09-25T22:25:58.081093] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1807 records). [2025-09-25T22:25:58.081324] [INFO ] [MAIN ] RDW: Loaded 52404 primary data records. [2025-09-25T22:25:58.081850] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-25T22:25:58.086124] [INFO ] [MAIN ] Derivative Progress: 1496/2043 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 50s. Rate: 142.7 symbols/min [2025-09-25T22:25:58.098253] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:58.279536] [DEBUG] [MAIN ] RDN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:58.292487] [INFO ] [MAIN ] RDN: Generated 1807 derivative records from 45605 primary records. [2025-09-25T22:25:58.292729] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-25T22:25:58.480692] [DEBUG] [LOCAL ] RDN: Derivative data saved (1807 records). [2025-09-25T22:25:58.481126] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-25T22:25:58.484877] [INFO ] [MAIN ] Derivative Progress: 1497/2043 symbols completed. RDN took 1.2s. Estimated remaining: 3m 50s. Rate: 142.7 symbols/min [2025-09-25T22:25:58.485329] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:58.504843] [DEBUG] [LOCAL ] RDY: Loaded 47087 existing records from primary storage. [2025-09-25T22:25:58.506354] [INFO ] [MAIN ] RDY: Loaded 47087 primary data records. [2025-09-25T22:25:58.873027] [DEBUG] [LOCAL ] RELX: Loaded 48211 existing records from primary storage. [2025-09-25T22:25:58.894750] [INFO ] [MAIN ] RELX: Loaded 48211 primary data records. [2025-09-25T22:25:58.895409] [DEBUG] [MAIN ] RDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:58.936681] [INFO ] [MAIN ] RDW: Generated 1807 derivative records from 52404 primary records. [2025-09-25T22:25:58.967818] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-25T22:25:59.032400] [DEBUG] [LOCAL ] RDW: Derivative data saved (1807 records). [2025-09-25T22:25:59.044018] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-25T22:25:59.047991] [INFO ] [MAIN ] Derivative Progress: 1498/2043 symbols completed. RDW took 1.3s. Estimated remaining: 3m 49s. Rate: 142.6 symbols/min [2025-09-25T22:25:59.329465] [DEBUG] [MAIN ] RDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:59.331696] [INFO ] [MAIN ] RDY: Generated 1807 derivative records from 47087 primary records. [2025-09-25T22:25:59.331791] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-25T22:25:59.350720] [DEBUG] [LOCAL ] RDY: Derivative data saved (1807 records). [2025-09-25T22:25:59.351821] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-25T22:25:59.354673] [INFO ] [MAIN ] Derivative Progress: 1499/2043 symbols completed. RDY took 1.3s. Estimated remaining: 3m 49s. Rate: 142.7 symbols/min [2025-09-25T22:25:59.374837] [DEBUG] [MAIN ] RELX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:25:59.375603] [INFO ] [MAIN ] RELX: Generated 1807 derivative records from 48211 primary records. [2025-09-25T22:25:59.375689] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-25T22:25:59.392164] [DEBUG] [LOCAL ] RELX: Derivative data saved (1807 records). [2025-09-25T22:25:59.392270] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-25T22:25:59.394952] [INFO ] [MAIN ] Derivative Progress: 1500/2043 symbols completed. RELX took 0.9s. Estimated remaining: 3m 48s. Rate: 142.8 symbols/min [2025-09-25T22:25:59.395989] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:59.396320] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:59.396731] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:25:59.446077] [DEBUG] [LOCAL ] RERE: Loaded 41364 existing records from primary storage. [2025-09-25T22:25:59.446295] [INFO ] [MAIN ] RERE: Loaded 41364 primary data records. [2025-09-25T22:25:59.625014] [DEBUG] [LOCAL ] REVG: Loaded 41220 existing records from primary storage. [2025-09-25T22:25:59.649507] [INFO ] [MAIN ] REVG: Loaded 41220 primary data records. [2025-09-25T22:25:59.689460] [DEBUG] [LOCAL ] RES: Loaded 47879 existing records from primary storage. [2025-09-25T22:25:59.749703] [INFO ] [MAIN ] RES: Loaded 47879 primary data records. [2025-09-25T22:26:00.560108] [DEBUG] [MAIN ] RERE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:00.562291] [INFO ] [MAIN ] RERE: Generated 1807 derivative records from 41364 primary records. [2025-09-25T22:26:00.563040] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-25T22:26:00.581815] [DEBUG] [LOCAL ] RERE: Derivative data saved (1807 records). [2025-09-25T22:26:00.582178] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-25T22:26:00.584962] [INFO ] [MAIN ] Derivative Progress: 1501/2043 symbols completed. RERE took 1.2s. Estimated remaining: 3m 48s. Rate: 142.6 symbols/min [2025-09-25T22:26:00.585531] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:00.630236] [DEBUG] [MAIN ] REVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:00.637931] [INFO ] [MAIN ] REVG: Generated 1807 derivative records from 41220 primary records. [2025-09-25T22:26:00.638638] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-25T22:26:00.636831] [DEBUG] [MAIN ] RES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:00.640292] [DEBUG] [LOCAL ] REX: Loaded 14094 existing records from primary storage. [2025-09-25T22:26:00.641802] [INFO ] [MAIN ] RES: Generated 1807 derivative records from 47879 primary records. [2025-09-25T22:26:00.649305] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-25T22:26:00.650464] [INFO ] [MAIN ] REX: Loaded 14094 primary data records. [2025-09-25T22:26:00.749758] [DEBUG] [LOCAL ] RES: Derivative data saved (1807 records). [2025-09-25T22:26:00.768067] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-25T22:26:00.778492] [INFO ] [MAIN ] Derivative Progress: 1502/2043 symbols completed. RES took 1.4s. Estimated remaining: 3m 48s. Rate: 142.6 symbols/min [2025-09-25T22:26:00.796217] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:00.813954] [DEBUG] [LOCAL ] REVG: Derivative data saved (1807 records). [2025-09-25T22:26:00.831289] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-25T22:26:00.847895] [INFO ] [MAIN ] Derivative Progress: 1503/2043 symbols completed. REVG took 1.5s. Estimated remaining: 3m 47s. Rate: 142.7 symbols/min [2025-09-25T22:26:00.892577] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:01.073222] [DEBUG] [MAIN ] REX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:01.074224] [INFO ] [MAIN ] REX: Generated 1807 derivative records from 14094 primary records. [2025-09-25T22:26:01.074315] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-25T22:26:01.124036] [DEBUG] [LOCAL ] REXR: Loaded 52467 existing records from primary storage. [2025-09-25T22:26:01.125434] [INFO ] [MAIN ] REXR: Loaded 52467 primary data records. [2025-09-25T22:26:01.125286] [DEBUG] [LOCAL ] REX: Derivative data saved (1807 records). [2025-09-25T22:26:01.126376] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-25T22:26:01.134201] [INFO ] [MAIN ] Derivative Progress: 1504/2043 symbols completed. REX took 0.5s. Estimated remaining: 3m 47s. Rate: 142.7 symbols/min [2025-09-25T22:26:01.199585] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:01.201035] [DEBUG] [LOCAL ] REZI: Loaded 47235 existing records from primary storage. [2025-09-25T22:26:01.217202] [INFO ] [MAIN ] REZI: Loaded 47235 primary data records. [2025-09-25T22:26:01.953794] [DEBUG] [LOCAL ] RF: Loaded 54020 existing records from primary storage. [2025-09-25T22:26:01.956043] [INFO ] [MAIN ] RF: Loaded 54020 primary data records. [2025-09-25T22:26:02.320615] [DEBUG] [MAIN ] REXR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:02.321856] [INFO ] [MAIN ] REXR: Generated 1807 derivative records from 52467 primary records. [2025-09-25T22:26:02.322046] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-25T22:26:02.336756] [DEBUG] [MAIN ] REZI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:02.352198] [INFO ] [MAIN ] REZI: Generated 1807 derivative records from 47235 primary records. [2025-09-25T22:26:02.359348] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-25T22:26:02.359194] [DEBUG] [LOCAL ] REXR: Derivative data saved (1807 records). [2025-09-25T22:26:02.360148] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-25T22:26:02.363583] [INFO ] [MAIN ] Derivative Progress: 1505/2043 symbols completed. REXR took 1.6s. Estimated remaining: 3m 46s. Rate: 142.6 symbols/min [2025-09-25T22:26:02.365298] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:02.383910] [DEBUG] [LOCAL ] REZI: Derivative data saved (1807 records). [2025-09-25T22:26:02.384461] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-25T22:26:02.386713] [INFO ] [MAIN ] Derivative Progress: 1506/2043 symbols completed. REZI took 1.5s. Estimated remaining: 3m 46s. Rate: 142.6 symbols/min [2025-09-25T22:26:02.387334] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:02.419081] [DEBUG] [LOCAL ] RFI: Loaded 10508 existing records from primary storage. [2025-09-25T22:26:02.419548] [DEBUG] [MAIN ] RF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:02.425333] [DEBUG] [LOCAL ] RFL: Loaded 11000 existing records from primary storage. [2025-09-25T22:26:02.425478] [INFO ] [MAIN ] RFI: Loaded 10508 primary data records. [2025-09-25T22:26:02.426603] [INFO ] [MAIN ] RF: Generated 1807 derivative records from 54020 primary records. [2025-09-25T22:26:02.432381] [INFO ] [MAIN ] RFL: Loaded 11000 primary data records. [2025-09-25T22:26:02.432543] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-25T22:26:02.618920] [DEBUG] [LOCAL ] RF: Derivative data saved (1807 records). [2025-09-25T22:26:02.655826] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-25T22:26:02.680694] [INFO ] [MAIN ] Derivative Progress: 1507/2043 symbols completed. RF took 1.5s. Estimated remaining: 3m 45s. Rate: 142.7 symbols/min [2025-09-25T22:26:02.716262] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:03.141303] [DEBUG] [LOCAL ] RFM: Loaded 4168 existing records from primary storage. [2025-09-25T22:26:03.141565] [INFO ] [MAIN ] RFM: Loaded 4168 primary data records. [2025-09-25T22:26:03.497008] [DEBUG] [MAIN ] RFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:03.499384] [INFO ] [MAIN ] RFI: Generated 1807 derivative records from 10508 primary records. [2025-09-25T22:26:03.512536] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-25T22:26:03.513376] [DEBUG] [MAIN ] RFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:03.516401] [INFO ] [MAIN ] RFL: Generated 1807 derivative records from 11000 primary records. [2025-09-25T22:26:03.523741] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-25T22:26:03.551612] [DEBUG] [LOCAL ] RFI: Derivative data saved (1807 records). [2025-09-25T22:26:03.556090] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-25T22:26:03.555604] [DEBUG] [LOCAL ] RFL: Derivative data saved (1807 records). [2025-09-25T22:26:03.559104] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-25T22:26:03.558740] [INFO ] [MAIN ] Derivative Progress: 1508/2043 symbols completed. RFI took 1.2s. Estimated remaining: 3m 45s. Rate: 142.6 symbols/min [2025-09-25T22:26:03.574743] [INFO ] [MAIN ] Derivative Progress: 1509/2043 symbols completed. RFL took 1.2s. Estimated remaining: 3m 45s. Rate: 142.7 symbols/min [2025-09-25T22:26:03.574605] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:03.576042] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:03.575202] [DEBUG] [MAIN ] RFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:03.577496] [INFO ] [MAIN ] RFM: Generated 1807 derivative records from 4168 primary records. [2025-09-25T22:26:03.577905] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-25T22:26:03.608304] [DEBUG] [LOCAL ] RFM: Derivative data saved (1807 records). [2025-09-25T22:26:03.608461] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-25T22:26:03.612448] [INFO ] [MAIN ] Derivative Progress: 1510/2043 symbols completed. RFM took 0.9s. Estimated remaining: 3m 44s. Rate: 142.8 symbols/min [2025-09-25T22:26:03.608863] [DEBUG] [LOCAL ] RFMZ: Loaded 8769 existing records from primary storage. [2025-09-25T22:26:03.613072] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:03.613307] [INFO ] [MAIN ] RFMZ: Loaded 8769 primary data records. [2025-09-25T22:26:03.760357] [DEBUG] [LOCAL ] RGA: Loaded 30376 existing records from primary storage. [2025-09-25T22:26:03.794293] [INFO ] [MAIN ] RGA: Loaded 30376 primary data records. [2025-09-25T22:26:03.827235] [DEBUG] [LOCAL ] RGR: Loaded 20534 existing records from primary storage. [2025-09-25T22:26:03.866900] [INFO ] [MAIN ] RGR: Loaded 20534 primary data records. [2025-09-25T22:26:04.717325] [DEBUG] [MAIN ] RFMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:04.731015] [INFO ] [MAIN ] RFMZ: Generated 1807 derivative records from 8769 primary records. [2025-09-25T22:26:04.731631] [DEBUG] [MAIN ] RGA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:04.731294] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-25T22:26:04.732580] [INFO ] [MAIN ] RGA: Generated 1807 derivative records from 30376 primary records. [2025-09-25T22:26:04.733886] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-25T22:26:04.750460] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1807 records). [2025-09-25T22:26:04.750672] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-25T22:26:04.753635] [INFO ] [MAIN ] Derivative Progress: 1511/2043 symbols completed. RFMZ took 1.2s. Estimated remaining: 3m 44s. Rate: 142.6 symbols/min [2025-09-25T22:26:04.754547] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:04.788943] [DEBUG] [MAIN ] RGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:04.793156] [DEBUG] [LOCAL ] RGT: Loaded 2869 existing records from primary storage. [2025-09-25T22:26:04.789590] [DEBUG] [LOCAL ] RGA: Derivative data saved (1807 records). [2025-09-25T22:26:04.792957] [INFO ] [MAIN ] RGR: Generated 1807 derivative records from 20534 primary records. [2025-09-25T22:26:04.793405] [INFO ] [MAIN ] RGT: Loaded 2869 primary data records. [2025-09-25T22:26:04.798820] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-25T22:26:04.805211] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-25T22:26:04.841075] [INFO ] [MAIN ] Derivative Progress: 1512/2043 symbols completed. RGA took 1.3s. Estimated remaining: 3m 43s. Rate: 142.7 symbols/min [2025-09-25T22:26:04.888562] [DEBUG] [LOCAL ] RGR: Derivative data saved (1807 records). [2025-09-25T22:26:04.893928] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-25T22:26:04.879478] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:04.910504] [INFO ] [MAIN ] Derivative Progress: 1513/2043 symbols completed. RGR took 1.3s. Estimated remaining: 3m 43s. Rate: 142.7 symbols/min [2025-09-25T22:26:05.198407] [DEBUG] [MAIN ] RGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:05.199275] [INFO ] [MAIN ] RGT: Generated 1807 derivative records from 2869 primary records. [2025-09-25T22:26:05.199365] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-25T22:26:05.201127] [DEBUG] [LOCAL ] RH: Loaded 47979 existing records from primary storage. [2025-09-25T22:26:05.201743] [INFO ] [MAIN ] RH: Loaded 47979 primary data records. [2025-09-25T22:26:05.343449] [DEBUG] [LOCAL ] RGT: Derivative data saved (1807 records). [2025-09-25T22:26:05.379819] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-25T22:26:05.389400] [INFO ] [MAIN ] Derivative Progress: 1514/2043 symbols completed. RGT took 0.6s. Estimated remaining: 3m 42s. Rate: 142.7 symbols/min [2025-09-25T22:26:05.561048] [DEBUG] [MAIN ] RH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:05.561794] [INFO ] [MAIN ] RH: Generated 1807 derivative records from 47979 primary records. [2025-09-25T22:26:05.561887] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-25T22:26:05.578789] [DEBUG] [LOCAL ] RH: Derivative data saved (1807 records). [2025-09-25T22:26:05.578858] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-25T22:26:05.582098] [INFO ] [MAIN ] Derivative Progress: 1515/2043 symbols completed. RH took 0.7s. Estimated remaining: 3m 42s. Rate: 142.8 symbols/min [2025-09-25T22:26:05.583145] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:05.583370] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:05.584338] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:05.656684] [DEBUG] [LOCAL ] RHI: Loaded 49628 existing records from primary storage. [2025-09-25T22:26:05.670674] [INFO ] [MAIN ] RHI: Loaded 49628 primary data records. [2025-09-25T22:26:05.756143] [DEBUG] [LOCAL ] RHP: Loaded 42046 existing records from primary storage. [2025-09-25T22:26:05.801093] [INFO ] [MAIN ] RHP: Loaded 42046 primary data records. [2025-09-25T22:26:05.841670] [DEBUG] [LOCAL ] RIG: Loaded 54059 existing records from primary storage. [2025-09-25T22:26:05.933376] [INFO ] [MAIN ] RIG: Loaded 54059 primary data records. [2025-09-25T22:26:06.748166] [DEBUG] [MAIN ] RHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:06.751261] [INFO ] [MAIN ] RHI: Generated 1807 derivative records from 49628 primary records. [2025-09-25T22:26:06.751367] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-25T22:26:06.778099] [DEBUG] [MAIN ] RHP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:06.778978] [INFO ] [MAIN ] RHP: Generated 1807 derivative records from 42046 primary records. [2025-09-25T22:26:06.779393] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-25T22:26:06.803800] [DEBUG] [LOCAL ] RHP: Derivative data saved (1807 records). [2025-09-25T22:26:06.805594] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-25T22:26:06.810140] [INFO ] [MAIN ] Derivative Progress: 1516/2043 symbols completed. RHP took 1.2s. Estimated remaining: 3m 42s. Rate: 142.6 symbols/min [2025-09-25T22:26:06.811387] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:06.812365] [DEBUG] [LOCAL ] RHI: Derivative data saved (1807 records). [2025-09-25T22:26:06.813150] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-25T22:26:06.832166] [INFO ] [MAIN ] Derivative Progress: 1517/2043 symbols completed. RHI took 1.2s. Estimated remaining: 3m 41s. Rate: 142.7 symbols/min [2025-09-25T22:26:06.833424] [DEBUG] [MAIN ] RIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:06.835115] [INFO ] [MAIN ] RIG: Generated 1807 derivative records from 54059 primary records. [2025-09-25T22:26:06.834104] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:06.835286] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-25T22:26:06.854768] [DEBUG] [LOCAL ] RIG: Derivative data saved (1807 records). [2025-09-25T22:26:06.854968] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-25T22:26:06.858090] [INFO ] [MAIN ] Derivative Progress: 1518/2043 symbols completed. RIG took 1.3s. Estimated remaining: 3m 41s. Rate: 142.8 symbols/min [2025-09-25T22:26:06.858518] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:06.879272] [DEBUG] [LOCAL ] RIV: Loaded 12070 existing records from primary storage. [2025-09-25T22:26:06.879604] [INFO ] [MAIN ] RIV: Loaded 12070 primary data records. [2025-09-25T22:26:07.277627] [DEBUG] [LOCAL ] RITM: Loaded 53206 existing records from primary storage. [2025-09-25T22:26:07.280298] [INFO ] [MAIN ] RITM: Loaded 53206 primary data records. [2025-09-25T22:26:07.279266] [DEBUG] [LOCAL ] RIO: Loaded 53783 existing records from primary storage. [2025-09-25T22:26:07.286689] [INFO ] [MAIN ] RIO: Loaded 53783 primary data records. [2025-09-25T22:26:08.087588] [DEBUG] [MAIN ] RIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:08.089516] [INFO ] [MAIN ] RIV: Generated 1807 derivative records from 12070 primary records. [2025-09-25T22:26:08.090094] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-25T22:26:08.110619] [DEBUG] [LOCAL ] RIV: Derivative data saved (1807 records). [2025-09-25T22:26:08.111004] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-25T22:26:08.113896] [INFO ] [MAIN ] Derivative Progress: 1519/2043 symbols completed. RIV took 1.3s. Estimated remaining: 3m 40s. Rate: 142.6 symbols/min [2025-09-25T22:26:08.114389] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:08.134027] [DEBUG] [MAIN ] RITM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:08.135180] [INFO ] [MAIN ] RITM: Generated 1807 derivative records from 53206 primary records. [2025-09-25T22:26:08.135558] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-25T22:26:08.172225] [DEBUG] [LOCAL ] RITM: Derivative data saved (1807 records). [2025-09-25T22:26:08.172904] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-25T22:26:08.176013] [DEBUG] [MAIN ] RIO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:08.175590] [INFO ] [MAIN ] Derivative Progress: 1520/2043 symbols completed. RITM took 1.3s. Estimated remaining: 3m 40s. Rate: 142.7 symbols/min [2025-09-25T22:26:08.176534] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:08.177588] [INFO ] [MAIN ] RIO: Generated 1807 derivative records from 53783 primary records. [2025-09-25T22:26:08.177731] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-25T22:26:08.208814] [DEBUG] [LOCAL ] RIO: Derivative data saved (1807 records). [2025-09-25T22:26:08.209097] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-25T22:26:08.211705] [INFO ] [MAIN ] Derivative Progress: 1521/2043 symbols completed. RIO took 1.4s. Estimated remaining: 3m 39s. Rate: 142.8 symbols/min [2025-09-25T22:26:08.212178] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:08.236851] [DEBUG] [LOCAL ] RJF: Loaded 47455 existing records from primary storage. [2025-09-25T22:26:08.237161] [INFO ] [MAIN ] RJF: Loaded 47455 primary data records. [2025-09-25T22:26:08.614337] [DEBUG] [LOCAL ] RKT: Loaded 54111 existing records from primary storage. [2025-09-25T22:26:08.616345] [INFO ] [MAIN ] RKT: Loaded 54111 primary data records. [2025-09-25T22:26:08.615375] [DEBUG] [LOCAL ] RL: Loaded 41765 existing records from primary storage. [2025-09-25T22:26:08.616946] [INFO ] [MAIN ] RL: Loaded 41765 primary data records. [2025-09-25T22:26:09.301348] [DEBUG] [MAIN ] RJF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:09.302536] [INFO ] [MAIN ] RJF: Generated 1807 derivative records from 47455 primary records. [2025-09-25T22:26:09.303102] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-25T22:26:09.326385] [DEBUG] [LOCAL ] RJF: Derivative data saved (1807 records). [2025-09-25T22:26:09.327035] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-25T22:26:09.330678] [INFO ] [MAIN ] Derivative Progress: 1522/2043 symbols completed. RJF took 1.2s. Estimated remaining: 3m 39s. Rate: 142.6 symbols/min [2025-09-25T22:26:09.331066] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:09.360624] [DEBUG] [MAIN ] RKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:09.371136] [INFO ] [MAIN ] RKT: Generated 1807 derivative records from 54111 primary records. [2025-09-25T22:26:09.371381] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-25T22:26:09.392546] [DEBUG] [MAIN ] RL: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:26:09.405046] [DEBUG] [LOCAL ] RLI: Loaded 33549 existing records from primary storage. [2025-09-25T22:26:09.414166] [INFO ] [MAIN ] RL: Generated 1806 derivative records from 41765 primary records. [2025-09-25T22:26:09.419163] [INFO ] [MAIN ] RLI: Loaded 33549 primary data records. [2025-09-25T22:26:09.418792] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-25T22:26:09.518125] [DEBUG] [LOCAL ] RKT: Derivative data saved (1807 records). [2025-09-25T22:26:09.526156] [DEBUG] [LOCAL ] RL: Derivative data saved (1806 records). [2025-09-25T22:26:09.526286] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-25T22:26:09.533205] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-25T22:26:09.545960] [INFO ] [MAIN ] Derivative Progress: 1523/2043 symbols completed. RKT took 1.4s. Estimated remaining: 3m 39s. Rate: 142.6 symbols/min [2025-09-25T22:26:09.567361] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:09.568130] [INFO ] [MAIN ] Derivative Progress: 1524/2043 symbols completed. RL took 1.3s. Estimated remaining: 3m 38s. Rate: 142.7 symbols/min [2025-09-25T22:26:09.623631] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:09.792637] [DEBUG] [LOCAL ] RLTY: Loaded 11174 existing records from primary storage. [2025-09-25T22:26:09.793050] [INFO ] [MAIN ] RLTY: Loaded 11174 primary data records. [2025-09-25T22:26:10.007486] [DEBUG] [LOCAL ] RLJ: Loaded 48574 existing records from primary storage. [2025-09-25T22:26:10.051986] [INFO ] [MAIN ] RLJ: Loaded 48574 primary data records. [2025-09-25T22:26:10.183071] [DEBUG] [MAIN ] RLI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:10.200949] [INFO ] [MAIN ] RLI: Generated 1807 derivative records from 33549 primary records. [2025-09-25T22:26:10.211597] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-25T22:26:10.450762] [DEBUG] [LOCAL ] RLI: Derivative data saved (1807 records). [2025-09-25T22:26:10.458049] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-25T22:26:10.461046] [INFO ] [MAIN ] Derivative Progress: 1525/2043 symbols completed. RLI took 1.1s. Estimated remaining: 3m 38s. Rate: 142.6 symbols/min [2025-09-25T22:26:10.593601] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:10.615612] [DEBUG] [MAIN ] RLTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:10.616708] [INFO ] [MAIN ] RLTY: Generated 1807 derivative records from 11174 primary records. [2025-09-25T22:26:10.616895] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-25T22:26:10.637144] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1807 records). [2025-09-25T22:26:10.637379] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-25T22:26:10.639987] [INFO ] [MAIN ] Derivative Progress: 1526/2043 symbols completed. RLTY took 1.0s. Estimated remaining: 3m 37s. Rate: 142.7 symbols/min [2025-09-25T22:26:10.640490] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:10.664377] [DEBUG] [LOCAL ] RM: Loaded 7695 existing records from primary storage. [2025-09-25T22:26:10.694263] [DEBUG] [MAIN ] RLJ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:10.695128] [INFO ] [MAIN ] RLJ: Generated 1807 derivative records from 48574 primary records. [2025-09-25T22:26:10.693941] [INFO ] [MAIN ] RM: Loaded 7695 primary data records. [2025-09-25T22:26:10.700522] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-25T22:26:10.729074] [DEBUG] [LOCAL ] RLX: Loaded 48602 existing records from primary storage. [2025-09-25T22:26:10.765746] [INFO ] [MAIN ] RLX: Loaded 48602 primary data records. [2025-09-25T22:26:10.802429] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1807 records). [2025-09-25T22:26:10.834758] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-25T22:26:10.870565] [INFO ] [MAIN ] Derivative Progress: 1527/2043 symbols completed. RLJ took 1.3s. Estimated remaining: 3m 37s. Rate: 142.7 symbols/min [2025-09-25T22:26:11.016342] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:11.383742] [DEBUG] [LOCAL ] RMAX: Loaded 21993 existing records from primary storage. [2025-09-25T22:26:11.384953] [INFO ] [MAIN ] RMAX: Loaded 21993 primary data records. [2025-09-25T22:26:11.554815] [DEBUG] [MAIN ] RM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:11.593057] [INFO ] [MAIN ] RM: Generated 1807 derivative records from 7695 primary records. [2025-09-25T22:26:11.617000] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-25T22:26:11.780516] [DEBUG] [MAIN ] RLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:11.782838] [INFO ] [MAIN ] RLX: Generated 1807 derivative records from 48602 primary records. [2025-09-25T22:26:11.783317] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-25T22:26:11.785407] [DEBUG] [LOCAL ] RM: Derivative data saved (1807 records). [2025-09-25T22:26:11.803552] [DEBUG] [LOCAL ] RLX: Derivative data saved (1807 records). [2025-09-25T22:26:11.803876] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-25T22:26:11.807341] [INFO ] [MAIN ] Derivative Progress: 1528/2043 symbols completed. RLX took 1.2s. Estimated remaining: 3m 37s. Rate: 142.6 symbols/min [2025-09-25T22:26:11.793545] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-25T22:26:11.811635] [INFO ] [MAIN ] Derivative Progress: 1529/2043 symbols completed. RM took 1.2s. Estimated remaining: 3m 36s. Rate: 142.7 symbols/min [2025-09-25T22:26:11.830297] [DEBUG] [MAIN ] RMAX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:11.831096] [INFO ] [MAIN ] RMAX: Generated 1807 derivative records from 21993 primary records. [2025-09-25T22:26:11.831163] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-25T22:26:11.847194] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1807 records). [2025-09-25T22:26:11.847265] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-25T22:26:11.849845] [INFO ] [MAIN ] Derivative Progress: 1530/2043 symbols completed. RMAX took 0.9s. Estimated remaining: 3m 36s. Rate: 142.8 symbols/min [2025-09-25T22:26:11.851001] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:11.851207] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:11.851097] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:11.865021] [DEBUG] [LOCAL ] RMI: Loaded 4702 existing records from primary storage. [2025-09-25T22:26:11.865237] [INFO ] [MAIN ] RMI: Loaded 4702 primary data records. [2025-09-25T22:26:11.913114] [DEBUG] [LOCAL ] RMM: Loaded 10537 existing records from primary storage. [2025-09-25T22:26:11.926085] [INFO ] [MAIN ] RMM: Loaded 10537 primary data records. [2025-09-25T22:26:12.274847] [DEBUG] [LOCAL ] RMD: Loaded 42571 existing records from primary storage. [2025-09-25T22:26:12.411819] [INFO ] [MAIN ] RMD: Loaded 42571 primary data records. [2025-09-25T22:26:13.028857] [DEBUG] [MAIN ] RMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:13.030628] [INFO ] [MAIN ] RMI: Generated 1807 derivative records from 4702 primary records. [2025-09-25T22:26:13.031295] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-25T22:26:13.062538] [DEBUG] [MAIN ] RMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:13.065033] [INFO ] [MAIN ] RMM: Generated 1807 derivative records from 10537 primary records. [2025-09-25T22:26:13.066750] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-25T22:26:13.079838] [DEBUG] [LOCAL ] RMI: Derivative data saved (1807 records). [2025-09-25T22:26:13.087318] [DEBUG] [LOCAL ] RMM: Derivative data saved (1807 records). [2025-09-25T22:26:13.087461] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-25T22:26:13.090382] [INFO ] [MAIN ] Derivative Progress: 1531/2043 symbols completed. RMM took 1.2s. Estimated remaining: 3m 35s. Rate: 142.6 symbols/min [2025-09-25T22:26:13.085566] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-25T22:26:13.093260] [INFO ] [MAIN ] Derivative Progress: 1532/2043 symbols completed. RMI took 1.2s. Estimated remaining: 3m 35s. Rate: 142.7 symbols/min [2025-09-25T22:26:13.090764] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:13.094328] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:13.118335] [DEBUG] [LOCAL ] RMMZ: Loaded 4858 existing records from primary storage. [2025-09-25T22:26:13.118724] [DEBUG] [MAIN ] RMD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:13.119017] [INFO ] [MAIN ] RMMZ: Loaded 4858 primary data records. [2025-09-25T22:26:13.132159] [INFO ] [MAIN ] RMD: Generated 1807 derivative records from 42571 primary records. [2025-09-25T22:26:13.137234] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-25T22:26:13.236040] [DEBUG] [LOCAL ] RMT: Loaded 17611 existing records from primary storage. [2025-09-25T22:26:13.258387] [DEBUG] [LOCAL ] RMD: Derivative data saved (1807 records). [2025-09-25T22:26:13.262700] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-25T22:26:13.248714] [INFO ] [MAIN ] RMT: Loaded 17611 primary data records. [2025-09-25T22:26:13.265908] [INFO ] [MAIN ] Derivative Progress: 1533/2043 symbols completed. RMD took 1.4s. Estimated remaining: 3m 34s. Rate: 142.8 symbols/min [2025-09-25T22:26:13.271480] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:13.862401] [DEBUG] [LOCAL ] RNG: Loaded 48491 existing records from primary storage. [2025-09-25T22:26:13.863440] [INFO ] [MAIN ] RNG: Loaded 48491 primary data records. [2025-09-25T22:26:14.027390] [DEBUG] [MAIN ] RMMZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:14.074851] [INFO ] [MAIN ] RMMZ: Generated 1807 derivative records from 4858 primary records. [2025-09-25T22:26:14.084443] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-25T22:26:14.242824] [DEBUG] [MAIN ] RMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:14.245137] [INFO ] [MAIN ] RMT: Generated 1807 derivative records from 17611 primary records. [2025-09-25T22:26:14.245521] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-25T22:26:14.256502] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1807 records). [2025-09-25T22:26:14.260402] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-25T22:26:14.263445] [INFO ] [MAIN ] Derivative Progress: 1534/2043 symbols completed. RMMZ took 1.2s. Estimated remaining: 3m 34s. Rate: 142.6 symbols/min [2025-09-25T22:26:14.264424] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:14.271260] [DEBUG] [LOCAL ] RMT: Derivative data saved (1807 records). [2025-09-25T22:26:14.271758] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-25T22:26:14.274154] [INFO ] [MAIN ] Derivative Progress: 1535/2043 symbols completed. RMT took 1.2s. Estimated remaining: 3m 34s. Rate: 142.7 symbols/min [2025-09-25T22:26:14.274806] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:14.299565] [DEBUG] [MAIN ] RNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:14.304857] [INFO ] [MAIN ] RNG: Generated 1807 derivative records from 48491 primary records. [2025-09-25T22:26:14.312032] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-25T22:26:14.312467] [DEBUG] [LOCAL ] RNGR: Loaded 20559 existing records from primary storage. [2025-09-25T22:26:14.313006] [INFO ] [MAIN ] RNGR: Loaded 20559 primary data records. [2025-09-25T22:26:14.324767] [DEBUG] [LOCAL ] RNP: Loaded 15850 existing records from primary storage. [2025-09-25T22:26:14.349631] [INFO ] [MAIN ] RNP: Loaded 15850 primary data records. [2025-09-25T22:26:14.498986] [DEBUG] [LOCAL ] RNG: Derivative data saved (1807 records). [2025-09-25T22:26:14.537958] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-25T22:26:14.570962] [INFO ] [MAIN ] Derivative Progress: 1536/2043 symbols completed. RNG took 1.3s. Estimated remaining: 3m 33s. Rate: 142.7 symbols/min [2025-09-25T22:26:14.576675] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:15.065012] [DEBUG] [LOCAL ] RNR: Loaded 34424 existing records from primary storage. [2025-09-25T22:26:15.066610] [INFO ] [MAIN ] RNR: Loaded 34424 primary data records. [2025-09-25T22:26:15.215411] [DEBUG] [MAIN ] RNGR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:15.217946] [INFO ] [MAIN ] RNGR: Generated 1807 derivative records from 20559 primary records. [2025-09-25T22:26:15.248189] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-25T22:26:15.422516] [DEBUG] [MAIN ] RNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:15.434989] [INFO ] [MAIN ] RNP: Generated 1807 derivative records from 15850 primary records. [2025-09-25T22:26:15.436814] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-25T22:26:15.455219] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1807 records). [2025-09-25T22:26:15.456124] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-25T22:26:15.459174] [INFO ] [MAIN ] Derivative Progress: 1537/2043 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 33s. Rate: 142.6 symbols/min [2025-09-25T22:26:15.459971] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:15.466240] [DEBUG] [LOCAL ] RNP: Derivative data saved (1807 records). [2025-09-25T22:26:15.466392] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-25T22:26:15.468942] [INFO ] [MAIN ] Derivative Progress: 1538/2043 symbols completed. RNP took 1.2s. Estimated remaining: 3m 32s. Rate: 142.7 symbols/min [2025-09-25T22:26:15.469385] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:15.493855] [DEBUG] [MAIN ] RNR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:15.494724] [INFO ] [MAIN ] RNR: Generated 1807 derivative records from 34424 primary records. [2025-09-25T22:26:15.500746] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-25T22:26:15.526413] [DEBUG] [LOCAL ] RNR: Derivative data saved (1807 records). [2025-09-25T22:26:15.526790] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-25T22:26:15.535674] [INFO ] [MAIN ] Derivative Progress: 1539/2043 symbols completed. RNR took 1.0s. Estimated remaining: 3m 32s. Rate: 142.8 symbols/min [2025-09-25T22:26:15.537857] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:15.537545] [DEBUG] [LOCAL ] ROG: Loaded 23271 existing records from primary storage. [2025-09-25T22:26:15.538000] [INFO ] [MAIN ] ROG: Loaded 23271 primary data records. [2025-09-25T22:26:15.632950] [DEBUG] [LOCAL ] RNST: Loaded 37407 existing records from primary storage. [2025-09-25T22:26:15.653459] [INFO ] [MAIN ] RNST: Loaded 37407 primary data records. [2025-09-25T22:26:16.115030] [DEBUG] [LOCAL ] ROK: Loaded 44258 existing records from primary storage. [2025-09-25T22:26:16.238368] [INFO ] [MAIN ] ROK: Loaded 44258 primary data records. [2025-09-25T22:26:16.659152] [DEBUG] [MAIN ] ROG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:16.660838] [INFO ] [MAIN ] ROG: Generated 1807 derivative records from 23271 primary records. [2025-09-25T22:26:16.661155] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-25T22:26:16.684776] [DEBUG] [LOCAL ] ROG: Derivative data saved (1807 records). [2025-09-25T22:26:16.685848] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-25T22:26:16.688721] [INFO ] [MAIN ] Derivative Progress: 1540/2043 symbols completed. ROG took 1.2s. Estimated remaining: 3m 32s. Rate: 142.6 symbols/min [2025-09-25T22:26:16.689369] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:16.712291] [DEBUG] [MAIN ] RNST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:16.713513] [INFO ] [MAIN ] RNST: Generated 1807 derivative records from 37407 primary records. [2025-09-25T22:26:16.713799] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-25T22:26:16.753945] [DEBUG] [MAIN ] ROK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:16.756819] [INFO ] [MAIN ] ROK: Generated 1807 derivative records from 44258 primary records. [2025-09-25T22:26:16.757453] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-25T22:26:16.758914] [DEBUG] [LOCAL ] RNST: Derivative data saved (1807 records). [2025-09-25T22:26:16.759777] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-25T22:26:16.763284] [INFO ] [MAIN ] Derivative Progress: 1541/2043 symbols completed. RNST took 1.3s. Estimated remaining: 3m 31s. Rate: 142.7 symbols/min [2025-09-25T22:26:16.772365] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:16.797080] [DEBUG] [LOCAL ] ROK: Derivative data saved (1807 records). [2025-09-25T22:26:16.798104] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-25T22:26:16.800990] [INFO ] [MAIN ] Derivative Progress: 1542/2043 symbols completed. ROK took 1.3s. Estimated remaining: 3m 30s. Rate: 142.8 symbols/min [2025-09-25T22:26:16.816244] [INFO ] [MAIN ] RPT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:16.817776] [DEBUG] [LOCAL ] ROL: Loaded 50649 existing records from primary storage. [2025-09-25T22:26:16.818176] [INFO ] [MAIN ] ROL: Loaded 50649 primary data records. [2025-09-25T22:26:17.006512] [DEBUG] [LOCAL ] RPT: Loaded 19668 existing records from primary storage. [2025-09-25T22:26:17.036282] [INFO ] [MAIN ] RPT: Loaded 19668 primary data records. [2025-09-25T22:26:17.241215] [DEBUG] [LOCAL ] RPM: Loaded 41430 existing records from primary storage. [2025-09-25T22:26:17.270594] [INFO ] [MAIN ] RPM: Loaded 41430 primary data records. [2025-09-25T22:26:17.908615] [DEBUG] [MAIN ] ROL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:17.910904] [INFO ] [MAIN ] ROL: Generated 1807 derivative records from 50649 primary records. [2025-09-25T22:26:17.911406] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-25T22:26:17.936247] [DEBUG] [LOCAL ] ROL: Derivative data saved (1807 records). [2025-09-25T22:26:17.938813] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-25T22:26:17.942066] [INFO ] [MAIN ] Derivative Progress: 1543/2043 symbols completed. ROL took 1.3s. Estimated remaining: 3m 30s. Rate: 142.7 symbols/min [2025-09-25T22:26:17.957452] [DEBUG] [MAIN ] RPT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:17.958770] [INFO ] [MAIN ] RPT: Generated 1807 derivative records from 19668 primary records. [2025-09-25T22:26:17.958986] [DEBUG] [LOCAL ] RPT: Saving derivative data. [2025-09-25T22:26:17.990103] [DEBUG] [MAIN ] RPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:17.992892] [DEBUG] [LOCAL ] RPT: Derivative data saved (1807 records). [2025-09-25T22:26:17.994095] [INFO ] [MAIN ] RPM: Generated 1807 derivative records from 41430 primary records. [2025-09-25T22:26:17.994303] [INFO ] [MAIN ] RPT: Successfully saved derivative data. [2025-09-25T22:26:17.996984] [INFO ] [MAIN ] Derivative Progress: 1544/2043 symbols completed. RPT took 1.2s. Estimated remaining: 3m 30s. Rate: 142.7 symbols/min [2025-09-25T22:26:17.994215] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-25T22:26:18.014778] [DEBUG] [LOCAL ] RPM: Derivative data saved (1807 records). [2025-09-25T22:26:18.014910] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-25T22:26:18.021725] [INFO ] [MAIN ] Derivative Progress: 1545/2043 symbols completed. RPM took 1.3s. Estimated remaining: 3m 29s. Rate: 142.8 symbols/min [2025-09-25T22:26:18.022839] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:18.023279] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:18.023128] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:18.084792] [DEBUG] [LOCAL ] RQI: Loaded 29374 existing records from primary storage. [2025-09-25T22:26:18.085155] [INFO ] [MAIN ] RQI: Loaded 29374 primary data records. [2025-09-25T22:26:18.199865] [DEBUG] [LOCAL ] RRX: Loaded 41433 existing records from primary storage. [2025-09-25T22:26:18.228033] [INFO ] [MAIN ] RRX: Loaded 41433 primary data records. [2025-09-25T22:26:18.234760] [DEBUG] [LOCAL ] RRC: Loaded 53166 existing records from primary storage. [2025-09-25T22:26:18.248780] [INFO ] [MAIN ] RRC: Loaded 53166 primary data records. [2025-09-25T22:26:19.222476] [DEBUG] [MAIN ] RQI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:19.225089] [INFO ] [MAIN ] RQI: Generated 1807 derivative records from 29374 primary records. [2025-09-25T22:26:19.225467] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-25T22:26:19.245912] [DEBUG] [LOCAL ] RQI: Derivative data saved (1807 records). [2025-09-25T22:26:19.246333] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-25T22:26:19.249099] [INFO ] [MAIN ] Derivative Progress: 1546/2043 symbols completed. RQI took 1.2s. Estimated remaining: 3m 29s. Rate: 142.6 symbols/min [2025-09-25T22:26:19.249624] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:19.272336] [DEBUG] [MAIN ] RRX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:19.281224] [INFO ] [MAIN ] RRX: Generated 1807 derivative records from 41433 primary records. [2025-09-25T22:26:19.287624] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-25T22:26:19.288024] [DEBUG] [MAIN ] RRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:19.290204] [INFO ] [MAIN ] RRC: Generated 1807 derivative records from 53166 primary records. [2025-09-25T22:26:19.290403] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-25T22:26:19.327052] [DEBUG] [LOCAL ] RRX: Derivative data saved (1807 records). [2025-09-25T22:26:19.328013] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-25T22:26:19.332484] [INFO ] [MAIN ] Derivative Progress: 1547/2043 symbols completed. RRX took 1.3s. Estimated remaining: 3m 29s. Rate: 142.7 symbols/min [2025-09-25T22:26:19.334768] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:19.346530] [DEBUG] [LOCAL ] RRC: Derivative data saved (1807 records). [2025-09-25T22:26:19.346870] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-25T22:26:19.349974] [INFO ] [MAIN ] Derivative Progress: 1548/2043 symbols completed. RRC took 1.3s. Estimated remaining: 3m 28s. Rate: 142.8 symbols/min [2025-09-25T22:26:19.350702] [DEBUG] [LOCAL ] RS: Loaded 25703 existing records from primary storage. [2025-09-25T22:26:19.351294] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:19.351185] [INFO ] [MAIN ] RS: Loaded 25703 primary data records. [2025-09-25T22:26:19.389517] [DEBUG] [LOCAL ] RSF: Loaded 4145 existing records from primary storage. [2025-09-25T22:26:19.402141] [INFO ] [MAIN ] RSF: Loaded 4145 primary data records. [2025-09-25T22:26:20.036598] [DEBUG] [LOCAL ] RSG: Loaded 47849 existing records from primary storage. [2025-09-25T22:26:20.048877] [INFO ] [MAIN ] RSG: Loaded 47849 primary data records. [2025-09-25T22:26:20.411697] [DEBUG] [MAIN ] RS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:20.421509] [INFO ] [MAIN ] RS: Generated 1807 derivative records from 25703 primary records. [2025-09-25T22:26:20.427205] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-25T22:26:20.427545] [DEBUG] [MAIN ] RSF: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:26:20.430329] [INFO ] [MAIN ] RSF: Generated 1806 derivative records from 4145 primary records. [2025-09-25T22:26:20.430512] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-25T22:26:20.455206] [DEBUG] [LOCAL ] RS: Derivative data saved (1807 records). [2025-09-25T22:26:20.462101] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-25T22:26:20.465533] [INFO ] [MAIN ] Derivative Progress: 1549/2043 symbols completed. RS took 1.2s. Estimated remaining: 3m 28s. Rate: 142.7 symbols/min [2025-09-25T22:26:20.469982] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:20.469676] [DEBUG] [LOCAL ] RSF: Derivative data saved (1806 records). [2025-09-25T22:26:20.470318] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-25T22:26:20.473743] [INFO ] [MAIN ] Derivative Progress: 1550/2043 symbols completed. RSF took 1.1s. Estimated remaining: 3m 27s. Rate: 142.7 symbols/min [2025-09-25T22:26:20.475008] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:20.496905] [DEBUG] [MAIN ] RSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:20.498088] [INFO ] [MAIN ] RSG: Generated 1807 derivative records from 47849 primary records. [2025-09-25T22:26:20.498332] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-25T22:26:20.548282] [DEBUG] [LOCAL ] RSG: Derivative data saved (1807 records). [2025-09-25T22:26:20.549345] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-25T22:26:20.549226] [DEBUG] [LOCAL ] RSKD: Loaded 34089 existing records from primary storage. [2025-09-25T22:26:20.553867] [INFO ] [MAIN ] RSKD: Loaded 34089 primary data records. [2025-09-25T22:26:20.553744] [INFO ] [MAIN ] Derivative Progress: 1551/2043 symbols completed. RSG took 1.2s. Estimated remaining: 3m 27s. Rate: 142.8 symbols/min [2025-09-25T22:26:20.566308] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:20.682980] [DEBUG] [LOCAL ] RSI: Loaded 47388 existing records from primary storage. [2025-09-25T22:26:20.689303] [INFO ] [MAIN ] RSI: Loaded 47388 primary data records. [2025-09-25T22:26:21.071927] [DEBUG] [LOCAL ] RTO: Loaded 40564 existing records from primary storage. [2025-09-25T22:26:21.072507] [INFO ] [MAIN ] RTO: Loaded 40564 primary data records. [2025-09-25T22:26:21.711925] [DEBUG] [MAIN ] RSKD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:21.713710] [INFO ] [MAIN ] RSKD: Generated 1807 derivative records from 34089 primary records. [2025-09-25T22:26:21.715448] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-25T22:26:21.735105] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1807 records). [2025-09-25T22:26:21.735828] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-25T22:26:21.743014] [INFO ] [MAIN ] Derivative Progress: 1552/2043 symbols completed. RSKD took 1.3s. Estimated remaining: 3m 27s. Rate: 142.6 symbols/min [2025-09-25T22:26:21.746966] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:21.763374] [DEBUG] [MAIN ] RSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:21.764584] [INFO ] [MAIN ] RSI: Generated 1807 derivative records from 47388 primary records. [2025-09-25T22:26:21.765183] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-25T22:26:21.783157] [DEBUG] [LOCAL ] RSI: Derivative data saved (1807 records). [2025-09-25T22:26:21.783696] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-25T22:26:21.786686] [INFO ] [MAIN ] Derivative Progress: 1553/2043 symbols completed. RSI took 1.3s. Estimated remaining: 3m 26s. Rate: 142.7 symbols/min [2025-09-25T22:26:21.787388] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:21.807415] [DEBUG] [MAIN ] RTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:21.808415] [INFO ] [MAIN ] RTO: Generated 1807 derivative records from 40564 primary records. [2025-09-25T22:26:21.808888] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-25T22:26:21.849320] [DEBUG] [LOCAL ] RTO: Derivative data saved (1807 records). [2025-09-25T22:26:21.849704] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-25T22:26:21.853865] [INFO ] [MAIN ] Derivative Progress: 1554/2043 symbols completed. RTO took 1.3s. Estimated remaining: 3m 25s. Rate: 142.8 symbols/min [2025-09-25T22:26:21.854417] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:21.889082] [DEBUG] [LOCAL ] RTX: Loaded 54098 existing records from primary storage. [2025-09-25T22:26:21.889477] [INFO ] [MAIN ] RTX: Loaded 54098 primary data records. [2025-09-25T22:26:22.053110] [DEBUG] [LOCAL ] RVT: Loaded 27248 existing records from primary storage. [2025-09-25T22:26:22.078585] [INFO ] [MAIN ] RVT: Loaded 27248 primary data records. [2025-09-25T22:26:22.065192] [DEBUG] [LOCAL ] RVLV: Loaded 48170 existing records from primary storage. [2025-09-25T22:26:22.140601] [INFO ] [MAIN ] RVLV: Loaded 48170 primary data records. [2025-09-25T22:26:22.976184] [DEBUG] [MAIN ] RTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:22.977420] [INFO ] [MAIN ] RTX: Generated 1807 derivative records from 54098 primary records. [2025-09-25T22:26:22.977793] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-25T22:26:22.998308] [DEBUG] [LOCAL ] RTX: Derivative data saved (1807 records). [2025-09-25T22:26:22.998850] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-25T22:26:23.002703] [INFO ] [MAIN ] Derivative Progress: 1555/2043 symbols completed. RTX took 1.3s. Estimated remaining: 3m 25s. Rate: 142.6 symbols/min [2025-09-25T22:26:23.003741] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:23.022745] [DEBUG] [MAIN ] RVT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:23.023977] [INFO ] [MAIN ] RVT: Generated 1807 derivative records from 27248 primary records. [2025-09-25T22:26:23.025316] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-25T22:26:23.057891] [DEBUG] [LOCAL ] RVT: Derivative data saved (1807 records). [2025-09-25T22:26:23.058318] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-25T22:26:23.061854] [INFO ] [MAIN ] Derivative Progress: 1556/2043 symbols completed. RVT took 1.2s. Estimated remaining: 3m 25s. Rate: 142.7 symbols/min [2025-09-25T22:26:23.062277] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:23.058749] [DEBUG] [MAIN ] RVLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:23.063940] [INFO ] [MAIN ] RVLV: Generated 1807 derivative records from 48170 primary records. [2025-09-25T22:26:23.064194] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-25T22:26:23.093869] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1807 records). [2025-09-25T22:26:23.094037] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-25T22:26:23.099011] [INFO ] [MAIN ] Derivative Progress: 1557/2043 symbols completed. RVLV took 1.3s. Estimated remaining: 3m 24s. Rate: 142.8 symbols/min [2025-09-25T22:26:23.099504] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:23.120315] [DEBUG] [LOCAL ] RVTY: Loaded 47880 existing records from primary storage. [2025-09-25T22:26:23.120773] [INFO ] [MAIN ] RVTY: Loaded 47880 primary data records. [2025-09-25T22:26:23.267899] [DEBUG] [LOCAL ] RWT: Loaded 41085 existing records from primary storage. [2025-09-25T22:26:23.274076] [INFO ] [MAIN ] RWT: Loaded 41085 primary data records. [2025-09-25T22:26:23.689156] [DEBUG] [LOCAL ] RXO: Loaded 48150 existing records from primary storage. [2025-09-25T22:26:23.701912] [INFO ] [MAIN ] RXO: Loaded 48150 primary data records. [2025-09-25T22:26:24.295917] [DEBUG] [MAIN ] RVTY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:24.298296] [INFO ] [MAIN ] RVTY: Generated 1807 derivative records from 47880 primary records. [2025-09-25T22:26:24.299052] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-25T22:26:24.319001] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1807 records). [2025-09-25T22:26:24.319429] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-25T22:26:24.322523] [INFO ] [MAIN ] Derivative Progress: 1558/2043 symbols completed. RVTY took 1.3s. Estimated remaining: 3m 24s. Rate: 142.6 symbols/min [2025-09-25T22:26:24.343400] [DEBUG] [MAIN ] RWT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:24.344599] [INFO ] [MAIN ] RWT: Generated 1807 derivative records from 41085 primary records. [2025-09-25T22:26:24.344871] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-25T22:26:24.374915] [DEBUG] [MAIN ] RXO: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:26:24.380745] [INFO ] [MAIN ] RXO: Generated 1806 derivative records from 48150 primary records. [2025-09-25T22:26:24.380849] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-25T22:26:24.379866] [DEBUG] [LOCAL ] RWT: Derivative data saved (1807 records). [2025-09-25T22:26:24.381791] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-25T22:26:24.384985] [INFO ] [MAIN ] Derivative Progress: 1559/2043 symbols completed. RWT took 1.3s. Estimated remaining: 3m 23s. Rate: 142.7 symbols/min [2025-09-25T22:26:24.400882] [DEBUG] [LOCAL ] RXO: Derivative data saved (1806 records). [2025-09-25T22:26:24.400962] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-25T22:26:24.405422] [INFO ] [MAIN ] Derivative Progress: 1560/2043 symbols completed. RXO took 1.3s. Estimated remaining: 3m 23s. Rate: 142.8 symbols/min [2025-09-25T22:26:24.406453] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:24.407020] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:24.406852] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:24.454258] [DEBUG] [LOCAL ] RYAM: Loaded 35428 existing records from primary storage. [2025-09-25T22:26:24.454635] [INFO ] [MAIN ] RYAM: Loaded 35428 primary data records. [2025-09-25T22:26:24.635808] [DEBUG] [LOCAL ] RY: Loaded 48274 existing records from primary storage. [2025-09-25T22:26:24.613691] [DEBUG] [LOCAL ] RYAN: Loaded 44574 existing records from primary storage. [2025-09-25T22:26:24.664378] [INFO ] [MAIN ] RY: Loaded 48274 primary data records. [2025-09-25T22:26:24.695265] [INFO ] [MAIN ] RYAN: Loaded 44574 primary data records. [2025-09-25T22:26:25.617526] [DEBUG] [MAIN ] RYAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:25.619349] [INFO ] [MAIN ] RYAM: Generated 1807 derivative records from 35428 primary records. [2025-09-25T22:26:25.621025] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-25T22:26:25.641861] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1807 records). [2025-09-25T22:26:25.642167] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-25T22:26:25.644637] [INFO ] [MAIN ] Derivative Progress: 1561/2043 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 23s. Rate: 142.6 symbols/min [2025-09-25T22:26:25.646065] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:25.676723] [DEBUG] [MAIN ] RY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:25.678623] [INFO ] [MAIN ] RY: Generated 1807 derivative records from 48274 primary records. [2025-09-25T22:26:25.679046] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-25T22:26:25.694591] [DEBUG] [MAIN ] RYAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:25.704188] [INFO ] [MAIN ] RYAN: Generated 1807 derivative records from 44574 primary records. [2025-09-25T22:26:25.720242] [DEBUG] [LOCAL ] RY: Derivative data saved (1807 records). [2025-09-25T22:26:25.720339] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-25T22:26:25.722153] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-25T22:26:25.721013] [DEBUG] [LOCAL ] RYI: Loaded 21726 existing records from primary storage. [2025-09-25T22:26:25.725931] [INFO ] [MAIN ] RYI: Loaded 21726 primary data records. [2025-09-25T22:26:25.725806] [INFO ] [MAIN ] Derivative Progress: 1562/2043 symbols completed. RY took 1.3s. Estimated remaining: 3m 22s. Rate: 142.7 symbols/min [2025-09-25T22:26:25.726510] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:25.799575] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1807 records). [2025-09-25T22:26:25.823906] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-25T22:26:25.852310] [INFO ] [MAIN ] Derivative Progress: 1563/2043 symbols completed. RYAN took 1.4s. Estimated remaining: 3m 22s. Rate: 142.8 symbols/min [2025-09-25T22:26:25.866005] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:26.091355] [DEBUG] [LOCAL ] RZB: Loaded 6274 existing records from primary storage. [2025-09-25T22:26:26.091729] [INFO ] [MAIN ] RZB: Loaded 6274 primary data records. [2025-09-25T22:26:26.278259] [DEBUG] [LOCAL ] RYN: Loaded 45996 existing records from primary storage. [2025-09-25T22:26:26.326308] [INFO ] [MAIN ] RYN: Loaded 45996 primary data records. [2025-09-25T22:26:26.808482] [DEBUG] [MAIN ] RYI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:26.810618] [INFO ] [MAIN ] RYI: Generated 1807 derivative records from 21726 primary records. [2025-09-25T22:26:26.811196] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-25T22:26:26.833809] [DEBUG] [LOCAL ] RYI: Derivative data saved (1807 records). [2025-09-25T22:26:26.834829] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-25T22:26:26.837436] [INFO ] [MAIN ] Derivative Progress: 1564/2043 symbols completed. RYI took 1.2s. Estimated remaining: 3m 21s. Rate: 142.6 symbols/min [2025-09-25T22:26:26.837850] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:26.865912] [DEBUG] [LOCAL ] RZC: Loaded 6805 existing records from primary storage. [2025-09-25T22:26:26.866995] [INFO ] [MAIN ] RZC: Loaded 6805 primary data records. [2025-09-25T22:26:26.866871] [DEBUG] [MAIN ] RZB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:26.903021] [INFO ] [MAIN ] RZB: Generated 1807 derivative records from 6274 primary records. [2025-09-25T22:26:26.921467] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-25T22:26:27.009522] [DEBUG] [LOCAL ] RZB: Derivative data saved (1807 records). [2025-09-25T22:26:27.044890] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-25T22:26:27.071684] [INFO ] [MAIN ] Derivative Progress: 1565/2043 symbols completed. RZB took 1.2s. Estimated remaining: 3m 21s. Rate: 142.7 symbols/min [2025-09-25T22:26:27.062092] [DEBUG] [MAIN ] RYN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:27.094516] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:27.094291] [INFO ] [MAIN ] RYN: Generated 1807 derivative records from 45996 primary records. [2025-09-25T22:26:27.119137] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-25T22:26:27.279013] [DEBUG] [LOCAL ] RYN: Derivative data saved (1807 records). [2025-09-25T22:26:27.279964] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-25T22:26:27.286237] [INFO ] [MAIN ] Derivative Progress: 1566/2043 symbols completed. RYN took 1.6s. Estimated remaining: 3m 21s. Rate: 142.7 symbols/min [2025-09-25T22:26:27.288128] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:27.332605] [DEBUG] [MAIN ] RZC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:27.333747] [INFO ] [MAIN ] RZC: Generated 1807 derivative records from 6805 primary records. [2025-09-25T22:26:27.334011] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-25T22:26:27.353353] [DEBUG] [LOCAL ] RZC: Derivative data saved (1807 records). [2025-09-25T22:26:27.353835] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-25T22:26:27.356407] [INFO ] [MAIN ] Derivative Progress: 1567/2043 symbols completed. RZC took 0.5s. Estimated remaining: 3m 20s. Rate: 142.8 symbols/min [2025-09-25T22:26:27.373513] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:27.375434] [DEBUG] [LOCAL ] S: Loaded 53928 existing records from primary storage. [2025-09-25T22:26:27.389788] [INFO ] [MAIN ] S: Loaded 53928 primary data records. [2025-09-25T22:26:27.526080] [DEBUG] [LOCAL ] SA: Loaded 43469 existing records from primary storage. [2025-09-25T22:26:27.573397] [DEBUG] [LOCAL ] SABA: Loaded 9248 existing records from primary storage. [2025-09-25T22:26:27.537538] [INFO ] [MAIN ] SA: Loaded 43469 primary data records. [2025-09-25T22:26:27.620696] [INFO ] [MAIN ] SABA: Loaded 9248 primary data records. [2025-09-25T22:26:28.638771] [DEBUG] [MAIN ] S: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:28.643616] [INFO ] [MAIN ] S: Generated 1807 derivative records from 53928 primary records. [2025-09-25T22:26:28.644612] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-25T22:26:28.676634] [DEBUG] [LOCAL ] S: Derivative data saved (1807 records). [2025-09-25T22:26:28.679762] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-25T22:26:28.683155] [INFO ] [MAIN ] Derivative Progress: 1568/2043 symbols completed. S took 1.6s. Estimated remaining: 3m 20s. Rate: 142.6 symbols/min [2025-09-25T22:26:28.684157] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:28.702545] [DEBUG] [MAIN ] SA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:28.704111] [INFO ] [MAIN ] SA: Generated 1807 derivative records from 43469 primary records. [2025-09-25T22:26:28.704365] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-25T22:26:28.748955] [DEBUG] [LOCAL ] SA: Derivative data saved (1807 records). [2025-09-25T22:26:28.747688] [DEBUG] [MAIN ] SABA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:28.749247] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-25T22:26:28.754555] [INFO ] [MAIN ] SABA: Generated 1807 derivative records from 9248 primary records. [2025-09-25T22:26:28.754854] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-25T22:26:28.753217] [INFO ] [MAIN ] Derivative Progress: 1569/2043 symbols completed. SA took 1.5s. Estimated remaining: 3m 19s. Rate: 142.7 symbols/min [2025-09-25T22:26:28.756668] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:28.789956] [DEBUG] [LOCAL ] SABA: Derivative data saved (1807 records). [2025-09-25T22:26:28.790499] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-25T22:26:28.793455] [INFO ] [MAIN ] Derivative Progress: 1570/2043 symbols completed. SABA took 1.4s. Estimated remaining: 3m 19s. Rate: 142.8 symbols/min [2025-09-25T22:26:28.794257] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:28.811530] [DEBUG] [LOCAL ] SAFE: Loaded 30617 existing records from primary storage. [2025-09-25T22:26:28.811911] [INFO ] [MAIN ] SAFE: Loaded 30617 primary data records. [2025-09-25T22:26:28.985463] [DEBUG] [LOCAL ] SAH: Loaded 22254 existing records from primary storage. [2025-09-25T22:26:29.000341] [INFO ] [MAIN ] SAH: Loaded 22254 primary data records. [2025-09-25T22:26:29.001159] [DEBUG] [LOCAL ] SAM: Loaded 21650 existing records from primary storage. [2025-09-25T22:26:29.007531] [INFO ] [MAIN ] SAM: Loaded 21650 primary data records. [2025-09-25T22:26:29.974898] [DEBUG] [MAIN ] SAFE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:29.978535] [INFO ] [MAIN ] SAFE: Generated 1807 derivative records from 30617 primary records. [2025-09-25T22:26:29.978771] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-25T22:26:30.011945] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1807 records). [2025-09-25T22:26:30.010877] [DEBUG] [MAIN ] SAM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:30.012203] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-25T22:26:30.015433] [INFO ] [MAIN ] Derivative Progress: 1571/2043 symbols completed. SAFE took 1.3s. Estimated remaining: 3m 19s. Rate: 142.6 symbols/min [2025-09-25T22:26:30.012960] [INFO ] [MAIN ] SAM: Generated 1807 derivative records from 21650 primary records. [2025-09-25T22:26:30.023843] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:30.023924] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-25T22:26:30.030483] [DEBUG] [MAIN ] SAH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:30.039166] [INFO ] [MAIN ] SAH: Generated 1807 derivative records from 22254 primary records. [2025-09-25T22:26:30.047406] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-25T22:26:30.047575] [DEBUG] [LOCAL ] SAM: Derivative data saved (1807 records). [2025-09-25T22:26:30.048735] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-25T22:26:30.052159] [INFO ] [MAIN ] Derivative Progress: 1572/2043 symbols completed. SAM took 1.3s. Estimated remaining: 3m 18s. Rate: 142.7 symbols/min [2025-09-25T22:26:30.063911] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:30.069236] [DEBUG] [LOCAL ] SAH: Derivative data saved (1807 records). [2025-09-25T22:26:30.069375] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-25T22:26:30.072170] [INFO ] [MAIN ] Derivative Progress: 1573/2043 symbols completed. SAH took 1.3s. Estimated remaining: 3m 18s. Rate: 142.8 symbols/min [2025-09-25T22:26:30.130713] [DEBUG] [LOCAL ] SAN: Loaded 53398 existing records from primary storage. [2025-09-25T22:26:30.130956] [INFO ] [MAIN ] SAN: Loaded 53398 primary data records. [2025-09-25T22:26:30.266301] [DEBUG] [LOCAL ] SAND: Loaded 52153 existing records from primary storage. [2025-09-25T22:26:30.286967] [INFO ] [MAIN ] SAND: Loaded 52153 primary data records. [2025-09-25T22:26:30.881394] [DEBUG] [MAIN ] SAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:30.882385] [INFO ] [MAIN ] SAN: Generated 1807 derivative records from 53398 primary records. [2025-09-25T22:26:30.882617] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-25T22:26:30.900343] [DEBUG] [LOCAL ] SAN: Derivative data saved (1807 records). [2025-09-25T22:26:30.900563] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-25T22:26:30.902857] [INFO ] [MAIN ] Derivative Progress: 1574/2043 symbols completed. SAN took 0.9s. Estimated remaining: 3m 17s. Rate: 142.7 symbols/min [2025-09-25T22:26:30.920393] [DEBUG] [MAIN ] SAND: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:30.921279] [INFO ] [MAIN ] SAND: Generated 1807 derivative records from 52153 primary records. [2025-09-25T22:26:30.921354] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-25T22:26:30.937733] [DEBUG] [LOCAL ] SAND: Derivative data saved (1807 records). [2025-09-25T22:26:30.937821] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-25T22:26:30.941284] [INFO ] [MAIN ] Derivative Progress: 1575/2043 symbols completed. SAND took 0.9s. Estimated remaining: 3m 17s. Rate: 142.7 symbols/min [2025-09-25T22:26:30.942228] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:30.942818] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:30.943248] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:30.966095] [DEBUG] [LOCAL ] SAR: Loaded 16248 existing records from primary storage. [2025-09-25T22:26:30.966263] [INFO ] [MAIN ] SAR: Loaded 16248 primary data records. [2025-09-25T22:26:31.220877] [DEBUG] [LOCAL ] SARO: Loaded 49097 existing records from primary storage. [2025-09-25T22:26:31.333925] [DEBUG] [LOCAL ] SAP: Loaded 50440 existing records from primary storage. [2025-09-25T22:26:31.339391] [INFO ] [MAIN ] SAP: Loaded 50440 primary data records. [2025-09-25T22:26:31.348883] [INFO ] [MAIN ] SARO: Loaded 49097 primary data records. [2025-09-25T22:26:32.054558] [DEBUG] [MAIN ] SAR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:32.055569] [INFO ] [MAIN ] SAR: Generated 1807 derivative records from 16248 primary records. [2025-09-25T22:26:32.055820] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-25T22:26:32.075713] [DEBUG] [LOCAL ] SAR: Derivative data saved (1807 records). [2025-09-25T22:26:32.076509] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-25T22:26:32.079072] [INFO ] [MAIN ] Derivative Progress: 1576/2043 symbols completed. SAR took 1.1s. Estimated remaining: 3m 17s. Rate: 142.6 symbols/min [2025-09-25T22:26:32.081359] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:32.100321] [DEBUG] [MAIN ] SAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:32.101279] [INFO ] [MAIN ] SAP: Generated 1807 derivative records from 50440 primary records. [2025-09-25T22:26:32.101434] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-25T22:26:32.121637] [DEBUG] [LOCAL ] SAP: Derivative data saved (1807 records). [2025-09-25T22:26:32.121880] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-25T22:26:32.124886] [INFO ] [MAIN ] Derivative Progress: 1577/2043 symbols completed. SAP took 1.2s. Estimated remaining: 3m 16s. Rate: 142.7 symbols/min [2025-09-25T22:26:32.133631] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:32.139438] [DEBUG] [MAIN ] SARO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:32.149434] [INFO ] [MAIN ] SARO: Generated 1807 derivative records from 49097 primary records. [2025-09-25T22:26:32.149829] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-25T22:26:32.167924] [DEBUG] [LOCAL ] SARO: Derivative data saved (1807 records). [2025-09-25T22:26:32.178770] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-25T22:26:32.183264] [INFO ] [MAIN ] Derivative Progress: 1578/2043 symbols completed. SARO took 1.2s. Estimated remaining: 3m 15s. Rate: 142.8 symbols/min [2025-09-25T22:26:32.183831] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:32.185408] [DEBUG] [LOCAL ] SB: Loaded 33516 existing records from primary storage. [2025-09-25T22:26:32.185736] [INFO ] [MAIN ] SB: Loaded 33516 primary data records. [2025-09-25T22:26:32.330953] [DEBUG] [LOCAL ] SBI: Loaded 7807 existing records from primary storage. [2025-09-25T22:26:32.372911] [INFO ] [MAIN ] SBI: Loaded 7807 primary data records. [2025-09-25T22:26:32.694460] [DEBUG] [LOCAL ] SBH: Loaded 50195 existing records from primary storage. [2025-09-25T22:26:32.728692] [INFO ] [MAIN ] SBH: Loaded 50195 primary data records. [2025-09-25T22:26:33.294835] [DEBUG] [MAIN ] SB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:33.295917] [INFO ] [MAIN ] SB: Generated 1807 derivative records from 33516 primary records. [2025-09-25T22:26:33.296227] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-25T22:26:33.315915] [DEBUG] [LOCAL ] SB: Derivative data saved (1807 records). [2025-09-25T22:26:33.316566] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-25T22:26:33.320505] [INFO ] [MAIN ] Derivative Progress: 1579/2043 symbols completed. SB took 1.2s. Estimated remaining: 3m 15s. Rate: 142.6 symbols/min [2025-09-25T22:26:33.323184] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:33.339125] [DEBUG] [MAIN ] SBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:33.341968] [INFO ] [MAIN ] SBI: Generated 1807 derivative records from 7807 primary records. [2025-09-25T22:26:33.344868] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-25T22:26:33.359000] [DEBUG] [MAIN ] SBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:33.368998] [DEBUG] [LOCAL ] SBR: Loaded 7250 existing records from primary storage. [2025-09-25T22:26:33.369114] [INFO ] [MAIN ] SBR: Loaded 7250 primary data records. [2025-09-25T22:26:33.385353] [INFO ] [MAIN ] SBH: Generated 1807 derivative records from 50195 primary records. [2025-09-25T22:26:33.407214] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-25T22:26:33.461317] [DEBUG] [LOCAL ] SBI: Derivative data saved (1807 records). [2025-09-25T22:26:33.501098] [DEBUG] [LOCAL ] SBH: Derivative data saved (1807 records). [2025-09-25T22:26:33.474268] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-25T22:26:33.501242] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-25T22:26:33.508090] [INFO ] [MAIN ] Derivative Progress: 1580/2043 symbols completed. SBI took 1.3s. Estimated remaining: 3m 15s. Rate: 142.6 symbols/min [2025-09-25T22:26:33.510997] [INFO ] [MAIN ] Derivative Progress: 1581/2043 symbols completed. SBH took 1.4s. Estimated remaining: 3m 14s. Rate: 142.7 symbols/min [2025-09-25T22:26:33.511115] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:33.511827] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:33.735733] [DEBUG] [LOCAL ] SBSI: Loaded 14872 existing records from primary storage. [2025-09-25T22:26:33.735947] [INFO ] [MAIN ] SBSI: Loaded 14872 primary data records. [2025-09-25T22:26:34.094978] [DEBUG] [LOCAL ] SBS: Loaded 49864 existing records from primary storage. [2025-09-25T22:26:34.095385] [INFO ] [MAIN ] SBS: Loaded 49864 primary data records. [2025-09-25T22:26:34.258319] [DEBUG] [MAIN ] SBR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:34.276396] [INFO ] [MAIN ] SBR: Generated 1807 derivative records from 7250 primary records. [2025-09-25T22:26:34.326091] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-25T22:26:34.486259] [DEBUG] [LOCAL ] SBR: Derivative data saved (1807 records). [2025-09-25T22:26:34.487280] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-25T22:26:34.489945] [INFO ] [MAIN ] Derivative Progress: 1582/2043 symbols completed. SBR took 1.2s. Estimated remaining: 3m 14s. Rate: 142.6 symbols/min [2025-09-25T22:26:34.490722] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:34.511545] [DEBUG] [MAIN ] SBSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:34.512526] [INFO ] [MAIN ] SBSI: Generated 1807 derivative records from 14872 primary records. [2025-09-25T22:26:34.512752] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-25T22:26:34.531939] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1807 records). [2025-09-25T22:26:34.532377] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-25T22:26:34.535269] [INFO ] [MAIN ] Derivative Progress: 1583/2043 symbols completed. SBSI took 1.0s. Estimated remaining: 3m 13s. Rate: 142.7 symbols/min [2025-09-25T22:26:34.538352] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:34.558572] [DEBUG] [MAIN ] SBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:34.559636] [INFO ] [MAIN ] SBS: Generated 1807 derivative records from 49864 primary records. [2025-09-25T22:26:34.559820] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-25T22:26:34.594343] [DEBUG] [LOCAL ] SBS: Derivative data saved (1807 records). [2025-09-25T22:26:34.594529] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-25T22:26:34.597496] [INFO ] [MAIN ] Derivative Progress: 1584/2043 symbols completed. SBS took 1.1s. Estimated remaining: 3m 13s. Rate: 142.8 symbols/min [2025-09-25T22:26:34.598065] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:34.633102] [DEBUG] [LOCAL ] SBSW: Loaded 53355 existing records from primary storage. [2025-09-25T22:26:34.633440] [INFO ] [MAIN ] SBSW: Loaded 53355 primary data records. [2025-09-25T22:26:34.692022] [DEBUG] [LOCAL ] SCD: Loaded 12668 existing records from primary storage. [2025-09-25T22:26:34.750301] [DEBUG] [LOCAL ] SCCO: Loaded 49775 existing records from primary storage. [2025-09-25T22:26:34.743963] [INFO ] [MAIN ] SCD: Loaded 12668 primary data records. [2025-09-25T22:26:34.769766] [INFO ] [MAIN ] SCCO: Loaded 49775 primary data records. [2025-09-25T22:26:35.698675] [DEBUG] [MAIN ] SBSW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:35.699661] [INFO ] [MAIN ] SBSW: Generated 1807 derivative records from 53355 primary records. [2025-09-25T22:26:35.699998] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-25T22:26:35.726865] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1807 records). [2025-09-25T22:26:35.747368] [DEBUG] [MAIN ] SCD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:35.747039] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-25T22:26:35.755403] [INFO ] [MAIN ] SCD: Generated 1807 derivative records from 12668 primary records. [2025-09-25T22:26:35.755953] [DEBUG] [MAIN ] SCCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:35.754415] [INFO ] [MAIN ] Derivative Progress: 1585/2043 symbols completed. SBSW took 1.3s. Estimated remaining: 3m 13s. Rate: 142.6 symbols/min [2025-09-25T22:26:35.757067] [INFO ] [MAIN ] SCCO: Generated 1807 derivative records from 49775 primary records. [2025-09-25T22:26:35.756281] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:35.755532] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-25T22:26:35.757314] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-25T22:26:35.786635] [DEBUG] [LOCAL ] SCD: Derivative data saved (1807 records). [2025-09-25T22:26:35.787767] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-25T22:26:35.790688] [INFO ] [MAIN ] Derivative Progress: 1586/2043 symbols completed. SCD took 1.2s. Estimated remaining: 3m 12s. Rate: 142.7 symbols/min [2025-09-25T22:26:35.791448] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:35.797521] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1807 records). [2025-09-25T22:26:35.797740] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-25T22:26:35.800789] [INFO ] [MAIN ] Derivative Progress: 1587/2043 symbols completed. SCCO took 1.3s. Estimated remaining: 3m 12s. Rate: 142.8 symbols/min [2025-09-25T22:26:35.801214] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:35.819881] [DEBUG] [LOCAL ] SCL: Loaded 15001 existing records from primary storage. [2025-09-25T22:26:35.820167] [INFO ] [MAIN ] SCL: Loaded 15001 primary data records. [2025-09-25T22:26:35.996328] [DEBUG] [LOCAL ] SCHW: Loaded 54075 existing records from primary storage. [2025-09-25T22:26:36.020248] [INFO ] [MAIN ] SCHW: Loaded 54075 primary data records. [2025-09-25T22:26:36.036715] [DEBUG] [LOCAL ] SCI: Loaded 46946 existing records from primary storage. [2025-09-25T22:26:36.047389] [INFO ] [MAIN ] SCI: Loaded 46946 primary data records. [2025-09-25T22:26:36.976026] [DEBUG] [MAIN ] SCL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:36.979103] [INFO ] [MAIN ] SCL: Generated 1807 derivative records from 15001 primary records. [2025-09-25T22:26:36.980043] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-25T22:26:37.012388] [DEBUG] [LOCAL ] SCL: Derivative data saved (1807 records). [2025-09-25T22:26:37.014392] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-25T22:26:37.017090] [INFO ] [MAIN ] Derivative Progress: 1588/2043 symbols completed. SCL took 1.2s. Estimated remaining: 3m 11s. Rate: 142.6 symbols/min [2025-09-25T22:26:37.014860] [DEBUG] [MAIN ] SCI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:37.018238] [INFO ] [MAIN ] SCI: Generated 1807 derivative records from 46946 primary records. [2025-09-25T22:26:37.018563] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-25T22:26:37.049970] [DEBUG] [LOCAL ] SCI: Derivative data saved (1807 records). [2025-09-25T22:26:37.050090] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-25T22:26:37.053028] [INFO ] [MAIN ] Derivative Progress: 1589/2043 symbols completed. SCI took 1.3s. Estimated remaining: 3m 11s. Rate: 142.7 symbols/min [2025-09-25T22:26:37.045677] [DEBUG] [MAIN ] SCHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:37.054275] [INFO ] [MAIN ] SCHW: Generated 1807 derivative records from 54075 primary records. [2025-09-25T22:26:37.054400] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-25T22:26:37.071697] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1807 records). [2025-09-25T22:26:37.071833] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-25T22:26:37.075456] [INFO ] [MAIN ] Derivative Progress: 1590/2043 symbols completed. SCHW took 1.3s. Estimated remaining: 3m 10s. Rate: 142.8 symbols/min [2025-09-25T22:26:37.076300] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:37.076186] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:37.076513] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:37.115606] [DEBUG] [LOCAL ] SCM: Loaded 19974 existing records from primary storage. [2025-09-25T22:26:37.115837] [INFO ] [MAIN ] SCM: Loaded 19974 primary data records. [2025-09-25T22:26:37.204386] [DEBUG] [LOCAL ] SD: Loaded 29168 existing records from primary storage. [2025-09-25T22:26:37.219937] [INFO ] [MAIN ] SD: Loaded 29168 primary data records. [2025-09-25T22:26:37.378157] [DEBUG] [LOCAL ] SCS: Loaded 43480 existing records from primary storage. [2025-09-25T22:26:37.480229] [INFO ] [MAIN ] SCS: Loaded 43480 primary data records. [2025-09-25T22:26:38.219880] [DEBUG] [MAIN ] SCM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:38.220896] [INFO ] [MAIN ] SCM: Generated 1807 derivative records from 19974 primary records. [2025-09-25T22:26:38.223735] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-25T22:26:38.257967] [DEBUG] [MAIN ] SD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:38.259994] [INFO ] [MAIN ] SD: Generated 1807 derivative records from 29168 primary records. [2025-09-25T22:26:38.260782] [DEBUG] [LOCAL ] SCM: Derivative data saved (1807 records). [2025-09-25T22:26:38.261280] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-25T22:26:38.263862] [INFO ] [MAIN ] Derivative Progress: 1591/2043 symbols completed. SCM took 1.2s. Estimated remaining: 3m 10s. Rate: 142.6 symbols/min [2025-09-25T22:26:38.260938] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-25T22:26:38.265321] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:38.297185] [DEBUG] [MAIN ] SCS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:38.301623] [INFO ] [MAIN ] SCS: Generated 1807 derivative records from 43480 primary records. [2025-09-25T22:26:38.302957] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-25T22:26:38.304241] [DEBUG] [LOCAL ] SD: Derivative data saved (1807 records). [2025-09-25T22:26:38.318153] [DEBUG] [LOCAL ] SDHC: Loaded 10574 existing records from primary storage. [2025-09-25T22:26:38.321805] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-25T22:26:38.321927] [INFO ] [MAIN ] SDHC: Loaded 10574 primary data records. [2025-09-25T22:26:38.328247] [INFO ] [MAIN ] Derivative Progress: 1592/2043 symbols completed. SD took 1.3s. Estimated remaining: 3m 10s. Rate: 142.7 symbols/min [2025-09-25T22:26:38.354408] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:38.354173] [DEBUG] [LOCAL ] SCS: Derivative data saved (1807 records). [2025-09-25T22:26:38.368131] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-25T22:26:38.416089] [INFO ] [MAIN ] Derivative Progress: 1593/2043 symbols completed. SCS took 1.3s. Estimated remaining: 3m 9s. Rate: 142.8 symbols/min [2025-09-25T22:26:38.457790] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:38.528047] [DEBUG] [LOCAL ] SDHY: Loaded 10653 existing records from primary storage. [2025-09-25T22:26:38.550536] [INFO ] [MAIN ] SDHY: Loaded 10653 primary data records. [2025-09-25T22:26:38.868082] [DEBUG] [LOCAL ] SDRL: Loaded 42248 existing records from primary storage. [2025-09-25T22:26:38.892391] [INFO ] [MAIN ] SDRL: Loaded 42248 primary data records. [2025-09-25T22:26:39.411680] [DEBUG] [MAIN ] SDHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:39.413881] [INFO ] [MAIN ] SDHC: Generated 1807 derivative records from 10574 primary records. [2025-09-25T22:26:39.415166] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-25T22:26:39.438286] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1807 records). [2025-09-25T22:26:39.438635] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-25T22:26:39.441325] [INFO ] [MAIN ] Derivative Progress: 1594/2043 symbols completed. SDHC took 1.2s. Estimated remaining: 3m 9s. Rate: 142.6 symbols/min [2025-09-25T22:26:39.455163] [DEBUG] [MAIN ] SDHY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:39.457790] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:39.457685] [INFO ] [MAIN ] SDHY: Generated 1807 derivative records from 10653 primary records. [2025-09-25T22:26:39.458193] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-25T22:26:39.475739] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1807 records). [2025-09-25T22:26:39.476173] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-25T22:26:39.478941] [INFO ] [MAIN ] Derivative Progress: 1595/2043 symbols completed. SDHY took 1.1s. Estimated remaining: 3m 8s. Rate: 142.7 symbols/min [2025-09-25T22:26:39.479662] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:39.498687] [DEBUG] [MAIN ] SDRL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:39.499809] [INFO ] [MAIN ] SDRL: Generated 1807 derivative records from 42248 primary records. [2025-09-25T22:26:39.504006] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-25T22:26:39.527560] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1807 records). [2025-09-25T22:26:39.527837] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-25T22:26:39.533086] [INFO ] [MAIN ] Derivative Progress: 1596/2043 symbols completed. SDRL took 1.1s. Estimated remaining: 3m 8s. Rate: 142.8 symbols/min [2025-09-25T22:26:39.528246] [DEBUG] [LOCAL ] SEG: Loaded 13814 existing records from primary storage. [2025-09-25T22:26:39.545182] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:39.545575] [INFO ] [MAIN ] SEG: Loaded 13814 primary data records. [2025-09-25T22:26:39.679017] [DEBUG] [LOCAL ] SEE: Loaded 48710 existing records from primary storage. [2025-09-25T22:26:39.685053] [INFO ] [MAIN ] SEE: Loaded 48710 primary data records. [2025-09-25T22:26:40.254416] [DEBUG] [LOCAL ] SEI: Loaded 50031 existing records from primary storage. [2025-09-25T22:26:40.254944] [INFO ] [MAIN ] SEI: Loaded 50031 primary data records. [2025-09-25T22:26:40.598401] [DEBUG] [MAIN ] SEG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:40.600364] [INFO ] [MAIN ] SEG: Generated 1807 derivative records from 13814 primary records. [2025-09-25T22:26:40.601556] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-25T22:26:40.638213] [DEBUG] [MAIN ] SEE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:40.639502] [INFO ] [MAIN ] SEE: Generated 1807 derivative records from 48710 primary records. [2025-09-25T22:26:40.639933] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-25T22:26:40.659976] [DEBUG] [LOCAL ] SEG: Derivative data saved (1807 records). [2025-09-25T22:26:40.660481] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-25T22:26:40.663379] [INFO ] [MAIN ] Derivative Progress: 1597/2043 symbols completed. SEG took 1.2s. Estimated remaining: 3m 8s. Rate: 142.6 symbols/min [2025-09-25T22:26:40.663755] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:40.668345] [DEBUG] [LOCAL ] SEE: Derivative data saved (1807 records). [2025-09-25T22:26:40.668480] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-25T22:26:40.673794] [INFO ] [MAIN ] Derivative Progress: 1598/2043 symbols completed. SEE took 1.2s. Estimated remaining: 3m 7s. Rate: 142.7 symbols/min [2025-09-25T22:26:40.674469] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:40.692407] [DEBUG] [MAIN ] SEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:40.693429] [INFO ] [MAIN ] SEI: Generated 1807 derivative records from 50031 primary records. [2025-09-25T22:26:40.693504] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-25T22:26:40.716289] [DEBUG] [LOCAL ] SEI: Derivative data saved (1807 records). [2025-09-25T22:26:40.716736] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-25T22:26:40.722841] [INFO ] [MAIN ] Derivative Progress: 1599/2043 symbols completed. SEI took 1.2s. Estimated remaining: 3m 7s. Rate: 142.8 symbols/min [2025-09-25T22:26:40.723256] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:40.777824] [DEBUG] [LOCAL ] SEMR: Loaded 41879 existing records from primary storage. [2025-09-25T22:26:40.779193] [INFO ] [MAIN ] SEMR: Loaded 41879 primary data records. [2025-09-25T22:26:40.791950] [DEBUG] [LOCAL ] SEM: Loaded 43243 existing records from primary storage. [2025-09-25T22:26:40.813797] [INFO ] [MAIN ] SEM: Loaded 43243 primary data records. [2025-09-25T22:26:41.158381] [DEBUG] [LOCAL ] SES: Loaded 51942 existing records from primary storage. [2025-09-25T22:26:41.365702] [INFO ] [MAIN ] SES: Loaded 51942 primary data records. [2025-09-25T22:26:41.887538] [DEBUG] [MAIN ] SEMR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:41.888187] [DEBUG] [MAIN ] SEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:41.889616] [INFO ] [MAIN ] SEMR: Generated 1807 derivative records from 41879 primary records. [2025-09-25T22:26:41.890029] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-25T22:26:41.891273] [INFO ] [MAIN ] SEM: Generated 1807 derivative records from 43243 primary records. [2025-09-25T22:26:41.892978] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-25T22:26:41.922870] [DEBUG] [LOCAL ] SEM: Derivative data saved (1807 records). [2025-09-25T22:26:41.923207] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-25T22:26:41.926529] [INFO ] [MAIN ] Derivative Progress: 1600/2043 symbols completed. SEM took 1.3s. Estimated remaining: 3m 6s. Rate: 142.6 symbols/min [2025-09-25T22:26:41.928249] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:41.948177] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1807 records). [2025-09-25T22:26:41.948313] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-25T22:26:41.947710] [DEBUG] [MAIN ] SES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:41.952060] [INFO ] [MAIN ] SES: Generated 1807 derivative records from 51942 primary records. [2025-09-25T22:26:41.951141] [INFO ] [MAIN ] Derivative Progress: 1601/2043 symbols completed. SEMR took 1.3s. Estimated remaining: 3m 6s. Rate: 142.7 symbols/min [2025-09-25T22:26:41.952522] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:41.952827] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-25T22:26:41.973278] [DEBUG] [LOCAL ] SFB: Loaded 4020 existing records from primary storage. [2025-09-25T22:26:41.973927] [INFO ] [MAIN ] SFB: Loaded 4020 primary data records. [2025-09-25T22:26:42.100701] [DEBUG] [LOCAL ] SES: Derivative data saved (1807 records). [2025-09-25T22:26:42.123729] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-25T22:26:42.159465] [INFO ] [MAIN ] Derivative Progress: 1602/2043 symbols completed. SES took 1.4s. Estimated remaining: 3m 5s. Rate: 142.8 symbols/min [2025-09-25T22:26:42.169870] [DEBUG] [LOCAL ] SF: Loaded 42020 existing records from primary storage. [2025-09-25T22:26:42.178505] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:42.180913] [INFO ] [MAIN ] SF: Loaded 42020 primary data records. [2025-09-25T22:26:42.511491] [DEBUG] [LOCAL ] SFBS: Loaded 21381 existing records from primary storage. [2025-09-25T22:26:42.534052] [INFO ] [MAIN ] SFBS: Loaded 21381 primary data records. [2025-09-25T22:26:42.996571] [DEBUG] [MAIN ] SFB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:42.997862] [INFO ] [MAIN ] SFB: Generated 1807 derivative records from 4020 primary records. [2025-09-25T22:26:42.998057] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-25T22:26:43.032929] [DEBUG] [LOCAL ] SFB: Derivative data saved (1807 records). [2025-09-25T22:26:43.033533] [DEBUG] [MAIN ] SF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:43.033613] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-25T22:26:43.034691] [INFO ] [MAIN ] SF: Generated 1807 derivative records from 42020 primary records. [2025-09-25T22:26:43.037756] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-25T22:26:43.037663] [INFO ] [MAIN ] Derivative Progress: 1603/2043 symbols completed. SFB took 1.1s. Estimated remaining: 3m 5s. Rate: 142.7 symbols/min [2025-09-25T22:26:43.058397] [DEBUG] [LOCAL ] SF: Derivative data saved (1807 records). [2025-09-25T22:26:43.058517] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-25T22:26:43.061995] [INFO ] [MAIN ] Derivative Progress: 1604/2043 symbols completed. SF took 1.1s. Estimated remaining: 3m 4s. Rate: 142.8 symbols/min [2025-09-25T22:26:43.074710] [DEBUG] [MAIN ] SFBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:43.075429] [INFO ] [MAIN ] SFBS: Generated 1807 derivative records from 21381 primary records. [2025-09-25T22:26:43.075491] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-25T22:26:43.091776] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1807 records). [2025-09-25T22:26:43.091839] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-25T22:26:43.096174] [INFO ] [MAIN ] Derivative Progress: 1605/2043 symbols completed. SFBS took 0.9s. Estimated remaining: 3m 4s. Rate: 142.8 symbols/min [2025-09-25T22:26:43.096909] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:43.097032] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:43.097876] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:43.175564] [DEBUG] [LOCAL ] SFL: Loaded 45665 existing records from primary storage. [2025-09-25T22:26:43.176491] [INFO ] [MAIN ] SFL: Loaded 45665 primary data records. [2025-09-25T22:26:43.269975] [DEBUG] [LOCAL ] SG: Loaded 53838 existing records from primary storage. [2025-09-25T22:26:43.280497] [INFO ] [MAIN ] SG: Loaded 53838 primary data records. [2025-09-25T22:26:43.368995] [DEBUG] [LOCAL ] SGHC: Loaded 46069 existing records from primary storage. [2025-09-25T22:26:43.383566] [INFO ] [MAIN ] SGHC: Loaded 46069 primary data records. [2025-09-25T22:26:44.232751] [DEBUG] [MAIN ] SFL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:44.234123] [INFO ] [MAIN ] SFL: Generated 1807 derivative records from 45665 primary records. [2025-09-25T22:26:44.234302] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-25T22:26:44.233103] [DEBUG] [MAIN ] SG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:44.235436] [INFO ] [MAIN ] SG: Generated 1807 derivative records from 53838 primary records. [2025-09-25T22:26:44.235852] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-25T22:26:44.283836] [DEBUG] [LOCAL ] SFL: Derivative data saved (1807 records). [2025-09-25T22:26:44.285073] [DEBUG] [MAIN ] SGHC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:26:44.285187] [DEBUG] [LOCAL ] SG: Derivative data saved (1807 records). [2025-09-25T22:26:44.285474] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-25T22:26:44.284353] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-25T22:26:44.290178] [INFO ] [MAIN ] Derivative Progress: 1606/2043 symbols completed. SG took 1.2s. Estimated remaining: 3m 4s. Rate: 142.7 symbols/min [2025-09-25T22:26:44.286508] [INFO ] [MAIN ] SGHC: Generated 1806 derivative records from 46069 primary records. [2025-09-25T22:26:44.293279] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:44.293188] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-25T22:26:44.292999] [INFO ] [MAIN ] Derivative Progress: 1607/2043 symbols completed. SFL took 1.2s. Estimated remaining: 3m 3s. Rate: 142.8 symbols/min [2025-09-25T22:26:44.295100] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:44.315888] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1806 records). [2025-09-25T22:26:44.316258] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-25T22:26:44.320471] [INFO ] [MAIN ] Derivative Progress: 1608/2043 symbols completed. SGHC took 1.2s. Estimated remaining: 3m 3s. Rate: 142.9 symbols/min [2025-09-25T22:26:44.325017] [DEBUG] [LOCAL ] SGU: Loaded 6706 existing records from primary storage. [2025-09-25T22:26:44.325388] [INFO ] [MAIN ] SGU: Loaded 6706 primary data records. [2025-09-25T22:26:44.325255] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:44.532541] [DEBUG] [LOCAL ] SHCO: Loaded 26175 existing records from primary storage. [2025-09-25T22:26:44.553689] [INFO ] [MAIN ] SHCO: Loaded 26175 primary data records. [2025-09-25T22:26:44.736292] [DEBUG] [LOCAL ] SHAK: Loaded 49485 existing records from primary storage. [2025-09-25T22:26:44.766434] [INFO ] [MAIN ] SHAK: Loaded 49485 primary data records. [2025-09-25T22:26:45.438202] [DEBUG] [MAIN ] SGU: Filtered 6966 bins outside market hours, 7764 incomplete bins [2025-09-25T22:26:45.440045] [INFO ] [MAIN ] SGU: Generated 1802 derivative records from 6706 primary records. [2025-09-25T22:26:45.440396] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-25T22:26:45.485051] [DEBUG] [LOCAL ] SGU: Derivative data saved (1802 records). [2025-09-25T22:26:45.485518] [DEBUG] [MAIN ] SHCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:45.485668] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-25T22:26:45.489186] [INFO ] [MAIN ] Derivative Progress: 1609/2043 symbols completed. SGU took 1.2s. Estimated remaining: 3m 2s. Rate: 142.7 symbols/min [2025-09-25T22:26:45.490241] [INFO ] [MAIN ] SHCO: Generated 1807 derivative records from 26175 primary records. [2025-09-25T22:26:45.490839] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-25T22:26:45.491446] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:45.511561] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1807 records). [2025-09-25T22:26:45.524613] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-25T22:26:45.527840] [DEBUG] [MAIN ] SHAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:45.527403] [INFO ] [MAIN ] Derivative Progress: 1610/2043 symbols completed. SHCO took 1.2s. Estimated remaining: 3m 2s. Rate: 142.8 symbols/min [2025-09-25T22:26:45.529126] [INFO ] [MAIN ] SHAK: Generated 1807 derivative records from 49485 primary records. [2025-09-25T22:26:45.529332] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-25T22:26:45.528187] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:45.548764] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1807 records). [2025-09-25T22:26:45.548973] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-25T22:26:45.553639] [INFO ] [MAIN ] Derivative Progress: 1611/2043 symbols completed. SHAK took 1.3s. Estimated remaining: 3m 1s. Rate: 142.9 symbols/min [2025-09-25T22:26:45.554039] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:45.594099] [DEBUG] [LOCAL ] SHG: Loaded 27160 existing records from primary storage. [2025-09-25T22:26:45.594425] [INFO ] [MAIN ] SHG: Loaded 27160 primary data records. [2025-09-25T22:26:45.737333] [DEBUG] [LOCAL ] SHEL: Loaded 54061 existing records from primary storage. [2025-09-25T22:26:45.743534] [INFO ] [MAIN ] SHEL: Loaded 54061 primary data records. [2025-09-25T22:26:46.087560] [DEBUG] [LOCAL ] SHO: Loaded 50179 existing records from primary storage. [2025-09-25T22:26:46.089044] [INFO ] [MAIN ] SHO: Loaded 50179 primary data records. [2025-09-25T22:26:46.645315] [DEBUG] [MAIN ] SHG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:46.646481] [INFO ] [MAIN ] SHG: Generated 1807 derivative records from 27160 primary records. [2025-09-25T22:26:46.646732] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-25T22:26:46.680009] [DEBUG] [MAIN ] SHEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:46.683726] [INFO ] [MAIN ] SHEL: Generated 1807 derivative records from 54061 primary records. [2025-09-25T22:26:46.684369] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-25T22:26:46.685231] [DEBUG] [LOCAL ] SHG: Derivative data saved (1807 records). [2025-09-25T22:26:46.694137] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-25T22:26:46.701736] [INFO ] [MAIN ] Derivative Progress: 1612/2043 symbols completed. SHG took 1.2s. Estimated remaining: 3m 1s. Rate: 142.7 symbols/min [2025-09-25T22:26:46.702581] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:46.722973] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1807 records). [2025-09-25T22:26:46.728013] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-25T22:26:46.728599] [DEBUG] [LOCAL ] SHOC: Loaded 3735 existing records from primary storage. [2025-09-25T22:26:46.728370] [DEBUG] [MAIN ] SHO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:46.732847] [INFO ] [MAIN ] Derivative Progress: 1613/2043 symbols completed. SHEL took 1.2s. Estimated remaining: 3m 1s. Rate: 142.8 symbols/min [2025-09-25T22:26:46.733890] [INFO ] [MAIN ] SHO: Generated 1807 derivative records from 50179 primary records. [2025-09-25T22:26:46.733068] [INFO ] [MAIN ] SHOC: Loaded 3735 primary data records. [2025-09-25T22:26:46.739633] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-25T22:26:46.739491] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:46.938948] [DEBUG] [LOCAL ] SHO: Derivative data saved (1807 records). [2025-09-25T22:26:46.944909] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-25T22:26:47.062278] [INFO ] [MAIN ] Derivative Progress: 1614/2043 symbols completed. SHO took 1.5s. Estimated remaining: 3m 0s. Rate: 142.8 symbols/min [2025-09-25T22:26:47.073838] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:47.137478] [DEBUG] [LOCAL ] SHW: Loaded 50823 existing records from primary storage. [2025-09-25T22:26:47.138022] [INFO ] [MAIN ] SHW: Loaded 50823 primary data records. [2025-09-25T22:26:47.236377] [DEBUG] [MAIN ] SHOC: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:26:47.279314] [INFO ] [MAIN ] SHOC: Generated 1806 derivative records from 3735 primary records. [2025-09-25T22:26:47.290772] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-25T22:26:47.292881] [DEBUG] [LOCAL ] SID: Loaded 42519 existing records from primary storage. [2025-09-25T22:26:47.304466] [INFO ] [MAIN ] SID: Loaded 42519 primary data records. [2025-09-25T22:26:47.385161] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1806 records). [2025-09-25T22:26:47.409593] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-25T22:26:47.435749] [INFO ] [MAIN ] Derivative Progress: 1615/2043 symbols completed. SHOC took 0.7s. Estimated remaining: 2m 60s. Rate: 142.8 symbols/min [2025-09-25T22:26:47.500265] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:47.940193] [DEBUG] [MAIN ] SHW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:47.954947] [INFO ] [MAIN ] SHW: Generated 1807 derivative records from 50823 primary records. [2025-09-25T22:26:47.955470] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-25T22:26:47.958313] [DEBUG] [LOCAL ] SIG: Loaded 46847 existing records from primary storage. [2025-09-25T22:26:47.958539] [INFO ] [MAIN ] SIG: Loaded 46847 primary data records. [2025-09-25T22:26:48.070226] [DEBUG] [LOCAL ] SHW: Derivative data saved (1807 records). [2025-09-25T22:26:48.082914] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-25T22:26:48.077720] [DEBUG] [MAIN ] SID: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:48.085587] [INFO ] [MAIN ] Derivative Progress: 1616/2043 symbols completed. SHW took 1.4s. Estimated remaining: 2m 59s. Rate: 142.8 symbols/min [2025-09-25T22:26:48.097349] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:48.106281] [INFO ] [MAIN ] SID: Generated 1807 derivative records from 42519 primary records. [2025-09-25T22:26:48.113411] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-25T22:26:48.337122] [DEBUG] [LOCAL ] SID: Derivative data saved (1807 records). [2025-09-25T22:26:48.343801] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-25T22:26:48.347424] [INFO ] [MAIN ] Derivative Progress: 1617/2043 symbols completed. SID took 1.3s. Estimated remaining: 2m 59s. Rate: 142.8 symbols/min [2025-09-25T22:26:48.347990] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:48.362873] [DEBUG] [LOCAL ] SII: Loaded 23425 existing records from primary storage. [2025-09-25T22:26:48.363709] [INFO ] [MAIN ] SII: Loaded 23425 primary data records. [2025-09-25T22:26:48.546381] [DEBUG] [LOCAL ] SILA: Loaded 31516 existing records from primary storage. [2025-09-25T22:26:48.557140] [INFO ] [MAIN ] SILA: Loaded 31516 primary data records. [2025-09-25T22:26:48.799748] [DEBUG] [MAIN ] SIG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:48.806156] [INFO ] [MAIN ] SIG: Generated 1807 derivative records from 46847 primary records. [2025-09-25T22:26:48.806436] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-25T22:26:49.033214] [DEBUG] [LOCAL ] SIG: Derivative data saved (1807 records). [2025-09-25T22:26:49.043341] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-25T22:26:49.047824] [INFO ] [MAIN ] Derivative Progress: 1618/2043 symbols completed. SIG took 1.6s. Estimated remaining: 2m 59s. Rate: 142.7 symbols/min [2025-09-25T22:26:49.070931] [DEBUG] [MAIN ] SII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:49.071960] [INFO ] [MAIN ] SII: Generated 1807 derivative records from 23425 primary records. [2025-09-25T22:26:49.072108] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-25T22:26:49.091338] [DEBUG] [LOCAL ] SII: Derivative data saved (1807 records). [2025-09-25T22:26:49.091552] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-25T22:26:49.095754] [INFO ] [MAIN ] Derivative Progress: 1619/2043 symbols completed. SII took 1.0s. Estimated remaining: 2m 58s. Rate: 142.8 symbols/min [2025-09-25T22:26:49.110717] [DEBUG] [MAIN ] SILA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:49.111366] [INFO ] [MAIN ] SILA: Generated 1807 derivative records from 31516 primary records. [2025-09-25T22:26:49.111427] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-25T22:26:49.127178] [DEBUG] [LOCAL ] SILA: Derivative data saved (1807 records). [2025-09-25T22:26:49.127264] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-25T22:26:49.131319] [INFO ] [MAIN ] Derivative Progress: 1620/2043 symbols completed. SILA took 0.8s. Estimated remaining: 2m 58s. Rate: 142.9 symbols/min [2025-09-25T22:26:49.131990] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:49.132240] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:49.132305] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:49.225085] [DEBUG] [LOCAL ] SITC: Loaded 41936 existing records from primary storage. [2025-09-25T22:26:49.226131] [INFO ] [MAIN ] SITC: Loaded 41936 primary data records. [2025-09-25T22:26:49.272571] [DEBUG] [LOCAL ] SITE: Loaded 35314 existing records from primary storage. [2025-09-25T22:26:49.302569] [DEBUG] [LOCAL ] SJM: Loaded 50513 existing records from primary storage. [2025-09-25T22:26:49.291569] [INFO ] [MAIN ] SITE: Loaded 35314 primary data records. [2025-09-25T22:26:49.317109] [INFO ] [MAIN ] SJM: Loaded 50513 primary data records. [2025-09-25T22:26:50.355600] [DEBUG] [MAIN ] SITE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:50.359143] [INFO ] [MAIN ] SITE: Generated 1807 derivative records from 35314 primary records. [2025-09-25T22:26:50.359455] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-25T22:26:50.389809] [DEBUG] [MAIN ] SITC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:50.394439] [DEBUG] [LOCAL ] SITE: Derivative data saved (1807 records). [2025-09-25T22:26:50.396152] [INFO ] [MAIN ] SITC: Generated 1807 derivative records from 41936 primary records. [2025-09-25T22:26:50.396428] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-25T22:26:50.410998] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-25T22:26:50.413844] [INFO ] [MAIN ] Derivative Progress: 1621/2043 symbols completed. SITE took 1.3s. Estimated remaining: 2m 57s. Rate: 142.7 symbols/min [2025-09-25T22:26:50.414323] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:50.411443] [DEBUG] [MAIN ] SJM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:50.416177] [INFO ] [MAIN ] SJM: Generated 1807 derivative records from 50513 primary records. [2025-09-25T22:26:50.417308] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-25T22:26:50.449926] [DEBUG] [LOCAL ] SJM: Derivative data saved (1807 records). [2025-09-25T22:26:50.450553] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-25T22:26:50.454227] [INFO ] [MAIN ] Derivative Progress: 1622/2043 symbols completed. SJM took 1.3s. Estimated remaining: 2m 57s. Rate: 142.8 symbols/min [2025-09-25T22:26:50.455529] [DEBUG] [LOCAL ] SITC: Derivative data saved (1807 records). [2025-09-25T22:26:50.456176] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-25T22:26:50.456099] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:50.459055] [INFO ] [MAIN ] Derivative Progress: 1623/2043 symbols completed. SITC took 1.3s. Estimated remaining: 2m 56s. Rate: 142.9 symbols/min [2025-09-25T22:26:50.467142] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:50.482757] [DEBUG] [LOCAL ] SJT: Loaded 22312 existing records from primary storage. [2025-09-25T22:26:50.483020] [INFO ] [MAIN ] SJT: Loaded 22312 primary data records. [2025-09-25T22:26:50.532875] [DEBUG] [LOCAL ] SKIL: Loaded 6368 existing records from primary storage. [2025-09-25T22:26:50.568093] [INFO ] [MAIN ] SKIL: Loaded 6368 primary data records. [2025-09-25T22:26:50.703914] [DEBUG] [LOCAL ] SKE: Loaded 35919 existing records from primary storage. [2025-09-25T22:26:50.722273] [INFO ] [MAIN ] SKE: Loaded 35919 primary data records. [2025-09-25T22:26:51.562152] [DEBUG] [MAIN ] SKIL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:51.576443] [INFO ] [MAIN ] SKIL: Generated 1807 derivative records from 6368 primary records. [2025-09-25T22:26:51.577185] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-25T22:26:51.577575] [DEBUG] [MAIN ] SJT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:51.588354] [INFO ] [MAIN ] SJT: Generated 1807 derivative records from 22312 primary records. [2025-09-25T22:26:51.588542] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-25T22:26:51.606799] [DEBUG] [MAIN ] SKE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:51.616246] [INFO ] [MAIN ] SKE: Generated 1807 derivative records from 35919 primary records. [2025-09-25T22:26:51.625467] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1807 records). [2025-09-25T22:26:51.626377] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-25T22:26:51.631254] [INFO ] [MAIN ] Derivative Progress: 1624/2043 symbols completed. SKIL took 1.2s. Estimated remaining: 2m 56s. Rate: 142.7 symbols/min [2025-09-25T22:26:51.626230] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-25T22:26:51.633438] [DEBUG] [LOCAL ] SJT: Derivative data saved (1807 records). [2025-09-25T22:26:51.633917] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:51.634630] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-25T22:26:51.638244] [INFO ] [MAIN ] Derivative Progress: 1625/2043 symbols completed. SJT took 1.2s. Estimated remaining: 2m 56s. Rate: 142.8 symbols/min [2025-09-25T22:26:51.649089] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:51.669130] [DEBUG] [LOCAL ] SKLZ: Loaded 12038 existing records from primary storage. [2025-09-25T22:26:51.670395] [INFO ] [MAIN ] SKLZ: Loaded 12038 primary data records. [2025-09-25T22:26:51.670263] [DEBUG] [LOCAL ] SKE: Derivative data saved (1807 records). [2025-09-25T22:26:51.676028] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-25T22:26:51.697079] [INFO ] [MAIN ] Derivative Progress: 1626/2043 symbols completed. SKE took 1.2s. Estimated remaining: 2m 55s. Rate: 142.9 symbols/min [2025-09-25T22:26:51.713939] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:51.834006] [DEBUG] [LOCAL ] SKM: Loaded 35350 existing records from primary storage. [2025-09-25T22:26:51.862949] [INFO ] [MAIN ] SKM: Loaded 35350 primary data records. [2025-09-25T22:26:52.257345] [DEBUG] [LOCAL ] SKT: Loaded 42940 existing records from primary storage. [2025-09-25T22:26:52.314783] [INFO ] [MAIN ] SKT: Loaded 42940 primary data records. [2025-09-25T22:26:52.808542] [DEBUG] [MAIN ] SKLZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:52.809907] [INFO ] [MAIN ] SKLZ: Generated 1807 derivative records from 12038 primary records. [2025-09-25T22:26:52.810205] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-25T22:26:52.841424] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1807 records). [2025-09-25T22:26:52.846841] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-25T22:26:52.850033] [INFO ] [MAIN ] Derivative Progress: 1627/2043 symbols completed. SKLZ took 1.2s. Estimated remaining: 2m 55s. Rate: 142.7 symbols/min [2025-09-25T22:26:52.850706] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:52.850938] [DEBUG] [MAIN ] SKM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:52.852041] [INFO ] [MAIN ] SKM: Generated 1807 derivative records from 35350 primary records. [2025-09-25T22:26:52.854022] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-25T22:26:52.872244] [DEBUG] [LOCAL ] SKM: Derivative data saved (1807 records). [2025-09-25T22:26:52.872413] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-25T22:26:52.875532] [INFO ] [MAIN ] Derivative Progress: 1628/2043 symbols completed. SKM took 1.2s. Estimated remaining: 2m 54s. Rate: 142.8 symbols/min [2025-09-25T22:26:52.876263] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:52.895023] [DEBUG] [MAIN ] SKT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:52.901427] [INFO ] [MAIN ] SKT: Generated 1807 derivative records from 42940 primary records. [2025-09-25T22:26:52.901747] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-25T22:26:52.932003] [DEBUG] [LOCAL ] SKYH: Loaded 16732 existing records from primary storage. [2025-09-25T22:26:52.936549] [INFO ] [MAIN ] SKYH: Loaded 16732 primary data records. [2025-09-25T22:26:52.937015] [DEBUG] [LOCAL ] SKT: Derivative data saved (1807 records). [2025-09-25T22:26:52.937349] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-25T22:26:52.974739] [INFO ] [MAIN ] Derivative Progress: 1629/2043 symbols completed. SKT took 1.3s. Estimated remaining: 2m 54s. Rate: 142.9 symbols/min [2025-09-25T22:26:53.004984] [DEBUG] [LOCAL ] SKY: Loaded 38035 existing records from primary storage. [2025-09-25T22:26:53.011666] [INFO ] [MAIN ] SKY: Loaded 38035 primary data records. [2025-09-25T22:26:53.011878] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:53.718486] [DEBUG] [LOCAL ] SLB: Loaded 54087 existing records from primary storage. [2025-09-25T22:26:53.719599] [INFO ] [MAIN ] SLB: Loaded 54087 primary data records. [2025-09-25T22:26:53.907212] [DEBUG] [MAIN ] SKYH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:53.948900] [INFO ] [MAIN ] SKYH: Generated 1807 derivative records from 16732 primary records. [2025-09-25T22:26:53.975814] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-25T22:26:54.205903] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1807 records). [2025-09-25T22:26:54.207290] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-25T22:26:54.210956] [INFO ] [MAIN ] Derivative Progress: 1630/2043 symbols completed. SKYH took 1.3s. Estimated remaining: 2m 54s. Rate: 142.7 symbols/min [2025-09-25T22:26:54.211487] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:54.227721] [DEBUG] [MAIN ] SKY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:54.229339] [INFO ] [MAIN ] SKY: Generated 1807 derivative records from 38035 primary records. [2025-09-25T22:26:54.229576] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-25T22:26:54.249179] [DEBUG] [LOCAL ] SKY: Derivative data saved (1807 records). [2025-09-25T22:26:54.249701] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-25T22:26:54.254107] [INFO ] [MAIN ] Derivative Progress: 1631/2043 symbols completed. SKY took 1.4s. Estimated remaining: 2m 53s. Rate: 142.8 symbols/min [2025-09-25T22:26:54.255209] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:54.275815] [DEBUG] [MAIN ] SLB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:54.276883] [INFO ] [MAIN ] SLB: Generated 1807 derivative records from 54087 primary records. [2025-09-25T22:26:54.277028] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-25T22:26:54.304903] [DEBUG] [LOCAL ] SLB: Derivative data saved (1807 records). [2025-09-25T22:26:54.306381] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-25T22:26:54.309425] [INFO ] [MAIN ] Derivative Progress: 1632/2043 symbols completed. SLB took 1.3s. Estimated remaining: 2m 53s. Rate: 142.9 symbols/min [2025-09-25T22:26:54.326310] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:54.328363] [DEBUG] [LOCAL ] SLF: Loaded 39211 existing records from primary storage. [2025-09-25T22:26:54.328815] [INFO ] [MAIN ] SLF: Loaded 39211 primary data records. [2025-09-25T22:26:54.707678] [DEBUG] [LOCAL ] SLG: Loaded 45836 existing records from primary storage. [2025-09-25T22:26:54.707962] [INFO ] [MAIN ] SLG: Loaded 45836 primary data records. [2025-09-25T22:26:54.718590] [DEBUG] [LOCAL ] SLGN: Loaded 40698 existing records from primary storage. [2025-09-25T22:26:54.755462] [INFO ] [MAIN ] SLGN: Loaded 40698 primary data records. [2025-09-25T22:26:55.484291] [DEBUG] [MAIN ] SLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:55.485342] [INFO ] [MAIN ] SLF: Generated 1807 derivative records from 39211 primary records. [2025-09-25T22:26:55.485781] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-25T22:26:55.507632] [DEBUG] [LOCAL ] SLF: Derivative data saved (1807 records). [2025-09-25T22:26:55.508711] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-25T22:26:55.513020] [INFO ] [MAIN ] Derivative Progress: 1633/2043 symbols completed. SLF took 1.3s. Estimated remaining: 2m 52s. Rate: 142.7 symbols/min [2025-09-25T22:26:55.536451] [DEBUG] [MAIN ] SLG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:55.537916] [INFO ] [MAIN ] SLG: Generated 1807 derivative records from 45836 primary records. [2025-09-25T22:26:55.538021] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-25T22:26:55.570776] [DEBUG] [MAIN ] SLGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:55.572546] [INFO ] [MAIN ] SLGN: Generated 1807 derivative records from 40698 primary records. [2025-09-25T22:26:55.572934] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-25T22:26:55.574500] [DEBUG] [LOCAL ] SLG: Derivative data saved (1807 records). [2025-09-25T22:26:55.574940] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-25T22:26:55.578011] [INFO ] [MAIN ] Derivative Progress: 1634/2043 symbols completed. SLG took 1.3s. Estimated remaining: 2m 52s. Rate: 142.8 symbols/min [2025-09-25T22:26:55.593381] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1807 records). [2025-09-25T22:26:55.593458] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-25T22:26:55.596409] [INFO ] [MAIN ] Derivative Progress: 1635/2043 symbols completed. SLGN took 1.3s. Estimated remaining: 2m 51s. Rate: 142.9 symbols/min [2025-09-25T22:26:55.597398] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:55.597540] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:55.597192] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:55.666257] [DEBUG] [LOCAL ] SLQT: Loaded 44097 existing records from primary storage. [2025-09-25T22:26:55.666542] [INFO ] [MAIN ] SLQT: Loaded 44097 primary data records. [2025-09-25T22:26:55.667180] [DEBUG] [LOCAL ] SLVM: Loaded 28188 existing records from primary storage. [2025-09-25T22:26:55.679545] [INFO ] [MAIN ] SLVM: Loaded 28188 primary data records. [2025-09-25T22:26:55.926350] [DEBUG] [LOCAL ] SM: Loaded 52692 existing records from primary storage. [2025-09-25T22:26:55.978185] [INFO ] [MAIN ] SM: Loaded 52692 primary data records. [2025-09-25T22:26:56.794345] [DEBUG] [MAIN ] SLVM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:56.796984] [INFO ] [MAIN ] SLVM: Generated 1807 derivative records from 28188 primary records. [2025-09-25T22:26:56.797718] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-25T22:26:56.797400] [DEBUG] [MAIN ] SLQT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:56.799690] [INFO ] [MAIN ] SLQT: Generated 1807 derivative records from 44097 primary records. [2025-09-25T22:26:56.799812] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-25T22:26:56.832832] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1807 records). [2025-09-25T22:26:56.834295] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-25T22:26:56.837556] [INFO ] [MAIN ] Derivative Progress: 1636/2043 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 51s. Rate: 142.7 symbols/min [2025-09-25T22:26:56.839749] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1807 records). [2025-09-25T22:26:56.840185] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-25T22:26:56.840083] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:56.845237] [INFO ] [MAIN ] Derivative Progress: 1637/2043 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 51s. Rate: 142.8 symbols/min [2025-09-25T22:26:56.848065] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:56.866319] [DEBUG] [MAIN ] SM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:56.867589] [INFO ] [MAIN ] SM: Generated 1807 derivative records from 52692 primary records. [2025-09-25T22:26:56.870215] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-25T22:26:56.883991] [DEBUG] [LOCAL ] SMBK: Loaded 8297 existing records from primary storage. [2025-09-25T22:26:56.895572] [DEBUG] [LOCAL ] SM: Derivative data saved (1807 records). [2025-09-25T22:26:56.894437] [INFO ] [MAIN ] SMBK: Loaded 8297 primary data records. [2025-09-25T22:26:56.901244] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-25T22:26:56.904232] [INFO ] [MAIN ] Derivative Progress: 1638/2043 symbols completed. SM took 1.3s. Estimated remaining: 2m 50s. Rate: 142.9 symbols/min [2025-09-25T22:26:56.944195] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:56.975670] [DEBUG] [LOCAL ] SMC: Loaded 11564 existing records from primary storage. [2025-09-25T22:26:56.981088] [INFO ] [MAIN ] SMC: Loaded 11564 primary data records. [2025-09-25T22:26:57.636173] [DEBUG] [LOCAL ] SMFG: Loaded 48429 existing records from primary storage. [2025-09-25T22:26:57.636992] [INFO ] [MAIN ] SMFG: Loaded 48429 primary data records. [2025-09-25T22:26:58.006408] [DEBUG] [MAIN ] SMBK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:58.007915] [INFO ] [MAIN ] SMBK: Generated 1807 derivative records from 8297 primary records. [2025-09-25T22:26:58.008159] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-25T22:26:58.034904] [DEBUG] [MAIN ] SMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:58.040529] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1807 records). [2025-09-25T22:26:58.036948] [INFO ] [MAIN ] SMC: Generated 1807 derivative records from 11564 primary records. [2025-09-25T22:26:58.040840] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-25T22:26:58.046088] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-25T22:26:58.046813] [INFO ] [MAIN ] Derivative Progress: 1639/2043 symbols completed. SMBK took 1.2s. Estimated remaining: 2m 50s. Rate: 142.7 symbols/min [2025-09-25T22:26:58.047146] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:58.067603] [DEBUG] [LOCAL ] SMC: Derivative data saved (1807 records). [2025-09-25T22:26:58.068057] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-25T22:26:58.071383] [INFO ] [MAIN ] Derivative Progress: 1640/2043 symbols completed. SMC took 1.2s. Estimated remaining: 2m 49s. Rate: 142.8 symbols/min [2025-09-25T22:26:58.071966] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:58.091185] [DEBUG] [MAIN ] SMFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:58.096057] [INFO ] [MAIN ] SMFG: Generated 1807 derivative records from 48429 primary records. [2025-09-25T22:26:58.096237] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-25T22:26:58.114923] [DEBUG] [LOCAL ] SMHI: Loaded 13854 existing records from primary storage. [2025-09-25T22:26:58.119226] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1807 records). [2025-09-25T22:26:58.116170] [INFO ] [MAIN ] SMHI: Loaded 13854 primary data records. [2025-09-25T22:26:58.130606] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-25T22:26:58.155428] [INFO ] [MAIN ] Derivative Progress: 1641/2043 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 49s. Rate: 142.9 symbols/min [2025-09-25T22:26:58.172283] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:58.302561] [DEBUG] [LOCAL ] SMG: Loaded 44209 existing records from primary storage. [2025-09-25T22:26:58.343963] [INFO ] [MAIN ] SMG: Loaded 44209 primary data records. [2025-09-25T22:26:58.587737] [DEBUG] [LOCAL ] SMP: Loaded 19897 existing records from primary storage. [2025-09-25T22:26:58.601495] [INFO ] [MAIN ] SMP: Loaded 19897 primary data records. [2025-09-25T22:26:59.242787] [DEBUG] [MAIN ] SMHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:59.244118] [INFO ] [MAIN ] SMHI: Generated 1807 derivative records from 13854 primary records. [2025-09-25T22:26:59.244835] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-25T22:26:59.266594] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1807 records). [2025-09-25T22:26:59.267681] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-25T22:26:59.270719] [INFO ] [MAIN ] Derivative Progress: 1642/2043 symbols completed. SMHI took 1.2s. Estimated remaining: 2m 49s. Rate: 142.7 symbols/min [2025-09-25T22:26:59.271507] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:59.286773] [DEBUG] [MAIN ] SMG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:59.287622] [INFO ] [MAIN ] SMG: Generated 1807 derivative records from 44209 primary records. [2025-09-25T22:26:59.287804] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-25T22:26:59.321179] [DEBUG] [MAIN ] SMP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:26:59.321606] [DEBUG] [LOCAL ] SMG: Derivative data saved (1807 records). [2025-09-25T22:26:59.322639] [INFO ] [MAIN ] SMP: Generated 1807 derivative records from 19897 primary records. [2025-09-25T22:26:59.322769] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-25T22:26:59.322855] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-25T22:26:59.326979] [INFO ] [MAIN ] Derivative Progress: 1643/2043 symbols completed. SMG took 1.3s. Estimated remaining: 2m 48s. Rate: 142.8 symbols/min [2025-09-25T22:26:59.327443] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:59.356366] [DEBUG] [LOCAL ] SMP: Derivative data saved (1807 records). [2025-09-25T22:26:59.356587] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-25T22:26:59.359760] [INFO ] [MAIN ] Derivative Progress: 1644/2043 symbols completed. SMP took 1.2s. Estimated remaining: 2m 48s. Rate: 142.9 symbols/min [2025-09-25T22:26:59.360244] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:26:59.392525] [DEBUG] [LOCAL ] SMRT: Loaded 44436 existing records from primary storage. [2025-09-25T22:26:59.392927] [INFO ] [MAIN ] SMRT: Loaded 44436 primary data records. [2025-09-25T22:26:59.515441] [DEBUG] [LOCAL ] SMWB: Loaded 32959 existing records from primary storage. [2025-09-25T22:26:59.520015] [INFO ] [MAIN ] SMWB: Loaded 32959 primary data records. [2025-09-25T22:26:59.853930] [DEBUG] [LOCAL ] SN: Loaded 50150 existing records from primary storage. [2025-09-25T22:26:59.873929] [INFO ] [MAIN ] SN: Loaded 50150 primary data records. [2025-09-25T22:27:00.476565] [DEBUG] [MAIN ] SMRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:00.478577] [INFO ] [MAIN ] SMRT: Generated 1807 derivative records from 44436 primary records. [2025-09-25T22:27:00.478979] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-25T22:27:00.501105] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1807 records). [2025-09-25T22:27:00.501623] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-25T22:27:00.505025] [INFO ] [MAIN ] Derivative Progress: 1645/2043 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 47s. Rate: 142.7 symbols/min [2025-09-25T22:27:00.506353] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:00.528774] [DEBUG] [MAIN ] SMWB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:00.529969] [INFO ] [MAIN ] SMWB: Generated 1807 derivative records from 32959 primary records. [2025-09-25T22:27:00.542548] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-25T22:27:00.543010] [DEBUG] [MAIN ] SN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:00.544586] [INFO ] [MAIN ] SN: Generated 1807 derivative records from 50150 primary records. [2025-09-25T22:27:00.545071] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-25T22:27:00.592787] [DEBUG] [LOCAL ] SNA: Loaded 26478 existing records from primary storage. [2025-09-25T22:27:00.593713] [INFO ] [MAIN ] SNA: Loaded 26478 primary data records. [2025-09-25T22:27:00.593303] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1807 records). [2025-09-25T22:27:00.606665] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-25T22:27:00.652101] [DEBUG] [LOCAL ] SN: Derivative data saved (1807 records). [2025-09-25T22:27:00.654719] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-25T22:27:00.644594] [INFO ] [MAIN ] Derivative Progress: 1646/2043 symbols completed. SMWB took 1.3s. Estimated remaining: 2m 47s. Rate: 142.8 symbols/min [2025-09-25T22:27:00.690678] [INFO ] [MAIN ] Derivative Progress: 1647/2043 symbols completed. SN took 1.3s. Estimated remaining: 2m 46s. Rate: 142.9 symbols/min [2025-09-25T22:27:00.690748] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:00.715600] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:00.990237] [DEBUG] [LOCAL ] SNDA: Loaded 4711 existing records from primary storage. [2025-09-25T22:27:00.990795] [INFO ] [MAIN ] SNDA: Loaded 4711 primary data records. [2025-09-25T22:27:01.370122] [DEBUG] [LOCAL ] SNAP: Loaded 54186 existing records from primary storage. [2025-09-25T22:27:01.371553] [INFO ] [MAIN ] SNAP: Loaded 54186 primary data records. [2025-09-25T22:27:01.522713] [DEBUG] [MAIN ] SNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:01.578593] [INFO ] [MAIN ] SNA: Generated 1807 derivative records from 26478 primary records. [2025-09-25T22:27:01.712495] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-25T22:27:01.736935] [DEBUG] [LOCAL ] SNA: Derivative data saved (1807 records). [2025-09-25T22:27:01.738318] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-25T22:27:01.741829] [INFO ] [MAIN ] Derivative Progress: 1648/2043 symbols completed. SNA took 1.2s. Estimated remaining: 2m 46s. Rate: 142.7 symbols/min [2025-09-25T22:27:01.757218] [DEBUG] [MAIN ] SNDA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:01.758187] [INFO ] [MAIN ] SNDA: Generated 1807 derivative records from 4711 primary records. [2025-09-25T22:27:01.758354] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-25T22:27:01.774979] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1807 records). [2025-09-25T22:27:01.775389] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-25T22:27:01.780430] [INFO ] [MAIN ] Derivative Progress: 1649/2043 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 46s. Rate: 142.8 symbols/min [2025-09-25T22:27:01.796515] [DEBUG] [MAIN ] SNAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:01.797233] [INFO ] [MAIN ] SNAP: Generated 1807 derivative records from 54186 primary records. [2025-09-25T22:27:01.797298] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-25T22:27:01.814191] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1807 records). [2025-09-25T22:27:01.814294] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-25T22:27:01.817108] [INFO ] [MAIN ] Derivative Progress: 1650/2043 symbols completed. SNAP took 1.1s. Estimated remaining: 2m 45s. Rate: 142.9 symbols/min [2025-09-25T22:27:01.818565] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:01.818502] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:01.818339] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:01.901707] [DEBUG] [LOCAL ] SNV: Loaded 49296 existing records from primary storage. [2025-09-25T22:27:01.902529] [INFO ] [MAIN ] SNV: Loaded 49296 primary data records. [2025-09-25T22:27:01.950367] [DEBUG] [LOCAL ] SNN: Loaded 44731 existing records from primary storage. [2025-09-25T22:27:01.976704] [INFO ] [MAIN ] SNN: Loaded 44731 primary data records. [2025-09-25T22:27:02.042248] [DEBUG] [LOCAL ] SNDR: Loaded 41031 existing records from primary storage. [2025-09-25T22:27:02.053400] [INFO ] [MAIN ] SNDR: Loaded 41031 primary data records. [2025-09-25T22:27:03.018515] [DEBUG] [MAIN ] SNV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:03.019482] [INFO ] [MAIN ] SNV: Generated 1807 derivative records from 49296 primary records. [2025-09-25T22:27:03.019684] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-25T22:27:03.054536] [DEBUG] [MAIN ] SNN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:03.056379] [INFO ] [MAIN ] SNN: Generated 1807 derivative records from 44731 primary records. [2025-09-25T22:27:03.056962] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-25T22:27:03.083228] [DEBUG] [MAIN ] SNDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:03.084440] [INFO ] [MAIN ] SNDR: Generated 1807 derivative records from 41031 primary records. [2025-09-25T22:27:03.082899] [DEBUG] [LOCAL ] SNV: Derivative data saved (1807 records). [2025-09-25T22:27:03.085560] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-25T22:27:03.084830] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-25T22:27:03.089336] [INFO ] [MAIN ] Derivative Progress: 1651/2043 symbols completed. SNV took 1.3s. Estimated remaining: 2m 45s. Rate: 142.7 symbols/min [2025-09-25T22:27:03.090910] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:03.109016] [DEBUG] [LOCAL ] SNN: Derivative data saved (1807 records). [2025-09-25T22:27:03.109834] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-25T22:27:03.114569] [INFO ] [MAIN ] Derivative Progress: 1652/2043 symbols completed. SNN took 1.3s. Estimated remaining: 2m 44s. Rate: 142.8 symbols/min [2025-09-25T22:27:03.115460] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:03.116298] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1807 records). [2025-09-25T22:27:03.116435] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-25T22:27:03.120036] [INFO ] [MAIN ] Derivative Progress: 1653/2043 symbols completed. SNDR took 1.3s. Estimated remaining: 2m 44s. Rate: 142.9 symbols/min [2025-09-25T22:27:03.120492] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:03.195883] [DEBUG] [LOCAL ] SOBO: Loaded 39894 existing records from primary storage. [2025-09-25T22:27:03.196228] [INFO ] [MAIN ] SOBO: Loaded 39894 primary data records. [2025-09-25T22:27:03.237219] [DEBUG] [LOCAL ] SNX: Loaded 40172 existing records from primary storage. [2025-09-25T22:27:03.259105] [INFO ] [MAIN ] SNX: Loaded 40172 primary data records. [2025-09-25T22:27:03.440693] [DEBUG] [LOCAL ] SOC: Loaded 50651 existing records from primary storage. [2025-09-25T22:27:03.512788] [INFO ] [MAIN ] SOC: Loaded 50651 primary data records. [2025-09-25T22:27:04.225049] [DEBUG] [MAIN ] SOBO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:04.228350] [INFO ] [MAIN ] SOBO: Generated 1807 derivative records from 39894 primary records. [2025-09-25T22:27:04.228479] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-25T22:27:04.259496] [DEBUG] [MAIN ] SNX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:04.262038] [INFO ] [MAIN ] SNX: Generated 1807 derivative records from 40172 primary records. [2025-09-25T22:27:04.263046] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-25T22:27:04.275358] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1807 records). [2025-09-25T22:27:04.282629] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-25T22:27:04.282512] [DEBUG] [LOCAL ] SNX: Derivative data saved (1807 records). [2025-09-25T22:27:04.284006] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-25T22:27:04.286305] [INFO ] [MAIN ] Derivative Progress: 1654/2043 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 44s. Rate: 142.7 symbols/min [2025-09-25T22:27:04.291872] [INFO ] [MAIN ] Derivative Progress: 1655/2043 symbols completed. SNX took 1.2s. Estimated remaining: 2m 43s. Rate: 142.8 symbols/min [2025-09-25T22:27:04.288050] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:04.292302] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:04.309442] [DEBUG] [MAIN ] SOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:04.310494] [INFO ] [MAIN ] SOC: Generated 1807 derivative records from 50651 primary records. [2025-09-25T22:27:04.310779] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-25T22:27:04.335325] [DEBUG] [LOCAL ] SOC: Derivative data saved (1807 records). [2025-09-25T22:27:04.335546] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-25T22:27:04.338826] [INFO ] [MAIN ] Derivative Progress: 1656/2043 symbols completed. SOC took 1.2s. Estimated remaining: 2m 43s. Rate: 142.9 symbols/min [2025-09-25T22:27:04.335225] [DEBUG] [LOCAL ] SOJC: Loaded 5090 existing records from primary storage. [2025-09-25T22:27:04.339152] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:04.339630] [INFO ] [MAIN ] SOJC: Loaded 5090 primary data records. [2025-09-25T22:27:04.393302] [DEBUG] [LOCAL ] SOJD: Loaded 13059 existing records from primary storage. [2025-09-25T22:27:04.418883] [INFO ] [MAIN ] SOJD: Loaded 13059 primary data records. [2025-09-25T22:27:04.525920] [DEBUG] [LOCAL ] SOJE: Loaded 9346 existing records from primary storage. [2025-09-25T22:27:04.579316] [INFO ] [MAIN ] SOJE: Loaded 9346 primary data records. [2025-09-25T22:27:05.478369] [DEBUG] [MAIN ] SOJC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:05.479865] [INFO ] [MAIN ] SOJC: Generated 1807 derivative records from 5090 primary records. [2025-09-25T22:27:05.480215] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-25T22:27:05.502372] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1807 records). [2025-09-25T22:27:05.502990] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-25T22:27:05.507084] [INFO ] [MAIN ] Derivative Progress: 1657/2043 symbols completed. SOJC took 1.2s. Estimated remaining: 2m 42s. Rate: 142.7 symbols/min [2025-09-25T22:27:05.521477] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:05.522165] [DEBUG] [MAIN ] SOJD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:05.523780] [INFO ] [MAIN ] SOJD: Generated 1807 derivative records from 13059 primary records. [2025-09-25T22:27:05.527233] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-25T22:27:05.560524] [DEBUG] [MAIN ] SOJE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:05.561610] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1807 records). [2025-09-25T22:27:05.562902] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-25T22:27:05.562801] [INFO ] [MAIN ] SOJE: Generated 1807 derivative records from 9346 primary records. [2025-09-25T22:27:05.566462] [INFO ] [MAIN ] Derivative Progress: 1658/2043 symbols completed. SOJD took 1.3s. Estimated remaining: 2m 42s. Rate: 142.8 symbols/min [2025-09-25T22:27:05.566615] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-25T22:27:05.566917] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:05.596988] [DEBUG] [LOCAL ] SOL: Loaded 13615 existing records from primary storage. [2025-09-25T22:27:05.598713] [INFO ] [MAIN ] SOL: Loaded 13615 primary data records. [2025-09-25T22:27:05.598407] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1807 records). [2025-09-25T22:27:05.604199] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-25T22:27:05.627277] [INFO ] [MAIN ] Derivative Progress: 1659/2043 symbols completed. SOJE took 1.3s. Estimated remaining: 2m 41s. Rate: 142.9 symbols/min [2025-09-25T22:27:05.645232] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:05.963596] [DEBUG] [LOCAL ] SOLV: Loaded 44431 existing records from primary storage. [2025-09-25T22:27:05.964037] [INFO ] [MAIN ] SOLV: Loaded 44431 primary data records. [2025-09-25T22:27:06.074798] [DEBUG] [LOCAL ] SON: Loaded 43244 existing records from primary storage. [2025-09-25T22:27:06.094733] [INFO ] [MAIN ] SON: Loaded 43244 primary data records. [2025-09-25T22:27:06.690606] [DEBUG] [MAIN ] SOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:06.691982] [INFO ] [MAIN ] SOL: Generated 1807 derivative records from 13615 primary records. [2025-09-25T22:27:06.692272] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-25T22:27:06.712508] [DEBUG] [LOCAL ] SOL: Derivative data saved (1807 records). [2025-09-25T22:27:06.713269] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-25T22:27:06.715938] [INFO ] [MAIN ] Derivative Progress: 1660/2043 symbols completed. SOL took 1.2s. Estimated remaining: 2m 41s. Rate: 142.7 symbols/min [2025-09-25T22:27:06.717111] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:06.756324] [DEBUG] [MAIN ] SOLV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:06.762306] [DEBUG] [MAIN ] SON: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:06.764686] [INFO ] [MAIN ] SOLV: Generated 1807 derivative records from 44431 primary records. [2025-09-25T22:27:06.764857] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-25T22:27:06.763957] [INFO ] [MAIN ] SON: Generated 1807 derivative records from 43244 primary records. [2025-09-25T22:27:06.765560] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-25T22:27:06.801270] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1807 records). [2025-09-25T22:27:06.801583] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-25T22:27:06.804879] [INFO ] [MAIN ] Derivative Progress: 1661/2043 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 40s. Rate: 142.8 symbols/min [2025-09-25T22:27:06.796872] [DEBUG] [LOCAL ] SON: Derivative data saved (1807 records). [2025-09-25T22:27:06.805410] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:06.805567] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-25T22:27:06.809572] [INFO ] [MAIN ] Derivative Progress: 1662/2043 symbols completed. SON took 1.2s. Estimated remaining: 2m 40s. Rate: 142.9 symbols/min [2025-09-25T22:27:06.809948] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:06.816124] [DEBUG] [LOCAL ] SOR: Loaded 2934 existing records from primary storage. [2025-09-25T22:27:06.830864] [INFO ] [MAIN ] SOR: Loaded 2934 primary data records. [2025-09-25T22:27:06.925118] [DEBUG] [LOCAL ] SOS: Loaded 8154 existing records from primary storage. [2025-09-25T22:27:06.950081] [INFO ] [MAIN ] SOS: Loaded 8154 primary data records. [2025-09-25T22:27:07.007020] [DEBUG] [LOCAL ] SONY: Loaded 53747 existing records from primary storage. [2025-09-25T22:27:07.025746] [INFO ] [MAIN ] SONY: Loaded 53747 primary data records. [2025-09-25T22:27:07.929516] [DEBUG] [MAIN ] SOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:07.931283] [INFO ] [MAIN ] SOR: Generated 1807 derivative records from 2934 primary records. [2025-09-25T22:27:07.931410] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-25T22:27:07.951986] [DEBUG] [LOCAL ] SOR: Derivative data saved (1807 records). [2025-09-25T22:27:07.952158] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-25T22:27:07.954445] [INFO ] [MAIN ] Derivative Progress: 1663/2043 symbols completed. SOR took 1.1s. Estimated remaining: 2m 40s. Rate: 142.7 symbols/min [2025-09-25T22:27:07.970341] [DEBUG] [MAIN ] SOS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:07.972007] [INFO ] [MAIN ] SOS: Generated 1807 derivative records from 8154 primary records. [2025-09-25T22:27:07.972083] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-25T22:27:07.989011] [DEBUG] [LOCAL ] SOS: Derivative data saved (1807 records). [2025-09-25T22:27:07.989150] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-25T22:27:07.993291] [INFO ] [MAIN ] Derivative Progress: 1664/2043 symbols completed. SOS took 1.2s. Estimated remaining: 2m 39s. Rate: 142.8 symbols/min [2025-09-25T22:27:08.011961] [DEBUG] [MAIN ] SONY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:08.013077] [INFO ] [MAIN ] SONY: Generated 1807 derivative records from 53747 primary records. [2025-09-25T22:27:08.013150] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-25T22:27:08.031990] [DEBUG] [LOCAL ] SONY: Derivative data saved (1807 records). [2025-09-25T22:27:08.032206] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-25T22:27:08.036458] [INFO ] [MAIN ] Derivative Progress: 1665/2043 symbols completed. SONY took 1.3s. Estimated remaining: 2m 39s. Rate: 142.9 symbols/min [2025-09-25T22:27:08.037743] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:08.038057] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:08.038907] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:08.049636] [DEBUG] [LOCAL ] SPE: Loaded 6414 existing records from primary storage. [2025-09-25T22:27:08.049837] [INFO ] [MAIN ] SPE: Loaded 6414 primary data records. [2025-09-25T22:27:08.407981] [DEBUG] [LOCAL ] SPB: Loaded 34467 existing records from primary storage. [2025-09-25T22:27:08.422901] [INFO ] [MAIN ] SPB: Loaded 34467 primary data records. [2025-09-25T22:27:08.437983] [DEBUG] [LOCAL ] SPCE: Loaded 50249 existing records from primary storage. [2025-09-25T22:27:08.459453] [INFO ] [MAIN ] SPCE: Loaded 50249 primary data records. [2025-09-25T22:27:09.130789] [DEBUG] [MAIN ] SPE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:09.134135] [INFO ] [MAIN ] SPE: Generated 1807 derivative records from 6414 primary records. [2025-09-25T22:27:09.134570] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-25T22:27:09.157067] [DEBUG] [LOCAL ] SPE: Derivative data saved (1807 records). [2025-09-25T22:27:09.158563] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-25T22:27:09.162742] [INFO ] [MAIN ] Derivative Progress: 1666/2043 symbols completed. SPE took 1.1s. Estimated remaining: 2m 38s. Rate: 142.8 symbols/min [2025-09-25T22:27:09.163471] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:09.200726] [DEBUG] [MAIN ] SPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:09.202234] [INFO ] [MAIN ] SPB: Generated 1807 derivative records from 34467 primary records. [2025-09-25T22:27:09.202450] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-25T22:27:09.203725] [DEBUG] [MAIN ] SPCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:09.204903] [INFO ] [MAIN ] SPCE: Generated 1807 derivative records from 50249 primary records. [2025-09-25T22:27:09.212025] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-25T22:27:09.235466] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1807 records). [2025-09-25T22:27:09.236264] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-25T22:27:09.239800] [INFO ] [MAIN ] Derivative Progress: 1667/2043 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 38s. Rate: 142.8 symbols/min [2025-09-25T22:27:09.240481] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:09.243927] [DEBUG] [LOCAL ] SPB: Derivative data saved (1807 records). [2025-09-25T22:27:09.244137] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-25T22:27:09.246803] [INFO ] [MAIN ] Derivative Progress: 1668/2043 symbols completed. SPB took 1.2s. Estimated remaining: 2m 37s. Rate: 142.9 symbols/min [2025-09-25T22:27:09.247402] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:09.295213] [DEBUG] [LOCAL ] SPG: Loaded 50772 existing records from primary storage. [2025-09-25T22:27:09.295513] [INFO ] [MAIN ] SPG: Loaded 50772 primary data records. [2025-09-25T22:27:09.338243] [DEBUG] [LOCAL ] SPH: Loaded 18140 existing records from primary storage. [2025-09-25T22:27:09.351699] [INFO ] [MAIN ] SPH: Loaded 18140 primary data records. [2025-09-25T22:27:09.608827] [DEBUG] [LOCAL ] SPGI: Loaded 46194 existing records from primary storage. [2025-09-25T22:27:09.668581] [INFO ] [MAIN ] SPGI: Loaded 46194 primary data records. [2025-09-25T22:27:10.403949] [DEBUG] [MAIN ] SPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:10.407787] [INFO ] [MAIN ] SPG: Generated 1807 derivative records from 50772 primary records. [2025-09-25T22:27:10.408109] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-25T22:27:10.422314] [DEBUG] [MAIN ] SPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:10.432066] [INFO ] [MAIN ] SPH: Generated 1807 derivative records from 18140 primary records. [2025-09-25T22:27:10.433867] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-25T22:27:10.452150] [DEBUG] [LOCAL ] SPG: Derivative data saved (1807 records). [2025-09-25T22:27:10.455240] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-25T22:27:10.459763] [DEBUG] [LOCAL ] SPH: Derivative data saved (1807 records). [2025-09-25T22:27:10.460031] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-25T22:27:10.462994] [INFO ] [MAIN ] Derivative Progress: 1669/2043 symbols completed. SPG took 1.3s. Estimated remaining: 2m 37s. Rate: 142.7 symbols/min [2025-09-25T22:27:10.468008] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:10.468242] [INFO ] [MAIN ] Derivative Progress: 1670/2043 symbols completed. SPH took 1.2s. Estimated remaining: 2m 37s. Rate: 142.8 symbols/min [2025-09-25T22:27:10.469058] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:10.485716] [DEBUG] [MAIN ] SPGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:10.486624] [INFO ] [MAIN ] SPGI: Generated 1807 derivative records from 46194 primary records. [2025-09-25T22:27:10.486915] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-25T22:27:10.514213] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1807 records). [2025-09-25T22:27:10.514638] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-25T22:27:10.519970] [INFO ] [MAIN ] Derivative Progress: 1671/2043 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 36s. Rate: 142.9 symbols/min [2025-09-25T22:27:10.520462] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:10.543348] [DEBUG] [LOCAL ] SPMC: Loaded 5577 existing records from primary storage. [2025-09-25T22:27:10.543515] [INFO ] [MAIN ] SPMC: Loaded 5577 primary data records. [2025-09-25T22:27:10.674682] [DEBUG] [LOCAL ] SPHR: Loaded 40404 existing records from primary storage. [2025-09-25T22:27:10.675017] [INFO ] [MAIN ] SPHR: Loaded 40404 primary data records. [2025-09-25T22:27:10.859367] [DEBUG] [LOCAL ] SPIR: Loaded 37679 existing records from primary storage. [2025-09-25T22:27:10.887467] [INFO ] [MAIN ] SPIR: Loaded 37679 primary data records. [2025-09-25T22:27:11.629730] [DEBUG] [MAIN ] SPMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:11.636551] [INFO ] [MAIN ] SPMC: Generated 1807 derivative records from 5577 primary records. [2025-09-25T22:27:11.637126] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-25T22:27:11.638716] [DEBUG] [MAIN ] SPHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:11.640128] [INFO ] [MAIN ] SPHR: Generated 1807 derivative records from 40404 primary records. [2025-09-25T22:27:11.649490] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-25T22:27:11.658064] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1807 records). [2025-09-25T22:27:11.666972] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-25T22:27:11.676426] [INFO ] [MAIN ] Derivative Progress: 1672/2043 symbols completed. SPMC took 1.2s. Estimated remaining: 2m 36s. Rate: 142.8 symbols/min [2025-09-25T22:27:11.678072] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:11.695206] [DEBUG] [MAIN ] SPIR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:11.697580] [INFO ] [MAIN ] SPIR: Generated 1807 derivative records from 37679 primary records. [2025-09-25T22:27:11.698355] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-25T22:27:11.699754] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1807 records). [2025-09-25T22:27:11.700461] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-25T22:27:11.704456] [INFO ] [MAIN ] Derivative Progress: 1673/2043 symbols completed. SPHR took 1.2s. Estimated remaining: 2m 35s. Rate: 142.8 symbols/min [2025-09-25T22:27:11.705044] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:11.722494] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1807 records). [2025-09-25T22:27:11.722711] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-25T22:27:11.726362] [INFO ] [MAIN ] Derivative Progress: 1674/2043 symbols completed. SPIR took 1.3s. Estimated remaining: 2m 35s. Rate: 142.9 symbols/min [2025-09-25T22:27:11.727000] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:11.759434] [DEBUG] [LOCAL ] SPNT: Loaded 35119 existing records from primary storage. [2025-09-25T22:27:11.759775] [INFO ] [MAIN ] SPNT: Loaded 35119 primary data records. [2025-09-25T22:27:12.021408] [DEBUG] [LOCAL ] SPOT: Loaded 51178 existing records from primary storage. [2025-09-25T22:27:12.071234] [INFO ] [MAIN ] SPOT: Loaded 51178 primary data records. [2025-09-25T22:27:12.029063] [DEBUG] [LOCAL ] SPR: Loaded 41539 existing records from primary storage. [2025-09-25T22:27:12.190521] [INFO ] [MAIN ] SPR: Loaded 41539 primary data records. [2025-09-25T22:27:12.889448] [DEBUG] [MAIN ] SPNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:12.892545] [INFO ] [MAIN ] SPNT: Generated 1807 derivative records from 35119 primary records. [2025-09-25T22:27:12.893286] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-25T22:27:12.913209] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1807 records). [2025-09-25T22:27:12.913316] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-25T22:27:12.915719] [INFO ] [MAIN ] Derivative Progress: 1675/2043 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 35s. Rate: 142.8 symbols/min [2025-09-25T22:27:12.916247] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:12.939570] [DEBUG] [MAIN ] SPOT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:12.949935] [DEBUG] [LOCAL ] SPRU: Loaded 8554 existing records from primary storage. [2025-09-25T22:27:12.951905] [INFO ] [MAIN ] SPOT: Generated 1807 derivative records from 51178 primary records. [2025-09-25T22:27:12.953032] [INFO ] [MAIN ] SPRU: Loaded 8554 primary data records. [2025-09-25T22:27:12.953273] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-25T22:27:13.014517] [DEBUG] [MAIN ] SPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:13.042752] [INFO ] [MAIN ] SPR: Generated 1807 derivative records from 41539 primary records. [2025-09-25T22:27:13.059436] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-25T22:27:13.117001] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1807 records). [2025-09-25T22:27:13.124105] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-25T22:27:13.144003] [INFO ] [MAIN ] Derivative Progress: 1676/2043 symbols completed. SPOT took 1.4s. Estimated remaining: 2m 34s. Rate: 142.8 symbols/min [2025-09-25T22:27:13.201632] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:13.208889] [DEBUG] [LOCAL ] SPR: Derivative data saved (1807 records). [2025-09-25T22:27:13.209735] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-25T22:27:13.214320] [INFO ] [MAIN ] Derivative Progress: 1677/2043 symbols completed. SPR took 1.5s. Estimated remaining: 2m 34s. Rate: 142.9 symbols/min [2025-09-25T22:27:13.215006] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:13.357973] [DEBUG] [LOCAL ] SPXX: Loaded 9037 existing records from primary storage. [2025-09-25T22:27:13.358160] [INFO ] [MAIN ] SPXX: Loaded 9037 primary data records. [2025-09-25T22:27:13.474434] [DEBUG] [LOCAL ] SPXC: Loaded 23521 existing records from primary storage. [2025-09-25T22:27:13.485866] [INFO ] [MAIN ] SPXC: Loaded 23521 primary data records. [2025-09-25T22:27:13.854810] [DEBUG] [MAIN ] SPRU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:13.898324] [INFO ] [MAIN ] SPRU: Generated 1807 derivative records from 8554 primary records. [2025-09-25T22:27:13.898759] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-25T22:27:14.111218] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1807 records). [2025-09-25T22:27:14.113115] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-25T22:27:14.116228] [INFO ] [MAIN ] Derivative Progress: 1678/2043 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 33s. Rate: 142.8 symbols/min [2025-09-25T22:27:14.145287] [DEBUG] [MAIN ] SPXX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:14.146932] [INFO ] [MAIN ] SPXX: Generated 1807 derivative records from 9037 primary records. [2025-09-25T22:27:14.147205] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-25T22:27:14.182333] [DEBUG] [MAIN ] SPXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:14.186925] [INFO ] [MAIN ] SPXC: Generated 1807 derivative records from 23521 primary records. [2025-09-25T22:27:14.187178] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-25T22:27:14.187054] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1807 records). [2025-09-25T22:27:14.188086] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-25T22:27:14.191868] [INFO ] [MAIN ] Derivative Progress: 1679/2043 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 33s. Rate: 142.8 symbols/min [2025-09-25T22:27:14.207860] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1807 records). [2025-09-25T22:27:14.207946] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-25T22:27:14.211700] [INFO ] [MAIN ] Derivative Progress: 1680/2043 symbols completed. SPXC took 1.0s. Estimated remaining: 2m 32s. Rate: 142.9 symbols/min [2025-09-25T22:27:14.212819] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:14.212971] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:14.212689] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:14.250321] [DEBUG] [LOCAL ] SQNS: Loaded 26181 existing records from primary storage. [2025-09-25T22:27:14.250596] [INFO ] [MAIN ] SQNS: Loaded 26181 primary data records. [2025-09-25T22:27:14.466700] [DEBUG] [LOCAL ] SR: Loaded 33151 existing records from primary storage. [2025-09-25T22:27:14.583608] [INFO ] [MAIN ] SR: Loaded 33151 primary data records. [2025-09-25T22:27:14.674471] [DEBUG] [LOCAL ] SQM: Loaded 48895 existing records from primary storage. [2025-09-25T22:27:14.688088] [INFO ] [MAIN ] SQM: Loaded 48895 primary data records. [2025-09-25T22:27:15.260802] [DEBUG] [MAIN ] SQNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:15.262851] [INFO ] [MAIN ] SQNS: Generated 1807 derivative records from 26181 primary records. [2025-09-25T22:27:15.263440] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-25T22:27:15.283287] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1807 records). [2025-09-25T22:27:15.283400] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-25T22:27:15.287583] [INFO ] [MAIN ] Derivative Progress: 1681/2043 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 32s. Rate: 142.8 symbols/min [2025-09-25T22:27:15.288487] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:15.309474] [DEBUG] [MAIN ] SR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:15.312056] [INFO ] [MAIN ] SR: Generated 1807 derivative records from 33151 primary records. [2025-09-25T22:27:15.312707] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-25T22:27:15.339232] [DEBUG] [MAIN ] SQM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:15.340731] [INFO ] [MAIN ] SQM: Generated 1807 derivative records from 48895 primary records. [2025-09-25T22:27:15.343114] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-25T22:27:15.343707] [DEBUG] [LOCAL ] SR: Derivative data saved (1807 records). [2025-09-25T22:27:15.344173] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-25T22:27:15.347398] [INFO ] [MAIN ] Derivative Progress: 1682/2043 symbols completed. SR took 1.1s. Estimated remaining: 2m 32s. Rate: 142.9 symbols/min [2025-09-25T22:27:15.348130] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:15.380162] [DEBUG] [LOCAL ] SQM: Derivative data saved (1807 records). [2025-09-25T22:27:15.380333] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-25T22:27:15.383550] [INFO ] [MAIN ] Derivative Progress: 1683/2043 symbols completed. SQM took 1.2s. Estimated remaining: 2m 31s. Rate: 142.9 symbols/min [2025-09-25T22:27:15.386567] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:15.393686] [DEBUG] [LOCAL ] SREA: Loaded 10476 existing records from primary storage. [2025-09-25T22:27:15.393829] [INFO ] [MAIN ] SREA: Loaded 10476 primary data records. [2025-09-25T22:27:15.501543] [DEBUG] [LOCAL ] SRE: Loaded 53815 existing records from primary storage. [2025-09-25T22:27:15.507094] [INFO ] [MAIN ] SRE: Loaded 53815 primary data records. [2025-09-25T22:27:15.876988] [DEBUG] [LOCAL ] SRFM: Loaded 36106 existing records from primary storage. [2025-09-25T22:27:15.907452] [INFO ] [MAIN ] SRFM: Loaded 36106 primary data records. [2025-09-25T22:27:16.504005] [DEBUG] [MAIN ] SREA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:16.510833] [DEBUG] [MAIN ] SRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:16.514252] [INFO ] [MAIN ] SRE: Generated 1807 derivative records from 53815 primary records. [2025-09-25T22:27:16.511978] [INFO ] [MAIN ] SREA: Generated 1807 derivative records from 10476 primary records. [2025-09-25T22:27:16.514931] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-25T22:27:16.515072] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-25T22:27:16.548553] [DEBUG] [LOCAL ] SREA: Derivative data saved (1807 records). [2025-09-25T22:27:16.549548] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-25T22:27:16.553910] [INFO ] [MAIN ] Derivative Progress: 1684/2043 symbols completed. SREA took 1.2s. Estimated remaining: 2m 31s. Rate: 142.8 symbols/min [2025-09-25T22:27:16.554665] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:16.550505] [DEBUG] [LOCAL ] SRE: Derivative data saved (1807 records). [2025-09-25T22:27:16.555778] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-25T22:27:16.559638] [INFO ] [MAIN ] Derivative Progress: 1685/2043 symbols completed. SRE took 1.3s. Estimated remaining: 2m 30s. Rate: 142.9 symbols/min [2025-09-25T22:27:16.562345] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:16.578058] [DEBUG] [MAIN ] SRFM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:16.579048] [INFO ] [MAIN ] SRFM: Generated 1807 derivative records from 36106 primary records. [2025-09-25T22:27:16.584427] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-25T22:27:16.604280] [DEBUG] [LOCAL ] SRG: Loaded 15726 existing records from primary storage. [2025-09-25T22:27:16.604672] [INFO ] [MAIN ] SRG: Loaded 15726 primary data records. [2025-09-25T22:27:16.739915] [DEBUG] [LOCAL ] SRI: Loaded 27654 existing records from primary storage. [2025-09-25T22:27:16.746178] [INFO ] [MAIN ] SRI: Loaded 27654 primary data records. [2025-09-25T22:27:16.747082] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1807 records). [2025-09-25T22:27:16.764306] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-25T22:27:16.777888] [INFO ] [MAIN ] Derivative Progress: 1686/2043 symbols completed. SRFM took 1.4s. Estimated remaining: 2m 30s. Rate: 142.9 symbols/min [2025-09-25T22:27:16.861924] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:17.140224] [DEBUG] [LOCAL ] SRV: Loaded 7583 existing records from primary storage. [2025-09-25T22:27:17.163177] [INFO ] [MAIN ] SRV: Loaded 7583 primary data records. [2025-09-25T22:27:17.650173] [DEBUG] [MAIN ] SRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:17.652108] [INFO ] [MAIN ] SRG: Generated 1807 derivative records from 15726 primary records. [2025-09-25T22:27:17.652986] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-25T22:27:17.671590] [DEBUG] [LOCAL ] SRG: Derivative data saved (1807 records). [2025-09-25T22:27:17.672175] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-25T22:27:17.675054] [INFO ] [MAIN ] Derivative Progress: 1687/2043 symbols completed. SRG took 1.1s. Estimated remaining: 2m 30s. Rate: 142.8 symbols/min [2025-09-25T22:27:17.676056] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:17.697038] [DEBUG] [MAIN ] SRI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:17.698225] [INFO ] [MAIN ] SRI: Generated 1807 derivative records from 27654 primary records. [2025-09-25T22:27:17.698524] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-25T22:27:17.721192] [DEBUG] [LOCAL ] SRI: Derivative data saved (1807 records). [2025-09-25T22:27:17.721495] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-25T22:27:17.727342] [INFO ] [MAIN ] Derivative Progress: 1688/2043 symbols completed. SRI took 1.2s. Estimated remaining: 2m 29s. Rate: 142.9 symbols/min [2025-09-25T22:27:17.727916] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:17.742316] [DEBUG] [MAIN ] SRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:17.743398] [INFO ] [MAIN ] SRV: Generated 1807 derivative records from 7583 primary records. [2025-09-25T22:27:17.755681] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-25T22:27:17.791099] [DEBUG] [LOCAL ] SRV: Derivative data saved (1807 records). [2025-09-25T22:27:17.792094] [DEBUG] [LOCAL ] SSB: Loaded 43106 existing records from primary storage. [2025-09-25T22:27:17.792361] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-25T22:27:17.792292] [INFO ] [MAIN ] SSB: Loaded 43106 primary data records. [2025-09-25T22:27:17.796077] [INFO ] [MAIN ] Derivative Progress: 1689/2043 symbols completed. SRV took 0.9s. Estimated remaining: 2m 29s. Rate: 143.0 symbols/min [2025-09-25T22:27:17.796531] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:17.872959] [DEBUG] [LOCAL ] SSD: Loaded 22447 existing records from primary storage. [2025-09-25T22:27:17.890599] [INFO ] [MAIN ] SSD: Loaded 22447 primary data records. [2025-09-25T22:27:18.385954] [DEBUG] [LOCAL ] SSL: Loaded 41545 existing records from primary storage. [2025-09-25T22:27:18.408170] [INFO ] [MAIN ] SSL: Loaded 41545 primary data records. [2025-09-25T22:27:18.926228] [DEBUG] [MAIN ] SSB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:18.928551] [INFO ] [MAIN ] SSB: Generated 1807 derivative records from 43106 primary records. [2025-09-25T22:27:18.928706] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-25T22:27:18.948676] [DEBUG] [LOCAL ] SSB: Derivative data saved (1807 records). [2025-09-25T22:27:18.952563] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-25T22:27:18.955617] [INFO ] [MAIN ] Derivative Progress: 1690/2043 symbols completed. SSB took 1.3s. Estimated remaining: 2m 28s. Rate: 142.8 symbols/min [2025-09-25T22:27:18.956088] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:18.979935] [DEBUG] [MAIN ] SSD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:18.982317] [INFO ] [MAIN ] SSD: Generated 1807 derivative records from 22447 primary records. [2025-09-25T22:27:18.982616] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-25T22:27:19.006025] [DEBUG] [LOCAL ] SSD: Derivative data saved (1807 records). [2025-09-25T22:27:19.006221] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-25T22:27:19.018816] [INFO ] [MAIN ] Derivative Progress: 1691/2043 symbols completed. SSD took 1.3s. Estimated remaining: 2m 28s. Rate: 142.9 symbols/min [2025-09-25T22:27:19.019348] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:19.020150] [DEBUG] [LOCAL ] SST: Loaded 12151 existing records from primary storage. [2025-09-25T22:27:19.033966] [INFO ] [MAIN ] SST: Loaded 12151 primary data records. [2025-09-25T22:27:19.058057] [DEBUG] [MAIN ] SSL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:19.104872] [INFO ] [MAIN ] SSL: Generated 1807 derivative records from 41545 primary records. [2025-09-25T22:27:19.110696] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-25T22:27:19.249929] [DEBUG] [LOCAL ] SSL: Derivative data saved (1807 records). [2025-09-25T22:27:19.280075] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-25T22:27:19.283980] [INFO ] [MAIN ] Derivative Progress: 1692/2043 symbols completed. SSL took 1.5s. Estimated remaining: 2m 27s. Rate: 142.9 symbols/min [2025-09-25T22:27:19.285243] [DEBUG] [LOCAL ] SSTK: Loaded 26638 existing records from primary storage. [2025-09-25T22:27:19.285362] [INFO ] [MAIN ] SSTK: Loaded 26638 primary data records. [2025-09-25T22:27:19.423544] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:19.770205] [DEBUG] [MAIN ] SST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:19.772056] [INFO ] [MAIN ] SST: Generated 1807 derivative records from 12151 primary records. [2025-09-25T22:27:19.772220] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-25T22:27:19.806842] [DEBUG] [LOCAL ] SST: Derivative data saved (1807 records). [2025-09-25T22:27:19.807076] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-25T22:27:19.808509] [DEBUG] [LOCAL ] ST: Loaded 50150 existing records from primary storage. [2025-09-25T22:27:19.811698] [INFO ] [MAIN ] Derivative Progress: 1693/2043 symbols completed. SST took 0.9s. Estimated remaining: 2m 27s. Rate: 142.9 symbols/min [2025-09-25T22:27:19.811815] [INFO ] [MAIN ] ST: Loaded 50150 primary data records. [2025-09-25T22:27:20.023056] [DEBUG] [MAIN ] SSTK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:20.038560] [INFO ] [MAIN ] SSTK: Generated 1807 derivative records from 26638 primary records. [2025-09-25T22:27:20.150101] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-25T22:27:20.184864] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1807 records). [2025-09-25T22:27:20.185357] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-25T22:27:20.189468] [INFO ] [MAIN ] Derivative Progress: 1694/2043 symbols completed. SSTK took 1.2s. Estimated remaining: 2m 27s. Rate: 142.9 symbols/min [2025-09-25T22:27:20.212077] [DEBUG] [MAIN ] ST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:20.213005] [INFO ] [MAIN ] ST: Generated 1807 derivative records from 50150 primary records. [2025-09-25T22:27:20.213073] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-25T22:27:20.230214] [DEBUG] [LOCAL ] ST: Derivative data saved (1807 records). [2025-09-25T22:27:20.230296] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-25T22:27:20.233112] [INFO ] [MAIN ] Derivative Progress: 1695/2043 symbols completed. ST took 0.8s. Estimated remaining: 2m 26s. Rate: 143.0 symbols/min [2025-09-25T22:27:20.234215] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:20.233906] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:20.234342] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:20.268046] [DEBUG] [LOCAL ] STC: Loaded 17792 existing records from primary storage. [2025-09-25T22:27:20.268321] [INFO ] [MAIN ] STC: Loaded 17792 primary data records. [2025-09-25T22:27:20.455620] [DEBUG] [LOCAL ] STE: Loaded 35635 existing records from primary storage. [2025-09-25T22:27:20.514104] [INFO ] [MAIN ] STE: Loaded 35635 primary data records. [2025-09-25T22:27:20.696285] [DEBUG] [LOCAL ] STAG: Loaded 50416 existing records from primary storage. [2025-09-25T22:27:20.712321] [INFO ] [MAIN ] STAG: Loaded 50416 primary data records. [2025-09-25T22:27:21.592167] [DEBUG] [MAIN ] STC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:21.595882] [INFO ] [MAIN ] STC: Generated 1807 derivative records from 17792 primary records. [2025-09-25T22:27:21.597380] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-25T22:27:21.627609] [DEBUG] [LOCAL ] STC: Derivative data saved (1807 records). [2025-09-25T22:27:21.629045] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-25T22:27:21.632784] [INFO ] [MAIN ] Derivative Progress: 1696/2043 symbols completed. STC took 1.4s. Estimated remaining: 2m 26s. Rate: 142.8 symbols/min [2025-09-25T22:27:21.633919] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:21.672066] [DEBUG] [MAIN ] STE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:21.674022] [INFO ] [MAIN ] STE: Generated 1807 derivative records from 35635 primary records. [2025-09-25T22:27:21.674165] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-25T22:27:21.697937] [DEBUG] [LOCAL ] STEL: Loaded 23712 existing records from primary storage. [2025-09-25T22:27:21.731144] [DEBUG] [MAIN ] STAG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:21.731780] [INFO ] [MAIN ] STEL: Loaded 23712 primary data records. [2025-09-25T22:27:21.733407] [INFO ] [MAIN ] STAG: Generated 1807 derivative records from 50416 primary records. [2025-09-25T22:27:21.733736] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-25T22:27:21.886398] [DEBUG] [LOCAL ] STAG: Derivative data saved (1807 records). [2025-09-25T22:27:21.872410] [DEBUG] [LOCAL ] STE: Derivative data saved (1807 records). [2025-09-25T22:27:21.905029] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-25T22:27:21.916738] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-25T22:27:21.922082] [INFO ] [MAIN ] Derivative Progress: 1697/2043 symbols completed. STAG took 1.7s. Estimated remaining: 2m 25s. Rate: 142.8 symbols/min [2025-09-25T22:27:21.932970] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:21.946351] [INFO ] [MAIN ] Derivative Progress: 1698/2043 symbols completed. STE took 1.7s. Estimated remaining: 2m 25s. Rate: 142.9 symbols/min [2025-09-25T22:27:21.957340] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:22.186877] [DEBUG] [LOCAL ] STEW: Loaded 16254 existing records from primary storage. [2025-09-25T22:27:22.187359] [INFO ] [MAIN ] STEW: Loaded 16254 primary data records. [2025-09-25T22:27:22.311489] [DEBUG] [LOCAL ] STEM: Loaded 40148 existing records from primary storage. [2025-09-25T22:27:22.338589] [INFO ] [MAIN ] STEM: Loaded 40148 primary data records. [2025-09-25T22:27:22.733567] [DEBUG] [MAIN ] STEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:22.754864] [INFO ] [MAIN ] STEL: Generated 1807 derivative records from 23712 primary records. [2025-09-25T22:27:22.774309] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-25T22:27:22.990698] [DEBUG] [LOCAL ] STEL: Derivative data saved (1807 records). [2025-09-25T22:27:22.991418] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-25T22:27:22.994431] [INFO ] [MAIN ] Derivative Progress: 1699/2043 symbols completed. STEL took 1.4s. Estimated remaining: 2m 25s. Rate: 142.8 symbols/min [2025-09-25T22:27:22.995710] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:23.013882] [DEBUG] [LOCAL ] STK: Loaded 9500 existing records from primary storage. [2025-09-25T22:27:23.030327] [DEBUG] [MAIN ] STEW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:23.030089] [INFO ] [MAIN ] STK: Loaded 9500 primary data records. [2025-09-25T22:27:23.036630] [INFO ] [MAIN ] STEW: Generated 1807 derivative records from 16254 primary records. [2025-09-25T22:27:23.065227] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-25T22:27:23.246793] [DEBUG] [LOCAL ] STEW: Derivative data saved (1807 records). [2025-09-25T22:27:23.269462] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-25T22:27:23.357811] [DEBUG] [MAIN ] STEM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:23.359446] [INFO ] [MAIN ] STEM: Generated 1807 derivative records from 40148 primary records. [2025-09-25T22:27:23.363586] [INFO ] [MAIN ] Derivative Progress: 1700/2043 symbols completed. STEW took 1.4s. Estimated remaining: 2m 24s. Rate: 142.8 symbols/min [2025-09-25T22:27:23.398010] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-25T22:27:23.416170] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:23.435816] [DEBUG] [LOCAL ] STEM: Derivative data saved (1807 records). [2025-09-25T22:27:23.436418] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-25T22:27:23.441139] [INFO ] [MAIN ] Derivative Progress: 1701/2043 symbols completed. STEM took 1.5s. Estimated remaining: 2m 24s. Rate: 142.8 symbols/min [2025-09-25T22:27:23.441897] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:23.474774] [DEBUG] [MAIN ] STK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:23.476026] [INFO ] [MAIN ] STK: Generated 1807 derivative records from 9500 primary records. [2025-09-25T22:27:23.476350] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-25T22:27:23.529057] [DEBUG] [LOCAL ] STK: Derivative data saved (1807 records). [2025-09-25T22:27:23.544729] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-25T22:27:23.549243] [DEBUG] [LOCAL ] STLA: Loaded 53932 existing records from primary storage. [2025-09-25T22:27:23.547717] [INFO ] [MAIN ] Derivative Progress: 1702/2043 symbols completed. STK took 0.6s. Estimated remaining: 2m 23s. Rate: 142.9 symbols/min [2025-09-25T22:27:23.549890] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:23.549979] [INFO ] [MAIN ] STLA: Loaded 53932 primary data records. [2025-09-25T22:27:23.675669] [DEBUG] [LOCAL ] STM: Loaded 53974 existing records from primary storage. [2025-09-25T22:27:23.694818] [INFO ] [MAIN ] STM: Loaded 53974 primary data records. [2025-09-25T22:27:23.863090] [DEBUG] [LOCAL ] STN: Loaded 23298 existing records from primary storage. [2025-09-25T22:27:24.022177] [INFO ] [MAIN ] STN: Loaded 23298 primary data records. [2025-09-25T22:27:24.614231] [DEBUG] [MAIN ] STLA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:24.615421] [INFO ] [MAIN ] STLA: Generated 1807 derivative records from 53932 primary records. [2025-09-25T22:27:24.616702] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-25T22:27:24.640423] [DEBUG] [LOCAL ] STLA: Derivative data saved (1807 records). [2025-09-25T22:27:24.641197] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-25T22:27:24.643826] [INFO ] [MAIN ] Derivative Progress: 1703/2043 symbols completed. STLA took 1.2s. Estimated remaining: 2m 23s. Rate: 142.8 symbols/min [2025-09-25T22:27:24.647580] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:24.663933] [DEBUG] [MAIN ] STM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:24.665231] [INFO ] [MAIN ] STM: Generated 1807 derivative records from 53974 primary records. [2025-09-25T22:27:24.665433] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-25T22:27:24.687306] [DEBUG] [LOCAL ] STM: Derivative data saved (1807 records). [2025-09-25T22:27:24.687691] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-25T22:27:24.690568] [INFO ] [MAIN ] Derivative Progress: 1704/2043 symbols completed. STM took 1.2s. Estimated remaining: 2m 22s. Rate: 142.8 symbols/min [2025-09-25T22:27:24.691242] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:24.705602] [DEBUG] [MAIN ] STN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:24.706807] [INFO ] [MAIN ] STN: Generated 1807 derivative records from 23298 primary records. [2025-09-25T22:27:24.707048] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-25T22:27:24.744374] [DEBUG] [LOCAL ] STN: Derivative data saved (1807 records). [2025-09-25T22:27:24.744705] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-25T22:27:24.745157] [DEBUG] [LOCAL ] STRV: Loaded 11659 existing records from primary storage. [2025-09-25T22:27:24.748749] [INFO ] [MAIN ] Derivative Progress: 1705/2043 symbols completed. STN took 1.2s. Estimated remaining: 2m 22s. Rate: 142.9 symbols/min [2025-09-25T22:27:24.749409] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:24.749608] [INFO ] [MAIN ] STRV: Loaded 11659 primary data records. [2025-09-25T22:27:24.883782] [DEBUG] [LOCAL ] STNG: Loaded 44319 existing records from primary storage. [2025-09-25T22:27:24.890186] [INFO ] [MAIN ] STNG: Loaded 44319 primary data records. [2025-09-25T22:27:25.332832] [DEBUG] [LOCAL ] STT: Loaded 51441 existing records from primary storage. [2025-09-25T22:27:25.372015] [INFO ] [MAIN ] STT: Loaded 51441 primary data records. [2025-09-25T22:27:25.895606] [DEBUG] [MAIN ] STRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:25.897766] [INFO ] [MAIN ] STRV: Generated 1807 derivative records from 11659 primary records. [2025-09-25T22:27:25.898334] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-25T22:27:25.916857] [DEBUG] [LOCAL ] STRV: Derivative data saved (1807 records). [2025-09-25T22:27:25.918272] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-25T22:27:25.921123] [INFO ] [MAIN ] Derivative Progress: 1706/2043 symbols completed. STRV took 1.2s. Estimated remaining: 2m 22s. Rate: 142.8 symbols/min [2025-09-25T22:27:25.923794] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:25.938784] [DEBUG] [MAIN ] STNG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:25.939630] [INFO ] [MAIN ] STNG: Generated 1807 derivative records from 44319 primary records. [2025-09-25T22:27:25.939877] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-25T22:27:25.961106] [DEBUG] [LOCAL ] STNG: Derivative data saved (1807 records). [2025-09-25T22:27:25.969335] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-25T22:27:25.972686] [INFO ] [MAIN ] Derivative Progress: 1707/2043 symbols completed. STNG took 1.3s. Estimated remaining: 2m 21s. Rate: 142.8 symbols/min [2025-09-25T22:27:25.985713] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:25.987423] [DEBUG] [MAIN ] STT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:25.988466] [INFO ] [MAIN ] STT: Generated 1807 derivative records from 51441 primary records. [2025-09-25T22:27:25.988553] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-25T22:27:26.000857] [DEBUG] [LOCAL ] STVN: Loaded 26453 existing records from primary storage. [2025-09-25T22:27:26.009772] [INFO ] [MAIN ] STVN: Loaded 26453 primary data records. [2025-09-25T22:27:26.133169] [DEBUG] [LOCAL ] STT: Derivative data saved (1807 records). [2025-09-25T22:27:26.138676] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-25T22:27:26.142296] [INFO ] [MAIN ] Derivative Progress: 1708/2043 symbols completed. STT took 1.4s. Estimated remaining: 2m 21s. Rate: 142.9 symbols/min [2025-09-25T22:27:26.375873] [DEBUG] [LOCAL ] STWD: Loaded 52269 existing records from primary storage. [2025-09-25T22:27:26.376695] [INFO ] [MAIN ] STWD: Loaded 52269 primary data records. [2025-09-25T22:27:26.706987] [DEBUG] [MAIN ] STVN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:26.707973] [INFO ] [MAIN ] STVN: Generated 1807 derivative records from 26453 primary records. [2025-09-25T22:27:26.708058] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-25T22:27:26.727156] [DEBUG] [LOCAL ] STVN: Derivative data saved (1807 records). [2025-09-25T22:27:26.727431] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-25T22:27:26.730133] [INFO ] [MAIN ] Derivative Progress: 1709/2043 symbols completed. STVN took 0.8s. Estimated remaining: 2m 20s. Rate: 142.9 symbols/min [2025-09-25T22:27:26.745441] [DEBUG] [MAIN ] STWD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:26.746078] [INFO ] [MAIN ] STWD: Generated 1807 derivative records from 52269 primary records. [2025-09-25T22:27:26.746144] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-25T22:27:26.762322] [DEBUG] [LOCAL ] STWD: Derivative data saved (1807 records). [2025-09-25T22:27:26.762395] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-25T22:27:26.765660] [INFO ] [MAIN ] Derivative Progress: 1710/2043 symbols completed. STWD took 0.8s. Estimated remaining: 2m 20s. Rate: 142.9 symbols/min [2025-09-25T22:27:26.766277] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:26.766453] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:26.767447] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:26.771849] [DEBUG] [LOCAL ] STXD: Loaded 1335 existing records from primary storage. [2025-09-25T22:27:26.772907] [INFO ] [MAIN ] STXD: Loaded 1335 primary data records. [2025-09-25T22:27:26.788546] [DEBUG] [LOCAL ] STXG: Loaded 2599 existing records from primary storage. [2025-09-25T22:27:26.781760] [DEBUG] [LOCAL ] STXE: Loaded 2216 existing records from primary storage. [2025-09-25T22:27:26.793928] [INFO ] [MAIN ] STXE: Loaded 2216 primary data records. [2025-09-25T22:27:26.793990] [INFO ] [MAIN ] STXG: Loaded 2599 primary data records. [2025-09-25T22:27:27.863399] [DEBUG] [MAIN ] STXG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:27.870166] [INFO ] [MAIN ] STXG: Generated 1806 derivative records from 2599 primary records. [2025-09-25T22:27:27.869248] [DEBUG] [MAIN ] STXE: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:27.870350] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-25T22:27:27.878792] [INFO ] [MAIN ] STXE: Generated 1806 derivative records from 2216 primary records. [2025-09-25T22:27:27.884591] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-25T22:27:27.885504] [DEBUG] [MAIN ] STXD: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:27.886762] [INFO ] [MAIN ] STXD: Generated 1806 derivative records from 1335 primary records. [2025-09-25T22:27:27.899539] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-25T22:27:27.926097] [DEBUG] [LOCAL ] STXE: Derivative data saved (1806 records). [2025-09-25T22:27:27.927896] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-25T22:27:27.931180] [INFO ] [MAIN ] Derivative Progress: 1711/2043 symbols completed. STXE took 1.2s. Estimated remaining: 2m 20s. Rate: 142.8 symbols/min [2025-09-25T22:27:27.933121] [DEBUG] [LOCAL ] STXG: Derivative data saved (1806 records). [2025-09-25T22:27:27.932438] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:27.933985] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-25T22:27:27.937901] [INFO ] [MAIN ] Derivative Progress: 1712/2043 symbols completed. STXG took 1.2s. Estimated remaining: 2m 19s. Rate: 142.9 symbols/min [2025-09-25T22:27:27.939619] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:27.940813] [DEBUG] [LOCAL ] STXD: Derivative data saved (1806 records). [2025-09-25T22:27:27.940993] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-25T22:27:27.943822] [DEBUG] [LOCAL ] STXK: Loaded 1527 existing records from primary storage. [2025-09-25T22:27:27.946754] [INFO ] [MAIN ] Derivative Progress: 1713/2043 symbols completed. STXD took 1.2s. Estimated remaining: 2m 19s. Rate: 142.9 symbols/min [2025-09-25T22:27:27.946856] [INFO ] [MAIN ] STXK: Loaded 1527 primary data records. [2025-09-25T22:27:27.947316] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:28.012713] [DEBUG] [LOCAL ] STXT: Loaded 2574 existing records from primary storage. [2025-09-25T22:27:28.036524] [INFO ] [MAIN ] STXT: Loaded 2574 primary data records. [2025-09-25T22:27:28.029225] [DEBUG] [LOCAL ] STXV: Loaded 1645 existing records from primary storage. [2025-09-25T22:27:28.058783] [INFO ] [MAIN ] STXV: Loaded 1645 primary data records. [2025-09-25T22:27:28.980542] [DEBUG] [MAIN ] STXK: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:28.986927] [INFO ] [MAIN ] STXK: Generated 1806 derivative records from 1527 primary records. [2025-09-25T22:27:28.987287] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-25T22:27:29.016666] [DEBUG] [MAIN ] STXT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:29.023349] [DEBUG] [MAIN ] STXV: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:29.028782] [INFO ] [MAIN ] STXV: Generated 1806 derivative records from 1645 primary records. [2025-09-25T22:27:29.029588] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-25T22:27:29.029425] [INFO ] [MAIN ] STXT: Generated 1806 derivative records from 2574 primary records. [2025-09-25T22:27:29.032842] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-25T22:27:29.033840] [DEBUG] [LOCAL ] STXK: Derivative data saved (1806 records). [2025-09-25T22:27:29.034902] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-25T22:27:29.038033] [INFO ] [MAIN ] Derivative Progress: 1714/2043 symbols completed. STXK took 1.1s. Estimated remaining: 2m 18s. Rate: 142.8 symbols/min [2025-09-25T22:27:29.045054] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:29.065393] [DEBUG] [LOCAL ] STXT: Derivative data saved (1806 records). [2025-09-25T22:27:29.065708] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-25T22:27:29.071906] [INFO ] [MAIN ] Derivative Progress: 1715/2043 symbols completed. STXT took 1.1s. Estimated remaining: 2m 18s. Rate: 142.9 symbols/min [2025-09-25T22:27:29.073780] [DEBUG] [LOCAL ] STXV: Derivative data saved (1806 records). [2025-09-25T22:27:29.074047] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:29.074515] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-25T22:27:29.077929] [INFO ] [MAIN ] Derivative Progress: 1716/2043 symbols completed. STXV took 1.1s. Estimated remaining: 2m 17s. Rate: 143.0 symbols/min [2025-09-25T22:27:29.078713] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:29.149440] [DEBUG] [LOCAL ] SUI: Loaded 42259 existing records from primary storage. [2025-09-25T22:27:29.164572] [INFO ] [MAIN ] SUI: Loaded 42259 primary data records. [2025-09-25T22:27:29.315816] [DEBUG] [LOCAL ] STZ: Loaded 52652 existing records from primary storage. [2025-09-25T22:27:29.321610] [INFO ] [MAIN ] STZ: Loaded 52652 primary data records. [2025-09-25T22:27:29.333477] [DEBUG] [LOCAL ] SU: Loaded 53845 existing records from primary storage. [2025-09-25T22:27:29.434711] [INFO ] [MAIN ] SU: Loaded 53845 primary data records. [2025-09-25T22:27:30.245999] [DEBUG] [MAIN ] SUI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:30.247490] [INFO ] [MAIN ] SUI: Generated 1807 derivative records from 42259 primary records. [2025-09-25T22:27:30.248321] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-25T22:27:30.294427] [DEBUG] [MAIN ] SU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:30.293927] [DEBUG] [LOCAL ] SUI: Derivative data saved (1807 records). [2025-09-25T22:27:30.294778] [DEBUG] [MAIN ] STZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:30.295538] [INFO ] [MAIN ] SU: Generated 1807 derivative records from 53845 primary records. [2025-09-25T22:27:30.295609] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-25T22:27:30.298159] [INFO ] [MAIN ] Derivative Progress: 1717/2043 symbols completed. SUI took 1.2s. Estimated remaining: 2m 17s. Rate: 142.8 symbols/min [2025-09-25T22:27:30.299387] [INFO ] [MAIN ] STZ: Generated 1807 derivative records from 52652 primary records. [2025-09-25T22:27:30.299488] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-25T22:27:30.298522] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-25T22:27:30.298452] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:30.331684] [DEBUG] [LOCAL ] SU: Derivative data saved (1807 records). [2025-09-25T22:27:30.332476] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-25T22:27:30.335848] [INFO ] [MAIN ] Derivative Progress: 1718/2043 symbols completed. SU took 1.3s. Estimated remaining: 2m 16s. Rate: 142.9 symbols/min [2025-09-25T22:27:30.336209] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:30.337804] [DEBUG] [LOCAL ] STZ: Derivative data saved (1807 records). [2025-09-25T22:27:30.337991] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-25T22:27:30.341212] [INFO ] [MAIN ] Derivative Progress: 1719/2043 symbols completed. STZ took 1.3s. Estimated remaining: 2m 16s. Rate: 143.0 symbols/min [2025-09-25T22:27:30.341515] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:30.372788] [DEBUG] [LOCAL ] SUN: Loaded 37657 existing records from primary storage. [2025-09-25T22:27:30.373063] [INFO ] [MAIN ] SUN: Loaded 37657 primary data records. [2025-09-25T22:27:30.726703] [DEBUG] [LOCAL ] SUPV: Loaded 47575 existing records from primary storage. [2025-09-25T22:27:30.722517] [DEBUG] [LOCAL ] SUZ: Loaded 46114 existing records from primary storage. [2025-09-25T22:27:30.748513] [INFO ] [MAIN ] SUPV: Loaded 47575 primary data records. [2025-09-25T22:27:30.748810] [INFO ] [MAIN ] SUZ: Loaded 46114 primary data records. [2025-09-25T22:27:31.500335] [DEBUG] [MAIN ] SUN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:31.501994] [INFO ] [MAIN ] SUN: Generated 1807 derivative records from 37657 primary records. [2025-09-25T22:27:31.502166] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-25T22:27:31.522346] [DEBUG] [LOCAL ] SUN: Derivative data saved (1807 records). [2025-09-25T22:27:31.522954] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-25T22:27:31.526090] [INFO ] [MAIN ] Derivative Progress: 1720/2043 symbols completed. SUN took 1.2s. Estimated remaining: 2m 16s. Rate: 142.8 symbols/min [2025-09-25T22:27:31.526938] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:31.548574] [DEBUG] [MAIN ] SUZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:31.549781] [INFO ] [MAIN ] SUZ: Generated 1807 derivative records from 46114 primary records. [2025-09-25T22:27:31.550033] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-25T22:27:31.574562] [DEBUG] [MAIN ] SUPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:31.581952] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1807 records). [2025-09-25T22:27:31.583236] [INFO ] [MAIN ] SUPV: Generated 1807 derivative records from 47575 primary records. [2025-09-25T22:27:31.583421] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-25T22:27:31.583692] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-25T22:27:31.586407] [INFO ] [MAIN ] Derivative Progress: 1721/2043 symbols completed. SUZ took 1.2s. Estimated remaining: 2m 15s. Rate: 142.9 symbols/min [2025-09-25T22:27:31.586968] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:31.620549] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1807 records). [2025-09-25T22:27:31.620743] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-25T22:27:31.623924] [INFO ] [MAIN ] Derivative Progress: 1722/2043 symbols completed. SUPV took 1.3s. Estimated remaining: 2m 15s. Rate: 143.0 symbols/min [2025-09-25T22:27:31.624420] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:31.641117] [DEBUG] [LOCAL ] SVV: Loaded 39864 existing records from primary storage. [2025-09-25T22:27:31.641411] [INFO ] [MAIN ] SVV: Loaded 39864 primary data records. [2025-09-25T22:27:32.054849] [DEBUG] [LOCAL ] SW: Loaded 53551 existing records from primary storage. [2025-09-25T22:27:32.056826] [INFO ] [MAIN ] SW: Loaded 53551 primary data records. [2025-09-25T22:27:32.063571] [DEBUG] [LOCAL ] SWK: Loaded 52803 existing records from primary storage. [2025-09-25T22:27:32.109303] [INFO ] [MAIN ] SWK: Loaded 52803 primary data records. [2025-09-25T22:27:32.752732] [DEBUG] [MAIN ] SVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:32.753940] [INFO ] [MAIN ] SVV: Generated 1807 derivative records from 39864 primary records. [2025-09-25T22:27:32.755490] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-25T22:27:32.776182] [DEBUG] [LOCAL ] SVV: Derivative data saved (1807 records). [2025-09-25T22:27:32.776672] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-25T22:27:32.780200] [INFO ] [MAIN ] Derivative Progress: 1723/2043 symbols completed. SVV took 1.3s. Estimated remaining: 2m 14s. Rate: 142.8 symbols/min [2025-09-25T22:27:32.801591] [DEBUG] [MAIN ] SW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:32.802793] [INFO ] [MAIN ] SW: Generated 1807 derivative records from 53551 primary records. [2025-09-25T22:27:32.803264] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-25T22:27:32.824262] [DEBUG] [LOCAL ] SW: Derivative data saved (1807 records). [2025-09-25T22:27:32.838039] [DEBUG] [MAIN ] SWK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:32.837697] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-25T22:27:32.840720] [INFO ] [MAIN ] Derivative Progress: 1724/2043 symbols completed. SW took 1.3s. Estimated remaining: 2m 14s. Rate: 142.9 symbols/min [2025-09-25T22:27:32.842136] [INFO ] [MAIN ] SWK: Generated 1807 derivative records from 52803 primary records. [2025-09-25T22:27:32.842420] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-25T22:27:32.859876] [DEBUG] [LOCAL ] SWK: Derivative data saved (1807 records). [2025-09-25T22:27:32.860030] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-25T22:27:32.863843] [INFO ] [MAIN ] Derivative Progress: 1725/2043 symbols completed. SWK took 1.2s. Estimated remaining: 2m 13s. Rate: 143.0 symbols/min [2025-09-25T22:27:32.864701] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:32.864911] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:32.865175] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:32.879071] [DEBUG] [LOCAL ] SWZ: Loaded 6042 existing records from primary storage. [2025-09-25T22:27:32.879302] [INFO ] [MAIN ] SWZ: Loaded 6042 primary data records. [2025-09-25T22:27:33.221895] [DEBUG] [LOCAL ] SWX: Loaded 31496 existing records from primary storage. [2025-09-25T22:27:33.232764] [INFO ] [MAIN ] SWX: Loaded 31496 primary data records. [2025-09-25T22:27:33.269994] [DEBUG] [LOCAL ] SXC: Loaded 41877 existing records from primary storage. [2025-09-25T22:27:33.294459] [INFO ] [MAIN ] SXC: Loaded 41877 primary data records. [2025-09-25T22:27:34.005880] [DEBUG] [MAIN ] SWZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:34.009007] [INFO ] [MAIN ] SWZ: Generated 1807 derivative records from 6042 primary records. [2025-09-25T22:27:34.009551] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-25T22:27:34.027374] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1807 records). [2025-09-25T22:27:34.029296] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-25T22:27:34.032766] [INFO ] [MAIN ] Derivative Progress: 1726/2043 symbols completed. SWZ took 1.2s. Estimated remaining: 2m 13s. Rate: 142.8 symbols/min [2025-09-25T22:27:34.033095] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:34.058305] [DEBUG] [MAIN ] SWX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:34.066330] [INFO ] [MAIN ] SWX: Generated 1807 derivative records from 31496 primary records. [2025-09-25T22:27:34.066519] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-25T22:27:34.080477] [DEBUG] [LOCAL ] SXI: Loaded 11616 existing records from primary storage. [2025-09-25T22:27:34.088894] [DEBUG] [MAIN ] SXC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:34.091362] [INFO ] [MAIN ] SXC: Generated 1807 derivative records from 41877 primary records. [2025-09-25T22:27:34.091474] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-25T22:27:34.090516] [INFO ] [MAIN ] SXI: Loaded 11616 primary data records. [2025-09-25T22:27:34.143971] [DEBUG] [LOCAL ] SWX: Derivative data saved (1807 records). [2025-09-25T22:27:34.193513] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-25T22:27:34.188266] [DEBUG] [LOCAL ] SXC: Derivative data saved (1807 records). [2025-09-25T22:27:34.206890] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-25T22:27:34.232667] [INFO ] [MAIN ] Derivative Progress: 1727/2043 symbols completed. SXC took 1.4s. Estimated remaining: 2m 13s. Rate: 142.9 symbols/min [2025-09-25T22:27:34.240616] [INFO ] [MAIN ] Derivative Progress: 1728/2043 symbols completed. SWX took 1.4s. Estimated remaining: 2m 12s. Rate: 142.9 symbols/min [2025-09-25T22:27:34.246146] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:34.267609] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:34.496324] [DEBUG] [MAIN ] SXI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:34.521059] [DEBUG] [LOCAL ] SXT: Loaded 29329 existing records from primary storage. [2025-09-25T22:27:34.520424] [INFO ] [MAIN ] SXI: Generated 1807 derivative records from 11616 primary records. [2025-09-25T22:27:34.521317] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-25T22:27:34.521423] [INFO ] [MAIN ] SXT: Loaded 29329 primary data records. [2025-09-25T22:27:34.618569] [DEBUG] [LOCAL ] SXI: Derivative data saved (1807 records). [2025-09-25T22:27:34.625914] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-25T22:27:34.661248] [INFO ] [MAIN ] Derivative Progress: 1729/2043 symbols completed. SXI took 0.6s. Estimated remaining: 2m 12s. Rate: 142.9 symbols/min [2025-09-25T22:27:34.686294] [DEBUG] [LOCAL ] SYF: Loaded 53840 existing records from primary storage. [2025-09-25T22:27:34.674606] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:34.735460] [INFO ] [MAIN ] SYF: Loaded 53840 primary data records. [2025-09-25T22:27:35.245814] [DEBUG] [LOCAL ] SYK: Loaded 47405 existing records from primary storage. [2025-09-25T22:27:35.247270] [INFO ] [MAIN ] SYK: Loaded 47405 primary data records. [2025-09-25T22:27:35.581889] [DEBUG] [MAIN ] SXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:35.593515] [INFO ] [MAIN ] SXT: Generated 1807 derivative records from 29329 primary records. [2025-09-25T22:27:35.593892] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-25T22:27:35.616373] [DEBUG] [LOCAL ] SXT: Derivative data saved (1807 records). [2025-09-25T22:27:35.617139] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-25T22:27:35.620107] [INFO ] [MAIN ] Derivative Progress: 1730/2043 symbols completed. SXT took 1.4s. Estimated remaining: 2m 11s. Rate: 142.8 symbols/min [2025-09-25T22:27:35.640291] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:35.641226] [DEBUG] [MAIN ] SYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:35.642991] [INFO ] [MAIN ] SYF: Generated 1807 derivative records from 53840 primary records. [2025-09-25T22:27:35.643703] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-25T22:27:35.669028] [DEBUG] [LOCAL ] SYF: Derivative data saved (1807 records). [2025-09-25T22:27:35.669275] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-25T22:27:35.672432] [INFO ] [MAIN ] Derivative Progress: 1731/2043 symbols completed. SYF took 1.4s. Estimated remaining: 2m 11s. Rate: 142.9 symbols/min [2025-09-25T22:27:35.673138] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:35.690991] [DEBUG] [MAIN ] SYK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:35.691938] [INFO ] [MAIN ] SYK: Generated 1807 derivative records from 47405 primary records. [2025-09-25T22:27:35.692129] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-25T22:27:35.709408] [DEBUG] [LOCAL ] SYK: Derivative data saved (1807 records). [2025-09-25T22:27:35.709676] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-25T22:27:35.712403] [INFO ] [MAIN ] Derivative Progress: 1732/2043 symbols completed. SYK took 1.0s. Estimated remaining: 2m 10s. Rate: 143.0 symbols/min [2025-09-25T22:27:35.712783] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:35.765355] [DEBUG] [LOCAL ] SYY: Loaded 53623 existing records from primary storage. [2025-09-25T22:27:35.765821] [INFO ] [MAIN ] SYY: Loaded 53623 primary data records. [2025-09-25T22:27:35.904751] [DEBUG] [LOCAL ] T: Loaded 54188 existing records from primary storage. [2025-09-25T22:27:35.910871] [INFO ] [MAIN ] T: Loaded 54188 primary data records. [2025-09-25T22:27:36.177074] [DEBUG] [LOCAL ] TAC: Loaded 43179 existing records from primary storage. [2025-09-25T22:27:36.233028] [INFO ] [MAIN ] TAC: Loaded 43179 primary data records. [2025-09-25T22:27:36.847576] [DEBUG] [MAIN ] SYY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:36.849066] [INFO ] [MAIN ] SYY: Generated 1807 derivative records from 53623 primary records. [2025-09-25T22:27:36.849182] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-25T22:27:36.884077] [DEBUG] [MAIN ] T: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:36.886728] [INFO ] [MAIN ] T: Generated 1807 derivative records from 54188 primary records. [2025-09-25T22:27:36.885854] [DEBUG] [LOCAL ] SYY: Derivative data saved (1807 records). [2025-09-25T22:27:36.887082] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-25T22:27:36.887207] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-25T22:27:36.889990] [INFO ] [MAIN ] Derivative Progress: 1733/2043 symbols completed. SYY took 1.2s. Estimated remaining: 2m 10s. Rate: 142.8 symbols/min [2025-09-25T22:27:36.899447] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:36.929185] [DEBUG] [LOCAL ] T: Derivative data saved (1807 records). [2025-09-25T22:27:36.929086] [DEBUG] [MAIN ] TAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:36.929376] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-25T22:27:36.932845] [INFO ] [MAIN ] Derivative Progress: 1734/2043 symbols completed. T took 1.3s. Estimated remaining: 2m 10s. Rate: 142.9 symbols/min [2025-09-25T22:27:36.934070] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:36.933829] [INFO ] [MAIN ] TAC: Generated 1807 derivative records from 43179 primary records. [2025-09-25T22:27:36.934362] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-25T22:27:36.952310] [DEBUG] [LOCAL ] TAC: Derivative data saved (1807 records). [2025-09-25T22:27:36.952485] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-25T22:27:36.956040] [INFO ] [MAIN ] Derivative Progress: 1735/2043 symbols completed. TAC took 1.2s. Estimated remaining: 2m 9s. Rate: 143.0 symbols/min [2025-09-25T22:27:36.956696] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:37.057662] [DEBUG] [LOCAL ] TAK: Loaded 50211 existing records from primary storage. [2025-09-25T22:27:37.058861] [DEBUG] [LOCAL ] TALO: Loaded 51193 existing records from primary storage. [2025-09-25T22:27:37.060004] [INFO ] [MAIN ] TAK: Loaded 50211 primary data records. [2025-09-25T22:27:37.060139] [INFO ] [MAIN ] TALO: Loaded 51193 primary data records. [2025-09-25T22:27:37.236441] [DEBUG] [LOCAL ] TAL: Loaded 52439 existing records from primary storage. [2025-09-25T22:27:37.254269] [INFO ] [MAIN ] TAL: Loaded 52439 primary data records. [2025-09-25T22:27:38.175907] [DEBUG] [MAIN ] TALO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:38.177705] [INFO ] [MAIN ] TALO: Generated 1807 derivative records from 51193 primary records. [2025-09-25T22:27:38.178202] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-25T22:27:38.178115] [DEBUG] [MAIN ] TAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:38.179805] [INFO ] [MAIN ] TAK: Generated 1807 derivative records from 50211 primary records. [2025-09-25T22:27:38.179995] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-25T22:27:38.223908] [DEBUG] [MAIN ] TAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:38.225807] [INFO ] [MAIN ] TAL: Generated 1807 derivative records from 52439 primary records. [2025-09-25T22:27:38.226342] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-25T22:27:38.238614] [DEBUG] [LOCAL ] TALO: Derivative data saved (1807 records). [2025-09-25T22:27:38.241284] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-25T22:27:38.246039] [INFO ] [MAIN ] Derivative Progress: 1736/2043 symbols completed. TALO took 1.3s. Estimated remaining: 2m 9s. Rate: 142.8 symbols/min [2025-09-25T22:27:38.247976] [DEBUG] [LOCAL ] TAK: Derivative data saved (1807 records). [2025-09-25T22:27:38.249827] [DEBUG] [LOCAL ] TAL: Derivative data saved (1807 records). [2025-09-25T22:27:38.246896] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:38.249202] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-25T22:27:38.250076] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-25T22:27:38.253154] [INFO ] [MAIN ] Derivative Progress: 1737/2043 symbols completed. TAK took 1.4s. Estimated remaining: 2m 8s. Rate: 142.9 symbols/min [2025-09-25T22:27:38.256982] [INFO ] [MAIN ] Derivative Progress: 1738/2043 symbols completed. TAL took 1.3s. Estimated remaining: 2m 8s. Rate: 143.0 symbols/min [2025-09-25T22:27:38.257296] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:38.275422] [DEBUG] [LOCAL ] TBB: Loaded 11782 existing records from primary storage. [2025-09-25T22:27:38.275596] [INFO ] [MAIN ] TBB: Loaded 11782 primary data records. [2025-09-25T22:27:38.629288] [DEBUG] [LOCAL ] TAP: Loaded 53263 existing records from primary storage. [2025-09-25T22:27:38.630264] [INFO ] [MAIN ] TAP: Loaded 53263 primary data records. [2025-09-25T22:27:38.985558] [DEBUG] [MAIN ] TBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:38.987081] [INFO ] [MAIN ] TBB: Generated 1807 derivative records from 11782 primary records. [2025-09-25T22:27:38.987280] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-25T22:27:39.007458] [DEBUG] [LOCAL ] TBB: Derivative data saved (1807 records). [2025-09-25T22:27:39.007730] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-25T22:27:39.010147] [INFO ] [MAIN ] Derivative Progress: 1739/2043 symbols completed. TBB took 0.8s. Estimated remaining: 2m 8s. Rate: 142.9 symbols/min [2025-09-25T22:27:39.025824] [DEBUG] [MAIN ] TAP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:39.026577] [INFO ] [MAIN ] TAP: Generated 1807 derivative records from 53263 primary records. [2025-09-25T22:27:39.026667] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-25T22:27:39.044467] [DEBUG] [LOCAL ] TAP: Derivative data saved (1807 records). [2025-09-25T22:27:39.044600] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-25T22:27:39.046982] [INFO ] [MAIN ] Derivative Progress: 1740/2043 symbols completed. TAP took 0.8s. Estimated remaining: 2m 7s. Rate: 143.0 symbols/min [2025-09-25T22:27:39.048253] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:39.048089] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:39.047992] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:39.055088] [DEBUG] [LOCAL ] TBN: Loaded 3020 existing records from primary storage. [2025-09-25T22:27:39.055428] [INFO ] [MAIN ] TBN: Loaded 3020 primary data records. [2025-09-25T22:27:39.222210] [DEBUG] [LOCAL ] TBI: Loaded 22787 existing records from primary storage. [2025-09-25T22:27:39.241875] [INFO ] [MAIN ] TBI: Loaded 22787 primary data records. [2025-09-25T22:27:39.305672] [DEBUG] [LOCAL ] TBBB: Loaded 35967 existing records from primary storage. [2025-09-25T22:27:39.438578] [INFO ] [MAIN ] TBBB: Loaded 35967 primary data records. [2025-09-25T22:27:40.196612] [DEBUG] [MAIN ] TBN: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:27:40.198246] [INFO ] [MAIN ] TBN: Generated 1805 derivative records from 3020 primary records. [2025-09-25T22:27:40.198833] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-25T22:27:40.219410] [DEBUG] [LOCAL ] TBN: Derivative data saved (1805 records). [2025-09-25T22:27:40.219688] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-25T22:27:40.224827] [INFO ] [MAIN ] Derivative Progress: 1741/2043 symbols completed. TBN took 1.2s. Estimated remaining: 2m 7s. Rate: 142.8 symbols/min [2025-09-25T22:27:40.225152] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:40.246998] [DEBUG] [MAIN ] TBI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:40.248842] [INFO ] [MAIN ] TBI: Generated 1807 derivative records from 22787 primary records. [2025-09-25T22:27:40.248938] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-25T22:27:40.286358] [DEBUG] [MAIN ] TBBB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:40.288056] [INFO ] [MAIN ] TBBB: Generated 1807 derivative records from 35967 primary records. [2025-09-25T22:27:40.288428] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-25T22:27:40.290133] [DEBUG] [LOCAL ] TBI: Derivative data saved (1807 records). [2025-09-25T22:27:40.290295] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-25T22:27:40.298593] [INFO ] [MAIN ] Derivative Progress: 1742/2043 symbols completed. TBI took 1.3s. Estimated remaining: 2m 6s. Rate: 142.9 symbols/min [2025-09-25T22:27:40.307007] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:40.334363] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1807 records). [2025-09-25T22:27:40.334515] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-25T22:27:40.338500] [INFO ] [MAIN ] Derivative Progress: 1743/2043 symbols completed. TBBB took 1.3s. Estimated remaining: 2m 6s. Rate: 143.0 symbols/min [2025-09-25T22:27:40.339070] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:40.368358] [DEBUG] [LOCAL ] TDF: Loaded 6536 existing records from primary storage. [2025-09-25T22:27:40.369787] [DEBUG] [LOCAL ] TD: Loaded 52650 existing records from primary storage. [2025-09-25T22:27:40.370123] [INFO ] [MAIN ] TD: Loaded 52650 primary data records. [2025-09-25T22:27:40.375589] [INFO ] [MAIN ] TDF: Loaded 6536 primary data records. [2025-09-25T22:27:40.755380] [DEBUG] [LOCAL ] TDC: Loaded 47186 existing records from primary storage. [2025-09-25T22:27:40.860328] [INFO ] [MAIN ] TDC: Loaded 47186 primary data records. [2025-09-25T22:27:41.409733] [DEBUG] [MAIN ] TDF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:41.412342] [INFO ] [MAIN ] TDF: Generated 1807 derivative records from 6536 primary records. [2025-09-25T22:27:41.412634] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-25T22:27:41.436305] [DEBUG] [MAIN ] TD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:41.440502] [INFO ] [MAIN ] TD: Generated 1807 derivative records from 52650 primary records. [2025-09-25T22:27:41.440789] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-25T22:27:41.462476] [DEBUG] [LOCAL ] TD: Derivative data saved (1807 records). [2025-09-25T22:27:41.462578] [DEBUG] [LOCAL ] TDF: Derivative data saved (1807 records). [2025-09-25T22:27:41.462774] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-25T22:27:41.462872] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-25T22:27:41.465493] [INFO ] [MAIN ] Derivative Progress: 1744/2043 symbols completed. TDF took 1.1s. Estimated remaining: 2m 6s. Rate: 142.8 symbols/min [2025-09-25T22:27:41.468863] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:41.468989] [INFO ] [MAIN ] Derivative Progress: 1745/2043 symbols completed. TD took 1.2s. Estimated remaining: 2m 5s. Rate: 142.9 symbols/min [2025-09-25T22:27:41.469444] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:41.488715] [DEBUG] [MAIN ] TDC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:41.489875] [INFO ] [MAIN ] TDC: Generated 1807 derivative records from 47186 primary records. [2025-09-25T22:27:41.490003] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-25T22:27:41.515251] [DEBUG] [LOCAL ] TDC: Derivative data saved (1807 records). [2025-09-25T22:27:41.515624] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-25T22:27:41.519205] [INFO ] [MAIN ] Derivative Progress: 1746/2043 symbols completed. TDC took 1.2s. Estimated remaining: 2m 5s. Rate: 143.0 symbols/min [2025-09-25T22:27:41.519733] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:41.531091] [DEBUG] [LOCAL ] TDG: Loaded 22191 existing records from primary storage. [2025-09-25T22:27:41.531246] [INFO ] [MAIN ] TDG: Loaded 22191 primary data records. [2025-09-25T22:27:41.768164] [DEBUG] [LOCAL ] TDOC: Loaded 53735 existing records from primary storage. [2025-09-25T22:27:41.774787] [INFO ] [MAIN ] TDOC: Loaded 53735 primary data records. [2025-09-25T22:27:42.033922] [DEBUG] [LOCAL ] TDS: Loaded 43081 existing records from primary storage. [2025-09-25T22:27:42.034149] [INFO ] [MAIN ] TDS: Loaded 43081 primary data records. [2025-09-25T22:27:42.704798] [DEBUG] [MAIN ] TDG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:42.706162] [INFO ] [MAIN ] TDG: Generated 1807 derivative records from 22191 primary records. [2025-09-25T22:27:42.706417] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-25T22:27:42.736529] [DEBUG] [LOCAL ] TDG: Derivative data saved (1807 records). [2025-09-25T22:27:42.738961] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-25T22:27:42.742513] [INFO ] [MAIN ] Derivative Progress: 1747/2043 symbols completed. TDG took 1.3s. Estimated remaining: 2m 4s. Rate: 142.8 symbols/min [2025-09-25T22:27:42.751255] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:42.757337] [DEBUG] [MAIN ] TDOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:42.759079] [INFO ] [MAIN ] TDOC: Generated 1807 derivative records from 53735 primary records. [2025-09-25T22:27:42.759339] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-25T22:27:42.779067] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1807 records). [2025-09-25T22:27:42.780289] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-25T22:27:42.783669] [INFO ] [MAIN ] Derivative Progress: 1748/2043 symbols completed. TDOC took 1.3s. Estimated remaining: 2m 4s. Rate: 142.9 symbols/min [2025-09-25T22:27:42.784905] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:42.800254] [DEBUG] [MAIN ] TDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:42.801142] [INFO ] [MAIN ] TDS: Generated 1807 derivative records from 43081 primary records. [2025-09-25T22:27:42.801332] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-25T22:27:42.818893] [DEBUG] [LOCAL ] TDS: Derivative data saved (1807 records). [2025-09-25T22:27:42.819007] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-25T22:27:42.823445] [INFO ] [MAIN ] Derivative Progress: 1749/2043 symbols completed. TDS took 1.3s. Estimated remaining: 2m 3s. Rate: 143.0 symbols/min [2025-09-25T22:27:42.841103] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:42.854826] [DEBUG] [LOCAL ] TDY: Loaded 22795 existing records from primary storage. [2025-09-25T22:27:42.855094] [INFO ] [MAIN ] TDY: Loaded 22795 primary data records. [2025-09-25T22:27:42.915910] [DEBUG] [LOCAL ] TDW: Loaded 45760 existing records from primary storage. [2025-09-25T22:27:42.941971] [DEBUG] [LOCAL ] TEAF: Loaded 7487 existing records from primary storage. [2025-09-25T22:27:42.968182] [INFO ] [MAIN ] TDW: Loaded 45760 primary data records. [2025-09-25T22:27:42.962965] [INFO ] [MAIN ] TEAF: Loaded 7487 primary data records. [2025-09-25T22:27:43.888259] [DEBUG] [MAIN ] TDY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:43.891932] [INFO ] [MAIN ] TDY: Generated 1807 derivative records from 22795 primary records. [2025-09-25T22:27:43.892064] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-25T22:27:43.921701] [DEBUG] [MAIN ] TDW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:43.923540] [INFO ] [MAIN ] TDW: Generated 1807 derivative records from 45760 primary records. [2025-09-25T22:27:43.923979] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-25T22:27:43.946164] [DEBUG] [MAIN ] TEAF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:43.948853] [INFO ] [MAIN ] TEAF: Generated 1807 derivative records from 7487 primary records. [2025-09-25T22:27:43.952211] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-25T22:27:43.967059] [DEBUG] [LOCAL ] TDY: Derivative data saved (1807 records). [2025-09-25T22:27:43.971089] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-25T22:27:43.976551] [INFO ] [MAIN ] Derivative Progress: 1750/2043 symbols completed. TDY took 1.2s. Estimated remaining: 2m 3s. Rate: 142.9 symbols/min [2025-09-25T22:27:43.977863] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1807 records). [2025-09-25T22:27:43.978558] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:43.978202] [DEBUG] [LOCAL ] TDW: Derivative data saved (1807 records). [2025-09-25T22:27:43.979435] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-25T22:27:43.982947] [INFO ] [MAIN ] Derivative Progress: 1751/2043 symbols completed. TDW took 1.2s. Estimated remaining: 2m 3s. Rate: 142.9 symbols/min [2025-09-25T22:27:43.978773] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-25T22:27:43.983739] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:43.987444] [INFO ] [MAIN ] Derivative Progress: 1752/2043 symbols completed. TEAF took 1.1s. Estimated remaining: 2m 2s. Rate: 143.0 symbols/min [2025-09-25T22:27:43.988331] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:44.014016] [DEBUG] [LOCAL ] TEI: Loaded 20713 existing records from primary storage. [2025-09-25T22:27:44.014710] [INFO ] [MAIN ] TEI: Loaded 20713 primary data records. [2025-09-25T22:27:44.210351] [DEBUG] [LOCAL ] TEF: Loaded 37632 existing records from primary storage. [2025-09-25T22:27:44.236595] [INFO ] [MAIN ] TEF: Loaded 37632 primary data records. [2025-09-25T22:27:44.461841] [DEBUG] [LOCAL ] TECK: Loaded 53826 existing records from primary storage. [2025-09-25T22:27:44.475521] [INFO ] [MAIN ] TECK: Loaded 53826 primary data records. [2025-09-25T22:27:45.160401] [DEBUG] [MAIN ] TEI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:45.162536] [INFO ] [MAIN ] TEI: Generated 1807 derivative records from 20713 primary records. [2025-09-25T22:27:45.163054] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-25T22:27:45.183510] [DEBUG] [LOCAL ] TEI: Derivative data saved (1807 records). [2025-09-25T22:27:45.183878] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-25T22:27:45.187917] [INFO ] [MAIN ] Derivative Progress: 1753/2043 symbols completed. TEI took 1.2s. Estimated remaining: 2m 2s. Rate: 142.9 symbols/min [2025-09-25T22:27:45.205307] [DEBUG] [MAIN ] TEF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:45.206725] [INFO ] [MAIN ] TEF: Generated 1807 derivative records from 37632 primary records. [2025-09-25T22:27:45.206985] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-25T22:27:45.228540] [DEBUG] [LOCAL ] TEF: Derivative data saved (1807 records). [2025-09-25T22:27:45.228794] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-25T22:27:45.231900] [INFO ] [MAIN ] Derivative Progress: 1754/2043 symbols completed. TEF took 1.2s. Estimated remaining: 2m 1s. Rate: 142.9 symbols/min [2025-09-25T22:27:45.245626] [DEBUG] [MAIN ] TECK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:45.246554] [INFO ] [MAIN ] TECK: Generated 1807 derivative records from 53826 primary records. [2025-09-25T22:27:45.246627] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-25T22:27:45.263210] [DEBUG] [LOCAL ] TECK: Derivative data saved (1807 records). [2025-09-25T22:27:45.263287] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-25T22:27:45.267833] [INFO ] [MAIN ] Derivative Progress: 1755/2043 symbols completed. TECK took 1.3s. Estimated remaining: 2m 1s. Rate: 143.0 symbols/min [2025-09-25T22:27:45.268921] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:45.269355] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:45.269515] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:45.309068] [DEBUG] [LOCAL ] TEO: Loaded 22136 existing records from primary storage. [2025-09-25T22:27:45.309243] [INFO ] [MAIN ] TEO: Loaded 22136 primary data records. [2025-09-25T22:27:45.428568] [DEBUG] [LOCAL ] TEN: Loaded 31215 existing records from primary storage. [2025-09-25T22:27:45.440890] [INFO ] [MAIN ] TEN: Loaded 31215 primary data records. [2025-09-25T22:27:45.768217] [DEBUG] [LOCAL ] TEL: Loaded 51528 existing records from primary storage. [2025-09-25T22:27:45.789544] [INFO ] [MAIN ] TEL: Loaded 51528 primary data records. [2025-09-25T22:27:46.373970] [DEBUG] [MAIN ] TEO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:46.375232] [INFO ] [MAIN ] TEO: Generated 1807 derivative records from 22136 primary records. [2025-09-25T22:27:46.375333] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-25T22:27:46.393341] [DEBUG] [LOCAL ] TEO: Derivative data saved (1807 records). [2025-09-25T22:27:46.393474] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-25T22:27:46.396779] [INFO ] [MAIN ] Derivative Progress: 1756/2043 symbols completed. TEO took 1.1s. Estimated remaining: 2m 1s. Rate: 142.9 symbols/min [2025-09-25T22:27:46.397089] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:46.429375] [DEBUG] [MAIN ] TEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:46.429624] [DEBUG] [MAIN ] TEN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:46.430518] [INFO ] [MAIN ] TEN: Generated 1807 derivative records from 31215 primary records. [2025-09-25T22:27:46.431175] [INFO ] [MAIN ] TEL: Generated 1807 derivative records from 51528 primary records. [2025-09-25T22:27:46.431340] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-25T22:27:46.431271] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-25T22:27:46.461818] [DEBUG] [LOCAL ] TEN: Derivative data saved (1807 records). [2025-09-25T22:27:46.462475] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-25T22:27:46.466322] [INFO ] [MAIN ] Derivative Progress: 1757/2043 symbols completed. TEN took 1.2s. Estimated remaining: 2m 0s. Rate: 142.9 symbols/min [2025-09-25T22:27:46.466950] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:46.472299] [DEBUG] [LOCAL ] TEL: Derivative data saved (1807 records). [2025-09-25T22:27:46.472459] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-25T22:27:46.476019] [INFO ] [MAIN ] Derivative Progress: 1758/2043 symbols completed. TEL took 1.2s. Estimated remaining: 1m 60s. Rate: 143.0 symbols/min [2025-09-25T22:27:46.476541] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:46.522697] [DEBUG] [LOCAL ] TEVA: Loaded 54023 existing records from primary storage. [2025-09-25T22:27:46.522910] [INFO ] [MAIN ] TEVA: Loaded 54023 primary data records. [2025-09-25T22:27:46.737100] [DEBUG] [LOCAL ] TEX: Loaded 44916 existing records from primary storage. [2025-09-25T22:27:46.758240] [INFO ] [MAIN ] TEX: Loaded 44916 primary data records. [2025-09-25T22:27:46.947065] [DEBUG] [LOCAL ] TFC: Loaded 54057 existing records from primary storage. [2025-09-25T22:27:46.999204] [INFO ] [MAIN ] TFC: Loaded 54057 primary data records. [2025-09-25T22:27:47.632466] [DEBUG] [MAIN ] TEVA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:47.633805] [INFO ] [MAIN ] TEVA: Generated 1807 derivative records from 54023 primary records. [2025-09-25T22:27:47.634362] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-25T22:27:47.652725] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1807 records). [2025-09-25T22:27:47.653523] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-25T22:27:47.656872] [INFO ] [MAIN ] Derivative Progress: 1759/2043 symbols completed. TEVA took 1.3s. Estimated remaining: 1m 59s. Rate: 142.9 symbols/min [2025-09-25T22:27:47.657592] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:47.679873] [DEBUG] [MAIN ] TEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:47.681573] [INFO ] [MAIN ] TEX: Generated 1807 derivative records from 44916 primary records. [2025-09-25T22:27:47.694771] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-25T22:27:47.695316] [DEBUG] [MAIN ] TFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:47.697849] [INFO ] [MAIN ] TFC: Generated 1807 derivative records from 54057 primary records. [2025-09-25T22:27:47.698041] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-25T22:27:47.730857] [DEBUG] [LOCAL ] TEX: Derivative data saved (1807 records). [2025-09-25T22:27:47.731945] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-25T22:27:47.735498] [INFO ] [MAIN ] Derivative Progress: 1760/2043 symbols completed. TEX took 1.3s. Estimated remaining: 1m 59s. Rate: 142.9 symbols/min [2025-09-25T22:27:47.745902] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:47.752074] [DEBUG] [LOCAL ] TFC: Derivative data saved (1807 records). [2025-09-25T22:27:47.753092] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-25T22:27:47.756237] [INFO ] [MAIN ] Derivative Progress: 1761/2043 symbols completed. TFC took 1.3s. Estimated remaining: 1m 58s. Rate: 143.0 symbols/min [2025-09-25T22:27:47.756667] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:47.769104] [DEBUG] [LOCAL ] TFII: Loaded 34506 existing records from primary storage. [2025-09-25T22:27:47.769430] [INFO ] [MAIN ] TFII: Loaded 34506 primary data records. [2025-09-25T22:27:47.955024] [DEBUG] [LOCAL ] TFIN: Loaded 23741 existing records from primary storage. [2025-09-25T22:27:47.960849] [INFO ] [MAIN ] TFIN: Loaded 23741 primary data records. [2025-09-25T22:27:48.243092] [DEBUG] [LOCAL ] TFPM: Loaded 37671 existing records from primary storage. [2025-09-25T22:27:48.279508] [INFO ] [MAIN ] TFPM: Loaded 37671 primary data records. [2025-09-25T22:27:48.911634] [DEBUG] [MAIN ] TFII: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:48.915073] [INFO ] [MAIN ] TFII: Generated 1807 derivative records from 34506 primary records. [2025-09-25T22:27:48.915600] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-25T22:27:48.936106] [DEBUG] [LOCAL ] TFII: Derivative data saved (1807 records). [2025-09-25T22:27:48.936963] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-25T22:27:48.939568] [INFO ] [MAIN ] Derivative Progress: 1762/2043 symbols completed. TFII took 1.3s. Estimated remaining: 1m 58s. Rate: 142.9 symbols/min [2025-09-25T22:27:48.942353] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:48.964512] [DEBUG] [MAIN ] TFIN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:48.965848] [INFO ] [MAIN ] TFIN: Generated 1807 derivative records from 23741 primary records. [2025-09-25T22:27:48.966181] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-25T22:27:49.001602] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1807 records). [2025-09-25T22:27:49.002635] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-25T22:27:49.002510] [DEBUG] [MAIN ] TFPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:49.005980] [INFO ] [MAIN ] Derivative Progress: 1763/2043 symbols completed. TFIN took 1.3s. Estimated remaining: 1m 58s. Rate: 142.9 symbols/min [2025-09-25T22:27:49.007422] [INFO ] [MAIN ] TFPM: Generated 1807 derivative records from 37671 primary records. [2025-09-25T22:27:49.007952] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-25T22:27:49.008195] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:49.053998] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1807 records). [2025-09-25T22:27:49.054455] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-25T22:27:49.062061] [INFO ] [MAIN ] Derivative Progress: 1764/2043 symbols completed. TFPM took 1.3s. Estimated remaining: 1m 57s. Rate: 143.0 symbols/min [2025-09-25T22:27:49.062491] [DEBUG] [LOCAL ] TG: Loaded 10546 existing records from primary storage. [2025-09-25T22:27:49.064751] [DEBUG] [LOCAL ] TFX: Loaded 37634 existing records from primary storage. [2025-09-25T22:27:49.063215] [INFO ] [MAIN ] TG: Loaded 10546 primary data records. [2025-09-25T22:27:49.063023] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:49.070110] [INFO ] [MAIN ] TFX: Loaded 37634 primary data records. [2025-09-25T22:27:49.730218] [DEBUG] [LOCAL ] TGLS: Loaded 28513 existing records from primary storage. [2025-09-25T22:27:49.730543] [INFO ] [MAIN ] TGLS: Loaded 28513 primary data records. [2025-09-25T22:27:50.093890] [DEBUG] [MAIN ] TG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:50.096985] [INFO ] [MAIN ] TG: Generated 1807 derivative records from 10546 primary records. [2025-09-25T22:27:50.098163] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-25T22:27:50.116349] [DEBUG] [LOCAL ] TG: Derivative data saved (1807 records). [2025-09-25T22:27:50.130466] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-25T22:27:50.142338] [INFO ] [MAIN ] Derivative Progress: 1765/2043 symbols completed. TG took 1.1s. Estimated remaining: 1m 57s. Rate: 142.9 symbols/min [2025-09-25T22:27:50.143026] [DEBUG] [MAIN ] TFX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:50.143344] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:50.145011] [INFO ] [MAIN ] TFX: Generated 1807 derivative records from 37634 primary records. [2025-09-25T22:27:50.145257] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-25T22:27:50.171270] [DEBUG] [LOCAL ] TFX: Derivative data saved (1807 records). [2025-09-25T22:27:50.171723] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-25T22:27:50.174747] [INFO ] [MAIN ] Derivative Progress: 1766/2043 symbols completed. TFX took 1.2s. Estimated remaining: 1m 56s. Rate: 143.0 symbols/min [2025-09-25T22:27:50.175368] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:50.194409] [DEBUG] [MAIN ] TGLS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:50.195587] [INFO ] [MAIN ] TGLS: Generated 1807 derivative records from 28513 primary records. [2025-09-25T22:27:50.195825] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-25T22:27:50.217431] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1807 records). [2025-09-25T22:27:50.236301] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-25T22:27:50.240574] [INFO ] [MAIN ] Derivative Progress: 1767/2043 symbols completed. TGLS took 1.2s. Estimated remaining: 1m 56s. Rate: 143.0 symbols/min [2025-09-25T22:27:50.241188] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:50.256354] [DEBUG] [LOCAL ] TGS: Loaded 32812 existing records from primary storage. [2025-09-25T22:27:50.256789] [INFO ] [MAIN ] TGS: Loaded 32812 primary data records. [2025-09-25T22:27:50.323026] [DEBUG] [LOCAL ] TGNA: Loaded 49082 existing records from primary storage. [2025-09-25T22:27:50.353260] [INFO ] [MAIN ] TGNA: Loaded 49082 primary data records. [2025-09-25T22:27:50.979876] [DEBUG] [LOCAL ] TGT: Loaded 54168 existing records from primary storage. [2025-09-25T22:27:50.991592] [INFO ] [MAIN ] TGT: Loaded 54168 primary data records. [2025-09-25T22:27:51.417747] [DEBUG] [MAIN ] TGS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:51.419472] [INFO ] [MAIN ] TGS: Generated 1807 derivative records from 32812 primary records. [2025-09-25T22:27:51.421378] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-25T22:27:51.456674] [DEBUG] [MAIN ] TGNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:51.459918] [INFO ] [MAIN ] TGNA: Generated 1807 derivative records from 49082 primary records. [2025-09-25T22:27:51.463418] [DEBUG] [LOCAL ] TGS: Derivative data saved (1807 records). [2025-09-25T22:27:51.463530] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-25T22:27:51.463672] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-25T22:27:51.467473] [INFO ] [MAIN ] Derivative Progress: 1768/2043 symbols completed. TGS took 1.3s. Estimated remaining: 1m 55s. Rate: 142.9 symbols/min [2025-09-25T22:27:51.485878] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1807 records). [2025-09-25T22:27:51.486080] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-25T22:27:51.490087] [INFO ] [MAIN ] Derivative Progress: 1769/2043 symbols completed. TGNA took 1.3s. Estimated remaining: 1m 55s. Rate: 142.9 symbols/min [2025-09-25T22:27:51.507865] [DEBUG] [MAIN ] TGT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:51.508676] [INFO ] [MAIN ] TGT: Generated 1807 derivative records from 54168 primary records. [2025-09-25T22:27:51.508744] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-25T22:27:51.525219] [DEBUG] [LOCAL ] TGT: Derivative data saved (1807 records). [2025-09-25T22:27:51.525367] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-25T22:27:51.528605] [INFO ] [MAIN ] Derivative Progress: 1770/2043 symbols completed. TGT took 1.3s. Estimated remaining: 1m 55s. Rate: 143.0 symbols/min [2025-09-25T22:27:51.529815] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:51.529689] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:51.530609] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:51.537347] [DEBUG] [LOCAL ] THIR: Loaded 2219 existing records from primary storage. [2025-09-25T22:27:51.537552] [INFO ] [MAIN ] THIR: Loaded 2219 primary data records. [2025-09-25T22:27:51.733333] [DEBUG] [LOCAL ] THG: Loaded 21891 existing records from primary storage. [2025-09-25T22:27:51.770257] [INFO ] [MAIN ] THG: Loaded 21891 primary data records. [2025-09-25T22:27:52.035191] [DEBUG] [LOCAL ] THC: Loaded 48304 existing records from primary storage. [2025-09-25T22:27:52.041368] [INFO ] [MAIN ] THC: Loaded 48304 primary data records. [2025-09-25T22:27:52.477905] [DEBUG] [MAIN ] THIR: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:27:52.491880] [INFO ] [MAIN ] THIR: Generated 1806 derivative records from 2219 primary records. [2025-09-25T22:27:52.609459] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-25T22:27:52.628309] [DEBUG] [LOCAL ] THIR: Derivative data saved (1806 records). [2025-09-25T22:27:52.629494] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-25T22:27:52.633089] [INFO ] [MAIN ] Derivative Progress: 1771/2043 symbols completed. THIR took 1.1s. Estimated remaining: 1m 54s. Rate: 142.9 symbols/min [2025-09-25T22:27:52.634270] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:52.645004] [DEBUG] [LOCAL ] THLV: Loaded 1612 existing records from primary storage. [2025-09-25T22:27:52.658531] [INFO ] [MAIN ] THLV: Loaded 1612 primary data records. [2025-09-25T22:27:52.659053] [DEBUG] [MAIN ] THG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:52.683551] [INFO ] [MAIN ] THG: Generated 1807 derivative records from 21891 primary records. [2025-09-25T22:27:52.721776] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-25T22:27:52.865410] [DEBUG] [MAIN ] THC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:52.894094] [INFO ] [MAIN ] THC: Generated 1807 derivative records from 48304 primary records. [2025-09-25T22:27:53.017330] [DEBUG] [LOCAL ] THG: Derivative data saved (1807 records). [2025-09-25T22:27:53.017751] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-25T22:27:53.017889] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-25T22:27:53.024067] [INFO ] [MAIN ] Derivative Progress: 1772/2043 symbols completed. THG took 1.5s. Estimated remaining: 1m 54s. Rate: 142.9 symbols/min [2025-09-25T22:27:53.034014] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:53.048771] [DEBUG] [LOCAL ] THC: Derivative data saved (1807 records). [2025-09-25T22:27:53.049003] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-25T22:27:53.052578] [INFO ] [MAIN ] Derivative Progress: 1773/2043 symbols completed. THC took 1.5s. Estimated remaining: 1m 53s. Rate: 143.0 symbols/min [2025-09-25T22:27:53.053413] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:53.075870] [DEBUG] [MAIN ] THLV: Filtered 6966 bins outside market hours, 7761 incomplete bins [2025-09-25T22:27:53.076890] [INFO ] [MAIN ] THLV: Generated 1805 derivative records from 1612 primary records. [2025-09-25T22:27:53.076962] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-25T22:27:53.108888] [DEBUG] [LOCAL ] THLV: Derivative data saved (1805 records). [2025-09-25T22:27:53.109164] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-25T22:27:53.111684] [INFO ] [MAIN ] Derivative Progress: 1774/2043 symbols completed. THLV took 0.5s. Estimated remaining: 1m 53s. Rate: 143.0 symbols/min [2025-09-25T22:27:53.120778] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:53.136973] [DEBUG] [LOCAL ] THQ: Loaded 24695 existing records from primary storage. [2025-09-25T22:27:53.137402] [INFO ] [MAIN ] THQ: Loaded 24695 primary data records. [2025-09-25T22:27:53.138779] [DEBUG] [LOCAL ] THO: Loaded 42681 existing records from primary storage. [2025-09-25T22:27:53.153987] [INFO ] [MAIN ] THO: Loaded 42681 primary data records. [2025-09-25T22:27:53.351435] [DEBUG] [LOCAL ] THR: Loaded 20062 existing records from primary storage. [2025-09-25T22:27:53.377622] [INFO ] [MAIN ] THR: Loaded 20062 primary data records. [2025-09-25T22:27:54.300887] [DEBUG] [MAIN ] THQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:54.303567] [INFO ] [MAIN ] THQ: Generated 1807 derivative records from 24695 primary records. [2025-09-25T22:27:54.304043] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-25T22:27:54.347060] [DEBUG] [MAIN ] THO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:54.349268] [INFO ] [MAIN ] THO: Generated 1807 derivative records from 42681 primary records. [2025-09-25T22:27:54.349896] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-25T22:27:54.379222] [DEBUG] [MAIN ] THR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:54.381503] [INFO ] [MAIN ] THR: Generated 1807 derivative records from 20062 primary records. [2025-09-25T22:27:54.381857] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-25T22:27:54.384425] [DEBUG] [LOCAL ] THQ: Derivative data saved (1807 records). [2025-09-25T22:27:54.392960] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-25T22:27:54.396422] [INFO ] [MAIN ] Derivative Progress: 1775/2043 symbols completed. THQ took 1.3s. Estimated remaining: 1m 53s. Rate: 142.9 symbols/min [2025-09-25T22:27:54.397328] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:54.411513] [DEBUG] [LOCAL ] THR: Derivative data saved (1807 records). [2025-09-25T22:27:54.413349] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-25T22:27:54.417321] [INFO ] [MAIN ] Derivative Progress: 1776/2043 symbols completed. THR took 1.3s. Estimated remaining: 1m 52s. Rate: 142.9 symbols/min [2025-09-25T22:27:54.418036] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:54.420744] [DEBUG] [LOCAL ] THO: Derivative data saved (1807 records). [2025-09-25T22:27:54.421158] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-25T22:27:54.426219] [INFO ] [MAIN ] Derivative Progress: 1777/2043 symbols completed. THO took 1.4s. Estimated remaining: 1m 52s. Rate: 143.0 symbols/min [2025-09-25T22:27:54.426947] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:54.451817] [DEBUG] [LOCAL ] THW: Loaded 19235 existing records from primary storage. [2025-09-25T22:27:54.462071] [INFO ] [MAIN ] THW: Loaded 19235 primary data records. [2025-09-25T22:27:54.604477] [DEBUG] [LOCAL ] THS: Loaded 38320 existing records from primary storage. [2025-09-25T22:27:54.609516] [INFO ] [MAIN ] THS: Loaded 38320 primary data records. [2025-09-25T22:27:54.743746] [DEBUG] [LOCAL ] TIMB: Loaded 36834 existing records from primary storage. [2025-09-25T22:27:54.806719] [INFO ] [MAIN ] TIMB: Loaded 36834 primary data records. [2025-09-25T22:27:55.631817] [DEBUG] [MAIN ] THS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:55.631531] [DEBUG] [MAIN ] THW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:55.632857] [INFO ] [MAIN ] THS: Generated 1807 derivative records from 38320 primary records. [2025-09-25T22:27:55.633805] [INFO ] [MAIN ] THW: Generated 1807 derivative records from 19235 primary records. [2025-09-25T22:27:55.634061] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-25T22:27:55.634116] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-25T22:27:55.669247] [DEBUG] [LOCAL ] THS: Derivative data saved (1807 records). [2025-09-25T22:27:55.670307] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-25T22:27:55.681700] [INFO ] [MAIN ] Derivative Progress: 1778/2043 symbols completed. THS took 1.3s. Estimated remaining: 1m 51s. Rate: 142.9 symbols/min [2025-09-25T22:27:55.688600] [DEBUG] [MAIN ] TIMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:55.689598] [INFO ] [MAIN ] TIMB: Generated 1807 derivative records from 36834 primary records. [2025-09-25T22:27:55.692229] [DEBUG] [LOCAL ] THW: Derivative data saved (1807 records). [2025-09-25T22:27:55.692402] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-25T22:27:55.695115] [INFO ] [MAIN ] Derivative Progress: 1779/2043 symbols completed. THW took 1.3s. Estimated remaining: 1m 51s. Rate: 142.9 symbols/min [2025-09-25T22:27:55.688278] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:55.695793] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:55.695695] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-25T22:27:55.718242] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1807 records). [2025-09-25T22:27:55.721861] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-25T22:27:55.721777] [DEBUG] [LOCAL ] TISI: Loaded 3795 existing records from primary storage. [2025-09-25T22:27:55.725282] [INFO ] [MAIN ] TISI: Loaded 3795 primary data records. [2025-09-25T22:27:55.725198] [INFO ] [MAIN ] Derivative Progress: 1780/2043 symbols completed. TIMB took 1.3s. Estimated remaining: 1m 50s. Rate: 143.0 symbols/min [2025-09-25T22:27:55.730935] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:55.927509] [DEBUG] [LOCAL ] TIXT: Loaded 31678 existing records from primary storage. [2025-09-25T22:27:55.941494] [INFO ] [MAIN ] TIXT: Loaded 31678 primary data records. [2025-09-25T22:27:56.317571] [DEBUG] [LOCAL ] TJX: Loaded 54059 existing records from primary storage. [2025-09-25T22:27:56.326751] [INFO ] [MAIN ] TJX: Loaded 54059 primary data records. [2025-09-25T22:27:56.820978] [DEBUG] [MAIN ] TISI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:56.822015] [INFO ] [MAIN ] TISI: Generated 1807 derivative records from 3795 primary records. [2025-09-25T22:27:56.822483] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-25T22:27:56.855178] [DEBUG] [LOCAL ] TISI: Derivative data saved (1807 records). [2025-09-25T22:27:56.855448] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-25T22:27:56.858174] [INFO ] [MAIN ] Derivative Progress: 1781/2043 symbols completed. TISI took 1.2s. Estimated remaining: 1m 50s. Rate: 142.9 symbols/min [2025-09-25T22:27:56.853410] [DEBUG] [MAIN ] TIXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:56.859208] [INFO ] [MAIN ] TIXT: Generated 1807 derivative records from 31678 primary records. [2025-09-25T22:27:56.859562] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-25T22:27:56.859509] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:56.877224] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1807 records). [2025-09-25T22:27:56.877717] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-25T22:27:56.881094] [INFO ] [MAIN ] Derivative Progress: 1782/2043 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 50s. Rate: 143.0 symbols/min [2025-09-25T22:27:56.881488] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:56.898694] [DEBUG] [MAIN ] TJX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:56.899583] [INFO ] [MAIN ] TJX: Generated 1807 derivative records from 54059 primary records. [2025-09-25T22:27:56.899732] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-25T22:27:56.917996] [DEBUG] [LOCAL ] TJX: Derivative data saved (1807 records). [2025-09-25T22:27:56.918297] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-25T22:27:56.921821] [INFO ] [MAIN ] Derivative Progress: 1783/2043 symbols completed. TJX took 1.2s. Estimated remaining: 1m 49s. Rate: 143.0 symbols/min [2025-09-25T22:27:56.957887] [DEBUG] [LOCAL ] TK: Loaded 39941 existing records from primary storage. [2025-09-25T22:27:56.958520] [INFO ] [MAIN ] TK: Loaded 39941 primary data records. [2025-09-25T22:27:57.052847] [DEBUG] [LOCAL ] TKC: Loaded 38717 existing records from primary storage. [2025-09-25T22:27:57.078285] [INFO ] [MAIN ] TKC: Loaded 38717 primary data records. [2025-09-25T22:27:57.620249] [DEBUG] [MAIN ] TK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:57.621193] [INFO ] [MAIN ] TK: Generated 1807 derivative records from 39941 primary records. [2025-09-25T22:27:57.621290] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-25T22:27:57.653568] [DEBUG] [MAIN ] TKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:57.654945] [INFO ] [MAIN ] TKC: Generated 1807 derivative records from 38717 primary records. [2025-09-25T22:27:57.655259] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-25T22:27:57.657397] [DEBUG] [LOCAL ] TK: Derivative data saved (1807 records). [2025-09-25T22:27:57.657711] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-25T22:27:57.668282] [INFO ] [MAIN ] Derivative Progress: 1784/2043 symbols completed. TK took 0.8s. Estimated remaining: 1m 49s. Rate: 143.0 symbols/min [2025-09-25T22:27:57.675858] [DEBUG] [LOCAL ] TKC: Derivative data saved (1807 records). [2025-09-25T22:27:57.675930] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-25T22:27:57.678705] [INFO ] [MAIN ] Derivative Progress: 1785/2043 symbols completed. TKC took 0.8s. Estimated remaining: 1m 48s. Rate: 143.0 symbols/min [2025-09-25T22:27:57.679243] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:57.679443] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:57.679540] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:57.748011] [DEBUG] [LOCAL ] TKR: Loaded 40556 existing records from primary storage. [2025-09-25T22:27:57.748216] [INFO ] [MAIN ] TKR: Loaded 40556 primary data records. [2025-09-25T22:27:57.888604] [DEBUG] [LOCAL ] TLK: Loaded 39713 existing records from primary storage. [2025-09-25T22:27:57.894240] [DEBUG] [LOCAL ] TKO: Loaded 44485 existing records from primary storage. [2025-09-25T22:27:57.920272] [INFO ] [MAIN ] TLK: Loaded 39713 primary data records. [2025-09-25T22:27:57.909940] [INFO ] [MAIN ] TKO: Loaded 44485 primary data records. [2025-09-25T22:27:58.825449] [DEBUG] [MAIN ] TKR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:58.826972] [INFO ] [MAIN ] TKR: Generated 1807 derivative records from 40556 primary records. [2025-09-25T22:27:58.827207] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-25T22:27:58.847161] [DEBUG] [LOCAL ] TKR: Derivative data saved (1807 records). [2025-09-25T22:27:58.849189] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-25T22:27:58.852962] [INFO ] [MAIN ] Derivative Progress: 1786/2043 symbols completed. TKR took 1.2s. Estimated remaining: 1m 48s. Rate: 142.9 symbols/min [2025-09-25T22:27:58.853558] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:58.870633] [DEBUG] [MAIN ] TLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:58.871815] [INFO ] [MAIN ] TLK: Generated 1807 derivative records from 39713 primary records. [2025-09-25T22:27:58.871987] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-25T22:27:58.899163] [DEBUG] [MAIN ] TKO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:58.905519] [INFO ] [MAIN ] TKO: Generated 1807 derivative records from 44485 primary records. [2025-09-25T22:27:58.916951] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-25T22:27:58.920707] [DEBUG] [LOCAL ] TLYS: Loaded 17017 existing records from primary storage. [2025-09-25T22:27:58.929419] [INFO ] [MAIN ] TLYS: Loaded 17017 primary data records. [2025-09-25T22:27:58.967492] [DEBUG] [LOCAL ] TLK: Derivative data saved (1807 records). [2025-09-25T22:27:58.981276] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-25T22:27:58.989964] [INFO ] [MAIN ] Derivative Progress: 1787/2043 symbols completed. TLK took 1.3s. Estimated remaining: 1m 47s. Rate: 143.0 symbols/min [2025-09-25T22:27:59.025860] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:59.083305] [DEBUG] [LOCAL ] TKO: Derivative data saved (1807 records). [2025-09-25T22:27:59.132811] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-25T22:27:59.142975] [INFO ] [MAIN ] Derivative Progress: 1788/2043 symbols completed. TKO took 1.5s. Estimated remaining: 1m 47s. Rate: 143.0 symbols/min [2025-09-25T22:27:59.256105] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:27:59.304836] [DEBUG] [LOCAL ] TM: Loaded 36783 existing records from primary storage. [2025-09-25T22:27:59.305316] [INFO ] [MAIN ] TM: Loaded 36783 primary data records. [2025-09-25T22:27:59.667596] [DEBUG] [MAIN ] TLYS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:27:59.685776] [INFO ] [MAIN ] TLYS: Generated 1807 derivative records from 17017 primary records. [2025-09-25T22:27:59.684362] [DEBUG] [LOCAL ] TME: Loaded 53589 existing records from primary storage. [2025-09-25T22:27:59.686022] [INFO ] [MAIN ] TME: Loaded 53589 primary data records. [2025-09-25T22:27:59.685952] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-25T22:27:59.817917] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1807 records). [2025-09-25T22:27:59.818524] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-25T22:27:59.842012] [INFO ] [MAIN ] Derivative Progress: 1789/2043 symbols completed. TLYS took 1.0s. Estimated remaining: 1m 47s. Rate: 142.9 symbols/min [2025-09-25T22:27:59.843437] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:00.100774] [DEBUG] [MAIN ] TM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:00.102608] [INFO ] [MAIN ] TM: Generated 1807 derivative records from 36783 primary records. [2025-09-25T22:28:00.102715] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-25T22:28:00.133528] [DEBUG] [LOCAL ] TM: Derivative data saved (1807 records). [2025-09-25T22:28:00.134062] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-25T22:28:00.137517] [INFO ] [MAIN ] Derivative Progress: 1790/2043 symbols completed. TM took 1.1s. Estimated remaining: 1m 46s. Rate: 143.0 symbols/min [2025-09-25T22:28:00.138142] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:00.171918] [DEBUG] [MAIN ] TME: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:00.171510] [DEBUG] [LOCAL ] TMHC: Loaded 45968 existing records from primary storage. [2025-09-25T22:28:00.172749] [INFO ] [MAIN ] TMHC: Loaded 45968 primary data records. [2025-09-25T22:28:00.172866] [INFO ] [MAIN ] TME: Generated 1807 derivative records from 53589 primary records. [2025-09-25T22:28:00.173041] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-25T22:28:00.266768] [DEBUG] [LOCAL ] TME: Derivative data saved (1807 records). [2025-09-25T22:28:00.284983] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-25T22:28:00.308424] [INFO ] [MAIN ] Derivative Progress: 1791/2043 symbols completed. TME took 1.1s. Estimated remaining: 1m 46s. Rate: 143.0 symbols/min [2025-09-25T22:28:00.347758] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:00.560896] [DEBUG] [LOCAL ] TMO: Loaded 52717 existing records from primary storage. [2025-09-25T22:28:00.561387] [INFO ] [MAIN ] TMO: Loaded 52717 primary data records. [2025-09-25T22:28:00.699982] [DEBUG] [LOCAL ] TNC: Loaded 15213 existing records from primary storage. [2025-09-25T22:28:00.713933] [INFO ] [MAIN ] TNC: Loaded 15213 primary data records. [2025-09-25T22:28:01.283983] [DEBUG] [MAIN ] TMHC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:01.286099] [INFO ] [MAIN ] TMHC: Generated 1807 derivative records from 45968 primary records. [2025-09-25T22:28:01.286796] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-25T22:28:01.307977] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1807 records). [2025-09-25T22:28:01.308685] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-25T22:28:01.311613] [INFO ] [MAIN ] Derivative Progress: 1792/2043 symbols completed. TMHC took 1.5s. Estimated remaining: 1m 45s. Rate: 142.9 symbols/min [2025-09-25T22:28:01.312382] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:01.337873] [DEBUG] [MAIN ] TMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:01.360944] [INFO ] [MAIN ] TMO: Generated 1807 derivative records from 52717 primary records. [2025-09-25T22:28:01.361560] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-25T22:28:01.361392] [DEBUG] [MAIN ] TNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:01.363679] [INFO ] [MAIN ] TNC: Generated 1807 derivative records from 15213 primary records. [2025-09-25T22:28:01.363867] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-25T22:28:01.408414] [DEBUG] [LOCAL ] TNC: Derivative data saved (1807 records). [2025-09-25T22:28:01.411364] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-25T22:28:01.414729] [INFO ] [MAIN ] Derivative Progress: 1793/2043 symbols completed. TNC took 1.1s. Estimated remaining: 1m 45s. Rate: 143.0 symbols/min [2025-09-25T22:28:01.415832] [DEBUG] [LOCAL ] TNET: Loaded 29060 existing records from primary storage. [2025-09-25T22:28:01.411453] [DEBUG] [LOCAL ] TMO: Derivative data saved (1807 records). [2025-09-25T22:28:01.416388] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-25T22:28:01.419678] [INFO ] [MAIN ] Derivative Progress: 1794/2043 symbols completed. TMO took 1.3s. Estimated remaining: 1m 44s. Rate: 143.0 symbols/min [2025-09-25T22:28:01.416046] [INFO ] [MAIN ] TNET: Loaded 29060 primary data records. [2025-09-25T22:28:01.420244] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:01.420474] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:01.839742] [DEBUG] [LOCAL ] TNK: Loaded 35468 existing records from primary storage. [2025-09-25T22:28:01.842463] [INFO ] [MAIN ] TNK: Loaded 35468 primary data records. [2025-09-25T22:28:01.856890] [DEBUG] [LOCAL ] TNL: Loaded 42237 existing records from primary storage. [2025-09-25T22:28:01.906970] [INFO ] [MAIN ] TNL: Loaded 42237 primary data records. [2025-09-25T22:28:02.601874] [DEBUG] [MAIN ] TNET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:02.603040] [INFO ] [MAIN ] TNET: Generated 1807 derivative records from 29060 primary records. [2025-09-25T22:28:02.603179] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-25T22:28:02.624673] [DEBUG] [LOCAL ] TNET: Derivative data saved (1807 records). [2025-09-25T22:28:02.625484] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-25T22:28:02.628494] [INFO ] [MAIN ] Derivative Progress: 1795/2043 symbols completed. TNET took 1.3s. Estimated remaining: 1m 44s. Rate: 142.9 symbols/min [2025-09-25T22:28:02.629560] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:02.653223] [DEBUG] [MAIN ] TNK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:02.654152] [INFO ] [MAIN ] TNK: Generated 1807 derivative records from 35468 primary records. [2025-09-25T22:28:02.654335] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-25T22:28:02.674840] [DEBUG] [LOCAL ] TNK: Derivative data saved (1807 records). [2025-09-25T22:28:02.688320] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-25T22:28:02.691520] [INFO ] [MAIN ] Derivative Progress: 1796/2043 symbols completed. TNK took 1.3s. Estimated remaining: 1m 44s. Rate: 143.0 symbols/min [2025-09-25T22:28:02.688638] [DEBUG] [MAIN ] TNL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:02.706546] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:02.707565] [INFO ] [MAIN ] TNL: Generated 1807 derivative records from 42237 primary records. [2025-09-25T22:28:02.708245] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-25T22:28:02.725987] [DEBUG] [LOCAL ] TNL: Derivative data saved (1807 records). [2025-09-25T22:28:02.727389] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-25T22:28:02.730691] [INFO ] [MAIN ] Derivative Progress: 1797/2043 symbols completed. TNL took 1.3s. Estimated remaining: 1m 43s. Rate: 143.0 symbols/min [2025-09-25T22:28:02.731261] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:02.751918] [DEBUG] [LOCAL ] TOL: Loaded 51422 existing records from primary storage. [2025-09-25T22:28:02.753287] [INFO ] [MAIN ] TOL: Loaded 51422 primary data records. [2025-09-25T22:28:02.976821] [DEBUG] [LOCAL ] TPB: Loaded 25164 existing records from primary storage. [2025-09-25T22:28:03.007083] [INFO ] [MAIN ] TPB: Loaded 25164 primary data records. [2025-09-25T22:28:03.020980] [DEBUG] [LOCAL ] TOST: Loaded 54071 existing records from primary storage. [2025-09-25T22:28:03.152617] [INFO ] [MAIN ] TOST: Loaded 54071 primary data records. [2025-09-25T22:28:03.830181] [DEBUG] [MAIN ] TOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:03.832202] [INFO ] [MAIN ] TOL: Generated 1807 derivative records from 51422 primary records. [2025-09-25T22:28:03.832789] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-25T22:28:03.851098] [DEBUG] [LOCAL ] TOL: Derivative data saved (1807 records). [2025-09-25T22:28:03.851873] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-25T22:28:03.854330] [INFO ] [MAIN ] Derivative Progress: 1798/2043 symbols completed. TOL took 1.2s. Estimated remaining: 1m 43s. Rate: 142.9 symbols/min [2025-09-25T22:28:03.890878] [DEBUG] [MAIN ] TOST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:03.892450] [INFO ] [MAIN ] TOST: Generated 1807 derivative records from 54071 primary records. [2025-09-25T22:28:03.892546] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-25T22:28:03.891509] [DEBUG] [MAIN ] TPB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:03.894434] [INFO ] [MAIN ] TPB: Generated 1807 derivative records from 25164 primary records. [2025-09-25T22:28:03.894859] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-25T22:28:03.926491] [DEBUG] [LOCAL ] TPB: Derivative data saved (1807 records). [2025-09-25T22:28:03.927579] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-25T22:28:03.931100] [INFO ] [MAIN ] Derivative Progress: 1799/2043 symbols completed. TPB took 1.2s. Estimated remaining: 1m 42s. Rate: 143.0 symbols/min [2025-09-25T22:28:03.931590] [DEBUG] [LOCAL ] TOST: Derivative data saved (1807 records). [2025-09-25T22:28:03.931944] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-25T22:28:03.935868] [INFO ] [MAIN ] Derivative Progress: 1800/2043 symbols completed. TOST took 1.2s. Estimated remaining: 1m 42s. Rate: 143.0 symbols/min [2025-09-25T22:28:03.936597] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:03.936831] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:03.937473] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:03.956060] [DEBUG] [LOCAL ] TPL: Loaded 12456 existing records from primary storage. [2025-09-25T22:28:03.956225] [INFO ] [MAIN ] TPL: Loaded 12456 primary data records. [2025-09-25T22:28:04.137947] [DEBUG] [LOCAL ] TPC: Loaded 39083 existing records from primary storage. [2025-09-25T22:28:04.143379] [INFO ] [MAIN ] TPC: Loaded 39083 primary data records. [2025-09-25T22:28:04.445357] [DEBUG] [LOCAL ] TPH: Loaded 45521 existing records from primary storage. [2025-09-25T22:28:04.458260] [INFO ] [MAIN ] TPH: Loaded 45521 primary data records. [2025-09-25T22:28:05.108093] [DEBUG] [MAIN ] TPL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:05.109884] [INFO ] [MAIN ] TPL: Generated 1807 derivative records from 12456 primary records. [2025-09-25T22:28:05.110417] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-25T22:28:05.130286] [DEBUG] [LOCAL ] TPL: Derivative data saved (1807 records). [2025-09-25T22:28:05.133875] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-25T22:28:05.137389] [INFO ] [MAIN ] Derivative Progress: 1801/2043 symbols completed. TPL took 1.2s. Estimated remaining: 1m 42s. Rate: 142.9 symbols/min [2025-09-25T22:28:05.138237] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:05.152901] [DEBUG] [MAIN ] TPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:05.154449] [INFO ] [MAIN ] TPC: Generated 1807 derivative records from 39083 primary records. [2025-09-25T22:28:05.154614] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-25T22:28:05.171541] [DEBUG] [LOCAL ] TPC: Derivative data saved (1807 records). [2025-09-25T22:28:05.171862] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-25T22:28:05.175757] [INFO ] [MAIN ] Derivative Progress: 1802/2043 symbols completed. TPC took 1.2s. Estimated remaining: 1m 41s. Rate: 143.0 symbols/min [2025-09-25T22:28:05.178325] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:05.194010] [DEBUG] [MAIN ] TPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:05.195133] [INFO ] [MAIN ] TPH: Generated 1807 derivative records from 45521 primary records. [2025-09-25T22:28:05.195268] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-25T22:28:05.214162] [DEBUG] [LOCAL ] TPH: Derivative data saved (1807 records). [2025-09-25T22:28:05.214672] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-25T22:28:05.219693] [INFO ] [MAIN ] Derivative Progress: 1803/2043 symbols completed. TPH took 1.3s. Estimated remaining: 1m 41s. Rate: 143.0 symbols/min [2025-09-25T22:28:05.220374] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:05.263216] [DEBUG] [LOCAL ] TPYP: Loaded 7942 existing records from primary storage. [2025-09-25T22:28:05.272248] [INFO ] [MAIN ] TPYP: Loaded 7942 primary data records. [2025-09-25T22:28:05.275912] [DEBUG] [LOCAL ] TPVG: Loaded 27220 existing records from primary storage. [2025-09-25T22:28:05.329719] [INFO ] [MAIN ] TPVG: Loaded 27220 primary data records. [2025-09-25T22:28:05.387065] [DEBUG] [LOCAL ] TPR: Loaded 53866 existing records from primary storage. [2025-09-25T22:28:05.423879] [INFO ] [MAIN ] TPR: Loaded 53866 primary data records. [2025-09-25T22:28:06.328209] [DEBUG] [MAIN ] TPYP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:06.330261] [INFO ] [MAIN ] TPYP: Generated 1807 derivative records from 7942 primary records. [2025-09-25T22:28:06.330366] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-25T22:28:06.351977] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1807 records). [2025-09-25T22:28:06.352191] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-25T22:28:06.363047] [INFO ] [MAIN ] Derivative Progress: 1804/2043 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 40s. Rate: 142.9 symbols/min [2025-09-25T22:28:06.368595] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:06.369978] [DEBUG] [MAIN ] TPR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:06.374547] [INFO ] [MAIN ] TPR: Generated 1807 derivative records from 53866 primary records. [2025-09-25T22:28:06.374897] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-25T22:28:06.402475] [DEBUG] [LOCAL ] TPZ: Loaded 5068 existing records from primary storage. [2025-09-25T22:28:06.412515] [DEBUG] [LOCAL ] TPR: Derivative data saved (1807 records). [2025-09-25T22:28:06.412699] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-25T22:28:06.407527] [INFO ] [MAIN ] TPZ: Loaded 5068 primary data records. [2025-09-25T22:28:06.412393] [DEBUG] [MAIN ] TPVG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:06.439097] [INFO ] [MAIN ] Derivative Progress: 1805/2043 symbols completed. TPR took 1.3s. Estimated remaining: 1m 40s. Rate: 143.0 symbols/min [2025-09-25T22:28:06.484477] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:06.486552] [INFO ] [MAIN ] TPVG: Generated 1807 derivative records from 27220 primary records. [2025-09-25T22:28:06.529026] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-25T22:28:06.808448] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1807 records). [2025-09-25T22:28:06.825709] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-25T22:28:06.830229] [INFO ] [MAIN ] Derivative Progress: 1806/2043 symbols completed. TPVG took 1.7s. Estimated remaining: 1m 39s. Rate: 143.0 symbols/min [2025-09-25T22:28:06.825857] [DEBUG] [LOCAL ] TR: Loaded 18389 existing records from primary storage. [2025-09-25T22:28:06.830789] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:06.831280] [INFO ] [MAIN ] TR: Loaded 18389 primary data records. [2025-09-25T22:28:06.989175] [DEBUG] [LOCAL ] TRAK: Loaded 9342 existing records from primary storage. [2025-09-25T22:28:07.002253] [INFO ] [MAIN ] TRAK: Loaded 9342 primary data records. [2025-09-25T22:28:07.361567] [DEBUG] [MAIN ] TPZ: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:28:07.372541] [INFO ] [MAIN ] TPZ: Generated 1806 derivative records from 5068 primary records. [2025-09-25T22:28:07.398749] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-25T22:28:07.543865] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1806 records). [2025-09-25T22:28:07.544251] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-25T22:28:07.546748] [INFO ] [MAIN ] Derivative Progress: 1807/2043 symbols completed. TPZ took 1.2s. Estimated remaining: 1m 39s. Rate: 142.9 symbols/min [2025-09-25T22:28:07.547519] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:07.570495] [DEBUG] [MAIN ] TR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:07.572268] [INFO ] [MAIN ] TR: Generated 1807 derivative records from 18389 primary records. [2025-09-25T22:28:07.577743] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-25T22:28:07.604980] [DEBUG] [LOCAL ] TR: Derivative data saved (1807 records). [2025-09-25T22:28:07.605940] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-25T22:28:07.605563] [DEBUG] [LOCAL ] TRC: Loaded 16113 existing records from primary storage. [2025-09-25T22:28:07.609834] [INFO ] [MAIN ] Derivative Progress: 1808/2043 symbols completed. TR took 1.1s. Estimated remaining: 1m 39s. Rate: 143.0 symbols/min [2025-09-25T22:28:07.610554] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:07.610188] [INFO ] [MAIN ] TRC: Loaded 16113 primary data records. [2025-09-25T22:28:07.763821] [DEBUG] [MAIN ] TRAK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:07.798279] [INFO ] [MAIN ] TRAK: Generated 1807 derivative records from 9342 primary records. [2025-09-25T22:28:07.809045] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-25T22:28:08.007951] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1807 records). [2025-09-25T22:28:08.009175] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-25T22:28:08.012959] [INFO ] [MAIN ] Derivative Progress: 1809/2043 symbols completed. TRAK took 1.2s. Estimated remaining: 1m 38s. Rate: 143.0 symbols/min [2025-09-25T22:28:08.030148] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:08.032464] [DEBUG] [LOCAL ] TREX: Loaded 50361 existing records from primary storage. [2025-09-25T22:28:08.034226] [INFO ] [MAIN ] TREX: Loaded 50361 primary data records. [2025-09-25T22:28:08.399067] [DEBUG] [MAIN ] TRC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:08.401133] [INFO ] [MAIN ] TRC: Generated 1807 derivative records from 16113 primary records. [2025-09-25T22:28:08.401259] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-25T22:28:08.422816] [DEBUG] [LOCAL ] TRC: Derivative data saved (1807 records). [2025-09-25T22:28:08.438252] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-25T22:28:08.441683] [INFO ] [MAIN ] Derivative Progress: 1810/2043 symbols completed. TRC took 0.9s. Estimated remaining: 1m 38s. Rate: 143.0 symbols/min [2025-09-25T22:28:08.445438] [DEBUG] [LOCAL ] TRGP: Loaded 51169 existing records from primary storage. [2025-09-25T22:28:08.445919] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:08.446271] [INFO ] [MAIN ] TRGP: Loaded 51169 primary data records. [2025-09-25T22:28:08.711508] [DEBUG] [MAIN ] TREX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:08.714532] [INFO ] [MAIN ] TREX: Generated 1807 derivative records from 50361 primary records. [2025-09-25T22:28:08.715493] [DEBUG] [LOCAL ] TRN: Loaded 37620 existing records from primary storage. [2025-09-25T22:28:08.896520] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-25T22:28:08.910194] [INFO ] [MAIN ] TRN: Loaded 37620 primary data records. [2025-09-25T22:28:09.132313] [DEBUG] [LOCAL ] TREX: Derivative data saved (1807 records). [2025-09-25T22:28:09.132480] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-25T22:28:09.135726] [INFO ] [MAIN ] Derivative Progress: 1811/2043 symbols completed. TREX took 1.5s. Estimated remaining: 1m 37s. Rate: 142.9 symbols/min [2025-09-25T22:28:09.265367] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:09.293685] [DEBUG] [MAIN ] TRGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:09.295351] [INFO ] [MAIN ] TRGP: Generated 1807 derivative records from 51169 primary records. [2025-09-25T22:28:09.295427] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-25T22:28:09.316568] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1807 records). [2025-09-25T22:28:09.316781] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-25T22:28:09.319509] [INFO ] [MAIN ] Derivative Progress: 1812/2043 symbols completed. TRGP took 1.3s. Estimated remaining: 1m 37s. Rate: 143.0 symbols/min [2025-09-25T22:28:09.333376] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:09.352484] [DEBUG] [MAIN ] TRN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:09.367115] [INFO ] [MAIN ] TRN: Generated 1807 derivative records from 37620 primary records. [2025-09-25T22:28:09.367344] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-25T22:28:09.381937] [DEBUG] [LOCAL ] TRNO: Loaded 44330 existing records from primary storage. [2025-09-25T22:28:09.387073] [INFO ] [MAIN ] TRNO: Loaded 44330 primary data records. [2025-09-25T22:28:09.386890] [DEBUG] [LOCAL ] TRN: Derivative data saved (1807 records). [2025-09-25T22:28:09.387593] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-25T22:28:09.396118] [INFO ] [MAIN ] Derivative Progress: 1813/2043 symbols completed. TRN took 1.0s. Estimated remaining: 1m 36s. Rate: 143.0 symbols/min [2025-09-25T22:28:09.698341] [DEBUG] [LOCAL ] TROX: Loaded 52162 existing records from primary storage. [2025-09-25T22:28:09.736075] [INFO ] [MAIN ] TROX: Loaded 52162 primary data records. [2025-09-25T22:28:10.084947] [DEBUG] [MAIN ] TRNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:10.085777] [INFO ] [MAIN ] TRNO: Generated 1807 derivative records from 44330 primary records. [2025-09-25T22:28:10.085845] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-25T22:28:10.107876] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1807 records). [2025-09-25T22:28:10.108286] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-25T22:28:10.110741] [INFO ] [MAIN ] Derivative Progress: 1814/2043 symbols completed. TRNO took 0.8s. Estimated remaining: 1m 36s. Rate: 143.0 symbols/min [2025-09-25T22:28:10.128590] [DEBUG] [MAIN ] TROX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:10.129388] [INFO ] [MAIN ] TROX: Generated 1807 derivative records from 52162 primary records. [2025-09-25T22:28:10.129471] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-25T22:28:10.145870] [DEBUG] [LOCAL ] TROX: Derivative data saved (1807 records). [2025-09-25T22:28:10.145945] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-25T22:28:10.148942] [INFO ] [MAIN ] Derivative Progress: 1815/2043 symbols completed. TROX took 0.8s. Estimated remaining: 1m 36s. Rate: 143.1 symbols/min [2025-09-25T22:28:10.149937] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:10.149759] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:10.150030] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:10.225770] [DEBUG] [LOCAL ] TRTX: Loaded 37759 existing records from primary storage. [2025-09-25T22:28:10.227468] [INFO ] [MAIN ] TRTX: Loaded 37759 primary data records. [2025-09-25T22:28:10.238957] [DEBUG] [LOCAL ] TRU: Loaded 51583 existing records from primary storage. [2025-09-25T22:28:10.266950] [INFO ] [MAIN ] TRU: Loaded 51583 primary data records. [2025-09-25T22:28:10.558560] [DEBUG] [LOCAL ] TRP: Loaded 52505 existing records from primary storage. [2025-09-25T22:28:10.605122] [INFO ] [MAIN ] TRP: Loaded 52505 primary data records. [2025-09-25T22:28:11.369944] [DEBUG] [MAIN ] TRTX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:11.372017] [INFO ] [MAIN ] TRTX: Generated 1807 derivative records from 37759 primary records. [2025-09-25T22:28:11.373013] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-25T22:28:11.404073] [DEBUG] [MAIN ] TRU: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:28:11.406302] [INFO ] [MAIN ] TRU: Generated 1806 derivative records from 51583 primary records. [2025-09-25T22:28:11.407159] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-25T22:28:11.410883] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1807 records). [2025-09-25T22:28:11.411155] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-25T22:28:11.414567] [INFO ] [MAIN ] Derivative Progress: 1816/2043 symbols completed. TRTX took 1.3s. Estimated remaining: 1m 35s. Rate: 142.9 symbols/min [2025-09-25T22:28:11.424562] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:11.443312] [DEBUG] [LOCAL ] TRU: Derivative data saved (1806 records). [2025-09-25T22:28:11.443774] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-25T22:28:11.461515] [INFO ] [MAIN ] Derivative Progress: 1817/2043 symbols completed. TRU took 1.3s. Estimated remaining: 1m 35s. Rate: 143.0 symbols/min [2025-09-25T22:28:11.464224] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:11.464899] [DEBUG] [MAIN ] TRP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:11.466714] [INFO ] [MAIN ] TRP: Generated 1807 derivative records from 52505 primary records. [2025-09-25T22:28:11.467039] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-25T22:28:11.494507] [DEBUG] [LOCAL ] TRP: Derivative data saved (1807 records). [2025-09-25T22:28:11.494753] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-25T22:28:11.499635] [INFO ] [MAIN ] Derivative Progress: 1818/2043 symbols completed. TRP took 1.4s. Estimated remaining: 1m 34s. Rate: 143.0 symbols/min [2025-09-25T22:28:11.500311] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:11.538258] [DEBUG] [LOCAL ] TRV: Loaded 48449 existing records from primary storage. [2025-09-25T22:28:11.538548] [INFO ] [MAIN ] TRV: Loaded 48449 primary data records. [2025-09-25T22:28:11.758921] [DEBUG] [LOCAL ] TSE: Loaded 28865 existing records from primary storage. [2025-09-25T22:28:11.760102] [DEBUG] [LOCAL ] TS: Loaded 52046 existing records from primary storage. [2025-09-25T22:28:11.760519] [INFO ] [MAIN ] TS: Loaded 52046 primary data records. [2025-09-25T22:28:11.769211] [INFO ] [MAIN ] TSE: Loaded 28865 primary data records. [2025-09-25T22:28:12.626789] [DEBUG] [MAIN ] TRV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:12.628300] [INFO ] [MAIN ] TRV: Generated 1807 derivative records from 48449 primary records. [2025-09-25T22:28:12.628772] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-25T22:28:12.647041] [DEBUG] [LOCAL ] TRV: Derivative data saved (1807 records). [2025-09-25T22:28:12.647280] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-25T22:28:12.649945] [INFO ] [MAIN ] Derivative Progress: 1819/2043 symbols completed. TRV took 1.2s. Estimated remaining: 1m 34s. Rate: 142.9 symbols/min [2025-09-25T22:28:12.650743] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:12.682282] [DEBUG] [MAIN ] TSE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:12.688137] [DEBUG] [MAIN ] TS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:12.690343] [INFO ] [MAIN ] TSE: Generated 1807 derivative records from 28865 primary records. [2025-09-25T22:28:12.690467] [INFO ] [MAIN ] TS: Generated 1807 derivative records from 52046 primary records. [2025-09-25T22:28:12.690758] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-25T22:28:12.694784] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-25T22:28:12.695047] [DEBUG] [LOCAL ] TSI: Loaded 8063 existing records from primary storage. [2025-09-25T22:28:12.696180] [INFO ] [MAIN ] TSI: Loaded 8063 primary data records. [2025-09-25T22:28:12.816634] [DEBUG] [LOCAL ] TS: Derivative data saved (1807 records). [2025-09-25T22:28:12.823338] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-25T22:28:12.817981] [DEBUG] [LOCAL ] TSE: Derivative data saved (1807 records). [2025-09-25T22:28:12.832972] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-25T22:28:12.832843] [INFO ] [MAIN ] Derivative Progress: 1820/2043 symbols completed. TS took 1.4s. Estimated remaining: 1m 34s. Rate: 143.0 symbols/min [2025-09-25T22:28:12.868787] [INFO ] [MAIN ] Derivative Progress: 1821/2043 symbols completed. TSE took 1.3s. Estimated remaining: 1m 33s. Rate: 143.0 symbols/min [2025-09-25T22:28:12.868931] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:12.874948] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:13.182107] [DEBUG] [LOCAL ] TSLX: Loaded 35517 existing records from primary storage. [2025-09-25T22:28:13.182468] [INFO ] [MAIN ] TSLX: Loaded 35517 primary data records. [2025-09-25T22:28:13.361020] [DEBUG] [LOCAL ] TSM: Loaded 54209 existing records from primary storage. [2025-09-25T22:28:13.429976] [INFO ] [MAIN ] TSM: Loaded 54209 primary data records. [2025-09-25T22:28:13.436879] [DEBUG] [MAIN ] TSI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:13.576811] [INFO ] [MAIN ] TSI: Generated 1807 derivative records from 8063 primary records. [2025-09-25T22:28:13.612201] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-25T22:28:13.717352] [DEBUG] [LOCAL ] TSI: Derivative data saved (1807 records). [2025-09-25T22:28:13.735073] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-25T22:28:13.755986] [INFO ] [MAIN ] Derivative Progress: 1822/2043 symbols completed. TSI took 1.1s. Estimated remaining: 1m 33s. Rate: 142.9 symbols/min [2025-09-25T22:28:13.798293] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:13.983758] [DEBUG] [MAIN ] TSLX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:13.985317] [INFO ] [MAIN ] TSLX: Generated 1807 derivative records from 35517 primary records. [2025-09-25T22:28:13.985604] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-25T22:28:14.007403] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1807 records). [2025-09-25T22:28:14.007837] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-25T22:28:14.011000] [INFO ] [MAIN ] Derivative Progress: 1823/2043 symbols completed. TSLX took 1.2s. Estimated remaining: 1m 32s. Rate: 143.0 symbols/min [2025-09-25T22:28:14.012360] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:14.063213] [DEBUG] [MAIN ] TSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:14.064479] [INFO ] [MAIN ] TSM: Generated 1807 derivative records from 54209 primary records. [2025-09-25T22:28:14.064731] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-25T22:28:14.124990] [DEBUG] [LOCAL ] TSN: Loaded 53256 existing records from primary storage. [2025-09-25T22:28:14.136671] [INFO ] [MAIN ] TSN: Loaded 53256 primary data records. [2025-09-25T22:28:14.137119] [DEBUG] [LOCAL ] TSM: Derivative data saved (1807 records). [2025-09-25T22:28:14.134616] [DEBUG] [LOCAL ] TSQ: Loaded 12165 existing records from primary storage. [2025-09-25T22:28:14.142573] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-25T22:28:14.171427] [INFO ] [MAIN ] TSQ: Loaded 12165 primary data records. [2025-09-25T22:28:14.174743] [INFO ] [MAIN ] Derivative Progress: 1824/2043 symbols completed. TSM took 1.3s. Estimated remaining: 1m 32s. Rate: 143.0 symbols/min [2025-09-25T22:28:14.301891] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:15.003155] [DEBUG] [LOCAL ] TT: Loaded 48171 existing records from primary storage. [2025-09-25T22:28:15.004070] [INFO ] [MAIN ] TT: Loaded 48171 primary data records. [2025-09-25T22:28:15.100132] [DEBUG] [MAIN ] TSQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:15.124526] [INFO ] [MAIN ] TSQ: Generated 1807 derivative records from 12165 primary records. [2025-09-25T22:28:15.158363] [DEBUG] [MAIN ] TSN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:15.158671] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-25T22:28:15.160618] [INFO ] [MAIN ] TSN: Generated 1807 derivative records from 53256 primary records. [2025-09-25T22:28:15.176587] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-25T22:28:15.272905] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1807 records). [2025-09-25T22:28:15.400756] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-25T22:28:15.404464] [INFO ] [MAIN ] Derivative Progress: 1825/2043 symbols completed. TSQ took 1.4s. Estimated remaining: 1m 32s. Rate: 142.9 symbols/min [2025-09-25T22:28:15.406003] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:15.405785] [DEBUG] [LOCAL ] TSN: Derivative data saved (1807 records). [2025-09-25T22:28:15.406217] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-25T22:28:15.410604] [INFO ] [MAIN ] Derivative Progress: 1826/2043 symbols completed. TSN took 1.6s. Estimated remaining: 1m 31s. Rate: 142.9 symbols/min [2025-09-25T22:28:15.411366] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:15.473847] [DEBUG] [MAIN ] TT: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:28:15.474831] [INFO ] [MAIN ] TT: Generated 1806 derivative records from 48171 primary records. [2025-09-25T22:28:15.474987] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-25T22:28:15.506592] [DEBUG] [LOCAL ] TT: Derivative data saved (1806 records). [2025-09-25T22:28:15.519580] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-25T22:28:15.522831] [INFO ] [MAIN ] Derivative Progress: 1827/2043 symbols completed. TT took 1.3s. Estimated remaining: 1m 31s. Rate: 143.0 symbols/min [2025-09-25T22:28:15.524777] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:15.524424] [DEBUG] [LOCAL ] TTC: Loaded 42754 existing records from primary storage. [2025-09-25T22:28:15.526014] [INFO ] [MAIN ] TTC: Loaded 42754 primary data records. [2025-09-25T22:28:15.597495] [DEBUG] [LOCAL ] TTE: Loaded 52025 existing records from primary storage. [2025-09-25T22:28:15.629001] [INFO ] [MAIN ] TTE: Loaded 52025 primary data records. [2025-09-25T22:28:16.204131] [DEBUG] [LOCAL ] TTI: Loaded 45740 existing records from primary storage. [2025-09-25T22:28:16.268795] [INFO ] [MAIN ] TTI: Loaded 45740 primary data records. [2025-09-25T22:28:16.637157] [DEBUG] [MAIN ] TTE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:16.652349] [INFO ] [MAIN ] TTE: Generated 1807 derivative records from 52025 primary records. [2025-09-25T22:28:16.651351] [DEBUG] [MAIN ] TTC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:16.653778] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-25T22:28:16.653705] [INFO ] [MAIN ] TTC: Generated 1807 derivative records from 42754 primary records. [2025-09-25T22:28:16.654834] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-25T22:28:16.688912] [DEBUG] [LOCAL ] TTE: Derivative data saved (1807 records). [2025-09-25T22:28:16.690203] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-25T22:28:16.690267] [DEBUG] [LOCAL ] TTC: Derivative data saved (1807 records). [2025-09-25T22:28:16.693434] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-25T22:28:16.693239] [INFO ] [MAIN ] Derivative Progress: 1828/2043 symbols completed. TTE took 1.3s. Estimated remaining: 1m 30s. Rate: 142.9 symbols/min [2025-09-25T22:28:16.696055] [INFO ] [MAIN ] Derivative Progress: 1829/2043 symbols completed. TTC took 1.3s. Estimated remaining: 1m 30s. Rate: 142.9 symbols/min [2025-09-25T22:28:16.713228] [DEBUG] [MAIN ] TTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:16.714026] [INFO ] [MAIN ] TTI: Generated 1807 derivative records from 45740 primary records. [2025-09-25T22:28:16.714095] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-25T22:28:16.730160] [DEBUG] [LOCAL ] TTI: Derivative data saved (1807 records). [2025-09-25T22:28:16.730273] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-25T22:28:16.733925] [INFO ] [MAIN ] Derivative Progress: 1830/2043 symbols completed. TTI took 1.2s. Estimated remaining: 1m 29s. Rate: 143.0 symbols/min [2025-09-25T22:28:16.734624] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:16.734914] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:16.734794] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:16.816933] [DEBUG] [LOCAL ] TV: Loaded 43277 existing records from primary storage. [2025-09-25T22:28:16.817248] [INFO ] [MAIN ] TV: Loaded 43277 primary data records. [2025-09-25T22:28:16.818154] [DEBUG] [LOCAL ] TUYA: Loaded 46865 existing records from primary storage. [2025-09-25T22:28:16.823558] [INFO ] [MAIN ] TUYA: Loaded 46865 primary data records. [2025-09-25T22:28:17.030070] [DEBUG] [LOCAL ] TU: Loaded 50254 existing records from primary storage. [2025-09-25T22:28:17.044586] [INFO ] [MAIN ] TU: Loaded 50254 primary data records. [2025-09-25T22:28:17.966563] [DEBUG] [MAIN ] TV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:17.967853] [INFO ] [MAIN ] TV: Generated 1807 derivative records from 43277 primary records. [2025-09-25T22:28:17.968189] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-25T22:28:17.982507] [DEBUG] [MAIN ] TUYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:17.983823] [INFO ] [MAIN ] TUYA: Generated 1807 derivative records from 46865 primary records. [2025-09-25T22:28:17.984353] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-25T22:28:18.021313] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1807 records). [2025-09-25T22:28:18.019988] [DEBUG] [LOCAL ] TV: Derivative data saved (1807 records). [2025-09-25T22:28:18.034378] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-25T22:28:18.038053] [DEBUG] [MAIN ] TU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:18.034596] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-25T22:28:18.037394] [INFO ] [MAIN ] Derivative Progress: 1831/2043 symbols completed. TV took 1.3s. Estimated remaining: 1m 29s. Rate: 142.8 symbols/min [2025-09-25T22:28:18.040681] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:18.040756] [INFO ] [MAIN ] Derivative Progress: 1832/2043 symbols completed. TUYA took 1.3s. Estimated remaining: 1m 29s. Rate: 142.9 symbols/min [2025-09-25T22:28:18.042222] [INFO ] [MAIN ] TU: Generated 1807 derivative records from 50254 primary records. [2025-09-25T22:28:18.042409] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:18.042662] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-25T22:28:18.062021] [DEBUG] [LOCAL ] TU: Derivative data saved (1807 records). [2025-09-25T22:28:18.062423] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-25T22:28:18.067012] [DEBUG] [LOCAL ] TVC: Loaded 3455 existing records from primary storage. [2025-09-25T22:28:18.070876] [INFO ] [MAIN ] Derivative Progress: 1833/2043 symbols completed. TU took 1.3s. Estimated remaining: 1m 28s. Rate: 143.0 symbols/min [2025-09-25T22:28:18.071322] [DEBUG] [LOCAL ] TVE: Loaded 2786 existing records from primary storage. [2025-09-25T22:28:18.071034] [INFO ] [MAIN ] TVC: Loaded 3455 primary data records. [2025-09-25T22:28:18.071846] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:18.071563] [INFO ] [MAIN ] TVE: Loaded 2786 primary data records. [2025-09-25T22:28:18.750962] [DEBUG] [LOCAL ] TWI: Loaded 34766 existing records from primary storage. [2025-09-25T22:28:18.752671] [INFO ] [MAIN ] TWI: Loaded 34766 primary data records. [2025-09-25T22:28:19.126589] [DEBUG] [MAIN ] TVC: Filtered 6966 bins outside market hours, 7762 incomplete bins [2025-09-25T22:28:19.127437] [DEBUG] [MAIN ] TVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:19.128621] [INFO ] [MAIN ] TVC: Generated 1804 derivative records from 3455 primary records. [2025-09-25T22:28:19.130278] [INFO ] [MAIN ] TVE: Generated 1807 derivative records from 2786 primary records. [2025-09-25T22:28:19.131089] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-25T22:28:19.131676] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-25T22:28:19.163050] [DEBUG] [LOCAL ] TVE: Derivative data saved (1807 records). [2025-09-25T22:28:19.165236] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-25T22:28:19.169140] [INFO ] [MAIN ] Derivative Progress: 1834/2043 symbols completed. TVE took 1.1s. Estimated remaining: 1m 28s. Rate: 142.9 symbols/min [2025-09-25T22:28:19.172061] [DEBUG] [LOCAL ] TVC: Derivative data saved (1804 records). [2025-09-25T22:28:19.172284] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:19.172601] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-25T22:28:19.176342] [INFO ] [MAIN ] Derivative Progress: 1835/2043 symbols completed. TVC took 1.1s. Estimated remaining: 1m 27s. Rate: 142.9 symbols/min [2025-09-25T22:28:19.177835] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:19.196063] [DEBUG] [MAIN ] TWI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:19.200141] [INFO ] [MAIN ] TWI: Generated 1807 derivative records from 34766 primary records. [2025-09-25T22:28:19.200675] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-25T22:28:19.200430] [DEBUG] [LOCAL ] TWN: Loaded 3228 existing records from primary storage. [2025-09-25T22:28:19.201297] [INFO ] [MAIN ] TWN: Loaded 3228 primary data records. [2025-09-25T22:28:19.271983] [DEBUG] [LOCAL ] TWI: Derivative data saved (1807 records). [2025-09-25T22:28:19.278084] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-25T22:28:19.286268] [INFO ] [MAIN ] Derivative Progress: 1836/2043 symbols completed. TWI took 1.2s. Estimated remaining: 1m 27s. Rate: 143.0 symbols/min [2025-09-25T22:28:19.310470] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:19.580478] [DEBUG] [LOCAL ] TWLO: Loaded 53111 existing records from primary storage. [2025-09-25T22:28:19.594881] [INFO ] [MAIN ] TWLO: Loaded 53111 primary data records. [2025-09-25T22:28:19.839589] [DEBUG] [LOCAL ] TWO: Loaded 48681 existing records from primary storage. [2025-09-25T22:28:19.840580] [INFO ] [MAIN ] TWO: Loaded 48681 primary data records. [2025-09-25T22:28:20.211096] [DEBUG] [MAIN ] TWN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:20.218077] [INFO ] [MAIN ] TWN: Generated 1807 derivative records from 3228 primary records. [2025-09-25T22:28:20.231517] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-25T22:28:20.427615] [DEBUG] [LOCAL ] TWN: Derivative data saved (1807 records). [2025-09-25T22:28:20.428334] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-25T22:28:20.431709] [INFO ] [MAIN ] Derivative Progress: 1837/2043 symbols completed. TWN took 1.3s. Estimated remaining: 1m 27s. Rate: 142.9 symbols/min [2025-09-25T22:28:20.432684] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:20.455534] [DEBUG] [MAIN ] TWLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:20.456441] [INFO ] [MAIN ] TWLO: Generated 1807 derivative records from 53111 primary records. [2025-09-25T22:28:20.457104] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-25T22:28:20.491332] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1807 records). [2025-09-25T22:28:20.491744] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-25T22:28:20.495491] [INFO ] [MAIN ] Derivative Progress: 1838/2043 symbols completed. TWLO took 1.3s. Estimated remaining: 1m 26s. Rate: 142.9 symbols/min [2025-09-25T22:28:20.496926] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:20.496808] [DEBUG] [LOCAL ] TX: Loaded 23787 existing records from primary storage. [2025-09-25T22:28:20.497340] [INFO ] [MAIN ] TX: Loaded 23787 primary data records. [2025-09-25T22:28:20.565542] [DEBUG] [MAIN ] TWO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:20.595986] [INFO ] [MAIN ] TWO: Generated 1807 derivative records from 48681 primary records. [2025-09-25T22:28:20.622143] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-25T22:28:20.747818] [DEBUG] [LOCAL ] TWO: Derivative data saved (1807 records). [2025-09-25T22:28:20.869407] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-25T22:28:20.872970] [INFO ] [MAIN ] Derivative Progress: 1839/2043 symbols completed. TWO took 1.6s. Estimated remaining: 1m 26s. Rate: 142.9 symbols/min [2025-09-25T22:28:20.874348] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:20.890418] [DEBUG] [LOCAL ] TXNM: Loaded 44153 existing records from primary storage. [2025-09-25T22:28:20.891919] [INFO ] [MAIN ] TXNM: Loaded 44153 primary data records. [2025-09-25T22:28:21.047796] [DEBUG] [LOCAL ] TXO: Loaded 18913 existing records from primary storage. [2025-09-25T22:28:21.063322] [INFO ] [MAIN ] TXO: Loaded 18913 primary data records. [2025-09-25T22:28:21.430632] [DEBUG] [MAIN ] TX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:21.456993] [INFO ] [MAIN ] TX: Generated 1807 derivative records from 23787 primary records. [2025-09-25T22:28:21.573210] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-25T22:28:21.605540] [DEBUG] [LOCAL ] TX: Derivative data saved (1807 records). [2025-09-25T22:28:21.606387] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-25T22:28:21.609566] [INFO ] [MAIN ] Derivative Progress: 1840/2043 symbols completed. TX took 1.2s. Estimated remaining: 1m 25s. Rate: 142.9 symbols/min [2025-09-25T22:28:21.610322] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:21.632068] [DEBUG] [MAIN ] TXNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:21.633168] [INFO ] [MAIN ] TXNM: Generated 1807 derivative records from 44153 primary records. [2025-09-25T22:28:21.633406] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-25T22:28:21.653665] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1807 records). [2025-09-25T22:28:21.655908] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-25T22:28:21.658857] [INFO ] [MAIN ] Derivative Progress: 1841/2043 symbols completed. TXNM took 1.2s. Estimated remaining: 1m 25s. Rate: 143.0 symbols/min [2025-09-25T22:28:21.659283] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:21.673753] [DEBUG] [MAIN ] TXO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:21.674601] [INFO ] [MAIN ] TXO: Generated 1807 derivative records from 18913 primary records. [2025-09-25T22:28:21.674869] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-25T22:28:21.714044] [DEBUG] [LOCAL ] TY: Loaded 7718 existing records from primary storage. [2025-09-25T22:28:21.715668] [INFO ] [MAIN ] TY: Loaded 7718 primary data records. [2025-09-25T22:28:21.715516] [DEBUG] [LOCAL ] TXO: Derivative data saved (1807 records). [2025-09-25T22:28:21.716077] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-25T22:28:21.719977] [INFO ] [MAIN ] Derivative Progress: 1842/2043 symbols completed. TXO took 0.8s. Estimated remaining: 1m 24s. Rate: 143.0 symbols/min [2025-09-25T22:28:21.731667] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:21.827987] [DEBUG] [LOCAL ] TXT: Loaded 50103 existing records from primary storage. [2025-09-25T22:28:21.849976] [INFO ] [MAIN ] TXT: Loaded 50103 primary data records. [2025-09-25T22:28:21.909294] [DEBUG] [LOCAL ] TYG: Loaded 14343 existing records from primary storage. [2025-09-25T22:28:21.944508] [INFO ] [MAIN ] TYG: Loaded 14343 primary data records. [2025-09-25T22:28:22.842733] [DEBUG] [MAIN ] TY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:22.845523] [INFO ] [MAIN ] TY: Generated 1807 derivative records from 7718 primary records. [2025-09-25T22:28:22.847887] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-25T22:28:22.892086] [DEBUG] [MAIN ] TYG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:22.893529] [INFO ] [MAIN ] TYG: Generated 1807 derivative records from 14343 primary records. [2025-09-25T22:28:22.891365] [DEBUG] [MAIN ] TXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:22.894118] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-25T22:28:22.894828] [INFO ] [MAIN ] TXT: Generated 1807 derivative records from 50103 primary records. [2025-09-25T22:28:22.898518] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-25T22:28:22.897954] [DEBUG] [LOCAL ] TY: Derivative data saved (1807 records). [2025-09-25T22:28:22.899700] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-25T22:28:22.902622] [INFO ] [MAIN ] Derivative Progress: 1843/2043 symbols completed. TY took 1.2s. Estimated remaining: 1m 24s. Rate: 142.9 symbols/min [2025-09-25T22:28:22.932590] [DEBUG] [LOCAL ] TYG: Derivative data saved (1807 records). [2025-09-25T22:28:22.933140] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-25T22:28:22.936308] [INFO ] [MAIN ] Derivative Progress: 1844/2043 symbols completed. TYG took 1.2s. Estimated remaining: 1m 24s. Rate: 142.9 symbols/min [2025-09-25T22:28:22.936854] [DEBUG] [LOCAL ] TXT: Derivative data saved (1807 records). [2025-09-25T22:28:22.936992] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-25T22:28:22.939708] [INFO ] [MAIN ] Derivative Progress: 1845/2043 symbols completed. TXT took 1.3s. Estimated remaining: 1m 23s. Rate: 143.0 symbols/min [2025-09-25T22:28:22.940197] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:22.940404] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:22.940519] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:22.968953] [DEBUG] [LOCAL ] TYL: Loaded 22453 existing records from primary storage. [2025-09-25T22:28:22.969160] [INFO ] [MAIN ] TYL: Loaded 22453 primary data records. [2025-09-25T22:28:23.228324] [DEBUG] [LOCAL ] UA: Loaded 50812 existing records from primary storage. [2025-09-25T22:28:23.228917] [INFO ] [MAIN ] UA: Loaded 50812 primary data records. [2025-09-25T22:28:23.338802] [DEBUG] [LOCAL ] U: Loaded 54189 existing records from primary storage. [2025-09-25T22:28:23.361694] [INFO ] [MAIN ] U: Loaded 54189 primary data records. [2025-09-25T22:28:24.064323] [DEBUG] [MAIN ] TYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:24.065590] [INFO ] [MAIN ] TYL: Generated 1807 derivative records from 22453 primary records. [2025-09-25T22:28:24.065884] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-25T22:28:24.084225] [DEBUG] [LOCAL ] TYL: Derivative data saved (1807 records). [2025-09-25T22:28:24.084917] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-25T22:28:24.087574] [INFO ] [MAIN ] Derivative Progress: 1846/2043 symbols completed. TYL took 1.1s. Estimated remaining: 1m 23s. Rate: 142.9 symbols/min [2025-09-25T22:28:24.088846] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:24.122617] [DEBUG] [MAIN ] UA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:24.124034] [INFO ] [MAIN ] UA: Generated 1807 derivative records from 50812 primary records. [2025-09-25T22:28:24.124122] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-25T22:28:24.124420] [DEBUG] [MAIN ] U: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:24.126063] [INFO ] [MAIN ] U: Generated 1807 derivative records from 54189 primary records. [2025-09-25T22:28:24.126358] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-25T22:28:24.161613] [DEBUG] [LOCAL ] UA: Derivative data saved (1807 records). [2025-09-25T22:28:24.161122] [DEBUG] [LOCAL ] U: Derivative data saved (1807 records). [2025-09-25T22:28:24.161834] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-25T22:28:24.164174] [INFO ] [MAIN ] Derivative Progress: 1847/2043 symbols completed. U took 1.2s. Estimated remaining: 1m 22s. Rate: 143.0 symbols/min [2025-09-25T22:28:24.164752] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:24.164849] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-25T22:28:24.168876] [INFO ] [MAIN ] Derivative Progress: 1848/2043 symbols completed. UA took 1.2s. Estimated remaining: 1m 22s. Rate: 143.0 symbols/min [2025-09-25T22:28:24.169550] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:24.192597] [DEBUG] [LOCAL ] UAN: Loaded 5475 existing records from primary storage. [2025-09-25T22:28:24.192843] [INFO ] [MAIN ] UAN: Loaded 5475 primary data records. [2025-09-25T22:28:24.329009] [DEBUG] [LOCAL ] UAA: Loaded 53899 existing records from primary storage. [2025-09-25T22:28:24.329542] [INFO ] [MAIN ] UAA: Loaded 53899 primary data records. [2025-09-25T22:28:24.720539] [DEBUG] [LOCAL ] UBER: Loaded 54196 existing records from primary storage. [2025-09-25T22:28:24.732666] [INFO ] [MAIN ] UBER: Loaded 54196 primary data records. [2025-09-25T22:28:25.296710] [DEBUG] [MAIN ] UAN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:25.298324] [INFO ] [MAIN ] UAN: Generated 1807 derivative records from 5475 primary records. [2025-09-25T22:28:25.298434] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-25T22:28:25.318262] [DEBUG] [LOCAL ] UAN: Derivative data saved (1807 records). [2025-09-25T22:28:25.320819] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-25T22:28:25.323328] [INFO ] [MAIN ] Derivative Progress: 1849/2043 symbols completed. UAN took 1.2s. Estimated remaining: 1m 21s. Rate: 142.9 symbols/min [2025-09-25T22:28:25.324710] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:25.339754] [DEBUG] [MAIN ] UAA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:25.340910] [INFO ] [MAIN ] UAA: Generated 1807 derivative records from 53899 primary records. [2025-09-25T22:28:25.341213] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-25T22:28:25.364826] [DEBUG] [LOCAL ] UAA: Derivative data saved (1807 records). [2025-09-25T22:28:25.377625] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-25T22:28:25.380724] [INFO ] [MAIN ] Derivative Progress: 1850/2043 symbols completed. UAA took 1.3s. Estimated remaining: 1m 21s. Rate: 143.0 symbols/min [2025-09-25T22:28:25.381382] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:25.381745] [DEBUG] [MAIN ] UBER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:25.383070] [INFO ] [MAIN ] UBER: Generated 1807 derivative records from 54196 primary records. [2025-09-25T22:28:25.384826] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-25T22:28:25.403410] [DEBUG] [LOCAL ] UBER: Derivative data saved (1807 records). [2025-09-25T22:28:25.403566] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-25T22:28:25.406444] [INFO ] [MAIN ] Derivative Progress: 1851/2043 symbols completed. UBER took 1.2s. Estimated remaining: 1m 21s. Rate: 143.0 symbols/min [2025-09-25T22:28:25.406890] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:25.470324] [DEBUG] [LOCAL ] UCB: Loaded 38325 existing records from primary storage. [2025-09-25T22:28:25.471770] [DEBUG] [LOCAL ] UBS: Loaded 52821 existing records from primary storage. [2025-09-25T22:28:25.472326] [INFO ] [MAIN ] UBS: Loaded 52821 primary data records. [2025-09-25T22:28:25.472225] [INFO ] [MAIN ] UCB: Loaded 38325 primary data records. [2025-09-25T22:28:25.939406] [DEBUG] [LOCAL ] UDR: Loaded 52177 existing records from primary storage. [2025-09-25T22:28:26.148968] [INFO ] [MAIN ] UDR: Loaded 52177 primary data records. [2025-09-25T22:28:26.602374] [DEBUG] [MAIN ] UCB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:26.610440] [INFO ] [MAIN ] UCB: Generated 1807 derivative records from 38325 primary records. [2025-09-25T22:28:26.610607] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-25T22:28:26.609298] [DEBUG] [MAIN ] UBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:26.613504] [INFO ] [MAIN ] UBS: Generated 1807 derivative records from 52821 primary records. [2025-09-25T22:28:26.626998] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-25T22:28:26.641338] [DEBUG] [LOCAL ] UCB: Derivative data saved (1807 records). [2025-09-25T22:28:26.648785] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-25T22:28:26.652804] [INFO ] [MAIN ] Derivative Progress: 1852/2043 symbols completed. UCB took 1.3s. Estimated remaining: 1m 20s. Rate: 142.9 symbols/min [2025-09-25T22:28:26.653848] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:26.654135] [DEBUG] [LOCAL ] UBS: Derivative data saved (1807 records). [2025-09-25T22:28:26.654372] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-25T22:28:26.657814] [INFO ] [MAIN ] Derivative Progress: 1853/2043 symbols completed. UBS took 1.3s. Estimated remaining: 1m 20s. Rate: 143.0 symbols/min [2025-09-25T22:28:26.658681] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:26.682041] [DEBUG] [MAIN ] UDR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:26.683104] [INFO ] [MAIN ] UDR: Generated 1807 derivative records from 52177 primary records. [2025-09-25T22:28:26.683262] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-25T22:28:26.687959] [DEBUG] [LOCAL ] UFI: Loaded 8169 existing records from primary storage. [2025-09-25T22:28:26.688454] [INFO ] [MAIN ] UFI: Loaded 8169 primary data records. [2025-09-25T22:28:26.844994] [DEBUG] [LOCAL ] UDR: Derivative data saved (1807 records). [2025-09-25T22:28:26.861877] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-25T22:28:26.871984] [INFO ] [MAIN ] Derivative Progress: 1854/2043 symbols completed. UDR took 1.5s. Estimated remaining: 1m 19s. Rate: 143.0 symbols/min [2025-09-25T22:28:26.937821] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:26.930758] [DEBUG] [LOCAL ] UE: Loaded 43255 existing records from primary storage. [2025-09-25T22:28:26.938188] [INFO ] [MAIN ] UE: Loaded 43255 primary data records. [2025-09-25T22:28:27.449413] [DEBUG] [MAIN ] UFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:27.452587] [INFO ] [MAIN ] UFI: Generated 1807 derivative records from 8169 primary records. [2025-09-25T22:28:27.452963] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-25T22:28:27.455175] [DEBUG] [LOCAL ] UGI: Loaded 50914 existing records from primary storage. [2025-09-25T22:28:27.462329] [INFO ] [MAIN ] UGI: Loaded 50914 primary data records. [2025-09-25T22:28:27.511001] [DEBUG] [LOCAL ] UFI: Derivative data saved (1807 records). [2025-09-25T22:28:27.522358] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-25T22:28:27.556218] [INFO ] [MAIN ] Derivative Progress: 1855/2043 symbols completed. UFI took 0.9s. Estimated remaining: 1m 19s. Rate: 142.9 symbols/min [2025-09-25T22:28:27.598851] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:27.828060] [DEBUG] [MAIN ] UE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:27.829202] [INFO ] [MAIN ] UE: Generated 1807 derivative records from 43255 primary records. [2025-09-25T22:28:27.829447] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-25T22:28:27.851432] [DEBUG] [LOCAL ] UE: Derivative data saved (1807 records). [2025-09-25T22:28:27.851845] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-25T22:28:27.854768] [INFO ] [MAIN ] Derivative Progress: 1856/2043 symbols completed. UE took 1.2s. Estimated remaining: 1m 18s. Rate: 143.0 symbols/min [2025-09-25T22:28:27.855765] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:27.895779] [DEBUG] [LOCAL ] UGP: Loaded 42992 existing records from primary storage. [2025-09-25T22:28:27.896142] [INFO ] [MAIN ] UGP: Loaded 42992 primary data records. [2025-09-25T22:28:27.963911] [DEBUG] [MAIN ] UGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:28.001249] [DEBUG] [LOCAL ] UHAL: Loaded 16671 existing records from primary storage. [2025-09-25T22:28:28.000828] [INFO ] [MAIN ] UGI: Generated 1807 derivative records from 50914 primary records. [2025-09-25T22:28:28.011870] [INFO ] [MAIN ] UHAL: Loaded 16671 primary data records. [2025-09-25T22:28:28.027940] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-25T22:28:28.270075] [DEBUG] [LOCAL ] UGI: Derivative data saved (1807 records). [2025-09-25T22:28:28.402176] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-25T22:28:28.446398] [INFO ] [MAIN ] Derivative Progress: 1857/2043 symbols completed. UGI took 1.6s. Estimated remaining: 1m 18s. Rate: 142.9 symbols/min [2025-09-25T22:28:28.491000] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:28.706618] [DEBUG] [MAIN ] UGP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:28.707532] [INFO ] [MAIN ] UGP: Generated 1807 derivative records from 42992 primary records. [2025-09-25T22:28:28.707769] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-25T22:28:28.737696] [DEBUG] [LOCAL ] UGP: Derivative data saved (1807 records). [2025-09-25T22:28:28.738091] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-25T22:28:28.740622] [INFO ] [MAIN ] Derivative Progress: 1858/2043 symbols completed. UGP took 1.1s. Estimated remaining: 1m 18s. Rate: 143.0 symbols/min [2025-09-25T22:28:28.754535] [DEBUG] [MAIN ] UHAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:28.755359] [INFO ] [MAIN ] UHAL: Generated 1807 derivative records from 16671 primary records. [2025-09-25T22:28:28.756097] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-25T22:28:28.781973] [DEBUG] [LOCAL ] UHS: Loaded 41433 existing records from primary storage. [2025-09-25T22:28:28.785359] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1807 records). [2025-09-25T22:28:28.784811] [INFO ] [MAIN ] UHS: Loaded 41433 primary data records. [2025-09-25T22:28:28.785574] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-25T22:28:28.822483] [INFO ] [MAIN ] Derivative Progress: 1859/2043 symbols completed. UHAL took 1.0s. Estimated remaining: 1m 17s. Rate: 143.0 symbols/min [2025-09-25T22:28:29.125595] [DEBUG] [MAIN ] UHS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:29.126441] [INFO ] [MAIN ] UHS: Generated 1807 derivative records from 41433 primary records. [2025-09-25T22:28:29.126532] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-25T22:28:29.142676] [DEBUG] [LOCAL ] UHS: Derivative data saved (1807 records). [2025-09-25T22:28:29.142811] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-25T22:28:29.145259] [INFO ] [MAIN ] Derivative Progress: 1860/2043 symbols completed. UHS took 0.7s. Estimated remaining: 1m 17s. Rate: 143.0 symbols/min [2025-09-25T22:28:29.146514] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:29.146899] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:29.146708] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:29.165369] [DEBUG] [LOCAL ] UHT: Loaded 10040 existing records from primary storage. [2025-09-25T22:28:29.171223] [INFO ] [MAIN ] UHT: Loaded 10040 primary data records. [2025-09-25T22:28:29.171562] [DEBUG] [LOCAL ] UI: Loaded 12905 existing records from primary storage. [2025-09-25T22:28:29.234362] [INFO ] [MAIN ] UI: Loaded 12905 primary data records. [2025-09-25T22:28:29.394509] [DEBUG] [LOCAL ] UIS: Loaded 37319 existing records from primary storage. [2025-09-25T22:28:29.428586] [INFO ] [MAIN ] UIS: Loaded 37319 primary data records. [2025-09-25T22:28:30.225950] [DEBUG] [MAIN ] UHT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:30.225498] [DEBUG] [MAIN ] UI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:30.226899] [INFO ] [MAIN ] UHT: Generated 1807 derivative records from 10040 primary records. [2025-09-25T22:28:30.227749] [INFO ] [MAIN ] UI: Generated 1807 derivative records from 12905 primary records. [2025-09-25T22:28:30.228058] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-25T22:28:30.228123] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-25T22:28:30.258267] [DEBUG] [LOCAL ] UHT: Derivative data saved (1807 records). [2025-09-25T22:28:30.262297] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-25T22:28:30.264837] [INFO ] [MAIN ] Derivative Progress: 1861/2043 symbols completed. UHT took 1.1s. Estimated remaining: 1m 16s. Rate: 142.9 symbols/min [2025-09-25T22:28:30.262035] [DEBUG] [LOCAL ] UI: Derivative data saved (1807 records). [2025-09-25T22:28:30.266292] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-25T22:28:30.270748] [INFO ] [MAIN ] Derivative Progress: 1862/2043 symbols completed. UI took 1.1s. Estimated remaining: 1m 16s. Rate: 143.0 symbols/min [2025-09-25T22:28:30.270878] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:30.271552] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:30.287117] [DEBUG] [MAIN ] UIS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:30.288121] [INFO ] [MAIN ] UIS: Generated 1807 derivative records from 37319 primary records. [2025-09-25T22:28:30.288354] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-25T22:28:30.307236] [DEBUG] [LOCAL ] UIS: Derivative data saved (1807 records). [2025-09-25T22:28:30.307541] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-25T22:28:30.310890] [INFO ] [MAIN ] Derivative Progress: 1863/2043 symbols completed. UIS took 1.2s. Estimated remaining: 1m 15s. Rate: 143.1 symbols/min [2025-09-25T22:28:30.311570] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:30.390256] [DEBUG] [LOCAL ] UL: Loaded 53455 existing records from primary storage. [2025-09-25T22:28:30.390622] [INFO ] [MAIN ] UL: Loaded 53455 primary data records. [2025-09-25T22:28:30.436851] [DEBUG] [LOCAL ] ULS: Loaded 39538 existing records from primary storage. [2025-09-25T22:28:30.475886] [INFO ] [MAIN ] ULS: Loaded 39538 primary data records. [2025-09-25T22:28:30.742129] [DEBUG] [LOCAL ] UMC: Loaded 53104 existing records from primary storage. [2025-09-25T22:28:30.742507] [INFO ] [MAIN ] UMC: Loaded 53104 primary data records. [2025-09-25T22:28:31.513814] [DEBUG] [MAIN ] UL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:31.514886] [INFO ] [MAIN ] UL: Generated 1807 derivative records from 53455 primary records. [2025-09-25T22:28:31.516246] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-25T22:28:31.554321] [DEBUG] [LOCAL ] UL: Derivative data saved (1807 records). [2025-09-25T22:28:31.554808] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-25T22:28:31.558279] [INFO ] [MAIN ] Derivative Progress: 1864/2043 symbols completed. UL took 1.3s. Estimated remaining: 1m 15s. Rate: 142.9 symbols/min [2025-09-25T22:28:31.559096] [DEBUG] [MAIN ] ULS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:31.560105] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:31.561323] [INFO ] [MAIN ] ULS: Generated 1807 derivative records from 39538 primary records. [2025-09-25T22:28:31.565524] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-25T22:28:31.598418] [DEBUG] [LOCAL ] ULS: Derivative data saved (1807 records). [2025-09-25T22:28:31.598858] [DEBUG] [MAIN ] UMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:31.599210] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-25T22:28:31.603204] [INFO ] [MAIN ] UMC: Generated 1807 derivative records from 53104 primary records. [2025-09-25T22:28:31.602253] [INFO ] [MAIN ] Derivative Progress: 1865/2043 symbols completed. ULS took 1.3s. Estimated remaining: 1m 15s. Rate: 143.0 symbols/min [2025-09-25T22:28:31.603380] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-25T22:28:31.604572] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:31.634302] [DEBUG] [LOCAL ] UMC: Derivative data saved (1807 records). [2025-09-25T22:28:31.634482] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-25T22:28:31.638143] [INFO ] [MAIN ] Derivative Progress: 1866/2043 symbols completed. UMC took 1.3s. Estimated remaining: 1m 14s. Rate: 143.0 symbols/min [2025-09-25T22:28:31.638669] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:31.646909] [DEBUG] [LOCAL ] UNF: Loaded 11977 existing records from primary storage. [2025-09-25T22:28:31.647358] [INFO ] [MAIN ] UNF: Loaded 11977 primary data records. [2025-09-25T22:28:31.722991] [DEBUG] [LOCAL ] UMH: Loaded 33809 existing records from primary storage. [2025-09-25T22:28:31.738704] [INFO ] [MAIN ] UMH: Loaded 33809 primary data records. [2025-09-25T22:28:32.197782] [DEBUG] [LOCAL ] UNFI: Loaded 42191 existing records from primary storage. [2025-09-25T22:28:32.218526] [INFO ] [MAIN ] UNFI: Loaded 42191 primary data records. [2025-09-25T22:28:32.757510] [DEBUG] [MAIN ] UNF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:32.760808] [INFO ] [MAIN ] UNF: Generated 1807 derivative records from 11977 primary records. [2025-09-25T22:28:32.761681] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-25T22:28:32.792764] [DEBUG] [MAIN ] UMH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:32.795222] [DEBUG] [LOCAL ] UNF: Derivative data saved (1807 records). [2025-09-25T22:28:32.795529] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-25T22:28:32.798333] [INFO ] [MAIN ] Derivative Progress: 1867/2043 symbols completed. UNF took 1.2s. Estimated remaining: 1m 14s. Rate: 142.9 symbols/min [2025-09-25T22:28:32.799361] [INFO ] [MAIN ] UMH: Generated 1807 derivative records from 33809 primary records. [2025-09-25T22:28:32.799845] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:32.800033] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-25T22:28:32.823938] [DEBUG] [LOCAL ] UMH: Derivative data saved (1807 records). [2025-09-25T22:28:32.824291] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-25T22:28:32.827739] [INFO ] [MAIN ] Derivative Progress: 1868/2043 symbols completed. UMH took 1.3s. Estimated remaining: 1m 13s. Rate: 143.0 symbols/min [2025-09-25T22:28:32.828412] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:32.852428] [DEBUG] [MAIN ] UNFI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:32.853357] [INFO ] [MAIN ] UNFI: Generated 1807 derivative records from 42191 primary records. [2025-09-25T22:28:32.853486] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-25T22:28:32.871187] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1807 records). [2025-09-25T22:28:32.890133] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-25T22:28:32.893633] [INFO ] [MAIN ] Derivative Progress: 1869/2043 symbols completed. UNFI took 1.3s. Estimated remaining: 1m 13s. Rate: 143.0 symbols/min [2025-09-25T22:28:32.895081] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:32.902322] [DEBUG] [LOCAL ] UNMA: Loaded 3611 existing records from primary storage. [2025-09-25T22:28:32.903315] [INFO ] [MAIN ] UNMA: Loaded 3611 primary data records. [2025-09-25T22:28:33.027557] [DEBUG] [LOCAL ] UNH: Loaded 54184 existing records from primary storage. [2025-09-25T22:28:33.060418] [INFO ] [MAIN ] UNH: Loaded 54184 primary data records. [2025-09-25T22:28:33.089745] [DEBUG] [LOCAL ] UNM: Loaded 49045 existing records from primary storage. [2025-09-25T22:28:33.129598] [INFO ] [MAIN ] UNM: Loaded 49045 primary data records. [2025-09-25T22:28:34.010932] [DEBUG] [MAIN ] UNMA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:34.012742] [INFO ] [MAIN ] UNMA: Generated 1807 derivative records from 3611 primary records. [2025-09-25T22:28:34.013018] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-25T22:28:34.032778] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1807 records). [2025-09-25T22:28:34.046316] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-25T22:28:34.049072] [INFO ] [MAIN ] Derivative Progress: 1870/2043 symbols completed. UNMA took 1.2s. Estimated remaining: 1m 13s. Rate: 142.9 symbols/min [2025-09-25T22:28:34.050007] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:34.051421] [DEBUG] [MAIN ] UNH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:34.054576] [INFO ] [MAIN ] UNH: Generated 1807 derivative records from 54184 primary records. [2025-09-25T22:28:34.055228] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-25T22:28:34.086963] [DEBUG] [MAIN ] UNM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:34.088769] [DEBUG] [LOCAL ] UNH: Derivative data saved (1807 records). [2025-09-25T22:28:34.089639] [INFO ] [MAIN ] UNM: Generated 1807 derivative records from 49045 primary records. [2025-09-25T22:28:34.089899] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-25T22:28:34.090002] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-25T22:28:34.094014] [INFO ] [MAIN ] Derivative Progress: 1871/2043 symbols completed. UNH took 1.3s. Estimated remaining: 1m 12s. Rate: 143.0 symbols/min [2025-09-25T22:28:34.103415] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:34.111192] [DEBUG] [LOCAL ] UNM: Derivative data saved (1807 records). [2025-09-25T22:28:34.111682] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-25T22:28:34.115260] [INFO ] [MAIN ] Derivative Progress: 1872/2043 symbols completed. UNM took 1.3s. Estimated remaining: 1m 12s. Rate: 143.1 symbols/min [2025-09-25T22:28:34.116176] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:34.170096] [DEBUG] [LOCAL ] UNP: Loaded 53641 existing records from primary storage. [2025-09-25T22:28:34.170382] [INFO ] [MAIN ] UNP: Loaded 53641 primary data records. [2025-09-25T22:28:34.313007] [DEBUG] [LOCAL ] UP: Loaded 43475 existing records from primary storage. [2025-09-25T22:28:34.334192] [INFO ] [MAIN ] UP: Loaded 43475 primary data records. [2025-09-25T22:28:34.604831] [DEBUG] [LOCAL ] UPS: Loaded 54100 existing records from primary storage. [2025-09-25T22:28:34.628684] [INFO ] [MAIN ] UPS: Loaded 54100 primary data records. [2025-09-25T22:28:35.346685] [DEBUG] [MAIN ] UNP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:35.348035] [INFO ] [MAIN ] UNP: Generated 1807 derivative records from 53641 primary records. [2025-09-25T22:28:35.348298] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-25T22:28:35.380821] [DEBUG] [LOCAL ] UNP: Derivative data saved (1807 records). [2025-09-25T22:28:35.381093] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-25T22:28:35.383494] [INFO ] [MAIN ] Derivative Progress: 1873/2043 symbols completed. UNP took 1.3s. Estimated remaining: 1m 11s. Rate: 142.9 symbols/min [2025-09-25T22:28:35.401766] [DEBUG] [MAIN ] UP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:35.402997] [INFO ] [MAIN ] UP: Generated 1807 derivative records from 43475 primary records. [2025-09-25T22:28:35.403296] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-25T22:28:35.426271] [DEBUG] [LOCAL ] UP: Derivative data saved (1807 records). [2025-09-25T22:28:35.426742] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-25T22:28:35.429749] [INFO ] [MAIN ] Derivative Progress: 1874/2043 symbols completed. UP took 1.3s. Estimated remaining: 1m 11s. Rate: 143.0 symbols/min [2025-09-25T22:28:35.444410] [DEBUG] [MAIN ] UPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:35.445237] [INFO ] [MAIN ] UPS: Generated 1807 derivative records from 54100 primary records. [2025-09-25T22:28:35.445334] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-25T22:28:35.461791] [DEBUG] [LOCAL ] UPS: Derivative data saved (1807 records). [2025-09-25T22:28:35.461903] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-25T22:28:35.465608] [INFO ] [MAIN ] Derivative Progress: 1875/2043 symbols completed. UPS took 1.3s. Estimated remaining: 1m 10s. Rate: 143.0 symbols/min [2025-09-25T22:28:35.467024] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:35.467232] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:35.466782] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:35.497026] [DEBUG] [LOCAL ] USAC: Loaded 22931 existing records from primary storage. [2025-09-25T22:28:35.497327] [INFO ] [MAIN ] USAC: Loaded 22931 primary data records. [2025-09-25T22:28:35.666512] [DEBUG] [LOCAL ] USA: Loaded 36217 existing records from primary storage. [2025-09-25T22:28:35.688171] [DEBUG] [LOCAL ] URI: Loaded 36449 existing records from primary storage. [2025-09-25T22:28:35.741466] [INFO ] [MAIN ] USA: Loaded 36217 primary data records. [2025-09-25T22:28:35.749942] [INFO ] [MAIN ] URI: Loaded 36449 primary data records. [2025-09-25T22:28:36.612012] [DEBUG] [MAIN ] USAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:36.613523] [INFO ] [MAIN ] USAC: Generated 1807 derivative records from 22931 primary records. [2025-09-25T22:28:36.615125] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-25T22:28:36.634928] [DEBUG] [LOCAL ] USAC: Derivative data saved (1807 records). [2025-09-25T22:28:36.635409] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-25T22:28:36.638169] [INFO ] [MAIN ] Derivative Progress: 1876/2043 symbols completed. USAC took 1.2s. Estimated remaining: 1m 10s. Rate: 142.9 symbols/min [2025-09-25T22:28:36.639295] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:36.660573] [DEBUG] [MAIN ] USA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:36.674396] [INFO ] [MAIN ] USA: Generated 1807 derivative records from 36217 primary records. [2025-09-25T22:28:36.673665] [DEBUG] [MAIN ] URI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:36.675252] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-25T22:28:36.675191] [INFO ] [MAIN ] URI: Generated 1807 derivative records from 36449 primary records. [2025-09-25T22:28:36.675360] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-25T22:28:36.708144] [DEBUG] [LOCAL ] USA: Derivative data saved (1807 records). [2025-09-25T22:28:36.708275] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-25T22:28:36.708053] [DEBUG] [LOCAL ] URI: Derivative data saved (1807 records). [2025-09-25T22:28:36.710994] [INFO ] [MAIN ] Derivative Progress: 1877/2043 symbols completed. USA took 1.2s. Estimated remaining: 1m 10s. Rate: 143.0 symbols/min [2025-09-25T22:28:36.711321] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-25T22:28:36.711683] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:36.714794] [INFO ] [MAIN ] Derivative Progress: 1878/2043 symbols completed. URI took 1.2s. Estimated remaining: 1m 9s. Rate: 143.0 symbols/min [2025-09-25T22:28:36.715307] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:36.753130] [DEBUG] [LOCAL ] USNA: Loaded 18261 existing records from primary storage. [2025-09-25T22:28:36.753308] [INFO ] [MAIN ] USNA: Loaded 18261 primary data records. [2025-09-25T22:28:36.904637] [DEBUG] [LOCAL ] USB: Loaded 54078 existing records from primary storage. [2025-09-25T22:28:36.905006] [INFO ] [MAIN ] USB: Loaded 54078 primary data records. [2025-09-25T22:28:37.167856] [DEBUG] [LOCAL ] USFD: Loaded 51583 existing records from primary storage. [2025-09-25T22:28:37.245705] [INFO ] [MAIN ] USFD: Loaded 51583 primary data records. [2025-09-25T22:28:37.926709] [DEBUG] [MAIN ] USNA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:37.928837] [INFO ] [MAIN ] USNA: Generated 1807 derivative records from 18261 primary records. [2025-09-25T22:28:37.929503] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-25T22:28:37.976755] [DEBUG] [LOCAL ] USNA: Derivative data saved (1807 records). [2025-09-25T22:28:37.977890] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-25T22:28:37.977773] [DEBUG] [MAIN ] USB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:37.981395] [INFO ] [MAIN ] Derivative Progress: 1879/2043 symbols completed. USNA took 1.3s. Estimated remaining: 1m 9s. Rate: 142.9 symbols/min [2025-09-25T22:28:37.983130] [INFO ] [MAIN ] USB: Generated 1807 derivative records from 54078 primary records. [2025-09-25T22:28:37.983534] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:37.984097] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-25T22:28:38.010537] [DEBUG] [LOCAL ] USB: Derivative data saved (1807 records). [2025-09-25T22:28:38.010872] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-25T22:28:38.014389] [INFO ] [MAIN ] Derivative Progress: 1880/2043 symbols completed. USB took 1.4s. Estimated remaining: 1m 8s. Rate: 143.0 symbols/min [2025-09-25T22:28:38.015003] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:38.045463] [DEBUG] [LOCAL ] USPH: Loaded 16720 existing records from primary storage. [2025-09-25T22:28:38.046432] [INFO ] [MAIN ] USPH: Loaded 16720 primary data records. [2025-09-25T22:28:38.046334] [DEBUG] [MAIN ] USFD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:38.059710] [INFO ] [MAIN ] USFD: Generated 1807 derivative records from 51583 primary records. [2025-09-25T22:28:38.070169] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-25T22:28:38.188286] [DEBUG] [LOCAL ] USFD: Derivative data saved (1807 records). [2025-09-25T22:28:38.209833] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-25T22:28:38.252324] [INFO ] [MAIN ] Derivative Progress: 1881/2043 symbols completed. USFD took 1.5s. Estimated remaining: 1m 8s. Rate: 143.0 symbols/min [2025-09-25T22:28:38.263026] [DEBUG] [LOCAL ] UTF: Loaded 28971 existing records from primary storage. [2025-09-25T22:28:38.287789] [INFO ] [MAIN ] UTF: Loaded 28971 primary data records. [2025-09-25T22:28:38.293487] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:38.815268] [DEBUG] [LOCAL ] UTI: Loaded 40842 existing records from primary storage. [2025-09-25T22:28:38.821324] [DEBUG] [MAIN ] USPH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:38.821581] [INFO ] [MAIN ] UTI: Loaded 40842 primary data records. [2025-09-25T22:28:38.822795] [INFO ] [MAIN ] USPH: Generated 1807 derivative records from 16720 primary records. [2025-09-25T22:28:38.823049] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-25T22:28:38.981894] [DEBUG] [LOCAL ] USPH: Derivative data saved (1807 records). [2025-09-25T22:28:39.008805] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-25T22:28:39.045203] [INFO ] [MAIN ] Derivative Progress: 1882/2043 symbols completed. USPH took 1.1s. Estimated remaining: 1m 8s. Rate: 142.9 symbols/min [2025-09-25T22:28:39.045901] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:39.186427] [DEBUG] [MAIN ] UTF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:39.188396] [INFO ] [MAIN ] UTF: Generated 1807 derivative records from 28971 primary records. [2025-09-25T22:28:39.188610] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-25T22:28:39.219886] [DEBUG] [LOCAL ] UTL: Loaded 11165 existing records from primary storage. [2025-09-25T22:28:39.221517] [INFO ] [MAIN ] UTL: Loaded 11165 primary data records. [2025-09-25T22:28:39.246690] [DEBUG] [LOCAL ] UTF: Derivative data saved (1807 records). [2025-09-25T22:28:39.272611] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-25T22:28:39.305421] [INFO ] [MAIN ] Derivative Progress: 1883/2043 symbols completed. UTF took 1.3s. Estimated remaining: 1m 7s. Rate: 142.9 symbols/min [2025-09-25T22:28:39.325304] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:39.589133] [DEBUG] [MAIN ] UTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:39.590147] [INFO ] [MAIN ] UTI: Generated 1807 derivative records from 40842 primary records. [2025-09-25T22:28:39.590785] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-25T22:28:39.622023] [DEBUG] [LOCAL ] UTI: Derivative data saved (1807 records). [2025-09-25T22:28:39.623840] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-25T22:28:39.626518] [INFO ] [MAIN ] Derivative Progress: 1884/2043 symbols completed. UTI took 1.3s. Estimated remaining: 1m 7s. Rate: 143.0 symbols/min [2025-09-25T22:28:39.642168] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:39.643533] [DEBUG] [LOCAL ] UTZ: Loaded 45025 existing records from primary storage. [2025-09-25T22:28:39.644710] [INFO ] [MAIN ] UTZ: Loaded 45025 primary data records. [2025-09-25T22:28:39.846552] [DEBUG] [LOCAL ] UVE: Loaded 21997 existing records from primary storage. [2025-09-25T22:28:39.890044] [INFO ] [MAIN ] UVE: Loaded 21997 primary data records. [2025-09-25T22:28:40.186236] [DEBUG] [MAIN ] UTL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:40.198336] [INFO ] [MAIN ] UTL: Generated 1807 derivative records from 11165 primary records. [2025-09-25T22:28:40.219242] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-25T22:28:40.281001] [DEBUG] [LOCAL ] UTL: Derivative data saved (1807 records). [2025-09-25T22:28:40.302815] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-25T22:28:40.325859] [INFO ] [MAIN ] Derivative Progress: 1885/2043 symbols completed. UTL took 1.3s. Estimated remaining: 1m 6s. Rate: 142.9 symbols/min [2025-09-25T22:28:40.352104] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:40.523699] [DEBUG] [MAIN ] UTZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:40.524953] [INFO ] [MAIN ] UTZ: Generated 1807 derivative records from 45025 primary records. [2025-09-25T22:28:40.525829] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-25T22:28:40.552178] [DEBUG] [LOCAL ] UVV: Loaded 22542 existing records from primary storage. [2025-09-25T22:28:40.553591] [INFO ] [MAIN ] UVV: Loaded 22542 primary data records. [2025-09-25T22:28:40.562196] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1807 records). [2025-09-25T22:28:40.570364] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-25T22:28:40.596107] [INFO ] [MAIN ] Derivative Progress: 1886/2043 symbols completed. UTZ took 1.3s. Estimated remaining: 1m 6s. Rate: 142.9 symbols/min [2025-09-25T22:28:40.639750] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:40.754602] [DEBUG] [MAIN ] UVE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:40.780935] [INFO ] [MAIN ] UVE: Generated 1807 derivative records from 21997 primary records. [2025-09-25T22:28:40.902343] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-25T22:28:40.922705] [DEBUG] [LOCAL ] UVE: Derivative data saved (1807 records). [2025-09-25T22:28:40.924678] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-25T22:28:40.928992] [INFO ] [MAIN ] Derivative Progress: 1887/2043 symbols completed. UVE took 1.3s. Estimated remaining: 1m 5s. Rate: 143.0 symbols/min [2025-09-25T22:28:40.929994] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:40.959089] [DEBUG] [LOCAL ] UZD: Loaded 6391 existing records from primary storage. [2025-09-25T22:28:40.961000] [INFO ] [MAIN ] UZD: Loaded 6391 primary data records. [2025-09-25T22:28:41.059795] [DEBUG] [LOCAL ] UWMC: Loaded 53128 existing records from primary storage. [2025-09-25T22:28:41.098024] [INFO ] [MAIN ] UWMC: Loaded 53128 primary data records. [2025-09-25T22:28:41.097914] [DEBUG] [MAIN ] UVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:41.124722] [INFO ] [MAIN ] UVV: Generated 1807 derivative records from 22542 primary records. [2025-09-25T22:28:41.169825] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-25T22:28:41.496091] [DEBUG] [LOCAL ] UVV: Derivative data saved (1807 records). [2025-09-25T22:28:41.544189] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-25T22:28:41.547186] [INFO ] [MAIN ] Derivative Progress: 1888/2043 symbols completed. UVV took 1.2s. Estimated remaining: 1m 5s. Rate: 142.9 symbols/min [2025-09-25T22:28:41.705345] [DEBUG] [MAIN ] UZD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:41.706924] [INFO ] [MAIN ] UZD: Generated 1807 derivative records from 6391 primary records. [2025-09-25T22:28:41.707051] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-25T22:28:41.726526] [DEBUG] [LOCAL ] UZD: Derivative data saved (1807 records). [2025-09-25T22:28:41.726893] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-25T22:28:41.729733] [INFO ] [MAIN ] Derivative Progress: 1889/2043 symbols completed. UZD took 0.8s. Estimated remaining: 1m 5s. Rate: 143.0 symbols/min [2025-09-25T22:28:41.745557] [DEBUG] [MAIN ] UWMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:41.746419] [INFO ] [MAIN ] UWMC: Generated 1807 derivative records from 53128 primary records. [2025-09-25T22:28:41.746524] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-25T22:28:41.762601] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1807 records). [2025-09-25T22:28:41.762806] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-25T22:28:41.765985] [INFO ] [MAIN ] Derivative Progress: 1890/2043 symbols completed. UWMC took 1.1s. Estimated remaining: 1m 4s. Rate: 143.0 symbols/min [2025-09-25T22:28:41.767028] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:41.767477] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:41.767586] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:41.784831] [DEBUG] [LOCAL ] UZE: Loaded 7510 existing records from primary storage. [2025-09-25T22:28:41.785068] [INFO ] [MAIN ] UZE: Loaded 7510 primary data records. [2025-09-25T22:28:41.825001] [DEBUG] [LOCAL ] UZF: Loaded 6530 existing records from primary storage. [2025-09-25T22:28:41.862404] [INFO ] [MAIN ] UZF: Loaded 6530 primary data records. [2025-09-25T22:28:42.398330] [DEBUG] [LOCAL ] V: Loaded 54149 existing records from primary storage. [2025-09-25T22:28:42.416071] [INFO ] [MAIN ] V: Loaded 54149 primary data records. [2025-09-25T22:28:42.909389] [DEBUG] [MAIN ] UZE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:42.910530] [INFO ] [MAIN ] UZE: Generated 1807 derivative records from 7510 primary records. [2025-09-25T22:28:42.910639] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-25T22:28:42.935908] [DEBUG] [MAIN ] UZF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:42.941138] [INFO ] [MAIN ] UZF: Generated 1807 derivative records from 6530 primary records. [2025-09-25T22:28:42.941622] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-25T22:28:42.945361] [DEBUG] [LOCAL ] UZE: Derivative data saved (1807 records). [2025-09-25T22:28:42.945757] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-25T22:28:42.961383] [INFO ] [MAIN ] Derivative Progress: 1891/2043 symbols completed. UZE took 1.2s. Estimated remaining: 1m 4s. Rate: 142.9 symbols/min [2025-09-25T22:28:42.967208] [DEBUG] [LOCAL ] UZF: Derivative data saved (1807 records). [2025-09-25T22:28:42.968035] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:42.968280] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-25T22:28:42.972247] [INFO ] [MAIN ] Derivative Progress: 1892/2043 symbols completed. UZF took 1.2s. Estimated remaining: 1m 3s. Rate: 143.0 symbols/min [2025-09-25T22:28:42.974197] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:42.994360] [DEBUG] [MAIN ] V: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:42.995379] [INFO ] [MAIN ] V: Generated 1807 derivative records from 54149 primary records. [2025-09-25T22:28:42.995499] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-25T22:28:43.013056] [DEBUG] [LOCAL ] V: Derivative data saved (1807 records). [2025-09-25T22:28:43.013327] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-25T22:28:43.016692] [INFO ] [MAIN ] Derivative Progress: 1893/2043 symbols completed. V took 1.2s. Estimated remaining: 1m 3s. Rate: 143.0 symbols/min [2025-09-25T22:28:43.017176] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:43.060630] [DEBUG] [LOCAL ] VAC: Loaded 34804 existing records from primary storage. [2025-09-25T22:28:43.060914] [INFO ] [MAIN ] VAC: Loaded 34804 primary data records. [2025-09-25T22:28:43.212351] [DEBUG] [LOCAL ] VAL: Loaded 50797 existing records from primary storage. [2025-09-25T22:28:43.223473] [INFO ] [MAIN ] VAL: Loaded 50797 primary data records. [2025-09-25T22:28:43.558780] [DEBUG] [LOCAL ] VALE: Loaded 54084 existing records from primary storage. [2025-09-25T22:28:43.564717] [INFO ] [MAIN ] VALE: Loaded 54084 primary data records. [2025-09-25T22:28:44.209212] [DEBUG] [MAIN ] VAC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:44.210285] [INFO ] [MAIN ] VAC: Generated 1807 derivative records from 34804 primary records. [2025-09-25T22:28:44.210524] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-25T22:28:44.248095] [DEBUG] [MAIN ] VAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:44.249013] [DEBUG] [LOCAL ] VAC: Derivative data saved (1807 records). [2025-09-25T22:28:44.249371] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-25T22:28:44.251790] [INFO ] [MAIN ] Derivative Progress: 1894/2043 symbols completed. VAC took 1.3s. Estimated remaining: 1m 3s. Rate: 142.9 symbols/min [2025-09-25T22:28:44.253420] [INFO ] [MAIN ] VAL: Generated 1807 derivative records from 50797 primary records. [2025-09-25T22:28:44.253590] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:44.253810] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-25T22:28:44.281458] [DEBUG] [LOCAL ] VAL: Derivative data saved (1807 records). [2025-09-25T22:28:44.280005] [DEBUG] [LOCAL ] VATE: Loaded 5649 existing records from primary storage. [2025-09-25T22:28:44.281614] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-25T22:28:44.298539] [INFO ] [MAIN ] Derivative Progress: 1895/2043 symbols completed. VAL took 1.3s. Estimated remaining: 1m 2s. Rate: 143.0 symbols/min [2025-09-25T22:28:44.295853] [DEBUG] [MAIN ] VALE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:44.298804] [INFO ] [MAIN ] VATE: Loaded 5649 primary data records. [2025-09-25T22:28:44.300174] [INFO ] [MAIN ] VALE: Generated 1807 derivative records from 54084 primary records. [2025-09-25T22:28:44.300388] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:44.305782] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-25T22:28:44.415381] [DEBUG] [LOCAL ] VBF: Loaded 7136 existing records from primary storage. [2025-09-25T22:28:44.421250] [INFO ] [MAIN ] VBF: Loaded 7136 primary data records. [2025-09-25T22:28:44.504045] [DEBUG] [LOCAL ] VALE: Derivative data saved (1807 records). [2025-09-25T22:28:44.536699] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-25T22:28:44.568293] [INFO ] [MAIN ] Derivative Progress: 1896/2043 symbols completed. VALE took 1.6s. Estimated remaining: 1m 2s. Rate: 143.0 symbols/min [2025-09-25T22:28:44.619384] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:45.004558] [DEBUG] [LOCAL ] VCV: Loaded 13629 existing records from primary storage. [2025-09-25T22:28:45.005792] [INFO ] [MAIN ] VCV: Loaded 13629 primary data records. [2025-09-25T22:28:45.369038] [DEBUG] [MAIN ] VATE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:45.370882] [INFO ] [MAIN ] VATE: Generated 1807 derivative records from 5649 primary records. [2025-09-25T22:28:45.371478] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-25T22:28:45.401039] [DEBUG] [MAIN ] VBF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:45.405047] [DEBUG] [LOCAL ] VATE: Derivative data saved (1807 records). [2025-09-25T22:28:45.406359] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-25T22:28:45.408913] [INFO ] [MAIN ] Derivative Progress: 1897/2043 symbols completed. VATE took 1.2s. Estimated remaining: 1m 1s. Rate: 142.9 symbols/min [2025-09-25T22:28:45.406116] [INFO ] [MAIN ] VBF: Generated 1807 derivative records from 7136 primary records. [2025-09-25T22:28:45.409556] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:45.409706] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-25T22:28:45.440325] [DEBUG] [LOCAL ] VBF: Derivative data saved (1807 records). [2025-09-25T22:28:45.446181] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-25T22:28:45.449576] [INFO ] [MAIN ] Derivative Progress: 1898/2043 symbols completed. VBF took 1.2s. Estimated remaining: 1m 1s. Rate: 143.0 symbols/min [2025-09-25T22:28:45.446430] [DEBUG] [MAIN ] VCV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:45.450404] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:45.451894] [INFO ] [MAIN ] VCV: Generated 1807 derivative records from 13629 primary records. [2025-09-25T22:28:45.452494] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-25T22:28:45.470128] [DEBUG] [LOCAL ] VCV: Derivative data saved (1807 records). [2025-09-25T22:28:45.484960] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-25T22:28:45.488634] [INFO ] [MAIN ] Derivative Progress: 1899/2043 symbols completed. VCV took 0.9s. Estimated remaining: 1m 0s. Rate: 143.0 symbols/min [2025-09-25T22:28:45.489189] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:45.496954] [DEBUG] [LOCAL ] VEL: Loaded 13206 existing records from primary storage. [2025-09-25T22:28:45.497133] [INFO ] [MAIN ] VEL: Loaded 13206 primary data records. [2025-09-25T22:28:45.627076] [DEBUG] [LOCAL ] VEEV: Loaded 47463 existing records from primary storage. [2025-09-25T22:28:45.627526] [INFO ] [MAIN ] VEEV: Loaded 47463 primary data records. [2025-09-25T22:28:45.993929] [DEBUG] [LOCAL ] VET: Loaded 44385 existing records from primary storage. [2025-09-25T22:28:46.001985] [INFO ] [MAIN ] VET: Loaded 44385 primary data records. [2025-09-25T22:28:46.640393] [DEBUG] [MAIN ] VEL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:46.643177] [INFO ] [MAIN ] VEL: Generated 1807 derivative records from 13206 primary records. [2025-09-25T22:28:46.644847] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-25T22:28:46.668838] [DEBUG] [LOCAL ] VEL: Derivative data saved (1807 records). [2025-09-25T22:28:46.670476] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-25T22:28:46.673258] [INFO ] [MAIN ] Derivative Progress: 1900/2043 symbols completed. VEL took 1.2s. Estimated remaining: 1m 0s. Rate: 142.9 symbols/min [2025-09-25T22:28:46.675757] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:46.691766] [DEBUG] [MAIN ] VEEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:46.694360] [INFO ] [MAIN ] VEEV: Generated 1807 derivative records from 47463 primary records. [2025-09-25T22:28:46.694569] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-25T22:28:46.722152] [DEBUG] [MAIN ] VET: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:46.727630] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1807 records). [2025-09-25T22:28:46.727803] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-25T22:28:46.730424] [INFO ] [MAIN ] Derivative Progress: 1901/2043 symbols completed. VEEV took 1.3s. Estimated remaining: 59.6s. Rate: 143.0 symbols/min [2025-09-25T22:28:46.730731] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:46.727273] [INFO ] [MAIN ] VET: Generated 1807 derivative records from 44385 primary records. [2025-09-25T22:28:46.731066] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-25T22:28:46.762457] [DEBUG] [LOCAL ] VGI: Loaded 5203 existing records from primary storage. [2025-09-25T22:28:46.763915] [DEBUG] [LOCAL ] VET: Derivative data saved (1807 records). [2025-09-25T22:28:46.764003] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-25T22:28:46.768144] [INFO ] [MAIN ] Derivative Progress: 1902/2043 symbols completed. VET took 1.3s. Estimated remaining: 59.1s. Rate: 143.0 symbols/min [2025-09-25T22:28:46.763219] [INFO ] [MAIN ] VGI: Loaded 5203 primary data records. [2025-09-25T22:28:46.768611] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:46.981268] [DEBUG] [LOCAL ] VFC: Loaded 54000 existing records from primary storage. [2025-09-25T22:28:47.010199] [INFO ] [MAIN ] VFC: Loaded 54000 primary data records. [2025-09-25T22:28:47.120980] [DEBUG] [LOCAL ] VGM: Loaded 18293 existing records from primary storage. [2025-09-25T22:28:47.142180] [INFO ] [MAIN ] VGM: Loaded 18293 primary data records. [2025-09-25T22:28:47.829760] [DEBUG] [MAIN ] VGI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:47.831433] [INFO ] [MAIN ] VGI: Generated 1807 derivative records from 5203 primary records. [2025-09-25T22:28:47.832049] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-25T22:28:47.871041] [DEBUG] [LOCAL ] VGI: Derivative data saved (1807 records). [2025-09-25T22:28:47.870230] [DEBUG] [MAIN ] VFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:47.872244] [INFO ] [MAIN ] VFC: Generated 1807 derivative records from 54000 primary records. [2025-09-25T22:28:47.871331] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-25T22:28:47.875106] [INFO ] [MAIN ] Derivative Progress: 1903/2043 symbols completed. VGI took 1.1s. Estimated remaining: 58.8s. Rate: 142.9 symbols/min [2025-09-25T22:28:47.876531] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-25T22:28:47.906835] [DEBUG] [MAIN ] VGM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:47.908408] [INFO ] [MAIN ] VGM: Generated 1807 derivative records from 18293 primary records. [2025-09-25T22:28:47.908702] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-25T22:28:47.920222] [DEBUG] [LOCAL ] VFC: Derivative data saved (1807 records). [2025-09-25T22:28:47.921761] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-25T22:28:47.924808] [INFO ] [MAIN ] Derivative Progress: 1904/2043 symbols completed. VFC took 1.2s. Estimated remaining: 58.3s. Rate: 143.0 symbols/min [2025-09-25T22:28:47.932097] [DEBUG] [LOCAL ] VGM: Derivative data saved (1807 records). [2025-09-25T22:28:47.932254] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-25T22:28:47.934851] [INFO ] [MAIN ] Derivative Progress: 1905/2043 symbols completed. VGM took 1.2s. Estimated remaining: 57.9s. Rate: 143.1 symbols/min [2025-09-25T22:28:47.935858] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:47.935778] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:47.935567] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:47.942497] [DEBUG] [LOCAL ] VHI: Loaded 2896 existing records from primary storage. [2025-09-25T22:28:47.942838] [INFO ] [MAIN ] VHI: Loaded 2896 primary data records. [2025-09-25T22:28:48.343250] [DEBUG] [LOCAL ] VIK: Loaded 52883 existing records from primary storage. [2025-09-25T22:28:48.343925] [INFO ] [MAIN ] VIK: Loaded 52883 primary data records. [2025-09-25T22:28:48.345029] [DEBUG] [LOCAL ] VICI: Loaded 54039 existing records from primary storage. [2025-09-25T22:28:48.350910] [INFO ] [MAIN ] VICI: Loaded 54039 primary data records. [2025-09-25T22:28:48.673469] [DEBUG] [MAIN ] VHI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:48.697205] [INFO ] [MAIN ] VHI: Generated 1807 derivative records from 2896 primary records. [2025-09-25T22:28:48.752991] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-25T22:28:49.125022] [DEBUG] [LOCAL ] VHI: Derivative data saved (1807 records). [2025-09-25T22:28:49.125333] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-25T22:28:49.128047] [INFO ] [MAIN ] Derivative Progress: 1906/2043 symbols completed. VHI took 1.2s. Estimated remaining: 57.5s. Rate: 142.9 symbols/min [2025-09-25T22:28:49.131454] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:49.158946] [DEBUG] [MAIN ] VIK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:49.174012] [DEBUG] [MAIN ] VICI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:49.175332] [INFO ] [MAIN ] VIK: Generated 1807 derivative records from 52883 primary records. [2025-09-25T22:28:49.175571] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-25T22:28:49.176942] [INFO ] [MAIN ] VICI: Generated 1807 derivative records from 54039 primary records. [2025-09-25T22:28:49.177949] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-25T22:28:49.228442] [DEBUG] [LOCAL ] VICI: Derivative data saved (1807 records). [2025-09-25T22:28:49.229704] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-25T22:28:49.229568] [DEBUG] [LOCAL ] VIK: Derivative data saved (1807 records). [2025-09-25T22:28:49.233683] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-25T22:28:49.233481] [INFO ] [MAIN ] Derivative Progress: 1907/2043 symbols completed. VICI took 1.3s. Estimated remaining: 57.1s. Rate: 143.0 symbols/min [2025-09-25T22:28:49.237352] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:49.237498] [INFO ] [MAIN ] Derivative Progress: 1908/2043 symbols completed. VIK took 1.3s. Estimated remaining: 56.6s. Rate: 143.0 symbols/min [2025-09-25T22:28:49.238775] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:49.257458] [DEBUG] [LOCAL ] VIPS: Loaded 51734 existing records from primary storage. [2025-09-25T22:28:49.258063] [INFO ] [MAIN ] VIPS: Loaded 51734 primary data records. [2025-09-25T22:28:49.640031] [DEBUG] [LOCAL ] VIST: Loaded 46370 existing records from primary storage. [2025-09-25T22:28:49.641077] [DEBUG] [LOCAL ] VIRT: Loaded 47172 existing records from primary storage. [2025-09-25T22:28:49.642956] [INFO ] [MAIN ] VIST: Loaded 46370 primary data records. [2025-09-25T22:28:49.643299] [INFO ] [MAIN ] VIRT: Loaded 47172 primary data records. [2025-09-25T22:28:50.334827] [DEBUG] [MAIN ] VIPS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:50.337247] [INFO ] [MAIN ] VIPS: Generated 1807 derivative records from 51734 primary records. [2025-09-25T22:28:50.337683] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-25T22:28:50.364697] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1807 records). [2025-09-25T22:28:50.365087] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-25T22:28:50.367492] [INFO ] [MAIN ] Derivative Progress: 1909/2043 symbols completed. VIPS took 1.2s. Estimated remaining: 56.3s. Rate: 142.9 symbols/min [2025-09-25T22:28:50.368329] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:50.402406] [DEBUG] [MAIN ] VIST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:50.408304] [DEBUG] [MAIN ] VIRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:50.409436] [INFO ] [MAIN ] VIST: Generated 1807 derivative records from 46370 primary records. [2025-09-25T22:28:50.410449] [INFO ] [MAIN ] VIRT: Generated 1807 derivative records from 47172 primary records. [2025-09-25T22:28:50.410580] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-25T22:28:50.411608] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-25T22:28:50.443879] [DEBUG] [LOCAL ] VIST: Derivative data saved (1807 records). [2025-09-25T22:28:50.455883] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-25T22:28:50.459379] [INFO ] [MAIN ] Derivative Progress: 1910/2043 symbols completed. VIST took 1.2s. Estimated remaining: 55.8s. Rate: 143.0 symbols/min [2025-09-25T22:28:50.460458] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:50.462784] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1807 records). [2025-09-25T22:28:50.463028] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-25T22:28:50.466710] [INFO ] [MAIN ] Derivative Progress: 1911/2043 symbols completed. VIRT took 1.2s. Estimated remaining: 55.4s. Rate: 143.1 symbols/min [2025-09-25T22:28:50.467299] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:50.489865] [DEBUG] [LOCAL ] VIV: Loaded 45434 existing records from primary storage. [2025-09-25T22:28:50.490280] [INFO ] [MAIN ] VIV: Loaded 45434 primary data records. [2025-09-25T22:28:50.586343] [DEBUG] [LOCAL ] VKQ: Loaded 17468 existing records from primary storage. [2025-09-25T22:28:50.600950] [INFO ] [MAIN ] VKQ: Loaded 17468 primary data records. [2025-09-25T22:28:50.802630] [DEBUG] [LOCAL ] VLN: Loaded 28836 existing records from primary storage. [2025-09-25T22:28:50.855179] [INFO ] [MAIN ] VLN: Loaded 28836 primary data records. [2025-09-25T22:28:51.653750] [DEBUG] [MAIN ] VKQ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:51.651401] [DEBUG] [MAIN ] VIV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:51.657578] [INFO ] [MAIN ] VKQ: Generated 1807 derivative records from 17468 primary records. [2025-09-25T22:28:51.658929] [INFO ] [MAIN ] VIV: Generated 1807 derivative records from 45434 primary records. [2025-09-25T22:28:51.659167] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-25T22:28:51.659285] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-25T22:28:51.703869] [DEBUG] [MAIN ] VLN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:51.709088] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1807 records). [2025-09-25T22:28:51.708977] [INFO ] [MAIN ] VLN: Generated 1807 derivative records from 28836 primary records. [2025-09-25T22:28:51.709833] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-25T22:28:51.709730] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-25T22:28:51.714476] [INFO ] [MAIN ] Derivative Progress: 1912/2043 symbols completed. VKQ took 1.3s. Estimated remaining: 55.0s. Rate: 142.9 symbols/min [2025-09-25T22:28:51.724849] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:51.734583] [DEBUG] [LOCAL ] VLN: Derivative data saved (1807 records). [2025-09-25T22:28:51.736021] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-25T22:28:51.740165] [INFO ] [MAIN ] Derivative Progress: 1913/2043 symbols completed. VLN took 1.3s. Estimated remaining: 54.6s. Rate: 143.0 symbols/min [2025-09-25T22:28:51.741298] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:51.742170] [DEBUG] [LOCAL ] VIV: Derivative data saved (1807 records). [2025-09-25T22:28:51.742370] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-25T22:28:51.745675] [INFO ] [MAIN ] Derivative Progress: 1914/2043 symbols completed. VIV took 1.4s. Estimated remaining: 54.1s. Rate: 143.0 symbols/min [2025-09-25T22:28:51.746157] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:51.757071] [DEBUG] [LOCAL ] VLT: Loaded 4596 existing records from primary storage. [2025-09-25T22:28:51.757175] [INFO ] [MAIN ] VLT: Loaded 4596 primary data records. [2025-09-25T22:28:52.005551] [DEBUG] [LOCAL ] VLRS: Loaded 40930 existing records from primary storage. [2025-09-25T22:28:52.005883] [INFO ] [MAIN ] VLRS: Loaded 40930 primary data records. [2025-09-25T22:28:52.006820] [DEBUG] [LOCAL ] VLO: Loaded 53476 existing records from primary storage. [2025-09-25T22:28:52.138556] [INFO ] [MAIN ] VLO: Loaded 53476 primary data records. [2025-09-25T22:28:52.880405] [DEBUG] [MAIN ] VLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:52.883099] [INFO ] [MAIN ] VLT: Generated 1807 derivative records from 4596 primary records. [2025-09-25T22:28:52.883460] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-25T22:28:52.908270] [DEBUG] [LOCAL ] VLT: Derivative data saved (1807 records). [2025-09-25T22:28:52.908746] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-25T22:28:52.913421] [INFO ] [MAIN ] Derivative Progress: 1915/2043 symbols completed. VLT took 1.2s. Estimated remaining: 53.7s. Rate: 142.9 symbols/min [2025-09-25T22:28:52.914470] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:52.934230] [DEBUG] [MAIN ] VLRS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:52.935501] [INFO ] [MAIN ] VLRS: Generated 1807 derivative records from 40930 primary records. [2025-09-25T22:28:52.935712] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-25T22:28:52.950883] [DEBUG] [MAIN ] VLO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:52.959632] [INFO ] [MAIN ] VLO: Generated 1807 derivative records from 53476 primary records. [2025-09-25T22:28:52.964062] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-25T22:28:52.977520] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1807 records). [2025-09-25T22:28:52.982700] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-25T22:28:52.987471] [INFO ] [MAIN ] Derivative Progress: 1916/2043 symbols completed. VLRS took 1.2s. Estimated remaining: 53.3s. Rate: 143.0 symbols/min [2025-09-25T22:28:52.992007] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:52.992705] [DEBUG] [LOCAL ] VLO: Derivative data saved (1807 records). [2025-09-25T22:28:52.993083] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-25T22:28:52.996529] [INFO ] [MAIN ] Derivative Progress: 1917/2043 symbols completed. VLO took 1.3s. Estimated remaining: 52.8s. Rate: 143.1 symbols/min [2025-09-25T22:28:52.997213] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:53.051723] [DEBUG] [LOCAL ] VMI: Loaded 15578 existing records from primary storage. [2025-09-25T22:28:53.052721] [DEBUG] [LOCAL ] VLTO: Loaded 46368 existing records from primary storage. [2025-09-25T22:28:53.053073] [INFO ] [MAIN ] VMI: Loaded 15578 primary data records. [2025-09-25T22:28:53.053333] [INFO ] [MAIN ] VLTO: Loaded 46368 primary data records. [2025-09-25T22:28:53.347798] [DEBUG] [LOCAL ] VMC: Loaded 43970 existing records from primary storage. [2025-09-25T22:28:53.373856] [INFO ] [MAIN ] VMC: Loaded 43970 primary data records. [2025-09-25T22:28:54.209989] [DEBUG] [MAIN ] VMI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:54.210751] [DEBUG] [MAIN ] VLTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:54.211828] [INFO ] [MAIN ] VMI: Generated 1807 derivative records from 15578 primary records. [2025-09-25T22:28:54.213103] [INFO ] [MAIN ] VLTO: Generated 1807 derivative records from 46368 primary records. [2025-09-25T22:28:54.213873] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-25T22:28:54.213951] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-25T22:28:54.249777] [DEBUG] [LOCAL ] VMI: Derivative data saved (1807 records). [2025-09-25T22:28:54.250504] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-25T22:28:54.253418] [INFO ] [MAIN ] Derivative Progress: 1918/2043 symbols completed. VMI took 1.3s. Estimated remaining: 52.5s. Rate: 142.9 symbols/min [2025-09-25T22:28:54.255181] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1807 records). [2025-09-25T22:28:54.255408] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-25T22:28:54.258323] [INFO ] [MAIN ] Derivative Progress: 1919/2043 symbols completed. VLTO took 1.3s. Estimated remaining: 52.0s. Rate: 143.0 symbols/min [2025-09-25T22:28:54.275996] [DEBUG] [MAIN ] VMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:54.276894] [INFO ] [MAIN ] VMC: Generated 1807 derivative records from 43970 primary records. [2025-09-25T22:28:54.276965] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-25T22:28:54.293389] [DEBUG] [LOCAL ] VMC: Derivative data saved (1807 records). [2025-09-25T22:28:54.293562] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-25T22:28:54.297262] [INFO ] [MAIN ] Derivative Progress: 1920/2043 symbols completed. VMC took 1.3s. Estimated remaining: 51.6s. Rate: 143.0 symbols/min [2025-09-25T22:28:54.298977] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:54.298566] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:54.298449] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:54.324892] [DEBUG] [LOCAL ] VNCE: Loaded 7418 existing records from primary storage. [2025-09-25T22:28:54.325280] [INFO ] [MAIN ] VNCE: Loaded 7418 primary data records. [2025-09-25T22:28:54.472028] [DEBUG] [LOCAL ] VMO: Loaded 21177 existing records from primary storage. [2025-09-25T22:28:54.472359] [INFO ] [MAIN ] VMO: Loaded 21177 primary data records. [2025-09-25T22:28:54.689443] [DEBUG] [LOCAL ] VNO: Loaded 49325 existing records from primary storage. [2025-09-25T22:28:54.822038] [INFO ] [MAIN ] VNO: Loaded 49325 primary data records. [2025-09-25T22:28:55.496308] [DEBUG] [MAIN ] VNCE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:55.497757] [INFO ] [MAIN ] VNCE: Generated 1807 derivative records from 7418 primary records. [2025-09-25T22:28:55.499408] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-25T22:28:55.532173] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1807 records). [2025-09-25T22:28:55.532708] [DEBUG] [MAIN ] VMO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:55.532998] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-25T22:28:55.536241] [INFO ] [MAIN ] Derivative Progress: 1921/2043 symbols completed. VNCE took 1.2s. Estimated remaining: 51.2s. Rate: 142.9 symbols/min [2025-09-25T22:28:55.533889] [INFO ] [MAIN ] VMO: Generated 1807 derivative records from 21177 primary records. [2025-09-25T22:28:55.537473] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:55.537553] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-25T22:28:55.559012] [DEBUG] [LOCAL ] VMO: Derivative data saved (1807 records). [2025-09-25T22:28:55.559220] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-25T22:28:55.569837] [INFO ] [MAIN ] Derivative Progress: 1922/2043 symbols completed. VMO took 1.3s. Estimated remaining: 50.8s. Rate: 143.0 symbols/min [2025-09-25T22:28:55.575374] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:55.575875] [DEBUG] [MAIN ] VNO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:55.577281] [INFO ] [MAIN ] VNO: Generated 1807 derivative records from 49325 primary records. [2025-09-25T22:28:55.577828] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-25T22:28:55.601077] [DEBUG] [LOCAL ] VNO: Derivative data saved (1807 records). [2025-09-25T22:28:55.605742] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-25T22:28:55.610586] [INFO ] [MAIN ] Derivative Progress: 1923/2043 symbols completed. VNO took 1.3s. Estimated remaining: 50.3s. Rate: 143.0 symbols/min [2025-09-25T22:28:55.611061] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:55.606253] [DEBUG] [LOCAL ] VOC: Loaded 8970 existing records from primary storage. [2025-09-25T22:28:55.611272] [INFO ] [MAIN ] VOC: Loaded 8970 primary data records. [2025-09-25T22:28:55.760713] [DEBUG] [LOCAL ] VNT: Loaded 44172 existing records from primary storage. [2025-09-25T22:28:55.771522] [INFO ] [MAIN ] VNT: Loaded 44172 primary data records. [2025-09-25T22:28:56.131795] [DEBUG] [LOCAL ] VOYA: Loaded 43089 existing records from primary storage. [2025-09-25T22:28:56.205829] [INFO ] [MAIN ] VOYA: Loaded 43089 primary data records. [2025-09-25T22:28:56.728769] [DEBUG] [MAIN ] VOC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:56.730229] [INFO ] [MAIN ] VOC: Generated 1807 derivative records from 8970 primary records. [2025-09-25T22:28:56.730497] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-25T22:28:56.754609] [DEBUG] [LOCAL ] VOC: Derivative data saved (1807 records). [2025-09-25T22:28:56.762934] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-25T22:28:56.771001] [INFO ] [MAIN ] Derivative Progress: 1924/2043 symbols completed. VOC took 1.2s. Estimated remaining: 50.0s. Rate: 142.9 symbols/min [2025-09-25T22:28:56.771893] [DEBUG] [MAIN ] VNT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:56.773148] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:56.774166] [INFO ] [MAIN ] VNT: Generated 1807 derivative records from 44172 primary records. [2025-09-25T22:28:56.774950] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-25T22:28:56.794397] [DEBUG] [LOCAL ] VNT: Derivative data saved (1807 records). [2025-09-25T22:28:56.794833] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-25T22:28:56.797518] [INFO ] [MAIN ] Derivative Progress: 1925/2043 symbols completed. VNT took 1.3s. Estimated remaining: 49.5s. Rate: 143.0 symbols/min [2025-09-25T22:28:56.797969] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:56.816193] [DEBUG] [LOCAL ] VPV: Loaded 5389 existing records from primary storage. [2025-09-25T22:28:56.816668] [INFO ] [MAIN ] VPV: Loaded 5389 primary data records. [2025-09-25T22:28:56.877406] [DEBUG] [MAIN ] VOYA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:56.931248] [INFO ] [MAIN ] VOYA: Generated 1807 derivative records from 43089 primary records. [2025-09-25T22:28:56.932467] [DEBUG] [LOCAL ] VPG: Loaded 17301 existing records from primary storage. [2025-09-25T22:28:56.932602] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-25T22:28:56.951132] [INFO ] [MAIN ] VPG: Loaded 17301 primary data records. [2025-09-25T22:28:57.332564] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1807 records). [2025-09-25T22:28:57.348915] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-25T22:28:57.374868] [INFO ] [MAIN ] Derivative Progress: 1926/2043 symbols completed. VOYA took 1.8s. Estimated remaining: 49.1s. Rate: 142.9 symbols/min [2025-09-25T22:28:57.394267] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:57.661258] [DEBUG] [MAIN ] VPV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:57.663710] [INFO ] [MAIN ] VPV: Generated 1807 derivative records from 5389 primary records. [2025-09-25T22:28:57.664247] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-25T22:28:57.665889] [DEBUG] [LOCAL ] VRE: Loaded 35057 existing records from primary storage. [2025-09-25T22:28:57.666510] [INFO ] [MAIN ] VRE: Loaded 35057 primary data records. [2025-09-25T22:28:57.763818] [DEBUG] [LOCAL ] VPV: Derivative data saved (1807 records). [2025-09-25T22:28:57.805461] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-25T22:28:57.827322] [INFO ] [MAIN ] Derivative Progress: 1927/2043 symbols completed. VPV took 1.0s. Estimated remaining: 48.7s. Rate: 142.9 symbols/min [2025-09-25T22:28:57.828477] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:57.828078] [DEBUG] [MAIN ] VPG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:57.840744] [INFO ] [MAIN ] VPG: Generated 1807 derivative records from 17301 primary records. [2025-09-25T22:28:57.857166] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-25T22:28:58.067065] [DEBUG] [LOCAL ] VPG: Derivative data saved (1807 records). [2025-09-25T22:28:58.067349] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-25T22:28:58.070670] [INFO ] [MAIN ] Derivative Progress: 1928/2043 symbols completed. VPG took 1.3s. Estimated remaining: 48.3s. Rate: 143.0 symbols/min [2025-09-25T22:28:58.071317] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:58.086929] [DEBUG] [LOCAL ] VRTS: Loaded 9214 existing records from primary storage. [2025-09-25T22:28:58.087159] [INFO ] [MAIN ] VRTS: Loaded 9214 primary data records. [2025-09-25T22:28:58.244333] [DEBUG] [LOCAL ] VRT: Loaded 54143 existing records from primary storage. [2025-09-25T22:28:58.274150] [INFO ] [MAIN ] VRT: Loaded 54143 primary data records. [2025-09-25T22:28:58.305124] [DEBUG] [MAIN ] VRE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:58.359820] [INFO ] [MAIN ] VRE: Generated 1807 derivative records from 35057 primary records. [2025-09-25T22:28:58.387808] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-25T22:28:58.841043] [DEBUG] [LOCAL ] VRE: Derivative data saved (1807 records). [2025-09-25T22:28:58.842418] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-25T22:28:58.845730] [INFO ] [MAIN ] Derivative Progress: 1929/2043 symbols completed. VRE took 1.5s. Estimated remaining: 47.9s. Rate: 142.9 symbols/min [2025-09-25T22:28:58.846749] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:58.871078] [DEBUG] [MAIN ] VRTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:58.872191] [INFO ] [MAIN ] VRTS: Generated 1807 derivative records from 9214 primary records. [2025-09-25T22:28:58.873042] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-25T22:28:58.894066] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1807 records). [2025-09-25T22:28:58.894694] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-25T22:28:58.897678] [INFO ] [MAIN ] Derivative Progress: 1930/2043 symbols completed. VRTS took 0.8s. Estimated remaining: 47.4s. Rate: 143.0 symbols/min [2025-09-25T22:28:58.898713] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:58.936178] [DEBUG] [MAIN ] VRT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:28:58.937249] [INFO ] [MAIN ] VRT: Generated 1807 derivative records from 54143 primary records. [2025-09-25T22:28:58.937619] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-25T22:28:58.956572] [DEBUG] [LOCAL ] VRT: Derivative data saved (1807 records). [2025-09-25T22:28:58.956863] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-25T22:28:58.960272] [INFO ] [MAIN ] Derivative Progress: 1931/2043 symbols completed. VRT took 1.1s. Estimated remaining: 47.0s. Rate: 143.0 symbols/min [2025-09-25T22:28:58.960862] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:28:58.979436] [DEBUG] [LOCAL ] VSCO: Loaded 53190 existing records from primary storage. [2025-09-25T22:28:58.992039] [INFO ] [MAIN ] VSCO: Loaded 53190 primary data records. [2025-09-25T22:28:59.124733] [DEBUG] [LOCAL ] VSH: Loaded 48887 existing records from primary storage. [2025-09-25T22:28:59.125741] [INFO ] [MAIN ] VSH: Loaded 48887 primary data records. [2025-09-25T22:28:59.735193] [DEBUG] [LOCAL ] VST: Loaded 54110 existing records from primary storage. [2025-09-25T22:28:59.752417] [INFO ] [MAIN ] VST: Loaded 54110 primary data records. [2025-09-25T22:28:59.997965] [DEBUG] [MAIN ] VSCO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:00.121318] [INFO ] [MAIN ] VSCO: Generated 1807 derivative records from 53190 primary records. [2025-09-25T22:29:00.122271] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-25T22:29:00.147738] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1807 records). [2025-09-25T22:29:00.162159] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-25T22:29:00.166173] [INFO ] [MAIN ] Derivative Progress: 1932/2043 symbols completed. VSCO took 1.3s. Estimated remaining: 46.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:00.163415] [DEBUG] [MAIN ] VSH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:00.168054] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:00.170067] [INFO ] [MAIN ] VSH: Generated 1807 derivative records from 48887 primary records. [2025-09-25T22:29:00.170826] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-25T22:29:00.193131] [DEBUG] [LOCAL ] VSH: Derivative data saved (1807 records). [2025-09-25T22:29:00.196606] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-25T22:29:00.200343] [INFO ] [MAIN ] Derivative Progress: 1933/2043 symbols completed. VSH took 1.3s. Estimated remaining: 46.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:00.214985] [DEBUG] [MAIN ] VST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:00.215904] [INFO ] [MAIN ] VST: Generated 1807 derivative records from 54110 primary records. [2025-09-25T22:29:00.216029] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-25T22:29:00.245361] [DEBUG] [LOCAL ] VST: Derivative data saved (1807 records). [2025-09-25T22:29:00.245591] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-25T22:29:00.248922] [INFO ] [MAIN ] Derivative Progress: 1934/2043 symbols completed. VST took 1.3s. Estimated remaining: 45.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:00.267932] [DEBUG] [LOCAL ] VSTS: Loaded 49414 existing records from primary storage. [2025-09-25T22:29:00.268120] [INFO ] [MAIN ] VSTS: Loaded 49414 primary data records. [2025-09-25T22:29:00.612590] [DEBUG] [MAIN ] VSTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:00.613566] [INFO ] [MAIN ] VSTS: Generated 1807 derivative records from 49414 primary records. [2025-09-25T22:29:00.613637] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-25T22:29:00.631856] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1807 records). [2025-09-25T22:29:00.632050] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-25T22:29:00.634528] [INFO ] [MAIN ] Derivative Progress: 1935/2043 symbols completed. VSTS took 0.5s. Estimated remaining: 45.3s. Rate: 143.0 symbols/min [2025-09-25T22:29:00.635957] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:00.636109] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:00.637154] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:00.660436] [DEBUG] [LOCAL ] VTMX: Loaded 17636 existing records from primary storage. [2025-09-25T22:29:00.660719] [INFO ] [MAIN ] VTMX: Loaded 17636 primary data records. [2025-09-25T22:29:00.902962] [DEBUG] [LOCAL ] VTEX: Loaded 43673 existing records from primary storage. [2025-09-25T22:29:01.043742] [INFO ] [MAIN ] VTEX: Loaded 43673 primary data records. [2025-09-25T22:29:01.044980] [DEBUG] [LOCAL ] VTLE: Loaded 48959 existing records from primary storage. [2025-09-25T22:29:01.058933] [INFO ] [MAIN ] VTLE: Loaded 48959 primary data records. [2025-09-25T22:29:01.763483] [DEBUG] [MAIN ] VTMX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:01.764850] [INFO ] [MAIN ] VTMX: Generated 1807 derivative records from 17636 primary records. [2025-09-25T22:29:01.765125] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-25T22:29:01.787490] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1807 records). [2025-09-25T22:29:01.787880] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-25T22:29:01.791124] [INFO ] [MAIN ] Derivative Progress: 1936/2043 symbols completed. VTMX took 1.2s. Estimated remaining: 44.9s. Rate: 142.9 symbols/min [2025-09-25T22:29:01.792517] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:01.815254] [DEBUG] [MAIN ] VTEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:01.819426] [INFO ] [MAIN ] VTEX: Generated 1807 derivative records from 43673 primary records. [2025-09-25T22:29:01.823817] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-25T22:29:01.825036] [DEBUG] [LOCAL ] VTN: Loaded 7252 existing records from primary storage. [2025-09-25T22:29:01.839607] [INFO ] [MAIN ] VTN: Loaded 7252 primary data records. [2025-09-25T22:29:01.865088] [DEBUG] [MAIN ] VTLE: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:01.893994] [INFO ] [MAIN ] VTLE: Generated 1807 derivative records from 48959 primary records. [2025-09-25T22:29:01.902681] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-25T22:29:02.006551] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1807 records). [2025-09-25T22:29:02.004538] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1807 records). [2025-09-25T22:29:02.007016] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-25T22:29:02.007166] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-25T22:29:02.011570] [INFO ] [MAIN ] Derivative Progress: 1937/2043 symbols completed. VTLE took 1.4s. Estimated remaining: 44.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:02.027973] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:02.046747] [INFO ] [MAIN ] Derivative Progress: 1938/2043 symbols completed. VTEX took 1.4s. Estimated remaining: 44.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:02.058598] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:02.332955] [DEBUG] [LOCAL ] VTOL: Loaded 19814 existing records from primary storage. [2025-09-25T22:29:02.333143] [INFO ] [MAIN ] VTOL: Loaded 19814 primary data records. [2025-09-25T22:29:02.718065] [DEBUG] [LOCAL ] VTR: Loaded 53235 existing records from primary storage. [2025-09-25T22:29:02.721918] [INFO ] [MAIN ] VTR: Loaded 53235 primary data records. [2025-09-25T22:29:02.778455] [DEBUG] [MAIN ] VTN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:02.812527] [INFO ] [MAIN ] VTN: Generated 1807 derivative records from 7252 primary records. [2025-09-25T22:29:02.827157] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-25T22:29:02.901375] [DEBUG] [LOCAL ] VTN: Derivative data saved (1807 records). [2025-09-25T22:29:02.926292] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-25T22:29:02.930689] [INFO ] [MAIN ] Derivative Progress: 1939/2043 symbols completed. VTN took 1.1s. Estimated remaining: 43.7s. Rate: 142.9 symbols/min [2025-09-25T22:29:02.944889] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:03.120077] [DEBUG] [MAIN ] VTOL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:03.121025] [INFO ] [MAIN ] VTOL: Generated 1807 derivative records from 19814 primary records. [2025-09-25T22:29:03.122104] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-25T22:29:03.144310] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1807 records). [2025-09-25T22:29:03.153452] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-25T22:29:03.156399] [INFO ] [MAIN ] Derivative Progress: 1940/2043 symbols completed. VTOL took 1.1s. Estimated remaining: 43.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:03.158617] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:03.177082] [DEBUG] [LOCAL ] VTS: Loaded 30775 existing records from primary storage. [2025-09-25T22:29:03.178110] [INFO ] [MAIN ] VTS: Loaded 30775 primary data records. [2025-09-25T22:29:03.274484] [DEBUG] [MAIN ] VTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:03.298275] [INFO ] [MAIN ] VTR: Generated 1807 derivative records from 53235 primary records. [2025-09-25T22:29:03.341437] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-25T22:29:03.346565] [DEBUG] [LOCAL ] VVR: Loaded 30917 existing records from primary storage. [2025-09-25T22:29:03.346958] [INFO ] [MAIN ] VVR: Loaded 30917 primary data records. [2025-09-25T22:29:03.704163] [DEBUG] [LOCAL ] VTR: Derivative data saved (1807 records). [2025-09-25T22:29:03.715818] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-25T22:29:03.729818] [INFO ] [MAIN ] Derivative Progress: 1941/2043 symbols completed. VTR took 1.7s. Estimated remaining: 42.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:03.755262] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:03.975633] [DEBUG] [MAIN ] VTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:03.977300] [INFO ] [MAIN ] VTS: Generated 1807 derivative records from 30775 primary records. [2025-09-25T22:29:03.977613] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-25T22:29:03.995172] [DEBUG] [LOCAL ] VTS: Derivative data saved (1807 records). [2025-09-25T22:29:03.995788] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-25T22:29:03.999203] [INFO ] [MAIN ] Derivative Progress: 1942/2043 symbols completed. VTS took 1.1s. Estimated remaining: 42.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:03.999822] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:04.025328] [DEBUG] [LOCAL ] VVV: Loaded 50595 existing records from primary storage. [2025-09-25T22:29:04.033992] [INFO ] [MAIN ] VVV: Loaded 50595 primary data records. [2025-09-25T22:29:04.052931] [DEBUG] [MAIN ] VVR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:04.094434] [INFO ] [MAIN ] VVR: Generated 1807 derivative records from 30917 primary records. [2025-09-25T22:29:04.102774] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-25T22:29:04.209131] [DEBUG] [LOCAL ] VVR: Derivative data saved (1807 records). [2025-09-25T22:29:04.240762] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-25T22:29:04.231416] [DEBUG] [LOCAL ] VVX: Loaded 23504 existing records from primary storage. [2025-09-25T22:29:04.277075] [INFO ] [MAIN ] Derivative Progress: 1943/2043 symbols completed. VVR took 1.1s. Estimated remaining: 42.0s. Rate: 143.0 symbols/min [2025-09-25T22:29:04.373677] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:04.373234] [INFO ] [MAIN ] VVX: Loaded 23504 primary data records. [2025-09-25T22:29:04.817839] [DEBUG] [LOCAL ] VYX: Loaded 49359 existing records from primary storage. [2025-09-25T22:29:04.819143] [INFO ] [MAIN ] VYX: Loaded 49359 primary data records. [2025-09-25T22:29:04.818472] [DEBUG] [MAIN ] VVV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:04.821210] [INFO ] [MAIN ] VVV: Generated 1807 derivative records from 50595 primary records. [2025-09-25T22:29:04.821486] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-25T22:29:04.961210] [DEBUG] [LOCAL ] VVV: Derivative data saved (1807 records). [2025-09-25T22:29:04.972865] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-25T22:29:04.986932] [INFO ] [MAIN ] Derivative Progress: 1944/2043 symbols completed. VVV took 1.2s. Estimated remaining: 41.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:04.992596] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:05.198723] [DEBUG] [MAIN ] VVX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:05.199722] [INFO ] [MAIN ] VVX: Generated 1807 derivative records from 23504 primary records. [2025-09-25T22:29:05.199981] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-25T22:29:05.219067] [DEBUG] [LOCAL ] VVX: Derivative data saved (1807 records). [2025-09-25T22:29:05.219233] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-25T22:29:05.224396] [INFO ] [MAIN ] Derivative Progress: 1945/2043 symbols completed. VVX took 1.2s. Estimated remaining: 41.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:05.225684] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:05.269237] [DEBUG] [MAIN ] VYX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:05.270394] [INFO ] [MAIN ] VYX: Generated 1807 derivative records from 49359 primary records. [2025-09-25T22:29:05.270616] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-25T22:29:05.287780] [DEBUG] [LOCAL ] VYX: Derivative data saved (1807 records). [2025-09-25T22:29:05.302268] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-25T22:29:05.305749] [INFO ] [MAIN ] Derivative Progress: 1946/2043 symbols completed. VYX took 0.9s. Estimated remaining: 40.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:05.321244] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:05.324943] [DEBUG] [LOCAL ] VZ: Loaded 54181 existing records from primary storage. [2025-09-25T22:29:05.325171] [INFO ] [MAIN ] VZ: Loaded 54181 primary data records. [2025-09-25T22:29:05.453493] [DEBUG] [LOCAL ] W: Loaded 53885 existing records from primary storage. [2025-09-25T22:29:05.459541] [INFO ] [MAIN ] W: Loaded 53885 primary data records. [2025-09-25T22:29:05.890908] [DEBUG] [LOCAL ] WAB: Loaded 44516 existing records from primary storage. [2025-09-25T22:29:06.009818] [INFO ] [MAIN ] WAB: Loaded 44516 primary data records. [2025-09-25T22:29:06.262114] [DEBUG] [MAIN ] VZ: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:06.439593] [INFO ] [MAIN ] VZ: Generated 1807 derivative records from 54181 primary records. [2025-09-25T22:29:06.478262] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-25T22:29:06.503340] [DEBUG] [LOCAL ] VZ: Derivative data saved (1807 records). [2025-09-25T22:29:06.512931] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-25T22:29:06.521556] [INFO ] [MAIN ] Derivative Progress: 1947/2043 symbols completed. VZ took 1.5s. Estimated remaining: 40.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:06.522720] [DEBUG] [MAIN ] W: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:06.523670] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:06.525788] [INFO ] [MAIN ] W: Generated 1807 derivative records from 53885 primary records. [2025-09-25T22:29:06.526369] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-25T22:29:06.547952] [DEBUG] [LOCAL ] W: Derivative data saved (1807 records). [2025-09-25T22:29:06.548512] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-25T22:29:06.550939] [INFO ] [MAIN ] Derivative Progress: 1948/2043 symbols completed. W took 1.3s. Estimated remaining: 39.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:06.569400] [DEBUG] [MAIN ] WAB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:06.570313] [INFO ] [MAIN ] WAB: Generated 1807 derivative records from 44516 primary records. [2025-09-25T22:29:06.570426] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-25T22:29:06.588783] [DEBUG] [LOCAL ] WAB: Derivative data saved (1807 records). [2025-09-25T22:29:06.588980] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-25T22:29:06.592999] [INFO ] [MAIN ] Derivative Progress: 1949/2043 symbols completed. WAB took 1.3s. Estimated remaining: 39.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:06.626360] [DEBUG] [LOCAL ] WAL: Loaded 45685 existing records from primary storage. [2025-09-25T22:29:06.626628] [INFO ] [MAIN ] WAL: Loaded 45685 primary data records. [2025-09-25T22:29:06.962233] [DEBUG] [MAIN ] WAL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:06.963138] [INFO ] [MAIN ] WAL: Generated 1807 derivative records from 45685 primary records. [2025-09-25T22:29:06.963209] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-25T22:29:06.984253] [DEBUG] [LOCAL ] WAL: Derivative data saved (1807 records). [2025-09-25T22:29:06.984369] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-25T22:29:06.988675] [INFO ] [MAIN ] Derivative Progress: 1950/2043 symbols completed. WAL took 0.5s. Estimated remaining: 39.0s. Rate: 143.0 symbols/min [2025-09-25T22:29:06.990230] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:06.990347] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:06.990502] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:07.006256] [DEBUG] [LOCAL ] WBX: Loaded 12545 existing records from primary storage. [2025-09-25T22:29:07.006619] [INFO ] [MAIN ] WBX: Loaded 12545 primary data records. [2025-09-25T22:29:07.231089] [DEBUG] [LOCAL ] WAT: Loaded 35382 existing records from primary storage. [2025-09-25T22:29:07.231498] [INFO ] [MAIN ] WAT: Loaded 35382 primary data records. [2025-09-25T22:29:07.456355] [DEBUG] [LOCAL ] WBS: Loaded 49117 existing records from primary storage. [2025-09-25T22:29:07.468808] [INFO ] [MAIN ] WBS: Loaded 49117 primary data records. [2025-09-25T22:29:08.099932] [DEBUG] [MAIN ] WBX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:08.102471] [INFO ] [MAIN ] WBX: Generated 1807 derivative records from 12545 primary records. [2025-09-25T22:29:08.102778] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-25T22:29:08.122793] [DEBUG] [LOCAL ] WBX: Derivative data saved (1807 records). [2025-09-25T22:29:08.123360] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-25T22:29:08.127178] [INFO ] [MAIN ] Derivative Progress: 1951/2043 symbols completed. WBX took 1.1s. Estimated remaining: 38.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:08.127927] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:08.158123] [DEBUG] [MAIN ] WAT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:08.159382] [INFO ] [MAIN ] WAT: Generated 1807 derivative records from 35382 primary records. [2025-09-25T22:29:08.159561] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-25T22:29:08.189237] [DEBUG] [MAIN ] WBS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:08.191476] [INFO ] [MAIN ] WBS: Generated 1807 derivative records from 49117 primary records. [2025-09-25T22:29:08.192816] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-25T22:29:08.194160] [DEBUG] [LOCAL ] WAT: Derivative data saved (1807 records). [2025-09-25T22:29:08.195099] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-25T22:29:08.204481] [INFO ] [MAIN ] Derivative Progress: 1952/2043 symbols completed. WAT took 1.2s. Estimated remaining: 38.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:08.218891] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:08.223577] [DEBUG] [LOCAL ] WBS: Derivative data saved (1807 records). [2025-09-25T22:29:08.224346] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-25T22:29:08.228042] [INFO ] [MAIN ] Derivative Progress: 1953/2043 symbols completed. WBS took 1.2s. Estimated remaining: 37.8s. Rate: 143.0 symbols/min [2025-09-25T22:29:08.229472] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:08.244741] [DEBUG] [LOCAL ] WCC: Loaded 40294 existing records from primary storage. [2025-09-25T22:29:08.246056] [INFO ] [MAIN ] WCC: Loaded 40294 primary data records. [2025-09-25T22:29:08.426526] [DEBUG] [LOCAL ] WD: Loaded 23615 existing records from primary storage. [2025-09-25T22:29:08.452126] [INFO ] [MAIN ] WD: Loaded 23615 primary data records. [2025-09-25T22:29:08.766959] [DEBUG] [LOCAL ] WCN: Loaded 48385 existing records from primary storage. [2025-09-25T22:29:08.779806] [INFO ] [MAIN ] WCN: Loaded 48385 primary data records. [2025-09-25T22:29:09.371019] [DEBUG] [MAIN ] WCC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:09.373367] [INFO ] [MAIN ] WCC: Generated 1807 derivative records from 40294 primary records. [2025-09-25T22:29:09.373683] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-25T22:29:09.398438] [DEBUG] [LOCAL ] WCC: Derivative data saved (1807 records). [2025-09-25T22:29:09.400340] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-25T22:29:09.404115] [INFO ] [MAIN ] Derivative Progress: 1954/2043 symbols completed. WCC took 1.3s. Estimated remaining: 37.4s. Rate: 142.9 symbols/min [2025-09-25T22:29:09.405034] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:09.422118] [DEBUG] [MAIN ] WD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:09.423111] [INFO ] [MAIN ] WD: Generated 1807 derivative records from 23615 primary records. [2025-09-25T22:29:09.423697] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-25T22:29:09.444018] [DEBUG] [LOCAL ] WD: Derivative data saved (1807 records). [2025-09-25T22:29:09.445164] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-25T22:29:09.448027] [INFO ] [MAIN ] Derivative Progress: 1955/2043 symbols completed. WD took 1.2s. Estimated remaining: 36.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:09.453937] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:09.468530] [DEBUG] [MAIN ] WCN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:09.469827] [INFO ] [MAIN ] WCN: Generated 1807 derivative records from 48385 primary records. [2025-09-25T22:29:09.470008] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-25T22:29:09.489539] [DEBUG] [LOCAL ] WDH: Loaded 17486 existing records from primary storage. [2025-09-25T22:29:09.491981] [INFO ] [MAIN ] WDH: Loaded 17486 primary data records. [2025-09-25T22:29:09.494536] [DEBUG] [LOCAL ] WCN: Derivative data saved (1807 records). [2025-09-25T22:29:09.494680] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-25T22:29:09.497742] [INFO ] [MAIN ] Derivative Progress: 1956/2043 symbols completed. WCN took 1.3s. Estimated remaining: 36.5s. Rate: 143.0 symbols/min [2025-09-25T22:29:09.520961] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:09.645962] [DEBUG] [LOCAL ] WEA: Loaded 7359 existing records from primary storage. [2025-09-25T22:29:09.680383] [INFO ] [MAIN ] WEA: Loaded 7359 primary data records. [2025-09-25T22:29:09.946514] [DEBUG] [LOCAL ] WDS: Loaded 43934 existing records from primary storage. [2025-09-25T22:29:09.964914] [INFO ] [MAIN ] WDS: Loaded 43934 primary data records. [2025-09-25T22:29:10.606565] [DEBUG] [MAIN ] WDH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:10.608805] [INFO ] [MAIN ] WDH: Generated 1807 derivative records from 17486 primary records. [2025-09-25T22:29:10.609332] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-25T22:29:10.633827] [DEBUG] [LOCAL ] WDH: Derivative data saved (1807 records). [2025-09-25T22:29:10.635139] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-25T22:29:10.638173] [INFO ] [MAIN ] Derivative Progress: 1957/2043 symbols completed. WDH took 1.2s. Estimated remaining: 36.1s. Rate: 142.9 symbols/min [2025-09-25T22:29:10.639708] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:10.654438] [DEBUG] [MAIN ] WEA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:10.655495] [INFO ] [MAIN ] WEA: Generated 1807 derivative records from 7359 primary records. [2025-09-25T22:29:10.655782] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-25T22:29:10.673905] [DEBUG] [LOCAL ] WEA: Derivative data saved (1807 records). [2025-09-25T22:29:10.675192] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-25T22:29:10.679153] [INFO ] [MAIN ] Derivative Progress: 1958/2043 symbols completed. WEA took 1.2s. Estimated remaining: 35.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:10.679619] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:10.695978] [DEBUG] [MAIN ] WDS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:10.696963] [INFO ] [MAIN ] WDS: Generated 1807 derivative records from 43934 primary records. [2025-09-25T22:29:10.697164] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-25T22:29:10.726108] [DEBUG] [LOCAL ] WDS: Derivative data saved (1807 records). [2025-09-25T22:29:10.726401] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-25T22:29:10.730370] [INFO ] [MAIN ] Derivative Progress: 1959/2043 symbols completed. WDS took 1.3s. Estimated remaining: 35.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:10.730798] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:10.750714] [DEBUG] [LOCAL ] WEAV: Loaded 42256 existing records from primary storage. [2025-09-25T22:29:10.751010] [INFO ] [MAIN ] WEAV: Loaded 42256 primary data records. [2025-09-25T22:29:11.061305] [DEBUG] [LOCAL ] WEC: Loaded 52584 existing records from primary storage. [2025-09-25T22:29:11.145932] [INFO ] [MAIN ] WEC: Loaded 52584 primary data records. [2025-09-25T22:29:11.302107] [DEBUG] [LOCAL ] WELL: Loaded 52744 existing records from primary storage. [2025-09-25T22:29:11.330903] [INFO ] [MAIN ] WELL: Loaded 52744 primary data records. [2025-09-25T22:29:11.850599] [DEBUG] [MAIN ] WEAV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:11.852014] [INFO ] [MAIN ] WEAV: Generated 1807 derivative records from 42256 primary records. [2025-09-25T22:29:11.853277] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-25T22:29:11.876218] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1807 records). [2025-09-25T22:29:11.877457] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-25T22:29:11.880511] [INFO ] [MAIN ] Derivative Progress: 1960/2043 symbols completed. WEAV took 1.2s. Estimated remaining: 34.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:11.881519] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:11.898091] [DEBUG] [MAIN ] WEC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:11.899386] [INFO ] [MAIN ] WEC: Generated 1807 derivative records from 52584 primary records. [2025-09-25T22:29:11.899826] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-25T22:29:11.918306] [DEBUG] [LOCAL ] WEC: Derivative data saved (1807 records). [2025-09-25T22:29:11.918608] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-25T22:29:11.921075] [INFO ] [MAIN ] Derivative Progress: 1961/2043 symbols completed. WEC took 1.2s. Estimated remaining: 34.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:11.921959] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:11.940368] [DEBUG] [MAIN ] WELL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:11.941350] [INFO ] [MAIN ] WELL: Generated 1807 derivative records from 52744 primary records. [2025-09-25T22:29:11.941525] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-25T22:29:11.959461] [DEBUG] [LOCAL ] WELL: Derivative data saved (1807 records). [2025-09-25T22:29:11.959713] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-25T22:29:11.964136] [INFO ] [MAIN ] Derivative Progress: 1962/2043 symbols completed. WELL took 1.2s. Estimated remaining: 34.0s. Rate: 143.0 symbols/min [2025-09-25T22:29:11.964737] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:11.999702] [DEBUG] [LOCAL ] WF: Loaded 10863 existing records from primary storage. [2025-09-25T22:29:12.014368] [INFO ] [MAIN ] WF: Loaded 10863 primary data records. [2025-09-25T22:29:12.096314] [DEBUG] [LOCAL ] WES: Loaded 48352 existing records from primary storage. [2025-09-25T22:29:12.109321] [INFO ] [MAIN ] WES: Loaded 48352 primary data records. [2025-09-25T22:29:12.120854] [DEBUG] [LOCAL ] WEX: Loaded 35516 existing records from primary storage. [2025-09-25T22:29:12.159889] [INFO ] [MAIN ] WEX: Loaded 35516 primary data records. [2025-09-25T22:29:13.173768] [DEBUG] [MAIN ] WF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:13.175017] [INFO ] [MAIN ] WF: Generated 1807 derivative records from 10863 primary records. [2025-09-25T22:29:13.188957] [DEBUG] [MAIN ] WES: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:13.189985] [INFO ] [MAIN ] WES: Generated 1807 derivative records from 48352 primary records. [2025-09-25T22:29:13.188616] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-25T22:29:13.190415] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-25T22:29:13.211163] [DEBUG] [LOCAL ] WF: Derivative data saved (1807 records). [2025-09-25T22:29:13.222357] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-25T22:29:13.232348] [DEBUG] [LOCAL ] WES: Derivative data saved (1807 records). [2025-09-25T22:29:13.235296] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-25T22:29:13.235124] [INFO ] [MAIN ] Derivative Progress: 1963/2043 symbols completed. WF took 1.3s. Estimated remaining: 33.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:13.240261] [INFO ] [MAIN ] Derivative Progress: 1964/2043 symbols completed. WES took 1.4s. Estimated remaining: 33.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:13.254269] [DEBUG] [MAIN ] WEX: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:13.255335] [INFO ] [MAIN ] WEX: Generated 1807 derivative records from 35516 primary records. [2025-09-25T22:29:13.255404] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-25T22:29:13.271470] [DEBUG] [LOCAL ] WEX: Derivative data saved (1807 records). [2025-09-25T22:29:13.271542] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-25T22:29:13.275462] [INFO ] [MAIN ] Derivative Progress: 1965/2043 symbols completed. WEX took 1.4s. Estimated remaining: 32.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:13.276411] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:13.276521] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:13.276820] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:13.316688] [DEBUG] [LOCAL ] WFG: Loaded 25074 existing records from primary storage. [2025-09-25T22:29:13.316936] [INFO ] [MAIN ] WFG: Loaded 25074 primary data records. [2025-09-25T22:29:13.464901] [DEBUG] [LOCAL ] WGO: Loaded 39576 existing records from primary storage. [2025-09-25T22:29:13.475569] [INFO ] [MAIN ] WGO: Loaded 39576 primary data records. [2025-09-25T22:29:13.803908] [DEBUG] [LOCAL ] WFC: Loaded 54138 existing records from primary storage. [2025-09-25T22:29:13.818702] [INFO ] [MAIN ] WFC: Loaded 54138 primary data records. [2025-09-25T22:29:14.394900] [DEBUG] [MAIN ] WFG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:14.397341] [INFO ] [MAIN ] WFG: Generated 1807 derivative records from 25074 primary records. [2025-09-25T22:29:14.397864] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-25T22:29:14.422636] [DEBUG] [LOCAL ] WFG: Derivative data saved (1807 records). [2025-09-25T22:29:14.423114] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-25T22:29:14.425900] [INFO ] [MAIN ] Derivative Progress: 1966/2043 symbols completed. WFG took 1.1s. Estimated remaining: 32.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:14.439817] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:14.440917] [DEBUG] [MAIN ] WGO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:14.442898] [INFO ] [MAIN ] WGO: Generated 1807 derivative records from 39576 primary records. [2025-09-25T22:29:14.443511] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-25T22:29:14.463011] [DEBUG] [LOCAL ] WGO: Derivative data saved (1807 records). [2025-09-25T22:29:14.463503] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-25T22:29:14.466361] [INFO ] [MAIN ] Derivative Progress: 1967/2043 symbols completed. WGO took 1.2s. Estimated remaining: 31.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:14.481680] [DEBUG] [MAIN ] WFC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:14.483218] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:14.482835] [INFO ] [MAIN ] WFC: Generated 1807 derivative records from 54138 primary records. [2025-09-25T22:29:14.483508] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-25T22:29:14.502621] [DEBUG] [LOCAL ] WFC: Derivative data saved (1807 records). [2025-09-25T22:29:14.502977] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-25T22:29:14.507066] [INFO ] [MAIN ] Derivative Progress: 1968/2043 symbols completed. WFC took 1.2s. Estimated remaining: 31.5s. Rate: 143.0 symbols/min [2025-09-25T22:29:14.507503] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:14.526671] [DEBUG] [LOCAL ] WHG: Loaded 3397 existing records from primary storage. [2025-09-25T22:29:14.527075] [INFO ] [MAIN ] WHG: Loaded 3397 primary data records. [2025-09-25T22:29:14.690435] [DEBUG] [LOCAL ] WH: Loaded 46030 existing records from primary storage. [2025-09-25T22:29:14.691880] [INFO ] [MAIN ] WH: Loaded 46030 primary data records. [2025-09-25T22:29:14.839698] [DEBUG] [LOCAL ] WHD: Loaded 40871 existing records from primary storage. [2025-09-25T22:29:14.908697] [INFO ] [MAIN ] WHD: Loaded 40871 primary data records. [2025-09-25T22:29:15.680910] [DEBUG] [MAIN ] WHG: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:29:15.681385] [DEBUG] [MAIN ] WH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:15.682738] [INFO ] [MAIN ] WHG: Generated 1806 derivative records from 3397 primary records. [2025-09-25T22:29:15.683206] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-25T22:29:15.684284] [INFO ] [MAIN ] WH: Generated 1807 derivative records from 46030 primary records. [2025-09-25T22:29:15.685922] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-25T22:29:15.715941] [DEBUG] [LOCAL ] WHG: Derivative data saved (1806 records). [2025-09-25T22:29:15.716673] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-25T22:29:15.721993] [INFO ] [MAIN ] Derivative Progress: 1969/2043 symbols completed. WHG took 1.2s. Estimated remaining: 31.1s. Rate: 142.9 symbols/min [2025-09-25T22:29:15.723398] [DEBUG] [LOCAL ] WH: Derivative data saved (1807 records). [2025-09-25T22:29:15.724261] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:15.723948] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-25T22:29:15.728213] [INFO ] [MAIN ] Derivative Progress: 1970/2043 symbols completed. WH took 1.3s. Estimated remaining: 30.6s. Rate: 143.0 symbols/min [2025-09-25T22:29:15.729676] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:15.749355] [DEBUG] [MAIN ] WHD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:15.750357] [INFO ] [MAIN ] WHD: Generated 1807 derivative records from 40871 primary records. [2025-09-25T22:29:15.750578] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-25T22:29:15.755638] [DEBUG] [LOCAL ] WIA: Loaded 4901 existing records from primary storage. [2025-09-25T22:29:15.764613] [INFO ] [MAIN ] WIA: Loaded 4901 primary data records. [2025-09-25T22:29:15.785246] [DEBUG] [LOCAL ] WHD: Derivative data saved (1807 records). [2025-09-25T22:29:15.797180] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-25T22:29:15.817358] [INFO ] [MAIN ] Derivative Progress: 1971/2043 symbols completed. WHD took 1.3s. Estimated remaining: 30.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:15.823746] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:15.960038] [DEBUG] [LOCAL ] WINN: Loaded 11895 existing records from primary storage. [2025-09-25T22:29:15.984779] [INFO ] [MAIN ] WINN: Loaded 11895 primary data records. [2025-09-25T22:29:16.196203] [DEBUG] [LOCAL ] WHR: Loaded 48496 existing records from primary storage. [2025-09-25T22:29:16.218342] [INFO ] [MAIN ] WHR: Loaded 48496 primary data records. [2025-09-25T22:29:16.843300] [DEBUG] [MAIN ] WIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:16.845040] [INFO ] [MAIN ] WIA: Generated 1807 derivative records from 4901 primary records. [2025-09-25T22:29:16.846315] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-25T22:29:16.864466] [DEBUG] [LOCAL ] WIA: Derivative data saved (1807 records). [2025-09-25T22:29:16.864880] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-25T22:29:16.867787] [INFO ] [MAIN ] Derivative Progress: 1972/2043 symbols completed. WIA took 1.1s. Estimated remaining: 29.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:16.869335] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:16.890962] [DEBUG] [MAIN ] WINN: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:29:16.892052] [INFO ] [MAIN ] WINN: Generated 1806 derivative records from 11895 primary records. [2025-09-25T22:29:16.892556] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-25T22:29:16.915826] [DEBUG] [LOCAL ] WINN: Derivative data saved (1806 records). [2025-09-25T22:29:16.930149] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-25T22:29:16.930694] [DEBUG] [MAIN ] WHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:16.934345] [INFO ] [MAIN ] Derivative Progress: 1973/2043 symbols completed. WINN took 1.1s. Estimated remaining: 29.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:16.935598] [INFO ] [MAIN ] WHR: Generated 1807 derivative records from 48496 primary records. [2025-09-25T22:29:16.936055] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-25T22:29:16.936309] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:16.954958] [DEBUG] [LOCAL ] WHR: Derivative data saved (1807 records). [2025-09-25T22:29:16.955166] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-25T22:29:16.958722] [INFO ] [MAIN ] Derivative Progress: 1974/2043 symbols completed. WHR took 1.2s. Estimated remaining: 28.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:16.959695] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:16.993076] [DEBUG] [LOCAL ] WIW: Loaded 20711 existing records from primary storage. [2025-09-25T22:29:17.010573] [INFO ] [MAIN ] WIW: Loaded 20711 primary data records. [2025-09-25T22:29:17.035866] [DEBUG] [LOCAL ] WIT: Loaded 52681 existing records from primary storage. [2025-09-25T22:29:17.062467] [INFO ] [MAIN ] WIT: Loaded 52681 primary data records. [2025-09-25T22:29:17.299446] [DEBUG] [LOCAL ] WK: Loaded 37017 existing records from primary storage. [2025-09-25T22:29:17.363184] [INFO ] [MAIN ] WK: Loaded 37017 primary data records. [2025-09-25T22:29:18.127953] [DEBUG] [MAIN ] WIW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:18.129144] [INFO ] [MAIN ] WIW: Generated 1807 derivative records from 20711 primary records. [2025-09-25T22:29:18.129405] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-25T22:29:18.159410] [DEBUG] [LOCAL ] WIW: Derivative data saved (1807 records). [2025-09-25T22:29:18.165143] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-25T22:29:18.165502] [DEBUG] [MAIN ] WIT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:18.167939] [INFO ] [MAIN ] Derivative Progress: 1975/2043 symbols completed. WIW took 1.2s. Estimated remaining: 28.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:18.169565] [INFO ] [MAIN ] WIT: Generated 1807 derivative records from 52681 primary records. [2025-09-25T22:29:18.170141] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-25T22:29:18.169958] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:18.193446] [DEBUG] [LOCAL ] WIT: Derivative data saved (1807 records). [2025-09-25T22:29:18.193822] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-25T22:29:18.204905] [INFO ] [MAIN ] Derivative Progress: 1976/2043 symbols completed. WIT took 1.3s. Estimated remaining: 28.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:18.210467] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:18.210883] [DEBUG] [MAIN ] WK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:18.212634] [INFO ] [MAIN ] WK: Generated 1807 derivative records from 37017 primary records. [2025-09-25T22:29:18.212828] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-25T22:29:18.231575] [DEBUG] [LOCAL ] WK: Derivative data saved (1807 records). [2025-09-25T22:29:18.231790] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-25T22:29:18.235528] [INFO ] [MAIN ] Derivative Progress: 1977/2043 symbols completed. WK took 1.3s. Estimated remaining: 27.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:18.246700] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:18.265111] [DEBUG] [LOCAL ] WKC: Loaded 35324 existing records from primary storage. [2025-09-25T22:29:18.265489] [INFO ] [MAIN ] WKC: Loaded 35324 primary data records. [2025-09-25T22:29:18.303541] [DEBUG] [LOCAL ] WLKP: Loaded 6741 existing records from primary storage. [2025-09-25T22:29:18.333727] [INFO ] [MAIN ] WLKP: Loaded 6741 primary data records. [2025-09-25T22:29:18.583824] [DEBUG] [LOCAL ] WLK: Loaded 45752 existing records from primary storage. [2025-09-25T22:29:18.649070] [INFO ] [MAIN ] WLK: Loaded 45752 primary data records. [2025-09-25T22:29:19.350568] [DEBUG] [MAIN ] WKC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:19.353251] [INFO ] [MAIN ] WKC: Generated 1807 derivative records from 35324 primary records. [2025-09-25T22:29:19.354030] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-25T22:29:19.374199] [DEBUG] [LOCAL ] WKC: Derivative data saved (1807 records). [2025-09-25T22:29:19.374858] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-25T22:29:19.377681] [INFO ] [MAIN ] Derivative Progress: 1978/2043 symbols completed. WKC took 1.2s. Estimated remaining: 27.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:19.391858] [DEBUG] [MAIN ] WLKP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:19.392840] [INFO ] [MAIN ] WLKP: Generated 1807 derivative records from 6741 primary records. [2025-09-25T22:29:19.393115] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-25T22:29:19.412635] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1807 records). [2025-09-25T22:29:19.412831] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-25T22:29:19.415621] [INFO ] [MAIN ] Derivative Progress: 1979/2043 symbols completed. WLKP took 1.2s. Estimated remaining: 26.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:19.429107] [DEBUG] [MAIN ] WLK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:19.429982] [INFO ] [MAIN ] WLK: Generated 1807 derivative records from 45752 primary records. [2025-09-25T22:29:19.430054] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-25T22:29:19.446146] [DEBUG] [LOCAL ] WLK: Derivative data saved (1807 records). [2025-09-25T22:29:19.446212] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-25T22:29:19.458448] [INFO ] [MAIN ] Derivative Progress: 1980/2043 symbols completed. WLK took 1.2s. Estimated remaining: 26.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:19.459239] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:19.459730] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:19.459634] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:19.522639] [DEBUG] [LOCAL ] WLY: Loaded 30208 existing records from primary storage. [2025-09-25T22:29:19.523046] [INFO ] [MAIN ] WLY: Loaded 30208 primary data records. [2025-09-25T22:29:19.753368] [DEBUG] [LOCAL ] WMB: Loaded 54061 existing records from primary storage. [2025-09-25T22:29:19.766748] [INFO ] [MAIN ] WMB: Loaded 54061 primary data records. [2025-09-25T22:29:19.814002] [DEBUG] [LOCAL ] WM: Loaded 51342 existing records from primary storage. [2025-09-25T22:29:19.926946] [INFO ] [MAIN ] WM: Loaded 51342 primary data records. [2025-09-25T22:29:20.646178] [DEBUG] [MAIN ] WLY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:20.649829] [INFO ] [MAIN ] WLY: Generated 1807 derivative records from 30208 primary records. [2025-09-25T22:29:20.650284] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-25T22:29:20.672778] [DEBUG] [LOCAL ] WLY: Derivative data saved (1807 records). [2025-09-25T22:29:20.673702] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-25T22:29:20.676236] [INFO ] [MAIN ] Derivative Progress: 1981/2043 symbols completed. WLY took 1.2s. Estimated remaining: 26.0s. Rate: 142.9 symbols/min [2025-09-25T22:29:20.679296] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:20.694715] [DEBUG] [MAIN ] WMB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:20.704029] [INFO ] [MAIN ] WMB: Generated 1807 derivative records from 54061 primary records. [2025-09-25T22:29:20.709274] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-25T22:29:20.709783] [DEBUG] [MAIN ] WM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:20.712043] [INFO ] [MAIN ] WM: Generated 1807 derivative records from 51342 primary records. [2025-09-25T22:29:20.719492] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-25T22:29:20.729100] [DEBUG] [LOCAL ] WMB: Derivative data saved (1807 records). [2025-09-25T22:29:20.745515] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-25T22:29:20.748486] [INFO ] [MAIN ] Derivative Progress: 1982/2043 symbols completed. WMB took 1.3s. Estimated remaining: 25.6s. Rate: 143.0 symbols/min [2025-09-25T22:29:20.751046] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:20.754125] [DEBUG] [LOCAL ] WM: Derivative data saved (1807 records). [2025-09-25T22:29:20.761046] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-25T22:29:20.764616] [INFO ] [MAIN ] Derivative Progress: 1983/2043 symbols completed. WM took 1.3s. Estimated remaining: 25.2s. Rate: 143.0 symbols/min [2025-09-25T22:29:20.760945] [DEBUG] [LOCAL ] WMK: Loaded 14634 existing records from primary storage. [2025-09-25T22:29:20.765425] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:20.765313] [INFO ] [MAIN ] WMK: Loaded 14634 primary data records. [2025-09-25T22:29:21.137074] [DEBUG] [LOCAL ] WMS: Loaded 39993 existing records from primary storage. [2025-09-25T22:29:21.138293] [INFO ] [MAIN ] WMS: Loaded 39993 primary data records. [2025-09-25T22:29:21.272721] [DEBUG] [LOCAL ] WMT: Loaded 54190 existing records from primary storage. [2025-09-25T22:29:21.278629] [INFO ] [MAIN ] WMT: Loaded 54190 primary data records. [2025-09-25T22:29:21.681934] [DEBUG] [MAIN ] WMK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:21.709185] [INFO ] [MAIN ] WMK: Generated 1807 derivative records from 14634 primary records. [2025-09-25T22:29:21.777919] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-25T22:29:21.936724] [DEBUG] [LOCAL ] WMK: Derivative data saved (1807 records). [2025-09-25T22:29:21.937822] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-25T22:29:21.940543] [INFO ] [MAIN ] Derivative Progress: 1984/2043 symbols completed. WMK took 1.3s. Estimated remaining: 24.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:21.941504] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:21.965107] [DEBUG] [MAIN ] WMS: Filtered 6966 bins outside market hours, 7760 incomplete bins [2025-09-25T22:29:21.966246] [INFO ] [MAIN ] WMS: Generated 1806 derivative records from 39993 primary records. [2025-09-25T22:29:21.967360] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-25T22:29:21.996925] [DEBUG] [MAIN ] WMT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:22.002369] [INFO ] [MAIN ] WMT: Generated 1807 derivative records from 54190 primary records. [2025-09-25T22:29:22.003008] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-25T22:29:22.004252] [DEBUG] [LOCAL ] WMS: Derivative data saved (1806 records). [2025-09-25T22:29:22.005622] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-25T22:29:22.008051] [INFO ] [MAIN ] Derivative Progress: 1985/2043 symbols completed. WMS took 1.3s. Estimated remaining: 24.3s. Rate: 143.0 symbols/min [2025-09-25T22:29:22.027251] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:22.037007] [DEBUG] [LOCAL ] WMT: Derivative data saved (1807 records). [2025-09-25T22:29:22.038119] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-25T22:29:22.041907] [INFO ] [MAIN ] Derivative Progress: 1986/2043 symbols completed. WMT took 1.3s. Estimated remaining: 23.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:22.042617] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:22.056565] [DEBUG] [LOCAL ] WNC: Loaded 40262 existing records from primary storage. [2025-09-25T22:29:22.056974] [INFO ] [MAIN ] WNC: Loaded 40262 primary data records. [2025-09-25T22:29:22.404716] [DEBUG] [LOCAL ] WNS: Loaded 40320 existing records from primary storage. [2025-09-25T22:29:22.421385] [INFO ] [MAIN ] WNS: Loaded 40320 primary data records. [2025-09-25T22:29:22.586728] [DEBUG] [LOCAL ] WOLF: Loaded 53922 existing records from primary storage. [2025-09-25T22:29:22.621719] [INFO ] [MAIN ] WOLF: Loaded 53922 primary data records. [2025-09-25T22:29:23.136211] [DEBUG] [MAIN ] WNC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:23.138531] [INFO ] [MAIN ] WNC: Generated 1807 derivative records from 40262 primary records. [2025-09-25T22:29:23.138895] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-25T22:29:23.160077] [DEBUG] [LOCAL ] WNC: Derivative data saved (1807 records). [2025-09-25T22:29:23.160521] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-25T22:29:23.164591] [INFO ] [MAIN ] Derivative Progress: 1987/2043 symbols completed. WNC took 1.2s. Estimated remaining: 23.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:23.168528] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:23.183628] [DEBUG] [MAIN ] WNS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:23.184793] [INFO ] [MAIN ] WNS: Generated 1807 derivative records from 40320 primary records. [2025-09-25T22:29:23.185460] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-25T22:29:23.204535] [DEBUG] [LOCAL ] WNS: Derivative data saved (1807 records). [2025-09-25T22:29:23.204982] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-25T22:29:23.208102] [INFO ] [MAIN ] Derivative Progress: 1988/2043 symbols completed. WNS took 1.2s. Estimated remaining: 23.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:23.208525] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:23.234814] [DEBUG] [MAIN ] WOLF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:23.235857] [INFO ] [MAIN ] WOLF: Generated 1807 derivative records from 53922 primary records. [2025-09-25T22:29:23.235971] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-25T22:29:23.265634] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1807 records). [2025-09-25T22:29:23.276023] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-25T22:29:23.279952] [INFO ] [MAIN ] Derivative Progress: 1989/2043 symbols completed. WOLF took 1.2s. Estimated remaining: 22.7s. Rate: 143.0 symbols/min [2025-09-25T22:29:23.275764] [DEBUG] [LOCAL ] WOR: Loaded 25005 existing records from primary storage. [2025-09-25T22:29:23.280579] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:23.280694] [INFO ] [MAIN ] WOR: Loaded 25005 primary data records. [2025-09-25T22:29:23.413853] [DEBUG] [LOCAL ] WOW: Loaded 30492 existing records from primary storage. [2025-09-25T22:29:23.414286] [INFO ] [MAIN ] WOW: Loaded 30492 primary data records. [2025-09-25T22:29:23.832884] [DEBUG] [LOCAL ] WPC: Loaded 48858 existing records from primary storage. [2025-09-25T22:29:23.856380] [INFO ] [MAIN ] WPC: Loaded 48858 primary data records. [2025-09-25T22:29:24.467184] [DEBUG] [MAIN ] WOR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:24.469620] [INFO ] [MAIN ] WOR: Generated 1807 derivative records from 25005 primary records. [2025-09-25T22:29:24.469799] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-25T22:29:24.493933] [DEBUG] [LOCAL ] WOR: Derivative data saved (1807 records). [2025-09-25T22:29:24.494269] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-25T22:29:24.496760] [INFO ] [MAIN ] Derivative Progress: 1990/2043 symbols completed. WOR took 1.3s. Estimated remaining: 22.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:24.503162] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:24.513294] [DEBUG] [MAIN ] WOW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:24.514499] [INFO ] [MAIN ] WOW: Generated 1807 derivative records from 30492 primary records. [2025-09-25T22:29:24.514805] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-25T22:29:24.548429] [DEBUG] [LOCAL ] WOW: Derivative data saved (1807 records). [2025-09-25T22:29:24.548810] [DEBUG] [MAIN ] WPC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:24.549015] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-25T22:29:24.552260] [INFO ] [MAIN ] Derivative Progress: 1991/2043 symbols completed. WOW took 1.3s. Estimated remaining: 21.8s. Rate: 143.0 symbols/min [2025-09-25T22:29:24.549856] [INFO ] [MAIN ] WPC: Generated 1807 derivative records from 48858 primary records. [2025-09-25T22:29:24.552573] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-25T22:29:24.553741] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:24.572679] [DEBUG] [LOCAL ] WPC: Derivative data saved (1807 records). [2025-09-25T22:29:24.572864] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-25T22:29:24.576713] [INFO ] [MAIN ] Derivative Progress: 1992/2043 symbols completed. WPC took 1.3s. Estimated remaining: 21.4s. Rate: 143.0 symbols/min [2025-09-25T22:29:24.577339] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:24.626085] [DEBUG] [LOCAL ] WPP: Loaded 34018 existing records from primary storage. [2025-09-25T22:29:24.641269] [INFO ] [MAIN ] WPP: Loaded 34018 primary data records. [2025-09-25T22:29:24.642186] [DEBUG] [LOCAL ] WPM: Loaded 53121 existing records from primary storage. [2025-09-25T22:29:24.681670] [INFO ] [MAIN ] WPM: Loaded 53121 primary data records. [2025-09-25T22:29:25.009394] [DEBUG] [LOCAL ] WRB: Loaded 50934 existing records from primary storage. [2025-09-25T22:29:25.063873] [INFO ] [MAIN ] WRB: Loaded 50934 primary data records. [2025-09-25T22:29:25.978006] [DEBUG] [MAIN ] WPM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:25.997854] [INFO ] [MAIN ] WPM: Generated 1807 derivative records from 53121 primary records. [2025-09-25T22:29:25.999274] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-25T22:29:25.999064] [DEBUG] [MAIN ] WPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:26.005875] [INFO ] [MAIN ] WPP: Generated 1807 derivative records from 34018 primary records. [2025-09-25T22:29:26.022523] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-25T22:29:26.043923] [DEBUG] [LOCAL ] WPM: Derivative data saved (1807 records). [2025-09-25T22:29:26.049505] [DEBUG] [LOCAL ] WPP: Derivative data saved (1807 records). [2025-09-25T22:29:26.050355] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-25T22:29:26.050242] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-25T22:29:26.054604] [INFO ] [MAIN ] Derivative Progress: 1993/2043 symbols completed. WPP took 1.5s. Estimated remaining: 21.0s. Rate: 142.8 symbols/min [2025-09-25T22:29:26.062701] [INFO ] [MAIN ] Derivative Progress: 1994/2043 symbols completed. WPM took 1.6s. Estimated remaining: 20.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:26.079181] [DEBUG] [MAIN ] WRB: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:26.080228] [INFO ] [MAIN ] WRB: Generated 1807 derivative records from 50934 primary records. [2025-09-25T22:29:26.080317] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-25T22:29:26.097478] [DEBUG] [LOCAL ] WRB: Derivative data saved (1807 records). [2025-09-25T22:29:26.097694] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-25T22:29:26.101388] [INFO ] [MAIN ] Derivative Progress: 1995/2043 symbols completed. WRB took 1.5s. Estimated remaining: 20.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:26.102737] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:26.102993] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:26.104203] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:26.147090] [DEBUG] [LOCAL ] WS: Loaded 24167 existing records from primary storage. [2025-09-25T22:29:26.147444] [INFO ] [MAIN ] WS: Loaded 24167 primary data records. [2025-09-25T22:29:26.353429] [DEBUG] [LOCAL ] WRBY: Loaded 51247 existing records from primary storage. [2025-09-25T22:29:26.354708] [INFO ] [MAIN ] WRBY: Loaded 51247 primary data records. [2025-09-25T22:29:26.366915] [DEBUG] [LOCAL ] WSM: Loaded 50211 existing records from primary storage. [2025-09-25T22:29:26.377800] [INFO ] [MAIN ] WSM: Loaded 50211 primary data records. [2025-09-25T22:29:27.338281] [DEBUG] [MAIN ] WS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:27.339609] [INFO ] [MAIN ] WS: Generated 1807 derivative records from 24167 primary records. [2025-09-25T22:29:27.339809] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-25T22:29:27.359473] [DEBUG] [LOCAL ] WS: Derivative data saved (1807 records). [2025-09-25T22:29:27.362269] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-25T22:29:27.366572] [INFO ] [MAIN ] Derivative Progress: 1996/2043 symbols completed. WS took 1.3s. Estimated remaining: 19.7s. Rate: 142.8 symbols/min [2025-09-25T22:29:27.367100] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:27.384258] [DEBUG] [MAIN ] WRBY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:27.385620] [INFO ] [MAIN ] WRBY: Generated 1807 derivative records from 51247 primary records. [2025-09-25T22:29:27.385965] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-25T22:29:27.409903] [DEBUG] [MAIN ] WSM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:27.414961] [INFO ] [MAIN ] WSM: Generated 1807 derivative records from 50211 primary records. [2025-09-25T22:29:27.416683] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-25T22:29:27.419864] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1807 records). [2025-09-25T22:29:27.420601] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-25T22:29:27.423719] [INFO ] [MAIN ] Derivative Progress: 1997/2043 symbols completed. WRBY took 1.3s. Estimated remaining: 19.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:27.432229] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:27.449471] [DEBUG] [LOCAL ] WSM: Derivative data saved (1807 records). [2025-09-25T22:29:27.449678] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-25T22:29:27.452548] [INFO ] [MAIN ] Derivative Progress: 1998/2043 symbols completed. WSM took 1.3s. Estimated remaining: 18.9s. Rate: 143.0 symbols/min [2025-09-25T22:29:27.453155] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:27.463163] [DEBUG] [LOCAL ] WSO: Loaded 24870 existing records from primary storage. [2025-09-25T22:29:27.463430] [INFO ] [MAIN ] WSO: Loaded 24870 primary data records. [2025-09-25T22:29:27.591995] [DEBUG] [LOCAL ] WSR: Loaded 23424 existing records from primary storage. [2025-09-25T22:29:27.685171] [INFO ] [MAIN ] WSR: Loaded 23424 primary data records. [2025-09-25T22:29:27.904732] [DEBUG] [LOCAL ] WST: Loaded 37866 existing records from primary storage. [2025-09-25T22:29:27.910457] [INFO ] [MAIN ] WST: Loaded 37866 primary data records. [2025-09-25T22:29:28.544313] [DEBUG] [MAIN ] WSO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:28.547156] [INFO ] [MAIN ] WSO: Generated 1807 derivative records from 24870 primary records. [2025-09-25T22:29:28.547320] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-25T22:29:28.568385] [DEBUG] [LOCAL ] WSO: Derivative data saved (1807 records). [2025-09-25T22:29:28.568931] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-25T22:29:28.571808] [INFO ] [MAIN ] Derivative Progress: 1999/2043 symbols completed. WSO took 1.2s. Estimated remaining: 18.5s. Rate: 142.8 symbols/min [2025-09-25T22:29:28.572624] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:28.594707] [DEBUG] [MAIN ] WSR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:28.596014] [INFO ] [MAIN ] WSR: Generated 1807 derivative records from 23424 primary records. [2025-09-25T22:29:28.596283] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-25T22:29:28.611268] [DEBUG] [MAIN ] WST: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:28.612716] [INFO ] [MAIN ] WST: Generated 1807 derivative records from 37866 primary records. [2025-09-25T22:29:28.612825] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-25T22:29:28.650867] [DEBUG] [LOCAL ] WSR: Derivative data saved (1807 records). [2025-09-25T22:29:28.651866] [DEBUG] [LOCAL ] WST: Derivative data saved (1807 records). [2025-09-25T22:29:28.652127] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-25T22:29:28.652216] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-25T22:29:28.655052] [INFO ] [MAIN ] Derivative Progress: 2000/2043 symbols completed. WSR took 1.2s. Estimated remaining: 18.1s. Rate: 142.9 symbols/min [2025-09-25T22:29:28.655393] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:28.659064] [INFO ] [MAIN ] Derivative Progress: 2001/2043 symbols completed. WST took 1.2s. Estimated remaining: 17.6s. Rate: 143.0 symbols/min [2025-09-25T22:29:28.660169] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:28.708326] [DEBUG] [LOCAL ] WT: Loaded 47993 existing records from primary storage. [2025-09-25T22:29:28.708665] [INFO ] [MAIN ] WT: Loaded 47993 primary data records. [2025-09-25T22:29:28.887293] [DEBUG] [LOCAL ] WTI: Loaded 44092 existing records from primary storage. [2025-09-25T22:29:28.899356] [INFO ] [MAIN ] WTI: Loaded 44092 primary data records. [2025-09-25T22:29:28.920903] [DEBUG] [LOCAL ] WTRG: Loaded 51278 existing records from primary storage. [2025-09-25T22:29:28.941586] [INFO ] [MAIN ] WTRG: Loaded 51278 primary data records. [2025-09-25T22:29:29.888408] [DEBUG] [MAIN ] WT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:29.890084] [INFO ] [MAIN ] WT: Generated 1807 derivative records from 47993 primary records. [2025-09-25T22:29:29.890200] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-25T22:29:29.917546] [DEBUG] [LOCAL ] WT: Derivative data saved (1807 records). [2025-09-25T22:29:29.917786] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-25T22:29:29.921204] [INFO ] [MAIN ] Derivative Progress: 2002/2043 symbols completed. WT took 1.3s. Estimated remaining: 17.2s. Rate: 142.8 symbols/min [2025-09-25T22:29:29.921979] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:29.942694] [DEBUG] [MAIN ] WTRG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:29.943694] [INFO ] [MAIN ] WTRG: Generated 1807 derivative records from 51278 primary records. [2025-09-25T22:29:29.944000] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-25T22:29:29.970718] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1807 records). [2025-09-25T22:29:29.983994] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-25T22:29:29.985118] [DEBUG] [MAIN ] WTI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:29.988027] [INFO ] [MAIN ] Derivative Progress: 2003/2043 symbols completed. WTRG took 1.3s. Estimated remaining: 16.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:29.989133] [INFO ] [MAIN ] WTI: Generated 1807 derivative records from 44092 primary records. [2025-09-25T22:29:29.996616] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:29.996790] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-25T22:29:29.998547] [DEBUG] [LOCAL ] WTS: Loaded 18543 existing records from primary storage. [2025-09-25T22:29:29.999123] [INFO ] [MAIN ] WTS: Loaded 18543 primary data records. [2025-09-25T22:29:30.201783] [DEBUG] [LOCAL ] WTI: Derivative data saved (1807 records). [2025-09-25T22:29:30.224729] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-25T22:29:30.382469] [INFO ] [MAIN ] Derivative Progress: 2004/2043 symbols completed. WTI took 1.7s. Estimated remaining: 16.4s. Rate: 142.9 symbols/min [2025-09-25T22:29:30.383974] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:30.386945] [DEBUG] [LOCAL ] WTTR: Loaded 45381 existing records from primary storage. [2025-09-25T22:29:30.387466] [INFO ] [MAIN ] WTTR: Loaded 45381 primary data records. [2025-09-25T22:29:30.821943] [DEBUG] [LOCAL ] WU: Loaded 53843 existing records from primary storage. [2025-09-25T22:29:30.823275] [INFO ] [MAIN ] WU: Loaded 53843 primary data records. [2025-09-25T22:29:30.956933] [DEBUG] [MAIN ] WTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:30.981610] [INFO ] [MAIN ] WTS: Generated 1807 derivative records from 18543 primary records. [2025-09-25T22:29:31.027298] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-25T22:29:31.192760] [DEBUG] [LOCAL ] WTS: Derivative data saved (1807 records). [2025-09-25T22:29:31.194249] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-25T22:29:31.197807] [INFO ] [MAIN ] Derivative Progress: 2005/2043 symbols completed. WTS took 1.3s. Estimated remaining: 16.0s. Rate: 142.8 symbols/min [2025-09-25T22:29:31.198924] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:31.218634] [DEBUG] [MAIN ] WTTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:31.219681] [INFO ] [MAIN ] WTTR: Generated 1807 derivative records from 45381 primary records. [2025-09-25T22:29:31.220396] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-25T22:29:31.239735] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1807 records). [2025-09-25T22:29:31.240164] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-25T22:29:31.244494] [INFO ] [MAIN ] Derivative Progress: 2006/2043 symbols completed. WTTR took 1.2s. Estimated remaining: 15.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:31.245449] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:31.266469] [DEBUG] [MAIN ] WU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:31.267425] [INFO ] [MAIN ] WU: Generated 1807 derivative records from 53843 primary records. [2025-09-25T22:29:31.267632] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-25T22:29:31.284349] [DEBUG] [LOCAL ] WU: Derivative data saved (1807 records). [2025-09-25T22:29:31.297101] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-25T22:29:31.300300] [INFO ] [MAIN ] Derivative Progress: 2007/2043 symbols completed. WU took 0.9s. Estimated remaining: 15.1s. Rate: 143.0 symbols/min [2025-09-25T22:29:31.300766] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:31.323698] [DEBUG] [LOCAL ] WWW: Loaded 49549 existing records from primary storage. [2025-09-25T22:29:31.324000] [INFO ] [MAIN ] WWW: Loaded 49549 primary data records. [2025-09-25T22:29:31.711478] [DEBUG] [LOCAL ] WY: Loaded 53509 existing records from primary storage. [2025-09-25T22:29:31.704414] [DEBUG] [LOCAL ] XFLT: Loaded 30152 existing records from primary storage. [2025-09-25T22:29:31.711737] [INFO ] [MAIN ] WY: Loaded 53509 primary data records. [2025-09-25T22:29:31.720832] [INFO ] [MAIN ] XFLT: Loaded 30152 primary data records. [2025-09-25T22:29:32.404211] [DEBUG] [MAIN ] WWW: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:32.407437] [INFO ] [MAIN ] WWW: Generated 1807 derivative records from 49549 primary records. [2025-09-25T22:29:32.407739] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-25T22:29:32.431385] [DEBUG] [LOCAL ] WWW: Derivative data saved (1807 records). [2025-09-25T22:29:32.432326] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-25T22:29:32.435512] [INFO ] [MAIN ] Derivative Progress: 2008/2043 symbols completed. WWW took 1.2s. Estimated remaining: 14.7s. Rate: 142.8 symbols/min [2025-09-25T22:29:32.454858] [DEBUG] [MAIN ] WY: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:32.457364] [INFO ] [MAIN ] WY: Generated 1807 derivative records from 53509 primary records. [2025-09-25T22:29:32.459449] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-25T22:29:32.483795] [DEBUG] [MAIN ] XFLT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:32.489287] [INFO ] [MAIN ] XFLT: Generated 1807 derivative records from 30152 primary records. [2025-09-25T22:29:32.492402] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-25T22:29:32.492544] [DEBUG] [LOCAL ] WY: Derivative data saved (1807 records). [2025-09-25T22:29:32.493575] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-25T22:29:32.496598] [INFO ] [MAIN ] Derivative Progress: 2009/2043 symbols completed. WY took 1.3s. Estimated remaining: 14.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:32.512283] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1807 records). [2025-09-25T22:29:32.512379] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-25T22:29:32.515987] [INFO ] [MAIN ] Derivative Progress: 2010/2043 symbols completed. XFLT took 1.2s. Estimated remaining: 13.8s. Rate: 143.0 symbols/min [2025-09-25T22:29:32.517164] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:32.517276] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:32.517742] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:32.574347] [DEBUG] [LOCAL ] XHR: Loaded 44450 existing records from primary storage. [2025-09-25T22:29:32.574696] [INFO ] [MAIN ] XHR: Loaded 44450 primary data records. [2025-09-25T22:29:32.690910] [DEBUG] [LOCAL ] XPER: Loaded 29865 existing records from primary storage. [2025-09-25T22:29:32.696497] [INFO ] [MAIN ] XPER: Loaded 29865 primary data records. [2025-09-25T22:29:32.850172] [DEBUG] [LOCAL ] XOM: Loaded 54183 existing records from primary storage. [2025-09-25T22:29:32.899867] [INFO ] [MAIN ] XOM: Loaded 54183 primary data records. [2025-09-25T22:29:33.735410] [DEBUG] [MAIN ] XHR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:33.739172] [INFO ] [MAIN ] XHR: Generated 1807 derivative records from 44450 primary records. [2025-09-25T22:29:33.741484] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-25T22:29:33.773354] [DEBUG] [LOCAL ] XHR: Derivative data saved (1807 records). [2025-09-25T22:29:33.773790] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-25T22:29:33.776901] [INFO ] [MAIN ] Derivative Progress: 2011/2043 symbols completed. XHR took 1.3s. Estimated remaining: 13.4s. Rate: 142.8 symbols/min [2025-09-25T22:29:33.774200] [DEBUG] [MAIN ] XPER: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:33.778365] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:33.778287] [INFO ] [MAIN ] XPER: Generated 1807 derivative records from 29865 primary records. [2025-09-25T22:29:33.778853] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-25T22:29:33.801046] [DEBUG] [LOCAL ] XPER: Derivative data saved (1807 records). [2025-09-25T22:29:33.801275] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-25T22:29:33.804945] [INFO ] [MAIN ] Derivative Progress: 2012/2043 symbols completed. XPER took 1.3s. Estimated remaining: 13.0s. Rate: 142.9 symbols/min [2025-09-25T22:29:33.813354] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:33.819862] [DEBUG] [MAIN ] XOM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:33.821305] [INFO ] [MAIN ] XOM: Generated 1807 derivative records from 54183 primary records. [2025-09-25T22:29:33.821684] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-25T22:29:33.842241] [DEBUG] [LOCAL ] XOM: Derivative data saved (1807 records). [2025-09-25T22:29:33.842661] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-25T22:29:33.846719] [INFO ] [MAIN ] Derivative Progress: 2013/2043 symbols completed. XOM took 1.3s. Estimated remaining: 12.6s. Rate: 143.0 symbols/min [2025-09-25T22:29:33.847113] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:33.900711] [DEBUG] [LOCAL ] XPEV: Loaded 54029 existing records from primary storage. [2025-09-25T22:29:33.901595] [INFO ] [MAIN ] XPEV: Loaded 54029 primary data records. [2025-09-25T22:29:34.015942] [DEBUG] [LOCAL ] XPOF: Loaded 39074 existing records from primary storage. [2025-09-25T22:29:34.034440] [INFO ] [MAIN ] XPOF: Loaded 39074 primary data records. [2025-09-25T22:29:34.337825] [DEBUG] [LOCAL ] XPRO: Loaded 46275 existing records from primary storage. [2025-09-25T22:29:34.356882] [INFO ] [MAIN ] XPRO: Loaded 46275 primary data records. [2025-09-25T22:29:35.007484] [DEBUG] [MAIN ] XPEV: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:35.009975] [INFO ] [MAIN ] XPEV: Generated 1807 derivative records from 54029 primary records. [2025-09-25T22:29:35.010571] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-25T22:29:35.031271] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1807 records). [2025-09-25T22:29:35.032471] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-25T22:29:35.036277] [INFO ] [MAIN ] Derivative Progress: 2014/2043 symbols completed. XPEV took 1.3s. Estimated remaining: 12.2s. Rate: 142.8 symbols/min [2025-09-25T22:29:35.037379] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:35.056386] [DEBUG] [MAIN ] XPOF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:35.058676] [INFO ] [MAIN ] XPOF: Generated 1807 derivative records from 39074 primary records. [2025-09-25T22:29:35.059143] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-25T22:29:35.091823] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1807 records). [2025-09-25T22:29:35.093212] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-25T22:29:35.096996] [INFO ] [MAIN ] Derivative Progress: 2015/2043 symbols completed. XPOF took 1.3s. Estimated remaining: 11.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:35.107680] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:35.122046] [DEBUG] [MAIN ] XPRO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:35.123206] [DEBUG] [LOCAL ] XYF: Loaded 28337 existing records from primary storage. [2025-09-25T22:29:35.124510] [INFO ] [MAIN ] XPRO: Generated 1807 derivative records from 46275 primary records. [2025-09-25T22:29:35.124788] [INFO ] [MAIN ] XYF: Loaded 28337 primary data records. [2025-09-25T22:29:35.125079] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-25T22:29:35.305282] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1807 records). [2025-09-25T22:29:35.305535] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-25T22:29:35.332846] [INFO ] [MAIN ] Derivative Progress: 2016/2043 symbols completed. XPRO took 1.5s. Estimated remaining: 11.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:35.354097] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:35.533560] [DEBUG] [LOCAL ] XYL: Loaded 48470 existing records from primary storage. [2025-09-25T22:29:35.534975] [INFO ] [MAIN ] XYL: Loaded 48470 primary data records. [2025-09-25T22:29:35.717256] [DEBUG] [LOCAL ] YALA: Loaded 37777 existing records from primary storage. [2025-09-25T22:29:35.755761] [INFO ] [MAIN ] YALA: Loaded 37777 primary data records. [2025-09-25T22:29:36.316059] [DEBUG] [MAIN ] XYF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:36.336791] [INFO ] [MAIN ] XYF: Generated 1807 derivative records from 28337 primary records. [2025-09-25T22:29:36.338169] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-25T22:29:36.365549] [DEBUG] [LOCAL ] XYF: Derivative data saved (1807 records). [2025-09-25T22:29:36.366930] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-25T22:29:36.370244] [INFO ] [MAIN ] Derivative Progress: 2017/2043 symbols completed. XYF took 1.3s. Estimated remaining: 10.9s. Rate: 142.8 symbols/min [2025-09-25T22:29:36.370726] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:36.396502] [DEBUG] [MAIN ] XYL: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:36.398120] [INFO ] [MAIN ] XYL: Generated 1807 derivative records from 48470 primary records. [2025-09-25T22:29:36.398703] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-25T22:29:36.434722] [DEBUG] [LOCAL ] XYL: Derivative data saved (1807 records). [2025-09-25T22:29:36.448624] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-25T22:29:36.453244] [INFO ] [MAIN ] Derivative Progress: 2018/2043 symbols completed. XYL took 1.4s. Estimated remaining: 10.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:36.469451] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:36.469129] [DEBUG] [MAIN ] YALA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:36.471674] [INFO ] [MAIN ] YALA: Generated 1807 derivative records from 37777 primary records. [2025-09-25T22:29:36.471830] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-25T22:29:36.508128] [DEBUG] [LOCAL ] YALA: Derivative data saved (1807 records). [2025-09-25T22:29:36.508566] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-25T22:29:36.512127] [INFO ] [MAIN ] Derivative Progress: 2019/2043 symbols completed. YALA took 1.2s. Estimated remaining: 10.1s. Rate: 142.9 symbols/min [2025-09-25T22:29:36.512722] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:36.514794] [DEBUG] [LOCAL ] YELP: Loaded 45619 existing records from primary storage. [2025-09-25T22:29:36.515795] [INFO ] [MAIN ] YELP: Loaded 45619 primary data records. [2025-09-25T22:29:36.816152] [DEBUG] [LOCAL ] YETI: Loaded 52840 existing records from primary storage. [2025-09-25T22:29:36.938345] [DEBUG] [LOCAL ] YEXT: Loaded 43579 existing records from primary storage. [2025-09-25T22:29:36.938563] [INFO ] [MAIN ] YEXT: Loaded 43579 primary data records. [2025-09-25T22:29:36.937429] [INFO ] [MAIN ] YETI: Loaded 52840 primary data records. [2025-09-25T22:29:37.652095] [DEBUG] [MAIN ] YELP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:37.655915] [INFO ] [MAIN ] YELP: Generated 1807 derivative records from 45619 primary records. [2025-09-25T22:29:37.657691] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-25T22:29:37.686151] [DEBUG] [LOCAL ] YELP: Derivative data saved (1807 records). [2025-09-25T22:29:37.686755] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-25T22:29:37.689725] [INFO ] [MAIN ] Derivative Progress: 2020/2043 symbols completed. YELP took 1.3s. Estimated remaining: 9.7s. Rate: 142.8 symbols/min [2025-09-25T22:29:37.690677] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:37.713707] [DEBUG] [MAIN ] YETI: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:37.714987] [INFO ] [MAIN ] YETI: Generated 1807 derivative records from 52840 primary records. [2025-09-25T22:29:37.727904] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-25T22:29:37.730484] [DEBUG] [MAIN ] YEXT: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:37.739305] [INFO ] [MAIN ] YEXT: Generated 1807 derivative records from 43579 primary records. [2025-09-25T22:29:37.740864] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-25T22:29:37.762935] [DEBUG] [LOCAL ] YETI: Derivative data saved (1807 records). [2025-09-25T22:29:37.764892] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-25T22:29:37.765962] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1807 records). [2025-09-25T22:29:37.769659] [INFO ] [MAIN ] Derivative Progress: 2021/2043 symbols completed. YETI took 1.3s. Estimated remaining: 9.2s. Rate: 142.9 symbols/min [2025-09-25T22:29:37.785898] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-25T22:29:37.789898] [INFO ] [MAIN ] Derivative Progress: 2022/2043 symbols completed. YEXT took 1.3s. Estimated remaining: 8.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:37.790590] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:37.790342] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:37.814987] [DEBUG] [LOCAL ] YMM: Loaded 53043 existing records from primary storage. [2025-09-25T22:29:37.815342] [INFO ] [MAIN ] YMM: Loaded 53043 primary data records. [2025-09-25T22:29:38.248520] [DEBUG] [LOCAL ] YPF: Loaded 50878 existing records from primary storage. [2025-09-25T22:29:38.248933] [INFO ] [MAIN ] YPF: Loaded 50878 primary data records. [2025-09-25T22:29:38.359698] [DEBUG] [LOCAL ] YOU: Loaded 50190 existing records from primary storage. [2025-09-25T22:29:38.381276] [INFO ] [MAIN ] YOU: Loaded 50190 primary data records. [2025-09-25T22:29:38.966087] [DEBUG] [MAIN ] YMM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:38.969760] [INFO ] [MAIN ] YMM: Generated 1807 derivative records from 53043 primary records. [2025-09-25T22:29:38.971040] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-25T22:29:39.000070] [DEBUG] [LOCAL ] YMM: Derivative data saved (1807 records). [2025-09-25T22:29:39.000606] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-25T22:29:39.007504] [INFO ] [MAIN ] Derivative Progress: 2023/2043 symbols completed. YMM took 1.3s. Estimated remaining: 8.4s. Rate: 142.8 symbols/min [2025-09-25T22:29:39.024548] [DEBUG] [MAIN ] YPF: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:39.025887] [INFO ] [MAIN ] YPF: Generated 1807 derivative records from 50878 primary records. [2025-09-25T22:29:39.025975] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-25T22:29:39.060425] [DEBUG] [MAIN ] YOU: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:39.062305] [INFO ] [MAIN ] YOU: Generated 1807 derivative records from 50190 primary records. [2025-09-25T22:29:39.062682] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-25T22:29:39.063059] [DEBUG] [LOCAL ] YPF: Derivative data saved (1807 records). [2025-09-25T22:29:39.064195] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-25T22:29:39.067088] [INFO ] [MAIN ] Derivative Progress: 2024/2043 symbols completed. YPF took 1.3s. Estimated remaining: 8.0s. Rate: 142.8 symbols/min [2025-09-25T22:29:39.082969] [DEBUG] [LOCAL ] YOU: Derivative data saved (1807 records). [2025-09-25T22:29:39.083097] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-25T22:29:39.086548] [INFO ] [MAIN ] Derivative Progress: 2025/2043 symbols completed. YOU took 1.3s. Estimated remaining: 7.6s. Rate: 142.9 symbols/min [2025-09-25T22:29:39.087621] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:39.087540] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:39.089105] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:39.105393] [DEBUG] [LOCAL ] YRD: Loaded 12668 existing records from primary storage. [2025-09-25T22:29:39.105614] [INFO ] [MAIN ] YRD: Loaded 12668 primary data records. [2025-09-25T22:29:39.438833] [DEBUG] [LOCAL ] YSG: Loaded 25342 existing records from primary storage. [2025-09-25T22:29:39.452766] [INFO ] [MAIN ] YSG: Loaded 25342 primary data records. [2025-09-25T22:29:39.585092] [DEBUG] [LOCAL ] YUM: Loaded 51593 existing records from primary storage. [2025-09-25T22:29:39.601278] [INFO ] [MAIN ] YUM: Loaded 51593 primary data records. [2025-09-25T22:29:40.150572] [DEBUG] [MAIN ] YRD: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:40.151702] [INFO ] [MAIN ] YRD: Generated 1807 derivative records from 12668 primary records. [2025-09-25T22:29:40.153668] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-25T22:29:40.176263] [DEBUG] [LOCAL ] YRD: Derivative data saved (1807 records). [2025-09-25T22:29:40.178230] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-25T22:29:40.181818] [INFO ] [MAIN ] Derivative Progress: 2026/2043 symbols completed. YRD took 1.1s. Estimated remaining: 7.1s. Rate: 142.8 symbols/min [2025-09-25T22:29:40.183257] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:40.204778] [DEBUG] [MAIN ] YSG: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:40.206036] [INFO ] [MAIN ] YSG: Generated 1807 derivative records from 25342 primary records. [2025-09-25T22:29:40.206261] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-25T22:29:40.239347] [DEBUG] [MAIN ] YUM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:40.241013] [INFO ] [MAIN ] YUM: Generated 1807 derivative records from 51593 primary records. [2025-09-25T22:29:40.241135] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-25T22:29:40.256779] [DEBUG] [LOCAL ] YSG: Derivative data saved (1807 records). [2025-09-25T22:29:40.259078] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-25T22:29:40.261906] [INFO ] [MAIN ] Derivative Progress: 2027/2043 symbols completed. YSG took 1.2s. Estimated remaining: 6.7s. Rate: 142.9 symbols/min [2025-09-25T22:29:40.262748] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:40.265038] [DEBUG] [LOCAL ] YUM: Derivative data saved (1807 records). [2025-09-25T22:29:40.265266] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-25T22:29:40.269310] [INFO ] [MAIN ] Derivative Progress: 2028/2043 symbols completed. YUM took 1.2s. Estimated remaining: 6.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:40.269732] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:40.310389] [DEBUG] [LOCAL ] ZEPP: Loaded 17114 existing records from primary storage. [2025-09-25T22:29:40.310580] [INFO ] [MAIN ] ZEPP: Loaded 17114 primary data records. [2025-09-25T22:29:40.441058] [DEBUG] [LOCAL ] YUMC: Loaded 53072 existing records from primary storage. [2025-09-25T22:29:40.445362] [INFO ] [MAIN ] YUMC: Loaded 53072 primary data records. [2025-09-25T22:29:40.828838] [DEBUG] [LOCAL ] ZBH: Loaded 51599 existing records from primary storage. [2025-09-25T22:29:40.840031] [INFO ] [MAIN ] ZBH: Loaded 51599 primary data records. [2025-09-25T22:29:41.470811] [DEBUG] [MAIN ] ZEPP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:41.476441] [INFO ] [MAIN ] ZEPP: Generated 1807 derivative records from 17114 primary records. [2025-09-25T22:29:41.478077] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-25T22:29:41.495392] [DEBUG] [MAIN ] YUMC: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:41.503983] [INFO ] [MAIN ] YUMC: Generated 1807 derivative records from 53072 primary records. [2025-09-25T22:29:41.504408] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-25T22:29:41.536511] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1807 records). [2025-09-25T22:29:41.536823] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-25T22:29:41.540078] [INFO ] [MAIN ] Derivative Progress: 2029/2043 symbols completed. YUMC took 1.4s. Estimated remaining: 5.9s. Rate: 142.8 symbols/min [2025-09-25T22:29:41.540984] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:41.555419] [DEBUG] [MAIN ] ZBH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:41.556442] [INFO ] [MAIN ] ZBH: Generated 1807 derivative records from 51599 primary records. [2025-09-25T22:29:41.549978] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1807 records). [2025-09-25T22:29:41.556924] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-25T22:29:41.562550] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-25T22:29:41.562413] [INFO ] [MAIN ] Derivative Progress: 2030/2043 symbols completed. ZEPP took 1.3s. Estimated remaining: 5.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:41.564123] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:41.583475] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1807 records). [2025-09-25T22:29:41.583609] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-25T22:29:41.588464] [INFO ] [MAIN ] Derivative Progress: 2031/2043 symbols completed. ZBH took 1.3s. Estimated remaining: 5.0s. Rate: 142.9 symbols/min [2025-09-25T22:29:41.589176] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:41.623954] [DEBUG] [LOCAL ] ZH: Loaded 27089 existing records from primary storage. [2025-09-25T22:29:41.624290] [INFO ] [MAIN ] ZH: Loaded 27089 primary data records. [2025-09-25T22:29:41.790810] [DEBUG] [LOCAL ] ZGN: Loaded 41076 existing records from primary storage. [2025-09-25T22:29:41.816911] [INFO ] [MAIN ] ZGN: Loaded 41076 primary data records. [2025-09-25T22:29:41.870516] [DEBUG] [LOCAL ] ZETA: Loaded 53985 existing records from primary storage. [2025-09-25T22:29:41.914398] [INFO ] [MAIN ] ZETA: Loaded 53985 primary data records. [2025-09-25T22:29:42.748697] [DEBUG] [MAIN ] ZH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:42.750293] [INFO ] [MAIN ] ZH: Generated 1807 derivative records from 27089 primary records. [2025-09-25T22:29:42.750823] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-25T22:29:42.783039] [DEBUG] [LOCAL ] ZH: Derivative data saved (1807 records). [2025-09-25T22:29:42.788719] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-25T22:29:42.789054] [DEBUG] [MAIN ] ZGN: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:42.792044] [INFO ] [MAIN ] Derivative Progress: 2032/2043 symbols completed. ZH took 1.2s. Estimated remaining: 4.6s. Rate: 142.8 symbols/min [2025-09-25T22:29:42.807480] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:42.807911] [DEBUG] [MAIN ] ZETA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:42.807239] [INFO ] [MAIN ] ZGN: Generated 1807 derivative records from 41076 primary records. [2025-09-25T22:29:42.808837] [INFO ] [MAIN ] ZETA: Generated 1807 derivative records from 53985 primary records. [2025-09-25T22:29:42.809148] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-25T22:29:42.809285] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-25T22:29:42.844126] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1807 records). [2025-09-25T22:29:42.844542] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-25T22:29:42.848821] [INFO ] [MAIN ] Derivative Progress: 2033/2043 symbols completed. ZETA took 1.3s. Estimated remaining: 4.2s. Rate: 142.8 symbols/min [2025-09-25T22:29:42.849590] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:42.852622] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1807 records). [2025-09-25T22:29:42.852866] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-25T22:29:42.855591] [INFO ] [MAIN ] Derivative Progress: 2034/2043 symbols completed. ZGN took 1.3s. Estimated remaining: 3.8s. Rate: 142.9 symbols/min [2025-09-25T22:29:42.856038] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:42.924724] [DEBUG] [LOCAL ] ZIM: Loaded 53915 existing records from primary storage. [2025-09-25T22:29:42.938436] [INFO ] [MAIN ] ZIM: Loaded 53915 primary data records. [2025-09-25T22:29:42.950067] [DEBUG] [LOCAL ] ZK: Loaded 40293 existing records from primary storage. [2025-09-25T22:29:42.982827] [INFO ] [MAIN ] ZK: Loaded 40293 primary data records. [2025-09-25T22:29:43.145953] [DEBUG] [LOCAL ] ZIP: Loaded 44679 existing records from primary storage. [2025-09-25T22:29:43.164334] [INFO ] [MAIN ] ZIP: Loaded 44679 primary data records. [2025-09-25T22:29:43.970518] [DEBUG] [MAIN ] ZIM: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:43.986863] [INFO ] [MAIN ] ZIM: Generated 1807 derivative records from 53915 primary records. [2025-09-25T22:29:43.987508] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-25T22:29:43.987388] [DEBUG] [MAIN ] ZK: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:43.990457] [INFO ] [MAIN ] ZK: Generated 1807 derivative records from 40293 primary records. [2025-09-25T22:29:43.998596] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-25T22:29:44.021593] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1807 records). [2025-09-25T22:29:44.022692] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-25T22:29:44.026313] [INFO ] [MAIN ] Derivative Progress: 2035/2043 symbols completed. ZIM took 1.2s. Estimated remaining: 3.4s. Rate: 142.8 symbols/min [2025-09-25T22:29:44.027237] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:44.043264] [DEBUG] [LOCAL ] ZK: Derivative data saved (1807 records). [2025-09-25T22:29:44.046412] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-25T22:29:44.057275] [INFO ] [MAIN ] Derivative Progress: 2036/2043 symbols completed. ZK took 1.2s. Estimated remaining: 2.9s. Rate: 142.9 symbols/min [2025-09-25T22:29:44.058802] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:44.058677] [DEBUG] [MAIN ] ZIP: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:44.065722] [INFO ] [MAIN ] ZIP: Generated 1807 derivative records from 44679 primary records. [2025-09-25T22:29:44.066403] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-25T22:29:44.066299] [DEBUG] [LOCAL ] ZKH: Loaded 8074 existing records from primary storage. [2025-09-25T22:29:44.067894] [INFO ] [MAIN ] ZKH: Loaded 8074 primary data records. [2025-09-25T22:29:44.191493] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1807 records). [2025-09-25T22:29:44.197785] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-25T22:29:44.224054] [INFO ] [MAIN ] Derivative Progress: 2037/2043 symbols completed. ZIP took 1.4s. Estimated remaining: 2.5s. Rate: 142.9 symbols/min [2025-09-25T22:29:44.270238] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:44.431839] [DEBUG] [LOCAL ] ZTO: Loaded 50367 existing records from primary storage. [2025-09-25T22:29:44.433129] [INFO ] [MAIN ] ZTO: Loaded 50367 primary data records. [2025-09-25T22:29:44.536547] [DEBUG] [LOCAL ] ZTR: Loaded 16787 existing records from primary storage. [2025-09-25T22:29:44.560491] [INFO ] [MAIN ] ZTR: Loaded 16787 primary data records. [2025-09-25T22:29:45.112075] [DEBUG] [MAIN ] ZKH: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:45.220523] [INFO ] [MAIN ] ZKH: Generated 1807 derivative records from 8074 primary records. [2025-09-25T22:29:45.236748] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-25T22:29:45.261819] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1807 records). [2025-09-25T22:29:45.264014] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-25T22:29:45.268360] [INFO ] [MAIN ] Derivative Progress: 2038/2043 symbols completed. ZKH took 1.2s. Estimated remaining: 2.1s. Rate: 142.8 symbols/min [2025-09-25T22:29:45.285336] [DEBUG] [MAIN ] ZTO: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:45.286268] [INFO ] [MAIN ] ZTO: Generated 1807 derivative records from 50367 primary records. [2025-09-25T22:29:45.286392] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-25T22:29:45.304919] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1807 records). [2025-09-25T22:29:45.305158] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-25T22:29:45.308565] [INFO ] [MAIN ] Derivative Progress: 2039/2043 symbols completed. ZTO took 1.3s. Estimated remaining: 1.7s. Rate: 142.9 symbols/min [2025-09-25T22:29:45.324467] [DEBUG] [MAIN ] ZTR: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:45.325229] [INFO ] [MAIN ] ZTR: Generated 1807 derivative records from 16787 primary records. [2025-09-25T22:29:45.325295] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-25T22:29:45.341122] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1807 records). [2025-09-25T22:29:45.341185] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-25T22:29:45.344793] [INFO ] [MAIN ] Derivative Progress: 2040/2043 symbols completed. ZTR took 1.1s. Estimated remaining: 1.3s. Rate: 142.9 symbols/min [2025-09-25T22:29:45.345934] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:45.346267] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:45.346093] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-25T22:29:45.401887] [DEBUG] [LOCAL ] ZVIA: Loaded 35664 existing records from primary storage. [2025-09-25T22:29:45.402249] [INFO ] [MAIN ] ZVIA: Loaded 35664 primary data records. [2025-09-25T22:29:45.547883] [DEBUG] [LOCAL ] ZWS: Loaded 42806 existing records from primary storage. [2025-09-25T22:29:45.559930] [INFO ] [MAIN ] ZWS: Loaded 42806 primary data records. [2025-09-25T22:29:45.667762] [DEBUG] [LOCAL ] ZTS: Loaded 53392 existing records from primary storage. [2025-09-25T22:29:45.701929] [INFO ] [MAIN ] ZTS: Loaded 53392 primary data records. [2025-09-25T22:29:46.472491] [DEBUG] [MAIN ] ZVIA: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:46.476425] [INFO ] [MAIN ] ZVIA: Generated 1807 derivative records from 35664 primary records. [2025-09-25T22:29:46.477700] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-25T22:29:46.500151] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1807 records). [2025-09-25T22:29:46.501480] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-25T22:29:46.504529] [INFO ] [MAIN ] Derivative Progress: 2041/2043 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.8s. Rate: 142.8 symbols/min [2025-09-25T22:29:46.522759] [DEBUG] [MAIN ] ZWS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:46.525674] [INFO ] [MAIN ] ZWS: Generated 1807 derivative records from 42806 primary records. [2025-09-25T22:29:46.526994] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-25T22:29:46.554046] [DEBUG] [MAIN ] ZTS: Filtered 6966 bins outside market hours, 7759 incomplete bins [2025-09-25T22:29:46.555942] [INFO ] [MAIN ] ZTS: Generated 1807 derivative records from 53392 primary records. [2025-09-25T22:29:46.556293] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-25T22:29:46.560771] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1807 records). [2025-09-25T22:29:46.572888] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-25T22:29:46.578068] [INFO ] [MAIN ] Derivative Progress: 2042/2043 symbols completed. ZWS took 1.2s. Estimated remaining: 0.4s. Rate: 142.9 symbols/min [2025-09-25T22:29:46.580840] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1807 records). [2025-09-25T22:29:46.580927] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-25T22:29:46.585202] [INFO ] [MAIN ] Derivative Progress: 2043/2043 symbols completed. ZTS took 1.2s. Estimated remaining: 0.0s. Rate: 142.9 symbols/min [2025-09-25T22:29:46.586801] [INFO ] [MAIN ] Parallel derivative generation completed in 14m 18s [2025-09-25T22:29:46.587096] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2043/2043 symbols) [2025-09-25T22:29:47.586567] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2043/2043 @ 100.00%)' [2025-09-25T22:29:47.587937] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-25T22:29:47.588200] [INFO ] [STATE ] Last completion updated: 2025-09-25T22:29:47.588042